Popular repositories Loading

1. vllm-fork vllm-fork Public

   Forked from HabanaAI/vllm-fork

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 4 2

2. vllm-xpu-breakdown vllm-xpu-breakdown Public

   Profile and visualize vLLM inference op dispatch on Intel XPU — supports 65+ models across LLM, VL, diffusion, audio, and embedding architectures

   Python 2 1

3. vllm-hpu-extension vllm-hpu-extension Public

   Forked from HabanaAI/vllm-hpu-extension

   Python 1

4. vllm-gaudi vllm-gaudi Public

   Forked from vllm-project/vllm-gaudi

   Community maintained hardware plugin for vLLM on Intel Gaudi

   Python 1

5. MXNet2Caffe MXNet2Caffe Public

   Forked from GarrickLin/MXNet2Caffe

   Convert MXNet model to Caffe model

   Python

6. TensorRT TensorRT Public

   Forked from NVIDIA/TensorRT

   TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

   C++