Pinned Loading

1. sglang sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 24.6k 4.8k

2. sgl-learning-materials sgl-learning-materials Public

   Materials for learning SGLang

   775 60

3. ome ome Public

   Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

   Go 396 64

4. genai-bench genai-bench Public

   A Rust reimplementation of genai-bench for benchmarking LLM serving systems at high concurrency with accurate timing and industry-standard metrics

   Python 277 49

5. SpecForge SpecForge Public

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python 730 181

6. sglang-jax sglang-jax Public

   JAX backend for SGL

   Python 250 76