Skip to content

feat: add ds_load_balance P/D routing with Mooncake prefix hints. - #96

Draft
PixelFlat wants to merge 2 commits into
xLLM-AI:mainfrom
PixelFlat:codex/prefill-time-load-balance
Draft

PixelFlat wants to merge 2 commits into
xLLM-AI:mainfrom
PixelFlat:codex/prefill-time-load-balance

Commits

  1. Commits on Oct 23, 2026