Update dsv4 B200 SGLang launch: DeepEP + EAGLE speculative decoding#1138

Closed

yhyang201 wants to merge 12 commits into

SemiAnalysisAI:mainfrom

yhyang201:dsv4-sglang-deepep-eagle

Commits on Apr 24, 2026

Add dsv4-fp4-b200-sglang single-node config

cquil11
and
claude
committed
Switch dsv4-fp4-b200-sglang to Pro model, match vllm parallelism

cquil11
and
claude
committed
Match DSV4 Pro SGLang recipe literally; port HF cache path

cquil11
and
claude
committed
fix: use 'sglang serve' CLI, not python -m sglang.launch_server

cquil11
and
claude
committed
fix: mount repo at /ix for deepseek-v4-blackwell image

cquil11
and
claude
committed
fix: reinstall sglang from PyPI to work around masked editable install

cquil11
and
claude
committed
fix: uninstall editable sglang before reinstalling from PyPI

cquil11
and
claude
committed
fix: mount repo at /ix for deepseek-v4-blackwell; drop pip workaround

cquil11
and
claude
committed
fix: unset baked-in CUDA_VISIBLE_DEVICES for deepseek-v4-blackwell image

cquil11
and
claude
committed
fix: apply same /ix mount fix to launch_b200-nb.sh

cquil11
and
claude
committed
Drop --container-name arg from launch_b200-nb.sh

cquil11
and
claude
committed
Update dsv4 B200 SGLang launch to use DeepEP + EAGLE speculative decoding

yhyang201
and
claude
committed