You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Feature]: Support DeepSeek-V3 with PyTorch-based graph construction on Ascend NPU #2407
Implement DeepSeek-V3 using xLLM's PyTorch model execution path on Ascend NPU, reusing the existing runtime and graph infrastructure to simplify model development and optimization.
Expected support:
Register deepseek_v3 for --model_impl=python, adapting the existing DeepSeek-V3.2 configuration and W8A8 checkpoint loader.
Use dense MLA with index_topk=0, reusing YaRN RoPE and MLA preprocessing without requiring indexer weights.
Activity