Skip to content

Pull requests: lightseekorg/smg

New pull request New
27 Open 1,517 Closed
27 Open 1,517 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat(multimodal): configurable tensor transport + vLLM SHM and video documentation Improvements or additions to documentation grpc gRPC client and router changes model-gateway Model gateway crate changes protocols Protocols crate changes tests Test changes
#1818 opened Jun 22, 2026 by slin1237 Collaborator Loading…
3 tasks done
12
feat(tool_parser,reasoning_parser): add Step-3.5 tool and reasoning parsers reasoning-parser Reasoning parser changes tests Test changes tool-parser Tool/function call parser changes
#1817 opened Jun 22, 2026 by slin1237 Collaborator Loading…
2 of 3 tasks
6
feat(reasoning_parser): add Mistral/Magistral reasoning parser reasoning-parser Reasoning parser changes
#1816 opened Jun 22, 2026 by slin1237 Collaborator Loading…
2 of 3 tasks
7
feat(tool_parser,reasoning_parser): add MiniMax-M3 tool and reasoning parsers reasoning-parser Reasoning parser changes tests Test changes tool-parser Tool/function call parser changes
#1815 opened Jun 22, 2026 by slin1237 Collaborator Loading…
2 of 3 tasks
10
[blocked] chore(deps): bincode 1.3->3.0 (smg-mesh) — 3.0.0 is a tombstone compile_error release dependencies Dependency updates mesh Mesh crate changes
#1802 opened Jun 22, 2026 by slin1237 Collaborator • Draft
4
Discover local HTTP model ids from /v1/models model-gateway Model gateway crate changes openai OpenAI router changes
#1793 opened Jun 19, 2026 by SpencerGarnets Loading…
12
perf(least_load): sub-linear selection via power-of-two-choices enhancement New feature or request model-gateway Model gateway crate changes priority:high High priority
#1787 opened Jun 18, 2026 by slin1237 Collaborator Loading…
10
feat(grpc-servicer): add Prometheus /metrics sidecar dependencies Dependency updates enhancement New feature or request grpc gRPC client and router changes metrics-consolidation Epic: Engine Metrics Consolidation & PD Observability tests Test changes
#1782 opened Jun 18, 2026 by slin1237 Collaborator Loading…
1
26
fix(observability): include gRPC workers in GET /engine_metrics enhancement New feature or request grpc gRPC client and router changes metrics-consolidation Epic: Engine Metrics Consolidation & PD Observability model-gateway Model gateway crate changes tests Test changes
#1779 opened Jun 18, 2026 by slin1237 Collaborator Loading…
1
26
[gateway] WebSocket transport for the Responses API — up to 45% lower TTFT, 22–48% lower ITL p99 tail, 17–21% less gateway CPU dependencies Dependency updates documentation Improvements or additions to documentation grpc gRPC client and router changes model-gateway Model gateway crate changes tests Test changes
#1770 opened Jun 18, 2026 by Venkat2811 Loading…
5 tasks done
78
feat(smg): worker-sync observability — drops, spec fallback, refused tombstones, drift mesh Mesh crate changes model-gateway Model gateway crate changes
#1716 opened Jun 13, 2026 by CatherineSue Member Loading…
2 of 4 tasks
22
feat(smg): cluster-wide rate limiting via epoch-windowed mesh counters mesh Mesh crate changes model-gateway Model gateway crate changes
#1715 opened Jun 13, 2026 by CatherineSue Member Loading…
2 of 4 tasks
28
[WIP] EPD routing: pixel lanes (NIXL/SHM), servicer hardening, gateway data-plane perf dependencies Dependency updates grpc gRPC client and router changes model-gateway Model gateway crate changes multimodal Multimodal crate changes protocols Protocols crate changes
#1703 opened Jun 12, 2026 by chenht2022 Contributor • Draft
8
refactor(service-discovery): migrate k8s watcher to informer (reflector + Store) model-gateway Model gateway crate changes python-bindings Python bindings changes
#1688 opened Jun 11, 2026 by key4ng Collaborator Loading…
3 of 4 tasks
10
feat(mesh): causally-stable tombstone GC driven by per-peer ack watermarks mesh Mesh crate changes tests Test changes
#1686 opened Jun 11, 2026 by CatherineSue Member Loading…
2 of 4 tasks
15
fix(model_gateway): reclaim per-worker mutation lock for absent worker ids model-gateway Model gateway crate changes
#1684 opened Jun 11, 2026 by slin1237 Collaborator Loading…
2 of 4 tasks
7
fix(reasoning-parser): hold back split think_end_token across streaming chunks reasoning-parser Reasoning parser changes
#1678 opened Jun 11, 2026 by slin1237 Collaborator Loading…
2 of 4 tasks
5
feat(mesh): dead-node key cleanup — replica attribution, membership removal, sweep mesh Mesh crate changes model-gateway Model gateway crate changes tests Test changes
#1674 opened Jun 11, 2026 by CatherineSue Member Loading…
2 of 4 tasks
40
feat(smg): deterministic worker ids — restart-stable mesh keys dependencies Dependency updates model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved python-bindings Python bindings changes
#1668 opened Jun 11, 2026 by CatherineSue Member Loading…
2 of 4 tasks
22
fix(tokenizer): drain consumed tokens in DecodeStream to bound memory documentation Improvements or additions to documentation tokenizer Tokenizer related changes
#1638 opened Jun 10, 2026 by slin1237 Collaborator Loading…
3 of 4 tasks
3
refactor(reasoning-parser): rename Glm45Parser to GlmParser with catch-all "glm" pattern documentation Improvements or additions to documentation needs-rebase PR has merge conflicts that need to be resolved reasoning-parser Reasoning parser changes
#1566 opened May 28, 2026 by 1195343015 Contributor Loading…
4 tasks
10
fix(api): reject schemeless worker URLs in POST /workers model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved
#1532 opened May 24, 2026 by CatherineSue Member Loading…
2 of 4 tasks
6
feat(mlx-grpc): String stop sequence support for MLX on all 6 pipeline/path combinations grpc gRPC client and router changes model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved protocols Protocols crate changes tokenizer Tokenizer related changes
#1524 opened May 23, 2026 by zach-li-sudo Contributor Loading…
2 of 4 tasks
10
refactor(workflow): cleanup pass on the wfaas crate model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved tests Test changes workflow Workflow crate changes
#1500 opened May 15, 2026 by slin1237 Collaborator Loading…
4 tasks done
11
fix(mcp): evict pooled connections when tool discovery fails mcp MCP related changes needs-rebase PR has merge conflicts that need to be resolved
#1499 opened May 15, 2026 by MohanKumar21 Contributor Loading…
3 of 4 tasks
27
ProTip! Filter pull requests by the default branch with base:main.