Skip to content

stream:true not enabled in model server #2099

New issue
New issue
Closed
#2130
Closed
stream:true not enabled in model server#2099
#2130
Assignees
AWarno

Description

@ritaneves
ritaneves
opened on Jul 21, 2026

stream:true is not enabled in model server

some benchmarks are implemented bypassing model server because of this: e.g. Pinchbench, and this may be a blocker for model server usage for future benchmarks

Activity

  1. ritaneves
    assigned
    init-nikhil
    on Jul 21, 2026
  2. ritaneves
    added a parent issue on Jul 21, 2026
  3. ritaneves
    added this to NeMo Gym 0.5.0 - Aug 5on Jul 21, 2026
  4. github-project-automation
    moved this to Label Sync in NeMo Gym 0.5.0 - Aug 5on Jul 21, 2026
  5. github-project-automation
    moved this from Label Sync to Dev WIP in NeMo Gym 0.5.0 - Aug 5on Jul 23, 2026
  6. linear-code
    assigned
    AWarno
    and unassigned
    init-nikhil
    on Jul 27, 2026

  7. linear-code commented on Jul 27, 2026

    @linear-code
    linear-codeBot
    on Jul 27, 2026 – with Linear Code

    from rita:

    @AWarno could you please update?

  8. linear-code commented on Jul 27, 2026

    @linear-code
    linear-codeBot
    on Jul 27, 2026 – with Linear Code

    from awarno:

    the mr was created (not by me): #2130

  9. linear-code commented on Jul 27, 2026

    @linear-code
    linear-codeBot
    on Jul 27, 2026 – with Linear Code

    from rita:

    @AWarno did you happen to test it?

  10. linear-code commented on Jul 27, 2026

    @linear-code
    linear-codeBot
    on Jul 27, 2026 – with Linear Code

    from awarno:

    yes: as in the slack thread

  11. linear-code commented on Jul 27, 2026

    @linear-code
    linear-codeBot
    on Jul 27, 2026 – with Linear Code

    from awarno:

    https://nvidia.slack.com/archives/C0B1MSCB2R0/p1784299431107549

  12. linear-code commented on Jul 27, 2026

    @linear-code
    linear-codeBot
    on Jul 27, 2026 – with Linear Code

    from rita:

    Thank you, closing

  13. ananthsub
    closed this as completedin #2130on Jul 28, 2026
  14. ananthsub
    added a commit that references this issue on Jul 28, 2026

    feat: accept stream:true on /v1/chat/completions via synthesized SSE (#…

    50157b4
  15. github-project-automation
    moved this from Dev WIP to Done in NeMo Gym 0.5.0 - Aug 5on Jul 28, 2026
  16. OlegSudakov
    added a commit that references this issue on Aug 7, 2026

    feat: accept stream:true on /v1/chat/completions via synthesized SSE (N…

    5cea450
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions