Repository navigation

feat(checkpoint): recover active vLLM generation prefixes - #4506

Open

macandro96 wants to merge 29 commits into

amahishi/rollout-deadline-snapshotfrom

amahishi/ckpt-v2-prefix-recovery-pr1

Open

feat(checkpoint): recover active vLLM generation prefixes#4506
macandro96 wants to merge 29 commits into
amahishi/rollout-deadline-snapshotfrom
amahishi/ckpt-v2-prefix-recovery-pr1

Commits on Nov 2, 2026
- refactor(checkpoint): share one capture between trainer checkpoints and rollout snapshots
  
  authored and
  root
  committed
  aac0279
- refactor(single-controller): hold shared rollout state in one RolloutRuntimeState
  
  authored and
  root
  committed
  8a91144
- refactor(checkpoint): move Gym checkpoint code behind an environment checkpoint interface
  
  authored and
  root
  committed
  354848d
- refactor(checkpoint): move rollout snapshots into a rollout_checkpointing package
  
  authored and
  root
  committed
  29b6388
- refactor(checkpoint): move the restore chain into RolloutRestorer
  
  authored and
  root
  committed
  6752632
- refactor(single-controller): run the rollout pump through one dispatch path
  
  authored and
  root
  committed
  e2c49f7
- refactor(checkpoint): pass what the run resumed from as one ResumeSource
  
  authored and
  root
  committed
  436168e
- test(checkpoint): drop duplicated checkpoint test scaffolding
  
  authored and
  root
  committed
  2f09e77
- refactor(checkpoint): give recovery state backend-neutral names
  
  authored and
  root
  committed
  eb22043
- docs(checkpoint): describe single-controller rollout checkpointing
  
  authored and
  root
  committed
  25f3f18
- refactor(checkpoint): drop restore checks setup already made, and dead code
  
  authored and
  root
  committed
  c1cdd3c
- test(checkpoint): build the Gym environment checkpoint in one shared helper
  
  authored and
  root
  committed
  125a278
- refactor(checkpoint): clean up a Gym restore in one place
  
  authored and
  root
  committed
  ca9d89e
- refactor(checkpoint): drop Gym commit checks that cannot fail
  
  authored and
  root
  committed
  7171e5d
Commits on Nov 3, 2026
- feat(checkpoint): trace rollout events to check what a restore cost
  
  macandro96
  and
  claude
  committed
  8c75341
- feat(checkpoint): trace batch age
  
  macandro96
  and
  claude
  committed
  90297ce
- feat(checkpoint): split batch age exactly at refits
  
  macandro96
  and
  claude
  committed
  c2bf309
- feat(checkpoint): snapshot rollouts at the checkpoint deadline
  
  macandro96
  and
  claude
  committed
  dea7ae5
Commits on Nov 4, 2026
- feat(checkpoint): recover active vllm generation prefixes
  
  macandro96
  and
  claude
  committed
  a79bb91
- refactor(checkpoint): use NeMo Gym's generation-cut wire names
  
  ananthsub
  authored and
  macandro96
  committed
  24e8838
- fix(checkpoint): address review of generation-prefix recovery
  
  macandro96
  and
  claude
  committed
  613486b
- fix(checkpoint): address second review of generation-prefix recovery
  
  macandro96
  and
  claude
  committed
  c8494d9
- perf(checkpoint): read generation-cut progress from vLLM at cut time
  
  macandro96
  and
  claude
  committed
  78f1417
- fix(checkpoint): keep calls with single-token bad words cuttable
  
  macandro96
  and
  claude
  committed
  7ff344f
- feat(checkpoint): count uncut model calls by reason
  
  macandro96
  and
  claude
  committed
  91e0cc6
- perf(checkpoint): read vLLM progress directly under its output lock
  
  macandro96
  and
  claude
  committed
  aef31f5
- refactor(checkpoint): drop redundant generation-prefix code
  
  macandro96
  and
  claude
  committed
  5ffb797
- refactor(checkpoint): find a cut call's vLLM request through the trace's link
  
  macandro96
  and
  claude
  committed
  b6aff18
Commits on Nov 6, 2026
- perf(checkpoint): read sampled logprobs from vLLM's flat arrays
  
  macandro96
  and
  claude
  committed
  d33e362

Commits

Commits on Nov 2, 2026

Commits on Nov 3, 2026

Commits on Nov 4, 2026

Commits on Nov 6, 2026