Skip to content

[FEAT] Rollout outputs: selected-token logprobs, effective seeds and stop token IDs (part of #70) - #83

Open
MinhaoLi0318 wants to merge 12 commits into
InferMatrixLab:mainfrom
MinhaoLi0318:rl/rollout-outputs
Open

[FEAT] Rollout outputs: selected-token logprobs, effective seeds and stop token IDs (part of #70)#83
MinhaoLi0318 wants to merge 12 commits into
InferMatrixLab:mainfrom
MinhaoLi0318:rl/rollout-outputs

test: cover async speculation with CUDA Graphs in the GPU logprob test

205dcc6
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs