[Cherry-Pick] [BugFix] Fix inaccurate cache hit rate and TTFT after request preemption - #6626

Merged

Jiang-Jia-Jun merged 3 commits into

PaddlePaddle:release/2.5from

liyonghua0910:release/2.5+fix_preempted_metrics_0303

Mar 5, 2026

Commits on Mar 3, 2026

[chore] add has_been_rescheduled flag for requests
liyonghua0910
committed
91d3543
[refactor] rename reschedule to preempted for accuracy and fix cache hit metrics
liyonghua0910
committed
e332349

Commits on Mar 5, 2026

[chore] add ttft_s
liyonghua0910
committed
5cd46e2