Repository navigation

Make LRU prefix caching eviction policy only evict child blocks - #5822

Merged

santhnm2 merged 17 commits into

NVIDIA:mainfrom

santhnm2:prefix_caching_lru_fix

Jul 23, 2026

Merged

Make LRU prefix caching eviction policy only evict child blocks#5822
santhnm2 merged 17 commits into
NVIDIA:mainfrom
santhnm2:prefix_caching_lru_fix

Commits on Jul 15, 2026
- Make LRU prefix caching eviction policy only evict child blocks
  santhnm2
  committed
  3c08be5
Commits on Jul 17, 2026
- Merge branch 'main' into prefix_caching_lru_fix
  santhnm2
  authored
  c98746e
- Address reviewer feedback
  santhnm2
  committed
  e6babb6
- Safety check for cyclic parent chain
  santhnm2
  committed
  8830139
- Linting
  santhnm2
  committed
  e735ee5
- Merge branch 'main' into prefix_caching_lru_fix
  santhnm2
  authored
  0fd9e62
- Address reviewer feedback
  santhnm2
  committed
  2ce5bb4
- Linting
  santhnm2
  committed
  0356f2f
- Merge branch 'main' into prefix_caching_lru_fix
  santhnm2
  authored
  6641b68
- Add additional unit test for agentic / multi-turn scenario
  santhnm2
  committed
  42a6e3e
- Merge branch 'main' into prefix_caching_lru_fix
  santhnm2
  authored
  90b8f29
Commits on Jul 20, 2026
- Merge branch 'main' into prefix_caching_lru_fix
  santhnm2
  authored
  1e6d97b
- Rename reserved_evictable, add worked example to comments
  santhnm2
  committed
  646b343
Commits on Jul 21, 2026
- Switch to min heap
  santhnm2
  committed
  fff8b6c
Commits on Jul 22, 2026
- Persist parent idx and child count data structures
  santhnm2
  committed
  985e1e5
- num_evictable_to_exclude -> potential_matched_count
  santhnm2
  committed
  21d601d
- Merge branch 'main' into prefix_caching_lru_fix
  santhnm2
  authored
  840aa18