Repository navigation
Conversation
added 3 commits
October 13, 2026 17:04
The cold tier reports ssd_prefix_miss whenever it holds nothing reusable, and the session bank copied that over its own reason. A new conversation, a prompt sharing less than the reuse minimum with what is stored, and a turn evicted from RAM all read as an SSD miss. A plain ssd_prefix_miss is now reported as evicted (this conversation's own earlier turn left RAM and is not on the SSD), new_session, or prefix_divergence_at_token. Real SSD failures keep their reasons, and ssd_prefix_miss remains for a RAM-lane refusal with another cause.
The request log showed every miss as the raw reason in orange, so a new conversation read SSD_PREFIX_MISS. new_session is now NEW CHAT and prefix_divergence_at_token NO SHARED PREFIX (grey), evicted is EVICTED (yellow), SSD restore failures are SSD ERROR (orange). The tooltip carries the precise reason; ssd_prefix_miss from older servers stays readable.
jvmenen
pushed a commit
to jvmenen/MTPLX
that referenced
this pull request
Oct 14, 2026
…incl. single-rounding fix), 134 (youssofal#629), new 135 (fused lse prefill rounds twice)
jvmenen
pushed a commit
to jvmenen/MTPLX
that referenced
this pull request
Oct 14, 2026
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
The dashboard request log showed
SSD_PREFIX_MISSin orange for almost every miss. The cold tier reports that reason whenever it holds nothing reusable, and the session bank copied it over its own reason. So a new conversation, a prompt that shares less than the reuse minimum (512 tokens) with what is stored, and a turn that was evicted from memory all looked like an SSD fault, although the SSD is only the last place searched and nothing failed.Change
Server: a plain
ssd_prefix_missis now reported as what it meant:new_session: the bank holds nothing.prefix_divergence_at_token: other conversations are stored, but the shared prefix is below the reuse minimum.evicted: this conversation's own earlier turn left memory and is not on the SSD.Dashboard labels, with the precise reason in the tooltip:
new_sessionprefix_divergence_at_tokenevictedssd_restore_error:*,ssd_missing_*,ssd_prefix_no_recurrent_boundaryssd_prefix_miss(older servers)Compatibility
No new reason values; all three already exist in
CacheMissReason.ssd_prefix_missis still reported when the memory lane refused a prefix for another reason (the cause is inlast_ram_miss_reason), and real SSD failures keep their reasons. The dashboard still readsssd_prefix_missfrom older servers.Tests
tests/test_ram_miss_reason.py(new conversation, no shared prefix, own turn evicted, another conversation not treated as the owner, SSD failure passed through); three existing assertions updated to the new reasons. Ran withtest_cache_bank,test_cold_tier_disk_usage_scan,test_prefill_rereadandtest_session_bank: all pass.bun test(label and colour per reason, rendered row with tooltip),tsc --noEmitandbun run buildclean. The built assets are in a separate commit.