Repository navigation
Add protected context compaction for backports - #834
Conversation
PR Summary by QodoAdd opt-in protected context compaction for backports
AI Description
Diagram
High-Level Assessment
Files changed (11)
|
Code Review by Qodo
1.
|
2af51b5 to
8bd2e1c
Compare
|
/agentic_review |
|
Code review by qodo was updated up to the latest commit 8bd2e1c |
8bd2e1c to
dd7dc7c
Compare
| Backport context management is initially disabled. Set | ||
| `BACKPORT_CONTEXT_MANAGEMENT=true` to let the model compact older investigation |
There was a problem hiding this comment.
👍
any easy way to detect an issue suitable for testing this, when running in prod?
There was a problem hiding this comment.
pretty much anything that is not a simple backport. sadly as the LLMs got better, it is harder to get them to grow the context over 50k or so. they don't get confused like they used to
There was a problem hiding this comment.
and could we detect this even programatically to flag this?
There was a problem hiding this comment.
I'm not sure. I'll probably just look through the trace server occasionally and try to see which BackportWorkflow had big cost and run it locally. also the next thing would be to find components which have rules, to see if they were kept in place after compaction
Assisted-by: Codex
dd7dc7c to
f2e12fd
Compare
Context compaction is opt-in and disabled by default. It is only enabled when BACKPORT_CONTEXT_MANAGEMENT=true is explicitly configured. I was trying to find optimal backport where the compaction would happen, but our agents are pretty good with token consumption already. If merged we can turn this feature on only when we are sure that it works as expected.