[YMuskrat]

Summary

Valid ATIF answers such as [{"type":"text","text":"The answer is 4."}] currently disappear before grading, and an earlier string message can incorrectly become the final response. Reuse atif_content_text for agent text, final answers, conversation summaries and final-response evidence references in both host and verifier.

Text parts reach all judge bundles; image/audio parts retain the existing safe markers. Tests validate fixtures through Harbor's schema and compare host/verifier evidence, including references to the correct final step.

Closes #202

Focused message, evidence compiler, behavior evidence and judge-use tests: 76 passed. Full suite: 11,200 passed, 53 skipped, 25 baseline failures.

Verification

• Familiar with CONTRIBUTING.md
• Added focused behavioral regression tests
• Updated CHANGELOG.md
• Ran make lint (passed)
• Ran make test
• Ran make build (wheel and source distribution passed)
• No credentials, private datasets, or proprietary benchmark content added

The full suite used the repository's locked dependencies on Python 3.12 and pytest-xdist with four workers. It has 25 failures, all reproduced against unchanged main at f32c884. The identical failing test IDs occur on all three independent fixes; none is in a changed module. These include restricted Unix sockets/local subprocesses and existing SDK/CLI/report contracts. The full suite is not claimed green.

Release Impact

• Updated CHANGELOG.md

[rng1995]

Automated review: 1 findings (0 P1, 0 P2, 1 P3); 1 posted inline.

[chrisknvidia]

Reviewed 3a30acc7069ee8ebe005cb4b871eb367a11f18fa against main 098f96a0d169878ab85b6801a8f4609b29d11e50. The earlier media-only final-response finding is fixed in both host and verifier, including its evidence reference. No additional substantive code finding.

Not ready to merge yet:

• Commit d04404fa7a8e1fd929eeef5bf59ad1aba5cf4ba0 has no Signed-off-by trailer. I reproduced the exact DCO workflow check locally over the non-merge PR commits; this commit fails it. Add the author's sign-off and push the corrected history.
• Current-head DCO, CI, and Security workflow runs are all action_required, so their checks have not run. After the sign-off fix, a maintainer must authorize the new-head workflows and the required checks must pass.

Verification: 435 focused tests passed with Harbor 0.24.0; changed-file Ruff passed; 20 copied standalone-verifier cases across ten message combinations and two evidence budgets validated all reward files and final-response references. Those subprocess cases used a localhost judge with synthetic responses. No live agent/provider/container E2E or full-suite pass is claimed.

Integration note: this branch and #201 currently conflict in CHANGELOG.md and the atif_helpers.py import. Whichever lands second will need to preserve both helper imports and rerun host/verifier coverage after resolving.

[rng1995]

The review finding is fixed in d04404f and verified. One thing still blocks merging: the DCO check fails because d04404f has no Signed-off-by line. Please sign it off (for example git rebase --signoff origin/main) and force-push.

[rng1995]

@YMuskrat thanks for the quick fix. The only failing check is DCO: d04404f ("fix(tier3): retain text answer when final ATIF step is media-only") has no Signed-off-by line. Could you sign it off and force-push? For example:

git rebase --signoff origin/main && git push --force-with-lease

Everything else passes, and the PR is approved.

[rng1995]

@YMuskrat I pushed a merge of main (347bda3) to clear a CHANGELOG conflict after #188 landed. Please run git pull before the sign-off rebase, so --force-with-lease does not reject the push. d04404f still needs its Signed-off-by line for DCO.

[rng1995]

@YMuskrat to unblock DCO, d04404f was re-created with a maintainer Signed-off-by line. The code and message are unchanged and you are still the author. Current main is merged in to clear a CHANGELOG conflict. Because the branch was force-pushed, please fetch the updated branch before pushing anything else to it.