Repository navigation
feat(nooa): add gateway compatibility to the session smoke - #3848
Closed
init-nikhil wants to merge 1 commit into
Closed
init-nikhil wants to merge 1 commit into
init-nikhil wants to merge 1 commit into
Conversation
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
from
October 8, 2026 02:23
fe695e3 to
e67059e
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
from
October 8, 2026 02:23
86313d0 to
0b49742
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
from
October 8, 2026 21:01
e67059e to
ace2b7e
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
2 times, most recently
from
October 9, 2026 21:58
1b8b381 to
678ea2b
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
from
October 9, 2026 21:58
ace2b7e to
474c60f
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
from
October 10, 2026 05:25
474c60f to
69af26a
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
from
October 10, 2026 05:25
678ea2b to
b986f5a
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
from
October 10, 2026 05:29
69af26a to
e13ecdc
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
from
October 10, 2026 05:29
b986f5a to
04afd80
Compare
init-nikhil
marked this pull request as ready for review
October 12, 2026 04:31
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
from
October 14, 2026 22:14
81591cc to
f29545c
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
from
October 14, 2026 22:14
211de99 to
501150d
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
from
October 14, 2026 22:22
f29545c to
f82ceca
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
from
October 14, 2026 22:22
501150d to
a7c107a
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
from
October 14, 2026 22:28
f82ceca to
1ec5290
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
2 times, most recently
from
October 14, 2026 23:59
abd7ff5 to
8d25bcd
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
2 times, most recently
from
October 15, 2026 20:13
02eafcd to
e55c373
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
from
October 15, 2026 20:13
8d25bcd to
96ca245
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
from
October 15, 2026 20:25
e55c373 to
a5e9535
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
from
October 15, 2026 20:25
96ca245 to
58ff05c
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
from
October 15, 2026 23:11
a5e9535 to
1fc04d9
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
from
October 15, 2026 23:11
58ff05c to
6c28516
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
from
October 15, 2026 23:20
1fc04d9 to
65b82da
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-example
branch
2 times, most recently
from
October 15, 2026 23:39
5febf53 to
7b9d3fe
Compare
init-nikhil
force-pushed
the
init-nikhil/nooa-native-sessions
branch
from
October 15, 2026 23:39
65b82da to
58ac533
Compare
Signed-off-by: Nikhil Deshmudre <nikhil.deshmudre@gmail.com> (cherry picked from commit ace2b7e) Signed-off-by: Nikhil Deshmudre <nikhil.deshmudre@gmail.com> NOOA-only rebuild of PR #3848 from 474c60f. NOOA-only scope: shared infrastructure remains identical to main. Signed-off-by: Nikhil Deshmudre <nikhil.deshmudre@gmail.com>
This was referenced Oct 16, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Keep gateway-compatible NOOA agent-session smoke wiring on the standard single-agent-turn recipe, with unconstrained policy calls by default.
This is part of the existing NOOA integration stack, based on #3846; no separate issue is needed for this requested architecture revision. Shared/base environment servers, shared agent contracts, generic sandbox code, and other harnesses remain fixed.
Patterns adopted from merged #3717 (single-agent-turn lifecycle), #3554/#3961 (Hermes sessions and sandbox cleanup), #3640 (Codex), #3626 (Pi), and open #4560 (borrowed DeepSWE/OpenCode sandbox): seed Resources, seed agent, activate, close agent and collect evidence/cookies, verify, close Resources.
Compatibility: in sandboxed NOOA, agent-owned background services stop before verification; the Resources-owned sandbox and persisted artifacts remain available. Tasks requiring a NOOA-started service during grading are unsupported by this lifecycle. The standard contract has an episode-wide deadline and no separate NOOA agent deadline; Terminal-Bench recipes retain verifier timeouts but do not reproduce canonical per-agent deadlines.
The session smoke uses
example_nooa_tasks.jsonlandtask-input.jsonl; counter state remains owned by its resource session. The example inherits the BenchAgent default from #3846.Current revision:
7b9d3fe58555198a2d01deb27bb12a62fe8d7533.Validation evidence:
Implementation pushed before writing or running new behavior tests or local checks, as requested. Existing tests received only mechanical naming/import updates before this push. Checks, exact-layer tests, live-model smoke rollouts, and current-head CI are pending for this revision. Earlier test and CI evidence applies only to earlier revisions and does not validate this change. No new benchmark scores are claimed.
Tests and validation
Current revision:
85007120cb3b0bb780e7a5905a42baa83daa2761.This section supersedes older validation, revision, and stack-base notes retained above. The original text outside this section is preserved unchanged.
Closed because the current representative NOOA requests succeeded through Gym's unchanged shared
VLLMModel, so this adapter and its dependent references were removed without a replacement PR. #3844 now builds directly on #3846. The branch and this PR's original description are retained.All 6 bounded gateway cases returned HTTP 200, including a real subsequent BenchAgent history with a nonempty cache hint and equal duplicate reasoning aliases. A separate completed request confirmed the exact shared path: HTTP 200, completed, 6,407 input / 294 output tokens. Transmitted payload evidence confirms the cache hint and duplicate aliases reached the gateway.
Measured scope:
https://inference-api.nvidia.com/v1withnvidia/qwen/qwen3.6-35b-a3b. This is evidence for the tested route, not a guarantee for every gateway/model. Matrix and completed evidence:/tmp/nooa-defaults-naming-20261015/vllm-compatibility/results.jsonand/tmp/nooa-defaults-naming-20261015/vllm-compatibility-completed/shared_followup_cache_both/result.json.The removal worktree passed 74 focused tests, all-files pre-commit, diff checks, Ruff, shell syntax, and Fern (0 errors / 1 warning). Validation artifacts are under
/tmp/nooa-defaults-naming-20261015/remove-3848/. Final retained stack tip:acdea255088e82e7bd34e1e678c6579365692375.