Skip to content

feat(nooa): add gateway compatibility to the session smoke - #3848

Closed
init-nikhil wants to merge 1 commit into
init-nikhil/nooa-native-sessionsfrom
init-nikhil/nooa-native-example
Closed

init-nikhil wants to merge 1 commit into
init-nikhil/nooa-native-sessionsfrom
init-nikhil/nooa-native-example

Conversation

@init-nikhil

@init-nikhil init-nikhil commented Oct 1, 2026 •

Copy link
Copy Markdown
Member

Keep gateway-compatible NOOA agent-session smoke wiring on the standard single-agent-turn recipe, with unconstrained policy calls by default.

This is part of the existing NOOA integration stack, based on #3846; no separate issue is needed for this requested architecture revision. Shared/base environment servers, shared agent contracts, generic sandbox code, and other harnesses remain fixed.

Patterns adopted from merged #3717 (single-agent-turn lifecycle), #3554/#3961 (Hermes sessions and sandbox cleanup), #3640 (Codex), #3626 (Pi), and open #4560 (borrowed DeepSWE/OpenCode sandbox): seed Resources, seed agent, activate, close agent and collect evidence/cookies, verify, close Resources.

Compatibility: in sandboxed NOOA, agent-owned background services stop before verification; the Resources-owned sandbox and persisted artifacts remain available. Tasks requiring a NOOA-started service during grading are unsupported by this lifecycle. The standard contract has an episode-wide deadline and no separate NOOA agent deadline; Terminal-Bench recipes retain verifier timeouts but do not reproduce canonical per-agent deadlines.

The session smoke uses example_nooa_tasks.jsonl and task-input.jsonl; counter state remains owned by its resource session. The example inherits the BenchAgent default from #3846.

Current revision: 7b9d3fe58555198a2d01deb27bb12a62fe8d7533.

Validation evidence:

Implementation pushed before writing or running new behavior tests or local checks, as requested. Existing tests received only mechanical naming/import updates before this push. Checks, exact-layer tests, live-model smoke rollouts, and current-head CI are pending for this revision. Earlier test and CI evidence applies only to earlier revisions and does not validate this change. No new benchmark scores are claimed.

Tests and validation

Current revision: 85007120cb3b0bb780e7a5905a42baa83daa2761.

This section supersedes older validation, revision, and stack-base notes retained above. The original text outside this section is preserved unchanged.

Closed because the current representative NOOA requests succeeded through Gym's unchanged shared VLLMModel, so this adapter and its dependent references were removed without a replacement PR. #3844 now builds directly on #3846. The branch and this PR's original description are retained.

  • All 6 bounded gateway cases returned HTTP 200, including a real subsequent BenchAgent history with a nonempty cache hint and equal duplicate reasoning aliases. A separate completed request confirmed the exact shared path: HTTP 200, completed, 6,407 input / 294 output tokens. Transmitted payload evidence confirms the cache hint and duplicate aliases reached the gateway.

  • Measured scope: https://inference-api.nvidia.com/v1 with nvidia/qwen/qwen3.6-35b-a3b. This is evidence for the tested route, not a guarantee for every gateway/model. Matrix and completed evidence: /tmp/nooa-defaults-naming-20261015/vllm-compatibility/results.json and /tmp/nooa-defaults-naming-20261015/vllm-compatibility-completed/shared_followup_cache_both/result.json.

  • The removal worktree passed 74 focused tests, all-files pre-commit, diff checks, Ruff, shell syntax, and Fern (0 errors / 1 warning). Validation artifacts are under /tmp/nooa-defaults-naming-20261015/remove-3848/. Final retained stack tip: acdea255088e82e7bd34e1e678c6579365692375.

@init-nikhil init-nikhil added area:environment Individual environments, benchmarks, verifiers, and environment-specific resources servers area:agent Agent harnesses and Responses API agent behavior labels Oct 1, 2026
@copy-pr-bot

copy-pr-bot Bot commented Oct 1, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@init-nikhil
init-nikhil added this pull request to stack #3852 October 1, 2026 06:39
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch from fe695e3 to e67059e Compare October 8, 2026 02:23
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch from 86313d0 to 0b49742 Compare October 8, 2026 02:23
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch from e67059e to ace2b7e Compare October 8, 2026 21:01
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch 2 times, most recently from 1b8b381 to 678ea2b Compare October 9, 2026 21:58
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch from ace2b7e to 474c60f Compare October 9, 2026 21:58
@init-nikhil
init-nikhil removed this pull request from stack #3852 October 9, 2026 21:59
@init-nikhil
init-nikhil added this pull request to stack #4355 October 9, 2026 22:00
@init-nikhil
init-nikhil removed this pull request from stack #4355 October 10, 2026 05:25
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch from 474c60f to 69af26a Compare October 10, 2026 05:25
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch from 678ea2b to b986f5a Compare October 10, 2026 05:25
@init-nikhil
init-nikhil added this pull request to stack #4367 October 10, 2026 05:25
@init-nikhil init-nikhil changed the title feat(nooa): [wip] add a native stateful example feat(nooa): add gateway compatibility to the native smoke Oct 10, 2026
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch from 69af26a to e13ecdc Compare October 10, 2026 05:29
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch from b986f5a to 04afd80 Compare October 10, 2026 05:29
@init-nikhil
init-nikhil marked this pull request as ready for review October 12, 2026 04:31
@nemo-automation-bot
nemo-automation-bot Bot requested review from a team October 12, 2026 04:32
@init-nikhil
init-nikhil requested a review from yaoyu-33 October 12, 2026 04:37
@yaoyu-33 yaoyu-33 added complexity:low Localized change in one scope with a small, straightforward review surface feature New capabilities, enhancements, or enablement work labels Oct 12, 2026
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch from 81591cc to f29545c Compare October 14, 2026 22:14
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch from 211de99 to 501150d Compare October 14, 2026 22:14
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch from f29545c to f82ceca Compare October 14, 2026 22:22
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch from 501150d to a7c107a Compare October 14, 2026 22:22
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch from f82ceca to 1ec5290 Compare October 14, 2026 22:28
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch 2 times, most recently from abd7ff5 to 8d25bcd Compare October 14, 2026 23:59
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch 2 times, most recently from 02eafcd to e55c373 Compare October 15, 2026 20:13
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch from 8d25bcd to 96ca245 Compare October 15, 2026 20:13
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch from e55c373 to a5e9535 Compare October 15, 2026 20:25
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch from 96ca245 to 58ff05c Compare October 15, 2026 20:25
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch from a5e9535 to 1fc04d9 Compare October 15, 2026 23:11
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch from 58ff05c to 6c28516 Compare October 15, 2026 23:11
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch from 1fc04d9 to 65b82da Compare October 15, 2026 23:20
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-example branch 2 times, most recently from 5febf53 to 7b9d3fe Compare October 15, 2026 23:39
@init-nikhil
init-nikhil force-pushed the init-nikhil/nooa-native-sessions branch from 65b82da to 58ac533 Compare October 15, 2026 23:39
Signed-off-by: Nikhil Deshmudre <nikhil.deshmudre@gmail.com>
(cherry picked from commit ace2b7e)
Signed-off-by: Nikhil Deshmudre <nikhil.deshmudre@gmail.com>

NOOA-only rebuild of PR #3848 from 474c60f.

NOOA-only scope: shared infrastructure remains identical to main.

Signed-off-by: Nikhil Deshmudre <nikhil.deshmudre@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:model Model servers, inference providers, and model adapters complexity:low Localized change in one scope with a small, straightforward review surface feature New capabilities, enhancements, or enablement work ready-to-merge PR is approved, current, and waiting for final CI or merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants