[konarkmodi]

What does this PR do?

This PR adds Brave Search as an opt-in BrowseComp search provider using Brave's public
LLM Context API.

Brave Search makes the LLM Context request and persists the returned URL context
in a per-session cache under /tmp. The existing Browse tool signature is
retained for agent compatibility; Brave Browse serves matching URLs from that
cache and does not make a second provider request. There is no separate private
Brave extraction API call.

Tavily and Exa remain unchanged and continue to provide the existing defaults.

Transparency note: I contributed to this work as a part-time consultant for Brave through Tesseracted Labs GmbH.

Validation

Ran against the final diff:

python3 -m py_compile \
  resources_servers/browsecomp_advanced_harness/app.py \
  resources_servers/browsecomp_advanced_harness/tests/test_brave_provider.py

git diff --check upstream/main..HEAD

PRE_COMMIT_HOME=/tmp/gym-brave-pre-commit \
pre-commit run --files \
  benchmarks/browsecomp/provider_brave.yaml \
  resources_servers/browsecomp_advanced_harness/app.py \
  resources_servers/browsecomp_advanced_harness/tests/test_brave_provider.py \
  benchmarks/browsecomp/README.md \
  resources_servers/browsecomp_advanced_harness/README.md

The targeted pre-commit checks passed. The pytest suite was not run locally
because pytest is not installed in the environment.

Rollouts

Evaluated BrowseComp with:

• Policy model: gpt-4.1-2025-04-14
• Serving model: nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4
• Dataset: BrowseComp, 1,266 tasks
• Provider: Brave public LLM Context API

Run	Correct	Accuracy
Run 1	649 / 1,266	51.3%
Run 2	642 / 1,266	50.7%

Compatibility and benchmark impact

• Tavily remains the default provider.
• Exa behavior is unchanged.
• Brave is enabled only when the Brave provider configuration is composed.
• Browse remains compatible with the existing agent tool signature.
• The reported rollouts use the Brave provider and are included as
  representative benchmark evidence.

Checklist

• I have read the contributing guidelines.
• The change is focused; unrelated "drive-by" edits are tracked as separate issues/PRs.
• Tests added or updated and pass locally, or N/A for docs-only / non-code changes (so CI unit/server checks pass when applicable).
• Documentation added or updated, or N/A with justification.
• Pre-commit checks pass locally (pre-commit run --all-files) (so CI lint/format checks pass).
• New source files include the required Apache-2.0 SPDX header.
• All commits have DCO sign-off (git commit -s) (so the DCO check passes).

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[marcromeyn]

Thanks for the contribution, and sorry it sat without a response for so long. Two things: (1) the branch is 682 commits behind main; could you merge main so we can authorize CI? (2) #4709 proposes making BrowseComp's search provider pluggable instead of adding each provider to app.py. @ritugala (BrowseComp owner) is weighing whether to land Brave as-is or as the first provider on that interface; we'll follow up here once that's decided. Your Brave tests and config would carry over either way.

[abhibha-nvidia]

@konarkmodi Can you also run Browsecomp with Brave as the search provider on the superV3.5 GA and the GLM 5.3 as well?

[konarkmodi]

Thanks for the contribution, and sorry it sat without a response for so long. Two things: (1) the branch is 682 commits behind main; could you merge main so we can authorize CI? (2) #4709 proposes making BrowseComp's search provider pluggable instead of adding each provider to app.py. @ritugala (BrowseComp owner) is weighing whether to land Brave as-is or as the first provider on that interface; we'll follow up here once that's decided. Your Brave tests and config would carry over either way.

Thank you @marcromeyn, updated the branch from main. Looking forward to the decision on provider interface, happy to adapt accordingly.