Repository navigation
Conversation
tdene
force-pushed
the
tde/nv_internal_jest
branch
from
August 18, 2026 10:59
5dbac71 to
fc54306
Compare
tdene
force-pushed
the
tde/nv_internal_jest
branch
from
August 21, 2026 15:16
fc54306 to
4e55d53
Compare
tdene
force-pushed
the
tde/nv_internal_jest
branch
from
August 25, 2026 08:56
4e55d53 to
5442a2e
Compare
tdene
force-pushed
the
tde/nv_internal_jest
branch
from
September 1, 2026 11:32
5442a2e to
8d040c9
Compare
This was referenced Sep 8, 2026
Co-authored-by: Jorge Albericio <jalbericiola@nvidia.com> Signed-off-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
tdene
force-pushed
the
tde/nv_internal_jest
branch
from
October 2, 2026 02:42
8d040c9 to
a910318
Compare
Contributor
Author
|
/ok to test a910318 |
This was referenced Oct 22, 2026
This branch was previously deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Forces Jest invocations in nv-internal eval scripts to run in-band: each jest line in an instance's run_script.sh gains --runInBand (skipped when the row already sets --maxWorkers) and --forceExit.
This has already been done for part of the dataset manually (90 rows), but the rest of the dataset still errors out due to Jest issues, so a comprehensive fix is useful.
Jest sizes its default worker pool from os.cpus(). The eval container gets a memory cgroup but no cpuset, so a single episode on a large node spawns a core-count fleet of Node workers.
The episode runs under rootless Apptainer with a squashfuse rootfs: every node_modules read funnels through one user-space FUSE daemon per container, inside a fixed memory budget, on nodes running many concurrent episodes. Under load the worker fleet starves the FUSE daemon (D-state pileup) or exhausts the cgroup; separately, suites that leak open handles keep the jest process alive after all tests have passed.
Thus we reach the full
swebench_tests_timeout, produce no output, and score 0, corrupting reward.Checklist
pre-commit run --all-files) (so CI lint/format/copyright pass).git commit -s) (so the DCO check passes).