Repository navigation
fix(tb4): upgrade to 4.1 and preserve artifacts and limit outcomes - #6220
Merged
lafrancef merged 2 commits intoNov 16, 2026
Merged
Conversation
Update the official task pins across Harbor and relay profiles. Retain safe artifacts and bounded missing-reward logs, and keep confirmed sandbox allocation-limit deaths settled as zero through collection and recovery. Signed-off-by: Frederic Lafrance <flafrance@nvidia.com>
lafrancef
marked this pull request as ready for review
November 16, 2026 10:48
Signed-off-by: Frederic Lafrance <flafrance@nvidia.com>
Contributor
Author
|
/ok to test 816f7dd |
Contributor
|
🌿 Preview your docs: https://nvidia-preview-pr-6220-816f7dd3077e.docs.buildwithfern.com/nemo/gym |
Contributor
Author
|
@wprazuch, could you review and approve this? It includes the storage-limit fix from #6219 alongside the TB4.1 update and sandbox/artifact fixes. Core, sandbox, all eight server shards, and the combined coverage gate passed for |
wprazuch
approved these changes
Nov 16, 2026
ko3n1g
approved these changes
Nov 16, 2026
Contributor
|
🔄 Merge queue validation started! You can track the progress here: https://github.com/NVIDIA-NeMo/Gym/actions/runs/43875001646 |
lafrancef
deleted the
flafrance/fer-421-upstream-tb4-fixes-to-external-gym
branch
November 16, 2026 13:40
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Updates both TB4 profiles to the official Terminal-Bench 4.1 task and Compose-image pins.
Terminal-Bench 4.1 changes the verifiers, so scores and
partial_creditare not comparable with 4.0. Artifact filtering can also change grades when an artifact contains unsafe entries. Existing Harbor datasets must be refreshed using the entry README's version-migration steps. Separate GPU provider blocks need the documented shared-mount opt-out label too.Live rollout validation remains deferred because the validation host could not reach the required services.
No separate public issue; this updates the existing TB4 integration and preserves the failure-handling contracts from #5194 and #6114.
This consolidates the storage-limit fix also proposed in #6219.