Repository navigation
Conversation
|
/ok to test a4c854d |
|
/claude review |
|
SHIP WITH CARE — new The reward-integrity surface is the right thing to scrutinize hardest here, and it's guarded well:
NOTEs (author's call, non-blocking):
Test coverage is genuinely strong (AST-sliced execution of the inner runner/evaluator, real safetensors round-trip against a tiny Qwen, secret-leakage assertions on sandbox specs). Per CLAUDE.md, green tests aren't sufficient for a behavior-changing env — confirm the PR body records a real smoke rollout with a model before marking ready. |
|
We’re doing some cleanup of the open PR list. This PR has had no activity for over a month, so I’ve moved it back to draft. If this change is still needed, please resolve any merge conflicts and mark the PR ready for review again when it’s ready to merge. Thanks! |
What does this PR do?
Policy runs in claude code to edit NemoRL and Gym, then a 1hr GRPO training run is ran in a GPU sandbox on 1 H100. then AIME25 is evaluated as the reward
Validation
Rollouts
Compatibility and benchmark impact
Checklist
pre-commit run --all-files) (so CI lint/format checks pass).git commit -s) (so the DCO check passes).