Skip to content

fix(sandbox): reconcile Docker creates and resolve E2B service endpoints - #4822

Merged
marcromeyn merged 3 commits into
NVIDIA-NeMo:mainfrom
JeffPengCoder:feature/sandbox-provider-contracts
Oct 26, 2026
Merged

marcromeyn merged 3 commits into
NVIDIA-NeMo:mainfrom
JeffPengCoder:feature/sandbox-provider-contracts

Merge branch 'main' into feature/sandbox-provider-contracts

5c6e5d1
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
GitHub Actions / Harness conformance (non-blocking) failed Oct 26, 2026 in 0s

5 passed, 0 failed, 1 unavailable

Harness P0 result Failed scenario checks First failure Evidence
opencode passed 0 / 7 None Download report and logs
pi passed 0 / 7 None Download report and logs
codex passed 0 / 7 None Download report and logs
hermes passed 0 / 7 None Download report and logs
kilocode unavailable 2 / 7 model_error: the EnvironmentServer did not receive a failed response retaining the terminal model error Download report and logs
stirrup passed 0 / 7 None Download report and logs

Counts include execution errors and count each scenario once. Unavailable means setup, tests, execution, or evidence collection failed.

Each artifact contains probes/conformance_report.md, setup.log, tests.log, and per-scenario probes/<harness>/<scenario>/scenario_result.json and episode.log.

Rerun locally

From the tested Gym revision, activate your Gym environment and install the selected adapters' requirements and pinned runtimes. No model service or model credentials are needed.

python scripts/run_harness_conformance.py --harness kilocode --output "$(mktemp -d)/probes"

Each command runs the full suite for that harness and creates a fresh output directory. Open conformance_report.md in that directory for the full report.

Tested commit: 5c6e5d102e5d45dece0d972c74d8de7035abee7f.

Probe summaries and downloadable evidence. Local setup instructions.