Repository navigation
fix(sandbox): reconcile Docker creates and resolve E2B service endpoints - #4822
Merged
marcromeyn merged 3 commits intoOct 26, 2026
Merged
marcromeyn merged 3 commits into
marcromeyn merged 3 commits into
GitHub Actions / Harness conformance (non-blocking)
failed
Oct 26, 2026 in 0s
5 passed, 0 failed, 1 unavailable
| Harness | P0 result | Failed scenario checks | First failure | Evidence |
|---|---|---|---|---|
| opencode | passed | 0 / 7 | None | Download report and logs |
| pi | passed | 0 / 7 | None | Download report and logs |
| codex | passed | 0 / 7 | None | Download report and logs |
| hermes | passed | 0 / 7 | None | Download report and logs |
| kilocode | unavailable | 2 / 7 | model_error: the EnvironmentServer did not receive a failed response retaining the terminal model error | Download report and logs |
| stirrup | passed | 0 / 7 | None | Download report and logs |
Counts include execution errors and count each scenario once. Unavailable means setup, tests, execution, or evidence collection failed.
Each artifact contains probes/conformance_report.md, setup.log, tests.log, and per-scenario probes/<harness>/<scenario>/scenario_result.json and episode.log.
Rerun locally
From the tested Gym revision, activate your Gym environment and install the selected adapters' requirements and pinned runtimes. No model service or model credentials are needed.
python scripts/run_harness_conformance.py --harness kilocode --output "$(mktemp -d)/probes"Each command runs the full suite for that harness and creates a fresh output directory. Open conformance_report.md in that directory for the full report.
Tested commit: 5c6e5d102e5d45dece0d972c74d8de7035abee7f.
Probe summaries and downloadable evidence. Local setup instructions.
Loading