Repository navigation
fix(gdpval): count a model that delivers nothing as a lost battle, not a masked row - #6077
Merged
AdamRajfer merged 3 commits intoNov 16, 2026
GitHub Actions / Harness conformance (non-blocking)
succeeded
Nov 12, 2026 in 0s
10 passed, 0 failed, 0 unavailable
| Harness | P0 result | Failed scenario checks | First failure | Evidence |
|---|---|---|---|---|
| simple | passed | 1 / 9 | context_compaction: expected one completed automatic compaction, or none in the control | Download report and logs |
| opencode | passed | 0 / 9 | None | Download report and logs |
| pi | passed | 1 / 9 | context_compaction: expected one completed automatic compaction, or none in the control | Download report and logs |
| codex | passed | 0 / 9 | None | Download report and logs |
| hermes | passed | 0 / 9 | None | Download report and logs |
| kilocode | passed | 0 / 9 | None | Download report and logs |
| stirrup | passed | 0 / 9 | None | Download report and logs |
| copilot | passed | 1 / 9 | context_compaction: expected one completed automatic compaction, or none in the control | Download report and logs |
| openclaw | passed | 1 / 9 | context_compaction: expected one completed automatic compaction, or none in the control | Download report and logs |
| nooa | passed | 1 / 9 | context_compaction: expected one completed automatic compaction, or none in the control | Download report and logs |
Counts include execution errors and count each scenario once. Unavailable means setup, tests, execution, or evidence collection failed.
Each artifact contains probes/conformance_report.md, setup.log, tests.log, and per-scenario probes/<harness>/<scenario>/scenario_result.json and episode.log.
Tested commit: c0ff2f590d9f4d52460fc1ecea7d2cc8709f368c.
Probe summaries and downloadable evidence. Local setup instructions.
Loading