Repository navigation
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The Cookbook has a multi-container example, but no end-to-end recipe showing how to grade database state after the original environment is gone.
Add a small PostgreSQL order-total repair task that captures a deterministic JSON snapshot from a database sidecar, grades it in a separate verifier, and regrades the saved trial without rerunning the agent or database. The README includes commands pinned to released Harbor 0.24.0, an Oracle solution, and a Nop control. Register the recipe and link it from the root README.
The agent can read the tables and update only
orders.total_cents. A sidecar collect hook runs after the main container stops, captures all grading inputs in one SQL statement, and publishes the snapshot atomically. Remote superuser access is rejected; the verifier only reads JSON.Validation on Docker/Linux ARM64 from macOS with Harbor 0.24.0 and Python 3.13.17:
RegradeError, no rewardBoth original snapshot hashes remain unchanged after regrading. Ten additional checks cover database permissions, remote superuser rejection, and deterministic capture. Repository-wide Ruff lint/format, shell syntax, registry validation, and the new recipe's structure checks pass.
The existing structure-check failure on main is reproducible unchanged at
e093c9a: themulti-steprecipe keeps instructions and test entrypoints understeps/, while CI requires rootinstruction.mdandtests/test.sh. Main's CI run also failsvalidate-recipes. This PR leaves that existing recipe and validator unchanged.AI assistance was used for implementation and validation.