Skip to content

Document how to run evals for unreleased models#76

Open
jerilynzheng wants to merge 1 commit intovercel:mainfrom
jerilynzheng:jerilyn/doc-unreleased-models
Open

Document how to run evals for unreleased models#76
jerilynzheng wants to merge 1 commit intovercel:mainfrom
jerilynzheng:jerilyn/doc-unreleased-models

Conversation

@jerilynzheng
Copy link
Copy Markdown
Contributor

Summary

  • Adds README section explaining how to build a patched OpenCode binary for models not yet on models.dev
  • Documents agentOptions.binaryUrl and extraProviders usage in experiment configs
  • Covers the full workflow: patch OpenCode → build binary → upload → reference in config

Test plan

  • README renders correctly
  • Instructions verified against actual GLM 5.1 eval workflow

🤖 Generated with Claude Code

@jerilynzheng jerilynzheng requested a review from gaojude April 14, 2026 20:14
Adds README section explaining how to build a patched OpenCode binary,
upload it, and reference it via agentOptions.binaryUrl in experiment
configs. Also documents extraProviders for custom provider configurations.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@jerilynzheng jerilynzheng force-pushed the jerilyn/doc-unreleased-models branch from bcac9e3 to 130d524 Compare April 15, 2026 05:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant