You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit fc6772c
Browse filesBrowse the repository at this point in the historyBrowse files
Copy file name to clipboardExpand all lines: README.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -249,6 +249,7 @@ The Dataset column links to publicly available datasets (e.g., on HuggingFace).
249
249
| Asr With Pc | other | ASR with WER scoring (standard, case-sensitive, punctuation+capitalization) | Improve transcription quality with structural detail | - | - | - | <a href='resources_servers/asr_with_pc/configs/asr_with_pc.yaml'>asr_with_pc.yaml</a> | - |
250
250
| Assaybench | knowledge | AssayBench -- rank the hit genes of a CRISPR screen from its plain-text description (arXiv:2605.10876) | Tests whether a model can link mechanistic biology to measured phenotypic outcomes, scored with the paper's adjusted nDCG | - | - | - | <a href='resources_servers/assaybench/configs/assaybench.yaml'>assaybench.yaml</a> | - |
| Bird Sql | coding | Text-to-SQL with execution-based evaluation on BIRD dev (1534 SQLite tasks). Binary reward from unordered result-set equality. | Improve text-to-SQL capabilities on BIRD's realistic dev split using execution-based binary reward without an LLM judge. | - | - | - | <a href='resources_servers/bird_sql/configs/bird_sql.yaml'>bird_sql.yaml</a> | - |
254
255
| Blackjack | games | Blackjack. Model hits or stands. Reward +1 win, 0 draw, -1 loss/bust. | Example gymnasium-style multi-step environment | - | - | - | <a href='resources_servers/blackjack/configs/blackjack.yaml'>blackjack.yaml</a> | - |
@@ -372,6 +373,7 @@ The Dataset column links to publicly available datasets (e.g., on HuggingFace).
372
373
| Reasoning Gym | knowledge | LangGraph reflection agent compatible with resource servers that do not use tools; provides iterative reflection for diverse agent training data and test time scaling, extensible to use tools or other agent architectures | Iterative test time scaling for improved performance in reasoning tasks | ✓ | - | Apache 2.0 | <a href='resources_servers/reasoning_gym/configs/reflection_agent.yaml'>reflection_agent.yaml</a> | - |
373
374
| Reasoning Gym | knowledge | LangGraph ReWOO agent compatible with resource servers that do not use tools; enables diverse agent training data and test time scaling vs a simple agent, extensible to use tools or other agent architectures | Iterative test time scaling for improved performance in reasoning tasks | ✓ | - | Apache 2.0 | <a href='resources_servers/reasoning_gym/configs/rewoo_agent.yaml'>rewoo_agent.yaml</a> | - |
374
375
| Reasoning Gym | knowledge | Over 100 tasks including algebra, arithmetic, computation, cognition, geometry, graph theory, logic, and many common games. | Improve robustness, generalization, broad knowledge and reasoning | ✓ | - | Creative Commons Attribution 4.0 International | <a href='resources_servers/reasoning_gym/configs/reasoning_gym.yaml'>reasoning_gym.yaml</a> | <a href='https://huggingface.co/datasets/nvidia/Nemotron-RL-ReasoningGym-v1'>Nemotron-RL-ReasoningGym-v1</a> |
376
+
| Rna Design | agent | RNA inverse folding: the design tools served over MCP to a harness such as Claude Code. | - | - | - | - | <a href='resources_servers/rna_design/configs/rna_design.yaml'>rna_design.yaml</a> | - |
375
377
| Rolemrc | instruction_following | RoleMRC role-play MRC scored with reference metrics (ROUGE/BLEU/METEOR/BERTScore); ROUGE-L is the reward. | Improve role-play instruction following and knowledge-grounded responses. | - | ✓ | - | <a href='resources_servers/rolemrc/configs/rolemrc.yaml'>rolemrc.yaml</a> | - |
376
378
| Rolemrc | rlhf | RoleMRC role-play MRC scored by a 5-aspect LLM-as-judge (knowledge range, style, nested/multi-turn instruction, instruction priority). | Improve role-play instruction following under knowledge-range and instruction-priority constraints. | - | ✓ | - | <a href='resources_servers/rolemrc/configs/rolemrc_judge.yaml'>rolemrc_judge.yaml</a> | - |
0 commit comments