Fix Mistral GSM8K chat eval - #27757

Merged

alisonshao merged 25 commits into

sgl-project:mainfrom

JustinTong0323:fix/mistral-gsm8k-eval

Jul 10, 2026

Commits on Jun 9, 2026

Commits on Jun 10, 2026

Commits on Jun 19, 2026

Drop FA3-disable; keep eval-path fix only
JustinTong0323
committed

Commits on Jun 22, 2026

Migrate nightly GSM8K eval to sgl-eval (black-box subprocess)
JustinTong0323
committed
Refresh TP1 GSM8K lineup to modern models + fill sgl-eval thresholds
JustinTong0323
committed
Pin antlr4-python3-runtime==4.9.3 to fix sgl-eval import in CI
JustinTong0323
committed
Delete simple_eval_gsm8k.py; inline mixed-prefix scorer
JustinTong0323
committed
Drop Qwen3.5-4B from TP1 GSM8K lineup
JustinTong0323
committed
Trim comments to load-bearing why's; inline _build_prompt
JustinTong0323
committed
Address review: drop dead chat-stop wiring, fix _run_sgl_eval comment
JustinTong0323
committed
Split gsm8k by api mode: completion stays hand-rolled, chat -> sgl-eval
JustinTong0323
committed
Make sgl-eval opt-in (api='sgl_eval'); default gsm8k stays hand-rolled
JustinTong0323
committed

Commits on Jul 3, 2026

Commits on Jul 9, 2026