Repository navigation
[NVIDIA] Qwen3.5 B300 NVFP4 SGLang AgentX - #5006
Conversation
|
Thanks for the contribution!
中文感谢你的贡献!
|
|
[by Claude Code] The SGLang cookbook integration of this PR's AgentX config ( This PR has no authorized |
|
[by Claude Code] sgl-project/sglang#49787 has been merged. This PR's AgentX config ( This PR has no authorized |
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=42970945523 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=42970945523 |
|
[by Claude Code] The SGLang cookbook update of this PR's AgentX config ( This PR has no authorized |
|
[by Claude Code] sgl-project/sglang#50081 has been merged. This PR's AgentX config ( This PR has no authorized |
|
/use 42970945523 |
|
@nvpohanh staged run 42970945523. This run remains available across future |
|
As a PR reviewer and CODEOWNER, I have reviewed this and have: Checklist items
Additional detail section:Assessed head
Signed: |
✅✅✅ Verdict: PASS ✅✅✅Passed and not applicable checks✅ Check 0 (CODEOWNER): PASS — ✅ Check 1 (Sweep on in-PR commit): PASS — The PR's only commit is pinned head ✅ Check 2 (Evals): PASS — ✅ Check 3 (Upstream recipe): PASS — sglang#49787 and sglang#50081 are both MERGED. ✅ Check 4 (Reuse command): PASS — ✅ Check 5 (Checklist template): PASS — All 20 items of the current ✅ Check 6 (Upstream images / provenance / ordering): PASS — The image is the upstream ✅ Check 7 (Deprecated models): PASS — MODELS.md lists ✅ Check 8 (No architecture hacks): PASS — There are no ✅ Check 9 (Chat template for spec decode): PASS — The AgentX replay client drives ✅ Check 10 (No engine patches): PASS — The diff touches only the recipe YAML, ✅ Check 11 (Golden AL): PASS — The connector injects ✅ Check 13 (Draft precision): PASS — The draft is the embedded MTP head of ✅ Check 14 (Pareto coverage): PASS — For the curve qwen3.5 / agentic-coding / B300 SGLang / fp4 / run 42970945523 / p90 E2EL vs total tput per GPU, ✅ Check 15 (PR description): PASS — The PR body's config key and image match ✅ Check 16 (NVIDIA overview): PASS — The NVIDIA overview's Framework Recipes table lists Qwen3.5 with an SGLang link to the Qwen3.5 cookbook, which covers this B300 SGLang pair. ✅ Check 18 (Recipe/image/sweep consistency): PASS — All 14 ➖ Check 12 (Append-only): N/A — The new changelog entry does not use ➖ Check 17 (Dynamo metrics): N/A — This is a direct SGLang config, not Dynamo TRT-LLM. Assessed commit: |
…entx # Conflicts: # inferencex-e2e/perf-changelog.yaml
…entx # Conflicts: # inferencex-e2e/perf-changelog.yaml
|
Ingest report — ✅ Results ingested into the Ingest workflow · Merge Ingest run · Benchmark source run
benchmarkFiles 15, rawBenchmarkRows 28, coveredByPerJobFiles 14, purgedPoints 0, failedRunRows 0, runStatsNew 0, runStatsDuplicate 0, evalSamplesNew 3957, gpuMetricSamplesNew 181166, powerPublicationPoints 14, changelogEntriesWritten 1 Counts cover only this run. Rows: benchmark_results, eval_results, agentic rows linked to a trace, gpu_metrics series. This comment updates if the ingest is rerun. 中文Ingest 报告 — ✅ 结果已写入 上表仅统计本次运行写入的数据,各行单位依次为 benchmark_results 行、eval_results 行、已关联 trace 的 agentic 行和 gpu_metrics 序列。重新运行 ingest 时本评论会原地更新。 |
Config
qwen3.5-fp4-b300-sglang-agentic-mtp-pareto
Image
lmsysorg/sglang:nightly-dev-20261013-7224fce1
Type of Change
Checklist
python -m infx.matrix.changed --base origin/mainlists the new key