Repository navigation
Conversation
TianHao65
force-pushed
the
qwen35-dflash-acceptance-issue49
branch
from
November 3, 2026 03:15
232877c to
e9abb36
Compare
TianHao65
force-pushed
the
qwen35-dflash-acceptance-issue49
branch
from
November 3, 2026 03:25
e9abb36 to
396e349
Compare
TianHao65
force-pushed
the
qwen35-dflash-acceptance-issue49
branch
from
November 3, 2026 03:34
396e349 to
720f8ad
Compare
Add the packaged DFlash workload drivers, complete acceptance recording, dataset validation, launch and benchmark entry points, and usage documentation on qwen4_v0.5.21. Use the unified CI already merged into the target branch. Signed-off-by: TianHao65 <283868507+TianHao65@users.noreply.github.com>
TianHao65
force-pushed
the
qwen35-dflash-acceptance-issue49
branch
from
November 3, 2026 07:34
720f8ad to
531f5ea
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Refs #49. Add five DFlash workload drivers, response-counter recording, dataset downloads and test entry points. Rebased onto
apinge:qwen4_v0.5.21atc0a27e481010cd2f285fe426eed35860ae1920a5. CI PR65 is merged into this target; all separately cherry-picked CI and stacked-CI compatibility commits were removed. Head531f5ea32a607c22fc74639e86c69f85de3b3df2is one commit /18 files directly above the merged target. The README development baseline is updated accordingly.Data
Historical measurements on source
720f8ad566, 2026-11-03: Qwen3.5-397B PTPC-FP8 + DFlash, 8×MI308X/TP8, draft16, FP8 KV/page64, radix disabled, AITER full attention and Triton linear/draft attention. Greedy sampling, thinking disabled; one concurrency-sized warmup batch excluded.Weighted accept length = total completion tokens / total verify steps, including bonus tokens. Acceptance rate uses matched/proposed draft counters, excluding bonus tokens. All 28 length-truncated responses remain included.
Benchmarking and Profiling
All five frozen datasets, raw measured responses, summaries and configuration/hashes. GSM8K reuses the complete first run on measured source
720f8ad566; the other four ran subsequently with the same weights/backends/sampling. Two server starts; no baseline speedup comparison.Validation
508 measured responses have complete counters and pass independent recomputation. Owned servers stopped; eight GPUs released. Current checks:8 counter/HTTP fixture tests (10 workload/batch subcases), all five native CLI help commands,21 CI driver tests,17 evaluation shell syntax checks, Python syntax and clean diff. No new GPU evaluation was run after rebasing. Single-request probes produced malformed output on this stack; C1 numerical correctness remains unresolved. These measurements cover the listed client concurrencies32/64. Retain Draft.