Repository navigation
CollectiveX: footnote the H200 uccl-ep EP16 receive ring and correct the H100 cells / CollectiveX:为 H200 uccl-ep EP16 接收环添加脚注并修正 H100 单元格 - #1574
Merged
Conversation
The cell now runs with a 1040-token RDMA receive ring (InferenceX#4651); at the default depth the two-node BF16 prefill dispatch deadlocks (uccl-project/uccl#1110). The footnote it replaces described an August audit against a since-retired B200 pool. 中文:为 H200 uccl-ep EP16 单元格添加接收环脚注。该单元格现使用 1040 token 的 RDMA 接收环运行(InferenceX#4651);默认深度下双节点 BF16 prefill 的 dispatch 会死锁(uccl-project/uccl#1110)。被取代的脚注描述的是 8 月针对一个 已退役 B200 集群的审计。
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
The H100 pool is AWS EFA. Measured results now back these cells: - uccl-ep EP16 works in both modes; the August init-crash note is gone. - DeepEP V2 normal EP16 is decode only: ~25 ms at T=512 through the NCCL GIN proxy, so the prefill ladder can't finish within the 90-minute case budget. - nccl-ep low-latency EP16 is decode only, for the same reason (~1.2 ms floor at T=1). - DeepEP V2 low-latency EP16 is broken: it needs NVSHMEM IBGDA, which EFA doesn't have, and every rank segfaults at setup. 中文:按 EFA 集群修正 H100 支持矩阵单元格。H100 集群为 AWS EFA,以下单元格现均有实测结果支撑: - uccl-ep EP16 两种模式均可用,移除 8 月的初始化崩溃脚注。 - DeepEP V2 normal EP16 仅有 decode:经 NCCL GIN 代理 T=512 约 25 ms, prefill 梯级无法在 90 分钟单用例时限内完成。 - nccl-ep 低延迟 EP16 同理仅有 decode(T=1 下限约 1.2 ms)。 - DeepEP V2 低延迟 EP16 不可用:其需要 NVSHMEM IBGDA,EFA 不支持, 所有 rank 在初始化时段错误。
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit 7264b5c. Configure here.
The registry enables low-latency EP16 for uccl-ep and nccl-ep on H100 and H200, and those pools have measured, published rows. The notes still said no pool enabled it. - H100 uccl-ep low-latency EP16 gets its own EFA footnote (~3.4 ms at T=1). - H200's DeepEP V2, uccl-ep and nccl-ep low-latency EP16 cells now show as working; the stale virtualized-GDR note is removed. - ll-ep16-not-enabled now refers to the pool (only B200 uses it). - The nccl-ep low-latency notes list the real EP16 pools and include FP8. 中文:使低延迟 EP16 单元格与注册表一致。注册表已在 H100 和 H200 上为 uccl-ep 与 nccl-ep 启用低延迟 EP16,且这些集群已有实测并发布的结果,但脚注仍称没有集群启用。 - H100 uccl-ep 低延迟 EP16 新增 EFA 脚注(T=1 约 3.4 ms)。 - H200 的 DeepEP V2、uccl-ep 与 nccl-ep 低延迟 EP16 单元格改为可用;移除过时的虚拟化 GDR 脚注。 - ll-ep16-not-enabled 改为指本集群(仅 B200 使用)。 - nccl-ep 低延迟脚注列出实际启用 EP16 的集群,并包含 FP8。
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

Summary
H200 uccl-ep EP16 now has a measured prefill row. The cell's footnote says how it runs.
uccl-h200-rdma-recv-ring, replacinguccl-hseries-topend:-rdmarecv1040(InferenceX#4651).H100 cells, corrected for the EFA pool. Measured results now back each of these (run 1793321755):
Low-latency EP16 notes match the registry. The registry enables low-latency EP16 for uccl-ep and nccl-ep on H100 and H200, but the notes said no pool did:
ll-ep16-not-enablednow refers to the pool; only B200 uses it.The unused
uccl-h100-init-crashandhseries-ll-gdrfootnotes are removed. (The AMD cell corrections follow in #1580.) The CollectiveX component tests (73) pass, and oxfmt and oxlint are clean.中文
H200 uccl-ep EP16 现已有实测的 prefill 结果。该单元格的脚注说明了其运行方式。
uccl-h200-rdma-recv-ring,取代uccl-hseries-topend:-rdmarecv1040(InferenceX#4651)。H100 单元格按 EFA 集群修正。 以下各项现均有实测结果支撑(运行 1793321755):
低延迟 EP16 脚注与注册表一致。 注册表已在 H100 和 H200 上为 uccl-ep 与 nccl-ep 启用低延迟 EP16,但脚注称没有集群启用:
ll-ep16-not-enabled改为指本集群,仅 B200 使用。已移除未使用的
uccl-h100-init-crash与hseries-ll-gdr脚注。(AMD 单元格修正见 #1580。)CollectiveX 组件测试(73 项)通过,oxfmt 与 oxlint 检查通过。AI disclosure
This change was written with an AI coding assistant, and reviewed by the author.