Skip to content

build(container): [cherry-pick 1.7.0] bump EFA installer to 1.51.0, Mooncake 0.3.14, and NIXL refs (#18003) - #18348

Merged
nv-nmailhot merged 2 commits into
release/1.7.0from
dagil-nvidia/cherrypick-1.7.0-efa-mooncake-nixl
Nov 7, 2026
Merged

nv-nmailhot merged 2 commits into
release/1.7.0from
dagil-nvidia/cherrypick-1.7.0-efa-mooncake-nixl

Conversation

@dagil-nvidia

@dagil-nvidia dagil-nvidia commented Nov 6, 2026 •

Copy link
Copy Markdown
Collaborator

Overview

Cherry-pick of #18003 into release/1.7.0. Refs DGH-2454.

Bumps the AWS EFA installer to 1.51.0, the Mooncake transfer engine floor to 0.3.14, and the per-framework NIXL refs for the EFA images.

Pick Notes

Validation

  • Applied cleanly on release/1.7.0 at 9abd2ef (RC2).

…ooncake 0.3.14, and NIXL refs (#18003)

Signed-off-by: Dan Gil <dagil@nvidia.com>
@dagil-nvidia
dagil-nvidia requested review from a team as code owners November 6, 2026 22:17
@github-actions github-actions Bot added build backend::vllm Relates to the vllm backend container labels Nov 6, 2026
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Nov 6, 2026 •

Copy link
Copy Markdown
Codex Review Summary: ✅ Completed

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-11-06T22:18:12.628737Z 62b2710 PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 2 potential issues.

Devin Review

Comment thread container/context.yaml
nixl_ucx_ref: v1.23.0-rc1
vllm_omni_ref: "v0.32.0rc1"
nixl_ref: v1.4.1
nixl_ref: v1.5.0

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 vLLM EFA misses the NIXL upgrade

When the upstream image carries older NIXL, changing nixl_ref leaves vLLM EFA on that version. The CUDA runtime extracts NIXL from upstream instead of the newly built wheel.

Learn more

The framework-level NIXL ref sets NIXL_REF for both wheel construction and runtime stages through the argument template. wheel_builder builds NIXL at that ref, but the CUDA vLLM runtime extracts its libraries from the upstream Python wheel. The AWS extension only copies builder NIXL for TensorRT-LLM. Thus the new value does not control the shipped vLLM CUDA/EFA NIXL version; any version difference between upstream and 1.5.0 remains in the image.

Example: If the pinned upstream vLLM image bundles NIXL 1.4.1, setting nixl_ref: v1.5.0 builds a 1.5.0 SDK but the published vLLM EFA image still loads 1.4.1 from its upstream wheel.

Recommended fix: Install the matching nixl and nixl-cu13 wheels in the CUDA runtime or explicitly overlay the builder's libraries and Python bindings there. Verify the effective Python package version and loaded libnixl.so in the final AWS image.

Devin Review


Was this helpful? React with 👍 or 👎 to provide feedback.

Comment thread container/context.yaml
# Per-arch baseline stem (re-captured against tensorrt-llm/release, both arches).
baseline_sbom: release@93a3eaf1
nixl_ref: v1.3.1
nixl_ref: v1.5.2

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔍 TensorRT-LLM pin also affects non-EFA images

nixl_ref upgrades Python packages in standard TensorRT-LLM images while LD_PRELOAD retains upstream libnixl.so. Check compatibility of the new bindings with that library.

Devin Review


Was this helpful? React with 👍 or 👎 to provide feedback.

@devin-ai-integration

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 42306794534 (attempt 1) on d4e65c40ae

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 42306794534. Updated on every full-CI run of this PR.

@nv-nmailhot
nv-nmailhot merged commit b0e9129 into release/1.7.0 Nov 7, 2026
116 checks passed
@nv-nmailhot
nv-nmailhot deleted the dagil-nvidia/cherrypick-1.7.0-efa-mooncake-nixl branch November 7, 2026 02:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants