Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions docker/Dockerfile.rocm
Original file line number Diff line number Diff line change
Expand Up @@ -2,15 +2,15 @@
# ROCm / gfx950 image for Miles (built on a prebuilt sglang base):
#
# 1. rocm724-mi35x (gfx950, ROCm 7.2.4 / MI350 / MI355X, Python 3.12 base)
# build-arg:SGLANG_IMAGE_REPO=rocm/sgl-dev SGLANG_IMAGE_TAG=v0.5.20-rocm724-mi35x-20260919
# build-arg:SGLANG_IMAGE_REPO=lmsysorg/sglang SGLANG_IMAGE_TAG=v0.5.20-rocm724-mi35x
# WHEELS_TAG_ROCM=rocm724-gfx950-v0.5.20 TE_USE_WHEEL=1 APPLY_ROCR_VMMFIX=1
#
# 2. rocm10-mi35x (gfx950, ROCm 10 / MI350 / MI355X, Python 3.12 base)
# build-arg:SGLANG_IMAGE_REPO=rocm/sgl-dev SGLANG_IMAGE_TAG=v0.5.20-rocm10-mi35x-20260919
# build-arg:SGLANG_IMAGE_REPO=lmsysorg/sglang SGLANG_IMAGE_TAG=v0.5.20-rocm10-mi35x
# WHEELS_TAG_ROCM=rocm10-gfx950-v0.5.18 TE_USE_WHEEL=1 APEX_USE_PREBUILT=1 (cp312 shelf)

ARG SGLANG_IMAGE_REPO=rocm/sgl-dev
ARG SGLANG_IMAGE_TAG=v0.5.20-rocm724-mi35x-20260919
ARG SGLANG_IMAGE_REPO=lmsysorg/sglang
ARG SGLANG_IMAGE_TAG=v0.5.20-rocm724-mi35x
FROM ${SGLANG_IMAGE_REPO}:${SGLANG_IMAGE_TAG} AS sglang

SHELL ["/bin/bash", "-ceuxo", "pipefail"]
Expand Down
8 changes: 4 additions & 4 deletions docker/build.py
Original file line number Diff line number Diff line change
Expand Up @@ -60,8 +60,8 @@
"dockerfile": "docker/Dockerfile.rocm",
"build_args": {
"GPU_ARCH": "gfx950",
"SGLANG_IMAGE_REPO": "rocm/sgl-dev",
"SGLANG_IMAGE_TAG": "v0.5.20-rocm724-mi35x-20260919",
"SGLANG_IMAGE_REPO": "lmsysorg/sglang",
"SGLANG_IMAGE_TAG": "v0.5.20-rocm724-mi35x",
"WHEELS_TAG_ROCM": "rocm724-gfx950-v0.5.20",
"APPLY_ROCR_VMMFIX": "1",
"TE_USE_WHEEL": "1",
Expand All @@ -74,8 +74,8 @@
"dockerfile": "docker/Dockerfile.rocm",
"build_args": {
"GPU_ARCH": "gfx950",
"SGLANG_IMAGE_REPO": "rocm/sgl-dev",
"SGLANG_IMAGE_TAG": "v0.5.20-rocm10-mi35x-20260919",
"SGLANG_IMAGE_REPO": "lmsysorg/sglang",
"SGLANG_IMAGE_TAG": "v0.5.20-rocm10-mi35x",
"WHEELS_TAG_ROCM": "rocm10-gfx950-v0.5.18",
"APEX_USE_PREBUILT": "1",
"TE_USE_WHEEL": "1",
Expand Down
2 changes: 1 addition & 1 deletion docs/developer/ci/02-docker-build.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ The Dockerfile is the build recipe: it provides the cu13 defaults and emits one

**Output** — one `radixark/miles` image for the platform buildx targets: the SGLang base, then the Python dependencies declared in `requirements.txt`, Megatron-LM at its branch default or caller-pinned commit, Miles, and the prebuilt wheels (`sgl-router` among them). It also carries `kubectl`, `helm` and `tmux`, which the k8s-native launch path drives the cluster with. A multi-arch build is one `buildx` run executed once per platform — `TARGETARCH` differs each time, so each arch installs its own wheels — and buildx pushes the two as a single manifest.

`docker/Dockerfile.rocm` is the ROCm counterpart (build-args `GPU_ARCH`, a ROCm `SGLANG_IMAGE_TAG`, and a `WHEELS_TAG_ROCM` release from `XinyuJiangCMU/miles-wheels-rocm`). `rocm724-mi35x` uses the dated Python 3.12 base and ROCm 7.2.4 wheels from the `rocm724-gfx950-v0.5.20` release. It sets `APPLY_ROCR_VMMFIX=1` to install the point-release-matched ROCr VMM-pause fix; ROCm 10 has the fix upstream.
`docker/Dockerfile.rocm` is the ROCm counterpart (build-args `GPU_ARCH`, a ROCm `SGLANG_IMAGE_TAG`, and a `WHEELS_TAG_ROCM` release from `XinyuJiangCMU/miles-wheels-rocm`). Both ROCm variants build on the `lmsysorg/sglang` ROCm images of the same SGLang release as the CUDA base. `rocm724-mi35x` uses the Python 3.12 base and ROCm 7.2.4 wheels from the `rocm724-gfx950-v0.5.20` release. It sets `APPLY_ROCR_VMMFIX=1` to install the point-release-matched ROCr VMM-pause fix; ROCm 10 has the fix upstream.

### `docker/install-kube-tools.sh`

Expand Down
Loading