Skip to content

tt-media-server: serve MiniMax-H3-Image (t2i + edit) on BH Galaxy - #5562

Draft
cglagovichTT wants to merge 3 commits into
mainfrom
cglagovich/minimax-h3-image
Draft

cglagovichTT wants to merge 3 commits into
mainfrom
cglagovich/minimax-h3-image

Conversation

@cglagovichTT

Copy link
Copy Markdown
Contributor

Why: serve MiniMax-H3-Image (open weights) from tt-media-server; needs tenstorrent/tt-metal#65139.

What: model MiniMax-H3-Image / runner tt-minimax-h3-image, one replica on the full 4x8 BH Galaxy; /v1/images/generations (t2i) and /v1/images/edits (reference edit); width/height up to 4096 for this runner only.

Tested: served on a BH Galaxy (exabox); t2i and edit requests end to end, edit output byte-identical to the tt-metal test path.

🤖 Generated with Claude Code

cglagovichTT and others added 3 commits November 10, 2026 12:26
Adds model MiniMax-H3-Image with runner tt-minimax-h3-image: one replica on the
full 4x8 BH Galaxy (latency mode). /v1/images/generations serves text-to-image,
/v1/images/edits uses the request image as the reference. The runner warms one
t2i and one edit at startup. Request width/height may go to 4096 for this
runner only (1536 elsewhere); the step count is ignored (fixed 6-step sampler).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… on first start

The catalog entry downloads the public MiniMaxAI/MiniMax-H3-Image snapshot plus
MiniMax-H3 text_encoder/ (H3-Image ships none). On first start the runner
converts the snapshot once into cache_root/MiniMax-H3-Image-converted (file
lock + marker) and links the text encoder. Warm-up now covers 4K t2i, the
default operating point.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The runner warms through the pipeline warmup() (every text-encoder prompt rung,
a 4K t2i and a 2K edit), so no prompt length compiles on the serving path.
Older tt-metal trees without warmup() get the two warm-up requests.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant