[bug] Trying to generate a picture in ai-studio with the Hi-Dream lane results in Image generation failed: ComfyUI generation error

[stage-chuk]

What happened?

After launching ai-studio, I switched to the Hi-Dream lane and tried to generate an image by typing a simple prompt but I was met with a "Image generation failed: ComfyUI generation error" message.

Note: I was unable to complete step 2 of the onboarding steps after running setup-ai-studio.sh.

2. On the 'Studio' function (gear icon), set the 'browser_base' valve to" echo " http://$LANIP:8189 so returned media links open from your browser."

There was no "Studio" function available in the OpenWebUI interface and there were no valves listed under the Function/Studio section of the Controls panel.

Steps to reproduce

* bash scripts/gpu-mode.sh ai-studio
* Open OpenWebUI interface and select Hi-Dream lane
* Type in arbitrary prompt and send
* Notice error

Rig report — paste contents of bash scripts/report.sh [--verify | --soak | --bench | --full]

═══ Switching to AI-STUDIO mode (image · video · audio · voice) ═══
Starting: ComfyUI :8188 (both GPUs) + director :8090 + gallery/orchestrator/image-shim/tts + Open WebUI
Stopping: all GPU-bound LLM serving (Qwen + Gemma + DiffusionGemma)

  ▼ Stopping 27b-dual-mtp...[sudo: authenticate] Password:               
done
  ▼ Stopping 27b-dual-dflash...done
  ▼ Stopping 27b-dflash-noviz...done
  ▼ Stopping 27b-dual-turbo...done
  ▼ Stopping deckard-40b...done
  ▼ Stopping 35b-a3b-dual...done
  ▼ Stopping gemma-mtp...done
  ▼ Stopping gemma-int8...done
  ▼ Stopping gemma-12b...done
  ▼ Stopping diffusiongemma-26b-a4b...done
[+] up 1/1ng comfyui...
 ✔ Container comfyui Started                                                                                                                                             0.5s
done
[+] up 1/1ng studio-director (:8090, GPU0)...
 ✔ Container studio-director Running                                                                                                                                     0.0s
done
[+] up 1/1ng studio-gallery (:8189)...
 ✔ Container studio-gallery Running                                                                                                                                      0.0s
done
[+] Building 1.7s (11/11) FINISHED                                                                                                                                           
 => [internal] load local bake definitions                                                                                                                              0.0s
 => => reading from stdin 606B                                                                                                                                          0.0s
 => [internal] load build definition from Dockerfile                                                                                                                    0.0s
 => => transferring dockerfile: 335B                                                                                                                                    0.0s
 => [internal] load metadata for docker.io/library/python:3.12-slim                                                                                                     1.2s
 => [internal] load .dockerignore                                                                                                                                       0.0s
 => => transferring context: 2B                                                                                                                                         0.0s
 => [1/4] FROM docker.io/library/python:3.12-slim@sha256:6c4dd321d176d61ea848dc8c73a4f7dbae8f70e0ee48bb411ea2f045b599fa8e                                               0.0s
 => => resolve docker.io/library/python:3.12-slim@sha256:6c4dd321d176d61ea848dc8c73a4f7dbae8f70e0ee48bb411ea2f045b599fa8e                                               0.0s
 => [internal] load build context                                                                                                                                       0.0s
 => => transferring context: 37B                                                                                                                                        0.0s
 => CACHED [2/4] RUN apt-get update  && apt-get install -y --no-install-recommends ffmpeg  && rm -rf /var/lib/apt/lists/*                                               0.0s
 => CACHED [3/4] COPY orchestrator.py /app/orchestrator.py                                                                                                              0.0s
 => CACHED [4/4] WORKDIR /app                                                                                                                                           0.0s
 => exporting to image                                                                                                                                                  0.1s
 => => exporting layers                                                                                                                                                 0.0s
 => => exporting manifest sha256:b757d55365635473a12766fe713938aee485cd6d00dbcd4e4e5cd08029ce95b3                                                                       0.0s
 => => exporting config sha256:596c1fc0c5d9ad6438675c585251d4fac7a66e16aeddb3d0e5fc33c6e4f0e991                                                                         0.0s
 => => exporting attestation manifest sha256:0140116ed069cf527d1b5dfcfead10db231732d79f802a6c07308d988a1e6912                                                           0.0s
 => => exporting manifest list sha256:51eedf248ff76e9be8ee3296ef4d08d960dc808469425cc6608d57820734f631                                                                  0.0s
 => => naming to docker.io/library/studio-orchestrator:latest                                                                                                           0.0s
 => => unpacking to docker.io/library/studio-orchestrator:latest                                                                                                        0.0s
 => resolving provenance for metadata file                                                                                                                              0.0s
[+] up 2/2
 ✔ Image studio-orchestrator:latest Built                                                                                                                                1.7s
 ✔ Container studio-orchestrator    Started                                                                                                                             10.3s
done
[+] Building 0.7s (11/11) FINISHED                                                                                                                                           
 => [internal] load local bake definitions                                                                                                                              0.0s
 => => reading from stdin 592B                                                                                                                                          0.0s
 => [internal] load build definition from Dockerfile                                                                                                                    0.0s
 => => transferring dockerfile: 192B                                                                                                                                    0.0s
 => [internal] load metadata for docker.io/library/python:3.12-slim                                                                                                     0.3s
 => [internal] load .dockerignore                                                                                                                                       0.0s
 => => transferring context: 2B                                                                                                                                         0.0s
 => [1/4] FROM docker.io/library/python:3.12-slim@sha256:6c4dd321d176d61ea848dc8c73a4f7dbae8f70e0ee48bb411ea2f045b599fa8e                                               0.1s
 => => resolve docker.io/library/python:3.12-slim@sha256:6c4dd321d176d61ea848dc8c73a4f7dbae8f70e0ee48bb411ea2f045b599fa8e                                               0.0s
 => [internal] load build context                                                                                                                                       0.0s
 => => transferring context: 29B                                                                                                                                        0.0s
 => CACHED [2/4] RUN pip install --no-cache-dir aiohttp==3.10.11                                                                                                        0.0s
 => CACHED [3/4] WORKDIR /app                                                                                                                                           0.0s
 => CACHED [4/4] COPY shim.py /app/shim.py                                                                                                                              0.0s
 => exporting to image                                                                                                                                                  0.1s
 => => exporting layers                                                                                                                                                 0.0s
 => => exporting manifest sha256:1ee60122df59c6c4d008b1984b0bf8b352c15a8439431336a979204b3347653f                                                                       0.0s
 => => exporting config sha256:4c76470dc1f87cf962b59518788a89d5f55126cc551b2c1adf5973eb0d4cb652                                                                         0.0s
 => => exporting attestation manifest sha256:1710390468de23c5f89dd98fefb2256c82db5fa86c9efd910a02db43248a6618                                                           0.0s
 => => exporting manifest list sha256:aab5fb8e972370ee60c4db0a22079f01aafec51a7ce736d8a0189c64d9fcf5d6                                                                  0.0s
 => => naming to docker.io/library/studio-image-shim:latest                                                                                                             0.0s
 => => unpacking to docker.io/library/studio-image-shim:latest                                                                                                          0.0s
 => resolving provenance for metadata file                                                                                                                              0.0s
[+] up 2/2
 ✔ Image studio-image-shim:latest Built                                                                                                                                  0.7s
 ✔ Container studio-image-shim    Started                                                                                                                                0.3s
done
[+] Building 0.7s (12/12) FINISHED                                                                                                                                           
 => [internal] load local bake definitions                                                                                                                              0.0s
 => => reading from stdin 543B                                                                                                                                          0.0s
 => [internal] load build definition from Dockerfile                                                                                                                    0.0s
 => => transferring dockerfile: 517B                                                                                                                                    0.0s
 => [internal] load metadata for docker.io/library/python:3.12-slim                                                                                                     0.3s
 => [internal] load .dockerignore                                                                                                                                       0.0s
 => => transferring context: 2B                                                                                                                                         0.0s
 => [1/5] FROM docker.io/library/python:3.12-slim@sha256:6c4dd321d176d61ea848dc8c73a4f7dbae8f70e0ee48bb411ea2f045b599fa8e                                               0.1s
 => => resolve docker.io/library/python:3.12-slim@sha256:6c4dd321d176d61ea848dc8c73a4f7dbae8f70e0ee48bb411ea2f045b599fa8e                                               0.0s
 => [internal] load build context                                                                                                                                       0.0s
 => => transferring context: 28B                                                                                                                                        0.0s
 => CACHED [2/5] RUN apt-get update && apt-get install -y --no-install-recommends         espeak-ng ffmpeg libsndfile1     && rm -rf /var/lib/apt/lists/*               0.0s
 => CACHED [3/5] RUN pip install --no-cache-dir kokoro-onnx soundfile aiohttp                                                                                           0.0s
 => CACHED [4/5] WORKDIR /app                                                                                                                                           0.0s
 => CACHED [5/5] COPY tts.py /app/tts.py                                                                                                                                0.0s
 => exporting to image                                                                                                                                                  0.1s
 => => exporting layers                                                                                                                                                 0.0s
 => => exporting manifest sha256:0ca8e525256febf5ea214c5c5ae49eb76c954f456d2fbaed06ab8cbc211f1e5c                                                                       0.0s
 => => exporting config sha256:544dcd89338a3b82113d10a357423b952a869974e6a6b91557d3cb35e56a7f32                                                                         0.0s
 => => exporting attestation manifest sha256:457bcb392a8afc51f741bbe09439f8a1c22289cd86822810a8865926f4587588                                                           0.0s
 => => exporting manifest list sha256:8d5d40923ba99f9035ba2fa1cc7926fae1d659143cf157558ba7aeca0b5be94e                                                                  0.0s
 => => naming to docker.io/library/studio-tts:latest                                                                                                                    0.0s
 => => unpacking to docker.io/library/studio-tts:latest                                                                                                                 0.0s
 => resolving provenance for metadata file                                                                                                                              0.0s
[+] up 2/2
 ✔ Image studio-tts:latest Built                                                                                                                                         0.7s
 ✔ Container studio-tts    Started                                                                                                                                       0.4s
done
[+] Building 1.5s (14/14) FINISHED                                                                                                                                           
 => [internal] load local bake definitions                                                                                                                              0.0s
 => => reading from stdin 592B                                                                                                                                          0.0s
 => [internal] load build definition from Dockerfile                                                                                                                    0.0s
 => => transferring dockerfile: 1.99kB                                                                                                                                  0.0s
 => [internal] load metadata for docker.io/pytorch/pytorch:2.7.0-cuda12.8-cudnn9-runtime                                                                                1.0s
 => [internal] load .dockerignore                                                                                                                                       0.0s
 => => transferring context: 2B                                                                                                                                         0.0s
 => [1/7] FROM docker.io/pytorch/pytorch:2.7.0-cuda12.8-cudnn9-runtime@sha256:7db0e1bf4b1ac274ea09cf6358ab516f8a5c7d3d0e02311bed445f7e236a5d80                          0.0s
 => => resolve docker.io/pytorch/pytorch:2.7.0-cuda12.8-cudnn9-runtime@sha256:7db0e1bf4b1ac274ea09cf6358ab516f8a5c7d3d0e02311bed445f7e236a5d80                          0.0s
 => [internal] load build context                                                                                                                                       0.0s
 => => transferring context: 31B                                                                                                                                        0.0s
 => CACHED [2/7] RUN apt-get update && apt-get install -y --no-install-recommends         git ffmpeg libsndfile1     && rm -rf /var/lib/apt/lists/*                     0.0s
 => CACHED [3/7] RUN git clone https://github.com/Saganaki22/ComfyUI-Step_Audio_EditX_TTS.git /opt/step     && git -C /opt/step checkout d8eddc6618fdbe14a10cc99d13360  0.0s
 => CACHED [4/7] RUN pip install --no-cache-dir -r /opt/step/requirements.txt                                                                                           0.0s
 => CACHED [5/7] RUN pip install --no-cache-dir aiohttp einops ffmpeg-python rotary_embedding_torch                                                                     0.0s
 => CACHED [6/7] COPY server.py /opt/server.py                                                                                                                          0.0s
 => CACHED [7/7] WORKDIR /opt                                                                                                                                           0.0s
 => exporting to image                                                                                                                                                  0.1s
 => => exporting layers                                                                                                                                                 0.0s
 => => exporting manifest sha256:9c555fabeac51aeac8f757f0c2aa34a581902463463b0b2696f4b49b0a544b98                                                                       0.0s
 => => exporting config sha256:1ef190b2f8a5904bb798a14c6cc77191de69a7bfea4a1e69ac7254a8a7ad8f5a                                                                         0.0s
 => => exporting attestation manifest sha256:38a739e057a6e1f6e5044a179067259658e32f81c097612cc2e7366a999ed6b8                                                           0.0s
 => => exporting manifest list sha256:8b6ff055b050462ad3144fc88c6e9fd5f7439b9ebe451dd0459bf3ae5c08f2ae                                                                  0.0s
 => => naming to docker.io/library/studio-step-voice:latest                                                                                                             0.0s
 => => unpacking to docker.io/library/studio-step-voice:latest                                                                                                          0.0s
 => resolving provenance for metadata file                                                                                                                              0.0s
[+] up 2/2
 ✔ Image studio-step-voice:latest Built                                                                                                                                  1.6s
 ✔ Container studio-step-voice    Started                                                                                                                                0.5s
done
[+] up 1/1ng openwebui...
 ✔ Container open-webui Running                                                                                                                                          0.0s
done
[+] up 1/1ng litellm...  
 ✔ Container litellm Running                                                                                                                                             0.0s
done
[+] up 1/1ng qdrant...   
 ✔ Container qdrant Running                                                                                                                                              0.0s
done
[+] up 1/1ng searxng...  
 ✔ Container searxng Running                                                                                                                                             0.0s
done

AI-studio mode active. — one scene; pick the lane in Open WebUI.
  Open WebUI:  http://192.168.86.33:8080   (image · video · music · SFX · voice lanes)
  Gallery:     http://192.168.86.33:8189   (all generated media; survives ComfyUI down)
  ComfyUI:     http://192.168.86.33:8188   (full node graph / control)
First ComfyUI boot can take a few min (clones + node deps). Video DiT splits across both 3090s (DisTorch); image/audio lanes run on GPU0 beside the director.
GPU-mutex with the dual-card LLMs. Premium voice (step-audio-editx) is on-demand on GPU1 — mutually exclusive with an active video render.
Tail: sudo docker logs -f comfyui

Anything else?

#

[noonghunna]

Thanks for the detailed report! Two separate things here — taking them one at a time, and I've shipped a couple of fixes to help with both.

1. "No Studio function / no valves in Open WebUI"

The 🎬 Studio lane picker is an OWUI function that setup-ai-studio.sh installs in step 4 (push-pipe-to-owui.sh) — and that install requires an Open WebUI admin account to already exist. On a fresh machine you create that by signing up at the OWUI URL (the first account becomes admin). If setup-ai-studio.sh ran before you'd signed up, the pipe install was skipped (it can't write the function without an admin user) — which is exactly why there's no Studio function and no browser_base valve to set.

To fix it now:

1. Open http://<your-ip>:8080 and sign up (first account = admin).
2. Install the lanes:

   bash services/studio/push-pipe-to-owui.sh

3. Reload OWUI — the 🎬 Studio lanes appear in the model selector, and the valves (incl. browser_base) show under Admin → Functions → Studio.

I also just made this much harder to miss: on a fresh install where the pipe gets skipped, setup-ai-studio.sh now prints a loud, numbered "⚠ INSTALL THE STUDIO LANES" step with that exact command (#527), instead of a warning that scrolls past.

2. "Image generation failed: ComfyUI generation error" on the HiDream lane

That error is raised by ComfyUI, and the real cause is in its log (a missing model, a custom-node load failure, OOM, …) — which we can't see from here. I added a flag to report.sh that captures exactly that (#526). Once the lanes are installed, could you reproduce the HiDream failure and run:

bash scripts/report.sh --studio > studio-report.md

then paste the output? It appends the ComfyUI container log tail (the actual generation error), which will show whether the HiDream model finished downloading and whether its custom node loaded.

One quick question to untangle the two: when you hit the HiDream error, was the Studio function actually installed at that point? Just making sure we're chasing the right state.

Thanks again — with the --studio log we should pin the HiDream failure down quickly.

[stage-chuk]

1. Ah yes, the option was actually in the Admin panel and I didn't know that was where to find it. I did install the pipe stuff after making an account, but thanks for the change. It should make it clearer.
2. This is the output of the report:

club-3090 rig report

Generated: 2026-06-30 01:42:09 UTC

Redacted output (paths, host, user, tokens). Re-run with --no-redact for full data.

System

• OS: Ubuntu 26.04 LTS
• Kernel: 7.0.0-27-generic
• Environment: bare metal
• Locale: en_US.UTF-8
• Timezone: JST
• Uptime: up 15 hours, 29 minutes

CPU + RAM

• CPU: AMD Ryzen 7 5800X3D 8-Core Processor (16 threads)
• RAM: 60Gi total, 50Gi available
• Swap: 8.0Gi

Disk

• <MODEL_DIR>: 1.5T available, ext4 filesystem
• /var/lib/docker: 1.5T available, ext4 filesystem

GPU hardware

• GPU 0: NVIDIA GeForce RTX 3090 | 24576 MiB | driver 610.43.02 | VBIOS 94.02.42.00.F1 | persistence=Enabled
  • Power: limit=250.00 W (default=370.00 W, max=380.00 W) | current_draw=108.25 W ⚠ user-capped below default
  • PCIe: x4 lanes negotiated (GPU max x16, Gen up to 4) | bus 00000000:04:00.0 ⚠ slot is narrower than GPU capability — affects load + all-reduce bandwidth
• GPU 1: NVIDIA GeForce RTX 3090 | 24576 MiB | driver 610.43.02 | VBIOS 94.02.42.00.F1 | persistence=Enabled
  • Power: limit=250.00 W (default=370.00 W, max=380.00 W) | current_draw=39.12 W ⚠ user-capped below default
  • PCIe: x16 lanes negotiated (GPU max x16, Gen up to 3) | bus 00000000:0A:00.0
• ECC mode: [N/A] (3090s don't have ECC; expect N/A)

NVLink

No NVLink detected (PCIe-only)

Topology

PCIe / GPU topology matrix

	GPU0	GPU1	CPU Affinity	NUMA Affinity	GPU NUMA ID
GPU0	 X 	PHB	0-15	0		N/A
GPU1	PHB	 X 	0-15	0		N/A

Legend:

  X    = Self
  SYS  = Connection traversing PCIe as well as the SMP interconnect between NUMA nodes (e.g., QPI/UPI)
  NODE = Connection traversing PCIe as well as the interconnect between PCIe Host Bridges within a NUMA node
  PHB  = Connection traversing PCIe as well as a PCIe Host Bridge (typically the CPU)
  PXB  = Connection traversing multiple PCIe bridges (without traversing the PCIe Host Bridge)
  PIX  = Connection traversing at most a single PCIe bridge
  NV#  = Connection traversing a bonded set of # NVLinks

PCIe / P2P detail (lspci)

lspci PCIe/P2P detail (LnkSta / ACS / topology)

_Note: sudo unavailable/non-interactive — running lspci without root; ACS capability lines may be incomplete (LnkSta still accurate)._

# lspci -t  (PCIe topology tree)
-[0000:00]-+-00.0
           +-00.2
           +-01.0
           +-01.1-[01]----00.0
           +-01.2-[02-09]----00.0-[03-09]--+-01.0-[04]--+-00.0
           |                               |            \-00.1
           |                               +-03.0-[05]----00.0
           |                               +-04.0-[06]----00.0
           |                               +-08.0-[07]--+-00.0
           |                               |            +-00.1
           |                               |            \-00.3
           |                               +-09.0-[08]----00.0
           |                               \-0a.0-[09]----00.0
           +-02.0
           +-03.0
           +-03.1-[0a]--+-00.0
           |            \-00.1
           +-04.0
           +-05.0
           +-07.0
           +-07.1-[0b]----00.0
           +-08.0
           +-08.1-[0c]--+-00.0
           |            +-00.1
           |            +-00.3
           |            \-00.4
           +-14.0
           +-14.3
           +-18.0
           +-18.1
           +-18.2
           +-18.3
           +-18.4
           +-18.5
           +-18.6
           \-18.7

# lspci -vvv -s 0000:04:00.0  (GPU function: LnkCap/LnkSta/ACSCap/ACSCtl)
  (no matching LnkCap/LnkSta/ACSCap/ACSCtl lines)

# lspci -vvv -s 0000:03:01.0  (upstream bridge of 0000:04:00.0: LnkCap/LnkSta/ACSCap/ACSCtl)
  (no matching LnkCap/LnkSta/ACSCap/ACSCtl lines)

# lspci -vvv -s 0000:0a:00.0  (GPU function: LnkCap/LnkSta/ACSCap/ACSCtl)
  (no matching LnkCap/LnkSta/ACSCap/ACSCtl lines)

# lspci -vvv -s 0000:00:03.1  (upstream bridge of 0000:0a:00.0: LnkCap/LnkSta/ACSCap/ACSCtl)
  (no matching LnkCap/LnkSta/ACSCap/ACSCtl lines)

# lspci -nnk | grep -A3 -i nvidia  (driver binding + device IDs)
04:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA102 [GeForce RTX 3090] [10de:2204] (rev a1)
	Subsystem: Micro-Star International Co., Ltd. [MSI] Device [1462:3884]
	Kernel driver in use: nvidia
	Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia
04:00.1 Audio device [0403]: NVIDIA Corporation GA102 High Definition Audio Controller [10de:1aef] (rev a1)
	Subsystem: Micro-Star International Co., Ltd. [MSI] Device [1462:3884]
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel
--
0a:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA102 [GeForce RTX 3090] [10de:2204] (rev a1)
	Subsystem: Micro-Star International Co., Ltd. [MSI] Device [1462:3884]
	Kernel driver in use: nvidia
	Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia
0a:00.1 Audio device [0403]: NVIDIA Corporation GA102 High Definition Audio Controller [10de:1aef] (rev a1)
	Subsystem: Micro-Star International Co., Ltd. [MSI] Device [1462:3884]
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel

Full nvidia-smi

Full nvidia-smi output

Tue Jun 30 10:42:10 2026       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 610.43.02              KMD Version: 610.43.02     CUDA UMD Version: 13.3     |
+-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 3090        On  |   00000000:04:00.0 Off |                  N/A |
| 39%   63C    P2            109W /  250W |    5572MiB /  24576MiB |      3%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
|   1  NVIDIA GeForce RTX 3090        On  |   00000000:0A:00.0  On |                  N/A |
|  0%   51C    P5             39W /  250W |    1175MiB /  24576MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A            7359    C+G   ...c/gnome-remote-desktop-daemon        725MiB |
|    0   N/A  N/A            7405      G   /usr/bin/gnome-shell                      4MiB |
|    0   N/A  N/A          113539      C   python                                  256MiB |
|    0   N/A  N/A          113744      C   /app/llama-server                      4546MiB |
|    1   N/A  N/A            7405      G   /usr/bin/gnome-shell                    340MiB |
|    1   N/A  N/A            8887    C+G   /usr/bin/nautilus                        37MiB |
|    1   N/A  N/A            8910      G   /usr/bin/Xwayland                         6MiB |
|    1   N/A  N/A            9002    C+G   ptyxis                                  185MiB |
|    1   N/A  N/A           13723    C+G   /usr/bin/resources                       33MiB |
|    1   N/A  N/A          113539      C   python                                  256MiB |
|    1   N/A  N/A          117457    C+G   ...rack-uuid=3190708988185955192        119MiB |
|    1   N/A  N/A          120657    C+G   /usr/bin/gnome-text-editor               33MiB |
+-----------------------------------------------------------------------------------------+

Display / desktop state

• $DISPLAY: :0 (X11 / Wayland session present)
• $WAYLAND_DISPLAY: wayland-0
• Display processes running: Xwayland gnome-shell
• GPU 0 idle VRAM: 5572 MiB ⚠ something is using this GPU (display, browser, container)
• GPU 1 idle VRAM: 1175 MiB ⚠ something is using this GPU (display, browser, container)

Container runtime

• Docker: 29.6.1
• docker compose (v2): 5.2.0
• NVIDIA Container Toolkit: 1.19.1

Stack version

• club-3090: v0.10.0-26-gb8c4ce5-dirty (branch: master, SHA b8c4ce5)
• Working tree: ⚠ has uncommitted changes (run git status to inspect)
• GENESIS_PIN default: 7b9fd319 (per scripts/setup.sh)
• Cached vLLM images:
  • tag v0.22.0 digest sha256:0fec7ec5f3e6bc168e54899935fb0557da908a4832a1dbc88e2debcf2f889416 (4 weeks ago)

Profile state

• Profile schema version: 1
• Profile counts: 9 hardware, 10 models, 5 workloads, 13 engines, 11 drafters
• Compose registry: 55 entries
• Canonical scenarios: 9
• Calibration:
  • gemma-4-12b: 1 rows
  • gemma-4-26b-a4b: 0 rows
  • gemma-4-31b: 3 rows
  • qwen3.6-27b: 2 rows
  • qwen3.6-35b-a3b: 1 rows
• Active estate: none (~/.club3090/estate.yml not found)

KV math calibration

• Overall: 7/7 (100%)
• No FAIL rows. kv-calc projections should agree with measured VRAM within the ±1.5 GB error band.

Full kv-calc --calibration output

========================================================================================
Calibration — predicted per-card VRAM vs measured BENCHMARKS rows
========================================================================================

  Predicted = weights + activation + overhead + drafter + (KV capped at available).
  Budget = mem_util × VRAM. Measured = nvidia-smi peak during bench (target ≈ budget).
  Verdict ✓ iff PASS/TIGHT and measured < VRAM (boot OK).

== qwen3.6-27b ==
  compose                     predicted    budget   measured  verdict
  ─────────────────────────   ─────────  ────────  ─────────  ───────
  dual                          19.91 GB   22.80 GB    23.60 GB    PASS ✓
  minimal@64K                   21.60 GB   21.60 GB    22.40 GB   TIGHT ✓

  Verdict accuracy: 2/2 (100%)

== qwen3.6-35b-a3b ==
  compose                     predicted    budget   measured  verdict
  ─────────────────────────   ─────────  ────────  ─────────  ───────
  qwen-35b-a3b-dual             13.68 GB   22.08 GB    22.10 GB    PASS ✓

  Verdict accuracy: 1/1 (100%)

== gemma-4-31b ==
  compose                     predicted    budget   measured  verdict
  ─────────────────────────   ─────────  ────────  ─────────  ───────
  gemma-dual-int8               22.80 GB   22.80 GB    22.20 GB   TIGHT ✓
  gemma-dual                    22.80 GB   22.80 GB    22.50 GB   TIGHT ✓
  gemma-dual-int8@256K          22.80 GB   22.80 GB    22.50 GB   TIGHT ✓

  Verdict accuracy: 3/3 (100%)

== gemma-4-12b ==
  compose                     predicted    budget   measured  verdict
  ─────────────────────────   ─────────  ────────  ─────────  ───────
  gemma-dual                    21.60 GB   21.60 GB    21.60 GB   TIGHT ✓

  Verdict accuracy: 1/1 (100%)

Overall: 7/7 (100%)

Notes:
  - This is a directional estimator (±1.5 GB error band on the breakdown).
  - vLLM's `gpu_worker.py` boot log is the authoritative source.
  - If predicted PASS but measured > budget, file an issue with `scripts/report.sh --bench`.

Active container

No vLLM, llama.cpp, or estate container running. Start one with bash scripts/launch.sh and re-run for the full report.

Recent failed boot attempts

No recently-exited vLLM or llama.cpp containers found.

AI Studio logs (--studio)

Container log tails for image/video/audio generation bugs. ComfyUI carries the workflow
execution trace (the actual generation error). Redacted; pass --no-redact for full paths.

comfyui — Up 4 minutes (last 400 lines)

Requirement already satisfied: gguf>=0.17.1 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 9)) (0.19.0)
Requirement already satisfied: opencv-python in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 10)) (4.13.0.92)
Requirement already satisfied: scipy in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 11)) (1.17.1)
Requirement already satisfied: wcwidth in /opt/conda/lib/python3.11/site-packages (from ftfy->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 1)) (0.2.13)
Requirement already satisfied: numpy>=1.17 in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (2.2.5)
Requirement already satisfied: packaging>=20.0 in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (24.2)
Requirement already satisfied: psutil in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (7.0.0)
Requirement already satisfied: pyyaml in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (6.0.2)
Requirement already satisfied: torch>=2.0.0 in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (2.7.0+cu128)
Requirement already satisfied: huggingface_hub>=0.21.0 in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.21.0)
Requirement already satisfied: safetensors>=0.4.3 in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (0.8.0)
Requirement already satisfied: importlib_metadata in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (9.0.0)
Requirement already satisfied: filelock in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (3.18.0)
Requirement already satisfied: httpx<1.0.0 in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (0.28.1)
Requirement already satisfied: regex!=2019.12.17 in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (2026.6.28)
Requirement already satisfied: requests in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (2.32.3)
Requirement already satisfied: Pillow in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (11.0.0)
Requirement already satisfied: transformers in /opt/conda/lib/python3.11/site-packages (from peft>=0.17.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 5)) (5.12.1)
Requirement already satisfied: tqdm in /opt/conda/lib/python3.11/site-packages (from peft>=0.17.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 5)) (4.67.1)
Requirement already satisfied: anyio in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (4.14.1)
Requirement already satisfied: certifi in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (2025.1.31)
Requirement already satisfied: httpcore==1.* in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (1.0.9)
Requirement already satisfied: idna in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (3.10)
Requirement already satisfied: h11>=0.16 in /opt/conda/lib/python3.11/site-packages (from httpcore==1.*->httpx<1.0.0->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (0.16.0)
Requirement already satisfied: click>=8.4.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (8.4.2)
Requirement already satisfied: fsspec>=2023.5.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (2025.3.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.5.1 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.5.1)
Requirement already satisfied: typer<0.26.0,>=0.20.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (0.25.1)
Requirement already satisfied: typing-extensions>=4.1.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (4.15.0)
Requirement already satisfied: charset_normalizer<4,>=2 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (3.4.1)
Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (2.3.0)
Requirement already satisfied: sympy>=1.13.3 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.13.3)
Requirement already satisfied: networkx in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (3.4.2)
Requirement already satisfied: jinja2 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (3.1.6)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.7.1.26 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (9.7.1.26)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.13.0.11)
Requirement already satisfied: triton==3.3.0 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (3.3.0)
Requirement already satisfied: setuptools>=40.8.0 in /opt/conda/lib/python3.11/site-packages (from triton==3.3.0->torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (75.8.2)
Requirement already satisfied: zipp>=3.20 in /opt/conda/lib/python3.11/site-packages (from importlib_metadata->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (3.21.0)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /opt/conda/lib/python3.11/site-packages (from transformers->peft>=0.17.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 5)) (0.22.2)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.11/site-packages (from sympy>=1.13.3->torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.3.0)
Requirement already satisfied: shellingham>=1.3.0 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.5.4)
Requirement already satisfied: rich>=13.8.0 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (15.0.0)
Requirement already satisfied: annotated-doc>=0.0.2 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (0.0.4)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.11/site-packages (from jinja2->torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (3.0.2)
Requirement already satisfied: markdown-it-py>=2.2.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (4.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (2.19.1)
Requirement already satisfied: mdurl~=0.1 in /opt/conda/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (0.1.2)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
[bootstrap] Installing requirements for ComfyUI-nunchaku...
Requirement already satisfied: diffusers>=0.35 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (0.38.0)
Requirement already satisfied: transformers>=4.54 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (5.12.1)
Requirement already satisfied: sentencepiece in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 3)) (0.2.1)
Requirement already satisfied: protobuf in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 4)) (7.35.1)
Requirement already satisfied: huggingface_hub>=0.34 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 5)) (1.21.0)
Requirement already satisfied: tomli in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 6)) (2.4.1)
Requirement already satisfied: peft>=0.17 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (0.19.1)
Requirement already satisfied: accelerate>=1.10 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 8)) (1.14.0)
Requirement already satisfied: insightface in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (1.0.1)
Requirement already satisfied: opencv-python in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 10)) (4.13.0.92)
Requirement already satisfied: facexlib in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (0.3.0)
Requirement already satisfied: onnxruntime in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 12)) (1.27.0)
Requirement already satisfied: timm in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 13)) (1.0.27)
Requirement already satisfied: importlib_metadata in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (9.0.0)
Requirement already satisfied: filelock in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (3.18.0)
Requirement already satisfied: httpx<1.0.0 in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (0.28.1)
Requirement already satisfied: numpy in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (2.2.5)
Requirement already satisfied: regex!=2019.12.17 in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (2026.6.28)
Requirement already satisfied: requests in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (2.32.3)
Requirement already satisfied: safetensors>=0.8.0-rc.0 in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (0.8.0)
Requirement already satisfied: Pillow in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (11.0.0)
Requirement already satisfied: packaging>=20.0 in /opt/conda/lib/python3.11/site-packages (from transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (24.2)
Requirement already satisfied: pyyaml>=5.1 in /opt/conda/lib/python3.11/site-packages (from transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (6.0.2)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /opt/conda/lib/python3.11/site-packages (from transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (0.22.2)
Requirement already satisfied: typer in /opt/conda/lib/python3.11/site-packages (from transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (0.25.1)
Requirement already satisfied: tqdm>=4.60 in /opt/conda/lib/python3.11/site-packages (from transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (4.67.1)
Requirement already satisfied: click>=8.4.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.34->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 5)) (8.4.2)
Requirement already satisfied: fsspec>=2023.5.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.34->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 5)) (2025.3.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.5.1 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.34->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 5)) (1.5.1)
Requirement already satisfied: typing-extensions>=4.1.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.34->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 5)) (4.15.0)
Requirement already satisfied: psutil in /opt/conda/lib/python3.11/site-packages (from peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (7.0.0)
Requirement already satisfied: torch>=1.13.0 in /opt/conda/lib/python3.11/site-packages (from peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (2.7.0+cu128)
Requirement already satisfied: onnx in /opt/conda/lib/python3.11/site-packages (from insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (1.22.0)
Requirement already satisfied: scipy in /opt/conda/lib/python3.11/site-packages (from insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (1.17.1)
Requirement already satisfied: scikit-image in /opt/conda/lib/python3.11/site-packages (from insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (0.26.0)
Requirement already satisfied: filterpy in /opt/conda/lib/python3.11/site-packages (from facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (1.4.5)
Requirement already satisfied: numba in /opt/conda/lib/python3.11/site-packages (from facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (0.65.1)
Requirement already satisfied: torchvision in /opt/conda/lib/python3.11/site-packages (from facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (0.22.0+cu128)
Requirement already satisfied: flatbuffers in /opt/conda/lib/python3.11/site-packages (from onnxruntime->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 12)) (25.12.19)
Requirement already satisfied: anyio in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (4.14.1)
Requirement already satisfied: certifi in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (2025.1.31)
Requirement already satisfied: httpcore==1.* in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (1.0.9)
Requirement already satisfied: idna in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (3.10)
Requirement already satisfied: h11>=0.16 in /opt/conda/lib/python3.11/site-packages (from httpcore==1.*->httpx<1.0.0->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (0.16.0)
Requirement already satisfied: sympy>=1.13.3 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (1.13.3)
Requirement already satisfied: networkx in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (3.4.2)
Requirement already satisfied: jinja2 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (3.1.6)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.7.1.26 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (9.7.1.26)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (1.13.0.11)
Requirement already satisfied: triton==3.3.0 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (3.3.0)
Requirement already satisfied: setuptools>=40.8.0 in /opt/conda/lib/python3.11/site-packages (from triton==3.3.0->torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (75.8.2)
Requirement already satisfied: shellingham>=1.3.0 in /opt/conda/lib/python3.11/site-packages (from typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (1.5.4)
Requirement already satisfied: rich>=13.8.0 in /opt/conda/lib/python3.11/site-packages (from typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (15.0.0)
Requirement already satisfied: annotated-doc>=0.0.2 in /opt/conda/lib/python3.11/site-packages (from typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (0.0.4)
Requirement already satisfied: matplotlib in /opt/conda/lib/python3.11/site-packages (from filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (3.11.0)
Requirement already satisfied: zipp>=3.20 in /opt/conda/lib/python3.11/site-packages (from importlib_metadata->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (3.21.0)
Requirement already satisfied: llvmlite<0.48,>=0.47.0dev0 in /opt/conda/lib/python3.11/site-packages (from numba->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (0.47.0)
Requirement already satisfied: ml_dtypes>=0.5.4 in /opt/conda/lib/python3.11/site-packages (from onnx->insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (0.5.4)
Requirement already satisfied: charset_normalizer<4,>=2 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (3.4.1)
Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (2.3.0)
Requirement already satisfied: imageio!=2.35.0,>=2.33 in /opt/conda/lib/python3.11/site-packages (from scikit-image->insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (2.37.3)
Requirement already satisfied: tifffile>=2022.8.12 in /opt/conda/lib/python3.11/site-packages (from scikit-image->insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (2026.3.3)
Requirement already satisfied: lazy-loader>=0.4 in /opt/conda/lib/python3.11/site-packages (from scikit-image->insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (0.5)
Requirement already satisfied: markdown-it-py>=2.2.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (4.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (2.19.1)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.11/site-packages (from sympy>=1.13.3->torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.11/site-packages (from jinja2->torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (3.0.2)
Requirement already satisfied: contourpy>=1.0.1 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (1.3.3)
Requirement already satisfied: cycler>=0.10 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (4.63.0)
Requirement already satisfied: kiwisolver>=1.3.1 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (1.5.0)
Requirement already satisfied: pyparsing>=3 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (3.3.2)
Requirement already satisfied: python-dateutil>=2.7 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (2.9.0.post0)
Requirement already satisfied: mdurl~=0.1 in /opt/conda/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.8.0->typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (0.1.2)
Requirement already satisfied: six>=1.5 in /opt/conda/lib/python3.11/site-packages (from python-dateutil>=2.7->matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (1.17.0)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
[bootstrap] Installing requirements for HiDream_O1-ComfyUI...
Requirement already satisfied: accelerate in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 1)) (1.14.0)
Requirement already satisfied: diffusers in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (0.38.0)
Requirement already satisfied: einops in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 3)) (0.8.2)
Requirement already satisfied: huggingface_hub in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (1.21.0)
Requirement already satisfied: numpy in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 5)) (2.2.5)
Requirement already satisfied: pillow in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 6)) (11.0.0)
Requirement already satisfied: scipy in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 7)) (1.17.1)
Requirement already satisfied: safetensors in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 8)) (0.8.0)
Requirement already satisfied: torch in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (2.7.0+cu128)
Requirement already satisfied: torchvision in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 10)) (0.22.0+cu128)
Requirement already satisfied: transformers>=4.57.1 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 11)) (5.12.1)
Requirement already satisfied: typing_extensions in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 12)) (4.15.0)
Requirement already satisfied: tqdm in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 13)) (4.67.1)
Requirement already satisfied: packaging>=20.0 in /opt/conda/lib/python3.11/site-packages (from accelerate->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 1)) (24.2)
Requirement already satisfied: psutil in /opt/conda/lib/python3.11/site-packages (from accelerate->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 1)) (7.0.0)
Requirement already satisfied: pyyaml in /opt/conda/lib/python3.11/site-packages (from accelerate->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 1)) (6.0.2)
Requirement already satisfied: importlib_metadata in /opt/conda/lib/python3.11/site-packages (from diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (9.0.0)
Requirement already satisfied: filelock in /opt/conda/lib/python3.11/site-packages (from diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (3.18.0)
Requirement already satisfied: httpx<1.0.0 in /opt/conda/lib/python3.11/site-packages (from diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (0.28.1)
Requirement already satisfied: regex!=2019.12.17 in /opt/conda/lib/python3.11/site-packages (from diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (2026.6.28)
Requirement already satisfied: requests in /opt/conda/lib/python3.11/site-packages (from diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (2.32.3)
Requirement already satisfied: click>=8.4.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (8.4.2)
Requirement already satisfied: fsspec>=2023.5.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (2025.3.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.5.1 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (1.5.1)
Requirement already satisfied: typer<0.26.0,>=0.20.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (0.25.1)
Requirement already satisfied: sympy>=1.13.3 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (1.13.3)
Requirement already satisfied: networkx in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (3.4.2)
Requirement already satisfied: jinja2 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (3.1.6)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.7.1.26 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (9.7.1.26)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (1.13.0.11)
Requirement already satisfied: triton==3.3.0 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (3.3.0)
Requirement already satisfied: setuptools>=40.8.0 in /opt/conda/lib/python3.11/site-packages (from triton==3.3.0->torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (75.8.2)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /opt/conda/lib/python3.11/site-packages (from transformers>=4.57.1->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 11)) (0.22.2)
Requirement already satisfied: anyio in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (4.14.1)
Requirement already satisfied: certifi in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (2025.1.31)
Requirement already satisfied: httpcore==1.* in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (1.0.9)
Requirement already satisfied: idna in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (3.10)
Requirement already satisfied: h11>=0.16 in /opt/conda/lib/python3.11/site-packages (from httpcore==1.*->httpx<1.0.0->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (0.16.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.11/site-packages (from sympy>=1.13.3->torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (1.3.0)
Requirement already satisfied: shellingham>=1.3.0 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (1.5.4)
Requirement already satisfied: rich>=13.8.0 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (15.0.0)
Requirement already satisfied: annotated-doc>=0.0.2 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (0.0.4)
Requirement already satisfied: zipp>=3.20 in /opt/conda/lib/python3.11/site-packages (from importlib_metadata->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (3.21.0)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.11/site-packages (from jinja2->torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (3.0.2)
Requirement already satisfied: charset_normalizer<4,>=2 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (3.4.1)
Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (2.3.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (4.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (2.19.1)
Requirement already satisfied: mdurl~=0.1 in /opt/conda/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (0.1.2)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
[bootstrap] nunchaku already installed.
[bootstrap] Starting ComfyUI on 0.0.0.0:8188
[INFO] setup plugin alembic.autogenerate.schemas
[INFO] setup plugin alembic.autogenerate.tables
[INFO] setup plugin alembic.autogenerate.types
[INFO] setup plugin alembic.autogenerate.constraints
[INFO] setup plugin alembic.autogenerate.defaults
[INFO] setup plugin alembic.autogenerate.comments
[INFO] Adding extra search path diffusion_models /workspace/ComfyUI/models/diffusion_models
[INFO] Adding extra search path diffusion_models /workspace/ComfyUI/models/unet
[INFO] Adding extra search path unet /workspace/ComfyUI/models/unet
[INFO] Adding extra search path unet /workspace/ComfyUI/models/diffusion_models
[INFO] Adding extra search path text_encoders /workspace/ComfyUI/models/text_encoders
[INFO] Adding extra search path text_encoders /workspace/ComfyUI/models/clip
[INFO] Adding extra search path clip /workspace/ComfyUI/models/clip
[INFO] Adding extra search path clip /workspace/ComfyUI/models/text_encoders
[INFO] Adding extra search path vae /workspace/ComfyUI/models/vae
[INFO] Adding extra search path loras /workspace/ComfyUI/models/loras
[INFO] Adding extra search path checkpoints /workspace/ComfyUI/models/checkpoints
[INFO] Adding extra search path controlnet /workspace/ComfyUI/models/controlnet
[INFO] Adding extra search path upscale_models /workspace/ComfyUI/models/upscale_models
[INFO] [ComfyUI-Manager] Using `uv` as Python module for pip operations.
Using Python 3.11.12 environment at: /opt/conda
[START] Security scan
[DONE] Security scan
## ComfyUI-Manager: installing dependencies done.
** ComfyUI startup time: 2026-06-30 01:38:11.985
** Platform: Linux
** Python version: 3.11.12 | packaged by conda-forge | (main, Apr 10 2025, 22:23:25) [GCC 13.3.0]
** Python executable: /opt/conda/bin/python
** ComfyUI Path: /workspace/ComfyUI
** ComfyUI Base Folder Path: /workspace/ComfyUI
** User directory: /workspace/ComfyUI/user
** ComfyUI-Manager config path: /workspace/ComfyUI/user/__manager/config.ini
** Log path: /workspace/ComfyUI/user/comfyui.log
Using Python 3.11.12 environment at: /opt/conda
Using Python 3.11.12 environment at: /opt/conda
[INFO] 
Prestartup times for custom nodes:
[INFO]    0.6 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Manager
[INFO] 
[WARNING] WARNING: You need pytorch with cu130 or higher to use optimized CUDA operations.
[INFO] Found comfy_kitchen backend triton: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8']}
[INFO] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']}
[INFO] Found comfy_kitchen backend cuda: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_nvfp4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']}
[INFO] Checkpoint files will always be loaded safely.
[INFO] Total VRAM 24124 MB, total RAM 62171 MB
[INFO] pytorch version: 2.7.0+cu128
[INFO] Set vram state to: NORMAL_VRAM
[INFO] Device: cuda:0 NVIDIA GeForce RTX 3090 : cudaMallocAsync
[INFO] Device: cuda:1 NVIDIA GeForce RTX 3090 : cudaMallocAsync
[INFO] Using async weight offloading with 2 streams
[INFO] Enabled pinned memory 55954.0
[INFO] Using pytorch attention
[WARNING] Unsupported Pytorch detected. DynamicVRAM support requires Pytorch version 2.8 or later. Falling back to legacy ModelPatcher. VRAM estimates may be unreliable especially on Windows
[INFO] Python version: 3.11.12 | packaged by conda-forge | (main, Apr 10 2025, 22:23:25) [GCC 13.3.0]
[INFO] ComfyUI version: 0.26.0
[INFO] comfy-aimdo version: 0.4.10
[INFO] comfy-kitchen version: 0.2.10
[INFO] comfyui-frontend-package version: 1.45.19
[INFO] comfyui-workflow-templates version: 0.10.3
[INFO] comfyui-embedded-docs version: 0.5.5
[INFO] comfy-kitchen version: 0.2.10
[INFO] comfy-aimdo version: 0.4.10
[INFO] [Prompt Server] web root: /opt/conda/lib/python3.11/site-packages/comfyui_frontend_package/static
[INFO] Asset seeder disabled
[INFO] ComfyUI-GGUF: Partial torch compile only, consider updating pytorch
[INFO] [MultiGPU Core Patching] Patching mm.soft_empty_cache for Comprehensive Memory Management (VRAM + CPU + Store Pruning)
[MultiGPU Core Patching] Patching mm.get_torch_device, mm.text_encoder_device, mm.unet_offload_device
[MultiGPU DEBUG] Initial current_device: cuda:0
[MultiGPU DEBUG] Initial current_text_encoder_device: cuda:0
[MultiGPU DEBUG] Initial current_unet_offload_device: cpu
[MultiGPU] Patched comfy.model_management.current_stream to honor CUDA device arguments
[MultiGPU] Patched comfy.sample.sample with runtime device guard
[MultiGPU] Patched comfy.sample.sample_custom with runtime device guard
[MultiGPU] Applied comfy_kitchen CUDA DLPack device guard patch (P2P-aware)
[MultiGPU] DynamicVRAM not enabled; skipping multi-device aimdo initialization
[MultiGPU] Initiating custom_node Registration. . .
-----------------------------------------------
custom_node                   Found     Nodes
-----------------------------------------------
ComfyUI-LTXVideo                  N         0
ComfyUI-Florence2                 N         0
ComfyUI_bitsandbytes_NF4          N         0
x-flux-comfyui                    N         0
ComfyUI-MMAudio                   N         0
ComfyUI-GGUF                      Y        18
PuLID_ComfyUI                     N         0
ComfyUI-WanVideoWrapper           Y        20
-----------------------------------------------
[MultiGPU] Registration complete. Final mappings: CheckpointLoaderAdvancedMultiGPU, CheckpointLoaderAdvancedDisTorch2MultiGPU, DeviceSelectorMultiGPU, UNetLoaderLP, UNETLoaderMultiGPU, VAELoaderMultiGPU, CLIPLoaderMultiGPU, DualCLIPLoaderMultiGPU, TripleCLIPLoaderMultiGPU, QuadrupleCLIPLoaderMultiGPU, CLIPVisionLoaderMultiGPU, CheckpointLoaderSimpleMultiGPU, ControlNetLoaderMultiGPU, DiffusersLoaderMultiGPU, DiffControlNetLoaderMultiGPU, UNETLoaderDisTorch2MultiGPU, VAELoaderDisTorch2MultiGPU, CLIPLoaderDisTorch2MultiGPU, DualCLIPLoaderDisTorch2MultiGPU, TripleCLIPLoaderDisTorch2MultiGPU, QuadrupleCLIPLoaderDisTorch2MultiGPU, CLIPVisionLoaderDisTorch2MultiGPU, CheckpointLoaderSimpleDisTorch2MultiGPU, ControlNetLoaderDisTorch2MultiGPU, DiffusersLoaderDisTorch2MultiGPU, DiffControlNetLoaderDisTorch2MultiGPU, UnetLoaderGGUFDisTorchMultiGPU, UnetLoaderGGUFAdvancedDisTorchMultiGPU, CLIPLoaderGGUFDisTorchMultiGPU, DualCLIPLoaderGGUFDisTorchMultiGPU, TripleCLIPLoaderGGUFDisTorchMultiGPU, QuadrupleCLIPLoaderGGUFDisTorchMultiGPU, UnetLoaderGGUFDisTorch2MultiGPU, UnetLoaderGGUFAdvancedDisTorch2MultiGPU, CLIPLoaderGGUFDisTorch2MultiGPU, DualCLIPLoaderGGUFDisTorch2MultiGPU, TripleCLIPLoaderGGUFDisTorch2MultiGPU, QuadrupleCLIPLoaderGGUFDisTorch2MultiGPU, UnetLoaderGGUFMultiGPU, UnetLoaderGGUFAdvancedMultiGPU, CLIPLoaderGGUFMultiGPU, DualCLIPLoaderGGUFMultiGPU, TripleCLIPLoaderGGUFMultiGPU, QuadrupleCLIPLoaderGGUFMultiGPU, LoadWanVideoT5TextEncoderMultiGPU, WanVideoTextEncodeMultiGPU, WanVideoTextEncodeCachedMultiGPU, WanVideoTextEncodeSingleMultiGPU, WanVideoVAELoaderMultiGPU, WanVideoTinyVAELoaderMultiGPU, WanVideoBlockSwapMultiGPU, WanVideoImageToVideoEncodeMultiGPU, WanVideoDecodeMultiGPU, WanVideoModelLoaderMultiGPU, WanVideoSamplerMultiGPU, WanVideoVACEEncodeMultiGPU, WanVideoEncodeMultiGPU, LoadWanVideoClipTextEncoderMultiGPU, WanVideoClipVisionEncodeMultiGPU, WanVideoControlnetLoaderMultiGPU, FantasyTalkingModelLoaderMultiGPU, Wav2VecModelLoaderMultiGPU, WanVideoUni3C_ControlnetLoaderMultiGPU, DownloadAndLoadWav2VecModelMultiGPU
[INFO] ======================================== ComfyUI-nunchaku Initialization ========================================
[INFO] Nunchaku version: 1.2.0
[INFO] ComfyUI-nunchaku version: 1.2.1
/opt/conda/lib/python3.11/site-packages/timm/models/layers/__init__.py:49: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning)
'nunchaku_versions.json' not found. Node will start in minimal mode. Use 'update node' to fetch versions.
[INFO] =================================================================================================================
[WARNING] Warning: Could not load sageattention: No module named 'sageattention'
[WARNING] sageattention package is not installed, sageattention will not be available
[INFO] ### Loading: ComfyUI-Manager (V3.41)
[INFO] [ComfyUI-Manager] network_mode: public
[INFO] [ComfyUI-Manager] ComfyUI per-queue preview override detected (PR #11261). Manager's preview method feature is disabled. Use ComfyUI's --preview-method CLI option or 'Settings > Execution > Live preview method'.
[INFO] ### ComfyUI Revision: 1 [f6c162dd] *DETACHED | Released on '2026-06-23'
[INFO] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json
[INFO] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json
[INFO] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json
[INFO] 
Import times for custom nodes:
[INFO]    0.0 seconds: /workspace/ComfyUI/custom_nodes/websocket_image_save.py
[INFO]    0.0 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-GGUF
[INFO]    0.0 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-MultiGPU
[INFO]    0.0 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Manager
[INFO]    0.0 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-HunyuanVideoWrapper
[INFO]    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-KJNodes
[INFO]    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite
[INFO]    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper
[INFO]    0.4 seconds: /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI
[INFO]    0.7 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku
[INFO] 
[INFO] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json
[INFO] Context impl SQLiteImpl.
[INFO] Will assume non-transactional DDL.
[INFO] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json
[INFO] Using RAM pressure cache.
[INFO] Starting server

[INFO] To see the GUI go to: http://0.0.0.0:8188
FETCH ComfyRegistry Data: 5/157
FETCH ComfyRegistry Data: 10/157
FETCH ComfyRegistry Data: 15/157
FETCH ComfyRegistry Data: 20/157
FETCH ComfyRegistry Data: 25/157
FETCH ComfyRegistry Data: 30/157
FETCH ComfyRegistry Data: 35/157
FETCH ComfyRegistry Data: 40/157
FETCH ComfyRegistry Data: 45/157
FETCH ComfyRegistry Data: 50/157
FETCH ComfyRegistry Data: 55/157
FETCH ComfyRegistry Data: 60/157
FETCH ComfyRegistry Data: 65/157
FETCH ComfyRegistry Data: 70/157
[WARNING] [DEPRECATION WARNING] Detected import of deprecated legacy API: /scripts/ui.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version.
[WARNING] [DEPRECATION WARNING] Detected import of deprecated legacy API: /extensions/core/widgetInputs.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version.
[WARNING] [DEPRECATION WARNING] Detected import of deprecated legacy API: /extensions/core/groupNode.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version.
[WARNING] [DEPRECATION WARNING] Detected import of deprecated legacy API: /scripts/ui/components/buttonGroup.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version.
[WARNING] [DEPRECATION WARNING] Detected import of deprecated legacy API: /scripts/ui/components/button.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version.
FETCH ComfyRegistry Data: 75/157
FETCH ComfyRegistry Data: 80/157
FETCH ComfyRegistry Data: 85/157
FETCH ComfyRegistry Data: 90/157
FETCH ComfyRegistry Data: 95/157
FETCH ComfyRegistry Data: 100/157
FETCH ComfyRegistry Data: 105/157
FETCH ComfyRegistry Data: 110/157
FETCH ComfyRegistry Data: 115/157
[INFO] got prompt
[ERROR] !!! Exception during processing !!! HiDream-O1-Image-Dev-2604-FP8 is not installed. Enable download_if_missing to download it, or place the complete model folder in ComfyUI/models/diffusion_models.
[ERROR] Traceback (most recent call last):
  File "/workspace/ComfyUI/execution.py", line 542, in execute
    output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
                                                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspace/ComfyUI/execution.py", line 341, in get_output_data
    return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspace/ComfyUI/execution.py", line 315, in _async_map_node_over_list
    await process_inputs(input_dict, i)
  File "/workspace/ComfyUI/execution.py", line 303, in process_inputs
    result = f(**inputs)
             ^^^^^^^^^^^
  File "/workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI/nodes.py", line 307, in load_model
    raise FileNotFoundError(
FileNotFoundError: HiDream-O1-Image-Dev-2604-FP8 is not installed. Enable download_if_missing to download it, or place the complete model folder in ComfyUI/models/diffusion_models.

[INFO] Prompt executed in 0.01 seconds
FETCH ComfyRegistry Data: 120/157
FETCH ComfyRegistry Data: 125/157
FETCH ComfyRegistry Data: 130/157
FETCH ComfyRegistry Data: 135/157
FETCH ComfyRegistry Data: 140/157
FETCH ComfyRegistry Data: 145/157
FETCH ComfyRegistry Data: 150/157
FETCH ComfyRegistry Data: 155/157
FETCH ComfyRegistry Data [DONE]
[INFO] [ComfyUI-Manager] default cache updated: https://api.comfy.org/nodes
FETCH DATA from: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json [DONE]
[INFO] [ComfyUI-Manager] All startup tasks have been completed.

studio-director — Up 4 minutes (healthy) (last 200 lines)

18.45.415.673 I slot print_timing: id  2 | task 23255 | n_decoded =   3208, tg = 152.59 t/s, tg_3s = 152.86 t/s
18.48.419.396 I slot print_timing: id  2 | task 23255 | n_decoded =   3669, tg = 152.70 t/s, tg_3s = 153.48 t/s
18.51.420.337 I slot print_timing: id  2 | task 23255 | n_decoded =   4127, tg = 152.69 t/s, tg_3s = 152.62 t/s
18.52.984.898 I slot print_timing: id  2 | task 23255 | prompt eval time =      93.78 ms /   327 tokens (    0.29 ms per token,  3487.07 tokens per second)
18.52.984.902 I slot print_timing: id  2 | task 23255 |        eval time =   28593.33 ms /  4365 tokens (    6.55 ms per token,   152.66 tokens per second)
18.52.984.902 I slot print_timing: id  2 | task 23255 |       total time =   28687.11 ms /  4692 tokens
18.52.984.903 I slot print_timing: id  2 | task 23255 |    graphs reused =      27454
18.52.984.934 I slot      release: id  2 | task 23255 | stop processing: n_tokens = 4691, truncated = 0
18.52.984.954 I srv  update_slots: all slots are idle
18.52.985.217 I srv  stream_sessi: stream_session_attach_pipe: conv_id= (empty=1)
19.21.833.052 I srv    operator(): operator(): cleaning up before exit...
warn: LLAMA_ARG_HOST environment variable is set, but will be overwritten by command line argument --host
0.01.069.872 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.01.069.875 I device_info:
0.01.175.164 I   - CUDA0   : NVIDIA GeForce RTX 3090 (24123 MiB, 23103 MiB free)
0.01.175.169 I   - CPU     : AMD Ryzen 7 5800X3D 8-Core Processor (62171 MiB, 62171 MiB free)
0.01.175.950 I system_info: n_threads = 8 (n_threads_batch = 8) / 16 | CUDA : ARCHS = 500,610,700,750,800,860,890,900,1200 | USE_GRAPHS = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | 
0.01.175.955 I srv  llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
0.01.176.980 I srv          init: running without SSL
0.01.178.441 I srv          init: using 15 threads for HTTP server
0.01.179.757 I srv         start: binding port with default address family
0.01.181.433 I srv  llama_server: loading model
0.01.181.905 I srv    load_model: loading model '/models/qwen3.5-4b-gguf/hauhaucs-uncensored-q4km/Qwen3.5-4B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf'
0.01.245.430 I srv    load_model: [mtmd] estimated worst-case memory usage of mmproj is 892.48 MiB (took 63.50 ms)
0.01.246.285 I common_init_result: fitting params to device memory ...
0.01.246.287 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.05.892.360 W llama_context: n_ctx_seq (16384) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
0.05.929.239 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.06.051.625 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks
0.06.051.627 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024
0.06.051.627 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842

0.07.743.300 I srv    load_model: loaded multimodal model, '/models/qwen3.5-4b-gguf/hauhaucs-uncensored-q4km/mmproj-Qwen3.5-4B-Uncensored-HauhauCS-Aggressive-BF16.gguf'
0.07.743.312 I srv    load_model: initializing slots, n_slots = 4
0.07.755.781 W srv    load_model: speculative decoding will use checkpoints
0.07.755.791 W common_speculative_init: no implementations specified for speculative decoding
0.07.755.792 I slot   load_model: id  0 | task -1 | new slot, n_ctx = 16384
0.07.755.798 I slot   load_model: id  1 | task -1 | new slot, n_ctx = 16384
0.07.755.800 I slot   load_model: id  2 | task -1 | new slot, n_ctx = 16384
0.07.755.801 I slot   load_model: id  3 | task -1 | new slot, n_ctx = 16384
0.07.755.832 I srv    load_model: prompt cache is enabled, size limit: 8192 MiB
0.07.755.834 I srv    load_model: use `--cache-ram 0` to disable the prompt cache
0.07.755.834 I srv    load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
0.07.755.835 I srv    load_model: context checkpoints enabled, max = 32, min spacing = 8192
0.07.755.848 I srv          init: idle slots will be saved to prompt cache and cleared upon starting a new task
0.07.785.953 I init: chat template, example_format: '<|im_start|>system
You are a helpful assistant<|im_end|>
<|im_start|>user
Hello<|im_end|>
<|im_start|>assistant
Hi there<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
<think>
'
0.07.799.191 I srv          init: init: chat template, thinking = 1
0.07.799.233 I srv  llama_server: model loaded
0.07.799.239 I srv  llama_server: server is listening on http://0.0.0.0:8090
0.07.799.245 I srv  update_slots: all slots are idle
1.57.369.157 I srv    operator(): Chat format: peg-native
1.57.369.321 I slot get_availabl: id  3 | task -1 | selected slot by LRU, t_last = -1
1.57.369.323 I srv  get_availabl: updating prompt cache
1.57.369.328 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
1.57.369.333 I srv        update:  - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 16384 tokens, 8589934592 est)
1.57.369.334 I srv  get_availabl: prompt cache update took 0.01 ms
1.57.369.384 I slot launch_slot_: id  3 | task 0 | processing task, is_child = 0
1.57.369.386 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.57.369.387 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.57.369.402 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.57.369.403 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.57.369.412 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.57.369.413 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.57.476.257 I slot create_check: id  3 | task 0 | created context checkpoint 1 of 32 (pos_min = 244, pos_max = 244, n_tokens = 245, size = 50.251 MiB)
1.58.906.639 I slot print_timing: id  3 | task 0 | prompt eval time =     139.43 ms /   271 tokens (    0.51 ms per token,  1943.68 tokens per second)
1.58.906.643 I slot print_timing: id  3 | task 0 |        eval time =    1397.77 ms /   203 tokens (    6.89 ms per token,   145.23 tokens per second)
1.58.906.644 I slot print_timing: id  3 | task 0 |       total time =    1537.19 ms /   474 tokens
1.58.906.647 I slot print_timing: id  3 | task 0 |    graphs reused =        202
1.58.906.692 I slot      release: id  3 | task 0 | stop processing: n_tokens = 473, truncated = 0
1.58.906.698 I srv  update_slots: all slots are idle
1.58.907.958 I srv  stream_sessi: stream_session_attach_pipe: conv_id= (empty=1)
2.00.955.922 I srv    operator(): Chat format: peg-native
2.00.956.054 I slot get_availabl: id  2 | task -1 | selected slot by LRU, t_last = -1
2.00.956.056 I srv  get_availabl: updating prompt cache
2.00.956.060 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
2.00.956.062 I srv        update:  - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 16384 tokens, 8589934592 est)
2.00.956.066 I srv  get_availabl: prompt cache update took 0.01 ms
2.00.956.104 I slot launch_slot_: id  2 | task 206 | processing task, is_child = 0
2.00.956.107 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.00.956.107 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.00.956.122 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.00.956.122 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.00.956.133 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
2.00.956.172 W srv   prompt_save:  - saving prompt with length 473, total state size = 65.041 MiB (draft: 0.000 MiB)
2.01.033.751 I srv        update:  - cache state: 1 prompts, 115.292 MiB (limits: 8192.000 MiB, 16384 tokens, 33608 est)
2.01.033.764 I srv        update:    - prompt 0x5a8bc98e2f30:     473 tokens, checkpoints:  1,   115.292 MiB
2.01.033.765 I slot prompt_clear: id  3 | task -1 | clearing prompt with 473 tokens
2.01.101.815 I slot create_check: id  2 | task 206 | created context checkpoint 1 of 32 (pos_min = 264, pos_max = 264, n_tokens = 265, size = 50.251 MiB)
2.04.116.235 I slot print_timing: id  2 | task 206 | n_decoded =    438, tg = 145.94 t/s, tg_3s = 145.94 t/s
2.07.121.228 I slot print_timing: id  2 | task 206 | n_decoded =    885, tg = 147.35 t/s, tg_3s = 148.75 t/s
2.10.125.599 I slot print_timing: id  2 | task 206 | n_decoded =   1334, tg = 148.05 t/s, tg_3s = 149.45 t/s
2.12.515.663 I slot print_timing: id  2 | task 206 | prompt eval time =      81.02 ms /   269 tokens (    0.30 ms per token,  3320.25 tokens per second)
2.12.515.667 I slot print_timing: id  2 | task 206 |        eval time =   11400.73 ms /  1690 tokens (    6.75 ms per token,   148.24 tokens per second)
2.12.515.668 I slot print_timing: id  2 | task 206 |       total time =   11481.75 ms /  1959 tokens
2.12.515.669 I slot print_timing: id  2 | task 206 |    graphs reused =       1884
2.12.515.696 I slot      release: id  2 | task 206 | stop processing: n_tokens = 1958, truncated = 0
2.12.515.706 I srv  update_slots: all slots are idle
2.12.515.888 I srv  stream_sessi: stream_session_attach_pipe: conv_id= (empty=1)
2.12.538.686 I srv    operator(): Chat format: peg-native
2.12.538.797 I slot get_availabl: id  1 | task -1 | selected slot by LRU, t_last = -1
2.12.538.800 I srv  get_availabl: updating prompt cache
2.12.538.802 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
2.12.538.805 I srv        update:  - cache state: 1 prompts, 115.292 MiB (limits: 8192.000 MiB, 16384 tokens, 33608 est)
2.12.538.807 I srv        update:    - prompt 0x5a8bc98e2f30:     473 tokens, checkpoints:  1,   115.292 MiB
2.12.538.808 I srv  get_availabl: prompt cache update took 0.01 ms
2.12.538.838 I slot launch_slot_: id  1 | task 1898 | processing task, is_child = 0
2.12.538.840 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.12.538.841 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.12.538.853 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.12.538.917 W srv   prompt_save:  - saving prompt with length 1958, total state size = 111.476 MiB (draft: 0.000 MiB)
2.12.652.708 I srv        update:  - cache state: 2 prompts, 277.018 MiB (limits: 8192.000 MiB, 16384 tokens, 71889 est)
2.12.652.721 I srv        update:    - prompt 0x5a8bc98e2f30:     473 tokens, checkpoints:  1,   115.292 MiB
2.12.652.722 I srv        update:    - prompt 0x5a8bca079b80:    1958 tokens, checkpoints:  1,   161.726 MiB
2.12.652.723 I slot prompt_clear: id  2 | task -1 | clearing prompt with 1958 tokens
2.12.652.930 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
2.12.652.936 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
2.12.729.795 I slot create_check: id  1 | task 1898 | created context checkpoint 1 of 32 (pos_min = 337, pos_max = 337, n_tokens = 338, size = 50.251 MiB)
2.15.748.360 I slot print_timing: id  1 | task 1898 | n_decoded =    452, tg = 150.38 t/s, tg_3s = 150.38 t/s
2.18.752.288 I slot print_timing: id  1 | task 1898 | n_decoded =    902, tg = 150.09 t/s, tg_3s = 149.80 t/s
2.19.411.173 I slot print_timing: id  1 | task 1898 | prompt eval time =      89.55 ms /   342 tokens (    0.26 ms per token,  3819.22 tokens per second)
2.19.411.177 I slot print_timing: id  1 | task 1898 |        eval time =    6668.56 ms /  1000 tokens (    6.67 ms per token,   149.96 tokens per second)
2.19.411.178 I slot print_timing: id  1 | task 1898 |       total time =    6758.11 ms /  1342 tokens
2.19.411.178 I slot print_timing: id  1 | task 1898 |    graphs reused =       2878
2.19.411.222 I slot      release: id  1 | task 1898 | stop processing: n_tokens = 1341, truncated = 0
2.19.411.235 I srv  update_slots: all slots are idle
2.19.411.409 I srv  stream_sessi: stream_session_attach_pipe: conv_id= (empty=1)
2.19.438.335 I srv    operator(): Chat format: peg-native
2.19.438.457 I slot get_availabl: id  0 | task -1 | selected slot by LRU, t_last = -1
2.19.438.459 I srv  get_availabl: updating prompt cache
2.19.438.462 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
2.19.438.465 I srv        update:  - cache state: 2 prompts, 277.018 MiB (limits: 8192.000 MiB, 16384 tokens, 71889 est)
2.19.438.467 I srv        update:    - prompt 0x5a8bc98e2f30:     473 tokens, checkpoints:  1,   115.292 MiB
2.19.438.468 I srv        update:    - prompt 0x5a8bca079b80:    1958 tokens, checkpoints:  1,   161.726 MiB
2.19.438.468 I srv  get_availabl: prompt cache update took 0.01 ms
2.19.438.499 I slot launch_slot_: id  0 | task 2900 | processing task, is_child = 0
2.19.438.502 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.19.438.551 W srv   prompt_save:  - saving prompt with length 1341, total state size = 92.183 MiB (draft: 0.000 MiB)
2.19.542.571 I srv        update:  - cache state: 3 prompts, 419.451 MiB (limits: 8192.000 MiB, 16384 tokens, 73668 est)
2.19.542.574 I srv        update:    - prompt 0x5a8bc98e2f30:     473 tokens, checkpoints:  1,   115.292 MiB
2.19.542.574 I srv        update:    - prompt 0x5a8bca079b80:    1958 tokens, checkpoints:  1,   161.726 MiB
2.19.542.575 I srv        update:    - prompt 0x5a8bc7ea8e20:    1341 tokens, checkpoints:  1,   142.433 MiB
2.19.542.576 I slot prompt_clear: id  1 | task -1 | clearing prompt with 1341 tokens
2.19.542.684 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.19.542.685 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.19.542.693 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
2.19.542.693 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
2.19.598.441 I slot create_check: id  0 | task 2900 | created context checkpoint 1 of 32 (pos_min = 210, pos_max = 210, n_tokens = 211, size = 50.251 MiB)
2.22.612.374 I slot print_timing: id  0 | task 2900 | n_decoded =    451, tg = 150.30 t/s, tg_3s = 150.30 t/s
2.25.613.756 I slot print_timing: id  0 | task 2900 | n_decoded =    901, tg = 150.12 t/s, tg_3s = 149.93 t/s
2.28.618.654 I slot print_timing: id  0 | task 2900 | n_decoded =   1349, tg = 149.78 t/s, tg_3s = 149.09 t/s
2.31.625.589 I slot print_timing: id  0 | task 2900 | n_decoded =   1792, tg = 149.16 t/s, tg_3s = 147.33 t/s
2.34.626.786 I slot print_timing: id  0 | task 2900 | n_decoded =   2224, tg = 148.12 t/s, tg_3s = 143.94 t/s
2.37.628.218 I slot print_timing: id  0 | task 2900 | n_decoded =   2652, tg = 147.20 t/s, tg_3s = 142.60 t/s
2.40.631.820 I slot print_timing: id  0 | task 2900 | n_decoded =   3090, tg = 147.00 t/s, tg_3s = 145.82 t/s
2.43.635.342 I slot print_timing: id  0 | task 2900 | n_decoded =   3550, tg = 147.77 t/s, tg_3s = 153.15 t/s
2.46.639.421 I slot print_timing: id  0 | task 2900 | n_decoded =   4008, tg = 148.29 t/s, tg_3s = 152.46 t/s
2.49.644.306 I slot print_timing: id  0 | task 2900 | n_decoded =   4466, tg = 148.71 t/s, tg_3s = 152.42 t/s
2.52.646.607 I slot print_timing: id  0 | task 2900 | n_decoded =   4923, tg = 149.02 t/s, tg_3s = 152.22 t/s
2.55.650.862 I slot print_timing: id  0 | task 2900 | n_decoded =   5379, tg = 149.25 t/s, tg_3s = 151.78 t/s
2.58.654.983 I slot print_timing: id  0 | task 2900 | n_decoded =   5834, tg = 149.42 t/s, tg_3s = 151.46 t/s
3.01.656.611 I slot print_timing: id  0 | task 2900 | n_decoded =   6287, tg = 149.53 t/s, tg_3s = 150.92 t/s
3.04.660.825 I slot print_timing: id  0 | task 2900 | n_decoded =   6738, tg = 149.57 t/s, tg_3s = 150.12 t/s
3.07.662.659 I slot print_timing: id  0 | task 2900 | n_decoded =   7183, tg = 149.49 t/s, tg_3s = 148.24 t/s
3.10.663.539 I slot print_timing: id  0 | task 2900 | n_decoded =   7632, tg = 149.50 t/s, tg_3s = 149.62 t/s
3.13.671.338 I slot print_timing: id  0 | task 2900 | n_decoded =   8075, tg = 149.37 t/s, tg_3s = 147.28 t/s
3.16.671.760 I slot print_timing: id  0 | task 2900 | n_decoded =   8522, tg = 149.35 t/s, tg_3s = 148.98 t/s
3.19.672.488 I slot print_timing: id  0 | task 2900 | n_decoded =   8967, tg = 149.30 t/s, tg_3s = 148.30 t/s
3.22.678.016 I slot print_timing: id  0 | task 2900 | n_decoded =   9411, tg = 149.22 t/s, tg_3s = 147.73 t/s
3.25.682.721 I slot print_timing: id  0 | task 2900 | n_decoded =   9854, tg = 149.14 t/s, tg_3s = 147.44 t/s
3.28.685.478 I slot print_timing: id  0 | task 2900 | n_decoded =  10297, tg = 149.07 t/s, tg_3s = 147.53 t/s
3.31.686.211 I slot print_timing: id  0 | task 2900 | n_decoded =  10736, tg = 148.96 t/s, tg_3s = 146.30 t/s
3.34.687.280 I slot print_timing: id  0 | task 2900 | n_decoded =  11174, tg = 148.84 t/s, tg_3s = 145.95 t/s
3.37.695.873 I slot print_timing: id  0 | task 2900 | n_decoded =  11588, tg = 148.40 t/s, tg_3s = 137.61 t/s
3.40.702.141 I slot print_timing: id  0 | task 2900 | n_decoded =  11992, tg = 147.88 t/s, tg_3s = 134.39 t/s
3.43.706.051 I slot print_timing: id  0 | task 2900 | n_decoded =  12410, tg = 147.57 t/s, tg_3s = 139.15 t/s
3.46.707.320 I slot print_timing: id  0 | task 2900 | n_decoded =  12827, tg = 147.28 t/s, tg_3s = 138.94 t/s
3.49.711.110 I slot print_timing: id  0 | task 2900 | n_decoded =  13245, tg = 147.00 t/s, tg_3s = 139.16 t/s
3.52.717.962 I slot print_timing: id  0 | task 2900 | n_decoded =  13680, tg = 146.93 t/s, tg_3s = 144.67 t/s
3.55.718.434 I slot print_timing: id  0 | task 2900 | n_decoded =  14113, tg = 146.85 t/s, tg_3s = 144.31 t/s
3.58.718.494 I slot print_timing: id  0 | task 2900 | n_decoded =  14544, tg = 146.75 t/s, tg_3s = 143.66 t/s
4.01.721.296 I slot print_timing: id  0 | task 2900 | n_decoded =  14975, tg = 146.66 t/s, tg_3s = 143.53 t/s
4.04.724.670 I slot print_timing: id  0 | task 2900 | n_decoded =  15403, tg = 146.54 t/s, tg_3s = 142.51 t/s
4.07.729.503 I slot print_timing: id  0 | task 2900 | n_decoded =  15832, tg = 146.43 t/s, tg_3s = 142.77 t/s
4.10.110.222 I slot print_timing: id  0 | task 2900 | prompt eval time =      69.06 ms /   215 tokens (    0.32 ms per token,  3113.28 tokens per second)
4.10.110.226 I slot print_timing: id  0 | task 2900 |        eval time =  110498.42 ms / 16169 tokens (    6.83 ms per token,   146.33 tokens per second)
4.10.110.227 I slot print_timing: id  0 | task 2900 |       total time =  110567.48 ms / 16384 tokens
4.10.110.228 I slot print_timing: id  0 | task 2900 |    graphs reused =      18982
4.10.110.252 I slot      release: id  0 | task 2900 | stop processing: n_tokens = 16383, truncated = 1
4.10.110.300 I srv  update_slots: all slots are idle
4.10.111.397 I srv  stream_sessi: stream_session_attach_pipe: conv_id= (empty=1)

studio-orchestrator — Up 4 minutes (last 200 lines)

[orchestrator] :8190 comfy=http://localhost:8188 out=/output/video lanes=['ltx-t2v', 'ltx-i2v', 'sulphur-t2v', 'sulphur-i2v', '10eros-t2v', '10eros-i2v', 'image', 'chroma', 'hidream', 'zimage', 'krea', 'wan', 'wan-i2v', 'music', 'sfx']

studio-image-shim — Up 4 minutes (last 200 lines)

studio-tts — Up 4 minutes (last 200 lines)

studio-step-voice — Up 4 minutes (last 200 lines)

If you want to use the speaker diarization, please `pip install hdbscan`
[step-voice] lazy mode — model loads on first /clone or /edit (idle-unload 300s)

studio-gallery — Up 4 minutes (last 200 lines)

2026/06/29 07:32:46 [notice] 25#25: exit
2026/06/29 07:32:46 [notice] 30#30: exit
2026/06/29 07:32:46 [notice] 23#23: exit
2026/06/29 07:32:46 [notice] 28#28: exit
2026/06/29 07:32:46 [notice] 24#24: exit
2026/06/29 07:32:46 [notice] 26#26: exit
2026/06/29 07:32:46 [notice] 35#35: exit
2026/06/29 07:32:46 [notice] 31#31: exit
2026/06/29 07:32:46 [notice] 32#32: exit
2026/06/29 07:32:46 [notice] 34#34: exit
2026/06/29 07:32:46 [notice] 33#33: gracefully shutting down
2026/06/29 07:32:46 [notice] 33#33: exiting
2026/06/29 07:32:46 [notice] 33#33: exit
2026/06/29 07:32:46 [notice] 36#36: gracefully shutting down
2026/06/29 07:32:46 [notice] 36#36: exiting
2026/06/29 07:32:46 [notice] 36#36: exit
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 35
2026/06/29 07:32:46 [notice] 1#1: worker process 35 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 27
2026/06/29 07:32:46 [notice] 1#1: worker process 24 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: worker process 27 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 29
2026/06/29 07:32:46 [notice] 1#1: worker process 29 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 26
2026/06/29 07:32:46 [notice] 1#1: worker process 26 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: worker process 31 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 22
2026/06/29 07:32:46 [notice] 1#1: worker process 22 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: worker process 25 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 25
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 30
2026/06/29 07:32:46 [notice] 1#1: worker process 30 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: worker process 28 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: worker process 36 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 28
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 23
2026/06/29 07:32:46 [notice] 1#1: worker process 23 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 33
2026/06/29 07:32:46 [notice] 1#1: worker process 33 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 32
2026/06/29 07:32:46 [notice] 1#1: worker process 32 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 34
2026/06/29 07:32:46 [notice] 1#1: worker process 34 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: signal 17 (SIGCHLD) received from 21
2026/06/29 07:32:46 [notice] 1#1: worker process 21 exited with code 0
2026/06/29 07:32:46 [notice] 1#1: exit
/docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration
/docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/
/docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh
10-listen-on-ipv6-by-default.sh: info: can not modify /etc/nginx/conf.d/default.conf (read-only file system?)
/docker-entrypoint.sh: Sourcing /docker-entrypoint.d/15-local-resolvers.envsh
/docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh
/docker-entrypoint.sh: Launching /docker-entrypoint.d/30-tune-worker-processes.sh
/docker-entrypoint.sh: Configuration complete; ready for start up
2026/06/29 07:37:52 [notice] 1#1: using the "epoll" event method
2026/06/29 07:37:52 [notice] 1#1: nginx/1.31.2
2026/06/29 07:37:52 [notice] 1#1: built by gcc 15.2.0 (Alpine 15.2.0) 
2026/06/29 07:37:52 [notice] 1#1: OS: Linux 7.0.0-27-generic
2026/06/29 07:37:52 [notice] 1#1: getrlimit(RLIMIT_NOFILE): 1024:524288
2026/06/29 07:37:52 [notice] 1#1: start worker processes
2026/06/29 07:37:52 [notice] 1#1: start worker process 21
2026/06/29 07:37:52 [notice] 1#1: start worker process 22
2026/06/29 07:37:52 [notice] 1#1: start worker process 23
2026/06/29 07:37:52 [notice] 1#1: start worker process 24
2026/06/29 07:37:52 [notice] 1#1: start worker process 25
2026/06/29 07:37:52 [notice] 1#1: start worker process 26
2026/06/29 07:37:52 [notice] 1#1: start worker process 27
2026/06/29 07:37:52 [notice] 1#1: start worker process 28
2026/06/29 07:37:52 [notice] 1#1: start worker process 29
2026/06/29 07:37:52 [notice] 1#1: start worker process 30
2026/06/29 07:37:52 [notice] 1#1: start worker process 31
2026/06/29 07:37:52 [notice] 1#1: start worker process 32
2026/06/29 07:37:52 [notice] 1#1: start worker process 33
2026/06/29 07:37:52 [notice] 1#1: start worker process 34
2026/06/29 07:37:52 [notice] 1#1: start worker process 35
2026/06/29 07:37:52 [notice] 1#1: start worker process 36
2026/06/29 07:52:42 [notice] 1#1: signal 3 (SIGQUIT) received, shutting down
2026/06/29 07:52:42 [notice] 21#21: gracefully shutting down
2026/06/29 07:52:42 [notice] 22#22: gracefully shutting down
2026/06/29 07:52:42 [notice] 23#23: gracefully shutting down
2026/06/29 07:52:42 [notice] 24#24: gracefully shutting down
2026/06/29 07:52:42 [notice] 25#25: gracefully shutting down
2026/06/29 07:52:42 [notice] 22#22: exiting
2026/06/29 07:52:42 [notice] 21#21: exiting
2026/06/29 07:52:42 [notice] 26#26: gracefully shutting down
2026/06/29 07:52:42 [notice] 23#23: exiting
2026/06/29 07:52:42 [notice] 24#24: exiting
2026/06/29 07:52:42 [notice] 27#27: gracefully shutting down
2026/06/29 07:52:42 [notice] 26#26: exiting
2026/06/29 07:52:42 [notice] 25#25: exiting
2026/06/29 07:52:42 [notice] 28#28: gracefully shutting down
2026/06/29 07:52:42 [notice] 27#27: exiting
2026/06/29 07:52:42 [notice] 29#29: gracefully shutting down
2026/06/29 07:52:42 [notice] 30#30: gracefully shutting down
2026/06/29 07:52:42 [notice] 28#28: exiting
2026/06/29 07:52:42 [notice] 31#31: gracefully shutting down
2026/06/29 07:52:42 [notice] 32#32: gracefully shutting down
2026/06/29 07:52:42 [notice] 29#29: exiting
2026/06/29 07:52:42 [notice] 30#30: exiting
2026/06/29 07:52:42 [notice] 31#31: exiting
2026/06/29 07:52:42 [notice] 32#32: exiting
2026/06/29 07:52:42 [notice] 33#33: gracefully shutting down
2026/06/29 07:52:42 [notice] 33#33: exiting
2026/06/29 07:52:42 [notice] 23#23: exit
2026/06/29 07:52:42 [notice] 22#22: exit
2026/06/29 07:52:42 [notice] 26#26: exit
2026/06/29 07:52:42 [notice] 21#21: exit
2026/06/29 07:52:42 [notice] 24#24: exit
2026/06/29 07:52:42 [notice] 27#27: exit
2026/06/29 07:52:42 [notice] 30#30: exit
2026/06/29 07:52:42 [notice] 25#25: exit
2026/06/29 07:52:42 [notice] 28#28: exit
2026/06/29 07:52:42 [notice] 29#29: exit
2026/06/29 07:52:42 [notice] 32#32: exit
2026/06/29 07:52:42 [notice] 33#33: exit
2026/06/29 07:52:42 [notice] 31#31: exit
2026/06/29 07:52:42 [notice] 34#34: gracefully shutting down
2026/06/29 07:52:42 [notice] 34#34: exiting
2026/06/29 07:52:42 [notice] 36#36: gracefully shutting down
2026/06/29 07:52:42 [notice] 36#36: exiting
2026/06/29 07:52:42 [notice] 34#34: exit
2026/06/29 07:52:42 [notice] 35#35: gracefully shutting down
2026/06/29 07:52:42 [notice] 35#35: exiting
2026/06/29 07:52:42 [notice] 36#36: exit
2026/06/29 07:52:42 [notice] 35#35: exit
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 22
2026/06/29 07:52:42 [notice] 1#1: worker process 22 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: worker process 24 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: worker process 25 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 25
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 35
2026/06/29 07:52:42 [notice] 1#1: worker process 35 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 28
2026/06/29 07:52:42 [notice] 1#1: worker process 28 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 33
2026/06/29 07:52:42 [notice] 1#1: worker process 23 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: worker process 33 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: worker process 36 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 23
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 32
2026/06/29 07:52:42 [notice] 1#1: worker process 29 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: worker process 21 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: worker process 30 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: worker process 32 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: worker process 34 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 29
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 31
2026/06/29 07:52:42 [notice] 1#1: worker process 26 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: worker process 31 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: signal 29 (SIGIO) received
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 26
2026/06/29 07:52:42 [notice] 1#1: signal 17 (SIGCHLD) received from 27
2026/06/29 07:52:42 [notice] 1#1: worker process 27 exited with code 0
2026/06/29 07:52:42 [notice] 1#1: exit
/docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration
/docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/
/docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh
10-listen-on-ipv6-by-default.sh: info: can not modify /etc/nginx/conf.d/default.conf (read-only file system?)
/docker-entrypoint.sh: Sourcing /docker-entrypoint.d/15-local-resolvers.envsh
/docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh
/docker-entrypoint.sh: Launching /docker-entrypoint.d/30-tune-worker-processes.sh
/docker-entrypoint.sh: Configuration complete; ready for start up
2026/06/30 01:37:52 [notice] 1#1: using the "epoll" event method
2026/06/30 01:37:52 [notice] 1#1: nginx/1.31.2
2026/06/30 01:37:52 [notice] 1#1: built by gcc 15.2.0 (Alpine 15.2.0) 
2026/06/30 01:37:52 [notice] 1#1: OS: Linux 7.0.0-27-generic
2026/06/30 01:37:52 [notice] 1#1: getrlimit(RLIMIT_NOFILE): 1024:524288
2026/06/30 01:37:52 [notice] 1#1: start worker processes
2026/06/30 01:37:52 [notice] 1#1: start worker process 21
2026/06/30 01:37:52 [notice] 1#1: start worker process 22
2026/06/30 01:37:52 [notice] 1#1: start worker process 23
2026/06/30 01:37:52 [notice] 1#1: start worker process 24
2026/06/30 01:37:52 [notice] 1#1: start worker process 25
2026/06/30 01:37:52 [notice] 1#1: start worker process 26
2026/06/30 01:37:52 [notice] 1#1: start worker process 27
2026/06/30 01:37:52 [notice] 1#1: start worker process 28
2026/06/30 01:37:52 [notice] 1#1: start worker process 29
2026/06/30 01:37:52 [notice] 1#1: start worker process 30
2026/06/30 01:37:52 [notice] 1#1: start worker process 31
2026/06/30 01:37:52 [notice] 1#1: start worker process 32
2026/06/30 01:37:52 [notice] 1#1: start worker process 33
2026/06/30 01:37:52 [notice] 1#1: start worker process 34
2026/06/30 01:37:52 [notice] 1#1: start worker process 35
2026/06/30 01:37:52 [notice] 1#1: start worker process 36
2026/06/30 01:39:14 [error] 21#21: *1 open() "/srv/media/favicon.ico" failed (2: No such file or directory), client: 192.168.5.10, server: _, request: "GET /favicon.ico HTTP/1.1", host: "192.168.5.10:8189", referrer: "http://192.168.5.10:8189/"
192.168.5.10 - - [30/Jun/2026:01:39:14 +0000] "GET /favicon.ico HTTP/1.1" 404 555 "http://192.168.5.10:8189/" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/149.0.0.0 Safari/537.36" "-"

---

Generated by bash scripts/report.sh. Flags: --verify (verify-full), --stress (verify-stress 7/7 incl. Cliff 2 needles), --soak (SOAK_MODE=continuous, catches Cliff 2b), --bench (canonical TPS), --agentic (multi-turn TTFT/decode curve-shape, ~8 min estimate), --studio (AI Studio / ComfyUI container log tails — for generation bugs), --full (all five, ~43 min estimate). Use --no-redact to disable redaction (internal sharing only).

[noonghunna]

Got it pinned down from your --studio log — thanks, that's exactly what we needed. (And glad #1 sorted itself out; I've made that onboarding step louder regardless.)

Root cause: the HiDream model weights were never downloaded — a bug on our side, not anything you did. Your log has the smoking gun:

[ERROR] HiDream-O1-Image-Dev-2604-FP8 is not installed.
FileNotFoundError: ... place the complete model folder in ComfyUI/models/diffusion_models.

The lane is fully wired (the custom node loaded fine in your log), but the roster downloader (download_studio_models.sh, run by setup-ai-studio.sh) never invoked download_hidream_o1.sh, so the weights never landed on disk — and with download_if_missing: false, the lane fails the instant you pick it.

While auditing I found the Chroma lane (the 🔓 uncensored image option) had the same gap, so a heads-up: you'd hit the identical error there too. HiDream + Chroma were the only two affected — every other lane (Ideogram-4, Z-Image, Krea, and all the video/audio ones) is already covered by setup.

Fixed + merged in #529 — the roster now pulls both. To pick it up on your rig:

git pull
bash services/comfyui/download_studio_models.sh   # idempotent — grabs only what's missing (HiDream + Chroma)
sudo docker restart comfyui

…or just the one you want: bash services/comfyui/download_hidream_o1.sh (~8.8 GB) / bash services/comfyui/download_chroma.sh (~9 GB).

Appreciate you running the --studio report — that log is what turned a vague "ComfyUI error" into a one-line fix. 🙏

[stage-chuk]

I updated using these commands:

git pull
bash services/comfyui/download_studio_models.sh   # idempotent — grabs only what's missing (HiDream + Chroma)
sudo docker restart comfyui

However running ai-studio again and trying to generate with HiDream still produces a "Image generation failed: ComfyUI generation error" message.
Incidentally, using another lane (e.g. Ideogram 4) results in "Image generation failed: HTTP Error 400: Bad Request". This might be another issue so I will open a new issue for that.

This is the report after attempting to run HiDream:

club-3090 rig report

Generated: 2026-06-30 05:21:39 UTC

Redacted output (paths, host, user, tokens). Re-run with --no-redact for full data.

System

• OS: Ubuntu 26.04 LTS
• Kernel: 7.0.0-27-generic
• Environment: bare metal
• Locale: en_US.UTF-8
• Timezone: JST
• Uptime: up 2 hours, 0 minutes

CPU + RAM

• CPU: AMD Ryzen 7 5800X3D 8-Core Processor (16 threads)
• RAM: 60Gi total, 51Gi available
• Swap: 8.0Gi

Disk

• <MODEL_DIR>: 1.5T available, ext4 filesystem
• /var/lib/docker: 1.5T available, ext4 filesystem

GPU hardware

• GPU 0: NVIDIA GeForce RTX 3090 | 24576 MiB | driver 610.43.02 | VBIOS 94.02.42.00.F1 | persistence=Enabled
  • Power: limit=250.00 W (default=370.00 W, max=380.00 W) | current_draw=248.29 W ⚠ user-capped below default
  • PCIe: x4 lanes negotiated (GPU max x16, Gen up to 4) | bus 00000000:04:00.0 ⚠ slot is narrower than GPU capability — affects load + all-reduce bandwidth
• GPU 1: NVIDIA GeForce RTX 3090 | 24576 MiB | driver 610.43.02 | VBIOS 94.02.42.00.F1 | persistence=Enabled
  • Power: limit=250.00 W (default=370.00 W, max=380.00 W) | current_draw=26.53 W ⚠ user-capped below default
  • PCIe: x16 lanes negotiated (GPU max x16, Gen up to 3) | bus 00000000:0A:00.0
• ECC mode: [N/A] (3090s don't have ECC; expect N/A)

NVLink

No NVLink detected (PCIe-only)

Topology

PCIe / GPU topology matrix

	GPU0	GPU1	CPU Affinity	NUMA Affinity	GPU NUMA ID
GPU0	 X 	PHB	0-15	0		N/A
GPU1	PHB	 X 	0-15	0		N/A

Legend:

  X    = Self
  SYS  = Connection traversing PCIe as well as the SMP interconnect between NUMA nodes (e.g., QPI/UPI)
  NODE = Connection traversing PCIe as well as the interconnect between PCIe Host Bridges within a NUMA node
  PHB  = Connection traversing PCIe as well as a PCIe Host Bridge (typically the CPU)
  PXB  = Connection traversing multiple PCIe bridges (without traversing the PCIe Host Bridge)
  PIX  = Connection traversing at most a single PCIe bridge
  NV#  = Connection traversing a bonded set of # NVLinks

PCIe / P2P detail (lspci)

lspci PCIe/P2P detail (LnkSta / ACS / topology)

# lspci -t  (PCIe topology tree)
-[0000:00]-+-00.0
           +-00.2
           +-01.0
           +-01.1-[01]----00.0
           +-01.2-[02-09]----00.0-[03-09]--+-01.0-[04]--+-00.0
           |                               |            \-00.1
           |                               +-03.0-[05]----00.0
           |                               +-04.0-[06]----00.0
           |                               +-08.0-[07]--+-00.0
           |                               |            +-00.1
           |                               |            \-00.3
           |                               +-09.0-[08]----00.0
           |                               \-0a.0-[09]----00.0
           +-02.0
           +-03.0
           +-03.1-[0a]--+-00.0
           |            \-00.1
           +-04.0
           +-05.0
           +-07.0
           +-07.1-[0b]----00.0
           +-08.0
           +-08.1-[0c]--+-00.0
           |            +-00.1
           |            +-00.3
           |            \-00.4
           +-14.0
           +-14.3
           +-18.0
           +-18.1
           +-18.2
           +-18.3
           +-18.4
           +-18.5
           +-18.6
           \-18.7

# lspci -vvv -s 0000:04:00.0  (GPU function: LnkCap/LnkSta/ACSCap/ACSCtl)
		LnkCap:	Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <1us, L1 <4us
		LnkSta:	Speed 16GT/s, Width x4 (downgraded)

# lspci -vvv -s 0000:03:01.0  (upstream bridge of 0000:04:00.0: LnkCap/LnkSta/ACSCap/ACSCtl)
		LnkCap:	Port #1, Speed 16GT/s, Width x4, ASPM L1, Exit Latency L1 <32us
		LnkSta:	Speed 16GT/s, Width x4
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans+
		ACSCtl:	SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-

# lspci -vvv -s 0000:0a:00.0  (GPU function: LnkCap/LnkSta/ACSCap/ACSCtl)
		LnkCap:	Port #0, Speed 8GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <512ns, L1 <4us
		LnkSta:	Speed 2.5GT/s (downgraded), Width x16

# lspci -vvv -s 0000:00:03.1  (upstream bridge of 0000:0a:00.0: LnkCap/LnkSta/ACSCap/ACSCtl)
		LnkCap:	Port #0, Speed 8GT/s, Width x16, ASPM L1, Exit Latency L1 <64us
		LnkSta:	Speed 2.5GT/s, Width x16
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans+
		ACSCtl:	SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-

# lspci -nnk | grep -A3 -i nvidia  (driver binding + device IDs)
04:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA102 [GeForce RTX 3090] [10de:2204] (rev a1)
	Subsystem: Micro-Star International Co., Ltd. [MSI] Device [1462:3884]
	Kernel driver in use: nvidia
	Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia
04:00.1 Audio device [0403]: NVIDIA Corporation GA102 High Definition Audio Controller [10de:1aef] (rev a1)
	Subsystem: Micro-Star International Co., Ltd. [MSI] Device [1462:3884]
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel
--
0a:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA102 [GeForce RTX 3090] [10de:2204] (rev a1)
	Subsystem: Micro-Star International Co., Ltd. [MSI] Device [1462:3884]
	Kernel driver in use: nvidia
	Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia
0a:00.1 Audio device [0403]: NVIDIA Corporation GA102 High Definition Audio Controller [10de:1aef] (rev a1)
	Subsystem: Micro-Star International Co., Ltd. [MSI] Device [1462:3884]
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel

Full nvidia-smi

Full nvidia-smi output

Tue Jun 30 14:21:40 2026       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 610.43.02              KMD Version: 610.43.02     CUDA UMD Version: 13.3     |
+-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 3090        On  |   00000000:04:00.0 Off |                  N/A |
| 36%   64C    P2            249W /  250W |    5571MiB /  24576MiB |     96%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
|   1  NVIDIA GeForce RTX 3090        On  |   00000000:0A:00.0  On |                  N/A |
|  0%   43C    P8             28W /  250W |    1045MiB /  24576MiB |      3%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A           16127    C+G   ...c/gnome-remote-desktop-daemon        725MiB |
|    0   N/A  N/A           16173      G   /usr/bin/gnome-shell                      4MiB |
|    0   N/A  N/A           22829      C   python                                  256MiB |
|    0   N/A  N/A           23039      C   /app/llama-server                      4546MiB |
|    1   N/A  N/A           16173      G   /usr/bin/gnome-shell                    414MiB |
|    1   N/A  N/A           18068    C+G   ptyxis                                  113MiB |
|    1   N/A  N/A           18101      G   /usr/bin/Xwayland                         6MiB |
|    1   N/A  N/A           22829      C   python                                  256MiB |
|    1   N/A  N/A           26168    C+G   ...rack-uuid=3190708988185955192        119MiB |
+-----------------------------------------------------------------------------------------+

Display / desktop state

• $DISPLAY: :0 (X11 / Wayland session present)
• $WAYLAND_DISPLAY: wayland-0
• Display processes running: Xwayland gnome-shell
• GPU 0 idle VRAM: 5571 MiB ⚠ something is using this GPU (display, browser, container)
• GPU 1 idle VRAM: 980 MiB ⚠ something is using this GPU (display, browser, container)

Container runtime

• Docker: 29.6.1
• docker compose (v2): 5.2.0
• NVIDIA Container Toolkit: 1.19.1

Stack version

• club-3090: v0.10.0-28-g30f3d61-dirty (branch: master, SHA 30f3d61)
• Working tree: ⚠ has uncommitted changes (run git status to inspect)
• GENESIS_PIN default: 7b9fd319 (per scripts/setup.sh)
• Cached vLLM images:
  • tag v0.22.0 digest sha256:0fec7ec5f3e6bc168e54899935fb0557da908a4832a1dbc88e2debcf2f889416 (4 weeks ago)

Profile state

• Profile schema version: 1
• Profile counts: 9 hardware, 10 models, 5 workloads, 13 engines, 11 drafters
• Compose registry: 55 entries
• Canonical scenarios: 9
• Calibration:
  • gemma-4-12b: 1 rows
  • gemma-4-26b-a4b: 0 rows
  • gemma-4-31b: 3 rows
  • qwen3.6-27b: 2 rows
  • qwen3.6-35b-a3b: 1 rows
• Active estate: none (~/.club3090/estate.yml not found)

KV math calibration

• Overall: 7/7 (100%)
• No FAIL rows. kv-calc projections should agree with measured VRAM within the ±1.5 GB error band.

Full kv-calc --calibration output

========================================================================================
Calibration — predicted per-card VRAM vs measured BENCHMARKS rows
========================================================================================

  Predicted = weights + activation + overhead + drafter + (KV capped at available).
  Budget = mem_util × VRAM. Measured = nvidia-smi peak during bench (target ≈ budget).
  Verdict ✓ iff PASS/TIGHT and measured < VRAM (boot OK).

== qwen3.6-27b ==
  compose                     predicted    budget   measured  verdict
  ─────────────────────────   ─────────  ────────  ─────────  ───────
  dual                          19.91 GB   22.80 GB    23.60 GB    PASS ✓
  minimal@64K                   21.60 GB   21.60 GB    22.40 GB   TIGHT ✓

  Verdict accuracy: 2/2 (100%)

== qwen3.6-35b-a3b ==
  compose                     predicted    budget   measured  verdict
  ─────────────────────────   ─────────  ────────  ─────────  ───────
  qwen-35b-a3b-dual             13.68 GB   22.08 GB    22.10 GB    PASS ✓

  Verdict accuracy: 1/1 (100%)

== gemma-4-31b ==
  compose                     predicted    budget   measured  verdict
  ─────────────────────────   ─────────  ────────  ─────────  ───────
  gemma-dual-int8               22.80 GB   22.80 GB    22.20 GB   TIGHT ✓
  gemma-dual                    22.80 GB   22.80 GB    22.50 GB   TIGHT ✓
  gemma-dual-int8@256K          22.80 GB   22.80 GB    22.50 GB   TIGHT ✓

  Verdict accuracy: 3/3 (100%)

== gemma-4-12b ==
  compose                     predicted    budget   measured  verdict
  ─────────────────────────   ─────────  ────────  ─────────  ───────
  gemma-dual                    21.60 GB   21.60 GB    21.60 GB   TIGHT ✓

  Verdict accuracy: 1/1 (100%)

Overall: 7/7 (100%)

Notes:
  - This is a directional estimator (±1.5 GB error band on the breakdown).
  - vLLM's `gpu_worker.py` boot log is the authoritative source.
  - If predicted PASS but measured > budget, file an issue with `scripts/report.sh --bench`.

Active container

No vLLM, llama.cpp, or estate container running. Start one with bash scripts/launch.sh and re-run for the full report.

Recent failed boot attempts

No recently-exited vLLM or llama.cpp containers found.

AI Studio logs (--studio)

Container log tails for image/video/audio generation bugs. ComfyUI carries the workflow
execution trace (the actual generation error). Redacted; pass --no-redact for full paths.

comfyui — Up 2 minutes (last 400 lines)

Requirement already satisfied: numpy>=2 in /opt/conda/lib/python3.11/site-packages (from opencv-python->-r /workspace/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite//requirements.txt (line 1)) (2.2.5)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
[bootstrap] Installing requirements for ComfyUI-WanVideoWrapper...
Requirement already satisfied: ftfy in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 1)) (6.3.1)
Requirement already satisfied: accelerate>=1.2.1 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.14.0)
Requirement already satisfied: einops in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 3)) (0.8.2)
Requirement already satisfied: diffusers>=0.33.0 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (0.38.0)
Requirement already satisfied: peft>=0.17.0 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 5)) (0.19.1)
Requirement already satisfied: sentencepiece>=0.2.0 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 6)) (0.2.1)
Requirement already satisfied: protobuf in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 7)) (7.35.1)
Requirement already satisfied: pyloudnorm in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 8)) (0.2.0)
Requirement already satisfied: gguf>=0.17.1 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 9)) (0.19.0)
Requirement already satisfied: opencv-python in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 10)) (4.13.0.92)
Requirement already satisfied: scipy in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 11)) (1.17.1)
Requirement already satisfied: wcwidth in /opt/conda/lib/python3.11/site-packages (from ftfy->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 1)) (0.2.13)
Requirement already satisfied: numpy>=1.17 in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (2.2.5)
Requirement already satisfied: packaging>=20.0 in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (24.2)
Requirement already satisfied: psutil in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (7.0.0)
Requirement already satisfied: pyyaml in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (6.0.2)
Requirement already satisfied: torch>=2.0.0 in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (2.7.0+cu128)
Requirement already satisfied: huggingface_hub>=0.21.0 in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.21.0)
Requirement already satisfied: safetensors>=0.4.3 in /opt/conda/lib/python3.11/site-packages (from accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (0.8.0)
Requirement already satisfied: importlib_metadata in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (9.0.0)
Requirement already satisfied: filelock in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (3.18.0)
Requirement already satisfied: httpx<1.0.0 in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (0.28.1)
Requirement already satisfied: regex!=2019.12.17 in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (2026.6.28)
Requirement already satisfied: requests in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (2.32.3)
Requirement already satisfied: Pillow in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (11.0.0)
Requirement already satisfied: transformers in /opt/conda/lib/python3.11/site-packages (from peft>=0.17.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 5)) (5.12.1)
Requirement already satisfied: tqdm in /opt/conda/lib/python3.11/site-packages (from peft>=0.17.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 5)) (4.67.1)
Requirement already satisfied: anyio in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (4.14.1)
Requirement already satisfied: certifi in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (2025.1.31)
Requirement already satisfied: httpcore==1.* in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (1.0.9)
Requirement already satisfied: idna in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (3.10)
Requirement already satisfied: h11>=0.16 in /opt/conda/lib/python3.11/site-packages (from httpcore==1.*->httpx<1.0.0->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (0.16.0)
Requirement already satisfied: click>=8.4.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (8.4.2)
Requirement already satisfied: fsspec>=2023.5.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (2025.3.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.5.1 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.5.1)
Requirement already satisfied: typer<0.26.0,>=0.20.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (0.25.1)
Requirement already satisfied: typing-extensions>=4.1.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (4.15.0)
Requirement already satisfied: charset_normalizer<4,>=2 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (3.4.1)
Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (2.3.0)
Requirement already satisfied: sympy>=1.13.3 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.13.3)
Requirement already satisfied: networkx in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (3.4.2)
Requirement already satisfied: jinja2 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (3.1.6)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.7.1.26 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (9.7.1.26)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.13.0.11)
Requirement already satisfied: triton==3.3.0 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (3.3.0)
Requirement already satisfied: setuptools>=40.8.0 in /opt/conda/lib/python3.11/site-packages (from triton==3.3.0->torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (75.8.2)
Requirement already satisfied: zipp>=3.20 in /opt/conda/lib/python3.11/site-packages (from importlib_metadata->diffusers>=0.33.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 4)) (3.21.0)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /opt/conda/lib/python3.11/site-packages (from transformers->peft>=0.17.0->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 5)) (0.22.2)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.11/site-packages (from sympy>=1.13.3->torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.3.0)
Requirement already satisfied: shellingham>=1.3.0 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (1.5.4)
Requirement already satisfied: rich>=13.8.0 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (15.0.0)
Requirement already satisfied: annotated-doc>=0.0.2 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (0.0.4)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.11/site-packages (from jinja2->torch>=2.0.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (3.0.2)
Requirement already satisfied: markdown-it-py>=2.2.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (4.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (2.19.1)
Requirement already satisfied: mdurl~=0.1 in /opt/conda/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub>=0.21.0->accelerate>=1.2.1->-r /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper//requirements.txt (line 2)) (0.1.2)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
[bootstrap] Installing requirements for ComfyUI-nunchaku...
Requirement already satisfied: diffusers>=0.35 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (0.38.0)
Requirement already satisfied: transformers>=4.54 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (5.12.1)
Requirement already satisfied: sentencepiece in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 3)) (0.2.1)
Requirement already satisfied: protobuf in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 4)) (7.35.1)
Requirement already satisfied: huggingface_hub>=0.34 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 5)) (1.21.0)
Requirement already satisfied: tomli in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 6)) (2.4.1)
Requirement already satisfied: peft>=0.17 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (0.19.1)
Requirement already satisfied: accelerate>=1.10 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 8)) (1.14.0)
Requirement already satisfied: insightface in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (1.0.1)
Requirement already satisfied: opencv-python in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 10)) (4.13.0.92)
Requirement already satisfied: facexlib in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (0.3.0)
Requirement already satisfied: onnxruntime in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 12)) (1.27.0)
Requirement already satisfied: timm in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 13)) (1.0.27)
Requirement already satisfied: importlib_metadata in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (9.0.0)
Requirement already satisfied: filelock in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (3.18.0)
Requirement already satisfied: httpx<1.0.0 in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (0.28.1)
Requirement already satisfied: numpy in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (2.2.5)
Requirement already satisfied: regex!=2019.12.17 in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (2026.6.28)
Requirement already satisfied: requests in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (2.32.3)
Requirement already satisfied: safetensors>=0.8.0-rc.0 in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (0.8.0)
Requirement already satisfied: Pillow in /opt/conda/lib/python3.11/site-packages (from diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (11.0.0)
Requirement already satisfied: packaging>=20.0 in /opt/conda/lib/python3.11/site-packages (from transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (24.2)
Requirement already satisfied: pyyaml>=5.1 in /opt/conda/lib/python3.11/site-packages (from transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (6.0.2)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /opt/conda/lib/python3.11/site-packages (from transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (0.22.2)
Requirement already satisfied: typer in /opt/conda/lib/python3.11/site-packages (from transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (0.25.1)
Requirement already satisfied: tqdm>=4.60 in /opt/conda/lib/python3.11/site-packages (from transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (4.67.1)
Requirement already satisfied: click>=8.4.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.34->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 5)) (8.4.2)
Requirement already satisfied: fsspec>=2023.5.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.34->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 5)) (2025.3.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.5.1 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.34->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 5)) (1.5.1)
Requirement already satisfied: typing-extensions>=4.1.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.34->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 5)) (4.15.0)
Requirement already satisfied: psutil in /opt/conda/lib/python3.11/site-packages (from peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (7.0.0)
Requirement already satisfied: torch>=1.13.0 in /opt/conda/lib/python3.11/site-packages (from peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (2.7.0+cu128)
Requirement already satisfied: onnx in /opt/conda/lib/python3.11/site-packages (from insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (1.22.0)
Requirement already satisfied: scipy in /opt/conda/lib/python3.11/site-packages (from insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (1.17.1)
Requirement already satisfied: scikit-image in /opt/conda/lib/python3.11/site-packages (from insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (0.26.0)
Requirement already satisfied: filterpy in /opt/conda/lib/python3.11/site-packages (from facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (1.4.5)
Requirement already satisfied: numba in /opt/conda/lib/python3.11/site-packages (from facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (0.65.1)
Requirement already satisfied: torchvision in /opt/conda/lib/python3.11/site-packages (from facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (0.22.0+cu128)
Requirement already satisfied: flatbuffers in /opt/conda/lib/python3.11/site-packages (from onnxruntime->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 12)) (25.12.19)
Requirement already satisfied: anyio in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (4.14.1)
Requirement already satisfied: certifi in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (2025.1.31)
Requirement already satisfied: httpcore==1.* in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (1.0.9)
Requirement already satisfied: idna in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (3.10)
Requirement already satisfied: h11>=0.16 in /opt/conda/lib/python3.11/site-packages (from httpcore==1.*->httpx<1.0.0->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (0.16.0)
Requirement already satisfied: sympy>=1.13.3 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (1.13.3)
Requirement already satisfied: networkx in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (3.4.2)
Requirement already satisfied: jinja2 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (3.1.6)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.7.1.26 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (9.7.1.26)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (1.13.0.11)
Requirement already satisfied: triton==3.3.0 in /opt/conda/lib/python3.11/site-packages (from torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (3.3.0)
Requirement already satisfied: setuptools>=40.8.0 in /opt/conda/lib/python3.11/site-packages (from triton==3.3.0->torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (75.8.2)
Requirement already satisfied: shellingham>=1.3.0 in /opt/conda/lib/python3.11/site-packages (from typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (1.5.4)
Requirement already satisfied: rich>=13.8.0 in /opt/conda/lib/python3.11/site-packages (from typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (15.0.0)
Requirement already satisfied: annotated-doc>=0.0.2 in /opt/conda/lib/python3.11/site-packages (from typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (0.0.4)
Requirement already satisfied: matplotlib in /opt/conda/lib/python3.11/site-packages (from filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (3.11.0)
Requirement already satisfied: zipp>=3.20 in /opt/conda/lib/python3.11/site-packages (from importlib_metadata->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (3.21.0)
Requirement already satisfied: llvmlite<0.48,>=0.47.0dev0 in /opt/conda/lib/python3.11/site-packages (from numba->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (0.47.0)
Requirement already satisfied: ml_dtypes>=0.5.4 in /opt/conda/lib/python3.11/site-packages (from onnx->insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (0.5.4)
Requirement already satisfied: charset_normalizer<4,>=2 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (3.4.1)
Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers>=0.35->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 1)) (2.3.0)
Requirement already satisfied: imageio!=2.35.0,>=2.33 in /opt/conda/lib/python3.11/site-packages (from scikit-image->insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (2.37.3)
Requirement already satisfied: tifffile>=2022.8.12 in /opt/conda/lib/python3.11/site-packages (from scikit-image->insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (2026.3.3)
Requirement already satisfied: lazy-loader>=0.4 in /opt/conda/lib/python3.11/site-packages (from scikit-image->insightface->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 9)) (0.5)
Requirement already satisfied: markdown-it-py>=2.2.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (4.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (2.19.1)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.11/site-packages (from sympy>=1.13.3->torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.11/site-packages (from jinja2->torch>=1.13.0->peft>=0.17->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 7)) (3.0.2)
Requirement already satisfied: contourpy>=1.0.1 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (1.3.3)
Requirement already satisfied: cycler>=0.10 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (4.63.0)
Requirement already satisfied: kiwisolver>=1.3.1 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (1.5.0)
Requirement already satisfied: pyparsing>=3 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (3.3.2)
Requirement already satisfied: python-dateutil>=2.7 in /opt/conda/lib/python3.11/site-packages (from matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (2.9.0.post0)
Requirement already satisfied: mdurl~=0.1 in /opt/conda/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.8.0->typer->transformers>=4.54->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 2)) (0.1.2)
Requirement already satisfied: six>=1.5 in /opt/conda/lib/python3.11/site-packages (from python-dateutil>=2.7->matplotlib->filterpy->facexlib->-r /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku//requirements.txt (line 11)) (1.17.0)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
[bootstrap] Installing requirements for HiDream_O1-ComfyUI...
Requirement already satisfied: accelerate in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 1)) (1.14.0)
Requirement already satisfied: diffusers in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (0.38.0)
Requirement already satisfied: einops in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 3)) (0.8.2)
Requirement already satisfied: huggingface_hub in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (1.21.0)
Requirement already satisfied: numpy in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 5)) (2.2.5)
Requirement already satisfied: pillow in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 6)) (11.0.0)
Requirement already satisfied: scipy in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 7)) (1.17.1)
Requirement already satisfied: safetensors in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 8)) (0.8.0)
Requirement already satisfied: torch in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (2.7.0+cu128)
Requirement already satisfied: torchvision in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 10)) (0.22.0+cu128)
Requirement already satisfied: transformers>=4.57.1 in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 11)) (5.12.1)
Requirement already satisfied: typing_extensions in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 12)) (4.15.0)
Requirement already satisfied: tqdm in /opt/conda/lib/python3.11/site-packages (from -r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 13)) (4.67.1)
Requirement already satisfied: packaging>=20.0 in /opt/conda/lib/python3.11/site-packages (from accelerate->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 1)) (24.2)
Requirement already satisfied: psutil in /opt/conda/lib/python3.11/site-packages (from accelerate->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 1)) (7.0.0)
Requirement already satisfied: pyyaml in /opt/conda/lib/python3.11/site-packages (from accelerate->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 1)) (6.0.2)
Requirement already satisfied: importlib_metadata in /opt/conda/lib/python3.11/site-packages (from diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (9.0.0)
Requirement already satisfied: filelock in /opt/conda/lib/python3.11/site-packages (from diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (3.18.0)
Requirement already satisfied: httpx<1.0.0 in /opt/conda/lib/python3.11/site-packages (from diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (0.28.1)
Requirement already satisfied: regex!=2019.12.17 in /opt/conda/lib/python3.11/site-packages (from diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (2026.6.28)
Requirement already satisfied: requests in /opt/conda/lib/python3.11/site-packages (from diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (2.32.3)
Requirement already satisfied: click>=8.4.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (8.4.2)
Requirement already satisfied: fsspec>=2023.5.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (2025.3.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.5.1 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (1.5.1)
Requirement already satisfied: typer<0.26.0,>=0.20.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (0.25.1)
Requirement already satisfied: sympy>=1.13.3 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (1.13.3)
Requirement already satisfied: networkx in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (3.4.2)
Requirement already satisfied: jinja2 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (3.1.6)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.7.1.26 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (9.7.1.26)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (1.13.0.11)
Requirement already satisfied: triton==3.3.0 in /opt/conda/lib/python3.11/site-packages (from torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (3.3.0)
Requirement already satisfied: setuptools>=40.8.0 in /opt/conda/lib/python3.11/site-packages (from triton==3.3.0->torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (75.8.2)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /opt/conda/lib/python3.11/site-packages (from transformers>=4.57.1->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 11)) (0.22.2)
Requirement already satisfied: anyio in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (4.14.1)
Requirement already satisfied: certifi in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (2025.1.31)
Requirement already satisfied: httpcore==1.* in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (1.0.9)
Requirement already satisfied: idna in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (3.10)
Requirement already satisfied: h11>=0.16 in /opt/conda/lib/python3.11/site-packages (from httpcore==1.*->httpx<1.0.0->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (0.16.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.11/site-packages (from sympy>=1.13.3->torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (1.3.0)
Requirement already satisfied: shellingham>=1.3.0 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (1.5.4)
Requirement already satisfied: rich>=13.8.0 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (15.0.0)
Requirement already satisfied: annotated-doc>=0.0.2 in /opt/conda/lib/python3.11/site-packages (from typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (0.0.4)
Requirement already satisfied: zipp>=3.20 in /opt/conda/lib/python3.11/site-packages (from importlib_metadata->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (3.21.0)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.11/site-packages (from jinja2->torch->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 9)) (3.0.2)
Requirement already satisfied: charset_normalizer<4,>=2 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (3.4.1)
Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.11/site-packages (from requests->diffusers->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 2)) (2.3.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (4.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /opt/conda/lib/python3.11/site-packages (from rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (2.19.1)
Requirement already satisfied: mdurl~=0.1 in /opt/conda/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.8.0->typer<0.26.0,>=0.20.0->huggingface_hub->-r /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI//requirements.txt (line 4)) (0.1.2)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
[bootstrap] nunchaku already installed.
[bootstrap] Starting ComfyUI on 0.0.0.0:8188
[INFO] setup plugin alembic.autogenerate.schemas
[INFO] setup plugin alembic.autogenerate.tables
[INFO] setup plugin alembic.autogenerate.types
[INFO] setup plugin alembic.autogenerate.constraints
[INFO] setup plugin alembic.autogenerate.defaults
[INFO] setup plugin alembic.autogenerate.comments
[INFO] Adding extra search path diffusion_models /workspace/ComfyUI/models/diffusion_models
[INFO] Adding extra search path diffusion_models /workspace/ComfyUI/models/unet
[INFO] Adding extra search path unet /workspace/ComfyUI/models/unet
[INFO] Adding extra search path unet /workspace/ComfyUI/models/diffusion_models
[INFO] Adding extra search path text_encoders /workspace/ComfyUI/models/text_encoders
[INFO] Adding extra search path text_encoders /workspace/ComfyUI/models/clip
[INFO] Adding extra search path clip /workspace/ComfyUI/models/clip
[INFO] Adding extra search path clip /workspace/ComfyUI/models/text_encoders
[INFO] Adding extra search path vae /workspace/ComfyUI/models/vae
[INFO] Adding extra search path loras /workspace/ComfyUI/models/loras
[INFO] Adding extra search path checkpoints /workspace/ComfyUI/models/checkpoints
[INFO] Adding extra search path controlnet /workspace/ComfyUI/models/controlnet
[INFO] Adding extra search path upscale_models /workspace/ComfyUI/models/upscale_models
[INFO] [ComfyUI-Manager] Using `uv` as Python module for pip operations.
Using Python 3.11.12 environment at: /opt/conda
[START] Security scan
[DONE] Security scan
## ComfyUI-Manager: installing dependencies done.
** ComfyUI startup time: 2026-06-30 05:19:39.009
** Platform: Linux
** Python version: 3.11.12 | packaged by conda-forge | (main, Apr 10 2025, 22:23:25) [GCC 13.3.0]
** Python executable: /opt/conda/bin/python
** ComfyUI Path: /workspace/ComfyUI
** ComfyUI Base Folder Path: /workspace/ComfyUI
** User directory: /workspace/ComfyUI/user
** ComfyUI-Manager config path: /workspace/ComfyUI/user/__manager/config.ini
** Log path: /workspace/ComfyUI/user/comfyui.log
Using Python 3.11.12 environment at: /opt/conda
Using Python 3.11.12 environment at: /opt/conda
[INFO] 
Prestartup times for custom nodes:
[INFO]    0.7 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Manager
[INFO] 
[WARNING] WARNING: You need pytorch with cu130 or higher to use optimized CUDA operations.
[INFO] Found comfy_kitchen backend cuda: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_nvfp4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']}
[INFO] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']}
[INFO] Found comfy_kitchen backend triton: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8']}
[INFO] Checkpoint files will always be loaded safely.
[INFO] Total VRAM 24124 MB, total RAM 62171 MB
[INFO] pytorch version: 2.7.0+cu128
[INFO] Set vram state to: NORMAL_VRAM
[INFO] Device: cuda:0 NVIDIA GeForce RTX 3090 : cudaMallocAsync
[INFO] Device: cuda:1 NVIDIA GeForce RTX 3090 : cudaMallocAsync
[INFO] Using async weight offloading with 2 streams
[INFO] Enabled pinned memory 55954.0
[INFO] Using pytorch attention
[WARNING] Unsupported Pytorch detected. DynamicVRAM support requires Pytorch version 2.8 or later. Falling back to legacy ModelPatcher. VRAM estimates may be unreliable especially on Windows
[INFO] Python version: 3.11.12 | packaged by conda-forge | (main, Apr 10 2025, 22:23:25) [GCC 13.3.0]
[INFO] ComfyUI version: 0.26.0
[INFO] comfy-aimdo version: 0.4.10
[INFO] comfy-kitchen version: 0.2.10
[INFO] comfyui-frontend-package version: 1.45.19
[INFO] comfyui-workflow-templates version: 0.10.3
[INFO] comfyui-embedded-docs version: 0.5.5
[INFO] comfy-kitchen version: 0.2.10
[INFO] comfy-aimdo version: 0.4.10
[INFO] [Prompt Server] web root: /opt/conda/lib/python3.11/site-packages/comfyui_frontend_package/static
[INFO] Asset seeder disabled
[INFO] ComfyUI-GGUF: Partial torch compile only, consider updating pytorch
[INFO] [MultiGPU Core Patching] Patching mm.soft_empty_cache for Comprehensive Memory Management (VRAM + CPU + Store Pruning)
[MultiGPU Core Patching] Patching mm.get_torch_device, mm.text_encoder_device, mm.unet_offload_device
[MultiGPU DEBUG] Initial current_device: cuda:0
[MultiGPU DEBUG] Initial current_text_encoder_device: cuda:0
[MultiGPU DEBUG] Initial current_unet_offload_device: cpu
[MultiGPU] Patched comfy.model_management.current_stream to honor CUDA device arguments
[MultiGPU] Patched comfy.sample.sample with runtime device guard
[MultiGPU] Patched comfy.sample.sample_custom with runtime device guard
[MultiGPU] Applied comfy_kitchen CUDA DLPack device guard patch (P2P-aware)
[MultiGPU] DynamicVRAM not enabled; skipping multi-device aimdo initialization
[MultiGPU] Initiating custom_node Registration. . .
-----------------------------------------------
custom_node                   Found     Nodes
-----------------------------------------------
ComfyUI-LTXVideo                  N         0
ComfyUI-Florence2                 N         0
ComfyUI_bitsandbytes_NF4          N         0
x-flux-comfyui                    N         0
ComfyUI-MMAudio                   N         0
ComfyUI-GGUF                      Y        18
PuLID_ComfyUI                     N         0
ComfyUI-WanVideoWrapper           Y        20
-----------------------------------------------
[MultiGPU] Registration complete. Final mappings: CheckpointLoaderAdvancedMultiGPU, CheckpointLoaderAdvancedDisTorch2MultiGPU, DeviceSelectorMultiGPU, UNetLoaderLP, UNETLoaderMultiGPU, VAELoaderMultiGPU, CLIPLoaderMultiGPU, DualCLIPLoaderMultiGPU, TripleCLIPLoaderMultiGPU, QuadrupleCLIPLoaderMultiGPU, CLIPVisionLoaderMultiGPU, CheckpointLoaderSimpleMultiGPU, ControlNetLoaderMultiGPU, DiffusersLoaderMultiGPU, DiffControlNetLoaderMultiGPU, UNETLoaderDisTorch2MultiGPU, VAELoaderDisTorch2MultiGPU, CLIPLoaderDisTorch2MultiGPU, DualCLIPLoaderDisTorch2MultiGPU, TripleCLIPLoaderDisTorch2MultiGPU, QuadrupleCLIPLoaderDisTorch2MultiGPU, CLIPVisionLoaderDisTorch2MultiGPU, CheckpointLoaderSimpleDisTorch2MultiGPU, ControlNetLoaderDisTorch2MultiGPU, DiffusersLoaderDisTorch2MultiGPU, DiffControlNetLoaderDisTorch2MultiGPU, UnetLoaderGGUFDisTorchMultiGPU, UnetLoaderGGUFAdvancedDisTorchMultiGPU, CLIPLoaderGGUFDisTorchMultiGPU, DualCLIPLoaderGGUFDisTorchMultiGPU, TripleCLIPLoaderGGUFDisTorchMultiGPU, QuadrupleCLIPLoaderGGUFDisTorchMultiGPU, UnetLoaderGGUFDisTorch2MultiGPU, UnetLoaderGGUFAdvancedDisTorch2MultiGPU, CLIPLoaderGGUFDisTorch2MultiGPU, DualCLIPLoaderGGUFDisTorch2MultiGPU, TripleCLIPLoaderGGUFDisTorch2MultiGPU, QuadrupleCLIPLoaderGGUFDisTorch2MultiGPU, UnetLoaderGGUFMultiGPU, UnetLoaderGGUFAdvancedMultiGPU, CLIPLoaderGGUFMultiGPU, DualCLIPLoaderGGUFMultiGPU, TripleCLIPLoaderGGUFMultiGPU, QuadrupleCLIPLoaderGGUFMultiGPU, LoadWanVideoT5TextEncoderMultiGPU, WanVideoTextEncodeMultiGPU, WanVideoTextEncodeCachedMultiGPU, WanVideoTextEncodeSingleMultiGPU, WanVideoVAELoaderMultiGPU, WanVideoTinyVAELoaderMultiGPU, WanVideoBlockSwapMultiGPU, WanVideoImageToVideoEncodeMultiGPU, WanVideoDecodeMultiGPU, WanVideoModelLoaderMultiGPU, WanVideoSamplerMultiGPU, WanVideoVACEEncodeMultiGPU, WanVideoEncodeMultiGPU, LoadWanVideoClipTextEncoderMultiGPU, WanVideoClipVisionEncodeMultiGPU, WanVideoControlnetLoaderMultiGPU, FantasyTalkingModelLoaderMultiGPU, Wav2VecModelLoaderMultiGPU, WanVideoUni3C_ControlnetLoaderMultiGPU, DownloadAndLoadWav2VecModelMultiGPU
[INFO] ======================================== ComfyUI-nunchaku Initialization ========================================
[INFO] Nunchaku version: 1.2.0
[INFO] ComfyUI-nunchaku version: 1.2.1
/opt/conda/lib/python3.11/site-packages/timm/models/layers/__init__.py:49: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning)
'nunchaku_versions.json' not found. Node will start in minimal mode. Use 'update node' to fetch versions.
[INFO] =================================================================================================================
[WARNING] Warning: Could not load sageattention: No module named 'sageattention'
[WARNING] sageattention package is not installed, sageattention will not be available
[INFO] ### Loading: ComfyUI-Manager (V3.41)
[INFO] [ComfyUI-Manager] network_mode: public
[INFO] [ComfyUI-Manager] ComfyUI per-queue preview override detected (PR #11261). Manager's preview method feature is disabled. Use ComfyUI's --preview-method CLI option or 'Settings > Execution > Live preview method'.
[INFO] ### ComfyUI Revision: 1 [f6c162dd] *DETACHED | Released on '2026-06-23'
[INFO] 
Import times for custom nodes:
[INFO]    0.0 seconds: /workspace/ComfyUI/custom_nodes/websocket_image_save.py
[INFO]    0.0 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-MultiGPU
[INFO]    0.0 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-GGUF
[INFO]    0.0 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Manager
[INFO]    0.0 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-HunyuanVideoWrapper
[INFO]    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-KJNodes
[INFO]    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite
[INFO]    0.2 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-WanVideoWrapper
[INFO]    0.4 seconds: /workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI
[INFO]    0.7 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-nunchaku
[INFO] 
[INFO] Context impl SQLiteImpl.
[INFO] Will assume non-transactional DDL.
[INFO] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json
[INFO] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json
[INFO] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json
[INFO] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json
[INFO] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json
[INFO] Using RAM pressure cache.
[INFO] Starting server

[INFO] To see the GUI go to: http://0.0.0.0:8188
FETCH ComfyRegistry Data: 5/157
FETCH ComfyRegistry Data: 10/157
FETCH ComfyRegistry Data: 15/157
FETCH ComfyRegistry Data: 20/157
FETCH ComfyRegistry Data: 25/157
FETCH ComfyRegistry Data: 30/157
FETCH ComfyRegistry Data: 35/157
FETCH ComfyRegistry Data: 40/157
FETCH ComfyRegistry Data: 45/157
FETCH ComfyRegistry Data: 50/157
FETCH ComfyRegistry Data: 55/157
FETCH ComfyRegistry Data: 60/157
FETCH ComfyRegistry Data: 65/157
FETCH ComfyRegistry Data: 70/157
FETCH ComfyRegistry Data: 75/157
FETCH ComfyRegistry Data: 80/157
FETCH ComfyRegistry Data: 85/157
FETCH ComfyRegistry Data: 90/157
FETCH ComfyRegistry Data: 95/157
FETCH ComfyRegistry Data: 100/157
FETCH ComfyRegistry Data: 105/157
FETCH ComfyRegistry Data: 110/157
FETCH ComfyRegistry Data: 115/157
[INFO] got prompt
[ERROR] !!! Exception during processing !!! HiDream-O1-Image-Dev-2604-FP8 is not installed. Enable download_if_missing to download it, or place the complete model folder in ComfyUI/models/diffusion_models.
[ERROR] Traceback (most recent call last):
  File "/workspace/ComfyUI/execution.py", line 542, in execute
    output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
                                                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspace/ComfyUI/execution.py", line 341, in get_output_data
    return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspace/ComfyUI/execution.py", line 315, in _async_map_node_over_list
    await process_inputs(input_dict, i)
  File "/workspace/ComfyUI/execution.py", line 303, in process_inputs
    result = f(**inputs)
             ^^^^^^^^^^^
  File "/workspace/ComfyUI/custom_nodes/HiDream_O1-ComfyUI/nodes.py", line 307, in load_model
    raise FileNotFoundError(
FileNotFoundError: HiDream-O1-Image-Dev-2604-FP8 is not installed. Enable download_if_missing to download it, or place the complete model folder in ComfyUI/models/diffusion_models.

[INFO] Prompt executed in 0.01 seconds
FETCH ComfyRegistry Data: 120/157
FETCH ComfyRegistry Data: 125/157
FETCH ComfyRegistry Data: 130/157
FETCH ComfyRegistry Data: 135/157
FETCH ComfyRegistry Data: 140/157
FETCH ComfyRegistry Data: 145/157

studio-director — Up 2 minutes (healthy) (last 200 lines)

0.05.892.555 I srv          init: idle slots will be saved to prompt cache and cleared upon starting a new task
0.05.921.191 I init: chat template, example_format: '<|im_start|>system
You are a helpful assistant<|im_end|>
<|im_start|>user
Hello<|im_end|>
<|im_start|>assistant
Hi there<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
<think>
'
0.05.931.372 I srv          init: init: chat template, thinking = 1
0.05.931.410 I srv  llama_server: model loaded
0.05.931.413 I srv  llama_server: server is listening on http://0.0.0.0:8090
0.05.931.418 I srv  update_slots: all slots are idle
117.16.224.742 I srv    operator(): operator(): cleaning up before exit...
warn: LLAMA_ARG_HOST environment variable is set, but will be overwritten by command line argument --host
0.00.089.144 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.00.089.147 I device_info:
0.00.181.730 I   - CUDA0   : NVIDIA GeForce RTX 3090 (24123 MiB, 23104 MiB free)
0.00.181.738 I   - CPU     : AMD Ryzen 7 5800X3D 8-Core Processor (62171 MiB, 62171 MiB free)
0.00.181.807 I system_info: n_threads = 8 (n_threads_batch = 8) / 16 | CUDA : ARCHS = 500,610,700,750,800,860,890,900,1200 | USE_GRAPHS = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | 
0.00.181.813 I srv  llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
0.00.181.859 I srv          init: running without SSL
0.00.181.933 I srv          init: using 15 threads for HTTP server
0.00.182.392 I srv         start: binding port with default address family
0.00.183.554 I srv  llama_server: loading model
0.00.183.605 I srv    load_model: loading model '/models/qwen3.5-4b-gguf/hauhaucs-uncensored-q4km/Qwen3.5-4B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf'
0.00.245.460 I srv    load_model: [mtmd] estimated worst-case memory usage of mmproj is 892.48 MiB (took 61.83 ms)
0.00.245.487 I common_init_result: fitting params to device memory ...
0.00.245.490 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.01.427.528 W llama_context: n_ctx_seq (16384) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
0.01.455.411 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.01.500.461 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks
0.01.500.463 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024
0.01.500.464 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842

0.01.734.940 I srv    load_model: loaded multimodal model, '/models/qwen3.5-4b-gguf/hauhaucs-uncensored-q4km/mmproj-Qwen3.5-4B-Uncensored-HauhauCS-Aggressive-BF16.gguf'
0.01.734.951 I srv    load_model: initializing slots, n_slots = 4
0.01.745.882 W srv    load_model: speculative decoding will use checkpoints
0.01.745.896 W common_speculative_init: no implementations specified for speculative decoding
0.01.745.896 I slot   load_model: id  0 | task -1 | new slot, n_ctx = 16384
0.01.745.902 I slot   load_model: id  1 | task -1 | new slot, n_ctx = 16384
0.01.745.902 I slot   load_model: id  2 | task -1 | new slot, n_ctx = 16384
0.01.745.903 I slot   load_model: id  3 | task -1 | new slot, n_ctx = 16384
0.01.745.940 I srv    load_model: prompt cache is enabled, size limit: 8192 MiB
0.01.745.941 I srv    load_model: use `--cache-ram 0` to disable the prompt cache
0.01.745.942 I srv    load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
0.01.745.942 I srv    load_model: context checkpoints enabled, max = 32, min spacing = 8192
0.01.745.955 I srv          init: idle slots will be saved to prompt cache and cleared upon starting a new task
0.01.760.117 I init: chat template, example_format: '<|im_start|>system
You are a helpful assistant<|im_end|>
<|im_start|>user
Hello<|im_end|>
<|im_start|>assistant
Hi there<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
<think>
'
0.01.770.159 I srv          init: init: chat template, thinking = 1
0.01.770.198 I srv  llama_server: model loaded
0.01.770.203 I srv  llama_server: server is listening on http://0.0.0.0:8090
0.01.770.209 I srv  update_slots: all slots are idle
1.10.859.651 I srv    operator(): Chat format: peg-native
1.10.859.823 I slot get_availabl: id  3 | task -1 | selected slot by LRU, t_last = -1
1.10.859.825 I srv  get_availabl: updating prompt cache
1.10.859.830 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
1.10.859.834 I srv        update:  - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 16384 tokens, 8589934592 est)
1.10.859.834 I srv  get_availabl: prompt cache update took 0.01 ms
1.10.859.878 I slot launch_slot_: id  3 | task 0 | processing task, is_child = 0
1.10.859.880 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.10.859.881 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.10.859.894 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.10.859.895 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.10.859.903 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.10.859.903 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.10.860.586 I srv  stream_sessi: stream_session_attach_pipe: conv_id= (empty=1)
1.10.963.060 I slot create_check: id  3 | task 0 | created context checkpoint 1 of 32 (pos_min = 21, pos_max = 21, n_tokens = 22, size = 50.251 MiB)
1.13.984.842 I slot print_timing: id  3 | task 0 | n_decoded =    436, tg = 145.17 t/s, tg_3s = 145.17 t/s
1.16.987.134 I slot print_timing: id  3 | task 0 | n_decoded =    872, tg = 145.20 t/s, tg_3s = 145.22 t/s
1.19.991.618 I slot print_timing: id  3 | task 0 | n_decoded =   1303, tg = 144.62 t/s, tg_3s = 143.45 t/s
1.22.998.208 I slot print_timing: id  3 | task 0 | n_decoded =   1738, tg = 144.63 t/s, tg_3s = 144.68 t/s
1.26.000.409 I slot print_timing: id  3 | task 0 | n_decoded =   2167, tg = 144.29 t/s, tg_3s = 142.90 t/s
1.29.002.177 I slot print_timing: id  3 | task 0 | n_decoded =   2594, tg = 143.95 t/s, tg_3s = 142.25 t/s
1.32.009.150 I slot print_timing: id  3 | task 0 | n_decoded =   3021, tg = 143.67 t/s, tg_3s = 142.00 t/s
1.33.325.100 W srv          stop: cancel task, id_task = 0
1.33.331.478 I slot      release: id  3 | task 0 | stop processing: n_tokens = 3233, truncated = 0
1.33.331.533 I srv  update_slots: all slots are idle
1.58.851.977 I srv    operator(): Chat format: peg-native
1.58.852.151 I slot get_availabl: id  2 | task -1 | selected slot by LRU, t_last = -1
1.58.852.152 I srv  get_availabl: updating prompt cache
1.58.852.155 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
1.58.852.158 I srv        update:  - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 16384 tokens, 8589934592 est)
1.58.852.159 I srv  get_availabl: prompt cache update took 0.01 ms
1.58.852.203 I slot launch_slot_: id  2 | task 3211 | processing task, is_child = 0
1.58.852.203 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.58.852.204 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.58.852.222 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.58.852.222 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.58.852.233 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
1.58.852.334 W srv   prompt_save:  - saving prompt with length 3233, total state size = 151.344 MiB (draft: 0.000 MiB)
1.58.999.577 I srv        update:  - cache state: 1 prompts, 201.594 MiB (limits: 8192.000 MiB, 16384 tokens, 131376 est)
1.58.999.580 I srv        update:    - prompt 0x6511020ca780:    3233 tokens, checkpoints:  1,   201.594 MiB
1.58.999.581 I slot prompt_clear: id  3 | task -1 | clearing prompt with 3233 tokens
1.59.062.531 I slot create_check: id  2 | task 3211 | created context checkpoint 1 of 32 (pos_min = 244, pos_max = 244, n_tokens = 245, size = 50.251 MiB)
2.00.452.372 I slot print_timing: id  2 | task 3211 | prompt eval time =      88.42 ms /   273 tokens (    0.32 ms per token,  3087.71 tokens per second)
2.00.452.376 I slot print_timing: id  2 | task 3211 |        eval time =    1364.08 ms /   199 tokens (    6.85 ms per token,   145.89 tokens per second)
2.00.452.376 I slot print_timing: id  2 | task 3211 |       total time =    1452.49 ms /   472 tokens
2.00.452.381 I slot print_timing: id  2 | task 3211 |    graphs reused =       3392
2.00.452.427 I slot      release: id  2 | task 3211 | stop processing: n_tokens = 471, truncated = 0
2.00.452.432 I srv  update_slots: all slots are idle
2.00.453.248 I srv  stream_sessi: stream_session_attach_pipe: conv_id= (empty=1)
2.02.496.312 I srv    operator(): Chat format: peg-native
2.02.496.547 I slot get_availabl: id  1 | task -1 | selected slot by LRU, t_last = -1
2.02.496.557 I srv  get_availabl: updating prompt cache
2.02.496.565 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
2.02.496.571 I srv        update:  - cache state: 1 prompts, 201.594 MiB (limits: 8192.000 MiB, 16384 tokens, 131376 est)
2.02.496.574 I srv        update:    - prompt 0x6511020ca780:    3233 tokens, checkpoints:  1,   201.594 MiB
2.02.496.574 I srv  get_availabl: prompt cache update took 0.02 ms
2.02.496.674 I slot launch_slot_: id  1 | task 3413 | processing task, is_child = 0
2.02.496.682 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.02.496.683 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.02.496.710 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.02.496.752 W srv   prompt_save:  - saving prompt with length 471, total state size = 64.979 MiB (draft: 0.000 MiB)
2.02.574.448 I srv        update:  - cache state: 2 prompts, 316.823 MiB (limits: 8192.000 MiB, 16384 tokens, 95773 est)
2.02.574.452 I srv        update:    - prompt 0x6511020ca780:    3233 tokens, checkpoints:  1,   201.594 MiB
2.02.574.453 I srv        update:    - prompt 0x6511025c10b0:     471 tokens, checkpoints:  1,   115.229 MiB
2.02.574.453 I slot prompt_clear: id  2 | task -1 | clearing prompt with 471 tokens
2.02.574.502 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
2.02.574.504 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
2.02.642.761 I slot create_check: id  1 | task 3413 | created context checkpoint 1 of 32 (pos_min = 266, pos_max = 266, n_tokens = 267, size = 50.251 MiB)
2.05.662.685 I slot print_timing: id  1 | task 3413 | n_decoded =    438, tg = 145.75 t/s, tg_3s = 145.75 t/s
2.08.668.025 I slot print_timing: id  1 | task 3413 | n_decoded =    872, tg = 145.08 t/s, tg_3s = 144.41 t/s
2.11.668.117 I slot print_timing: id  1 | task 3413 | n_decoded =   1306, tg = 144.94 t/s, tg_3s = 144.66 t/s
2.14.673.412 I slot print_timing: id  1 | task 3413 | n_decoded =   1754, tg = 145.97 t/s, tg_3s = 149.07 t/s
2.17.677.047 I slot print_timing: id  1 | task 3413 | n_decoded =   2222, tg = 147.94 t/s, tg_3s = 155.81 t/s
2.17.696.220 I slot print_timing: id  1 | task 3413 | prompt eval time =      82.95 ms /   271 tokens (    0.31 ms per token,  3267.07 tokens per second)
2.17.696.223 I slot print_timing: id  1 | task 3413 |        eval time =   15038.74 ms /  2225 tokens (    6.76 ms per token,   147.95 tokens per second)
2.17.696.224 I slot print_timing: id  1 | task 3413 |       total time =   15121.69 ms /  2496 tokens
2.17.696.224 I slot print_timing: id  1 | task 3413 |    graphs reused =       5607
2.17.696.250 I slot      release: id  1 | task 3413 | stop processing: n_tokens = 2495, truncated = 0
2.17.696.258 I srv  update_slots: all slots are idle
2.17.696.482 I srv  stream_sessi: stream_session_attach_pipe: conv_id= (empty=1)
2.17.715.151 I srv    operator(): Chat format: peg-native
2.17.715.269 I slot get_availabl: id  0 | task -1 | selected slot by LRU, t_last = -1
2.17.715.271 I srv  get_availabl: updating prompt cache
2.17.715.273 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
2.17.715.275 I srv        update:  - cache state: 2 prompts, 316.823 MiB (limits: 8192.000 MiB, 16384 tokens, 95773 est)
2.17.715.276 I srv        update:    - prompt 0x6511020ca780:    3233 tokens, checkpoints:  1,   201.594 MiB
2.17.715.277 I srv        update:    - prompt 0x6511025c10b0:     471 tokens, checkpoints:  1,   115.229 MiB
2.17.715.278 I srv  get_availabl: prompt cache update took 0.01 ms
2.17.715.311 I slot launch_slot_: id  0 | task 5640 | processing task, is_child = 0
2.17.715.311 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.17.715.394 W srv   prompt_save:  - saving prompt with length 2495, total state size = 128.267 MiB (draft: 0.000 MiB)
2.17.839.792 I srv        update:  - cache state: 3 prompts, 495.341 MiB (limits: 8192.000 MiB, 16384 tokens, 102519 est)
2.17.839.796 I srv        update:    - prompt 0x6511020ca780:    3233 tokens, checkpoints:  1,   201.594 MiB
2.17.839.797 I srv        update:    - prompt 0x6511025c10b0:     471 tokens, checkpoints:  1,   115.229 MiB
2.17.839.798 I srv        update:    - prompt 0x6511020d15b0:    2495 tokens, checkpoints:  1,   178.518 MiB
2.17.839.799 I slot prompt_clear: id  1 | task -1 | clearing prompt with 2495 tokens
2.17.840.009 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.17.840.011 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.17.840.019 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
2.17.840.019 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
2.17.920.777 I slot create_check: id  0 | task 5640 | created context checkpoint 1 of 32 (pos_min = 339, pos_max = 339, n_tokens = 340, size = 50.251 MiB)
2.20.936.422 I slot print_timing: id  0 | task 5640 | n_decoded =    475, tg = 158.18 t/s, tg_3s = 158.18 t/s
2.23.938.924 I slot print_timing: id  0 | task 5640 | n_decoded =    944, tg = 157.19 t/s, tg_3s = 156.20 t/s
2.24.303.089 I slot print_timing: id  0 | task 5640 | prompt eval time =      93.47 ms /   344 tokens (    0.27 ms per token,  3680.21 tokens per second)
2.24.303.093 I slot print_timing: id  0 | task 5640 |        eval time =    6369.52 ms /  1000 tokens (    6.37 ms per token,   157.00 tokens per second)
2.24.303.094 I slot print_timing: id  0 | task 5640 |       total time =    6462.99 ms /  1344 tokens
2.24.303.094 I slot print_timing: id  0 | task 5640 |    graphs reused =       6601
2.24.303.127 I slot      release: id  0 | task 5640 | stop processing: n_tokens = 1343, truncated = 0
2.24.303.134 I srv  update_slots: all slots are idle
2.24.303.264 I srv  stream_sessi: stream_session_attach_pipe: conv_id= (empty=1)
2.24.321.493 I srv    operator(): Chat format: peg-native
2.24.321.637 I slot get_availabl: id  3 | task -1 | selected slot by LRU, t_last = 7202505090
2.24.321.640 I srv  get_availabl: updating prompt cache
2.24.321.642 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
2.24.321.645 I srv        update:  - cache state: 3 prompts, 495.341 MiB (limits: 8192.000 MiB, 16384 tokens, 102519 est)
2.24.321.646 I srv        update:    - prompt 0x6511020ca780:    3233 tokens, checkpoints:  1,   201.594 MiB
2.24.321.647 I srv        update:    - prompt 0x6511025c10b0:     471 tokens, checkpoints:  1,   115.229 MiB
2.24.321.648 I srv        update:    - prompt 0x6511020d15b0:    2495 tokens, checkpoints:  1,   178.518 MiB
2.24.321.648 I srv  get_availabl: prompt cache update took 0.01 ms
2.24.321.690 I slot launch_slot_: id  3 | task 6642 | processing task, is_child = 0
2.24.321.693 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.24.321.741 W srv   prompt_save:  - saving prompt with length 1343, total state size = 92.245 MiB (draft: 0.000 MiB)
2.24.416.205 I srv        update:  - cache state: 4 prompts, 637.837 MiB (limits: 8192.000 MiB, 16384 tokens, 96865 est)
2.24.416.209 I srv        update:    - prompt 0x6511020ca780:    3233 tokens, checkpoints:  1,   201.594 MiB
2.24.416.210 I srv        update:    - prompt 0x6511025c10b0:     471 tokens, checkpoints:  1,   115.229 MiB
2.24.416.210 I srv        update:    - prompt 0x6511020d15b0:    2495 tokens, checkpoints:  1,   178.518 MiB
2.24.416.211 I srv        update:    - prompt 0x651102608ad0:    1343 tokens, checkpoints:  1,   142.496 MiB
2.24.416.211 I slot prompt_clear: id  0 | task -1 | clearing prompt with 1343 tokens
2.24.416.325 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.24.416.327 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.24.416.335 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.24.416.335 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.24.416.387 W slot   operator(): id  3 | task 6642 | erased invalidated context checkpoint (pos_min = 21, pos_max = 21, n_tokens = 22, n_swa = 0, pos_next = 0, size = 50.251 MiB)
2.24.471.844 I slot create_check: id  3 | task 6642 | created context checkpoint 1 of 32 (pos_min = 212, pos_max = 212, n_tokens = 213, size = 50.251 MiB)

studio-orchestrator — Up 2 minutes (last 200 lines)

[orchestrator] :8190 comfy=http://localhost:8188 out=/output/video lanes=['ltx-t2v', 'ltx-i2v', 'sulphur-t2v', 'sulphur-i2v', '10eros-t2v', '10eros-i2v', 'image', 'chroma', 'hidream', 'zimage', 'krea', 'wan', 'wan-i2v', 'music', 'sfx']

studio-image-shim — Up 2 minutes (last 200 lines)

studio-tts — Up 2 minutes (last 200 lines)

studio-step-voice — Up 2 minutes (last 200 lines)

If you want to use the speaker diarization, please `pip install hdbscan`
[step-voice] lazy mode — model loads on first /clone or /edit (idle-unload 300s)

studio-gallery — Up 2 minutes (last 200 lines)

2026/06/30 03:20:14 [notice] 36#36: exiting
2026/06/30 03:20:14 [notice] 36#36: exit
2026/06/30 03:20:14 [notice] 32#32: gracefully shutting down
2026/06/30 03:20:14 [notice] 32#32: exiting
2026/06/30 03:20:14 [notice] 32#32: exit
2026/06/30 03:20:14 [notice] 30#30: gracefully shutting down
2026/06/30 03:20:14 [notice] 30#30: exiting
2026/06/30 03:20:14 [notice] 30#30: exit
2026/06/30 03:20:14 [notice] 27#27: gracefully shutting down
2026/06/30 03:20:14 [notice] 27#27: exiting
2026/06/30 03:20:14 [notice] 27#27: exit
2026/06/30 03:20:14 [notice] 29#29: gracefully shutting down
2026/06/30 03:20:14 [notice] 29#29: exiting
2026/06/30 03:20:14 [notice] 29#29: exit
2026/06/30 03:20:14 [notice] 1#1: signal 17 (SIGCHLD) received from 36
2026/06/30 03:20:14 [notice] 1#1: worker process 36 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 03:20:14 [notice] 1#1: signal 17 (SIGCHLD) received from 28
2026/06/30 03:20:14 [notice] 1#1: worker process 28 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 03:20:14 [notice] 1#1: signal 17 (SIGCHLD) received from 34
2026/06/30 03:20:14 [notice] 1#1: worker process 34 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: worker process 26 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 03:20:14 [notice] 1#1: signal 17 (SIGCHLD) received from 26
2026/06/30 03:20:14 [notice] 1#1: signal 17 (SIGCHLD) received from 35
2026/06/30 03:20:14 [notice] 1#1: worker process 35 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 03:20:14 [notice] 1#1: signal 17 (SIGCHLD) received from 23
2026/06/30 03:20:14 [notice] 1#1: worker process 23 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 03:20:14 [notice] 1#1: signal 17 (SIGCHLD) received from 25
2026/06/30 03:20:14 [notice] 1#1: worker process 22 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: worker process 24 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: worker process 25 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: worker process 29 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: worker process 32 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: worker process 33 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 03:20:14 [notice] 1#1: signal 17 (SIGCHLD) received from 31
2026/06/30 03:20:14 [notice] 1#1: worker process 31 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 03:20:14 [notice] 1#1: signal 17 (SIGCHLD) received from 21
2026/06/30 03:20:14 [notice] 1#1: worker process 21 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 03:20:14 [notice] 1#1: signal 17 (SIGCHLD) received from 30
2026/06/30 03:20:14 [notice] 1#1: worker process 27 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: worker process 30 exited with code 0
2026/06/30 03:20:14 [notice] 1#1: exit
/docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration
/docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/
/docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh
10-listen-on-ipv6-by-default.sh: info: can not modify /etc/nginx/conf.d/default.conf (read-only file system?)
/docker-entrypoint.sh: Sourcing /docker-entrypoint.d/15-local-resolvers.envsh
/docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh
/docker-entrypoint.sh: Launching /docker-entrypoint.d/30-tune-worker-processes.sh
/docker-entrypoint.sh: Configuration complete; ready for start up
2026/06/30 03:21:00 [notice] 1#1: using the "epoll" event method
2026/06/30 03:21:00 [notice] 1#1: nginx/1.31.2
2026/06/30 03:21:00 [notice] 1#1: built by gcc 15.2.0 (Alpine 15.2.0) 
2026/06/30 03:21:00 [notice] 1#1: OS: Linux 7.0.0-27-generic
2026/06/30 03:21:00 [notice] 1#1: getrlimit(RLIMIT_NOFILE): 1024:524288
2026/06/30 03:21:00 [notice] 1#1: start worker processes
2026/06/30 03:21:00 [notice] 1#1: start worker process 21
2026/06/30 03:21:00 [notice] 1#1: start worker process 22
2026/06/30 03:21:00 [notice] 1#1: start worker process 23
2026/06/30 03:21:00 [notice] 1#1: start worker process 24
2026/06/30 03:21:00 [notice] 1#1: start worker process 25
2026/06/30 03:21:00 [notice] 1#1: start worker process 26
2026/06/30 03:21:00 [notice] 1#1: start worker process 27
2026/06/30 03:21:00 [notice] 1#1: start worker process 28
2026/06/30 03:21:00 [notice] 1#1: start worker process 29
2026/06/30 03:21:00 [notice] 1#1: start worker process 30
2026/06/30 03:21:00 [notice] 1#1: start worker process 31
2026/06/30 03:21:00 [notice] 1#1: start worker process 32
2026/06/30 03:21:00 [notice] 1#1: start worker process 33
2026/06/30 03:21:00 [notice] 1#1: start worker process 34
2026/06/30 03:21:00 [notice] 1#1: start worker process 35
2026/06/30 03:21:00 [notice] 1#1: start worker process 36
2026/06/30 05:18:18 [notice] 1#1: signal 3 (SIGQUIT) received, shutting down
2026/06/30 05:18:18 [notice] 21#21: gracefully shutting down
2026/06/30 05:18:18 [notice] 22#22: gracefully shutting down
2026/06/30 05:18:18 [notice] 23#23: gracefully shutting down
2026/06/30 05:18:18 [notice] 24#24: gracefully shutting down
2026/06/30 05:18:18 [notice] 25#25: gracefully shutting down
2026/06/30 05:18:18 [notice] 26#26: gracefully shutting down
2026/06/30 05:18:18 [notice] 21#21: exiting
2026/06/30 05:18:18 [notice] 22#22: exiting
2026/06/30 05:18:18 [notice] 27#27: gracefully shutting down
2026/06/30 05:18:18 [notice] 28#28: gracefully shutting down
2026/06/30 05:18:18 [notice] 23#23: exiting
2026/06/30 05:18:18 [notice] 24#24: exiting
2026/06/30 05:18:18 [notice] 29#29: gracefully shutting down
2026/06/30 05:18:18 [notice] 25#25: exiting
2026/06/30 05:18:18 [notice] 26#26: exiting
2026/06/30 05:18:18 [notice] 30#30: gracefully shutting down
2026/06/30 05:18:18 [notice] 27#27: exiting
2026/06/30 05:18:18 [notice] 28#28: exiting
2026/06/30 05:18:18 [notice] 29#29: exiting
2026/06/30 05:18:18 [notice] 32#32: gracefully shutting down
2026/06/30 05:18:18 [notice] 31#31: gracefully shutting down
2026/06/30 05:18:18 [notice] 30#30: exiting
2026/06/30 05:18:18 [notice] 32#32: exiting
2026/06/30 05:18:18 [notice] 31#31: exiting
2026/06/30 05:18:18 [notice] 33#33: gracefully shutting down
2026/06/30 05:18:18 [notice] 36#36: gracefully shutting down
2026/06/30 05:18:18 [notice] 33#33: exiting
2026/06/30 05:18:18 [notice] 36#36: exiting
2026/06/30 05:18:18 [notice] 21#21: exit
2026/06/30 05:18:18 [notice] 23#23: exit
2026/06/30 05:18:18 [notice] 26#26: exit
2026/06/30 05:18:18 [notice] 25#25: exit
2026/06/30 05:18:18 [notice] 24#24: exit
2026/06/30 05:18:18 [notice] 22#22: exit
2026/06/30 05:18:18 [notice] 27#27: exit
2026/06/30 05:18:18 [notice] 30#30: exit
2026/06/30 05:18:18 [notice] 29#29: exit
2026/06/30 05:18:18 [notice] 36#36: exit
2026/06/30 05:18:18 [notice] 28#28: exit
2026/06/30 05:18:18 [notice] 32#32: exit
2026/06/30 05:18:18 [notice] 31#31: exit
2026/06/30 05:18:18 [notice] 33#33: exit
2026/06/30 05:18:18 [notice] 34#34: gracefully shutting down
2026/06/30 05:18:18 [notice] 34#34: exiting
2026/06/30 05:18:18 [notice] 34#34: exit
2026/06/30 05:18:18 [notice] 35#35: gracefully shutting down
2026/06/30 05:18:18 [notice] 35#35: exiting
2026/06/30 05:18:18 [notice] 35#35: exit
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 29
2026/06/30 05:18:18 [notice] 1#1: worker process 29 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 30
2026/06/30 05:18:18 [notice] 1#1: worker process 30 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 24
2026/06/30 05:18:18 [notice] 1#1: worker process 24 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 26
2026/06/30 05:18:18 [notice] 1#1: worker process 26 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 31
2026/06/30 05:18:18 [notice] 1#1: worker process 31 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: worker process 22 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: worker process 34 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 22
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 33
2026/06/30 05:18:18 [notice] 1#1: worker process 33 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 35
2026/06/30 05:18:18 [notice] 1#1: worker process 35 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: worker process 25 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: worker process 36 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 25
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 28
2026/06/30 05:18:18 [notice] 1#1: worker process 28 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 27
2026/06/30 05:18:18 [notice] 1#1: worker process 27 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: worker process 21 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: signal 29 (SIGIO) received
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 21
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 23
2026/06/30 05:18:18 [notice] 1#1: worker process 23 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: signal 17 (SIGCHLD) received from 32
2026/06/30 05:18:18 [notice] 1#1: worker process 32 exited with code 0
2026/06/30 05:18:18 [notice] 1#1: exit
/docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration
/docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/
/docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh
10-listen-on-ipv6-by-default.sh: info: can not modify /etc/nginx/conf.d/default.conf (read-only file system?)
/docker-entrypoint.sh: Sourcing /docker-entrypoint.d/15-local-resolvers.envsh
/docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh
/docker-entrypoint.sh: Launching /docker-entrypoint.d/30-tune-worker-processes.sh
/docker-entrypoint.sh: Configuration complete; ready for start up
2026/06/30 05:19:17 [notice] 1#1: using the "epoll" event method
2026/06/30 05:19:17 [notice] 1#1: nginx/1.31.2
2026/06/30 05:19:17 [notice] 1#1: built by gcc 15.2.0 (Alpine 15.2.0) 
2026/06/30 05:19:17 [notice] 1#1: OS: Linux 7.0.0-27-generic
2026/06/30 05:19:17 [notice] 1#1: getrlimit(RLIMIT_NOFILE): 1024:524288
2026/06/30 05:19:17 [notice] 1#1: start worker processes
2026/06/30 05:19:17 [notice] 1#1: start worker process 21
2026/06/30 05:19:17 [notice] 1#1: start worker process 22
2026/06/30 05:19:17 [notice] 1#1: start worker process 23
2026/06/30 05:19:17 [notice] 1#1: start worker process 24
2026/06/30 05:19:17 [notice] 1#1: start worker process 25
2026/06/30 05:19:17 [notice] 1#1: start worker process 26
2026/06/30 05:19:17 [notice] 1#1: start worker process 27
2026/06/30 05:19:17 [notice] 1#1: start worker process 28
2026/06/30 05:19:17 [notice] 1#1: start worker process 29
2026/06/30 05:19:17 [notice] 1#1: start worker process 30
2026/06/30 05:19:17 [notice] 1#1: start worker process 31
2026/06/30 05:19:17 [notice] 1#1: start worker process 32
2026/06/30 05:19:17 [notice] 1#1: start worker process 33
2026/06/30 05:19:17 [notice] 1#1: start worker process 34
2026/06/30 05:19:17 [notice] 1#1: start worker process 35
2026/06/30 05:19:17 [notice] 1#1: start worker process 36
2026/06/30 05:19:39 [error] 23#23: *3 open() "/srv/media/favicon.ico" failed (2: No such file or directory), client: 192.168.5.10, server: _, request: "GET /favicon.ico HTTP/1.1", host: "192.168.5.10:8189", referrer: "http://192.168.5.10:8189/"
192.168.5.10 - - [30/Jun/2026:05:19:39 +0000] "GET /favicon.ico HTTP/1.1" 404 555 "http://192.168.5.10:8189/" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/149.0.0.0 Safari/537.36" "-"

---

Generated by bash scripts/report.sh. Flags: --verify (verify-full), --stress (verify-stress 7/7 incl. Cliff 2 needles), --soak (SOAK_MODE=continuous, catches Cliff 2b), --bench (canonical TPS), --agentic (multi-turn TTFT/decode curve-shape, ~8 min estimate), --studio (AI Studio / ComfyUI container log tails — for generation bugs), --full (all five, ~43 min estimate). Use --no-redact to disable redaction (internal sharing only).

[noonghunna]

Update — root cause found, and it's the same bug behind #530. Good news: your models downloaded fine — they just weren't being mounted.

Your --studio log showed ComfyUI's model list empty for every lane, not only HiDream:

Value not in list: unet_name: 'ideogram4_fp8_scaled.safetensors' not in []   ← the models dir is empty
                   'z-image-turbo-fp8-e4m3fn.safetensors' not in []
                   'krea2_turbo_fp8_scaled.safetensors' not in []

(HiDream's custom node phrases the empty tree as "not installed"; the standard loaders reject at submit → the HTTP 400 you saw on Ideogram/Krea/Ace → #530.)

Why: the studio derives every path from one knob, MODEL_DIR. The downloads landed under <dirname MODEL_DIR>/comfyui/models (correct), but the ComfyUI container mounts ${COMFYUI_ROOT}/models — and COMFYUI_ROOT wasn't reaching the sudo docker compose (sudo strips it, and only MODEL_DIR was in .env), so it fell back to the /mnt default and mounted an empty tree. When your MODEL_DIR isn't the rig's /mnt path (fresh installs default it to $HOME/models), the two diverge. Our bug — sorry for the runaround; the roster fix earlier was real but orthogonal to this.

Fixed in #531, now on master — it pins COMFYUI_ROOT into .env so the container always mounts the same tree the downloads went into. No re-download needed (your weights are already on disk); just pick up the fix and relaunch:

git pull
gpu-mode ai-studio        # start_comfyui now pins COMFYUI_ROOT automatically

Then every lane (Ideogram / Krea / Z-Image + HiDream) should find its models. If it somehow doesn't auto-resolve (e.g. a stale value already in .env), the manual fallback:

echo "COMFYUI_ROOT=\"$(dirname "$(grep -E '^MODEL_DIR=' .env | cut -d= -f2- | tr -d '\"')")/comfyui\"" >> .env
gpu-mode ai-studio

Could you git pull + relaunch and confirm? Once images are generating I'll close this and #530. Thanks for the thorough reports — the not in [] line was the key that cracked it. 🙏