Runtime Error when exporting ByteDance-Seed/Seed-X-7B

[Fhrozen]

System Info

platform=ubuntu-24 (docker)
python=3.12
optimum=1.26.1
packages=

accelerate==1.9.0
addict==2.4.0
altair==5.5.0
annotated-types==0.7.0
antlr4-python3-runtime==4.9.3
anyascii==0.3.3
attrs==25.3.0
audioread==3.0.1
babel==2.17.0
bitsandbytes==0.46.1
blinker==1.9.0
blis==1.3.0
cachetools==6.1.0
catalogue==2.0.10
certifi==2025.7.14
cffi==1.17.1
charset-normalizer==3.4.2
click==8.2.1
cloudpathlib==0.21.1
cn2an==0.5.23
colorama==0.4.6
coloredlogs==15.0.1
confection==0.1.5
contourpy==1.3.2
coqpit-config==0.2.1
-e git+https://github.com/idiap/coqui-ai-TTS@c057d44c682ac1b43828611bac0277fbef03a0aa#egg=coqui_tts
csvw==3.5.1
curated-tokenizers==0.0.9
curated-transformers==0.1.1
cycler==0.12.1
cymem==2.0.11
dateparser==1.1.8
decorator==5.2.1
dlinfo==2.0.0
docopt==0.6.2
einops==0.8.1
espeakng-loader==0.2.4
filelock==3.18.0
Flask==3.1.1
flatbuffers==25.2.10
fonttools==4.57.0
fsspec==2025.3.2
fugashi==1.5.1
gitdb==4.0.12
GitPython==3.1.44
gruut==2.4.0
gruut-ipa==0.13.0
gruut_lang_de==2.0.1
gruut_lang_en==2.0.1
gruut_lang_es==2.0.1
gruut_lang_fr==2.0.2
hf-xet==1.1.5
huggingface-hub==0.33.4
humanfriendly==10.0
idna==3.10
inflect==7.5.0
isodate==0.7.2
itsdangerous==2.2.0
jaconv==0.4.0
jieba==0.42.1
Jinja2==3.1.6
joblib==1.5.1
jsonlines==1.2.0
jsonschema==4.25.0
jsonschema-specifications==2025.4.1
kiwisolver==1.4.8
langcodes==3.5.0
language-tags==1.2.0
language_data==1.3.0
lazy_loader==0.4
librosa==0.11.0
llvmlite==0.44.0
marisa-trie==1.2.1
markdown-it-py==3.0.0
MarkupSafe==3.0.2
matplotlib==3.10.1
mdurl==0.1.2
misaki==0.9.4
ml_dtypes==0.5.1
mojimoji==0.0.13
monotonic-alignment-search==0.2.0
more-itertools==10.7.0
mpmath==1.3.0
msgpack==1.1.1
munch==4.0.0
murmurhash==1.0.13
narwhals==1.47.1
networkx==3.4.2
num2words==0.5.14
numba==0.61.2
numpy==2.2.5
nvidia-cublas-cu12==12.6.4.1
nvidia-cuda-cupti-cu12==12.6.80
nvidia-cuda-nvrtc-cu12==12.6.77
nvidia-cuda-runtime-cu12==12.6.77
nvidia-cudnn-cu12==9.5.1.17
nvidia-cufft-cu12==11.3.0.4
nvidia-cufile-cu12==1.11.1.6
nvidia-curand-cu12==10.3.7.77
nvidia-cusolver-cu12==11.7.1.2
nvidia-cusparse-cu12==12.5.4.2
nvidia-cusparselt-cu12==0.6.3
nvidia-nccl-cu12==2.26.2
nvidia-nvjitlink-cu12==12.6.85
nvidia-nvtx-cu12==12.6.77
omegaconf==2.3.0
onnx==1.18.0
onnx-ir==0.1.4
onnxruntime-gpu==1.22.0
onnxscript==0.3.2
onnxslim==0.1.59
optimum==1.26.1
ordered-set==4.1.0
packaging==25.0
pandas==2.3.1
phonemizer-fork==3.3.2
pillow==11.2.1
plac==1.4.5
platformdirs==4.3.8
pooch==1.8.2
preshed==3.0.10
proces==0.1.7
protobuf==6.31.1
psutil==7.0.0
pyarrow==21.0.0
pycparser==2.22
pydantic==2.11.7
pydantic_core==2.33.2
pydeck==0.9.1
Pygments==2.19.2
pyopenjtalk==0.4.1
pyparsing==3.2.3
pypinyin==0.54.0
pypinyin-dict==0.9.0
pysbd==0.3.4
python-crfsuite==0.9.11
python-dateutil==2.9.0.post0
pytz==2025.2
PyYAML==6.0.2
rdflib==7.1.4
referencing==0.36.2
regex==2024.11.6
requests==2.32.4
rfc3986==1.5.0
rich==14.0.0
rpds-py==0.26.0
safetensors==0.5.3
scikit-learn==1.7.1
scipy==1.16.0
segments==2.3.0
sentencepiece==0.2.0
setuptools==80.1.0
shellingham==1.5.4
six==1.17.0
smart_open==7.3.0.post1
smmap==5.0.2
soundfile==0.13.1
soxr==0.5.0.post1
spacy==3.8.7
spacy-curated-transformers==0.3.1
spacy-legacy==3.0.12
spacy-loggers==1.0.5
srsly==2.5.1
streamlit==1.47.0
streamlit-advanced-audio==0.1.2
sympy==1.14.0
tenacity==9.1.2
thinc==8.3.6
threadpoolctl==3.6.0
tiktoken==0.9.0
tokenizers==0.21.2
toml==0.10.2
torch==2.7.0
torchaudio==2.7.0
torchvision==0.22.0
tornado==6.5.1
tqdm==4.67.1
transformers==4.53.2
triton==3.3.0
typeguard==4.4.4
typer==0.16.0
typing-inspection==0.4.1
typing_extensions==4.14.1
tzdata==2025.2
tzlocal==5.3.1
unidic==1.1.0
uritemplate==4.2.0
urllib3==2.5.0
wasabi==0.10.1
watchdog==6.0.0
weasel==0.4.1
Werkzeug==3.1.3
wrapt==1.17.2

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction (minimal, reproducible, runnable)

 python convert.py --model-id ByteDance-Seed/Seed-X-PPO-7B --quantize True --output_parent_dir ../models_converted/Seed  --task text-generation --opset 19

Expected behavior

Trying to convert ByteDance-Seed/Seed-X-7B, I had a runtime error using the conversion program shared at:
https://github.com/huggingface/transformers.js/tree/main/scripts and got the runtime error:

conversion1.log

Then, I tried to disable the autograd for exporting as detailed at https://github.com/pytorch/pytorch/issues/106972#issuecomment-2333814353

But, I got the current output:

conversion.log

I am wondering, if this error is related to optimum exporting, or transformers.
Was any issue exporting mistral models previous? I did not find any issue posted previously about the current error. Any guide is welcome.

[DWarez]

Hi @Fhrozen, the issue regarding the consversion1.log file is that the functions used to compute the mask during attention are using vmap (in particular causal_mask = _vmap_for_bhqkv.

This can be solved by patching the function with an implementation that doesn't use vmap. You can check out here

optimum/optimum/exporters/onnx/model_patcher.py

Line 223 in 6b33750

def sdpa_mask_without_vmap(

for an implementation that I found in PR #2319.

I replicated some code and adapted it to make it possible to export gemma3-text, you can check it here DWarez@ed5abe1

I hope this helps.

[Fhrozen]

@DWarez Thank you for the details. I will check and confirm the proper execution of the model.