OpenVINO backend: GPU compile-time memory optimizations#236

Draft

cavusmustafa wants to merge 16 commits into

ravi9:dev_backend_openvinofrom

cavusmustafa:ov-mem-optimizations

Commits on Jul 1, 2026

OpenVINO backend: 1) enable gpt-oss moe on OV bk; 2) enable mxfp4 support

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: disable TOPK_MOE op test

zhaixuejun1993
authored and
wine99
committed
OpenVINO Backend: Add op FILL support

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable set rows with multi dims

zhaixuejun1993
authored and
wine99
committed
fix the name missmatch in setrow + view

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable op GGML_UNARY_OP_SIGMOID

zhaixuejun1993
authored and
wine99
committed
OpenVINO Backend: enable SQR & SQRT

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: 1) ensure unique node names for OpenVINO; 2) add org_src to recorde the src ggml tensor for OpenVINO dynamic shape infer

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable fallback for openVINO to CPU backend

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: fix accurace issue in gemma3n arch test

zhaixuejun1993
authored and
wine99
committed
fix mpt failed case

zhaixuejun1993
authored and
wine99
committed
ggml-openvino: add GGML_OPENVINO_RELEASE_WEIGHTS to reclaim host weight RSS on GPU

Mustafa Cavus
and
claude
committed
ggml-openvino: stream weight requantization to cut the compile-time RSS peak

Mustafa Cavus
and
claude
committed
ggml-openvino: avoid redundant token_embd requantization at compile

Mustafa Cavus
and
claude
committed
ggml-openvino: gate compile-memory optimizations behind GGML_OPENVINO_REDUCE_COMPILE_MEM

Mustafa Cavus
and
claude
committed
ggml-openvino: add frontend model cache (GGML_OPENVINO_MODEL_CACHE_DIR)

Mustafa Cavus
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

OpenVINO backend: GPU compile-time memory optimizations#236

OpenVINO backend: GPU compile-time memory optimizations#236
cavusmustafa wants to merge 16 commits into
ravi9:dev_backend_openvinofrom
cavusmustafa:ov-mem-optimizations

Commits on Jul 1, 2026

OpenVINO backend: 1) enable gpt-oss moe on OV bk; 2) enable mxfp4 support

OpenVINO backend: disable TOPK_MOE op test

OpenVINO Backend: Add op FILL support

OpenVINO backend: enable set rows with multi dims

fix the name missmatch in setrow + view

OpenVINO backend: enable op GGML_UNARY_OP_SIGMOID

OpenVINO Backend: enable SQR & SQRT

OpenVINO backend: 1) ensure unique node names for OpenVINO; 2) add org_src to recorde the src ggml tensor for OpenVINO dynamic shape infer

OpenVINO backend: enable fallback for openVINO to CPU backend

OpenVINO backend: fix accurace issue in gemma3n arch test

fix mpt failed case

ggml-openvino: add GGML_OPENVINO_RELEASE_WEIGHTS to reclaim host weight RSS on GPU

ggml-openvino: stream weight requantization to cut the compile-time RSS peak

ggml-openvino: avoid redundant token_embd requantization at compile

ggml-openvino: gate compile-memory optimizations behind GGML_OPENVINO_REDUCE_COMPILE_MEM

ggml-openvino: add frontend model cache (GGML_OPENVINO_MODEL_CACHE_DIR)