Skip to content

Commit 0fa8884

Browse files
[XPU] fix weight scale shape (#42725)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com> Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
1 parent ff712f6 commit 0fa8884

1 file changed

Lines changed: 3 additions & 0 deletions

File tree

  • vllm/model_executor/kernels/linear/scaled_mm

vllm/model_executor/kernels/linear/scaled_mm/xpu.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -59,6 +59,9 @@ def process_weights_after_loading(self, layer: torch.nn.Module) -> None:
5959
replace_parameter(layer, "weight", weight.data.t())
6060
# else: already in [in, out] layout — no-op
6161

62+
weight_scale = layer.weight_scale.t().contiguous()
63+
replace_parameter(layer, "weight_scale", weight_scale.data)
64+
6265
def apply_weights(
6366
self,
6467
layer: torch.nn.Module,

0 commit comments

Comments
 (0)