Skip to content

Commit 8f40dfa

Browse files
authored
[XPU] fix pos_emb_type bug (#4638)
1 parent d68345c commit 8f40dfa

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

fastdeploy/worker/xpu_model_runner.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -850,7 +850,7 @@ def _init_share_inputs(self, max_num_seqs: int):
850850
else: # neox style = False
851851
rope_head_dim = head_dim // 2
852852

853-
if head_dim == self.model_config.head_dim:
853+
if rope_head_dim == self.model_config.head_dim:
854854
self.share_inputs["pos_emb_type"] = "NORMAL"
855855
else:
856856
self.share_inputs["pos_emb_type"] = "HALF_HEAD_DIM"

0 commit comments

Comments
 (0)