Skip to content

Commit 52d7a11

Browse files
committed
Parametrize use hf rope
1 parent 8b0b9f9 commit 52d7a11

File tree

2 files changed

+1
-1
lines changed

2 files changed

+1
-1
lines changed

examples/models/llama/model.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -150,7 +150,6 @@ def __init__(self, **kwargs):
150150
input_prune_map=input_prune_map,
151151
output_prune_map=output_prune_map,
152152
enable_dynamic_shape=self.enable_dynamic_shape,
153-
use_hf_rope=True,
154153
**params,
155154
)
156155

examples/models/qwen2_5/1_5b_config.json

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,5 +9,6 @@
99
"rope_theta": 1000000.0,
1010
"use_scaled_rope": false,
1111
"vocab_size": 151936,
12+
"use_hf_rope": true,
1213
"attention_qkv_bias": true
1314
}

0 commit comments

Comments
 (0)