Skip to content

Commit 02e887b

Browse files
committed
fix
1 parent d7f9a40 commit 02e887b

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

onnxruntime/python/tools/transformers/large_model_exporter.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -213,6 +213,7 @@ def fetch_onnx_inputs_outputs_name(
213213
):
214214
"""fetch onnx inputs and outputs name"""
215215
num_of_past_key = 0
216+
kv_cache_axis = {0: "batch_size"}
216217
# try get num_of_past_key and shape of past_key_value
217218
if past_key_values is not None:
218219
num_of_past_key = len(past_key_values)

0 commit comments

Comments
 (0)