Skip to content

Commit 9e7db0d

Browse files
committed
init params
1 parent fb9e154 commit 9e7db0d

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

mlperf/mixtral_run.sh

100644100755
File mode changed.

mlperf/offline_mode.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -354,11 +354,11 @@ def main(argv):
354354
(3072, 256),
355355
)
356356
engines = []
357-
params = 1
357+
params = None
358358
for i, (length, max_batch) in enumerate(length_and_batch):
359359
batch = min(counts_by_bucket[i], max_batch)
360360
log.info(f"Using batch size of {batch} for {length}")
361-
engine = create_engine_from_config_flags(batch=batch, cache_size=length)
361+
engine = create_engine_from_config_flags(batch=batch, cache_len=length)
362362
offline_inf = offline_inference.OfflineInference(engine, params)
363363
offline_inf.dummy = FLAGS.internal_dummy_model
364364
params = offline_inf.params

0 commit comments

Comments
 (0)