Skip to content

Commit 476593b

Browse files
authored
Update benchmark command in README.md (#141)
1 parent ec4b158 commit 476593b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -194,7 +194,7 @@ Start the server and then go to the deps/JetStream folder (downloaded during `in
194194
cd deps/JetStream
195195
wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json
196196
export dataset_path=ShareGPT_V3_unfiltered_cleaned_split.json
197-
python benchmarks/benchmark_serving.py --tokenizer $tokenizer_path --num-prompts 2000 --dataset-path $dataset_path --dataset sharegpt --save-request-outputs --warmup-first=True
197+
python benchmarks/benchmark_serving.py --tokenizer $tokenizer_path --num-prompts 2000 --dataset-path $dataset_path --dataset sharegpt --save-request-outputs --warmup-mode=sampled --model=$model_name
198198
```
199199
Please look at `deps/JetStream/benchmarks/README.md` for more information.
200200

0 commit comments

Comments
 (0)