File tree 1 file changed +1
-1
lines changed 1 file changed +1
-1
lines changed Original file line number Diff line number Diff line change @@ -194,7 +194,7 @@ Start the server and then go to the deps/JetStream folder (downloaded during `in
194
194
cd deps/JetStream
195
195
wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json
196
196
export dataset_path=ShareGPT_V3_unfiltered_cleaned_split.json
197
- python benchmarks/benchmark_serving.py --tokenizer $tokenizer_path --num-prompts 2000 --dataset-path $dataset_path --dataset sharegpt --save-request-outputs --warmup-first=True
197
+ python benchmarks/benchmark_serving.py --tokenizer $tokenizer_path --num-prompts 2000 --dataset-path $dataset_path --dataset sharegpt --save-request-outputs --warmup-mode=sampled --model= $model_name
198
198
```
199
199
Please look at ` deps/JetStream/benchmarks/README.md ` for more information.
200
200
You can’t perform that action at this time.
0 commit comments