Skip to content

Commit 514a6d6

Browse files
authored
update config in benchmark readme (#103)
Signed-off-by: Yingchun Guo <[email protected]>
1 parent 17d35e3 commit 514a6d6

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

evals/benchmark/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -60,6 +60,9 @@ The benchmark.yaml file defines the test suite and individual test cases. Below
6060
```yaml
6161
test_suite_config:
6262
examples: ["chatqna"] # Test cases to be run (e.g., chatqna, codegen)
63+
deployment_type: "k8s" # Default is "k8s", can also be "docker"
64+
service_ip: None # Leave as None for k8s, specify for Docker
65+
service_port: None # Leave as None for k8s, specify for Docker
6366
concurrent_level: 4 # The concurrency level
6467
user_queries: [1, 2, 4, 8, 16, 32, 64, 128, 256, 512, 1024, 2048] # Number of test requests
6568
random_prompt: false # Use random prompts if true, fixed prompts if false

0 commit comments

Comments
 (0)