Skip to content

Commit 476a327

Browse files
Align llm microservice parameters with end to end test (#89)
* Align llm microservice parameters with end to end test Signed-off-by: lvliang-intel <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: lvliang-intel <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
1 parent 907dc19 commit 476a327

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

evals/benchmark/stresscli/locust/llmfixed.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,12 @@ def getReqData():
1212
return {
1313
"query": "What is the revenue of Nike in last 10 years before 2023? Give me detail",
1414
"max_new_tokens": 128,
15+
"top_k": 10,
16+
"top_p": 0.95,
17+
"typical_p": 0.95,
18+
"temperature": 0.01,
19+
"repetition_penalty": 1.03,
20+
"streaming": True,
1521
}
1622

1723

0 commit comments

Comments
 (0)