Align llm microservice parameters with end to end test (#89)

* Align llm microservice parameters with end to end test Signed-off-by: lvliang-intel <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: lvliang-intel <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
opea-project · Aug 29, 2024 · 476a327 · 476a327
1 parent 907dc19
commit 476a327
Showing 1 changed file with 6 additions and 0 deletions.
diff --git a/evals/benchmark/stresscli/locust/llmfixed.py b/evals/benchmark/stresscli/locust/llmfixed.py
@@ -12,6 +12,12 @@ def getReqData():
     return {
         "query": "What is the revenue of Nike in last 10 years before 2023? Give me detail",
         "max_new_tokens": 128,
+        "top_k": 10,
+        "top_p": 0.95,
+        "typical_p": 0.95,
+        "temperature": 0.01,
+        "repetition_penalty": 1.03,
+        "streaming": True,
     }