Skip to content

Commit

Permalink
Fix microservice level benchmark issue (#86)
Browse files Browse the repository at this point in the history
* Fix microservice level benchmark issue

Signed-off-by: lvliang-intel <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
  • Loading branch information
lvliang-intel and pre-commit-ci[bot] authored Aug 28, 2024
1 parent 9ccb179 commit 211b560
Showing 1 changed file with 4 additions and 3 deletions.
7 changes: 4 additions & 3 deletions evals/benchmark/benchmark.py
Original file line number Diff line number Diff line change
Expand Up @@ -87,9 +87,10 @@ def create_and_save_run_yaml(example, deployment_type, service_type, service_nam
for user_queries in test_suite_config["user_queries"]:
concurrency = max(1, user_queries // test_suite_config["concurrent_level"])

bench_target = (
f"{example}{'bench' if service_type == 'e2e' and test_suite_config['random_prompt'] else 'fixed'}"
)
if service_type == "e2e":
bench_target = f"{example}{'bench' if test_suite_config['random_prompt'] else 'fixed'}"
else:
bench_target = f"{service_type}{'bench' if test_suite_config['random_prompt'] else 'fixed'}"
run_yaml_content = create_run_yaml_content(
service_name, base_url, bench_target, concurrency, user_queries, test_suite_config
)
Expand Down

0 comments on commit 211b560

Please sign in to comment.