Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bugfix] FIx benchmark args for randomly sampled dataset #5947

Merged
merged 29 commits into from
Jul 8, 2024
Merged
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
afa0e91
add benchmark for fix length input and output
haichuan1221 Jun 26, 2024
ffcc34c
fix format issue
haichuan1221 Jun 26, 2024
4f4962e
fix format issue
haichuan1221 Jun 26, 2024
3c405e0
fix format issue
haichuan1221 Jun 26, 2024
6b7415c
fix format issue
haichuan1221 Jun 26, 2024
7c5f1d9
fix format issue
haichuan1221 Jun 26, 2024
0f8fbf4
fix format issue
haichuan1221 Jun 26, 2024
cab9aa4
fix format issue
haichuan1221 Jun 26, 2024
66710c6
fix format issue
haichuan1221 Jun 26, 2024
ab11c8a
Merge branch 'vllm-project:main' into main
haichuan1221 Jun 26, 2024
0af62a8
Merge branch 'vllm-project:main' into main
haichuan1221 Jun 26, 2024
68e25fb
Merge branch 'vllm-project:main' into main
haichuan1221 Jun 27, 2024
b798b8e
Merge branch 'vllm-project:main' into main
haichuan1221 Jun 28, 2024
bac04ae
Merge branch 'vllm-project:main' into main
haichuan1221 Jun 30, 2024
e8fd224
Merge branch 'vllm-project:main' into main
haichuan1221 Jul 1, 2024
ff9a0b7
Merge branch 'vllm-project:main' into main
haichuan1221 Jul 2, 2024
13fbce4
Merge branch 'vllm-project:main' into main
haichuan1221 Jul 3, 2024
e2d4290
Merge branch 'vllm-project:main' into main
haichuan1221 Jul 4, 2024
80eb2ed
Merge branch 'vllm-project:main' into main
haichuan1221 Jul 7, 2024
bea16c3
add typing name and help message
haichuan1221 Jul 7, 2024
1608c7a
Merge branch 'main' of github.com:haichuan1221/vllm into main
haichuan1221 Jul 7, 2024
32add2a
fix comma issue
haichuan1221 Jul 7, 2024
e306c5b
fix comma issue
haichuan1221 Jul 7, 2024
fee6383
update format
ywang96 Jul 7, 2024
26a67cd
remove unneeded noqa
ywang96 Jul 7, 2024
5b4897f
move up args
ywang96 Jul 7, 2024
c099ef8
Merge branch 'vllm-project:main' into main
haichuan1221 Jul 7, 2024
e7dc45a
Merge branch 'vllm-project:main' into main
haichuan1221 Jul 8, 2024
a5152f2
fix issue
haichuan1221 Jul 8, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions benchmarks/benchmark_serving.py
Original file line number Diff line number Diff line change
Expand Up @@ -483,10 +483,10 @@ def main(args: argparse.Namespace):

elif args.dataset_name == "random":
input_requests = sample_random_requests(
input_len=args.input_len,
output_len=args.output_len,
input_len=args.random_input_len,
output_len=args.random_output_len,
num_prompts=args.num_prompts,
range_ratio=args.range_ratio,
range_ratio=args.random_range_ratio,
tokenizer=tokenizer,
)

Expand Down
Loading