Benchmark Nightly #190
zachgkbenchmark-nightly.yml
on: schedule
g5-12xl
/
create-runners
45s
g5-2xl
/
create-runners
35s
g5-48xl
/
create-runners
1m 7s
create-runners
49s
Matrix: handler-performance-test
Matrix: g5-12xl / benchmark_run
Matrix: g5-2xl / benchmark_run
Matrix: g5-48xl / benchmark_run
stop-g6-runners
5s
g5-12xl
/
stop-runners
6s
g5-2xl
/
stop-runners
5s
g5-48xl
/
stop-runners
6s
Annotations
2 errors
|
handler-performance-test (TestGPUHandlerPerformance, g6)
The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.
|
|
handler-performance-test (TestGPUHandlerPerformance, g6)
The operation was canceled.
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
llama2[ENGINE=lmi-dist]
|
7.39 MB |
|
|
llama2[ENGINE=vllm]
|
3.69 MB |
|
|
llama3[ENGINE=lmi-dist]
|
22.2 MB |
|
|
llama3[ENGINE=vllm]
|
44.4 MB |
|
|
mistral[ENGINE=lmi-dist]
|
3.69 MB |
|
|
mistral[ENGINE=vllm]
|
22.2 MB |
|
|
mixtral-8x7b[ENGINE=lmi-dist]
|
11.1 MB |
|
|
mixtral-8x7b[ENGINE=vllm]
|
3.7 MB |
|
|
template-g5.12xlarge
|
772 Bytes |
|
|
template-g5.2xlarge
|
830 Bytes |
|
|
template-g5.48xlarge
|
724 Bytes |
|