This repository has been archived by the owner on Aug 30, 2024. It is now read-only.
[Neural Speed] Greedy_search & Top_p_top_k sampling & Eval in cont-batching #660
Job | Run time |
---|---|
2m 21s | |
1m 59s | |
2m 2s | |
1m 58s | |
3s | |
3m 5s | |
3m 5s | |
3m 5s | |
0s | |
0s | |
0s | |
0s | |
17m 38s |