Added Top_p https://github.com/uripeled2/llm-client-sdk/issues/28 #85
Job | Run time |
---|---|
30s | |
31s | |
10s | |
14s | |
28s | |
15s | |
26s | |
38s | |
31s | |
14s | |
14s | |
30s | |
16s | |
29s | |
38s | |
32s | |
15s | |
17s | |
30s | |
13s | |
21s | |
8m 12s |
Job | Run time |
---|---|
30s | |
31s | |
10s | |
14s | |
28s | |
15s | |
26s | |
38s | |
31s | |
14s | |
14s | |
30s | |
16s | |
29s | |
38s | |
32s | |
15s | |
17s | |
30s | |
13s | |
21s | |
8m 12s |