[Quantization] Add quantization support for bitsandbytes
#24401
Job | Run time |
---|---|
25s | |
21s | |
2m 28s | |
8m 38s | |
3m 3s | |
2m 25s | |
6m 32s | |
23m 52s |
bitsandbytes
#24401
Job | Run time |
---|---|
25s | |
21s | |
2m 28s | |
8m 38s | |
3m 3s | |
2m 25s | |
6m 32s | |
23m 52s |