ggml : AVX512 gemm for Q4_0_8_8 (#9532) · ngxson/llama.cpp@1e7b929 · GitHub

Commit

ggml : AVX512 gemm for Q4_0_8_8 (ggerganov#9532)

Browse files

* AVX512 version of ggml_gemm_q4_0_8x8_q8_0

* Remove zero vector parameter passing

* Rename functions and rearrange order of macros

* Edit commments

* style : minor adjustments

* Update x to start from 0

---------

Co-authored-by: Georgi Gerganov <[email protected]>

Loading branch information

Srihari-mcw and ggerganov authored Sep 23, 2024

1 parent 37f8c7b commit 1e7b929