Use Q4_K for attn_v for Q2_K_S when n_gqa >= 4 #2564

Sign in to view logs

Triggered via pull request January 17, 2024 10:22

ikawrakow

opened #4996

ik/better_q2_k_s

Status Success

Total duration 8m 15s

Artifacts –

zig-build.yml

on: pull_request

Matrix: build