Skip to content
Publish Docker image

Use Q4_K for attn_v for Q2_K_S when n_gqa >= 4 #7043

Sign in to view logs

Use Q4_K for attn_v for Q2_K_S when n_gqa >= 4

Use Q4_K for attn_v for Q2_K_S when n_gqa >= 4 #7043

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Push Docker image to Docker Hub (light, .devops/main.Dockerfile, linux/amd64,linux/arm64)
27m 52s
Push Docker image to Docker Hub (full, .devops/full.Dockerfile, linux/amd64,linux/arm64)
22m 33s
Push Docker image to Docker Hub (light-cuda, .devops/main-cuda.Dockerfile, linux/amd64)
5m 49s
Push Docker image to Docker Hub (full-cuda, .devops/full-cuda.Dockerfile, linux/amd64)
9m 8s
Push Docker image to Docker Hub (light-rocm, .devops/main-rocm.Dockerfile, linux/amd64,linux/arm64)
8m 26s
Push Docker image to Docker Hub (full-rocm, .devops/full-rocm.Dockerfile, linux/amd64,linux/arm64)
8m 36s
1h 22m 24s