Skip to content
Back to pull request #4996

Use Q4_K for attn_v for Q2_K_S when n_gqa >= 4 #7672

Sign in to view logs

Use Q4_K for attn_v for Q2_K_S when n_gqa >= 4

Use Q4_K for attn_v for Q2_K_S when n_gqa >= 4 #7672

Triggered via pull request January 17, 2024 10:22
@ikawrakowikawrakow
opened #4996
ik/better_q2_k_s
Status Failure
Total duration 17m 51s
Artifacts –

build.yml

on: pull_request
Matrix: windows-latest-cmake-cublas
Matrix: windows-latest-cmake
ubuntu-focal-make
1m 36s
ubuntu-focal-make
ubuntu-latest-cmake
1m 41s
ubuntu-latest-cmake
macOS-latest-make
2m 27s
macOS-latest-make
macOS-latest-cmake
5m 8s
macOS-latest-cmake
macOS-latest-cmake-ios
6m 35s
macOS-latest-cmake-ios
macOS-latest-cmake-tvos
1m 24s
macOS-latest-cmake-tvos
ios-xcode-build
1m 51s
ios-xcode-build
android-build
5m 23s
android-build
Matrix: macOS-latest-swift
Matrix: ubuntu-latest-cmake-mpi
Matrix: ubuntu-latest-cmake-sanitizer
release
0s
release
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 4 warnings
windows-latest-cmake (avx512, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX512=ON -DBUIL...
Process completed with exit code 1.
windows-latest-cmake (avx512, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX512=ON -DBUIL...
Process completed with exit code 1.
windows-latest-cmake (clblast, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_CLBLAST=ON -DBU...
The job was canceled because "avx512_-DLLAMA_NATIVE_OFF" failed.
windows-latest-cmake (openblas, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_BLAS=ON -DBUIL...
The job was canceled because "avx512_-DLLAMA_NATIVE_OFF" failed.
windows-latest-cmake (openblas, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_BLAS=ON -DBUIL...
The operation was canceled.
windows-latest-cmake (avx, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX2=OFF -DBUILD_SH...
The job was canceled because "avx512_-DLLAMA_NATIVE_OFF" failed.
windows-latest-cmake (avx, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX2=OFF -DBUILD_SH...
The operation was canceled.
windows-latest-cmake (noavx, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX=OFF -DLLAMA_A...
The job was canceled because "avx512_-DLLAMA_NATIVE_OFF" failed.
windows-latest-cmake (noavx, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX=OFF -DLLAMA_A...
The operation was canceled.
macOS-latest-cmake-ios
Operation timed out (api.github.com:443)
macOS-latest-cmake-ios
Failed to download action 'https://api.github.com/repos/actions/checkout/tarball/50fbc622fc4ef5163becd7fab6573eac35f8462e'. Error: nodename nor servname provided, or not known (api.github.com:443)
macOS-latest-cmake-ios
Back off 28.604 seconds before retry.
macOS-latest-cmake-ios
Failed to download action 'https://api.github.com/repos/actions/checkout/tarball/50fbc622fc4ef5163becd7fab6573eac35f8462e'. Error: Operation timed out (api.github.com:443)
macOS-latest-cmake-ios
Back off 14.121 seconds before retry.