b12555
1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl
Chi tiết nguồn
<details open=""> <p>opencl: support dp4a for KQ mm in decomposed FA (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="6479808504" data-permission-text="Title is private" data-url="https://github.com/ggml-org/llama.cpp/issues/32577" data-hovercard-type="pull_request" data-hovercard-url="/ggml-org/llama.cpp/pull/32577/hovercard" href="https://github.com/ggml-org/llama.cpp/pull/32577">#32577</a>)</p> <ul> <li>opencl: support int8 KQ for DK = 512</li> </ul> <p>Co-authored-by: Shaofei Qi <a href="mailto:shaoqi@qti.qualcomm.com">shaoqi@qti.qualcomm.com</a><br> Co-authored-by: Hongqiang Wang <a href="mailto:wangh@qti.qualcomm.com">wangh@qti.qualcomm.com</a><br> Assisted-by: Codex</p> <ul> <li>opencl: allow query chunk up to 96 for int8 KQ</li> </ul> <p>Co-authored-by: Shaofei Qi <a href="mailto:shaoqi@qti.qualcomm.com">shaoqi@qti.qualcomm.com</a><br> Co-authored-by: Hongqiang Wang <a href="mailto:wangh@qti.qualcomm.com">wangh@qti.qualcomm.com</a><br> Assisted-by: Codex</p> <ul> <li>opencl: extend <code>build_program_from_source</code> to allow non-fatal failure</li> </ul> <p>Assisted-by: Codex</p> <ul> <li>opencl: add int8 KQ for decomposed FA with DK <= 256</li> </ul> <p>Co-authored-by: Shaofei Qi <a href="mailto:shaoqi@qti.qualcomm.com">shaoqi@qti.qualcomm.com</a><br> Co-authored-by: Hongqiang Wang <a href="mailto:wangh@qti.qualcomm.com">wangh@qti.qualcomm.com</a><br> Assisted-by: Codex</p> <hr> <p>Co-authored-by: Li He <a href="mailto:lih@qti.qualcomm.com">lih@qti.qualcomm.com</a><br> Co-authored-by: Hongqiang Wang <a href="mailto:wangh@qti.qualcomm.com">wangh@qti.qualcomm.com</a></p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </ul> <p><strong>Attestations:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/attestations/69894362">https://github.com/ggml-org/llama.cpp/attestations/69894362</a></li> </ul> <p><strong>macOS/iOS:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-macos-arm64.tar.gz">macOS Apple Silicon (arm64)</a></li> <li>macOS Apple Silicon (arm64, KleidiAI enabled) <a href="https://github.com/ggml-org/llama.cpp/pull/23780" data-hovercard-type="pull_request" data-hovercard-url="/ggml-org/llama.cpp/pull/23780/hovercard">DISABLED</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-macos-x64.tar.gz">macOS Intel (x64)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-xcframework.zip">iOS XCFramework</a></li> </ul> <p><strong>Linux:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-x64.tar.gz">Ubuntu x64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-arm64.tar.gz">Ubuntu arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-s390x.tar.gz">Ubuntu 24.04 s390x (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-26.04-s390x.tar.gz">Ubuntu 26.04 s390x (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-zdnn-s390x.tar.gz">Ubuntu 26.04 s390x (zDNN)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-vulkan-x64.tar.gz">Ubuntu x64 (Vulkan)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-vulkan-arm64.tar.gz">Ubuntu arm64 (Vulkan)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-cuda-12.8-x64.tar.gz">Ubuntu x64 (CUDA 12)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/cudart-llama-b12555-bin-ubuntu-cuda-12.8-x64.tar.gz">CUDA 12.8 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-cuda-13.5-x64.tar.gz">Ubuntu x64 (CUDA 13)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/cudart-llama-b12555-bin-ubuntu-cuda-13.5-x64.tar.gz">CUDA 13.5 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-cuda-13.5-arm64.tar.gz">Ubuntu arm64 (CUDA 13)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/cudart-llama-b12555-bin-ubuntu-cuda-13.5-arm64.tar.gz">CUDA 13.5 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-rocm-10.0-x64.tar.gz">Ubuntu x64 (ROCm 10.0)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-openvino-2026.4.1-x64.tar.gz">Ubuntu x64 (OpenVINO)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-sycl-fp32-x64.tar.gz">Ubuntu x64 (SYCL FP32)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-ubuntu-sycl-fp16-x64.tar.gz">Ubuntu x64 (SYCL FP16)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-linux-arm64-snapdragon.tar.gz">Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)</a> - <a href="https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/linux.md">setup guide</a></li> </ul> <p><strong>Android:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-android-arm64.tar.gz">Android arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12555/llama-b12555-bin-android-arm64-snapdragon.tar.gz">Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)</a> - <a href="https://github.com/ggml-org/llama.cpp/blob/maste
- b12555 ggml-org/llama.cpp releases · 20 thg 11, 2026