Exciting News: llama.cpp Officially Supports RISC-V 128-bit Vector Extension, Achieving Up to 9x Performance Improvement
On March 27, 2025, the “ggml : riscv: add 128-bit RVV support” (PR #12530), submitted by developer xctan, was officially merged into the ggml main branch. This update marks the addition of official support for RISC-V 128-bit vector extensions (RVV) within the ggml framework, providing critical infrastructure support for RISC-V’s advancements in AI inference acceleration and heterogeneous computing.