Advanced users • Whisper-cpp and Vulkan shared memory problem

I compiled whsiper-cpp on my RPI5 8GB, it is running fine.

I also compiled whisper with a Vulkan backend, but running that gives a memory error.

ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = V3D 7.1.7.0 (V3DV Mesa) | uma: 1 | fp16: 0 | bf16: 0 | warp size: 16 | shared memory: 16384 | int dot: 0 | matrix cores: none

ggml_vulkan: Error: Shared memory size too small for matrix multiplication.
.

How can I increase the shared memory (16384) for Vulkan?

BTW I doubt the Vulkan backend will be faster. Probably only use less CPU.

Statistics: Posted by Aardappeltaart — Sat Aug 02, 2025 1:25 pm

---