From 01da7cd3c187e3b87ab56b1b97c1606014f1c94a Mon Sep 17 00:00:00 2001 From: "Danilo M." Date: Fri, 25 Sep 2026 20:04:37 +0200 Subject: whisper.cpp: enable the ggml OpenVINO backend Runs the whole model through OpenVINO, next to the Vulkan backend. Both register as GPU devices and whisper uses one per run, selected with whisper-cli -dev N, so the two can be compared on the same build. whisper-bench has no device option; the README points at whisper-cli's exit timings instead. The backend includes opencl.hpp directly, so like openvino it needs OpenCL-CLHPP 2026.05.29, which the buildsystem provides via a hint. Test-built on -current, sbopkglint clean. Co-Authored-By: Claude Opus 5.5 --- whisper.cpp/README | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) (limited to 'whisper.cpp/README') diff --git a/whisper.cpp/README b/whisper.cpp/README index 3894eba..74b89f5 100644 --- a/whisper.cpp/README +++ b/whisper.cpp/README @@ -5,7 +5,7 @@ recognition (ASR) model, plus NVIDIA Parakeet models. - AVX intrinsics support for x86 architectures - Mixed F16 / F32 precision - Integer quantization support - - Vulkan GPU backend + - Vulkan and OpenVINO GPU backends - OpenVINO encoder support Installs whisper-cli, whisper-server, whisper-bench, whisper-quantize, @@ -19,4 +19,8 @@ is accepted, not only WAV, MP3 and FLAC. OpenVINO support is built in. The encoder must be converted to OpenVINO IR format first, see "OpenVINO Support" in the bundled README.md. +Both GPU backends are built in; whisper uses the first GPU device it +finds. Pick one with whisper-cli -dev N (the startup log lists the +devices) and compare the timings it prints at exit. + OpenBLAS is autodetected: if installed, it is used for the BLAS backend. -- cgit v1.2.3