diff options
| author | Danilo M. <danix@danix.xyz> | 2026-09-25 20:04:37 +0200 |
|---|---|---|
| committer | Danilo M. <danix@danix.xyz> | 2026-09-25 20:04:37 +0200 |
| commit | 01da7cd3c187e3b87ab56b1b97c1606014f1c94a (patch) | |
| tree | 7ed7991fc0bbd7e4644fd67b715ca0c2cfb3d615 /whisper.cpp | |
| parent | 3ef918b667f71ad838e430ae540f32c1b42e2d2c (diff) | |
| download | my-slackbuilds-01da7cd3c187e3b87ab56b1b97c1606014f1c94a.tar.gz my-slackbuilds-01da7cd3c187e3b87ab56b1b97c1606014f1c94a.zip | |
whisper.cpp: enable the ggml OpenVINO backend
Runs the whole model through OpenVINO, next to the Vulkan backend.
Both register as GPU devices and whisper uses one per run, selected
with whisper-cli -dev N, so the two can be compared on the same
build. whisper-bench has no device option; the README points at
whisper-cli's exit timings instead.
The backend includes opencl.hpp directly, so like openvino it needs
OpenCL-CLHPP 2026.05.29, which the buildsystem provides via a hint.
Test-built on -current, sbopkglint clean.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Diffstat (limited to 'whisper.cpp')
| -rw-r--r-- | whisper.cpp/README | 6 | ||||
| -rw-r--r-- | whisper.cpp/whisper.cpp.SlackBuild | 1 |
2 files changed, 6 insertions, 1 deletions
diff --git a/whisper.cpp/README b/whisper.cpp/README index 3894eba..74b89f5 100644 --- a/whisper.cpp/README +++ b/whisper.cpp/README @@ -5,7 +5,7 @@ recognition (ASR) model, plus NVIDIA Parakeet models. - AVX intrinsics support for x86 architectures - Mixed F16 / F32 precision - Integer quantization support - - Vulkan GPU backend + - Vulkan and OpenVINO GPU backends - OpenVINO encoder support Installs whisper-cli, whisper-server, whisper-bench, whisper-quantize, @@ -19,4 +19,8 @@ is accepted, not only WAV, MP3 and FLAC. OpenVINO support is built in. The encoder must be converted to OpenVINO IR format first, see "OpenVINO Support" in the bundled README.md. +Both GPU backends are built in; whisper uses the first GPU device it +finds. Pick one with whisper-cli -dev N (the startup log lists the +devices) and compare the timings it prints at exit. + OpenBLAS is autodetected: if installed, it is used for the BLAS backend. diff --git a/whisper.cpp/whisper.cpp.SlackBuild b/whisper.cpp/whisper.cpp.SlackBuild index f4de5fe..a30a36f 100644 --- a/whisper.cpp/whisper.cpp.SlackBuild +++ b/whisper.cpp/whisper.cpp.SlackBuild @@ -101,6 +101,7 @@ cd build -DGGML_BUILD_EXAMPLES=OFF \ -DGGML_BUILD_TESTS=OFF \ -DGGML_VULKAN=ON \ + -DGGML_OPENVINO=ON \ -DWHISPER_SDL2=ON \ -DWHISPER_COMMON_FFMPEG=ON \ $BLAS \ |