last updated: Jul 07, 2024


High-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model:

The binary produced by whisper.cpp is much faster for inference than the python version provided by openai.

I wrapped whisper.cpp to try and provide it a nicer UI in blisper. In the process, I discovered that the default golang bindings are very slow, and figured out how to make them quite a bit faster.

↑ up