Code Monkey home page Code Monkey logo

buzz's Introduction

Buzz

Transcribe and translate audio offline on your personal computer. Powered by OpenAI's Whisper.

MIT License CI GitHub release (latest by date)

Buzz

Features

  • Real-time transcription and translation from your computer's microphones to text (Demo)
  • Import audio and video files and export transcripts to TXT, SRT, and VTT (Demo)

Installation

To install Buzz, download the latest version for your operating system. Buzz is available on Mac and Windows.

Mac (macOS 11.7 and above)

  • Download and open the Buzz-x.y.z-dmg file.
  • After the installation window opens, drag the Buzz icon into the folder to add Buzz to your Applications directory.

Windows

  • Download and run the Buzz-x.y.z.exe file.

How to use

Live Recording

To start a live recording:

  • Select a recording task, language, quality, and microphone.
  • Click Record.

Note: Transcribing audio using the default Whisper model is resource-intensive. If your computer is unable to keep up with real-time transcription, consider turning on GGML inference.

Field Options Default Description
Task "Transcribe", "Translate" "Transcribe" "Transcribe" converts the input audio into text in the selected language, while "Translate" converts it into text in English.
Language See Whisper's documentation for the full list of supported languages "Detect Language" "Detect Language" will try to detect the spoken language in the audio based on the first few seconds. However, selecting a language is recommended (if known) as it will improve transcription quality in many cases.
Quality "Very Low", "Low", "Medium", "High" "Very Low" The transcription quality determines the Whisper model used for transcription. "Very Low" uses the "tiny" model; "Low" uses the "base" model; "Medium" uses the "small" model; and "High" uses the "medium" model. The larger models produce higher-quality transcriptions, but require more system resources. See Whisper's documentation for more information about the models.
Microphone [Available system microphones] [Default system microphone] Microphone for recording input audio.

Live Recording on Buzz

Record audio playing from computer

To record audio playing from an application on your computer, you may install an audio loopback driver (a program that lets you create virtual audio devices). The rest of this guide will use BlackHole on Mac, but you can use other alternatives for your operating system (see LoopBeAudio, LoopBack, and Virtual Audio Cable).

  1. Install BlackHole via Homebrew

    brew install blackhole-2ch
  2. Open Audio MIDI Setup from Spotlight or from /Applications/Utilities/Audio Midi Setup.app.

    Open Audio MIDI Setup from Spotlight

  3. Click the '+' icon at the lower left corner and select 'Create Multi-Output Device'.

    Create multi-output device

  4. Add your default speaker and BlackHole to the multi-output device.

    Screenshot of multi-output device

  5. Select this multi-output device as your speaker (application or system-wide) to play audio into BlackHole.

  6. Open Buzz, select BlackHole as your microphone, and record as before to see transcriptions from the audio playing through BlackHole.

File import

To import a file:

  • Click Import on the File menu (or Command + O on Mac, Ctrl + O on Windows).
  • Choose an audio or video file. Supported formats: "mp3", "wav", "m4a", "ogg", "mp4", "webm", "ogm".
  • Select a task, language, quality, and export format.
  • Click Run.
Field Options Default Description
Export As "TXT", "SRT", "VTT" "TXT" Export file format
Word-Level Timings Off / On Off If checked, the transcription will generate a separate subtitle line for each word in the audio. Enabled only when "Export As" is set to "SRT" or "VTT".

(See the Live Recording section for more information about the task, language, and quality settings.)

Media File Import on Buzz

Settings

Enable GGML inference

(Default: off)

Turn this on to use inference from Whisper.cpp. Whisper.cpp runs faster than Whisper's original Python implementation but requires a different set of models for inference. Whisper.cpp currently does not support the "Detect Language" option, and transcription will fall back to the original Whisper inference if selected. See the Whisper.cpp documentation for more information.

Model Link SHA256
tiny https://ggml.buzz.chidiwilliams.com/ggml-model-whisper-tiny.bin be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21
base https://ggml.buzz.chidiwilliams.com/ggml-model-whisper-base.bin 60ed5bc3dd14eea856493d334349b405782ddcaf0028d4b5df4088345fba2efe
small https://ggml.buzz.chidiwilliams.com/ggml-model-whisper-small.bin 1be3a9b2063867b937e64e2ec7483364a79917e157fa98c5d94b5c1fffea987b

Build/run locally

To build/run Buzz locally from source, first install the dependencies:

  1. Clone the repository

    git clone --recurse-submodules https://github.com/chidiwilliams/buzz
  2. Install Poetry.

  3. Install the project dependencies.

    poetry install
  4. (Optional) To use Whisper.cpp inference, run:

    make libwhisper.so

Then, to run:

poetry run python main.py

To build:

poetry run pyinstaller --noconfirm Buzz.spec

FAQ

  1. Where are the models stored?

    The Whisper models are stored in ~/.cache/whisper. The Whisper.cpp models are stored in ~/Library/Caches/Buzz (Mac OS), ~/.cache/Buzz (Unix), C:\Users/<username>\AppData\Local\Buzz\Buzz\Cache (Windows).

  2. What can I try if the transcription runs too slowly?

    Try using a lower quality or turning on GGML inference.

buzz's People

Contributors

chidiwilliams avatar faveoled avatar jordimas avatar kohasummons avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.