This is an AI Voice Assistant based on Large Language Models. A user can interact with the Voice Assistant in natural language, currently English.

The implementation brings various deep learning models together:

• Large Language Model (GPT-4 or Alpaca, can be chosen)
• Speech-To-Text Model (Wave2Vec2-Large)
• Text-To-Speech Model (Microsoft SpeechT5)

The speech module is interfaced with the local microphone to create live transcription via a VAD Process. A transcription is sent to the chosen LLM for processing based on wake words.

Once the LLM generates a response, speech module also saves the audio file and generates a speech output using a TTS model.

The User Interface is built using Streamlit and provides a familiar Chat-like experience.

Install project dependencies

pip install -r requirements 

If using GPT Models, create a .env file with environment variables for OPENAI_API_KEY and OPENAI_API_BASE.