This projects intends to create a demo of a voice assistant for Bittle. The voice assistant will be able to understand voice commands and execute them on the robot.

1. Control the robot via serial communication
2. Using LLM to understand natural language commands
3. Voice recognition
4. Transition to a domestic LLM
5. Fix the multi-threading bug
6. Implement an idle state; the robot should default to an idle state in the absence of commands
7. Replace the robots main program with a custom program
8. Refine texts prior to their submission to the LLM
9. Address the issue of the voice recognition server terminating the connection
10. Emit preliminary feedback pending the LLM's reply
11. Design a more realistic idle state
12. Design a better prompt

1. Run pip install -r requirements.txt
2. Add your xunfei APPID, APISERCET, XF_APIKEY and OPENAI_API_KEY to key.py
3. Connect the robot to your computer
4. Run python dog.py

• dog.py: main file; modified from ref/dog.py
• key.py: store the API keys
• sst.py: speech to text; modified from ref/iat_ws_python3.py
• tools.py: functions sending commands to the robot, used for tool calls
• send_command/: a folder containing the files used to set up the serial communication with the robot and send commands to it; copied from OpenCat

• OpenCat
• xunfei