The aim of this project is to develop a ROS2-based platform to enable the integration of voice commands and information recognized by the robot's vision and to operate the robot.
The project members are listed below:

The project is divided into four modules based on prioritization:

• Computer Vision
• Voice Command Recognition
• Decision Making
• Robotic Control We will develop them in order.

Sprint tag: COMP90082_2023_SM2_AI_RedBack_BL_SPRINTX Branch Naming Convention: <user_story_id>-<"feature/bug_fix">-<person>-<description>

All demos reflecting our project progress have been uploaded to a YouTube Playlist. Demo video for each independent module can also be accessed via direct links below:

• Object Detection
• Human Gesture
• Speech to Text

The project is mainly divided into two repos: AI RedBack and AI RedBack Vision(Client requested). AI RedBack has all the sprint documents and Voice Recognition content, while AI RedBack Vision mainly focuses on Vision.

• Official documentation can be found here: https://docs.ros.org/en/humble/Installation.html
• Confluence guide document: This link will guide you to install the ROS2.

• Official documentation can be found here: https://frankaemika.github.io/docs/installation_linux.html
• Confluence guide document: This link will guide you to install the Libfranka.

• Official documentation can be found here: https://support.franka.de/docs/franka_ros2.html
• Confluence guide document: This link will guide you to install the Franka_ros2.

• Version Oct 6, 2023

  • Updated semantic analysis ROS2 node to capture more information. Updated the recording app to enable it to start and end recording using space operations

• Version Sep 21, 2023

  • Upload the ROS2 node version of the application used for recording voice and update the document

• Version Sep 18, 2023

  • Upload ROS2 Python node files for voice to text conversion and their test. wav files

• Version Sep 6, 2023

  • Upload ROS2 python node

• Version Sep 3, 2023

  • Upload Python files for semantic analysis using OpenAI

• Version Aug 18, 2023

  • Upload documents related to sprint 1

• Version Aug 16, 2023

  • Create Github repo

"Please correct the grammar of the following text: "{transcript}""

"Translate the sentence into action, object and location, for example a sentence 'slowly move that red cup to the top of the table' should be 'Action: slowly move; Object: red cup; Location: top of the table'. If there is no location information, Location should be N/A. Now please translate {sentence}"

This file contains all the file list.