This is a central repository for tools, tutorials, resources, and documentation for robotic simulation in Unity.

The contents of this repository are in active development. Its features and API are subject to significant change as development progresses.

We're currently working on lots of things! Please take a short moment fill out our survey to help us identify what products and packages to build next.

Simulation plays an important role in robotics development, and we’re here to ensure that roboticists can use Unity for these simulations. We're starting off with a set of tools to make it easier to use Unity with existing ROS-based workflows. Try out some of our samples below to get started quickly.

Brief steps on installing the Unity Robotics packages.

A complete end-to-end demonstration, including how to set up the Unity environment, how to import a robot from URDF, and how to set up two-way communication with ROS for control.

A complete end-to-end demonstration in which we collect training data in Unity and use that data to train a deep neural network to predict the pose of a cube. This model is then deployed in a simulated robotic pick-and-place task.

A robot simulation demonstrating Unity's new physics solver (no ROS dependency).

An example simulation environment, integrated with ROS 2 and [New!] Visualizations, which enables the exercise of ROS 2's Navigation 2 and slam_toolbox packages using a simulated Turtlebot 3.

• [New!] (October 4, 2021) Introducing: Unity Robotics Visualizations Package blog post
• (August 13, 2021) Advance your robot autonomy with ROS 2 and Unity blog post
• (March 2, 2021) Teaching robots to see with Unity blog post
• (November 19, 2020) Robotics simulation in Unity is as easy as 1, 2, 3! blog post
• (November 12, 2020) Unite Now 2020: Simulating Robots with ROS and Unity video
• (August 26, 2020) Announcing Unity Robotic Simulation blog post
• (May 20, 2020) Use articulation bodies to easily prototype industrial designs with realistic motion and behavior blog post

• Unity Industrial Simulation
• Unity Computer Vision
• Unity ML-Agents Toolkit

• Contact Modification API This API will allow users to define custom contact reactions, such as ignoring subsets of contact points, in order to help simulate holes, slippery surfaces, soft contacts, and more. It is available in Unity versions 2021.2a12+. Read more about the new Contact Modification API.
• Collision detection modes exposed for ArticulationBody: discrete, sweep-based CCD, and speculative CCD. New continuous collision detection (CCD) modes will ensure that fast-moving objects collide with objects, instead of tunneling or passing through those objects, which can happen in the default “discrete” mode. This API is available in Unity versions 2020.3.5f1+. Read more about continuous collision detection.

Here’s a peek into what our Physics Team is hard at work on…

• Wheel Collider shapes. This feature will allow the user to specify the shape of the collider to be used for collision detection. Currently the collider shape is fixed to a cylinder, and collision detection is performed by casting a ray from the center of the cylinder. Custom shapes will improve the accuracy of simulating wheels over rough terrains, holes, etc. Read more about Wheel Collider.
• Force/Torque Sensor API. This API will allow users to get the force and torque acting on an articulation body (useful for simulating a force/torque sensor!), as well as to get the motor torque applied by an articulation drive.
• Query primitives. These simple, GameObject-less shapes allow for collision detection without requiring simulation (i.e., without calling Physics.Simulate). This feature will allow users to initialize objects in feasible locations, and can also be used for motion planning.

ROS2 support is now available! You can get started by following this tutorial.

The Unity Robotics projects are open-source and we encourage and welcome contributions. If you wish to contribute, be sure to review our contribution guidelines and code of conduct.

For questions or discussions about Unity Robotics package installations or how to best set up and integrate your robotics projects, please create a new thread on the Unity Robotics forum and make sure to include as much detail as possible.

For feature requests, bugs, or other issues, please file a GitHub issue using the provided templates and the Robotics team will investigate as soon as possible.

For any other questions or feedback, connect directly with the Robotics team at [email protected].

To get notified about new updates and features, sign up for our newsletter!

FAQs

Apache License 2.0