Classes that support Unity MR Collab Apps

• avatar system
• mark realworld objects
• share spatial mesh
• syncronize data
• display task

You can see the classes in action in the demo.

The demo is a pc maintenance scenario, where the goal is to change the hard drive of a computer. You can find a download for the AR and VR unity project here

The classes are sorted into shared classes that are used by both applications and AR and VR classes that are only used by one of the applications.

To enable communication between the AR and VR application, we provide the LocalDataSource.cs basecalass that can send and recieve serialized objects using a Web-RTC DataChannel.

To enable the VR user to place markers in the world of the AR user, we created the MarkerSyncronizer.cs that syncronizes them between the applications. The VR app then uses the MarkerSystem.cs to enable the VR user to place new markers. The SteamVRController.cs handles the SteamVR inputs. The MarkerPlaceMachine.cs class allows the AR user to mark the position of the machine that requires maintenance.

To share the Spatial mapping of the environment of the AR user with the VR user, we use the CustomObserver.cs to send, and the MeshReciever.cs to recieve and display the mesh to the VR user.

• Steam VR
• Unity Engine 2018.4.26f1
• Windows SDK 18362+
• NodeJS
• node-dss

• add the SteamVR plugin in your VR project
• add the MRTK in your AR project
• add the MR-WebRTC unity library to both projects.