[Question] Visual Observations Setup? about orbit HOT 3 OPEN

Thank you for your question!

We are in the process of extending the observation and rewards manager to also handle different sensors in the scene. This would allow users to define sensor configurations and obtain data from them in their observations.

However, currently, Isaac Sim does not support parallelized cameras. So the expected visual throughput would be slow. As discussed in #3, we will prioritize extending the current camera class to have a CameraView class that at least gets the data from different cameras. However, this will be an experimental class since we do not have a clear definition of what parallel camera APIs will look like from the Omniverse side.

I am going to leave this issue open for discussion.

from orbit.

Sharing this update here for what's in store in the coming releases of Isaac Sim and Orbit:

https://www.youtube.com/watch?v=BVhJ-6D6wcs&ab_channel=ErwinCoumans

from orbit.

@Mayankm96 I went through the code for the link. It seems he is using a separate render which has nothing to do with omniverse to render the cartpole urdf only.

from orbit.