Comments (6)
Yes, from what I know, it should get fixed in the coming release. I'll check with their upcoming release as soon as its available.
from orbit.
Hi!
Uploading the entire partnet-mobility (SAPIEN) dataset on Nucleus was proving to be rather expensive, so we didn't end up uploading the assets over there. We are working now on making an extension in Orbit that loads the dataset and also annotates part semantics (which might be useful for perception).
The expected timeline for this will be around the end of May. But if you need a quicker solution, I suggest downloading the dataset from where2act paper that has the SAPIEN dataset with convex decomposition using VHACD.
Form from their website to get access to their dataset: https://docs.google.com/forms/d/e/1FAIpQLSegEvIM22Ta44MrKM5d-guRE4aDR5K77ZQoInLWEyib-aeCFw/viewform
After that, you can import these assets using the URDF importer in Isaac Sim:
https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/ext_omni_isaac_urdf.html
Maybe the discussion in #48 might be useful here too.
from orbit.
Hi Mayank,
Thanks a lot, that's very helpful. Looking forward to the next releases.
from orbit.
Hi Mayank,
This worked very well and I am able to import all the objects. But I am running into an issue in which "phantom collisions" between the robot and the object happen. In particular, as soon as I import a second articulation (in addition to the robot) and then call self._robots.set_joint_positions(), in the very next physics step there happens a collision which shakes or tops over the articulated object - even if the object is 10 meter away.
I have raised this with nvidia directly (last post in https://forums.developer.nvidia.com/t/robot-reset-failing-if-in-contact-or-simultaneously-resetting-object-since-v2022-2-0/248452/8). But I was wondering if you have experienced anything similar when you were running the examples in the Orbit paper?
from orbit.
Hi!
We saw this too in one of our cabinet environments as well (thus the reason why we haven't open-sourced it yet). From what I have seen, there has been a regression in physics ArticulationView from Isaac Sim 2022.2.0 to Isaac Sim 2022.2.1 and I think that's the root cause of these failures.
Can you try running with 2022.2.0 and see what happens? Also, if you run with CPU physics (i.e. --cpu
flag), I think you'd see the "correct" behavior. If not, then the issue is arising from something else here.
Also based on the video, you should probably import the cabinet with a fixed joint. Then it won't topple.
from orbit.
That's very good to know, thanks.
Indeed, this does not happen if running on the CPU. I think I'm seeing some improvements after converting the usd files (including our robot) to instanceable, but there is still some weird behavior. I also added a fixed joint, but still ended up with the cabinet doors opening / closing at random points
I will try with 2022.2.0 as well. You wouldn't happen to know if this regression will be addressed in the next Isaac release?
from orbit.
Related Issues (20)
- [Bug Report] Conda environment not being setup correctly for ZSH
- [Question] Can I have different number of objects in each sub-environment? HOT 3
- [Bug Report] running robot_assembler.py in IsaacLab HOT 1
- [Proposal] Docs innacuracy - migration from OIGE `_get_dones` - detect cart `out_of_bounds`
- [Question] Didn't find wheel for isaacsim-rl 4.0.0.0 HOT 3
- [Question] Real-robot code
- [Bug Report] CUDA error happens when running my code
- How to create new task with new robot? HOT 2
- [Question] My ground terrain get so dark
- [Question]Questions about object peneration
- [Question] camera can see robot in diffferent envs HOT 1
- [Question] Stepping without physics simulation HOT 2
- [Question] Debugging physics simulation HOT 1
- [Question] voxel_resolution of deformable objects HOT 1
- [Question] Physical Material of deformable objects HOT 1
- [Bug Report] "No module named 'toml'" when Run and Debug "Train Environment" / "Play Environment" with VSCode HOT 1
- [Bug Report] "gymnasium.error.Error: Malformed environment ID" But ID is correct HOT 1
- [Proposal] Error out when CPU PhysX pipeline is enabled and user attempts to spawn a SDF asset
- [Proposal] Add a deprecation warning for `render_interval`'s predecessor `SimulationCfg.decimation`
- [Bug Report] omni.isaac.lab/test/deps/test_scipy.py test fails HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from orbit.