Comments (12)
Because zed_wrapper publishes color images encoded in BGRA8, nvblox cannot consume them. So you need to encode the color image to RGB8. The zed-ros2-examples repository contains the zed_rgb_convert package. This package converts images encoded in BGRA8 to BGR8. Change BGR8 to RGB8 and then build the package.
And depth images published by zed may have black pixels to distinguish boudaries from overlapping objects. Note depth settings document. I think that nvblox tend to be difficult for localizing voxels when it use black pixels from depth image.
If you set the depth option following bellow in common.yaml of the zed sdk, it can naturally fill in those black pixels.
option 1. ------------------------------------
depth:
quality: 1 #PERFORMANCE
sensing_mode: 1 #FILL
depth_confidence: 100
option 2. ------------------------------------
depth:
quality: 4 #NEURAL
sensing_mode: 0 #STANDARD
depth_confidence: 100
I've tested these settings on Xavier NX, Jetpack 4.6.2 and ZED2.
from isaac_ros_nvblox.
@podomong I have created a PR that adds support for all main color encoding inside this package: #32.
from isaac_ros_nvblox.
You can match Zed topics to the topic description listed here.
from isaac_ros_nvblox.
@swapnesh-wani-nvidia
did you test it?
Stereolabs doesn't plan Humble support until 2023, as it seems
Foxy topics do not match Humble nvblox deployment
Foxy deployment neither works on orin, but works on AGX
from isaac_ros_nvblox.
on orin it was not possible to visualize on foxy nvblox node from foxy zed topics at all,
neither on nvblox humble from zed foxy topics
but it was possible to visualize on on Jetson AGX[not orin], but without color[ just grey] also with some corruption as it seems
from isaac_ros_nvblox.
@AndreV84 We were having the same issue for integrating with a ZED mini camera. The main issue was that this lib doesn't support the Zed's BGRA8 image encoding, only RGB8. We have create a PR to overcome this issue: #32.
This is how our topic mapping are:
remappings=[('depth/image', '/zedm/zed_node/depth/depth_registered'),
('depth/camera_info', '/zedm/zed_node/depth/camera_info'),
('color/image', '/zedm/zed_node/rgb/image_rect_color'),
('color/camera_info', '/zedm/zed_node/rgb/camera_info'), ]),
The mesh in RVIZ doesn't look good yet, we are still investigating to why. If you get a chance to check it out, please let us know your results.
from isaac_ros_nvblox.
@hemalshahNV
Has the issue been closed as resolved or as insoluble?
from isaac_ros_nvblox.
@podomong so the nvblox is intact in your design, in order to get zed working with nvbolx on Jetson - I just clone the https://github.com/stereolabs/zed-ros2-examples/ repository, then change " BGR8 to RGB8 ", then build the package? right? how do I have to run the example build? concurrently with nvblox? OR you suggest to edit the BGR8 to RGB8 in nvblox code?
@nakai-omer could you extend how to use your suggested submodule to verity on Jetson with zed camera, please? soes it have to be running concurrently with nvblox in order to do conversion?
from isaac_ros_nvblox.
if to run the convert like that it will simply crash not starting the node at all
ros2 run zed_rgb_convert zed_rgb_convert
from isaac_ros_nvblox.
@AndreV84 It is this repo, just with an added library, you will need to checkout the PR, and build it from source (notice there is a submodule so you will need to run git submodule update --init --recursive
from isaac_ros_nvblox.
@nakai-omer thank you for your reply
Could you extend what you mean by PR, please?
from isaac_ros_nvblox.
Has anyone managed to get this working?
from isaac_ros_nvblox.
Related Issues (20)
- Mesh block is too big to weld. Exiting without doing anything. HOT 2
- How does nvblox node consumes topics of VSLAM node? HOT 3
- Isssue while executing VSLAM Node HOT 12
- Build issue HOT 1
- Nvbox in Isaac Gym (the Omniverse version) HOT 3
- rosdep install fails in nvblox_vslam_realsense tutorial HOT 7
- Mismatch between the point cloud slice and distance map slice HOT 5
- where is /opt/nvidia/tao/tao-converter HOT 2
- Use nvblox in a non-flat environment HOT 5
- colcon build --symlink-install error HOT 3
- CMake (Colcon) can not find nvToolsExt HOT 6
- Carter canβt move in the narrow area. HOT 4
- Nvblox with Realsense - Odom Frame does not exist / DKMS Kernel version HOT 3
- Failed to build base image: isaac_ros_dev-x86_64, aborting HOT 2
- What is the car used in this demo? HOT 2
- `Failed to call git rev-parse` and `Failed to build base image: isaac_ros_dev-x86_64, aborting.` HOT 2
- Occupancy grid not cleared if map_clearing_radius_m > 0 and use_static_occupancy_layer: true HOT 3
- Cannot see any result from example HOT 1
- No result from Realsense live data HOT 1
- realsense_splitter_node fails to load on Jetson Xavier NX HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from isaac_ros_nvblox.