nvidia-ai-iot / ros2_deepstream Goto Github PK

In single_stream_class.py, line 156, I think the minus sign is wrong:

bounding_box.center.y = float(top - (height/2))

should be

bounding_box.center.y = float(top + (height/2))

Please, correct me, if I'm wrong.
Otherwise the package works fine for me.
Thanks for your awesome work!

When I installed the dependencies and use command ' ros2 run single_stream_pkg single_stream --ros-args -p input_source:="/dev/video0"', some errors happened: No module named 'vision_msgs'.
How could I do?

Hi,

Great work! How to use this repo with my own custom trained model? (Detection, Classification, etc) any examples?

Best,
Hooman

Hey all, and thank you for this incredible project!
I would like to know what are the changes that need to be done in order to convert the input of the node from camera/mp4 file path to a topic of a node that publisher bag file of frames.
which class should be changed or what kind of topic should I use? or other modifications I should take in consider.
best regrades,
AK

I'm apologizing for open issue accidentally.

Device: Jetson Nano 4GB
OS: Ubuntu 20.04
Ros 2: Foxy
SDK: 6.0
Python: 3.8

When running the ros2 run single_stream_pkg single_stream --ros-args -p input_source:="/dev/video0" command I receive the following error message "ImportError: libpython3.6m.so.1.0: cannot open shared object file: No such file or directory". I fully installed the deepstream SDK and successfully ran the given examples. I also installed the deepstream python apps and ran that successfully.

The workstation is located in /home/ros2_ws/src/ros2_deepstream

is there a deployment with docker of the proposed solution?

On an Xavier NX, I've checked the repo out and run "sh docker_build.sh", but it fails on step #27 (RUN pip3 install pycuda --verbose) with the following error:

.
.
.
Updating cache with response from "https://files.pythonhosted.org/packages/bf/10/ff66fea6d1788c458663a84d88787bae15d45daa16f6b3ef33322a51fc7e/MarkupSafe-2.0.1.tar.gz"
Caching due to etag
Running setup.py (path:/tmp/pip-build-8glu0gil/MarkupSafe/setup.py) egg_info for package MarkupSafe
Running command python setup.py egg_info
Traceback (most recent call last):
File "", line 1, in
File "/tmp/pip-build-8glu0gil/MarkupSafe/setup.py", line 61, in
run_setup(True)
File "/tmp/pip-build-8glu0gil/MarkupSafe/setup.py", line 44, in run_setup
ext_modules=ext_modules if with_binary else [],
File "/usr/lib/python3/dist-packages/setuptools/init.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.6/distutils/core.py", line 121, in setup
dist.parse_config_files()
File "/usr/lib/python3/dist-packages/setuptools/dist.py", line 494, in parse_config_files
ignore_option_errors=ignore_option_errors)
File "/usr/lib/python3/dist-packages/setuptools/config.py", line 106, in parse_configuration
meta.parse()
File "/usr/lib/python3/dist-packages/setuptools/config.py", line 382, in parse
section_parser_method(section_options)
File "/usr/lib/python3/dist-packages/setuptools/config.py", line 355, in parse_section
self[name] = value
File "/usr/lib/python3/dist-packages/setuptools/config.py", line 173, in setitem
value = parser(value)
File "/usr/lib/python3/dist-packages/setuptools/config.py", line 430, in _parse_version
version = self._parse_attr(value)
File "/usr/lib/python3/dist-packages/setuptools/config.py", line 305, in _parse_attr
module = import_module(module_name)
File "/usr/lib/python3.6/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 994, in _gcd_import
File "", line 971, in _find_and_load
File "", line 953, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'markupsafe'
Cleaning up...
Removing source in /tmp/pip-build-8glu0gil/pycuda
Removing source in /tmp/pip-build-8glu0gil/pytools
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-8glu0gil/MarkupSafe/
Exception information:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/pip/basecommand.py", line 215, in main
status = self.run(options, args)
File "/usr/lib/python3/dist-packages/pip/commands/install.py", line 353, in run
wb.build(autobuilding=True)
File "/usr/lib/python3/dist-packages/pip/wheel.py", line 749, in build
self.requirement_set.prepare_files(self.finder)
File "/usr/lib/python3/dist-packages/pip/req/req_set.py", line 380, in prepare_files
ignore_dependencies=self.ignore_dependencies))
File "/usr/lib/python3/dist-packages/pip/req/req_set.py", line 634, in _prepare_file
abstract_dist.prep_for_dist()
File "/usr/lib/python3/dist-packages/pip/req/req_set.py", line 129, in prep_for_dist
self.req_to_install.run_egg_info()
File "/usr/lib/python3/dist-packages/pip/req/req_install.py", line 439, in run_egg_info
command_desc='python setup.py egg_info')
File "/usr/lib/python3/dist-packages/pip/utils/init.py", line 725, in call_subprocess
% (command_desc, proc.returncode, cwd))
pip.exceptions.InstallationError: Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-8glu0gil/MarkupSafe/
The command '/bin/sh -c pip3 install pycuda --verbose' returned a non-zero code: 1

Initially I thought maybe this was due to building on an Xavier, rather than an x86 platform. But the base image used in the Dockerfile is "nvcr.io/nvidia/deepstream-l4t:5.0.1-20.09-samples", which should be for arm64.

I've built a Docker container using this Dockerfile from the repo:
https://github.com/NVIDIA-AI-IOT/ros2_jetson/blob/main/docker/DockerFile.deepstream.ros2.eloquent

I then follow steps here (to run an example) inside the container:
https://github.com/NVIDIA-AI-IOT/ros2_deepstream

1. cd /workspace/ros2_ws/src/ros2_deepstream/
2. colcon build
3. source /opt/ros/eloquent/setup.bash
4. . install/setup.bash
5. ros2 run single_stream_pkg single_stream --ros-args -p input_source:="/dev/video0"

Steps 1-4 run fine, but running step #5 I receive this error:

** (process:139): WARNING **: 18:44:29.567: Failed to load shared library 'libgstreamer-1.0.so.0' referenced by the typelib: /lib/aarch64-linux-gnu/libm.so.6: version `GLIBC_2.29' not found (required by /usr/lib/aarch64-linux-gnu/libgstreamer-1.0.so.0)
Traceback (most recent call last):
File "/workspace/ros2_ws/src/ros2_deepstream/install/single_stream_pkg/lib/single_stream_pkg/single_stream", line 11, in
load_entry_point('single-stream-pkg==0.0.0', 'console_scripts', 'single_stream')()
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 480, in load_entry_point
return get_distribution(dist).load_entry_point(group, name)
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 2693, in load_entry_point
return ep.load()
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 2324, in load
return self.resolve()
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 2330, in resolve
module = import(self.module_name, fromlist=['name'], level=0)
File "/workspace/ros2_ws/src/ros2_deepstream/install/single_stream_pkg/lib/python3.6/site-packages/single_stream_pkg/single_stream.py", line 24, in
from single_stream_pkg.single_stream_class import InferencePublisher
File "/workspace/ros2_ws/src/ros2_deepstream/install/single_stream_pkg/lib/python3.6/site-packages/single_stream_pkg/single_stream_class.py", line 39, in
from gi.repository import GObject, Gst
File "", line 971, in _find_and_load
File "", line 955, in _find_and_load_unlocked
File "", line 656, in _load_unlocked
File "", line 626, in _load_backward_compatible
File "/usr/lib/python3/dist-packages/gi/importer.py", line 146, in load_module
dynamic_module = load_overrides(introspection_module)
File "/usr/lib/python3/dist-packages/gi/overrides/init.py", line 125, in load_overrides
override_mod = importlib.import_module(override_package_name)
File "/usr/lib/python3.6/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "/usr/lib/python3/dist-packages/gi/overrides/Gst.py", line 58, in
class Bin(Gst.Bin):
File "/usr/lib/python3/dist-packages/gi/module.py", line 181, in getattr
interfaces = tuple(interface for interface in get_interfaces_for_object(info)
File "/usr/lib/python3/dist-packages/gi/module.py", line 105, in get_interfaces_for_object
interfaces.append(getattr(module, name))
File "/usr/lib/python3/dist-packages/gi/overrides/init.py", line 39, in getattr
return getattr(self.introspection_module, name)
File "/usr/lib/python3/dist-packages/gi/module.py", line 220, in getattr
wrapper = metaclass(name, bases, dict)
File "/usr/lib/python3/dist-packages/gi/types.py", line 234, in init
register_interface_info(cls.info.get_g_type())
TypeError: must be an interface

This shared object file () is located here (inside the container);
root@ubuntu:/# find . -name libgstreamer-1.0.so.0
./usr/lib/aarch64-linux-gnu/libgstreamer-1.0.so.0
./usr/lib/aarch64-linux-gnu/tegra/libgstreamer-1.0.so.0

So I tried:

• export LD_LIBRARY_PATH=/usr/lib/aarch64-linux-gnu/libgstreamer-1.0.so.0:$LD_LIBRARY_PATH
• (receive same error as above)
• export LD_LIBRARY_PATH=/usr/lib/aarch64-linux-gnu/tegra/libgstreamer-1.0.so.0:$LD_LIBRARY_PATH
• (receive same error as above)

I'm not sure where to go from here. It seems the container is not built correctly to run code from the ros2_deepstream repo, even though that is the intended purpose of these containers?