Comments (5)
@huzaifahshamim this container includes TensorRT: https://github.com/dusty-nv/jetson-containers/tree/master/packages/onnxruntime
Or you can grab the wheels from http://jetson.webredirect.org/
Or if building onnxruntime from jetson-containers, it will rebuild the wheels for a custom configuration when necessary.
from jetson-containers.
Thank you for your quick response @dusty-nv .
Attempting to access jetson.webredirect.org gives me this error:
Hmmm… can't reach this page jetson.webredirect.org’s server IP address could not be found.
Try:Search the web for jetson webredirect org
Checking the connection
Checking the proxy, firewall, and DNS settings
I had some additional dependencies I needed installed, so I did not want to solely use that container.
I also had a few follow ups:
- My cuda version on the Orin is 12.2 which means that onnxruntime 17.0 should work correct? However, I still run into the cublass 11.0 errors. So, if I was to use the container, which one would I even use?
- If I dont want to use the container, how can I access the .org website you linked?
- What is the difference between the builder and nonbuilder tags?
Update: I believe I answered 1: Basically using $(autotag onnxruntime) let me know which container image is compatible.
Does this image also contain the devel version for tensorrt as that is what I also need. I would like to be able to use trtexec in the docker container that I spin up
from jetson-containers.
@huzaifahshamim yes I use the tensorrt-devel libraries and tensorrt-python bindings in jetson-containers, and jetson-containers will also build onnxruntime for you if needed.
from jetson-containers.
Sounds great, thank you! All is working well so far. I am running into an import error and was wondering what the best method to solve this would be.
I am attempting to replicate the inferencing done here: https://github.com/NVIDIA/TensorRT/blob/main/samples/python/efficientnet/infer.py
On line 24, from cuda import cudart
is called, and I get a ModuleNotFound error on that line when I attempt to run infer.py in my container. I know that pip3 install cuda is not the right way to do it. What is the best way to do so?
from jetson-containers.
@huzaifahshamim for that you would want to include the cuda-python package or wheels in your container:
- https://github.com/dusty-nv/jetson-containers/tree/master/packages/cuda/cuda-python
- http://jetson.webredirect.org/jp6/cu122/cuda-python/12.2.0+0.g2ae98f9.dirty
from jetson-containers.
Related Issues (20)
- [Bug]: Not able to import Llama index modules in tensor rt llms HOT 1
- Box.com HOT 2
- Agent Studio VADFilter update HOT 1
- deepspeed for XTTS HOT 3
- CSI Camera not working, deciding to use USB camera HOT 2
- Segmentation Fault Issue with Nsight Systems
- Invalid URL in tritton server
- link to packaging is down
- Error encountered when compiling cuML on Jestson AGX Orin
- Add SAM 2 HOT 1
- jetson-containers build nano_llm pip error HOT 1
- Newbie with Agent Studio
- Using Official NVIDIA Tensor RT Extension for Stable Diffusion Web UI
- Ollama pull error: The model you are attempting to pull requires a newer version of Ollama.Hi HOT 15
- Cannot build stable-diffusion-webui
- ImportError: whisper_trt not installed (minimum BSP version JetPack 6 / L4T R36
- Can you please add Gemma-2 support, I can not run my gemma2 model
- raise ConnectionError jetson-container offline HOT 3
- [Bug] Unable to build opencv container with the default opencv tag `4.8.1` HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jetson-containers.