haoliuhust / groundingdino-service Goto Github PK

after creating .mar file and moving the file to the model_store, i tried running it using the command provided. i checked the log file using:
sudo docker logs -f groundingdino
i came across a warning saying warnings.warn("Failed to load custom C++ ops. Running on CPU mode Only!") (i attached the log file [
log.txt
)

i would be grateful if you guide me through this . i installed nvidia-container-toolkit and i ran docker using nvidia runtime.
(sorry for the wrong issue tittle)

I come across the error below after running the image for creating .mar file:
WARNING: The NVIDIA Driver was not detected. GPU functionality will not be available.
Use the NVIDIA Container Toolkit to start this container with GPU support; see
https://docs.nvidia.com/datacenter/cloud-native/ .''

i'm serving it on a remote VM . I checked Nvidia-smi and everything looks fine(torch is able to recognize the gpus)
using ubuntu22 and cuda11.7

do you have any solutions for this problem?

My account was compromised, as a result many spam issues got created across multiple repos. I am deleting all such issues. Please check my tweet: https://x.com/arghyac35/status/1729721954909684064?s=20