Comments (2)
monajalal
commented on July 3, 2024
Killed all the Python processes and added the following lines from config = tf.ConfigProto()
config.gpu_options.allow_growth = True
session = tf.Session(config=config, ...)
as
config = tf.ConfigProto()
config.gpu_options.allow_growth = True
sess = tf.Session(graph=detection_graph, config=config)
and still get the same error as you see here:
Also, it gets stuck in the last line ending in compute capability: 6.1
mona@Mona:~/code/handpose/handtracking$ python detect_multi_threaded.py
/home/mona/anaconda3/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
from ._conv import register_converters as _register_converters
{'im_width': 320.0, 'im_height': 180.0, 'score_thresh': 0.2, 'num_hands_detect': 2} Namespace(display=1, fps=1, height=200, num_hands=2, num_workers=4, queue_size=5, video_source=0, width=300)
>> loading frozen model for worker
> ====== loading HAND frozen graph into memory
>> loading frozen model for worker
> ====== loading HAND frozen graph into memory
>> loading frozen model for worker
> ====== loading HAND frozen graph into memory
>> loading frozen model for worker
> ====== loading HAND frozen graph into memory
2018-06-25 10:47:11.156972: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2018-06-25 10:47:11.180850: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2018-06-25 10:47:11.211547: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2018-06-25 10:47:11.236604: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2018-06-25 10:47:11.423600: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1356] Found device 0 with properties:
name: TITAN Xp major: 6 minor: 1 memoryClockRate(GHz): 1.582
pciBusID: 0000:01:00.0
totalMemory: 11.90GiB freeMemory: 10.77GiB
2018-06-25 10:47:11.423652: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-25 10:47:11.499971: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1356] Found device 0 with properties:
name: TITAN Xp major: 6 minor: 1 memoryClockRate(GHz): 1.582
pciBusID: 0000:01:00.0
totalMemory: 11.90GiB freeMemory: 10.61GiB
2018-06-25 10:47:11.499999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-25 10:47:11.530682: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1356] Found device 0 with properties:
name: TITAN Xp major: 6 minor: 1 memoryClockRate(GHz): 1.582
pciBusID: 0000:01:00.0
totalMemory: 11.90GiB freeMemory: 10.42GiB
2018-06-25 10:47:11.530734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-25 10:47:11.539197: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1356] Found device 0 with properties:
name: TITAN Xp major: 6 minor: 1 memoryClockRate(GHz): 1.582
pciBusID: 0000:01:00.0
totalMemory: 11.90GiB freeMemory: 10.29GiB
2018-06-25 10:47:11.539239: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-25 10:47:11.690564: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-25 10:47:11.690599: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929] 0
2018-06-25 10:47:11.690608: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0: N
2018-06-25 10:47:11.690829: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9877 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:01:00.0, compute capability: 6.1)
2018-06-25 10:47:11.737120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-25 10:47:11.737156: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929] 0
2018-06-25 10:47:11.737164: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0: N
2018-06-25 10:47:11.737345: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 266 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:01:00.0, compute capability: 6.1)
> ====== Hand Inference graph loaded.
2018-06-25 10:47:11.746520: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-25 10:47:11.746573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-25 10:47:11.746583: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929] 0
2018-06-25 10:47:11.746591: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0: N
2018-06-25 10:47:11.746725: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 266 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:01:00.0, compute capability: 6.1)
2018-06-25 10:47:11.767820: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-25 10:47:11.767851: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929] 0
2018-06-25 10:47:11.767858: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0: N
2018-06-25 10:47:11.767886: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-25 10:47:11.767904: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929] 0
2018-06-25 10:47:11.767910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0: N
2018-06-25 10:47:11.767997: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 203 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:01:00.0, compute capability: 6.1)
2018-06-25 10:47:11.768033: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 203 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:01:00.0, compute capability: 6.1)
2018-06-25 10:47:11.768997: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 203.69M (213581824 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.769227: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 203.69M (213581824 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.770416: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 183.32M (192223744 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.770917: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 164.99M (173001472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.771418: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 148.49M (155701504 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.771908: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 133.64M (140131584 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.772398: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 120.28M (126118656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
> ====== Hand Inference graph loaded.
2018-06-25 10:47:11.772948: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 108.25M (113506816 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.773446: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 97.42M (102156288 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.773938: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 87.68M (91940864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.774431: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 78.91M (82746880 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.774925: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 71.02M (74472192 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.775428: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 63.92M (67025152 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.775925: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 57.53M (60322816 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.776422: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 51.78M (54290688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.776927: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 46.60M (48861696 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.777428: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 41.94M (43975680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.777453: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-25 10:47:11.777485: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-25 10:47:11.777493: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929] 0
2018-06-25 10:47:11.777498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0: N
2018-06-25 10:47:11.777771: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 203 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:01:00.0, compute capability: 6.1)
2018-06-25 10:47:11.777985: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 37.74M (39578112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.778566: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 33.97M (35620352 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.779093: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 30.57M (32058368 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.779608: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 27.52M (28852736 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.780125: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 24.76M (25967616 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.780640: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 22.29M (23371008 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.781157: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 20.06M (21033984 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.781678: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 18.05M (18930688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.782203: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 16.25M (17037824 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.782733: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 14.62M (15334144 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.783295: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 13.16M (13800960 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.783848: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 11.84M (12420864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.784398: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 10.66M (11179008 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.784961: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 9.59M (10061312 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
2018-06-25 10:47:11.785524: E tensorflow/stream_executor/cuda/cuda_driver.cc:936] failed to allocate 8.64M (9055232 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY
> ====== Hand Inference graph loaded.
2018-06-25 10:47:11.795805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-25 10:47:11.795869: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-25 10:47:11.795885: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929] 0
2018-06-25 10:47:11.795894: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0: N
2018-06-25 10:47:11.796063: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 203 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:01:00.0, compute capability: 6.1)
> ====== Hand Inference graph loaded.
2018-06-25 10:47:11.802724: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-25 10:47:11.802768: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-25 10:47:11.802778: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929] 0
2018-06-25 10:47:11.802786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0: N
2018-06-25 10:47:11.802908: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9877 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:01:00.0, compute capability: 6.1)
2018-06-25 10:47:12.321811: E tensorflow/stream_executor/cuda/cuda_dnn.cc:455] could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR
2018-06-25 10:47:12.321842: E tensorflow/stream_executor/cuda/cuda_dnn.cc:427] could not destroy cudnn handle: CUDNN_STATUS_BAD_PARAM
2018-06-25 10:47:12.321856: F tensorflow/core/kernels/conv_ops.cc:713] Check failed: stream->parent()->GetConvolveAlgorithms( conv_parameters.ShouldIncludeWinogradNonfusedAlgo<T>(), &algorithms)
>> loading frozen model for worker
> ====== loading HAND frozen graph into memory
2018-06-25 10:47:13.078694: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2018-06-25 10:47:13.166140: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1356] Found device 0 with properties:
name: TITAN Xp major: 6 minor: 1 memoryClockRate(GHz): 1.582
pciBusID: 0000:01:00.0
totalMemory: 11.90GiB freeMemory: 335.69MiB
2018-06-25 10:47:13.166167: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-25 10:47:13.372075: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-25 10:47:13.372106: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929] 0
2018-06-25 10:47:13.372111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0: N
2018-06-25 10:47:13.372235: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 54 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:01:00.0, compute capability: 6.1)
> ====== Hand Inference graph loaded.
2018-06-25 10:47:13.377552: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-25 10:47:13.377573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-25 10:47:13.377578: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929] 0
2018-06-25 10:47:13.377582: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0: N
2018-06-25 10:47:13.377661: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 54 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:01:00.0, compute capability: 6.1)
from handtracking.
monajalal
commented on July 3, 2024
use the following command and use kill -9 PID for any Python process:
$ sudo fuser -V /dev/nvidia*
from handtracking.
Related Issues (20)
- How can I detect hands in Jpg?(panel disappeared & size) HOT 1
- Just sending a note HOT 1
- why some label is not correct?
- Problem while training: zero mAp. HOT 2
- Threading to "improve" visual performance HOT 2
- Help Needed to convert the frozen graph to Tensorflow lite model HOT 4
- Problem with egohands_dataset_clean.py HOT 4
- hand detection
- Is the coordinate position of the detection box upper left corner, lower right corner or upper left corner with width and height?
- How can I use this model in Keras?
- Confusion while generating tf records
- question about frozen_inference_graph.pb
- Oxford hand dataset
- Using the savedmodel in this project for transfer learning in Keras
- Tensorflow Lite-Mobile HOT 3
- Loaded runtime CuDNN library: 7.4.2 but source was compiled with: 7.6.0 HOT 1
- Step-By-Step Tutorial and Requirements
- What's version of tensorflow was used to train model? HOT 1
- How to modify for a url stream?
- How can i use my own model for hand gestures
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from handtracking.