Question about Zero Volatile GPU-Util about lisa HOT 5 CLOSED

First thing to check is that you've installed tensorflow with gpu support. The default tensorflow package is cpu only.
pip3 install --user tensorflow-gpu

from lisa.

The package is tensorflow-gpu 1.9.0. @patverga

from lisa.

Does tensorflow output a line like:

2019-01-22 12:22:22.434234: I
tensorflow/core/common_runtime/gpu/gpu_device.cc:1098] Created TensorFlow
device (/job:localhost/replica:0/task:0/device:GPU:0 with 11428 MB memory)
-> physical GPU (device: 0, name: GeForce GTX TITAN X, pci bus id:
0000:82:00.0, compute capability: 5.2)

If so, then it's using GPU. If not, then you likely have some kind of
configuration issue.

I would expect GPU usage to fluctuate a lot during evaluation, and in fact
for most of the time to be spent on CPU since the code calls the official
CoNLL evaluation scripts (perl). Currently I believe evaluation uses the
same batch size as training, but you could increase it depending on your
GPU's memory to make better use of the GPU.

The code currently doesn't have a "predict" mode, which simply outputs
predictions for sentences without evaluating. This may be more the
functionality you desire, and I'm happy to accept pull requests :)

from lisa.

Does tensorflow output a line like:

2019-01-22 12:22:22.434234: I
tensorflow/core/common_runtime/gpu/gpu_device.cc:1098] Created TensorFlow
device (/job:localhost/replica:0/task:0/device:GPU:0 with 11428 MB memory)
-> physical GPU (device: 0, name: GeForce GTX TITAN X, pci bus id:
0000:82:00.0, compute capability: 5.2)

If so, then it's using GPU. If not, then you likely have some kind of
configuration issue.

I would expect GPU usage to fluctuate a lot during evaluation, and in fact
for most of the time to be spent on CPU since the code calls the official
CoNLL evaluation scripts (perl). Currently I believe evaluation uses the
same batch size as training, but you could increase it depending on your
GPU's memory to make better use of the GPU.

The code currently doesn't have a "predict" mode, which simply outputs
predictions for sentences without evaluating. This may be more the
functionality you desire, and I'm happy to accept pull requests :)

Thanks for your patient answer. I suddenly found that I set the parameter of debug as 1, which caused the high frequency of evaluation for validation and the low GPU usage.

from lisa.

from lisa.