Is there a way to convert a 1x1 2D Tensor to scalar? about mshadow HOT 7 CLOSED

You can not direct read scalar from GPU tensor. Currently, one thing you can possibly do is store the result to a Tensor2D and copy to CPU to read it. There was a performance reason why we did not support summing over all the elements in GPU.

If you are implementing neural nets, usually copy to CPU to evaluate the statistics won't harm the overall performance, because this was a cheap operation

from mshadow.

Hi tq,
Actually I am only going to do this on CPU, so do you suggest I should just do thing like this?

for(unsigned int i = 0 ; i < outgrad.shape[1] ; i ++){
for(unsigned int j = 0 ; j < outgrad.shape[2] ; j ++){
err += outgrad[i][j] * outgrad[i][j];
}
}

Thanks a lot !

from mshadow.

If it was a 2D tensor, remember C++ index starts from 0, so it should be shape[1] and shape[0].. If you use master version of mshadow.

for(unsigned int i = 0 ; i < outgrad.size(0) ; i ++){
    for(unsigned int j = 0 ; j < outgrad.size(1) ; j ++){
        err += outgrad[i][j] * outgrad[i][j];
     }
}

The shape convention in master was reversed from numpy and a bit weird. There is going to be a major refactor to solve the problem

from mshadow.

so shape[0] is the number of columns in a 2D tensor
and shape[1] is the number of rows, Is this correct ? What if we have a 3D Tensor ?
I am kind of confused by this phrase in the tutorial:
"shape_[0] gives the lowest dimension, shape_[1] gives the second dimension, etc. This is different from numpy."

what does it mean by "the lowest dimension"

Thanks!

from mshadow.

Sorry about the confusion, this is a deprecated convention that will be changed. For temporal solution, you can use tensor.size(i), updated in master, which follows the same convention as numpy. I have updated the example

from mshadow.

Got it.

Thanks !

from mshadow.

you are welcome

from mshadow.