Error during decoding about xnmt HOT 5 CLOSED

Hello sir,
I re-ran with the configurations provided by you on Python 2 and got the following output.

Training
Start training in minibatch mode...
Epoch 1.0000: train_ppl=370.9497 (words=5057, time=0-00:00:01)
Epoch 1.0000: test_ppl=249.1718 (words=5057, time=0-00:00:01)
Epoch 1.0000: best dev loss, writing model to /tmp/dev.mod
Evaluating
bleu: 0.0883409765451
wer: 0.903624733475
Epoch 2.0000: train_ppl=213.6305 (words=5057, time=0-00:00:05)
Epoch 2.0000: test_ppl=208.2777 (words=5057, time=0-00:00:05)
Epoch 2.0000: best dev loss, writing model to /tmp/dev.mod"

from xnmt.

The current idea is the following:
search_strategy returns the entire list of words (translated sentence) for a source sentence, which is sent to output for processing as a batch (array of array). The token iterator accesses the token ids in the batch. As you pointed out, the above error indicates the case of another dimension being added. But I am unable to reproduce it. Which version of Python is it? I haven't tested the pipeline on Python 3 yet. This was run on the current master branch.

from xnmt.

Hi,
This might be due to the change in a recent version of Numpy.
It apparently treats a single-element array as a scalar for the purposes of indexing. That would work against the above idea.
stack overflow
Can you please provide the version of Numpy you are using?

from xnmt.

Thanks for looking at this so quickly! Here is my info, it's the standard one I got from Anaconda, although the version of anaconda may be old...

(python2) gneubig@lor:~$ python
Python 2.7.13 |Continuum Analytics, Inc.| (default, Dec 19 2016, 13:46:45) 
[GCC 4.4.7 20120313 (Red Hat 4.4.7-1)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
Anaconda is brought to you by Continuum Analytics.
Please check out: http://continuum.io/thanks and https://anaconda.org
>>> import numpy as np
>>> print np.__version__
1.12.1

from xnmt.

@neubig, The error was being caused due to a change in output dimensions returned by concatenate function of the latest dynet. The latest version adds another dimension to the output. We reshape the output now.

from xnmt.