EOFError while training NER model about emnlp2017-bilstm-cnn-crf HOT 4 CLOSED

You need to talk to @nreimers ;)

from emnlp2017-bilstm-cnn-crf.

@reckart Okay thanks:)

from emnlp2017-bilstm-cnn-crf.

@nreimers Please have a look at the issue i am stuck and i need some guidance....
Thanks in advance.

from emnlp2017-bilstm-cnn-crf.

Hi,
looks like some issue with the pickle file. Sadly Windows and Python is not the best combination and it has several issues with storing and reading files correctly from the disk + issues with special characters. I would recommend to use Linux when you are working with Python and Keras.

On Windows you can get a good Linux environment when using Docker. There is also a docker file for this project to run the code.

When you search for EOF error, you find several problems, especially for Windows. One issue is that you might not have enough RAM?

The Glove embeddings are quite large and pickle is known to throw an EOFerror when it runs out of RAM. Try to use some smaller embeddings file or try it with more RAM.

Also try to delete the pickle files in the pkl-folder and to re-run the script.

Another solution for the EOFerror on Windows is to apply dos2unix / unix2dos to the pickle file and then try to load it again. Some report that it is an issue with the different line endings of unix / windows.

from emnlp2017-bilstm-cnn-crf.