Scores from epoch with best dev-scores: about emnlp2017-bilstm-cnn-crf HOT 5 OPEN

Hi,
the development and test score is computed every epoch.

The system further remembers what the epoch with the best development score was. It shows than in every epoch also the dev & test score from the epoch that had so far the best development score.

If the current epoch has the best dev score, it shows the dev & test score from that epoch.

from emnlp2017-bilstm-cnn-crf.

Hi thanks,

Are the actual predictions made by classifier written somewhere?

from emnlp2017-bilstm-cnn-crf.

The actual predictions are not written to disk during training. However, when you safe the model you can load it and use it for predictions. The git contains several examples how to load the models. For example, see the RunModel_CoNLL_Format.py

If you would like to have the predictions during training, you would need to modify the BiLSTM.fit function.

from emnlp2017-bilstm-cnn-crf.

So i need the function to write the predictions made for dev and test set for each epoch written to the respective files. Only BiLSTM.fit needs to be changed for that?

from emnlp2017-bilstm-cnn-crf.

Yes. BiLSTM.fit predicts the labels for the dev/test set. You just need to add lines so that these predictions (and maybe the gold labels) are stored in a file.

from emnlp2017-bilstm-cnn-crf.