Bootstrapping issue: No clear path to reproduce results about keras-language-modeling HOT 7 OPEN

I went ahead and added the word embeddings I've been using to Github

from keras-language-modeling.

Did you download the dataset from here? I'm not sure which resource it could be. Could you reproduce the error message?

Yep, the word2vec_100_dim.h5 was the output of using Gensim's Word2Vec model merged with the result of training a 100-dimension EmbeddingModel. I haven't formalized this yet, mostly I've been trying out different word embeddings to see what works. I think once something works well I will put the weight file on Github for general use.

I'd appreciate it if you wanted to open a PR for a stand-alone script. Let me know if you have more questions.

from keras-language-modeling.

Which word2vec output you are considering here ?
When we save gensim word2vec model we get typically following files -
outfilename, outfilename.syn1neg, outfilename.syn0.np, outfilename.syn1.np

Which one maps to ".h5" you mentioned above or word2vec_100_dim.embeddings you uploaded ?
Also couldn't see "word_embeddings.py" where you might have written something related to this.

from keras-language-modeling.

syn0 is the equivalent of the Keras embedding layer I believe, that's what I've been using. It's really these lines:

weights = np.load('word2vec_100_dim.embeddings')
language_model = model.prediction_model.layers[2]
language_model.layers[2].set_weights([weights])

from keras-language-modeling.

@codekansas Yes, I did have the insurance_qa_python repo cloned and had all the data_paths set properly.

Thanks for adding those .h5 entries. I'll take a look shortly and let you know if everything's working for me.

from keras-language-modeling.

Hi, do you mean outfilename.syn0.np = word2vec_100_dim.embeddings?

from keras-language-modeling.

It might be different depending on your version

from keras-language-modeling.