CUDA out of memory. What can I do to improve model performance? about bert-toxic-comments-multilabel HOT 3 OPEN

Are you using the BERT-large or BERT-base model type? With BERT-base, you should get very good results with a seq len of 256 and batch size of 16 (I did, anyway...).

Google's recommended seq/batch combos are at https://github.com/google-research/bert#out-of-memory-issues .

from bert-toxic-comments-multilabel.

I am using BERT-large uncased. Did you get your results after only 4 epochs?

from bert-toxic-comments-multilabel.

@tombriles I changed the model from large to base (uncased), and now a max seq len of 256 doesn't cause the out of memory error (it did before when I used the large model). I will report back on the performance once training is done!

from bert-toxic-comments-multilabel.