y-sui / lmprobing Goto Github PK
View Code? Open in Web Editor NEWGiven an encoder model (e.g., BERT) pre-trained on a certain task, we use the representations it produces to trian a classifier (without further fine-tuning the model) to predict a linguistic property of the input text.