Next word prediction, also referred as Language Modelling, is the process of predicting what word or multiple words come next in an application involving the basic task of typing.

We have been gradually accustomed to our mobile keyboards predicting the next word without even realizing it. Nowadays, emails and text based applications provides users with the ability to integrate this option directly.

Next word prediction is an application that uses transformers models to predict next word or a masked word in a sentence.