Start typing a message on your phone and the keyboard offers the next word. Type “The cat sat on the” and it may offer “mat”. A language model is a much bigger version of that idea.

A language model is a function. You give it a piece of text, and it returns one number for every entry in its vocabulary: the probability that this entry comes next. The probabilities are all between 0 and 1 and add up to 1.