- language models use [[Deep Learning]] to conduct a [[Probability Distributions|Probability Distribution]] over words used to predict the most likely next word in a sentence - gives the probability of a word sequence being "valid" - "valid" meaning how much it resembles typical human writing https://builtin.com/data-science/beginners-guide-language-models