From the course: Making Your AI Results More Predictable
Join today to access over 25,600 courses taught by industry experts.
Language model overview
From the course: Making Your AI Results More Predictable
Language model overview
- [Instructor] If you look up the meaning of language models, you may come across a definition similar to this one, a probability distribution over some text or language. Now what does that mean? To explore this, let's head over to OpenAI's platform where we can experiment with different technologies, and we are going to experiment with completion models. Completion models are now considered legacy and may soon be deprecated, but they do have a feature that's very powerful when it comes to understanding language models, and that is show probabilities. So we're going to select Most likely under Show probabilities, and let's type in, "Learning new things makes me," and I'll limit the amount of tokens to 30, and I'll Submit. Learning new things makes me happy. Now if I click on the completion, I'll see the probabilities, and happy was the most likely token to come up with over 41% chance. Now we see that happy had a 41.8% chance of coming up, after that there is feel, then there's…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.