From the course: Oracle Cloud Infrastructure AI Foundations Cert Prep
Join today to access over 25,300 courses taught by industry experts.
Introduction to large language models - Oracle Cloud Infrastructure Tutorial
From the course: Oracle Cloud Infrastructure AI Foundations Cert Prep
Introduction to large language models
(gentle music) - [Rohit] Hello and welcome. In the previous lesson, we looked at generative AI. In this lesson, let us look at large language models. A language model is a probabilistic model of text that determines the probability of a given sequence of words occurring in a sentence based on the previous words. It helps to predict which word is more likely to appear next in the sentence. So what does that mean? Let us say we have this particular sentence, "I wrote to the zoo to send me a pet. They sent me," and a blank here. This is taken from the opening of a children's book. What a language model will do is to compute a probability distribution over a vocabulary. That means that the language model knows about a set of words that should appear here. So that is what I mean by vocabulary. And the vocabulary will include words like lion, elephant, dog, cat, panther, basically all the words which could appear in this blank here. And language model is giving a probability to every word…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.