From the course: Claude with Amazon Bedrock by Anthropic

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

Temperature

Temperature

From the course: Claude with Amazon Bedrock by Anthropic

Start my 1-month free trial Buy for my team

Temperature

“

Earlier on inside this course, we spoke very briefly about how Claude actually generates text. Remember, we feed some amount of text into Claude, like the words what do you think. Claude is then going to tokenize this text or break it up into smaller chunks. Claude is then going to go through a prediction phase where it decides what possible words could come next and assign a probability to each of those different options. Finally, in the sampling phase, a token is actually chosen based upon these probabilities. So, in this diagram I have on the screen, given inputs of what do you think possible next tokens might be about, would, of, and so on. Everything you see here on the right hand side. Each of these gets assigned a probability. And then maybe in this case, Claude settles on about as being the best possible next token. So we would end up with the phrase, what do you think about? This entire process is then repeated to complete the sentence or complete the entire message. Now just…

Contents