From the course: Claude with Amazon Bedrock by Anthropic
Unlock this course with a free trial
Join today to access over 25,300 courses taught by industry experts.
A typical eval workflow
From the course: Claude with Amazon Bedrock by Anthropic
A typical eval workflow
In this video we're going to walk through all these steps implemented by a typical prompt evaluation workflow. Before you go through any of these steps however I just want you to understand two important things. First is there are many different ways you can assemble a workflow. There's no one set methodology set in stone that is standard across the industry. The second thing to understand is that there are many different open source packages and even paid options online that will help you implement your own workflows. Now in this video and this module we're going to start to implement our own custom workflow from scratch inside of a Jupyter Notebook. The reason we're doing this is to of course just help you understand how these workflows behave but also to help you understand that you don't have to get a really heavyweight solution to do prompt evals. You can start small just to get started and get a sense of how everything works and then scale up from there. Alright so let's get to…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.