From the course: Rust LLMOps

Overview - Rust Tutorial

From the course: Rust LLMOps

Start my 1-month free trial Buy for my team

Overview

“

- Hi, my name is Noah Gift, and I'm your instructor for this course. I'm an executive in residence at Duke, and this course is an exciting course because it covers some of the most cutting-edge things happening in the large language model space. First up, we dive into some of the concepts around DevOps that lead into LLMOps. Second up, we cover Rust Hugging Face Candle, which is a great way to integrate some of the things that you're doing in terms of a model so that you can deploy it into a cloud offering and run inference. We also dive into key LLMOps technologies, including Rust Bert, Rust PyTorch, and also ONNX. And these are emerging standards to build things with large language models. And then finally, at the very end, we get into generative AI, including using tools like AWS CodeWhisperer, Google Bard, and really dive into what are the different things that you can do with generative AI and how do they really bubble back up to LLMOps. All right, we've got a lot to cover, I hope to see you through the end of the course.

Contents