Large Language Models on AWS: Building and Deploying Open-Source LLMs
With Noah Gift and Pragmatic AI Labs
Liked by 16 users
Duration: 35m
Skill level: Intermediate
Released: 1/16/2025
Course details
In this course, MLOps expert Noah Gift highlights the world of open-source Large Language Models (LLMs) on AWS. Learn about essential toolchains, including how to optimize and compile LLMs such as llama.cpp. Discover the implications of Amdahl's law for your computational tasks and see practical demonstrations using the GGUF file format. Find out about Python UV scripting and packaging to maximize the functionality and efficiency of your models. Understand key concepts in llama.cpp through detailed walkthroughs and see end-to-end demos of quantized models on AWS G5 instances. Gain practical knowledge and hands-on experience that can directly apply to your projects. By the end of the course, you will be able to effectively utilize and optimize open-source LLMs on AWS, making your AI applications more efficient and powerful.
This course was created by Pragmatic AI Labs LLC. We are pleased to host this training in our library.
Skills you’ll gain
Earn a sharable certificate
Share what you’ve learned, and be a standout professional in your desired industry with a certificate showcasing your knowledge gained from the course.
-
Showcase on your LinkedIn profile under “Licenses and Certificate” section
-
Download or print out as PDF to share with others
-
Share as image online to demonstrate your skill
Meet the instructors
Learner reviews
Contents
What’s included
- Learn on the go Access on tablet and phone
Similar courses
Download courses
Use your iOS or Android LinkedIn Learning app, and watch courses on your mobile device without an internet connection.