From the course: Rust for Data Engineering
Unlock this course with a free trial
Join today to access over 25,300 courses taught by industry experts.
Doing fine-tuning - Rust Tutorial
From the course: Rust for Data Engineering
Doing fine-tuning
- [Instructor] Let's go ahead and take a look at the official Hugging Face Documentation here, and take a look at this course. You can see there's lots of different useful things in this course, but I want to take a look at the Fine-Tuning Section here, Fine-Tuning a Pre-Trained Model, and take a look at how I could actually implement that myself. So I'm going to go ahead and select this button here. And one of the nice things about this course, is it opens up a Colab Notebook, and it gives us a nice overview of the sections as well. So we can see here, it's not a lot of code here, it's just a section here that installs some software. It then goes through and has a Tokenized Function. It then has a Trainer, which goes right here. And then we go ahead and we do a train, and it will actually do the Fine-Tune Operation and then show us exactly what's happening. Now, if I wanted to run this myself and get, you know, better and…
Contents
-
-
-
-
-
-
-
-
-
-
-
-
Introduction to Hugging Face Hub5m 9s
-
(Locked)
Rust PyTorch pre-trained model ecosystem3m 39s
-
(Locked)
Rust GPU Hugging Face translator6m 14s
-
(Locked)
Rust PyTorch high-performance options7m 52s
-
(Locked)
EFS ONNX Rust inference with AWS Lambda9m 38s
-
(Locked)
Theory behind model fine-tuning2m 54s
-
(Locked)
Doing fine-tuning8m 9s
-
-