NVIDIA NeMo Customizer for Developers

NVIDIA NeMo™ Customizer is a high-performance, scalable microservice that simplifies fine-tuning and alignment of generative AI models for domain-specific use cases. The microservice supports popular customization techniques such as low-rank adaptation (LoRA), p-tuning, and supervised fine-tuning (SFT), with continued integration of the latest customization techniques.

NeMo Customizer, along with the other NeMo microservices, enables developers to create data flywheels that continuously optimize generative AI agents, enhancing the overall experience for end users.

Download NowRead DocumentationVisit Forum


See NVIDIA NeMo Customizer in Action

Learn how NeMo Customizer, along with NeMo Evaluator and NeMo Guardrails, enables developers to build custom AI agents.


How NVIDIA NeMo Customizer Works

NeMo Customizer provides an easy-to-use API that lets you customize generative AI models. Simply provide the dataset, model name, hyperparameters, and type of customization in the API payload. NeMo Customizer will initiate a job to tune the model, resulting in a customized version for you.

The architecture diagram below illustrates the flow for using NeMo Customizer letting you seamlessly launch multiple customization jobs. In the depicted scenario, you can utilize the NVIDIA NeMo Curator to gather high-quality data and NeMo Customizer to create two customization workflows: one for fine-tuning and one for alignment tuning. These outputs, along with NVIDIA NIM™, allow you to deploy a customized model tailored to your specific use case.

 A flowchart of how NVIDIA NeMo Customizer works

Introductory Blog

Read how NeMo Customizer simplifies the alignment and customization of generative AI models.

Tutorials

Explore tutorials designed to help you build custom generative AI models with the NeMo Customizer microservice.

GTC Session

Understand how NeMo Customizer, along with other NeMo microservices, facilitates the customization of generative AI models and supports ongoing performance evaluation, ensuring models remain relevant and effective over time.

Watch Now

How-To Blog

Dive deeper into how NVIDIA NeMo microservices help build data flywheels with a case study and a quick overview of the steps in an end-to-end pipeline.


Ways to Get Started With NVIDIA NeMo Customizer

Use the right tools and technologies to simplify fine-tuning and alignment of large language models (LLMs) for domain-specific use cases.

Develop

Get free access to the NeMo Customizer microservice for research, development, and testing.

Download Now

Deploy

Get a free license to try NVIDIA AI Enterprise in production for 90 days using your existing infrastructure.

Request a 90-Day License


Performance

NeMo Customizer uses several parallelism techniques to reduce the training time for large models with support for multi-GPU and multi-node infrastructure. These methods operate together to enhance the training process, ensuring optimal use of resources and improved training performance.

Experience 1.8x Faster Customization With NeMo Customizer

A chart showing 2x faster customization with NeMo Customizer

The benchmark represents customizing Llama-3-8B on one 8xH100 80G SXM with sequence packing (4096 pack size, 0.9958 packing efficiency).
On: customized with NeMo Customizer.
Off: customized with leading market alternatives.


Starter Kits

Start tuning your generative AI models with NeMo Customizer by accessing tutorials, best practices, and documentation for various use cases.

Customizing LLMs

Get started with popular customization techniques, such as LoRA, SFT, and p-tuning.


NVIDIA NeMo Customizer Learning Library


More Resources

Explore the Community

Get Training and Certification

Meet the Program for Startups

Ethical AI

NVIDIA’s platforms and application frameworks enable developers to build a wide array of AI applications. Consider potential algorithmic bias when choosing or creating the models being deployed. Work with the model’s developer to ensure that it meets the requirements for the relevant industry and use case; that the necessary instruction and documentation are provided to understand error rates, confidence intervals, and results; and that the model is being used under the conditions and in the manner intended.

Get started with NeMo Customizer today.

Download Now