From the course: NVIDIA Certified Associate AI Infrastructure and Operations (NCA-AIIO) Cert Prep

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

DGX platform

DGX platform - NVIDIA Tutorial

From the course: NVIDIA Certified Associate AI Infrastructure and Operations (NCA-AIIO) Cert Prep

Start my 1-month free trial Buy for my team

DGX platform

“

The core of any data center powered by NVIDIA technologies is DGX platform. I am giving you example here of DGX-A100 system. We'll discuss more of DGX system in coming section. So DGX is a platform. It is a data center AI system designed for training inferences and analytics. It has 8 NVIDIA GPUs with high-speed interconnects. This is how the server looks like. like. Obviously, this is a very big size server and here what we see are these eight NVIDIA A100 GPUs in it. These are all the GPUs. This is a cooling mechanism on top of it. Then it is accompanied by 15 terabyte of NVMe SSD. Then there is NVSwitch which is used for communication. We will talk about that. So this platform or these servers or nodes allow you to build a data center where you can run your AI ML workload. Primary use case for this is to run your natural language processing, computer vision, or speech application. You can use them to run AI inferences at scale. If you are running any high-performance computing…

Contents