From the course: NVIDIA Certified Associate AI Infrastructure and Operations (NCA-AIIO) Cert Prep

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

Cloud vs. on-prem

Cloud vs. on-prem

An obvious debate you may have, whether I should host applications in my on-prem data center or should I leverage Cloud? What is the advantage of one over the other? We are not saying that Cloud is better or on-prem is better. It depends on what is your purpose. Let's talk about advantage of both. That can also be important for your exam perspective. Cloud versus on-prem, GPU infrastructure, what are the key advantages? Obviously, Cloud gives you the scale you are looking for. On-prem gives you the security. Let's talk about the aspect which we have. Key advantage of Cloud infrastructure is low cost barrier to entry. You want to perform a model training. You don't want to buy all the hardware. Go ahead in Cloud, deploy the nodes you need and pay only for the time you have used. Afterward, decommission it, bring your model back into On-prem and start it running there. Cloud infrastructure is having very low cost of entry. You don't have to own a data center and buy space, and get…

Contents