From the course: GenAIOps Foundations

Unlock this course with a free trial

Join today to access over 25,600 courses taught by industry experts.

The generative AI application stack

The generative AI application stack

From the course: GenAIOps Foundations

The generative AI application stack

- [Instructor] Once a GenAI model is finalized, we need to build an application stack around it to provide services to the users. In this chapter, we will focus on key development aspects when building GenAI applications. A GenAI application contains several components. It has both ML and non-ML components. It also has data. These components need to work together to provide the required service. Let's discuss the key components of a reference GenAI stack. First, we have the non-ML components, namely the business application stack. It has user interfaces for users to interact with. It has backend business logic that enforces business requirements. There can be APIs that allow applications to interact with the service. There can be data stores that store business data. Then comes the AI/ML components. Here we have the GenAI models we decided on in the previous chapter. There can be other classical models too. Then there is the hardware infrastructure, like GPUs, that are needed to run…

Contents