From the course: Data Quality: Core Concepts

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

Thought exercise: Map your data lifecycle

Thought exercise: Map your data lifecycle

From the course: Data Quality: Core Concepts

Start my 1-month free trial Buy for my team

Thought exercise: Map your data lifecycle

“

- [Instructor] The second step is to map your data lifecycle. Now, if you're not super technical, don't worry, we won't dive too deep into this. It's just more so to show you a high level of how data represents the business model. So for Sell Things Inc, their goal is to have a marketplace that they can sell items on and that vendors can be on. In this architecture diagram, you have your website, which is the e-commerce platform, and then you have various microservices. So you have the shopping cart, you have search, you have the homepage. Those have a set events that go through a message broker that's replicated into a data lake, and that data lake serves as a source where all this data can be combined, such as third party data from Salesforce, which includes vendor information. That data is then funneled into ML models to give predictions that are funneled back into search and the homepage to give predictions. So if you've ever been on any marketplace and they give recommended…

Contents