From the course: Problem-Solving Strategies for Data Engineers
Join today to access over 25,300 courses taught by industry experts.
How to improve processes
From the course: Problem-Solving Strategies for Data Engineers
How to improve processes
- When I was talking in the beginning about the phases of data projects, I was talking about that this is a cycle basically. That once everything is done, we're going to start improving everything and we're going to start again with the design. Now, what are we going to improve? That is actually a question that a lot of people have. They don't know what to improve, and it's a bit more than just the performance. Of course, performance is the first thing that you think of, "Okay, if we're going to improve something, let's improve the performance." But a big thing is automation. Improving the automation of the whole pipeline, improving the automation of processes, where maybe there was a manual step at some point, remove that manual step and automate everything. This way, it's the most efficient for your pipeline, and that's a big improvement. It's most likely a bigger improvement than improving a part of the pipeline…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.