From the course: Apache Spark Essential Training: Big Data Engineering

Driving big data engineering with Apache Spark - Apache Spark Tutorial

From the course: Apache Spark Essential Training: Big Data Engineering

Driving big data engineering with Apache Spark

- [Kumaran] We live in the world of big data. This data needs to be stored, transported, and processed, in scalable and resilient ways to generate timely insights. Apache Spark has become the top data processing technology in the world. In this course, I will show you how to execute data engineering projects with Apache Spark. We will discuss some salient features of Spark that will help in scalable and resilient processing, then walk through the design of batch and real-time pipelines with Spark using examples, and finally, discuss some best practices. My name is Kumaran Ponnambalam. Let's now start solving data engineering problems with Apache Spark.

Contents