From the course: Kafka Essentials: Quick Start for Building Effective Data Pipelines by Pearson
Join today to access over 25,200 courses taught by industry experts.
Summary and next steps - Kafka Tutorial
From the course: Kafka Essentials: Quick Start for Building Effective Data Pipelines by Pearson
Summary and next steps
I hope you enjoyed Kafka Essentials, a quick start for building effective data pipelines. These lessons covered the essential topics needed to get started with Apache Kafka. The lessons began with basic concepts and examples that were demonstrated on a freely available Linux virtual machine. We continued with a series of Python examples that demonstrated important aspects of Kafka producers and consumers. Along the way, the Kafka-esque graphical user interface was used to view Kafka operations. A second example of Kafka image streaming was also demonstrated on the virtual machine. Next, we developed PySpark and Python consumers, which were used as a method to save data to external storage. We then turned to the Kafka connector interface as a way to build data pipelines between many popular services. A simple three broker installation recipe that included cluster-wide partition configuration examples was then presented. The final lesson discussed and demonstrated some essential…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.