From the course: Kafka Essentials: Quick Start for Building Effective Data Pipelines by Pearson

Unlock this course with a free trial

Join today to access over 25,200 courses taught by industry experts.

Topics

Topics

This is Lesson 3 of Kafka Essentials, a quick start for building effective data pipelines. In this lesson, I look at a simple Kafka Python application that produces or downloads data from the NOAA weather site, and then consumes the data by loading it into a Pandas DataFrame. The examples are expanded to demonstrate the use of keys and multiple partitions with Kafka. The lesson concludes by developing Python consumers that access data by index or timestamp.

Contents