From the course: Kafka Essentials: Quick Start for Building Effective Data Pipelines by Pearson
Unlock this course with a free trial
Join today to access over 25,200 courses taught by industry experts.
Topics - Kafka Tutorial
From the course: Kafka Essentials: Quick Start for Building Effective Data Pipelines by Pearson
Topics
This is Lesson 3 of Kafka Essentials, a quick start for building effective data pipelines. In this lesson, I look at a simple Kafka Python application that produces or downloads data from the NOAA weather site, and then consumes the data by loading it into a Pandas DataFrame. The examples are expanded to demonstrate the use of keys and multiple partitions with Kafka. The lesson concludes by developing Python consumers that access data by index or timestamp.