Constructing a Python consumer using keys, offsets, and time windows - Kafka Tutorial

Contents

• Introduction Introduction

  • Course welcome

    3m 31s
• 1. Kafka Background Concepts 1. Kafka Background Concepts

  • Topics

    29s
  • Why do I need a message broker?

    10m 53s
  • Understanding Kafka components

    22m 33s
  • Running Kafka on the LHM virtual machine

    22m 36s
  • Understanding basic Kafka usage

    35m 23s
• 2. Viewing Kafka Operations 2. Viewing Kafka Operations

  • (Locked)
    Topics

    25s
  • (Locked)
    Exploring the KafkaEsque UI features

    16m
  • (Locked)
    Replaying basic examples with KafkaEsque

    14m 1s
• 3. Streaming NOAA Weather Data with Kafka Python 3. Streaming NOAA Weather Data with Kafka Python

  • (Locked)
    Topics

    41s
  • (Locked)
    Understanding basic Kafka Python producers and consumers

    21m 20s
  • (Locked)
    Constructing a Python producer using keys and multiple partitions

    17m 7s
  • (Locked)
    Constructing a Python consumer using keys, offsets, and time windows

    25m 40s
• 4. Moving Kafka Topic Data to External Storage 4. Moving Kafka Topic Data to External Storage

  • (Locked)
    Topics

    21s
  • (Locked)
    Using a PySpark consumer to stream data to HDFS

    28m 49s
  • (Locked)
    Using a Python consumer to write data to MariaDB (MySQL)

    16m 37s
  • (Locked)
    Using a Python consumer to write data to HBASE

    25m 58s
• 5. Edge Image Streaming with Kafka Python 5. Edge Image Streaming with Kafka Python

  • (Locked)
    Topics

    29s
  • (Locked)
    Detecting edge 3D-printing problems

    19m 25s
  • (Locked)
    Understanding image capture, streaming, and real-time CNN analysis using Kafka producers and consumers

    22m
  • (Locked)
    Emulating an edge 3D-printing streaming example on the LHM virtual machine

    10m 16s
• 6. Data Pipelines and Kafka Connect 6. Data Pipelines and Kafka Connect

  • (Locked)
    Topics

    28s
  • (Locked)
    Understanding Kafka Connect design and use cases

    7m 32s
  • (Locked)
    How to manage Kafka connectors

    22m 38s
  • (Locked)
    Kafka Connect examples using files, HDFS, and MariaDB (MySQL)

    37m 9s
• 7. Installation Considerations 7. Installation Considerations

  • (Locked)
    Topics

    21s
  • (Locked)
    Installing Zookeeper and Kafka

    8m 29s
  • (Locked)
    Understanding hardware choices

    7m
  • (Locked)
    Creating a Kafka cluster

    31m 40s
  • (Locked)
    Configuring partitions

    24m 52s
• 8. Basic Administration Topics 8. Basic Administration Topics

  • (Locked)
    Topics

    22s
  • (Locked)
    Understanding partition allocation and management

    7m 34s
  • (Locked)
    Understanding file management and compaction

    10m 33s
  • (Locked)
    Learning Kafka topic operations

    10m 10s
  • (Locked)
    Using Kafka console consumer and producer tools

    21m 32s
• Conclusion Conclusion

  • (Locked)
    Summary and next steps

    1m 56s