End-to-end real-time data pipeline using Kafka, Spark, Delta Lake, DuckDB, and Power BI. Simulates clickstream analytics with batch + streaming workflows for modern data engineering.
python data sql kafka spark azure data-engineering data-analytics powerbi real-time-data azure-data-lake azure-eventhub etl-pipeline azure-databricks duckdb azure-synapse azure-data-engineering
-
Updated
Sep 18, 2025 - Python