A data framework for biology. Makes your data queryable, traceable, reproducible, and FAIR. One API: lakehouse, lineage, feature store, ontologies, LIMS, ELN.
-
Updated
Nov 2, 2025 - Python
#
data-lakehouse
Here are 14 public repositories matching this topic...
Data Engine for Manual/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.
streaming data-storage pandas algo-trading historical-data data-pipeline backtesting delta-lake data-lakehouse polars
-
Updated
Sep 14, 2025 - Python
The project aims to process Formula 1 racing data, create an automated data pipeline, and make the data available for presentation and analysis purposes.
-
Updated
Jan 10, 2024 - Python
Complete open-source data platform with Airbyte, Dremio, dbt, and Apache Superset - Documented in 18 languages
-
Updated
Oct 19, 2025 - Python
This project implements an end-to-end techstack for a data platform, for local development.
-
Updated
Sep 22, 2025 - Python
🚀 Scalable near-real-time data pipeline using Apache Iceberg, Spark, Kafka, and Trino. ACID-compliant JSON ingestion, processing, and analytics. Dockerized for easy deployment. #DataEngineering #DataLake
-
Updated
Apr 16, 2025 - Python
Инфраструктура для data engineer S3
tutorial docker-compose tutorials data-engineering data-lake tutorial-code habr data-lakehouse data-engineering-project
-
Updated
Aug 15, 2024 - Python
STEDI project
-
Updated
Nov 11, 2024 - Python
This project is my graduation project of Bachelor degree at HUST. It's about mini data lakehouse. Just got an A on it.
-
Updated
Jul 22, 2025 - Python
Diploma thesis for ECE NTUA in the course 3189 Advanced Topics in Database Systems under the supervision of Prof. Dimitrios Tsoumakos.
-
Updated
Aug 22, 2025 - Python
Canalización desde MongoDB hacia un Data Lake de Amazon S3, creación de Data Warehouse en Amazon Redshift y visualización en Tableau.
-
Updated
Apr 24, 2024 - Python
Real‑time streaming lakehouse stack: Kafka produces JSON events that Kafka Connect (Iceberg Sink) writes transactionally into Apache Iceberg tables versioned by Nessie, stored in MinIO (S3 compatible), and queried with Trino. Includes automatic schema evolution (additive), table bootstrap, and a Python data simulator.
minio kafka-connect apache-kafka schema-evolution trino apache-iceberg nessie data-lakehouse streaming-data-real-time-analytics
-
Updated
Sep 14, 2025 - Python
This project originated from my graduation thesis. It will be refactored, properly formatted, and enhanced with additional functionalities to evolve into a fully developed big data system.
-
Updated
Jul 30, 2025 - Python
DLH about NASA exoplanets
-
Updated
May 30, 2025 - Python
Improve this page
Add a description, image, and links to the data-lakehouse topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-lakehouse topic, visit your repo's landing page and select "manage topics."