Example end to end data engineering project.
-
Updated
Dec 8, 2022 - Python
Example end to end data engineering project.
Code for "Efficient Data Processing in Spark" Course
Ready to run docker-compose configuration for ML Flow with Mysql and Minio S3
Sample project to demonstrate data engineering best practices
Minio Backend for Django
Nyc_Taxi_Data_Pipeline - DE Project
Unified cloud storage API for storage services.
A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
Ansible role for installing and configuring Minio
Full stack data engineering tools and infrastructure set-up
Arquitetura CRM de Baixo Custo com Gen AI, projetada para startups que precisam processar e analisar dados de vendas de forma eficiente.
Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.
A proof-of-concept FastAPI-based service for sending emails via SMTP. Supports plain text and HTML emails, with or without attachments. Includes validation, error handling and Swagger UI documentation. Ideal for educational purposes and demonstrations.
Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.
Add a description, image, and links to the minio topic page so that developers can more easily learn about it.
To associate your repository with the minio topic, visit your repo's landing page and select "manage topics."