Delta Lake

Meet the Authors of "Delta Lake: The Definitive Guide" at #DataAISummit! 🚀 Don't miss this special book signing event for Delta Lake: The Definitive Guide on Thursday, June 12 from 1:30 - 2:15PM! 📘 Join authors R. Tyler Croy, Scott Haines, Tristen Wentling, Prashanth Babu, and Denny Lee for an exclusive chance to: ✅ Grab a signed copy of the book ✅ Chat with the authors about all things Delta Lake ✅ Connect with the vibrant Delta Lake community 🗓️ Thursday, June 12 ⏰ 1:30 – 2:15 PM 📍Databricks Booth Register for Data+AI Summit! 🔗 https://lnkd.in/dgTb63-s #deltalake #opensource #oss #lakehouse

🚨 Catch this session at the Data+AI Summit! 🚨 Discover how to unlock real-time, scalable data processing by integrating Change Data Feeds (CDFs) into serverless architectures using open-source tools like Delta-rs and Delta-Kernel-rs. Whether you’re working in #Rust or #Python, this session will show you how to stream and process changes with Lakestore’s serverless platform—no Apache Spark required! 🙌 What you’ll learn: ✅ How to leverage Delta tables and CDFs in serverless environments ✅ Seamless integration with Databricks and Unity Catalog ✅ Practical demos with Delta-rs and Delta-Kernel-rs 🎤 Speakers: Oussama Saoudi & Stephen Carman 🗓️ June 9-12 📍 San Francisco 🔗 Save your spot: https://lnkd.in/eDrBERQF #opensource #oss #deltalake #kernel #rust #dataaisummit

Are you ready to explore the future of cross-cloud data sharing? 🚀 At #DataAISummit, catch "Cross-Cloud Data Mesh with Delta Sharing and UniForm in Mercedes-Benz" to see how Mercedes-Benz is using Delta Sharing and UniForm to seamlessly connect data products across AWS and Azure. Learn how unified development, automated pipelines, and transparent cost tracking are empowering teams to deliver data products anywhere, quickly and securely. 🌐⚡️ 🗓️ June 9-12 📍 San Francisco 🔗 Learn more: https://lnkd.in/emt8NUrJ #opensource #oss #deltalake #deltasharing #aws #azure

Join us at Data+AI Summit for a deep-dive AMA exploring how Rust is transforming open table formats like Delta Lake and Apache Iceberg! 🎉 Hear from R. Tyler Croy, Robert Pack, and Denny Lee on how projects like delta-rs and iceberg-rs leverage Rust’s memory safety, zero-cost abstractions, and fearless concurrency to accelerate development and performance at scale. Whether you're a data engineer, Rustacean, or Lakehouse contributor, this is your chance to ask how #Rust is shaping the future of data infrastructure. 📅 June 9–12 📍 San Francisco 🔗 REGISTER: https://lnkd.in/dgTb63-s #DeltaLake #RustLang #ApacheIceberg #OpenTableFormats #DataEngineering #DataAISummit

The future of open table formats is being written now! Are you part of the conversation? 🤔 Open standards like Delta Lake and Apache Iceberg™ are redefining how data teams build scalable, interoperable, and open data architectures. At Data + AI Summit, don’t miss co-creators of Iceberg Ryan Blue and Daniel Weeks as they take the stage to explore: ✅ The latest innovations in open table formats ✅ How Delta Lake and Iceberg are evolving ✅ What’s driving format innovation across the ecosystem 📅 June 9–12 📍 San Francisco 🎟️ Register today: https://lnkd.in/dgTb63-s P.S. Get 50% off your Data+AI Summit ticket now through Monday, June 2! Comment "Delta Lake" below and we’ll send the code directly to your inbox. 📧 #opensource #oss #deltalake #apacheiceberg #dataaisummit

At #DataAISummit, join Scott Sandre (Databricks) for a deep dive into how Delta Lake is redesigning its #Spark connector by combining three key technologies: 1️⃣ Upgrading Spark APIs to DSv2 for deeper catalog integration and improved Spark optimizer support 2️⃣ Integrating fully with Delta Kernel to simplify Delta protocol complexities, accelerate feature adoption, and improve maintainability 3️⃣ Transforming Delta Lake with Catalog Commits to create a truly catalog-aware lakehouse format, enabling efficient metadata management, governance, and enhanced query performance Discover how these innovations are advancing Delta Lake’s architecture, pushing the boundaries of metadata management, and building a more intelligent, performant data #lakehouse platform. 🗓️ June 9-12 📍 San Francisco 🔗 REGISTER: https://lnkd.in/dgTb63-s #opensource #deltalake #oss

#DataAISummit Spotlight: Celebrating Five Years of delta-rs 🚀 This year marks a major milestone - five years since the launch of delta-rs, the Rust and Python implementation of Delta Lake. Originally built to bring Delta Lake’s reliability, performance, and open standards beyond the JVM, delta-rs has grown into a core part of the #opendata ecosystem. We'll dive into: 🛠️ How delta-rs evolved with the Rust data landscape - adapting to new requirements and a growing contributor base. 🤝 Lessons from maintaining a complex open source system, and how collaboration with the Rust and Delta Lake communities has shaped its direction. 🌱 Key moments from the journey so far, community contributions, and a look ahead at what’s next for Delta Lake in Rust and Python. 🗓️ June 9-12 📍 San Francisco 🔗 REGISTER: https://lnkd.in/dgTb63-s #opensource #oss #deltalake #rust #python

🌟 Session Spotlight: Delta Kernel for Rust and Java Join us at #DataAISummit to see how Delta Kernel makes it easy to read and write Delta tables - supporting robust integrations with DuckDB, ClickHouse, Spice AI, delta-dotnet, and more. 🚀 What you’ll learn: ✅ Lessons from building a high-performance, flexible library ✅ How our streamlined API lets you focus on innovation, not protocol complexity ✅ Exciting new features: write support and CDF scans ✅ The future roadmap for Delta Kernel and how you can get involved 🗓️ June 9-12 📍 San Francisco 🎟️ REGISTER: https://lnkd.in/dgTb63-s 🔥 Deal extended! Get 50% off your Data+AI Summit ticket—now through Monday, June 2. Comment "Delta Lake" below and we’ll send the code directly to your inbox. 📧 #opensource #oss #dataaisummit #deltalake

The countdown to #DataAISummit is on! ⌛ Here’s a session you won’t want to miss. Explore how powerful features like Time Travel, Column Mapping, Deletion Vectors, Liquid Clustering, UniForm interoperability, and Change Data Feed (CDF) can transform your data architecture, boost performance, and simplify management across the lakehouse. 🎤 Speaker: Youssef Mrini (Databricks) 🗓️ June 9-12 📍 San Francisco 🔗 Secure your spot: https://lnkd.in/dgTb63-s 🌟 Delta Lake community bonus: Want to save 50% on your DAIS ticket? Drop a comment below and we’ll DM you the code. 👇 Offer ends Sunday, May 25. #opensource #oss #linuxfoundation #deltalake

Git for Delta: Git-Like Branching Meets ACID Guarantees with LakeFS & Delta Lake 🤝 Discover how lakeFS and #DeltaLake bring Git-style version control, branching, and CI/CD to your data lakes-unlocking new levels of reliability and collaboration! Join our live session to discover how lakeFS and #DeltaLake together enable: 🔹 Concurrent Writes: Delta Lake’s optimistic concurrency control keeps data consistent, while lakeFS adds isolation and safe merging, so teams can collaborate without risk of data corruption or conflicts 🔹 Isolated Experimentation: Instantly branch your entire data lake-including Delta tables-for safe, parallel development and testing, without copying data 🔹 Automated Data Quality & CI/CD: Integrate hooks to validate Delta table contents, schema, and referential integrity before merging changes, ensuring only high-quality data reaches production. 🔹 Effortless Rollback & Reproducibility: Restore or reproduce any data state with commit history, supporting robust troubleshooting and #ML experiment reproducibility. 🗓️ Wednesday, May 21 🕗 9:00AM PT / 7:00PM EET 🔗 REGISTER 👉 https://lu.ma/gitfordelta Speakers: Ion Koutsouris (Delta Maintainer) & Robert Pack (Databricks) #opensource #git #deltalake #lakefs #rust