Ankit Kailaswar

Take Trino performance to the next level with robust data connectivity. Simba from insightsoftware provides ODBC & JDBC drivers that empower Trino to handle massive datasets with speed, efficiency, and reliability. Learn how strategic optimizations like load balancing and reduced query latency can unlock high-speed analytics across databases, data lakes, and cloud platforms. 🤝 👉 Read the full blog now to explore how Simba makes it possible: https://bit.ly/41l3t1U #BusinessIntelligence #Integration #Automation #ProcessAutomation #DataMigration #Trino

18

[Demo] See how Databricks makes Scala development faster and simpler with Serverless JAR Tasks and the Beta of Serverless Scala Databricks Connect. This end-to-end demo walks through building, deploying, and running JAR jobs on Serverless compute using Databricks Asset Bundles, with 5 to 10 second startup times, structured streaming support, and no infrastructure to manage: https://lnkd.in/g7uqRFPD

137

10 Comments

Delivering AI-ready data is harder than ever — too many tools, manual code, and pipelines that don’t scale. Join Databricks’ Bilal Aslam and Simon Whiteley, CTO at Advancing Analytics, to see how a unified, declarative platform helps you: - Replace repetitive code with tested pipelines - Support batch, streaming, and unstructured data - Monitor pipeline health with built-in quality checks, schema evolution, and error handling You’ll leave with a clear plan to simplify your stack, scale your workflows, and deliver reliable data for AI: https://lnkd.in/g2U4gW9h

206

5 Comments

Data engineers—rigid pipelines holding you back? 😫 It’s time to build smarter. Snowflake Openflow, powered by Apache NiFi, gives you open, extensible, and secure data integration—designed for AI, scale, and real-time data movement. Deploy with Snowpark Container Services or BYOC in your VPC. Unify structured, unstructured, batch, and streaming data—all in one interoperable platform. 🔍 Join our deep dive into Openflow’s architecture and see how it makes your pipelines AI-ready: https://bit.ly/3HgQG9w

155

1 Comment

⭐ 3 Ways to Get More from Your Databricks Investment with Data Cloud 🚀 Did you know that Zero Copy integration lets you bring your Databricks data into Data Cloud without moving it? That means you experience no duplication, no delays — to power real-time customer profiles, trigger automations, and personalize interactions. 👇 Here are 3 ways to use all that data power to get the best bang for your buck: ✅ Trigger Predictive Sales and Service: Use AI-trained models from Databricks to identify customers who need support and those who are most likely to convert or churn using AI-trained models from Databricks. Then proactively engage with them through Salesforce flows. ✅ Personalize Marketing Journeys: Employ advanced data science in Databricks to segment your audience and activate those segments in Salesforce Marketing Cloud to deliver tailored experiences. ✅ Unlock AI-Powered Case Routing: Use Databricks-built models in Service Cloud to classify and route support cases based on sentiment, product line, or customer value. 🚀 Learn how to bring intelligent activation to Databricks and make the most of all your data investments: https://lnkd.in/evG6VamW #Salesforce #Innovation

97

2 Comments

📣 New Blog Alert! 📣 Ever wished your data infrastructure could just manage itself? With Databricks Serverless, it practically does. Say goodbye to scaling headaches, costly idle time, and the complexity of managing clusters. Want to know how it works and what it could mean for your workflows? Mo Uddin dives deep into the ins and outs of Serverless in our latest blog! Want to know more? Read the blog now 👇 https://hubs.la/Q037MQGF0 #DataAnalytics #DataEngineering #Databricks #BigData

17

Build and deploy a complete machine learning workflow entirely within Snowflake ML! Our new solution guide walks you through an end-to-end ML lifecycle. You'll learn to define and manage features with Snowflake Feature Store, train and optimize models using Snowflake ML APIs for hyperparameter optimization, manage versioning and lifecycle with Snowflake Model Registry, and track performance and drift with integrated ML Observability. This guide demonstrates how to build, deploy, serve, and monitor models in production with seamlessly integrated MLOps features, all on Snowflake. Explore the solution and streamline your ML workflows: https://lnkd.in/g92t2Qcq

442

6 Comments

Airflow is the backbone of many data engineering teams, powering pipelines that transform raw data into valuable products. But how do you ensure it scales with your needs? In this episode, Savin Goyal at Outerbounds shares how data engineers use Airflow to build reliable workflows and why orchestration plays a critical role in managing large-scale data operations. We discuss best practices for optimizing Airflow, integrating it with ML workflows and maintaining efficiency as data demands grow. Listen to the conversation at the link in the comments. #AI #Automation #Airflow #MachineLearning

27

1 Comment

Databricks isn’t the problem. The missing orchestration layer is. Even with millions invested, too many teams end up with: 😱 Endless engineering backlogs 😱 Fragile, inconsistent pipelines 😱 Stakeholders shut out of the process The result? Zero trust. Zero impact. In our free whitepaper, we break down the 5-step action plan to turn Databricks into real business value. Link in the comments ⬇️

26

2 Comments

📁 Your NAS (Network-Attached Storage) holds your most valuable...and most ignored data. But legacy tools can’t keep up. BigID changes the game with: ⚡ Automatic folder discovery (no manual mapping) 🔎 Deep scans across legacy formats & hidden PII 💥 One platform for DSPM, DAG, DAM, and more Take control of your NAS data at scale: https://bit.ly/4kmzmOb

14

Did you know 7plus grew its average daily active users by more than 30% in 2024-25? Partnering with Databricks, Seven’s AI Factory is not about flashy demos or novelty chatbots but is solving three critical issues: predicting audience behaviour with precision, re-engaging dormant viewers, and democratising data across the business. The best news... it’s working! 7plus’ growth is outpacing the broader Australian streaming market by 10 percentage points. Find out more from Seven West Media's Director, Data and Growth, Andrew Brain, via Mediaweek Australia. https://lnkd.in/gf6-WfCT

122

3 Comments

Your Snowflake data warehouse is only as good as your data model. Snowflake offers flexibility — but that also means more responsibility. Without a solid schema strategy, even powerful compute won’t save a poor design. Here are 4 key best practices on modeling data in Snowflake. Check out our latest guide on everything you need to know about data warehousing with Snowflake: https://lnkd.in/dQ4pkuPH #DataModeling #DataWarehouse #Snowflake #DataEngineering #DatabaseSchema

9

Your AI agents can now talk directly to your data platform 🤖 We just shipped Dagster's Model Context Protocol (MCP) server. Now, Claude can read your pipeline definitions, check asset health, and debug failures in real time. No more copy-pasting error logs or explaining context - your AI assistant already understands your data architecture. When your orchestrator treats data as a first-class citizen, integrations like this just work. Read how we built it, link in the comments!

91

11 Comments

🔥 NEW BENCHMARK: Streaming 14.5 GB/s to Snowflake with 7.5 second P99 latency When you’re monitoring fast-moving markets or running critical analytics, every second matters. ⏳ Redpandas have a need for speed, so we ran tests to get the highest-throughput, lowest-latency #streamingdata pipeline using Redpanda Connect and #Snowflake for near real-time #analytics. The results? 🤘 3.8 billion messages streamed at 14.5 GB/s to a single Snowflake table with a P50 latency of under 2 seconds, and P99 under 8 seconds — 45% higher throughput than Snowflake's stated limit. Check out how we got there, and how you can do the same👇 https://lnkd.in/gDg7u_ZU

41