Harshil Vyas’ Post

View profile for Harshil Vyas

Anyscale3K followers

"Every engineer is a Data/ML Engineer... if the Infra is right!" 🚀 Srikanth Sundarrajan's opening slide was a mic-drop moment that had every Platform and Infra engineer in the room (including me!) nodding in agreement. It perfectly captures our own (Anyscale) core mission: to build infrastructure so seamless it empowers everyone to innovate with data, AI & ML. InMobi's Encore'25 provided a fantastic look under the hood of their AI/ML infrastructure. For anyone obsessed with building and scaling machine learning systems, this was gold. Three things that stood out: Cost-Effective Model Training: Deep dive into their strategies for optimizing large-scale training jobs, intelligently leveraging spot instances and right-sizing resources without compromising on model development velocity. Real-Time Feature Stores: A key focus was their approach to building and maintaining a feature store that serves up-to-date data with single-digit millisecond latency, which is critical for their real-time bidding (RTB) models. The Rise of GenAI Infra: It was exciting to hear about their early infrastructure bets for supporting Generative AI and LLMs, particularly for dynamic creative optimization. This signals a major shift in the computational demands for the next generation of AdTech. Kudos to the InMobi engineering teams for their transparency and for building a truly impressive, high-performance ML platform. #AI #ML #Infrastructure #Encore25 #InMobi #MLOps #FeatureStore #GenAI #CloudComputing #AdTech

  • No alternative text description for this image
Jeya G

own91 followers

6mo

mic-drop moment that had every Platform and Infra engineer in the room (including me!) nodding in agreement. 1)any one asked what for infra & why need infra 2) need to differentiate between Bare pain with barefoot. Need to guide a management as a common man common sense in the society

Like
Reply
Aditya Sharma

Chronexa6 followers

6mo

Awesome to see companies prioritizing the engineering fundamentals needed to build truly scalable AI systems. This is where the real innovation happens

Like
Reply
Piyush M Agarwal

LTI - Larsen & Toubro Infotech1K followers

6mo

when the pipes are right, every engineer goes from data‑plumber to model‑runner.. infra makes the diff‑RAy‑ence. 👍

TM Narasimhan

Proficient Solutions381 followers

6mo

Way to go Srikanth! Best Wishes for Continued Success!

Like
Reply
See more comments

To view or add a comment, sign in

Explore content categories