Serverless in SF 📍
Modal
Software Development
New York City, New York 8,262 followers
The serverless platform for AI, data and ML teams.
About us
Deploy generative AI models, large-scale batch jobs, job queues, and more on Modal's platform. We help data science and machine learning teams accelerate development, reduce costs, and effortlessly scale workloads across thousands of CPUs and GPUs. Our pay-per-use model ensures you're billed only for actual compute time, down to the CPU cycle. No more wasted resources or idle costs—just efficient, scalable computing power when you need it.
- Website
-
https://modal.com
External link for Modal
- Industry
- Software Development
- Company size
- 11-50 employees
- Headquarters
- New York City, New York
- Type
- Privately Held
- Specialties
- Serverless GPUs, LLM Inference, LLM Fine-Tuning, Generative Model Inference, Generative Model Training, Computational Biology, Audio Generation, Image Generation, Video Generation, Web Scraping, Batch Jobs, Batch Embeddings, and Scaling Out
Products
Modal
Platform as a Service (PaaS) Software
Modal is a serverless compute platform that makes it easy for developers to run compute-intensive workloads like ML inference, fine-tuning, and batch jobs. Our proprietary Rust-based container stack is best-in-class, allowing you to run any function in the cloud in less than a second, even on the most in-demand GPU types. We autoscale to thousands of GPUs or CPUs for your functions based on request volume so you can always meet customer demand while never paying for idle resources. Modal's Python SDK allows you to define custom images and hardware requirements in code. No more spending time on config files or cloud consoles. Let your team ship innovative AI products—we'll handle the compute.
Locations
-
Primary
New York City, New York 10038, US
-
Stockholm , SE
-
San Francisco, California 94103, US
Employees at Modal
Updates
-
Eric Zhang teasing a new product we're launching soon... Here's a hint: 📓 Thanks Pensar for having us at your NYC AI demo night!
-
-
Modal reposted this
Modal now supports JavaScript and Go. You can invoke GPU serverless functions, and launch secure VMs for untrusted code, from your Node/Deno/Bun/Go backends. Read more on our blog: https://lnkd.in/erQbqsyy (at Modal)
-
-
One of our most requested features of all time — Modal SDKs for JavaScript and Go. Now available as an alpha preview. Starting today, you can call deployed Modal Functions and create Sandboxes from JavaScript or Go code. Why does this matter? Many companies have their existing infra in one of these languages already, so it’s now much easier for them to use Modal. Just cause you're not a Python shop doesn't mean we're not thinking of you 💚 Much more to come as we work towards feature parity with our Python SDK! Link to full announcements in the comments below.
-
-
⚡ Building real-time, audio/video AI products? Learn how Lemon Slice (YC W24) used Modal, Daily, and Pipecat's super low latency primitives to build their AI-character-video-chat product. Key components of their stack: 1️⃣ They used Pipecat to orchestrate their multimodal AI services. Pipecat is an open-source framework that helps chunk and process data continuously. 2️⃣ To make communication between Pipecat and their video model (both deployed on Modal) as fast as possible, they leveraged Modal Tunnels and region selection. This colocates the services and allows the containers they run in to communicate directly with each other. 3️⃣ They used Daily to stream the generated video and audio to users. Daily’s platform makes it easy to leverage WebRTC, an open framework used for real-time browser communication. Link to the full case study in the comments.
-
-
We're hiring our first Product Marketing Lead at Modal! 🚀 Join us at a pivotal moment as we bring on our first dedicated Product Marketing hire. You'll be shaping our messaging, positioning, and content strategy from the ground up—owning the go-to-market plan that connects with our ideal customer profiles and drives awareness, engagement, and conversion. If you're excited about building from 0 to 1 and making a real impact, we’d love to talk.
-
-
🍋 Our customers are pushing the frontiers of video generation. Real-time video calls with AI characters, powered by a custom video diffusion transformer. Instead of requiring a custom model trained per character, Lemon Slice (YC W24)'s zero shot model only needs a single uploaded image. Congrats to the team!
🍋 Introducing Lemon Slice Live: the world’s first real-time audio-video AI model Anyone can have a video call with any character by just uploading a single photo. Every pixel on the screen is rendered at 25fps in real-time by a transformer model. 🛠️ Here’s how we built it plus a live demo you can try! https://lnkd.in/dM8xVQMz ✨ Today, stream any character. Tomorrow, stream any imaginable universe. 🤝 Thank you to our partners! We use Deepgram as our AI voice partner. Daily to help build a parallel processing pipeline that orchestrates everything via continuously streaming chunks. And Modal as the end-to-end compute platform. We partnered with these folks because they are best in the world at enabling real-time interactions. 🙏 And thank you to our awesome investors for their support: Y Combinator, Matrix, Diana Kimball Berlin, Ilya Sukhar, Alex Pall, Mantis Venture Capital, Jared Friedman, Surbhi Sarna, Nate Smith, Wayne Crosby, Alex Ren, Anne Lee Skates, Yana Welinder, Christina Cacioppo, Alexander Ratner, Arash Ferdowsi, Emmett Shear, Ankur Nagpal, Andrea Coravos, Aneel Ranadive, and many more amazing individuals.
-
We heard that Eric Zhang is unveiling a never-before-seen Modal product at this event 👀
Announcing a new series!!! Join us for NYC AI Demos presented by Pensar and Tech:NYC at the beautiful Refinery @ Domino! Come see Oscar Health, Modal, Suno, Vellum, Nomic AI, Haize Labs and more! RSVP link in the comments. Julie Samuels Caroline McKechnie Michaella Solar-March Daria Demidova Alexander Spyropoulos Margaret Shen Akshat Bubna Anita Kirkovska Akash Sharma Andriy Mulyar Leonard Tang Nimit Kalra Jack Friedson Justin Bu Lauren Pendo
-
Modal reposted this
We've been a fan of Modal since day 1. As a team of 5 we trained, deployed, and served sota models at scale – handling spiky workloads, and scaling to 7 figures in under 6 months. Training foundation models, optimizing/hosting at scale, crafting a product experience, and taking it all to market used to mean big teams and monster rounds. Our mindset hasn't changed. We stay lean, create maximum leverage, and move the world forward.
-