PyTorch

Join Christian Keller from Meta this coming Wednesday at PyTorch Day France to explore the development of Llama 4, its key features, including long=context and multimodal understanding, and MUCH MORE! It all goes LIVE 7 May at Station F in Paris! 🎟️ Register for FREE with code PYTORCH (includes access to PyTorch Day France + GOSIM AI Paris): https://hubs.la/Q03kY0Yb0 ➡️ View the schedule: https://hubs.la/Q03kY1jv0 #PyTorchDayFrance #PyTorch #PyTorchFoundation #FutureOfAI #AI #GenAI #MachineLearning #ML #DeepLearning #OpenSource #OpenSourceSoftware #OpenSourceDevelopment #OpenSourceCommunity #OSS #LinuxFoundation #events

PyTorch Day France—the first-ever PyTorch Day—comes at a key moment for the PyTorch Foundation. With our recent expansion into an umbrella foundation, PyTorch Foundation is now positioned to support a broader ecosystem of trusted, community-driven AI projects across the full AI lifecycle. 🎫 Register with code PYTORCH for free access to PyTorch Day France and GOSIM AI Paris. 📖 Read our blog for a deeper look at the featured sessions: https://hubs.la/Q03kXtdn0 ⛓️Two events, one registration—double the sessions, double the innovation. Sign up at: https://hubs.la/Q03kXvx_0 Hosted by PyTorch Foundation and co-located with GOSIM AI Paris (GOSIM Foundation). #PyTorch #PyTorchDayFrance #GOSIMAIParis #OpenSourceAI

PyTorch Day China 2025 is taking shape—check out the full schedule and start planning your day. Join us June 7 in Beijing, co-located with the @BAAI Conference, for a full day of cutting-edge technical talks, interactive discussions, and poster sessions powered by the open source AI community. 🗓️ View the schedule: https://hubs.la/Q03kMgpy0 📝 Register: https://hubs.la/Q03kMgr80 Hosted by PyTorch Foundation, this is the premier gathering for developers, researchers, and ML engineers shaping the future of deep learning. #PyTorch #OpenSourceAI #MachineLearning

PyTorch Day France is coming in HOT! Catch it LIVE NEXT WEEK - 7 May at Station F in Paris 🇫🇷 One epic day of AI, ML & PyTorch innovation—plus it's co-located with GOSIM AI Paris! 🎟️ Register for FREE with code PYTORCH (includes access to both events!): https://hubs.la/Q03kMvSK0 ➡️ View the schedule: https://hubs.la/Q03kMvft0 #PyTorchDayFrance #PyTorch #PyTorchFoundation #FutureOfAI #AI #GenAI #MachineLearning #ML #DeepLearning #OpenSource #OpenSourceSoftware #OpenSourceDevelopment #OpenSourceCommunity #OSS #LinuxFoundation #events

PyTorch DCP (Distributed Checkpointing) has recently enabled new optimizations for asynchronous checkpointing in order to reduce the collective overhead and GPU utilization drop and thus improve overall checkpointing efficiency. Using Crusoe’s 2K H200 cluster, with TorchTitan and training a Llama3-70B, we were able to verify these new features deliver substantial speedups at 1856 GPU scale, reducing the background processing time for async DCP checkpoints from ~436 seconds to ~67 seconds. This is roughly a 6.5x reduction in checkpoint processing time, enabling even more total training time to proceed at full training throughput. 🔗 Read our latest blog here: https://hubs.la/Q03kL5KP0 #PyTorch #Checkpointing #TorchTitan

New case study: How IBM Research Uses PyTorch and TerraTorch to Make Geospatial Computer Vision Accessible for Everyone 🌍 TerraTorch 1.0, a PyTorch domain library from IBM Research, is helping lower barriers to entry for building geospatial AI models using satellite imagery and Earth observation data. 🔗 Read the full case study: https://lnkd.in/gYjWbi7F #PyTorch #GeospatialAI #ComputerVision

We're excited to announce the upcoming PyTorch Docathon, a community-driven event dedicated to improving the documentation of PyTorch. 👋 Join us online and collaborate with fellow professionals to enhance your skills in documentation and technical writing. 🔗 Register now and contribute to the growth of the PyTorch ecosystem! Read our latest blog to learn more: https://hubs.la/Q03kGGz10 #PyTorch #PyTorchDocathon2025 #OpenSourceAI

FlexAttention’s decoding backend is now optimized for inference—supporting GQA, PagedAttention, nested jagged tensors, trainable biases, and more. Read our latest blog for performance tuning guidance and examples using torchtune and gpt-fast: 🔗 https://hubs.la/Q03ktqZX0 #PyTorch #FlexAttention #LLMInference #OpenSourceAI

Join Nouamane Tazi from Hugging Face NEXT WEEK at PyTorch Day France for: The Ultra-Scale Talk: Scaling Training to Thousands of GPUs. Learn more about this session here: https://hubs.la/Q03knnH00 It all goes LIVE 7 May at Station F in Paris! PyTorch Day France is co-located with GOSIM AI Paris - you can save 25% off your registration with code PYTORCHFRIEND. Register today: https://hubs.la/Q03knk--0 View the full schedule: https://hubs.la/Q03knr8Z0 #PyTorchDayFrance #PyTorch #PyTorchFoundation #FutureOfAI #AI #GenAI #MachineLearning #ML #DeepLearning #OpenSource #OpenSourceSoftware #OpenSourceDevelopment #OpenSourceCommunity #OSS #LinuxFoundation #events

Learn how Bamba v2 was trained using PyTorch FSDP at PyTorch Day France and how to optimize it in vLLM, a PyTorch Foundation ecosystem project 🖇️ 🇫🇷 PyTorch Day France: https://lnkd.in/gMK4BHdX 🤝 vLLM Meetup: https://lnkd.in/g-zsj_d2 #PyTorch #PyTorchDayFrance #vLLM