Leandro von Werra (@lvwerra) / X

Pinned

Feb 19, 2025

The Ultra-Scale Playbook: Training LLMs on GPU Clusters Learn how to train your own DeepSeek-V3 model using 5D parallelism, ZeRO, fast kernels, compute/comm overlap and bottlenecks with theory, interactive plots and 4000+ scaling experiments and audio! huggingface.co/spaces/nanotro…

FYI Microduck is currently generating $2.5B ARR

Thomas Wolf

@Thom_Wolf

Aug 27

currently selling one Microduck every 5 seconds

This is the Star Wars future we deserve! Would you rather live in a world filled with the same faceless white humanoids or a world where robots come in all shapes, colours and capabilities?

Thomas Wolf

@Thom_Wolf

Aug 27

We have a huge news to share today! Today we are unveiling the first truly accessible RL robot - welcome Microduck A 25 cm tiny open-source biped with 15 actuators and packed with sensors (camera, speaker, LiDAR, NFC, bluetooth, wifi, etc) that you train yourself with

00:00

Talking to my agents to figure out what they did for the past 9h blowing my monthly budget:

Introducing: The Stack v3 One thing that became very clear over the last few days: we need great open code models for cyber defence. This is the dataset they will be built on! And it's a behemoth: 5T tokens ready to train and 120TB raw data. Download:

HuggingFaceCode/stack-v3-train · Datasets at Hugging Face

From huggingface.co

9