-
-
Notifications
You must be signed in to change notification settings - Fork 4.3k
Open
Labels
feature requestFeature request pending on roadmapFeature request pending on roadmapmultigpuon roadmapFeature request on roadmapFeature request on roadmap
Description
Hi, may I ask if Unsloth currently supports multi-GPU training? I tried running it with torchrun for multi-GPU training using my own setup, but it failed. Could you please advise me on how to do it correctly? Thank you!
ichrnkv, Honza-Hroch, rahulspoudel, LIUKAI0815, steveepreston and 13 more
Metadata
Metadata
Assignees
Labels
feature requestFeature request pending on roadmapFeature request pending on roadmapmultigpuon roadmapFeature request on roadmapFeature request on roadmap