Skip to content

Conversation

@mmathew23
Copy link
Collaborator

Gemma3n is OOMing on from_pretrained. A quick fix is to move PYTORCH_CUDA_ALLOC_CONF variable into zoo.

@danielhanchen danielhanchen merged commit 98ac25f into unslothai:main Oct 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants