Unsloth AI

You can finetune Llama-3.2 for free on Colab now! Unsloth makes finetuning 2x faster and uses 60% less VRAM with no accuracy degradation. Llama 3.2 (1B) QLoRA fits on a 4GB GPU, and (3B) fits on 7GB. Vision support coming soon. Finetuning Colab: https://t.co/ko1xReM90u

Llama 3.2 versions including GGUF's + bnb 4 bit versions + reuploaded versions are now on @HuggingFace! See all versions of Llama 3.2 here: https://t.co/lI0nNf5Wu0 We are actively working on supporting Vision models and 1B and 3B.