Unsloth Backup Account

company

http://www.unsloth.ai

unslothai

Activity Feed

AI & ML interests

None defined yet.

Recent Activity

danielhanchen updated a model about 1 month ago

unslothai/Phi-4-mini-instruct

danielhanchen published a model about 1 month ago

unslothai/Phi-4-mini-instruct

danielhanchen updated a model about 1 month ago

unslothai/Llama-3.2-1B-Instruct

View all activity

unslothai's activity

danielhanchen

posted an update 1 day ago

Post

2090

You can now run Llama 4 on your own local device! 🦙
Run our Dynamic 1.78-bit and 2.71-bit Llama 4 GGUFs:
unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF

You can run them on llama.cpp and other inference engines. See our guide here: https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4

1 reply

danielhanchen

posted an update 9 days ago

Post

3288

You can now run DeepSeek-V3-0324 on your own local device!
Run our Dynamic 2.42 and 2.71-bit DeepSeek GGUFs: unsloth/DeepSeek-V3-0324-GGUF

You can run them on llama.cpp and other inference engines. See our guide here: https://docs.unsloth.ai/basics/tutorial-how-to-run-deepseek-v3-0324-locally

danielhanchen

updated a model about 1 month ago

unslothai/Phi-4-mini-instruct

Updated Feb 28 • 5

danielhanchen

published a model about 1 month ago

unslothai/Phi-4-mini-instruct

Updated Feb 28 • 5

danielhanchen

updated 2 models about 1 month ago

unslothai/Llama-3.2-1B-Instruct

Updated Feb 25 • 4

unslothai/Llama-3.2-1B-Instruct-unsloth-bnb-4bit

Updated Feb 25 • 8

danielhanchen

published 2 models about 1 month ago

unslothai/Llama-3.2-1B-Instruct-unsloth-bnb-4bit

Updated Feb 25 • 8

unslothai/Llama-3.2-1B-Instruct

Updated Feb 25 • 4

danielhanchen

posted an update 3 months ago

Post

3071

I uploaded DeepSeek R1 GGUFs!

unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF
2bit for MoE: unsloth/DeepSeek-R1-GGUF
unsloth/DeepSeek-R1-Zero-GGUF

More at unsloth/deepseek-r1-all-versions-678e1c48f5d2fce87892ace5

danielhanchen

posted an update 3 months ago

Post

4705

We fixed many bugs in Phi-4 & uploaded fixed GGUF + 4-bit versions! ✨

Our fixed versions are even higher on the Open LLM Leaderboard than Microsoft's!

GGUFs: unsloth/phi-4-GGUF
Dynamic 4-bit: unsloth/phi-4-unsloth-bnb-4bit

You can also now finetune Phi-4 for free on Colab: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb

Read our blogpost for more details on bug fixes etc: https://unsloth.ai/blog/phi4

danielhanchen

posted an update 3 months ago

Post

3199

Deepseek V3, including GGUF + bf16 versions are now uploaded!

Includes 2, 3, 4, 5, 6 and 8-bit quantized versions.

GGUFs: unsloth/DeepSeek-V3-GGUF
bf16: unsloth/DeepSeek-V3-bf16

Min. hardware requirements to run: 48GB RAM + 250GB of disk space for 2-bit.

See how to run them with examples and the full collection: unsloth/deepseek-v3-all-versions-677cf5cfd7df8b7815fc723c

danielhanchen

posted an update 4 months ago

Post

1563

I uploaded GGUFs, 4bit bitsandbytes and full 16bit precision weights for Llama 3.3 70B Instruct are here: unsloth/llama-33-all-versions-67535d7d994794b9d7cf5e9f

You can also finetune Llama 3.3 70B in under 48GB of VRAM with Unsloth!
GGUFs: unsloth/Llama-3.3-70B-Instruct-GGUF
BnB 4bit: unsloth/Llama-3.3-70B-Instruct-bnb-4bit
16bit: unsloth/Llama-3.3-70B-Instruct

1 reply

danielhanchen

posted an update 5 months ago

Post

1447

Vision finetuning is in 🦥Unsloth! You can now finetune Llama 3.2, Qwen2 VL, Pixtral and all Llava variants up to 2x faster and with up to 70% less VRAM usage! Colab to finetune Llama 3.2: https://colab.research.google.com/drive/1j0N4XTY1zXXy7mPAhOC1_gMYZ2F2EBlk?usp=sharing

1 reply

danielhanchen

updated 7 models 9 months ago

AI & ML interests

Recent Activity

Team members 1

unslothai's activity