unsloth/phi-4-unsloth-bnb-4bit
Text Generation
•
Updated
•
4.34k
•
21
Unsloth AI
Enterprise
company
Verified
AI & ML interests
Hey! We're focusing on making AI more accessible to everyone!
Recent Activity
unsloth's activity
shimmyshimmer
updated
a
model
about 13 hours ago
shimmyshimmer
updated
2
models
about 18 hours ago
shimmyshimmer
updated
a
Space
about 22 hours ago
What is the required GPU size to run Is a 4090 possible and does it support ollama
4
#5 opened 3 days ago
by
sminbb
danielhanchen
posted
an
update
1 day ago
Post
721
We fixed many bugs in Phi-4 & uploaded fixed GGUF + 4-bit versions! ✨
Our fixed versions are even higher on the Open LLM Leaderboard than Microsoft's!
GGUFs: unsloth/phi-4-GGUF
Dynamic 4-bit: unsloth/phi-4-unsloth-bnb-4bit
You can also now finetune Phi-4 for free on Colab: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb
Read our blogpost for more details on bug fixes etc: https://unsloth.ai/blog/phi4
Our fixed versions are even higher on the Open LLM Leaderboard than Microsoft's!
GGUFs: unsloth/phi-4-GGUF
Dynamic 4-bit: unsloth/phi-4-unsloth-bnb-4bit
You can also now finetune Phi-4 for free on Colab: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb
Read our blogpost for more details on bug fixes etc: https://unsloth.ai/blog/phi4
why use q5 for key cache?
1
#7 opened 2 days ago
by
CHNtentes
Getting error with Q3-K-M
5
#2 opened 3 days ago
by
alain401
Advice on running llama-server with Q2_K_L quant
1
#6 opened 3 days ago
by
vmajor
Are these imatrix GGUF quants?
4
#1 opened 4 days ago
by
Kearm
llama.cpp cannot load Q6_K model
5
#3 opened 3 days ago
by
vmajor
llama.cpp cannot load Q6_K model
5
#3 opened 3 days ago
by
vmajor
danielhanchen
updated
a
model
3 days ago
shimmyshimmer
updated
2
collections
3 days ago
danielhanchen
updated
a
model
3 days ago
shimmyshimmer
updated
a
model
3 days ago
shimmyshimmer
updated
a
collection
3 days ago
danielhanchen
updated
a
model
3 days ago