Hugging Face's logo
Michael Han's picture
144 19 199

Michael Han

shimmyshimmer
thunnai's profile picture julien-c's profile picture LamaSLEEM's profile picture
·
https://unsloth.ai

AI & ML interests

None yet

Recent Activity

new activity about 3 hours ago
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF:Colab Notebok DeepSeek-R1-Distill-Llama-8B-GGUF
new activity about 3 hours ago
unsloth/DeepSeek-R1-BF16:Any performance improvements??
liked a model about 3 hours ago
Erland/Mistral-Small-24B-Base-ChatML-2501-bnb-4bit
View all activity

Organizations

Unsloth AI's profile picture Hugging Face Discord Community's profile picture

shimmyshimmer's activity

New activity in unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF about 3 hours ago

Colab Notebok DeepSeek-R1-Distill-Llama-8B-GGUF

1
#6 opened about 17 hours ago by
sasha1234567
New activity in unsloth/DeepSeek-R1-BF16 about 3 hours ago

Any performance improvements??

1
#2 opened about 5 hours ago by
KrishnaKaasyap
New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit about 20 hours ago

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

6
#3 opened 3 days ago by
ChloeHuang1
New activity in unsloth/Mistral-Small-24B-Base-2501-bnb-4bit about 24 hours ago

updated model_max_length from to 1000000000000000019884624838656 to 32768
#1 opened 1 day ago by
LHC88
New activity in unsloth/Mistral-Small-24B-Base-2501 about 24 hours ago

updated model_max_length from to 1000000000000000019884624838656 to 32768
#1 opened 1 day ago by
LHC88
New activity in unsloth/Mistral-Small-24B-Base-2501-unsloth-bnb-4bit about 24 hours ago

updated model_max_length from to 1000000000000000019884624838656 to 32768
#1 opened 1 day ago by
LHC88
New activity in unsloth/Mistral-Small-24B-Instruct-2501-bnb-4bit about 24 hours ago

updated model_max_length from to 1000000000000000019884624838656 to 32768
#2 opened 1 day ago by
LHC88
New activity in unsloth/Mistral-Small-24B-Instruct-2501 about 24 hours ago

updated model_max_length from to 1000000000000000019884624838656 to 32768
#1 opened 1 day ago by
LHC88
New activity in unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit about 24 hours ago

updated model_max_length from to 1000000000000000019884624838656 to 32768

1
#1 opened 1 day ago by
LHC88
New activity in unsloth/DeepSeek-R1-Zero-GGUF 1 day ago

Do you have plan to quantize this to 1.58bit?

1
#1 opened 1 day ago by
Dango233
New activity in unsloth/DeepSeek-R1-Distill-Qwen-7B-GGUF 1 day ago

Unsloth code not recognising this model

1
#2 opened 1 day ago by
ZombieStriker
New activity in unsloth/README 2 days ago

Any Change you could do like a phi-3.5 vision?

3
#2 opened 5 months ago by
Nick103

Please Quantize MiniMaxAI/MiniMax-VL-01

1
#5 opened 3 days ago by
chilegazelle
New activity in unsloth/DeepSeek-R1-GGUF 2 days ago

Running the model with vLLM does not actually work

6
#12 opened 4 days ago by
aikitoria
New activity in unsloth/DeepSeek-R1-GGUF 3 days ago

No think tokens visible

2
#15 opened 4 days ago by
sudkamath

A Step-by-step deployment guide with ollama

2
#16 opened 3 days ago by
snowkylin
New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit 3 days ago

How to convert this model to GGUF?

2
#2 opened 3 days ago by
degot
New activity in unsloth/DeepSeek-R1-GGUF 3 days ago

Where did the BF16 come from?

6
#10 opened 4 days ago by
gshpychka
New activity in unsloth/DeepSeek-R1-GGUF 5 days ago

UD-IQ1_M models for distilled R1 versions?

2
#6 opened 6 days ago by
SamPurkis
New activity in unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit 5 days ago

thank you for the great work, can this be converted to gguf?

1
#1 opened 6 days ago by
asidaddy