Hugging Face's logo

unsloth
/
llama-3-8b-Instruct-bnb-4bit

Text Generation
Transformers
Safetensors
English
llama
llama-3
meta
facebook
unsloth
conversational
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
4
New discussion

How do i perform distillation for this model?
#4 opened about 1 month ago by
pr4nav101

BitsAndBytesConfig error

3
#1 opened 9 months ago by
vdavidr