Hugging Face's logo

unsloth
/
mistral-7b-bnb-4bit

Text Generation
Transformers
Safetensors
English
mistral
unsloth
mistral-7b
bnb
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
1

Use in pipeline

#1
by sudhir2016 - opened
Discussion
sudhir2016

Can you us the model directly in transformers pipeline ?

danielhanchen
 Unsloth AI org

@sudhir2016 Ye should work fine :) Your transformers version should just be 4.37 for it to work :)

sudhir2016

Thanks Dan. Yes it works.

sudhir2016 changed discussion status to closed

Sign up or log in to comment