Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Zuellni
/
orpheus-3b-0.1-ft-GGUF
like
2
GGUF
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
Orpheus-3b-0.1-finetuned
in GGUF format.
Downloads last month
517
GGUF
Model size
3.78B params
Architecture
llama
Hardware compatibility
Log In
to view the estimation
4-bit
Q4_K
2.36 GB
5-bit
Q5_K
2.73 GB
6-bit
Q6_K
3.11 GB
8-bit
Q8_0
4.03 GB
16-bit
BF16
7.58 GB
View +2 variants
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no library tag.
Model tree for
Zuellni/orpheus-3b-0.1-ft-GGUF
Base model
meta-llama/Llama-3.2-3B-Instruct
Finetuned
canopylabs/orpheus-3b-0.1-pretrained
Finetuned
canopylabs/orpheus-3b-0.1-ft
Quantized
(
19
)
this model
Collection including
Zuellni/orpheus-3b-0.1-ft-GGUF
Orpheus
Collection
https://github.com/Zuellni/Orpheus-GGUF
โข
3 items
โข
Updated
16 days ago