Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
PygmalionAI
/
Pygmalion-3-12B-GGUF
like
7
Follow
Pygmalion
386
GGUF
conversational
Model card
Files
Files and versions
Community
2
Deploy
Use this model
No model card
Downloads last month
2,311
GGUF
Model size
12.2B params
Architecture
llama
Hardware compatibility
Log In
to view the estimation
3-bit
IQ3_XXS
4.95 GB
Q3_K
6.08 GB
Q3_K_L
6.56 GB
4-bit
IQ4_XS
6.74 GB
Q4_K_S
7.12 GB
IQ4_NL
7.1 GB
Q4_K
7.48 GB
5-bit
Q5_K_S
8.52 GB
Q5_K
8.73 GB
6-bit
Q6_K
10.1 GB
8-bit
Q8_0
13 GB
16-bit
F16
24.5 GB
View +1 variant
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no library tag.
Collection including
PygmalionAI/Pygmalion-3-12B-GGUF
Pygmalion-3
Collection
6 items
โข
Updated
Feb 2
โข
3