Hammer2.1-GGUF
Collection
4 items
•
Updated
Melvin56/Hammer2.1-3b-GGUF
Original Model : MadeAgents/Hammer2.1-3b
All quants are made using the imatrix option.
| Model | Size (GB) |
|---|---|
| Q2_K_S | 1.19 |
| Q2_K | 1.27 |
| Q3_K_M | 1.60 |
| Q3_K_M | 1.60 |
| Q4_0 | 1.83 |
| Q4_K_M | 1.92 |
| Q5_K_M | 2.22 |
| Q6_K | 2.53 |
| Q8_0 | 3.28 |
| F16 | 6.17 |
- Downloads last month
- 115
Hardware compatibility
Log In
to view the estimation
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.
Model tree for Melvin56/Hammer2.1-3b-GGUF
Base model
Qwen/Qwen2.5-3B
Finetuned
Qwen/Qwen2.5-Coder-3B
Finetuned
Qwen/Qwen2.5-Coder-3B-Instruct
Finetuned
MadeAgents/Hammer2.1-3b