Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
SmolLM-1.7B-Instruct-v0.2-GGUF
like
7
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
20ba616
SmolLM-1.7B-Instruct-v0.2-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
cbfa746a5f0f4348ed1378a99cc62ee8cf7d35564ba8213d5bafef36d301391c
20ba616
verified
4 months ago
.gitattributes
Safe
2.48 kB
cbfa746a5f0f4348ed1378a99cc62ee8cf7d35564ba8213d5bafef36d301391c
4 months ago
README.md
Safe
3.07 kB
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
4 months ago
SmolLM-1.7B-Instruct-v0.2-GGUF_imatrix.dat
Safe
1.97 MB
LFS
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
4 months ago
SmolLM-1.7B-Instruct-v0.2.IQ1_M.gguf
Safe
444 MB
LFS
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
4 months ago
SmolLM-1.7B-Instruct-v0.2.IQ1_S.gguf
Safe
412 MB
LFS
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
4 months ago
SmolLM-1.7B-Instruct-v0.2.IQ2_XS.gguf
Safe
543 MB
LFS
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
4 months ago
SmolLM-1.7B-Instruct-v0.2.IQ3_XS.gguf
Safe
739 MB
LFS
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
4 months ago
SmolLM-1.7B-Instruct-v0.2.IQ4_XS.gguf
Safe
940 MB
LFS
3a6aa46ae18a56fb45f82336bf95fdfbaea7e40fe7dc0158182beb0366f8ed46
4 months ago
SmolLM-1.7B-Instruct-v0.2.Q2_K.gguf
Safe
675 MB
LFS
3a6aa46ae18a56fb45f82336bf95fdfbaea7e40fe7dc0158182beb0366f8ed46
4 months ago
SmolLM-1.7B-Instruct-v0.2.Q3_K_L.gguf
Safe
933 MB
LFS
a8b3c2e998a9b4734af6864cf3b03f03446c1d26643821c4c1cb2032ecf9cf47
4 months ago
SmolLM-1.7B-Instruct-v0.2.Q3_K_M.gguf
Safe
860 MB
LFS
a8b3c2e998a9b4734af6864cf3b03f03446c1d26643821c4c1cb2032ecf9cf47
4 months ago
SmolLM-1.7B-Instruct-v0.2.Q3_K_S.gguf
Safe
777 MB
LFS
5baea774bd9ce7057ffc3bcb3409b66695b64f2a040898afd9e7e17b6cb0c8cd
4 months ago
SmolLM-1.7B-Instruct-v0.2.Q4_K_M.gguf
Safe
1.06 GB
LFS
5baea774bd9ce7057ffc3bcb3409b66695b64f2a040898afd9e7e17b6cb0c8cd
4 months ago
SmolLM-1.7B-Instruct-v0.2.Q4_K_S.gguf
Safe
999 MB
LFS
d9499e6c10296db2a110c0d64cdcbe15d22d6b59abcab666cf027c762b66c8a2
4 months ago
SmolLM-1.7B-Instruct-v0.2.Q5_K_M.gguf
Safe
1.23 GB
LFS
cbfa746a5f0f4348ed1378a99cc62ee8cf7d35564ba8213d5bafef36d301391c
4 months ago