Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
SmolLM-1.7B-Instruct-v0.2-GGUF
like
7
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
SmolLM-1.7B-Instruct-v0.2-GGUF
1 contributor
History:
10 commits
MaziyarPanahi
222c9546a7f4d511c7692606ca09eadf316a9b72be00ed1b939c7de999241e12
946ce0c
verified
5 months ago
.gitattributes
Safe
2.7 kB
222c9546a7f4d511c7692606ca09eadf316a9b72be00ed1b939c7de999241e12
5 months ago
README.md
Safe
3.07 kB
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
5 months ago
SmolLM-1.7B-Instruct-v0.2-GGUF_imatrix.dat
Safe
1.97 MB
LFS
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
5 months ago
SmolLM-1.7B-Instruct-v0.2.IQ1_M.gguf
Safe
444 MB
LFS
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
5 months ago
SmolLM-1.7B-Instruct-v0.2.IQ1_S.gguf
Safe
412 MB
LFS
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
5 months ago
SmolLM-1.7B-Instruct-v0.2.IQ2_XS.gguf
Safe
543 MB
LFS
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
5 months ago
SmolLM-1.7B-Instruct-v0.2.IQ3_XS.gguf
Safe
739 MB
LFS
f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e
5 months ago
SmolLM-1.7B-Instruct-v0.2.IQ4_XS.gguf
Safe
940 MB
LFS
3a6aa46ae18a56fb45f82336bf95fdfbaea7e40fe7dc0158182beb0366f8ed46
5 months ago
SmolLM-1.7B-Instruct-v0.2.Q2_K.gguf
Safe
675 MB
LFS
3a6aa46ae18a56fb45f82336bf95fdfbaea7e40fe7dc0158182beb0366f8ed46
5 months ago
SmolLM-1.7B-Instruct-v0.2.Q3_K_L.gguf
Safe
933 MB
LFS
a8b3c2e998a9b4734af6864cf3b03f03446c1d26643821c4c1cb2032ecf9cf47
5 months ago
SmolLM-1.7B-Instruct-v0.2.Q3_K_M.gguf
Safe
860 MB
LFS
a8b3c2e998a9b4734af6864cf3b03f03446c1d26643821c4c1cb2032ecf9cf47
5 months ago
SmolLM-1.7B-Instruct-v0.2.Q3_K_S.gguf
Safe
777 MB
LFS
5baea774bd9ce7057ffc3bcb3409b66695b64f2a040898afd9e7e17b6cb0c8cd
5 months ago
SmolLM-1.7B-Instruct-v0.2.Q4_K_M.gguf
Safe
1.06 GB
LFS
5baea774bd9ce7057ffc3bcb3409b66695b64f2a040898afd9e7e17b6cb0c8cd
5 months ago
SmolLM-1.7B-Instruct-v0.2.Q4_K_S.gguf
Safe
999 MB
LFS
d9499e6c10296db2a110c0d64cdcbe15d22d6b59abcab666cf027c762b66c8a2
5 months ago
SmolLM-1.7B-Instruct-v0.2.Q5_K_M.gguf
Safe
1.23 GB
LFS
cbfa746a5f0f4348ed1378a99cc62ee8cf7d35564ba8213d5bafef36d301391c
5 months ago
SmolLM-1.7B-Instruct-v0.2.Q5_K_S.gguf
Safe
1.19 GB
LFS
1c412b11d80716c4f11d51f42d06a0d447c7da75f5a9eccdffd605c93f293932
5 months ago
SmolLM-1.7B-Instruct-v0.2.Q6_K.gguf
Safe
1.41 GB
LFS
754e897e7c2ed86d576659fe9d381e54ac1c7bc9aa5d1bc50c2e6d3255c1d3c8
5 months ago
SmolLM-1.7B-Instruct-v0.2.Q8_0.gguf
Safe
1.82 GB
LFS
222c9546a7f4d511c7692606ca09eadf316a9b72be00ed1b939c7de999241e12
5 months ago
