Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Files and versions
xet
Community
1
SmolLM-1.7B-Instruct-v0.2-GGUF
3.76 GB
  • 1 contributor
History: 3 commits
MaziyarPanahi's picture
MaziyarPanahi
3a6aa46ae18a56fb45f82336bf95fdfbaea7e40fe7dc0158182beb0366f8ed46
8ffa655 verified over 1 year ago
  • .gitattributes
    2.04 kB
    3a6aa46ae18a56fb45f82336bf95fdfbaea7e40fe7dc0158182beb0366f8ed46 over 1 year ago
  • README.md
    3.07 kB
    f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e over 1 year ago
  • SmolLM-1.7B-Instruct-v0.2-GGUF_imatrix.dat
    1.97 MB
    xet
    f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e over 1 year ago
  • SmolLM-1.7B-Instruct-v0.2.IQ1_M.gguf
    444 MB
    xet
    f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e over 1 year ago
  • SmolLM-1.7B-Instruct-v0.2.IQ1_S.gguf
    412 MB
    xet
    f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e over 1 year ago
  • SmolLM-1.7B-Instruct-v0.2.IQ2_XS.gguf
    543 MB
    xet
    f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e over 1 year ago
  • SmolLM-1.7B-Instruct-v0.2.IQ3_XS.gguf
    739 MB
    xet
    f028ca420c9524ba78dd54a5ea795d967fa09e1787656b10bafe9496ca313a4e over 1 year ago
  • SmolLM-1.7B-Instruct-v0.2.IQ4_XS.gguf
    940 MB
    xet
    3a6aa46ae18a56fb45f82336bf95fdfbaea7e40fe7dc0158182beb0366f8ed46 over 1 year ago
  • SmolLM-1.7B-Instruct-v0.2.Q2_K.gguf
    675 MB
    xet
    3a6aa46ae18a56fb45f82336bf95fdfbaea7e40fe7dc0158182beb0366f8ed46 over 1 year ago