xriminact
/

SmolLM-1.7B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

SmolLM-1.7B-Instruct-GGUF / README.md

xriminact's picture

Update README.md

d81cec1 verified 6 months ago

|

history blame contribute delete

235 Bytes

metadata

license: apache-2.0

Model Sources

https://huggingface.co/HuggingFaceTB/SmolLM-1.7B-Instruct

Uses

v v small model for running on edge with :fire: TTFT & Throughput

Direct Use

Use llama.cpp to inference the model