Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

6,855

Full-text search

Active filters: llama-cpp

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 10 days ago • 12.8k • 28

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated 10 days ago • 6.35k • 12

Karsh-CAI/Qwen2.5-32B-AGI-Q4_K_M-GGUF

Updated 14 days ago • 3.68k • 15

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 10 days ago • 1.88k • 10

mylesgoose/Llama-3.2-3B-instruct-abliterated-Q8_0-GGUF

Updated 8 days ago • 531 • 3

darkc0de/Llama-3.2-3B-Instruct-abliterated-Q8_0-GGUF

Updated 7 days ago • 281 • 3

Abc7347/BlackSheep-Llama3.2-3B-Q4_K_M-GGUF

Updated 3 days ago • 170 • 3

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3 • 833 • 47

elyza/Llama-3-ELYZA-JP-8B-GGUF

Updated Jun 26 • 2.92k • 32

byroneverson/gemma-2-27b-it-abliterated-gguf

Text Generation • Updated 25 days ago • 2.49k • 12

NikolayKozloff/NightyGurps-14b-v1.1-Q5_K_M-GGUF

Updated 13 days ago • 5 • 2

werty1248/Mistral-Nemo-NT-Ko-12B-dpo-GGUF

Updated 10 days ago • 113 • 2

pcuenq/Qwen2.5-0.5B-Instruct-with-new-merges-serialization-Q8_0-GGUF

Text Generation • Updated 5 days ago • 9 • 2

Thanabordee/openthaigpt1.5-7b-instruct-Q4_K_M-GGUF

Text Generation • Updated 5 days ago • 139 • 2

ClaudioItaly/Templare-12B-Q4_K_M-GGUF

Updated 3 days ago • 18 • 2

SteelQuants/MSM-MS-Cydrion-22B-Q6_K-GGUF

Updated 1 day ago • 24 • 2

zelk12/recoilme-gemma-2-Ataraxy-9B-v0.1-Q6_K-GGUF

Updated 1 day ago • 7 • 2

SzilviaB/SzilviaB-Daredevil-LongWriter-8B_abliterated-Q8_0-GGUF

Updated 1 day ago • 7 • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9 • 278 • 8

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated May 14 • 293 • 49

mtsdurica/madlad400-3b-mt-Q4_K_M-GGUF

Translation • Updated Jul 13 • 223 • 3

tspersian/mT5_base_translation_English_to_Persian-Farsi-Q4_K_M-GGUF

Translation • Updated Jul 14 • 42 • 1

Ayylex/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 23 • 85 • 1

SteelQuants/G2-DA-Nyxora-27b-V2-Q5_K_M-GGUF

Updated Jul 30 • 8 • 2

polyverse/falcon-7b-Q4_K_M-GGUF

Updated Aug 1 • 144 • 1

jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF

Text Generation • Updated Aug 4 • 74 • 5

polyverse/falcon-7b-Q5_K_M-GGUF

Updated Aug 7 • 43 • 1

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 2 • 1.06k • 4

HuggingFaceTB/smollm-135M-instruct-v0.2-Q8_0-GGUF

Updated Aug 18 • 1.32k • 4

winvoker/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Aug 14 • 5 • 1