Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

81

Full-text search

Active filters: llama.cpp

osanseviero/DareVox-7B-AWQ

Updated Feb 7 • 4

IndiaBuild/GGUF_Navarna_v0_1_OpenHermes_Hindi

Updated Feb 15 • 6

ahmetkca/trendyol-7B-v1.0-f16-gguf

Updated Feb 15 • 3

ahmetkca/trendyol-7B-v1.0-f32-gguf

google/gemma-7b-it-GGUF

Updated Aug 14 • 4 • 40

google/gemma-2b-GGUF

Updated Jun 27 • 19 • 9

iAkashPaul/Indic-gemma-2b-finetuned-sft-Navarasa-GGUF

Updated Mar 8 • 6 • 3

MrOvkill/gemma-2-inference-endpoint-GGUF

Text Generation • Updated Mar 11 • 4

google/gemma-1.1-7b-it-GGUF

Updated Jun 27 • 1 • 20

google/gemma-1.1-2b-it-GGUF

Updated Jun 27 • 20

pacozaa/bonito-gguf

Updated Apr 14 • 5

pmking27/PrathameshLLM-2B-GGUF

Updated Apr 9 • 3.28k • 1

teleprint-me/cyberpunk-valerie-v0.1

Text Generation • Updated Apr 18 • 10 • 1

qwp4w3hyb/Meta-Llama-3-8B-Instruct-iMat-GGUF

Text Generation • Updated Apr 29 • 773 • 6

asiansoul/Llama-3-Open-Ko-Linear-8B-GGUF

Updated Apr 28 • 11

mgonzs13/Mistroll-7B-v2.2-GGUF

Text Generation • Updated Apr 29 • 43

mgonzs13/ladybird-base-7B-v8-GGUF

Text Generation • Updated Apr 29 • 14

google/codegemma-1.1-2b-GGUF

Text Generation • Updated Jun 27

google/codegemma-1.1-7b-it-GGUF

Text Generation • Updated Jun 27 • 5 • 14

mgonzs13/TextBase-7B-v0.1-GGUF

Text Generation • Updated Jun 11 • 23

QuantFactory/TextBase-7B-v0.1-GGUF

Text Generation • Updated Jun 18 • 214

njwright92/ComicBot_v.2-gguf

Text Generation • Updated Aug 30 • 14

Irathernotsay/qwen2-1.5B-medical_qa-Finetune

Text Generation • Updated Jul 17 • 21

palusi/Qwen2-0.5B-Instruct-GGUF

Updated Jun 27 • 63

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k

Text Generation • Updated Jul 9 • 24

ruslanmv/Medical-Llama3-v2-Q4_K_M-GGUF

Updated Jun 30 • 3

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GGUF

Text Generation • Updated Jul 9 • 7

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GPTQ

Text Generation • Updated Jul 9 • 18

zhhan/Phi-3-mini-4k-instruct_gguf_derived

Summarization • Updated Jul 2 • 47

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ

Text Generation • Updated Jul 9 • 17