Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

4-bit precision

8-bit precision

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,850

Full-text search

Active filters: 5-bit

MaziyarPanahi/xLAM-7b-fc-r-GGUF

Text Generation • Updated 20 days ago • 250

MaziyarPanahi/xLAM-1b-fc-r-GGUF

Text Generation • Updated 20 days ago • 219

ReadyArt/Dumpling-Qwen2.5-32B_EXL2_5.0bpw_H8

Text Generation • Updated 20 days ago • 5

ReadyArt/EVA-Qwen2.5-14B-v0.2_EXL2_5.0bpw_H8

Text Generation • Updated 20 days ago • 4

ReadyArt/Wayfarer-12B_EXL2_5.0bpw_H8

Text Generation • Updated 19 days ago • 10

sleepdeprived3/UnslopNemo-12B-v3_5bpw_H8

Text Generation • Updated 18 days ago • 12

ReadyArt/Qwen2.5-32b-RP-Ink_EXL2_5.0bpw_H8

Updated 19 days ago • 17

sleepdeprived3/Qwen2.5-72b-RP-Ink_EXL2_5bpw_H8

Updated 18 days ago • 18

ReadyArt/Beeper-King-22B_EXL2_5.0bpw_H8

Updated 18 days ago • 12

ReadyArt/Chuluun-Qwen2.5-32B-v0.01_EXL2_5.0bpw_H8

Text Generation • Updated 18 days ago • 15

ReadyArt/Mistral-Small-Instruct-2409_EXL2_5.0bpw_H8

Updated 18 days ago • 11

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q5_K_M-GGUF

Text Generation • Updated 18 days ago • 11

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q5_K_S-GGUF

Text Generation • Updated 18 days ago • 5

SicariusSicariiStuff/Impish_QWEN_14B-1M-5.0bpw

Updated 18 days ago • 5

roleplaiapp/MN-12B-Mag-Mell-R1-Q5_K_M-GGUF

Text Generation • Updated 17 days ago • 16

roleplaiapp/MN-12B-Mag-Mell-R1-Q5_K_S-GGUF

Text Generation • Updated 17 days ago • 5

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q5_K_M-GGUF

Text Generation • Updated 16 days ago • 4

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q5_K_S-GGUF

Text Generation • Updated 16 days ago • 5

ReadyArt/magnum-twilight-12b_EXL2_5.0bpw_H8

Text Generation • Updated 16 days ago • 11

ReadyArt/Chuluun-Qwen2.5-72B-v0.08_EXL2_5.0bpw_H8

Text Generation • Updated 16 days ago • 4

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q5_K_M-GGUF

Text Generation • Updated 16 days ago • 761

roleplaiapp/14B-Qwen2.5-Kunou-v1-Q5_K_M-GGUF

Text Generation • Updated 16 days ago • 101

roleplaiapp/14B-Qwen2.5-Kunou-v1-Q5_K_S-GGUF

Text Generation • Updated 16 days ago • 4

roleplaiapp/q-2.5-deepseek-r1-veltha-v0.3-Q5_K_M-GGUF

Text Generation • Updated 16 days ago • 36

roleplaiapp/DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q5_K_M-GGUF

Text Generation • Updated 16 days ago • 21

roleplaiapp/DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q5_K_S-GGUF

Text Generation • Updated 16 days ago • 23

roleplaiapp/Virtuoso-Lite-Q5_K_M-GGUF

Text Generation • Updated 16 days ago • 4

roleplaiapp/Virtuoso-Lite-Q5_K_S-GGUF

Text Generation • Updated 16 days ago • 5

roleplaiapp/Pathfinder-RP-12B-RU-Q5_K_M-GGUF

Text Generation • Updated 15 days ago • 8

roleplaiapp/Pathfinder-RP-12B-RU-Q5_K_S-GGUF

Text Generation • Updated 15 days ago • 5