Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,832

Full-text search

Active filters: quantized

MaziyarPanahi/EXAONE-3.5-2.4B-Instruct-GGUF

Text Generation • Updated 16 days ago • 335 • 1

MaziyarPanahi/EXAONE-3.5-7.8B-Instruct-GGUF

Text Generation • Updated 16 days ago • 218 • 1

MaziyarPanahi/EXAONE-3.5-32B-Instruct-GGUF

Text Generation • Updated 15 days ago • 237 • 1

MaziyarPanahi/Hermes-3-Llama-3.2-3B-GGUF

Text Generation • Updated 13 days ago • 410k • 1

MaziyarPanahi/MISCHIEVOUS-12B-GGUF

Text Generation • Updated 10 days ago • 142 • 1

MaziyarPanahi/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2-GGUF

Text Generation • Updated 10 days ago • 135 • 1

MaziyarPanahi/ASR-Fixer-GGUF

Text Generation • Updated 10 days ago • 77 • 1

MaziyarPanahi/NekoMix-12B-GGUF

Text Generation • Updated 9 days ago • 116 • 1

MaziyarPanahi/Mistral-Nemo-Prism-12B-GGUF

Text Generation • Updated 9 days ago • 221 • 1

MaziyarPanahi/patricide-12B-Unslop-Mell-v2-GGUF

Text Generation • Updated 9 days ago • 163 • 2

SultanR/SmolTulu-1.7b-Reinforced-GGUF

Text Generation • Updated 8 days ago • 20 • 1

MaziyarPanahi/Falcon3-10B-Instruct-GGUF

Text Generation • Updated 7 days ago • 94 • 1

MaziyarPanahi/Falcon3-3B-Base-GGUF

Text Generation • Updated 7 days ago • 79 • 2

MaziyarPanahi/Qwen2.5-Coder-7B-Instruct-20241106-GGUF

Text Generation • Updated 6 days ago • 83 • 1

MaziyarPanahi/Rombos-Coder-V2.5-Qwen-7b-GGUF

Text Generation • Updated 6 days ago • 64 • 1

MaziyarPanahi/moxin-llm-7b-GGUF

Text Generation • Updated 5 days ago • 86 • 1

MaziyarPanahi/Lumimaid-Magnum-v4-12B-GGUF

Text Generation • Updated 1 day ago • 104 • 1

Lewdiculous/InfinityRP-v1-7B-GGUF-IQ-Imatrix

Updated May 4 • 473 • 41

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2

ravenscroftj/CodeGen-2B-multi-ggml-quant

Text Generation • Updated Aug 5, 2023 • 2

ravenscroftj/CodeGen-6B-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 9

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 14 • 4

ethzanalytics/dolly-v2-7b-sharded-8bit

Text Generation • Updated Jun 28, 2023 • 15 • 1

pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit

Summarization • Updated May 5, 2023 • 15

ethzanalytics/stablelm-tuned-alpha-7b-sharded-8bit

Text Generation • Updated May 4, 2023 • 16 • 2

rozek/OpenLLaMA_7B_300BT_q4

Text Generation • Updated May 5, 2023 • 1

ethzanalytics/stablelm-tuned-alpha-3b-gptq-4bit-128g

Text Generation • Updated May 7, 2023 • 14

rirv938/GPTQ-LLaMa-65B-4bit-triton

Text Generation • Updated May 25, 2023 • 12

kyo-takano/open-calm-7b-8bit

Text Generation • Updated May 28, 2023 • 18 • 10

CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA

Text Generation • Updated Jul 20, 2023 • 16