Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

119

Full-text search

Active filters: autoquant

mlabonne/NeuralDaredevil-8B-abliterated-4.5bpw-exl2

Updated Jul 28, 2024

mlabonne/NeuralDaredevil-8B-abliterated-AWQ

Text Generation • Updated Jul 28, 2024 • 17

Pushpendra817/SDXL-Captioner-GGUF

Image-Text-to-Text • Updated Aug 1, 2024 • 1

iqbalamo93/Meta-Llama-3.1-8B-Instruct-GPTQ-Q_8

Text Generation • Updated Sep 14, 2024 • 6.9k • 3

jeremierostan/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 3, 2024 • 1

jeremierostan/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 3, 2024 • 11

jeremierostan/Meta-Llama-3.1-8B-GGUF

Text Generation • Updated Aug 3, 2024 • 8

neifuisan/gemma-2b-it-GGUF

Updated Aug 5, 2024 • 2

mlabonne/Hermes-3-Llama-3.1-8B-lorablated-GGUF

Updated Aug 16, 2024 • 1.5k • 22

Corianas/mistral-7b-expert-iteration-iter3-GPTQ

Updated Aug 24, 2024 • 9

Corianas/mistral-7b-expert-iteration-iter3-GGUF

Updated Aug 19, 2024 • 1

hassu619/Llama-2-7b-chat-finetune_UNI-GGML

Question Answering • Updated Aug 20, 2024

Corianas/gpt-j-6B-Dolly-GGUF

Updated Aug 21, 2024

bebechien/gemma-2-2b-GGUF

Text Generation • Updated Aug 21, 2024 • 2

bebechien/gemma-2-2b-GPTQ

Text Generation • Updated Aug 21, 2024 • 13

bebechien/gemma-2-2b-4.5bpw-exl2

Text Generation • Updated Aug 21, 2024

Mardiyyah/Llama3-OpenBioLLM-8B-GGUF

Updated Aug 22, 2024 • 11 • 1

Corianas/Llama-3-Instruct-8B-SPPO-Iter3-8-32-GPTQ

Text Generation • Updated Aug 25, 2024 • 6

Corianas/Mistral7B-PairRM-SPPO-Iter3-4-32-GPTQ

Text Generation • Updated Aug 25, 2024 • 4

Corianas/Mistral7B-PairRM-SPPO-Iter3-4-64-GPTQ

Text Generation • Updated Aug 25, 2024 • 8

Corianas/Mistral7B-PairRM-SPPO-Iter3-4-128-GPTQ

Text Generation • Updated Aug 25, 2024 • 5

Corianas/Mistral7B-PairRM-SPPO-Iter3-8-32-GPTQ

Text Generation • Updated Aug 25, 2024 • 5

Corianas/Mistral7B-PairRM-SPPO-Iter3-8bit-64GSize-GPTQ

Text Generation • Updated Aug 25, 2024 • 5

Corianas/Mistral7B-PairRM-SPPO-Iter3-8-128-GPTQ

Text Generation • Updated Aug 25, 2024 • 12

Corianas/Llama-3-Instruct-8B-SPPO-Iter3-4-32-GPTQ

Text Generation • Updated Aug 25, 2024 • 6

Corianas/Llama-3-Instruct-8B-SPPO-Iter3-4-64-GPTQ

Text Generation • Updated Aug 25, 2024 • 5

speakleash/Bielik-11B-v2.2-Instruct-onnx-fp16

Text Generation • Updated Oct 7, 2024 • 5 • 1

pansophic/pansophic-1-preview-LLaMA3.1-8b-GPTQ

Text Generation • Updated Sep 5, 2024 • 12 • 1

Kukedlc/NeuralGemma-2B-Slerp-GGUF

Updated Sep 5, 2024 • 4

Kukedlc/Gemma2-2b-Spanish-Roleplay-GGUF

Text Generation • Updated Sep 22, 2024 • 84 • 1