Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

78,623

Full-text search

Active filters: gguf

njwright92/Comicbot

Text Generation • Updated Dec 18, 2023 • 2

bk2000/modelllama

Updated Sep 17, 2023 • 3

TheBloke/Nous-Hermes-Llama2-70B-GGUF

Updated Sep 27, 2023 • 778 • 26

TheBloke/Nous-Puffin-70B-GGUF

Updated Sep 27, 2023 • 363 • 11

TheBloke/CodeLlama-7B-Instruct-GGUF

Text Generation • Updated Sep 27, 2023 • 4.5k • 115

TheBloke/CodeLlama-7B-Python-GGUF

Text Generation • Updated Sep 27, 2023 • 3.92k • 56

Doctor-Shotgun/Misc-Models

Text Generation • Updated Jan 8, 2024 • 1.51k • 4

TheBloke/CodeLlama-13B-Python-GGUF

Text Generation • Updated Sep 27, 2023 • 1.42k • 33

TheBloke/CodeLlama-34B-GGUF

Text Generation • Updated Sep 27, 2023 • 2.84k • 56

TheBloke/CodeLlama-34B-Python-GGUF

Text Generation • Updated Sep 27, 2023 • 1.18k • 36

TheBloke/CodeLlama-34B-Instruct-GGUF

Text Generation • Updated Sep 27, 2023 • 2.21k • 95

TFMC/openbuddy-llama2-13b-v11.1-bf16-GGUF

Updated Aug 25, 2023 • 21 • 3

TheBloke/Samantha-1.11-70B-GGUF

Updated Sep 27, 2023 • 73 • 11

TheBloke/Samantha-1.11-CodeLlama-34B-GGUF

Updated Sep 27, 2023 • 522 • 18

TheBloke/Llama2-70B-OASST-SFT-v10-GGUF

Text Generation • Updated Sep 27, 2023 • 194 • 10

audreyt/Taiwan-LLaMa-v1.0-GGUF

Text Generation • Updated Oct 10, 2023 • 215 • 13

zarakiquemparte/zarablend-1.1-l2-7b-GGUF

Updated Aug 26, 2023 • 10 • 3

Nondzu/Phind-CodeLlama-34B-v1-GGUF

Updated Aug 26, 2023 • 7

TheBloke/Phind-CodeLlama-34B-v1-GGUF

Updated Sep 27, 2023 • 823 • 15

TheBloke/Phind-CodeLlama-34B-Python-v1-GGUF

Updated Sep 27, 2023 • 1.14k • 13

NikolayKozloff/OmegLLaMA-3B

Updated Aug 26, 2023 • 3

TheBloke/WizardCoder-Python-34B-V1.0-GGUF

Updated Sep 27, 2023 • 1.57k • 80

TheBloke/Zarafusionex-1.1-L2-7B-GGUF

Updated Sep 27, 2023 • 220 • 5

TheBloke/Synthia-70B-GGUF

Text Generation • Updated Sep 27, 2023 • 124 • 7

qnixsynapse/llama-2-chat-13b-gguf

Updated Aug 26, 2023 • 25

Aznor/llama-2-chat-7b-q4_0

Updated Aug 26, 2023 • 12

Aznor/llama-2-chat-13b-q5_0

Updated Aug 26, 2023 • 1

TheBloke/Genz-70b-GGUF

Text Generation • Updated Sep 27, 2023 • 596 • 9

TheBloke/Llama-2-70B-Orca-200k-GGUF

Text Generation • Updated Sep 27, 2023 • 406 • 22

juanjgit/orca_mini_3B-GGUF

Updated Sep 25, 2023 • 135 • 7