Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,907

Full-text search

Active filters: facebook

tensorblock/Llama-2-7b-chat-hf-30-sparsity-GGUF

Text Generation • Updated Nov 22, 2024 • 9

matrixportal/Llama-3.2-3B-Instruct-IQ3_M-GGUF

Text Generation • Updated Nov 22, 2024

matrixportal/Llama-3.2-3B-Instruct-IQ3_XXS-GGUF

Text Generation • Updated Nov 25, 2024

tensorblock/Meta-Llama-Guard-2-8B-GGUF

Text Generation • Updated Nov 22, 2024 • 6

guangy10/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated Nov 22, 2024

matrixportal/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated Nov 22, 2024 • 3

Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • Updated 17 days ago • 34 • 3

raethehacker/Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • Updated Nov 23, 2024 • 1 • 1

alices2/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 23, 2024 • 4 • 1

naonnaon/Llama-3.2-1B-Instruct-IQ4_XS-GGUF

Updated Nov 23, 2024 • 2

matrixportal/Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Nov 23, 2024

mlx-community/Meta-Llama-3.1-8B-Instruct-3bit

Text Generation • Updated Nov 23, 2024 • 169

artificialguybr/LLAMA3.2-1B-Synthia-I-Redmond

Text Generation • Updated Nov 24, 2024 • 18 • 1

artificialguybr/LLAMA3.2-1B-Synthia-I-Redmond-gguf

Updated Nov 24, 2024 • 99 • 1

mav23/Llama-2-70B-fp16-GGUF

Text Generation • Updated Nov 24, 2024 • 10

matrixportal/Llama-3.1-8B-Instruct-IQ3_M-GGUF

Text Generation • Updated Nov 24, 2024

ckoozzzu/dl6

Text Generation • Updated Nov 24, 2024 • 7

artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond

Text Generation • Updated Nov 25, 2024 • 15 • 1

artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond-gguf

Updated Nov 25, 2024 • 60 • 1

Maites/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 25, 2024 • 1

Maites/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 25, 2024 • 1

irinachengsc/Llama-3.1-8B-Q4_0-GGUF

Text Generation • Updated Nov 25, 2024 • 7

Triangle104/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF

Updated Nov 25, 2024 • 9

Triangle104/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Updated Nov 25, 2024 • 12

Triangle104/Meta-Llama-3.1-8B-Instruct-Q5_K_S-GGUF

Updated Nov 25, 2024 • 8

Triangle104/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Updated Nov 25, 2024 • 10

Triangle104/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Updated Nov 25, 2024 • 5

Triangle104/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Updated Nov 25, 2024 • 7

Maites/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 25, 2024 • 1

tensorblock/new1-GGUF

Text Generation • Updated Nov 25, 2024