Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,457

Full-text search

Active filters: meta

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • Updated Nov 21, 2024 • 25

bandoti/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated Nov 21, 2024 • 4

bandoti/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 21, 2024 • 6

Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B

Text Generation • Updated Nov 24, 2024 • 77 • 3

tensorblock/Llama-Guard-3-1B-GGUF

Text Generation • Updated Nov 21, 2024 • 53

tensorblock/Llama-2-7b-chat-hf-30-sparsity-GGUF

Text Generation • Updated Nov 22, 2024 • 33

matrixportal/Llama-3.2-3B-Instruct-IQ3_M-GGUF

Text Generation • Updated Nov 22, 2024 • 5

matrixportal/Llama-3.2-3B-Instruct-IQ3_XXS-GGUF

Text Generation • Updated Nov 25, 2024 • 4

tensorblock/Meta-Llama-Guard-2-8B-GGUF

Text Generation • Updated Nov 22, 2024 • 71

guangy10/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated Nov 22, 2024 • 7

matrixportal/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated Nov 22, 2024 • 3

Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • Updated about 9 hours ago • 132 • 3

raethehacker/Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • Updated Nov 23, 2024 • 16 • 1

alices2/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 23, 2024 • 3 • 1

naonnaon/Llama-3.2-1B-Instruct-IQ4_XS-GGUF

Updated Nov 23, 2024 • 7

matrixportal/Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Nov 23, 2024 • 3

mlx-community/Meta-Llama-3.1-8B-Instruct-3bit

Text Generation • Updated Nov 23, 2024 • 30

artificialguybr/LLAMA3.2-1B-Synthia-I-Redmond

Text Generation • Updated Nov 24, 2024 • 49 • 1

artificialguybr/LLAMA3.2-1B-Synthia-I-Redmond-gguf

Updated Nov 24, 2024 • 899 • 1

mav23/Llama-2-70B-fp16-GGUF

Text Generation • Updated Nov 24, 2024 • 47

matrixportal/Llama-3.1-8B-Instruct-IQ3_M-GGUF

Text Generation • Updated Nov 24, 2024 • 3

ckoozzzu/dl6

Text Generation • Updated Nov 24, 2024 • 11

artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond

Text Generation • Updated Nov 25, 2024 • 179 • 1

artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond-gguf

Updated Nov 25, 2024 • 898 • 1

Maites/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 25, 2024 • 7

Maites/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 25, 2024 • 6

irinachengsc/Llama-3.1-8B-Q4_0-GGUF

Text Generation • Updated Nov 25, 2024 • 4

Triangle104/Meta-Llama-3.1-8B-Instruct-Q5_K_S-GGUF

Updated Nov 25, 2024 • 4

Triangle104/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Updated Nov 25, 2024 • 5

Triangle104/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Updated Nov 25, 2024 • 5