Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,185

Full-text search

Active filters: meta

amd/Llama-2-7b-hf-awq-g128-int4-asym-fp32-onnx-ryzen-strix

Text Generation • Updated 2 days ago

amd/Llama2-7b-chat-awq-g128-int4-asym-fp32-onnx-ryzen-strix

Text Generation • Updated 2 days ago

amd/Meta-Llama-3-8B-awq-g128-int4-asym-fp32-onnx-ryzen-strix

Text Generation • Updated 2 days ago

amd/Llama-3.1-8B-awq-g128-int4-asym-fp32-onnx-ryzen-strix

Text Generation • Updated 2 days ago

v8karlo/Llama-3.2-1B-Instruct-Q8_0-GGUF

Updated 2 days ago • 15

jacobcarajo/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 2 days ago • 13

avikam/Llama-2-7b-hf-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 10

mradermacher/Llama-3.1-70B-Instruct-abliterated-GGUF

Updated 2 days ago • 381

mav23/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated 2 days ago • 244

mav23/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 2 days ago • 370

mav23/Llama-3.2-3B-GGUF

Text Generation • Updated 1 day ago • 327

mav23/Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated 1 day ago • 335

mav23/Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated 1 day ago • 91

iut62elec/llama3_2_1B_FT_new

Text Generation • Updated 1 day ago • 5

mav23/Meta-Llama-3-8B-GGUF

Text Generation • Updated 1 day ago • 185

mav23/Llama-3.1-8B-GGUF

Text Generation • Updated 1 day ago • 177

mav23/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated 1 day ago • 185

mav23/Llama-Guard-3-1B-GGUF

Text Generation • Updated 1 day ago • 172

carboncrystalx/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated about 24 hours ago • 5

carboncrystalx/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated about 23 hours ago • 3

BitStreamX/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated about 22 hours ago • 2

1a3orn/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated about 10 hours ago

beethogedeon/Llama-3.2-1B-Instruct-Q4_K_S-GGUF

Text Generation • Updated about 8 hours ago

1a3orn/Llama-3.2-3B-Q4_K_M-GGUF

Text Generation • Updated about 7 hours ago

1a3orn/Llama-3.2-3B-Q8_0-GGUF

Text Generation • Updated about 2 hours ago