Edit Models filters

Model Tree

meta-llama/Llama-2-70b-chat-hf

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

9

Full-text search

Active filters: meta-llama/Llama-2-70b-chat-hf

TheBloke/Llama-2-70B-Chat-GGUF

Text Generation • Updated Nov 21, 2023 • 8.13k • 123

mlc-ai/Llama-2-70b-chat-hf-q4f16_1-MLC

Updated Jul 11 • 6 • 2

TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 8.17k • 260

TheBloke/Llama-2-70B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 2.71k • 23

jamesdborin/llama2-70b-chat-4bit-AWQ

Text Generation • Updated Dec 11, 2023 • 27 • 1

softmax/Llama-2-70b-chat-hf-marlin

Text Generation • Updated Mar 17 • 360

strangervb/Llama-2-70B-Chat-GPTQ-2

Text Generation • Updated Mar 25 • 14

TitanML/llama2-70b-chat-4bit-AWQ

Text Generation • Updated Apr 24 • 26

espressor/meta-llama.Llama-2-70b-chat-hf_W8A8_FP8

Text Generation • Updated 27 days ago • 29