Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

87

Full-text search

Active filters: chatqa

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.2-exl2

Text Generation • Updated May 3, 2024 • 15

LoneStriker/Llama3-ChatQA-1.5-70B-2.4bpw-h6-exl2

Text Generation • Updated May 3, 2024 • 16

LoneStriker/Llama3-ChatQA-1.5-70B-3.5bpw-h6-exl2

Text Generation • Updated May 3, 2024 • 16

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.4-exl2

Text Generation • Updated May 3, 2024 • 15

LoneStriker/Llama3-ChatQA-1.5-70B-4.0bpw-h6-exl2

Text Generation • Updated May 3, 2024 • 15

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.6-exl2

Text Generation • Updated May 3, 2024 • 15

LoneStriker/Llama3-ChatQA-1.5-70B-4.65bpw-h6-exl2

Text Generation • Updated May 3, 2024 • 14

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.8-exl2

Text Generation • Updated May 3, 2024 • 14

LoneStriker/Llama3-ChatQA-1.5-70B-5.0bpw-h6-exl2

Text Generation • Updated May 3, 2024 • 17

blockblockblock/Llama3-ChatQA-1.5-8B-bpw5-exl2

Text Generation • Updated May 3, 2024 • 13

LoneStriker/Llama3-ChatQA-1.5-70B-6.0bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 16

blockblockblock/Llama3-ChatQA-1.5-8B-bpw5.5-exl2

Text Generation • Updated May 3, 2024 • 14

blockblockblock/Llama3-ChatQA-1.5-8B-bpw6-exl2

Text Generation • Updated May 3, 2024 • 16

bartowski/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated May 4, 2024 • 106 • 9

alexcovo/Llama3-ChatQA-1.5-8B-256K-Q4_K_M-GGUF

Text Generation • Updated May 4, 2024

lmstudio-community/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated May 4, 2024 • 31 • 6

lmstudio-community/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 4, 2024 • 114 • 6

QuantFactory/NVIDIA-Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 6, 2024 • 310 • 2

LiteLLMs/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 28, 2024 • 2

ivanzou/fdsfsdf24e34e

Updated Jul 29, 2024

rollend/Llama3-ChatQA-1.5-8B-Q4_K_M-GGUF

Text Generation • Updated May 31, 2024

narainp/Llama3-ChatQA-1.5-8B-Q4_K_M-GGUF

Text Generation • Updated May 31, 2024 • 1

lyonsn4/Llama3-ChatQA-1.5-8B-Q3_K_M-GGUF

Text Generation • Updated Jun 7, 2024

FlorianJc/Llama3-ChatQA-1.5-8B-vllm-fp8

Text Generation • Updated Jul 17, 2024 • 20

Tech-Meld/Llama3-ChatQA-1.5-8B-Q4_K_S-GGUF

Text Generation • Updated Jun 30, 2024 • 1

FlorianJc/Llama3-ChatQA-1.5-8B-v2-vllm-fp8

Text Generation • Updated Jul 17, 2024 • 20

Rakuto/Llama3-ChatQA-1.5-8B-GPTQ-4bit

Text Generation • Updated Jul 8, 2024 • 22

kscommhit/Llama3-ChatQA-1.5-8B-Q8_0-GGUF

Text Generation • Updated Jul 10, 2024 • 3

maximalists/BRAG-Qwen2-1.5b-v0.1

Text Generation • Updated Aug 5, 2024 • 206 • 5

Kolapsicle/llama-3-nvidia-ChatQA-1.5-8B-Q5_K_M-GGUF

Text Generation • Updated Jul 11, 2024 • 4