Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

253

Full-text search

Active filters: nvidia

nold/OpenMath-Mistral-7B-v0.1-hf-GGUF

Updated Feb 16, 2024 • 27

bartowski/OpenMath-Mistral-7B-v0.1-hf-exl2

Text Generation • Updated Feb 16, 2024

bartowski/OpenMath-CodeLlama-7b-Python-hf-exl2

Text Generation • Updated Feb 16, 2024

nvidia/Llama2-13B-SteerLM-RM

Text Generation • Updated Feb 22, 2024 • 15 • 8

nvidia/NV-Llama2-13B-RLHF-RM

Text Generation • Updated Mar 9, 2024 • 9 • 3

bartowski/Llama-3-ChatQA-1.5-8B-exl2

Text Generation • Updated May 2, 2024 • 3 • 3

fakezeta/Llama3-ChatQA-1.5-8B-ov-int8

Text Generation • Updated May 2, 2024 • 7 • 1

grimjim/llama-3-nvidia-ChatQA-1.5-8B

Text Generation • Updated May 2, 2024 • 274 • 4

bartowski/Llama-3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 2, 2024 • 282 • 41

bartowski/ChatQA-1.5-8B-AWQ

Text Generation • Updated May 2, 2024 • 25

mlx-community/Llama3-ChatQA-1.5-8B-4bit

Text Generation • Updated May 2, 2024 • 17

mlx-community/Llama3-ChatQA-1.5-8B-8bit

Text Generation • Updated May 2, 2024 • 16

LoneStriker/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 2, 2024 • 6 • 1

LoneStriker/Llama3-ChatQA-1.5-8B-3.0bpw-h6-exl2

Text Generation • Updated May 2, 2024 • 14

LoneStriker/Llama3-ChatQA-1.5-8B-4.0bpw-h6-exl2

Text Generation • Updated May 2, 2024 • 13 • 1

LoneStriker/Llama3-ChatQA-1.5-8B-5.0bpw-h6-exl2

Text Generation • Updated May 2, 2024 • 15

LoneStriker/Llama3-ChatQA-1.5-8B-6.0bpw-h6-exl2

Text Generation • Updated May 2, 2024 • 14

LoneStriker/Llama3-ChatQA-1.5-8B-8.0bpw-h8-exl2

Text Generation • Updated May 2, 2024 • 14

mradermacher/Llama3-ChatQA-1.5-8B-GGUF

Updated May 5, 2024 • 46

mradermacher/Llama3-ChatQA-1.5-8B-i1-GGUF

Updated May 5, 2024 • 28 • 1

mradermacher/Llama3-ChatQA-1.5-70B-GGUF

Updated May 5, 2024 • 9 • 1

mradermacher/Llama3-ChatQA-1.5-70B-i1-GGUF

Updated May 5, 2024 • 125 • 10

Sreenington/Llama-3-8B-ChatQA-AWQ

Text Generation • Updated May 5, 2024 • 21 • 2

beratcmn/Llama3-ChatQA-1.5-8B-lora

Text Generation • Updated May 3, 2024 • 4

beratcmn/Llama3-ChatQA-1.5-8B-256K

Text Generation • Updated May 3, 2024 • 22 • 6

LoneStriker/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated May 3, 2024 • 3 • 2

blockblockblock/Llama3-ChatQA-1.5-8B-bpw2.25-exl2

Text Generation • Updated May 3, 2024 • 15

blockblockblock/Llama3-ChatQA-1.5-8B-bpw2.5-exl2

Text Generation • Updated May 3, 2024 • 15

blockblockblock/Llama3-ChatQA-1.5-8B-bpw3-exl2

Text Generation • Updated May 3, 2024 • 16

blockblockblock/Llama3-ChatQA-1.5-8B-bpw3.5-exl2

Text Generation • Updated May 3, 2024 • 14