Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,906

Full-text search

Active filters: chat

anthracite-org/magnum-v2-4b

Text Generation • Updated Aug 27, 2024 • 131 • 20

Triangle104/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

Updated Aug 24, 2024 • 17 • 3

Triangle104/Hermes-3-Llama-3.1-8B-Q6_K-GGUF

Updated Aug 24, 2024 • 2 • 1

Triangle104/Hermes-3-Llama-3.1-8B-Q8_0-GGUF

Updated Aug 24, 2024 • 5 • 1

Niansuh/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 25, 2024 • 10 • 1

Niansuh/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 25, 2024 • 6 • 1

backyardai/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 29, 2024 • 225 • 2

backyardai/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 30, 2024 • 156 • 2

Ffftdtd5dtft/Hermes-3-Llama-3.1-8B-IQ1_S-GGUF

Updated Sep 4, 2024 • 33 • 1

jburmeister/Hermes-3-Llama-3.1-8B-GGUF

Updated Sep 5, 2024 • 1 • 1

Qwen/Qwen2.5-Math-72B-Instruct

Text Generation • Updated Sep 23, 2024 • 4.9k • 24

bartowski/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 3.16k • 12

bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 31.1k • 27

bartowski/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 6.1k • 32

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 18, 2024 • 23.3k • 12

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 17.6k • 14

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 38.5k • 14

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 10.9k • 23

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 4.89k • 17

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.75k • 6

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 13.7k • 17

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 992k • 54

Qwen/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 8.24k • 29

Qwen/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 20.5k • 28

Qwen/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 27.9k • 31

Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 17.2k • 50

Qwen/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 4.26k • 24

Qwen/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 13.4k • 26

Qwen/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 4.72k • 35

lmstudio-community/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 12k • 7