Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

136

Full-text search

Active filters: Qwen2.5

ctranslate2-4you/Qwen2.5-7B-Instruct-ct2-int8

Text Generation • Updated Nov 25, 2024 • 8

ctranslate2-4you/Qwen2.5-14B-Instruct-ct2-int8

Updated Nov 25, 2024 • 11

mradermacher/Neumind-Math-7B-Instruct-GGUF

Updated Dec 6, 2024 • 131 • 1

mradermacher/Neumind-Math-7B-Instruct-i1-GGUF

Updated Dec 6, 2024 • 357 • 1

mradermacher/Novaeus-Promptist-7B-Instruct-GGUF

Updated Dec 6, 2024 • 353 • 1

mradermacher/Acrux-500M-o1-Journey-GGUF

Updated Dec 8, 2024 • 605

mradermacher/Acrux-500M-o1-Journey-i1-GGUF

Updated Dec 8, 2024 • 322

mradermacher/QwQ-LCoT-3B-Instruct-GGUF

Updated Dec 12, 2024 • 180

mradermacher/QwQ-LCoT-3B-Instruct-i1-GGUF

Updated Dec 12, 2024 • 493

QuantFactory/Neumind-Math-7B-Instruct-GGUF

Text Generation • Updated Dec 13, 2024 • 88 • 1

mradermacher/QwQ-LCoT-7B-Instruct-GGUF

Updated Dec 25, 2024 • 224 • 1

mradermacher/QwQ-LCoT-7B-Instruct-i1-GGUF

Updated Dec 25, 2024 • 468 • 1

bartowski/QwQ-LCoT-7B-Instruct-GGUF

Text Generation • Updated Dec 16, 2024 • 2.27k • 9

Triangle104/Qwen-UMLS-7B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Dec 27, 2024 • 5

Triangle104/Qwen-UMLS-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 27, 2024 • 5

Triangle104/Qwen-UMLS-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Dec 27, 2024 • 6

Triangle104/Qwen-UMLS-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Dec 27, 2024 • 6

Triangle104/Qwen-UMLS-7B-Instruct-Q6_K-GGUF

Text Generation • Updated Dec 27, 2024 • 2

Triangle104/Qwen-UMLS-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Dec 27, 2024 • 3

Triangle104/QwQ-LCoT-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Dec 29, 2024 • 4

Triangle104/QwQ-LCoT-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 29, 2024 • 9

Triangle104/QwQ-LCoT-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Dec 29, 2024 • 4

Triangle104/QwQ-LCoT-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Dec 29, 2024 • 14

Triangle104/QwQ-LCoT-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Dec 29, 2024 • 4

Triangle104/QwQ-LCoT-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Dec 29, 2024 • 8

itlwas/QwQ-LCoT-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Feb 2 • 11

itlwas/QwQ-LCoT-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 29, 2024 • 12

Triangle104/QwQ-LCoT-7B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Dec 31, 2024 • 7

Triangle104/QwQ-LCoT-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 31, 2024 • 9

Triangle104/QwQ-LCoT-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Dec 31, 2024 • 6