Edit Models filters

Model Tree

Qwen/Qwen2-7B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

71

Full-text search

Active filters: Qwen/Qwen2-7B-Instruct

CHE-72/Qwen2-7B-Instruct-Q6_K-GGUF

Text Generation • Updated Jun 21, 2024 • 2

CHE-72/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jun 21, 2024

CHE-72/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 21, 2024

CHE-72/Qwen2-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Jun 21, 2024 • 1

CHE-72/Qwen2-7B-Instruct-Q5_0-GGUF

Text Generation • Updated Jun 21, 2024

CHE-72/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 21, 2024

CHE-72/Qwen2-7B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Jun 21, 2024

CHE-72/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Jun 21, 2024 • 2

CHE-72/Qwen2-7B-Instruct-Q3_K_L-GGUF

Text Generation • Updated Jun 21, 2024 • 1

CHE-72/Qwen2-7B-Instruct-Q3_K_M-GGUF

Text Generation • Updated Jun 21, 2024

CHE-72/Qwen2-7B-Instruct-Q3_K_S-GGUF

Text Generation • Updated Jun 21, 2024 • 2

CHE-72/Qwen2-7B-Instruct-Q2_K-GGUF

Text Generation • Updated Jun 21, 2024

CHE-72-ZLab/Alibaba-Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 23, 2024 • 33

Minuano/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 10, 2024 • 1

martintomov/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 11, 2024

PrunaAI/Qwen-Qwen2-7B-Instruct-bnb-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 22

PrunaAI/Qwen-Qwen2-7B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 20

Kondara/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 26, 2024

TAYUCOKI/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 29, 2024

nguyenphuthien/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 30, 2024 • 2

TrentJohnsongtri/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 30, 2024 • 1

blogcncom/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Aug 5, 2024 • 3

yashagra/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Aug 8, 2024 • 1

GPT4All-Community/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 562

ysn-rfd/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 17, 2024 • 2

hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Sep 17, 2024

Junrui2021/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 11, 2024 • 1

noway-wf/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 24, 2024

HEleven1/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 26, 2024 • 1

chaoxiao/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 27, 2024