-
-
-
-
-
-
Inference status
Active filters:
awq
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
•
Updated
•
431k
•
57
Qwen/Qwen2.5-72B-Instruct-AWQ
Text Generation
•
Updated
•
5.58k
•
18
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
•
Updated
•
161k
•
76
Qwen/Qwen2-VL-7B-Instruct-AWQ
Image-Text-to-Text
•
Updated
•
29.9k
•
27
Qwen/Qwen2.5-32B-Instruct-AWQ
Text Generation
•
Updated
•
6.83k
•
23
Qwen/Qwen2.5-Coder-7B-Instruct-AWQ
Text Generation
•
Updated
•
2.12k
•
3
TheBloke/llava-v1.5-13B-AWQ
Text Generation
•
Updated
•
152
•
33
TheBloke/llama2_70b_chat_uncensored-AWQ
Text Generation
•
Updated
•
37
•
6
TheBloke/Wizard-Vicuna-13B-Uncensored-AWQ
Text Generation
•
Updated
•
54
•
13
TheBloke/WizardLM-7B-uncensored-AWQ
Text Generation
•
Updated
•
40
•
4
TheBloke/fin-llama-33B-AWQ
Text Generation
•
Updated
•
19
•
5
TheBloke/LLaMA2-13B-Tiefighter-AWQ
Text Generation
•
Updated
•
291
•
38
TheBloke/MetaMath-Mistral-7B-AWQ
Text Generation
•
Updated
•
41
•
1
TheBloke/Yarn-Mistral-7B-128k-AWQ
Text Generation
•
Updated
•
778
•
71
TheBloke/OpenHermes-2.5-Mistral-7B-AWQ
Text Generation
•
Updated
•
10.7k
•
21
TheBloke/deepseek-coder-6.7B-instruct-AWQ
Text Generation
•
Updated
•
2.73k
•
15
TheBloke/deepseek-coder-6.7B-base-AWQ
Text Generation
•
Updated
•
10.4k
•
8
ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ
Text Generation
•
Updated
•
23.3k
•
15
TheBloke/dolphin-2.6-mistral-7B-AWQ
Text Generation
•
Updated
•
233
•
8
TheBloke/CodeLlama-70B-Instruct-AWQ
Text Generation
•
Updated
•
60
•
13
TheBloke/CodeLlama-70B-Python-AWQ
Text Generation
•
Updated
•
69
•
6
TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ
Updated
•
4.74k
•
20
alexandreteles/bonito-v1-awq
Text2Text Generation
•
Updated
•
164
•
2
anyisalin/L3-70B-Euryale-v2.1-AWQ
Text Generation
•
Updated
•
88
•
3
solidrust/Phi-3-mini-128k-instruct-AWQ
Text Generation
•
Updated
•
262
•
1
TechxGenus/Mistral-Large-Instruct-2407-AWQ
Text Generation
•
Updated
•
2.58k
•
9
dahara1/llama3.1-8b-Instruct-awq
Text Generation
•
Updated
•
79
•
2
solidrust/dolphin-2.9.4-llama3.1-8b-AWQ
Text Generation
•
Updated
•
305
•
3
team-hatakeyama-phase2/Tanuki-8B-dpo-v1.0-AWQ
Text Generation
•
Updated
•
989
•
1
solidrust/gemma-2-9b-it-AWQ
Text Generation
•
Updated
•
1.53k
•
2