Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,632

Full-text search

Active filters: awq

agi-designer/Aspera-SWE-Llama-7b-updated-4bit-awq

Text Generation • Updated Jun 24, 2024 • 22

elyza/Llama-3-ELYZA-JP-8B-AWQ

Text Generation • Updated Jun 26, 2024 • 1.56k • 3

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-v0.9-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 19

Weni/ZeroShot-Agents-Llama3-4.0.29-DPO-AWQ

Text Generation • Updated Jun 25, 2024 • 21

macadeliccc/dolphin-2.9.2-qwen2-7b-AWQ

Text Generation • Updated Jun 25, 2024 • 18

Weni/ZeroShot-Agents-Llama3-4.0.30-DPO-AWQ

Text Generation • Updated Jun 25, 2024 • 23

Weni/ZeroShot-Agents-Llama3-4.0.31-DPO-AWQ

Text Generation • Updated Jun 25, 2024 • 20

Weni/ZeroShot-Agents-Llama3-4.0.32-DPO-AWQ

Text Generation • Updated Jun 26, 2024 • 14

Weni/ZeroShot-Agents-Llama3-4.0.33-DPO-AWQ

Text Generation • Updated Jun 26, 2024 • 20

blehyaric/llama-2-7b-chat-hf-awq-gemm

Text Generation • Updated Jun 26, 2024 • 17

shuyuej/MedLLaMA3-70B-base-AWQ

Text Generation • Updated Jun 26, 2024

Fulcrum-AI/Ryze-AWQ-4bit

Text Generation • Updated Jun 26, 2024 • 17

blehyaric/llama-2-7b-chat-hf-awq-gemv

Text Generation • Updated Jun 26, 2024 • 20

blehyaric/llama-2-7b-chat-hf-awq-quick

Text Generation • Updated Jun 26, 2024 • 21

Weni/ZeroShot-Agents-Llama3-4.0.35-DPO-AWQ

Text Generation • Updated Jun 26, 2024 • 17

Weni/ZeroShot-Agents-Llama3-4.0.36-DPO-AWQ

Text Generation • Updated Jun 26, 2024 • 20

Weni/ZeroShot-Agents-Llama3-4.0.34-DPO-AWQ

Text Generation • Updated Jun 26, 2024 • 17

Sharvin-UD/Mistral-7B-Instruct-v0.3-AWQ

Text Generation • Updated Jun 27, 2024 • 18

Weni/ZeroShot-Agents-Llama3-4.0.37-DPO-AWQ

Text Generation • Updated Jun 27, 2024 • 20

PrunaAI/llmware-slim-sql-1b-v0-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 22

shunran/dolphin-2.9.3-yi-1.5-34b-32k-awq

Text Generation • Updated Jun 28, 2024 • 20

dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-awq

Text Generation • Updated Jun 27, 2024 • 38 • 1

Weni/ZeroShot-Agents-Llama3-4.0.37-DPO-480-AWQ

Text Generation • Updated Jun 27, 2024 • 17

dan-kwiat/codestral-learn-60-epoch-4-f-awq

Text Generation • Updated Jun 27, 2024 • 21

Weni/ZeroShot-Agents-Llama3-4.0.39-DPO-AWQ

Text Generation • Updated Jun 27, 2024 • 20

Weni/ZeroShot-Agents-Llama3-4.0.40-DPO-AWQ

Text Generation • Updated Jun 27, 2024 • 28

Ichigo2899/arcee-ai-Arcee-Spark-AWQ

Text Generation • Updated Jun 27, 2024 • 23

VincentChoi00/STOCK_SOLAR-10.7B-AWQ

Text Generation • Updated Jul 1, 2024 • 22

cc8055/4bitfinetunnedtinyllamagroq-AWQ

Text Generation • Updated Jun 28, 2024 • 21

Weni/ZeroShot-Agents-Llama3-4.0.41-DPO-AWQ

Text Generation • Updated Jun 28, 2024 • 27