Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,635

Full-text search

Active filters: awq

samim2024/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jun 21, 2024 • 19

tarun99121/mistral-tool-generator-awq

Text Generation • Updated Jun 21, 2024 • 10

Weni/ZeroShot-Agents-Llama3-4.0.22-DPO-AWQ

Text Generation • Updated Jun 21, 2024 • 19

dan-kwiat/test-learn-60-epoch-4-d-awq

Text Generation • Updated Jun 21, 2024 • 17

alegchenko/aya-23-35B-AWQ-ru-v0

Text Generation • Updated Jun 21, 2024 • 24

Weni/ZeroShot-Agents-Llama3-4.0.23-DPO-AWQ

Text Generation • Updated Jun 21, 2024 • 17

IlyaGusev/saiga_aya_23_35b_sft_m1_d5_awq_4bit

Text Generation • Updated Jun 22, 2024 • 18 • 3

Weni/ZeroShot-Agents-Llama3-4.0.24-DPO-AWQ

Text Generation • Updated Jun 22, 2024 • 15

Weni/ZeroShot-Agents-Llama3-4.0.25-DPO-AWQ

Text Generation • Updated Jun 22, 2024 • 18

darkcloudai/huskylm-2.5-8b-AWQ

Text Generation • Updated Jun 22, 2024 • 20

PrunaAI/llmware-slim-tags-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 18

PrunaAI/THU-KEG-ADELIE-SFT-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 18

PrunaAI/RESMPDEV-Gemma-Wukong-2b-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 15

PrunaAI/PipableAI-pip-library-etl-1.3b-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 20

PrunaAI/ajibawa-2023-Scarlett-Llama-3-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 19

PrunaAI/beomi-Llama-3-KoEn-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 17

PrunaAI/RESMPDEV-Wukong-0.1-Mistral-7B-v0.2-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 19

PrunaAI/M4-ai-tau-0.5B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 21

PrunaAI/openchat-openchat_3.5-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 13

PrunaAI/snorkelai-Snorkel-Mistral-PairRM-DPO-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 16

PrunaAI/allenai-tulu-2-dpo-13b-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 18

PrunaAI/Doctor-Shotgun-TinyLlama-1.1B-32k-Instruct-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 18

PrunaAI/Xwin-LM-Xwin-Math-7B-V1.1-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 19

PrunaAI/simecek-cswikimistral_0.1-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 17

PrunaAI/PORTULAN-gervasio-7b-portuguese-ptbr-decoder-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 20

PrunaAI/cognitivecomputations-dolphin-2.9.2-Phi-3-Medium-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 18

PrunaAI/codellama-CodeLlama-13b-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 19

PrunaAI/UnicomLLM-Unichat-llama3-Chinese-8B-28K-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 19

PrunaAI/AI-Sweden-Models-Llama-3-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 19

PrunaAI/alfredplpl-Llama-3-8B-Instruct-Ja-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 18