Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,829

Full-text search

Active filters: awq

PrunaAI/M4-ai-tau-0.5B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/openchat-openchat_3.5-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 7

PrunaAI/snorkelai-Snorkel-Mistral-PairRM-DPO-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 9

PrunaAI/allenai-tulu-2-dpo-13b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/Doctor-Shotgun-TinyLlama-1.1B-32k-Instruct-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/Xwin-LM-Xwin-Math-7B-V1.1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/simecek-cswikimistral_0.1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/PORTULAN-gervasio-7b-portuguese-ptbr-decoder-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/cognitivecomputations-dolphin-2.9.2-Phi-3-Medium-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/codellama-CodeLlama-13b-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/UnicomLLM-Unichat-llama3-Chinese-8B-28K-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/AI-Sweden-Models-Llama-3-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/alfredplpl-Llama-3-8B-Instruct-Ja-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/mychen76-mistral7b_ocr_to_json_v1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/sail-Sailor-14B-Chat-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/Nexusflow-NexusRaven-V2-13B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/TheDrummer-Moistral-11B-v2-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

Weni/ZeroShot-Agents-Llama3-4.0.26-DPO-AWQ

Text Generation • Updated Jun 23 • 23

PrunaAI/TinyLlama-TinyLlama_v1.1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/dreamgen-opus-v1.2-llama-3-8b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/bineric-NorskGPT-Llama3-8b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/01-ai-Yi-6B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/IDEA-CCNL-Ziya2-13B-Base-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/beomi-gemma-mling-7b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/arise-sustech-llm4decompile-6.7b-uo-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/nicholasKluge-TeenyTinyLlama-160m-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/lightblue-suzume-llama-3-8B-multilingual-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/cognitivecomputations-Dolphin-2.9.1-Phi-3-Kensho-4.5B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/maywell-Mistral-ko-7B-v0.1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/vilm-vinallama-7b-chat-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15