Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,829

Full-text search

Active filters: awq

PrunaAI/cognitivecomputations-dolphin-2.2.1-mistral-7b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/allenai-tulu-2-7b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/beomi-Yi-Ko-6B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/sambanovasystems-SambaLingo-Arabic-Base-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 59

PrunaAI/galatolo-cerbero-7b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 9

PrunaAI/cognitivecomputations-dolphin-2.1-mistral-7b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/nicholasKluge-TeenyTinyLlama-460m-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/HiTZ-latxa-7b-v1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/NurtureAI-Meta-Llama-3-8B-Instruct-64k-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/beowolx-MistralHermes-CodePro-7B-v1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/HPAI-BSC-Llama3-Aloe-8B-Alpha-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/PipableAI-pip-code-bandit-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/kaist-ai-janus-7b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/MediaTek-Research-Breeze-7B-Instruct-v1_0-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/capleaf-T-Llama-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/Rakuten-RakutenAI-7B-instruct-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/NousResearch-Nous-Hermes-Llama2-13b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/maywell-Synatra-7B-v0.3-Translation-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/fnlp-AnyGPT-chat-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/sambanovasystems-SambaLingo-Hungarian-Chat-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/rombodawg-Llama-3-8B-Instruct-Coder-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/IlyaGusev-saiga_mistral_7b_merged-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/codellama-CodeLlama-7b-Instruct-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/tokyotech-llm-Swallow-7b-plus-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/llm-jp-llm-jp-13b-v2.0-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/Undi95-Llama-3-LewdPlay-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/ajibawa-2023-WikiHow-Mistral-Instruct-7B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/failspy-Llama-3-8B-Instruct-MopeyMule-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/tokyotech-llm-Swallow-7b-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/ajibawa-2023-Uncensored-Jordan-13B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 22