Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

8,894

Full-text search

Active filters: pruna-ai

PrunaAI/Locutusque-Llama-3-Orca-2.0-8B-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 7

PrunaAI/Locutusque-Llama-3-Orca-2.0-8B-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/Locutusque-Llama-3-Orca-2.0-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 67

PrunaAI/ResplendentAI-Aura_v2_7B-bnb-8bit-smashed

Text Generation • Updated Jul 15, 2024 • 74

PrunaAI/ResplendentAI-Aura_v2_7B-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/ResplendentAI-Aura_v2_7B-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 4

PrunaAI/ResplendentAI-Aura_v2_7B-bnb-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 69

PrunaAI/ResplendentAI-Aura_v2_7B-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/ResplendentAI-Aura_v2_7B-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 7

PrunaAI/ResplendentAI-Aura_v2_7B-HQQ-1bit-smashed

Text Generation • Updated Jul 15, 2024 • 12

PrunaAI/ResplendentAI-Aura_v2_7B-HQQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 7

PrunaAI/ResplendentAI-Aura_v2_7B-HQQ-2bit-smashed

Text Generation • Updated Jul 15, 2024 • 8

PrunaAI/lmms-lab-LongVA-7B-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/lmms-lab-LongVA-7B-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/ResplendentAI-Aura_v2_7B-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 69

PrunaAI/Locutusque-Llama-3-Hercules-5.0-8B-bnb-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 68

PrunaAI/Locutusque-Llama-3-Hercules-5.0-8B-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 7

PrunaAI/Locutusque-Llama-3-Hercules-5.0-8B-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/Locutusque-Llama-3-Hercules-5.0-8B-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 8

PrunaAI/Locutusque-Llama-3-Hercules-5.0-8B-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 7

PrunaAI/microsoft-Phi-3-small-128k-instruct-bnb-8bit-smashed

Text Generation • Updated Jul 15, 2024 • 41

PrunaAI/microsoft-Phi-3-small-128k-instruct-HQQ-1bit-smashed

Text Generation • Updated Jul 15, 2024 • 13

PrunaAI/microsoft-Phi-3-small-128k-instruct-HQQ-2bit-smashed

Text Generation • Updated Jul 15, 2024 • 12

PrunaAI/Locutusque-Llama-3-Hercules-5.0-8B-HQQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 7

PrunaAI/Locutusque-Llama-3-Hercules-5.0-8B-HQQ-1bit-smashed

Text Generation • Updated Jul 15, 2024 • 8

PrunaAI/Locutusque-Llama-3-Hercules-5.0-8B-HQQ-2bit-smashed

Text Generation • Updated Jul 15, 2024 • 11

PrunaAI/microsoft-Phi-3-small-128k-instruct-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 7

PrunaAI/microsoft-Phi-3-small-128k-instruct-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 9

PrunaAI/microsoft-Phi-3-small-128k-instruct-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 8

PrunaAI/Qwen-Qwen1.5-1.8B-Chat-bnb-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 87