Edit Models filters

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

7,604

Full-text search

Active filters: pruna-ai

PrunaAI/google-gemma-1.1-2b-it-HQQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 2

PrunaAI/google-gemma-1.1-2b-it-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/google-gemma-1.1-2b-it-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/google-gemma-1.1-2b-it-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 3

PrunaAI/google-gemma-1.1-2b-it-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/LumiOpen-Viking-13B-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/LumiOpen-Viking-13B-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/openchat-openchat-3.5-1210-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/openchat-openchat-3.5-1210-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/DeepMount00-Mistral-RAG-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 3

PrunaAI/DeepMount00-Mistral-RAG-bnb-8bit-smashed

Text Generation • Updated Jul 16, 2024 • 3

PrunaAI/Alibaba-NLP-gte-Qwen2-1.5B-instruct-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 11

PrunaAI/DeepMount00-Mistral-RAG-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/DeepMount00-Mistral-RAG-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/DeepMount00-Mistral-RAG-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/DeepMount00-Mistral-RAG-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 3

PrunaAI/Alibaba-NLP-gte-Qwen2-1.5B-instruct-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 3

PrunaAI/DeepMount00-Mistral-RAG-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 4

PrunaAI/Alibaba-NLP-gte-Qwen2-1.5B-instruct-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 3

PrunaAI/Alibaba-NLP-gte-Qwen2-1.5B-instruct-HQQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 2

PrunaAI/Alibaba-NLP-gte-Qwen2-1.5B-instruct-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/Alibaba-NLP-gte-Qwen2-1.5B-instruct-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 3

PrunaAI/Alibaba-NLP-gte-Qwen2-1.5B-instruct-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/Alibaba-NLP-gte-Qwen2-1.5B-instruct-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/ibm-granite-granite-3b-code-instruct-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 5

PrunaAI/ibm-granite-granite-3b-code-instruct-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 4

PrunaAI/ibm-granite-granite-3b-code-instruct-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 2

PrunaAI/ibm-granite-granite-3b-code-instruct-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/ibm-granite-granite-3b-code-instruct-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/ibm-granite-granite-3b-code-instruct-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 1