Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

8-bit precision

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6,790

Full-text search

Active filters: pruna-ai

PrunaAI/Locutusque-gpt2-xl-conversational-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/NousResearch-Yarn-Llama-2-7b-128k-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 21

PrunaAI/openai-community-openai-gpt-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/beomi-llama-2-ko-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/Salesforce-codegen-350M-mono-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/Salesforce-codegen-350M-mono-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/cognitivecomputations-dolphin-2.6-mistral-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/microsoft-phi-1-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 25

PrunaAI/nomic-ai-gpt4all-falcon-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/ai-forever-rugpt3large_based_on_gpt2-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/togethercomputer-Llama-2-7B-32K-Instruct-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/abhishekchohan-mistral-7B-forest-dpo-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/Locutusque-gpt2-xl-conversational-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/NousResearch-Nous-Hermes-llama-2-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/HuggingFaceM4-tiny-random-MistralForCausalLM-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/HuggingFaceM4-tiny-random-MistralForCausalLM-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/ai-forever-rugpt3large_based_on_gpt2-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/HuggingFaceH4-mistral-7b-sft-beta-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 21

PrunaAI/NousResearch-Yarn-Llama-2-7b-128k-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/KoboldAI-GPT-J-6B-Janeway-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/NousResearch-Nous-Hermes-llama-2-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/codellama-CodeLlama-7b-Python-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/sdadas-polish-gpt2-xl-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 23

PrunaAI/abhinand-tamil-llama-7b-instruct-v0.1-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 22

PrunaAI/elyza-ELYZA-japanese-Llama-2-7b-fast-instruct-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/KoboldAI-GPT-J-6B-Janeway-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/Salesforce-codegen-350M-multi-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/abhinand-tamil-llama-7b-instruct-v0.1-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/vicgalle-gpt2-alpaca-gpt4-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/akreal-tiny-random-LlamaForCausalLM-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17