Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

8-bit precision

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6,791

Full-text search

Active filters: pruna-ai

PrunaAI/bigcode-gpt_bigcode-santacoder-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/vicgalle-gpt2-alpaca-gpt4-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/Salesforce-codegen-350M-multi-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/akreal-tiny-random-BloomForCausalLM-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/akreal-tiny-random-BloomForCausalLM-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/akreal-tiny-random-LlamaForCausalLM-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/abhishekchohan-mistral-7B-forest-dpo-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/stanford-crfm-alias-gpt2-small-x21-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/elyza-ELYZA-japanese-Llama-2-7b-fast-instruct-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/bigcode-gpt_bigcode-santacoder-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/rinna-japanese-gpt2-small-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/openaccess-ai-collective-tiny-mistral-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/rinna-japanese-gpt2-small-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 22

PrunaAI/ai-forever-rugpt3small_based_on_gpt2-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/ai-forever-rugpt3small_based_on_gpt2-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/openaccess-ai-collective-tiny-mistral-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/Open-Orca-Mistral-7B-SlimOrca-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/stanford-crfm-alias-gpt2-small-x21-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/illuin-tiny-random-FalconForCausalLM-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/illuin-tiny-random-FalconForCausalLM-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/HooshvareLab-gpt2-fa-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/Xenova-llama2.c-stories15M-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 30

PrunaAI/HooshvareLab-gpt2-fa-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/Xenova-llama2.c-stories15M-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 28

PrunaAI/IlyasMoutawwakil-tiny-random-llama-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/TheBloke-Llama-2-7B-fp16-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/IlyasMoutawwakil-tiny-random-llama-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/hfl-chinese-llama-2-1.3b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/euclaise-falcon_1b_stage2-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/hfl-chinese-llama-2-1.3b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18