Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

8-bit precision

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6,812

Full-text search

Active filters: pruna-ai

PrunaAI/hf-tiny-model-private-tiny-random-BloomForCausalLM-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/hf-tiny-model-private-tiny-random-BloomForCausalLM-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/sdadas-polish-gpt2-xl-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/h2oai-h2ogpt-gm-oasst1-en-2048-falcon-7b-v3-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/h2oai-h2ogpt-gm-oasst1-en-2048-falcon-7b-v3-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 22

PrunaAI/euclaise-falcon_1b_stage2-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/daryl149-llama-2-7b-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/TheBloke-Llama-2-7B-fp16-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 27

PrunaAI/beomi-kykim-gpt3-kor-small_based_on_gpt2-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/vicgalle-gpt2-open-instruct-v1-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/elyza-ELYZA-japanese-Llama-2-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/beomi-kykim-gpt3-kor-small_based_on_gpt2-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/vicgalle-gpt2-open-instruct-v1-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/ytu-ce-cosmos-turkish-gpt2-large-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/daryl149-llama-2-7b-hf-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 14 • 1

PrunaAI/ybelkada-falcon-7b-sharded-bf16-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/NousResearch-Yarn-Mistral-7b-64k-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/OpenBuddy-openbuddy-openllama-7b-v12-bf16-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17 • 1

PrunaAI/ybelkada-falcon-7b-sharded-bf16-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/dbmdz-german-gpt2-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/ytu-ce-cosmos-turkish-gpt2-large-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/Open-Orca-Mistral-7B-SlimOrca-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/Cheng98-llama-160m-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/AI-Sweden-Models-gpt-sw3-126m-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/AI-Sweden-Models-gpt-sw3-126m-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/Cheng98-llama-160m-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/dbmdz-german-gpt2-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 22

PrunaAI/OpenBuddy-openbuddy-openllama-7b-v12-bf16-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 17