Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

19,718

Full-text search

Active filters: 8-bit

sboughorbel/BLOOMChat-176B-v1-8bit

Text Generation • Updated Jul 1, 2023 • 10 • 2

osiria/prime-6.6b

Text Generation • Updated Jul 6, 2023 • 23

ethzanalytics/open_llama_13b-sharded-8bit

Text Generation • Updated Jul 2, 2023 • 7

vivekraina/bloom-560m-8bit

Text Generation • Updated Jul 4, 2023 • 7

vivekraina/falcon-7b-8bit

Text Generation • Updated Jul 4, 2023 • 8

vivekraina/falcon-7b-Instruct-8bit

Text Generation • Updated Jul 4, 2023 • 9

anejaisha/output2

Text2Text Generation • Updated Jul 5, 2023 • 1

avaassadi/bloom-1b1-alpaca-fine

Text Generation • Updated Jul 6, 2023 • 16

vivekraina/Falcon-instruct-8bit-test

Text Generation • Updated Jul 6, 2023 • 5

Abzu/mpt-7b-q8

Text Generation • Updated Jul 6, 2023 • 21 • 1

Abzu/mpt-7b-instruct-q8

Text Generation • Updated Jul 7, 2023 • 24 • 2

Abzu/mpt-7b-chat-q8

Text Generation • Updated Jul 7, 2023 • 23 • 1

Abzu/mpt-7b-storywriter-q8

Text Generation • Updated Jul 7, 2023 • 20 • 2

Abzu/mpt-30b-q8

Text Generation • Updated Jul 7, 2023 • 21 • 3

Abzu/mpt-30b-chat-q8

Text Generation • Updated Jul 7, 2023 • 21 • 1

Mediocreatmybest/blip2-opt-2.7b_8bit

Image-to-Text • Updated Aug 27, 2023 • 187 • 2

Mediocreatmybest/blip2-opt-6.7b_8bit

Image-to-Text • Updated Aug 27, 2023 • 9 • 1

Mediocreatmybest/blip2-flan-t5-xxl_8bit

Visual Question Answering • Updated Jul 9, 2023 • 1

gretelai/falcon-7b

Text Generation • Updated Jul 10, 2023 • 62

sgowdaks/falcon-40b-instruct-8bit

Updated Jul 11, 2023 • 1

FabbriSimo01/GPT_Large_Quantized

Text Generation • Updated Jul 15, 2023 • 922

FabbriSimo01/Bloom_1b_Quantized

Text Generation • Updated Jul 15, 2023 • 923

FabbriSimo01/Facebook_opt_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 906

FabbriSimo01/Cerebras_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 928

vivekraina/Falcon-8bit-test

Text Generation • Updated Jul 19, 2023 • 106

trillionmonster/Baichuan-13B-Chat-8bit

Text Generation • Updated Jul 25, 2023 • 16 • 9

vivekraina/Llama-2-7b-hf-8bit

Text Generation • Updated Jul 20, 2023 • 15 • 3

guardrail/llama-2-7b-guanaco-8bit-sharded

Text Generation • Updated Jul 20, 2023 • 17 • 4

richardr1126/spider-skeleton-wizard-coder-8bit

Text Generation • Updated Jul 26, 2023 • 7 • 1

rbiswasfc/falcon-7b-8bit

Text Generation • Updated Jul 21, 2023 • 51