Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

19,761

Full-text search

Active filters: 4-bit

TheBloke/openbuddy-llama2-13b64k-v15-AWQ

Text Generation • Updated Dec 13, 2023 • 30 • 1

TheBloke/openbuddy-llama2-13b64k-v15-GPTQ

Text Generation • Updated Dec 13, 2023 • 31

IndicRAGware/mistral-hindi-qlora-RAG-7b-v0.1

Updated Dec 13, 2023 • 2 • 1

gokul00060/loara-chat-arm

Updated Dec 15, 2023 • 3

TheBloke/MadMix-v0.2-GPTQ

Text Generation • Updated Dec 13, 2023 • 25

TheBloke/MadMix-v0.2-AWQ

Text Generation • Updated Dec 13, 2023 • 21

TheBloke/SOLAR-10.7B-Instruct-v1.0-AWQ

Text Generation • Updated Dec 13, 2023 • 190 • 5

TheBloke/SOLAR-10.7B-Instruct-v1.0-GPTQ

Text Generation • Updated Dec 13, 2023 • 50 • 12

TheBloke/SOLAR-10.7B-v1.0-GPTQ

Text Generation • Updated Dec 13, 2023 • 28 • 2

TheBloke/SOLAR-10.7B-v1.0-AWQ

Text Generation • Updated Dec 13, 2023 • 19 • 1

TheBloke/blossom-v3_1-yi-34b-AWQ

Text Generation • Updated Dec 13, 2023 • 20

TheBloke/blossom-v3_1-yi-34b-GPTQ

Text Generation • Updated Dec 13, 2023 • 18

TheBloke/Nyxene-v3-11B-AWQ

Text Generation • Updated Dec 13, 2023 • 21 • 1

TheBloke/meditron-7B-chat-AWQ

Text Generation • Updated Dec 13, 2023 • 20

TheBloke/Ana-v1-m7-AWQ

Text Generation • Updated Dec 13, 2023 • 22 • 2

TheBloke/Mixtral-SlimOrca-8x7B-GPTQ

Text Generation • Updated Dec 14, 2023 • 19 • 11

TheBloke/v1olet_merged_dpo_7B_v3-AWQ

Text Generation • Updated Dec 13, 2023 • 23 • 1

TheBloke/v1olet_merged_dpo_7B_v4-AWQ

Text Generation • Updated Dec 13, 2023 • 18 • 1

TheBloke/Nyxene-v3-11B-GPTQ

Text Generation • Updated Dec 13, 2023 • 20 • 2

TheBloke/LeoScorpius-7B-AWQ

Text Generation • Updated Dec 13, 2023 • 21 • 1

TheBloke/meditron-7B-chat-GPTQ

Text Generation • Updated Dec 13, 2023 • 23

TheBloke/Ana-v1-m7-GPTQ

Text Generation • Updated Dec 13, 2023 • 23 • 2

TheBloke/bagel-dpo-7B-v0.1-AWQ

Text Generation • Updated Dec 13, 2023 • 20

TheBloke/bagel-7B-v0.1-AWQ

Text Generation • Updated Dec 13, 2023 • 20

TheBloke/bagel-7B-v0.1-GPTQ

Text Generation • Updated Dec 13, 2023 • 26

TheBloke/bagel-dpo-7B-v0.1-GPTQ

Text Generation • Updated Dec 13, 2023 • 28

TheBloke/v1olet_merged_dpo_7B_v3-GPTQ

Text Generation • Updated Dec 13, 2023 • 25 • 1

TheBloke/v1olet_merged_dpo_7B_v4-GPTQ

Text Generation • Updated Dec 13, 2023 • 19 • 1

TheBloke/LeoScorpius-7B-GPTQ

Text Generation • Updated Dec 13, 2023 • 23 • 1

ZeyuMax/Test33M

Text Generation • Updated Dec 14, 2023 • 19