Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,830

Full-text search

Active filters: awq

TheBloke/Synthia-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 20 • 1

TheBloke/llama-2-13B-Guanaco-QLoRA-AWQ

Text Classification • Updated Nov 9, 2023 • 20

TheBloke/llama-2-7B-Guanaco-QLoRA-AWQ

Text Classification • Updated Nov 9, 2023 • 31 • 1

TheBloke/llama-2-70b-Guanaco-QLoRA-AWQ

Text Classification • Updated Nov 9, 2023 • 22

TheBloke/Llama-2-Coder-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 26 • 3

TheBloke/llama2-22B-daydreamer-v2-AWQ

Text Generation • Updated Nov 9, 2023 • 30

TheBloke/Llama2-22B-Daydreamer-v3-AWQ

Text Generation • Updated Nov 9, 2023 • 19 • 2

TheBloke/Yarn-Llama-2-13B-128K-AWQ

Text Generation • Updated Nov 9, 2023 • 21 • 2

TheBloke/Yarn-Llama-2-13B-64K-AWQ

Text Generation • Updated Nov 9, 2023 • 19

TheBloke/Yarn-Llama-2-7B-128K-AWQ

Text Generation • Updated Nov 9, 2023 • 27

TheBloke/Yarn-Llama-2-7B-64K-AWQ

Text Generation • Updated Nov 9, 2023 • 20

TheBloke/Kimiko-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 25

TheBloke/Kimiko-v2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 23 • 1

TheBloke/Llama-2-13B-LoRA-Assemble-AWQ

Text Generation • Updated Nov 9, 2023 • 21 • 1

TheBloke/Kimiko-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 22 • 1

TheBloke/Llama-2-7B-LoRA-Assemble-AWQ

Text Generation • Updated Nov 9, 2023 • 23 • 1

TheBloke/LlongOrca-7B-16K-AWQ

Text Generation • Updated Nov 9, 2023 • 22 • 1

TheBloke/Llama-2-70B-LoRA-Assemble-v2-AWQ

Text Generation • Updated Nov 9, 2023 • 24 • 1

TheBloke/OpenOrca-Platypus2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 26 • 3

TheBloke/OpenOrcaxOpenChat-Preview2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 24 • 1

TheBloke/CodeLlama-13B-oasst-sft-v10-AWQ

Text Generation • Updated Nov 9, 2023 • 26 • 1

TheBloke/Llama2-13B-MegaCode2-OASST-AWQ

Text Generation • Updated Nov 9, 2023 • 19 • 2

TheBloke/fiction.live-Kimiko-V2-70B-AWQ

Text Generation • Updated Nov 9, 2023 • 20

TheBloke/Llama2-70B-OASST-SFT-v10-AWQ

Text Generation • Updated Nov 9, 2023 • 39 • 2

TheBloke/OpenBuddy-Llama2-13B-v11.1-AWQ

Text Generation • Updated Nov 9, 2023 • 23 • 4

TheBloke/openchat_v3.2_super-AWQ

Text Generation • Updated Nov 9, 2023 • 19 • 1

TheBloke/OpenBuddy-Llama2-70b-v10.1-AWQ

Text Generation • Updated Nov 9, 2023 • 22 • 4

TheBloke/OpenAssistant-Llama2-13B-Orca-8K-3319-AWQ

Text Generation • Updated Nov 9, 2023 • 25 • 1

TheBloke/Lemur-70B-Chat-v1-AWQ

Text Generation • Updated Nov 9, 2023 • 26 • 1

TheBloke/Llama-2-PeanutButter_v19_R8-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 17 • 1