Edit Models filters

Inference status

Misc

arxiv: 2204.06745

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

69

Full-text search

Active filters: 2204.06745

osanseviero/stable-code-3b-Q2_K-GGUF

Updated Mar 26, 2024 • 5 • 1

TechxGenus/stable-code-3b-AWQ

Text Generation • Updated Apr 7, 2024 • 17 • 1

TechxGenus/stable-code-3b-GPTQ

Text Generation • Updated Apr 7, 2024 • 9

RichardErkhov/EleutherAI_-_gpt-neox-20b-4bits

Text Generation • Updated Apr 23, 2024 • 11

RichardErkhov/EleutherAI_-_gpt-neox-20b-8bits

Text Generation • Updated Apr 23, 2024 • 10

stabilityai/japanese-stablelm-2-base-1_6b

Text Generation • Updated May 2, 2024 • 24 • 12

RichardErkhov/stabilityai_-_stablelm-2-1_6b-4bits

Text Generation • Updated May 3, 2024 • 21

RichardErkhov/stabilityai_-_stablelm-2-1_6b-8bits

Text Generation • Updated May 3, 2024 • 22

RichardErkhov/stabilityai_-_stable-code-3b-4bits

Text Generation • Updated May 4, 2024 • 19

RichardErkhov/stabilityai_-_stable-code-3b-8bits

Text Generation • Updated May 4, 2024 • 21

RichardErkhov/stabilityai_-_stablelm-2-12b-4bits

Text Generation • Updated May 11, 2024 • 24

kroonen/stablelm-2-12b-GGUF

Updated Jun 6, 2024 • 7

QuantFactory/stable-code-3b-GGUF

Text Generation • Updated Jul 16, 2024 • 54 • 1

amd/AMD-Llama-135m

Text Generation • Updated Oct 9, 2024 • 12.2k • 110

amd/AMD-Llama-135m-code

Text Generation • Updated Oct 9, 2024 • 162 • 11

RichardErkhov/stabilityai_-_stablelm-3b-4e1t-gguf

Updated Jul 30, 2024 • 29

RichardErkhov/stabilityai_-_japanese-stablelm-3b-4e1t-instruct-gguf

Updated Jul 30, 2024 • 37

RichardErkhov/stabilityai_-_japanese-stablelm-3b-4e1t-base-gguf

Updated Jul 30, 2024 • 48

QuantFactory/AMD-Llama-135m-GGUF

Updated Oct 6, 2024 • 174 • 3

QuantFactory/AMD-Llama-135m-code-GGUF

Updated Oct 3, 2024 • 83 • 2

mav23/AMD-Llama-135m-GGUF

Updated Oct 3, 2024 • 22

RichardErkhov/amd_-_AMD-Llama-135m-gguf

Updated Oct 4, 2024 • 22

RichardErkhov/stabilityai_-_stablelm-3b-4e1t-4bits

Updated Oct 6, 2024 • 1

RichardErkhov/stabilityai_-_stablelm-3b-4e1t-8bits

Updated Oct 6, 2024

mav23/AMD-Llama-135m-code-GGUF

Updated Oct 9, 2024 • 146

akswelh/NEOX

Updated Oct 14, 2024

mav23/gpt-neox-20b-GGUF

Updated Oct 15, 2024 • 204

RichardErkhov/Upword_-_gpt-neox-20b-embeddings-gguf

Updated Oct 27, 2024 • 246

RichardErkhov/stabilityai_-_stablelm-2-12b-gguf

Updated Nov 1, 2024 • 14

RichardErkhov/EleutherAI_-_gpt-neox-20b-gguf

Updated Nov 2, 2024 • 422