ikawrakow
/

various-2bit-sota-gguf

Inference Endpoints

Model card Files Files and versions Community

various-2bit-sota-gguf

Commit History

Adding Nous-Hermes 2.31 bpw quantized models

6d5bc07

ikawrakow commited on Jan 10

Adding Mistral instruct models

d46804d

ikawrakow commited on Jan 10

Update README.md

ffe00e8

ikawrakow commited on Jan 10

Adding 2.31-bpw base quantized models

6b581ce

ikawrakow commited on Jan 10

Adding Nous-Hermes-2-Yi-34B 2-bit quants

baa54f2

ikawrakow commited on Jan 9

Adding Nous-Hermes-2-SOLAR-10.7B 2-bit quants

b0a7708

ikawrakow commited on Jan 9

Adding Rocket-3b 2-bit quants

c82cd0c

ikawrakow commited on Jan 9

Adding Mixtral-instruct-8x7b

f8d3017

ikawrakow commited on Jan 8

Adding Mixtral-8x7b

fe3f46d

ikawrakow commited on Jan 5

Update README.md

5c2dcb5

ikawrakow commited on Jan 5

Adding more

7790dee

ikawrakow commited on Jan 4

Adding first set of models

2aae552

ikawrakow commited on Jan 4

initial commit

1a5acd5

ikawrakow commited on Jan 4