Image description

Tsunemoto GGUF's of Senku-70B-Full

This is a GGUF quantization of Senku-70B-Full.

Q8 is available here

Original Repo Link:

Original Repository

Original Model Card:


Finetune of miqu-70b-sf dequant of miqudev's leak of Mistral-70B (allegedly an early mistral medium). My diffs are available under CC-0, this is a merge with the leaked model, you can use the other repository to save bandwidth.

EQ-Bench: 84.89

Will run more benches later.

Downloads last month
203
GGUF
Model size
69B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support