Q4_K_S GGUF for https://huggingface.co/MarsupialAI/Dumbstral-169B

No imat, no other quant schemes. This is all I'm willing to do for a model that nobody can reasonably run. FSM help Bartowski and Mradermacher if they choose to run full quant sets for this bastard.

Downloads last month
43
GGUF
Model size
170B params
Architecture
llama
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.