User Requests (GGUF)
Collection
25 items
•
Updated
•
1
[Request #54] - Click the link for more context.
concedo/KobbleTinyV2-1.1B
Use with the latest version of KoboldCpp, or this more up-to-date fork if you have issues.
⇲ Click here to expand/hide information – General chart with relative quant parformances.
Recommended read:
"Which GGUF is right for me? (Opinionated)" by Artefact2
Click the image to view full size.
- Downloads last month
- 74
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model authors have turned it off explicitly.