turboderp
/

Mistral-7B-Instruct-v0.3-exl3

Model card Files Files and versions Community

EXL3 quants of Mistral-7B-Instruct-v0.3

2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight
8.00 bits per weight / H8

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including turboderp/Mistral-7B-Instruct-v0.3-exl3

EXL3 models

11 items • Updated 21 minutes ago • 8