turboderp
/

granite-3.1-8b-instruct-exl2

Model card Files Files and versions Community

granite-3.1-8b-instruct-exl2 / README.md

turboderp's picture

Update README.md

fd736ec verified 29 days ago

|

648 Bytes

metadata

license: apache-2.0

EXL2 quants of granite-3.1-8b-instruct

4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight

measurement.json