GGUF Quants with iMatrix for : https://huggingface.co/ShinojiResearch/Senku-70B-Full
LlamaCPP Benchs :
- Senku-70b-b2081-iMat-c32_ch300-Q3_K_M.gguf,-,Hellaswag,84.5,,400,2024-02-07 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,ShinojiResearch,Nexesenex,
- Senku-70b-b2081-iMat-c32_ch300-Q3_K_M.gguf,-,Hellaswag,83.3,,1000,2024-02-07 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,ShinojiResearch,Nexesenex,
- Senku-70b-b2081-iMat-c32_ch300-Q3_K_M.gguf,-,Arc-Challenge,59.19732441,,299,2024-02-07 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,ShinojiResearch,Nexesenex,
- Senku-70b-b2081-iMat-c32_ch300-Q3_K_M.gguf,-,Arc-Easy,77.89473684,,570,2024-02-07 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,ShinojiResearch,Nexesenex,
- Senku-70b-b2081-iMat-c32_ch300-Q3_K_M.gguf,-,MMLU,49.52076677,,313,2024-02-07 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,ShinojiResearch,Nexesenex,
- Senku-70b-b2081-iMat-c32_ch300-Q3_K_M.gguf,-,Thruthful-QA,38.92288862,,817,2024-02-07 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,ShinojiResearch,Nexesenex,
- Senku-70b-b2081-iMat-c32_ch300-Q3_K_M.gguf,-,Winogrande,78.4530,,1267,2024-02-07 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,ShinojiResearch,Nexesenex,
- Senku-70b-b2081-iMat-c32_ch300-Q3_K_M.gguf,-,wikitext,4.3440,512,512,2024-02-07 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,ShinojiResearch,Nexesenex,81
- Senku-70b-b2081-iMat-c32_ch300-Q3_K_M.gguf,-,wikitext,3.8722,512,512,2024-02-07 00:00:00,70b,Mistral_Medium,32768,,,GGUF,ShinojiResearch,Nexesenex,655