7B Mistral based Mergekit tests for german text generation to find the best working (for context, grammar and general output) German merge for primarily fun Chat (E)RP, but could also work for other tasks. ChatML format works well, Alpaca should work even better.

Tester feedback welcome.

The best models will be released as 16bit safetensors, all kind of GGUF quants and all needed informations.

Downloads last month
101
GGUF
Model size
7.24B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support