metadata
license: apache-2.0
Readme yet to be done.
- Static quants of https://huggingface.co/Qwen/Qwen2-7B-Instruct at commit 41c66b0
- Quantized by ThiloteE with llama.cpp commit e09a800
Notes
These quants were created with a customized configuration that have been proven to not cause visible end of string (eos) tokens during inference with GPT4All. The config.json, generation_config.json and tokenizer_config.json differ from the original configuration as can be found in the original model's repository at the time of creation of these quants.