Hugging Face's logo

cgus
/
Qwen2.5-14B-Instruct-abliterated-exl2

Text Generation
Transformers
English
qwen2
chat
abliterated
uncensored
conversational
Inference Endpoints
4-bit precision
exl2
Model card Files Community
cgus commited on
Commit
740e43c
·
verified ·
1 Parent(s): 53ea7cd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -1
README.md CHANGED
@@ -20,7 +20,6 @@ Made by: [huihui-ai](https://huggingface.co/huihui-ai)
20
  [4.5bpw h6](https://huggingface.co/cgus/Qwen2.5-14B-Instruct-abliterated-exl2/tree/4.5bpw-h6)
21
  [5bpw h6](https://huggingface.co/cgus/Qwen2.5-14B-Instruct-abliterated-exl2/tree/5bpw-h6)
22
  [6bpw h6](https://huggingface.co/cgus/Qwen2.5-14B-Instruct-abliterated-exl2/tree/6bpw-h6)
23
- [8bpw h8](https://huggingface.co/cgus/Qwen2.5-14B-Instruct-abliterated-exl2/tree/8bpw-h8)
24
 
25
  ## Quantization notes
26
  Made with Exllamav2 0.2.3 with the default dataset. These quants are meant for modern RTX cards on Windows/Linux or AMD on Linux.
 
20
  [4.5bpw h6](https://huggingface.co/cgus/Qwen2.5-14B-Instruct-abliterated-exl2/tree/4.5bpw-h6)
21
  [5bpw h6](https://huggingface.co/cgus/Qwen2.5-14B-Instruct-abliterated-exl2/tree/5bpw-h6)
22
  [6bpw h6](https://huggingface.co/cgus/Qwen2.5-14B-Instruct-abliterated-exl2/tree/6bpw-h6)
 
23
 
24
  ## Quantization notes
25
  Made with Exllamav2 0.2.3 with the default dataset. These quants are meant for modern RTX cards on Windows/Linux or AMD on Linux.