Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

Abliterated version of Qwen/Qwen2.5-72B-Instruct, utilizing code from refusal_direction.

For more information about the Abliterated technique, refer to this article and check out @FailSpy.

GGUF

Try harder to remove admonition and moral appeal

This model is licensed under the Qwen LICENSE AGREEMENT, Copyright (c) Alibaba Cloud. All Rights Reserved.

Downloads last month
16
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for matatonic/Qwen2.5-72B-Instruct-abliterated-v2-4.5bpw-exl2

Base model

Qwen/Qwen2.5-72B
Quantized
(40)
this model