Qwen-1.5-Exl2
Collection
18 items
•
Updated
•
2
Qwen1.5-72B-Chat-8.0bpw-h8-exl2
This is a 8.0bpw/h8 quantized version of Qwen/Qwen1.5-72B-Chat made with exllamav2.
To run this, make sure you installed the up-to-date version of Exllamav2.
License
This project is distributed under the Tongyi Qianwen LICENSE AGREEMENT. See the LICENSE file for more information.
Feeling Generous? 😊
Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?
- Downloads last month
- 4
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.