Doctor-Shotgun's picture
Update README.md
ecdf705 verified
metadata
quantized_by: Doctor-Shotgun
license: apache-2.0
language:
  - en
tags:
  - music
  - llama
base_model: m-a-p/YuE-s1-7B-anneal-en-cot
pipeline_tag: text-generation

YuE-s1-7B-anneal-en-cot-exl2

m-a-p/YuE-s1-7B-anneal-en-cot quantized with Exllamav2. It appears to remain coherent using the default calibration data without adding audio tokens.

Intended to be used with the WIP exl2 inference repository for YuE.

Links: