library_name: transformers | |
license: apache-2.0 | |
base_model: Qwen/Qwen2.5-14B | |
5.0 BPW EXL2 quant of https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2 | |
8bit heads. Default measurement dataset. |
library_name: transformers | |
license: apache-2.0 | |
base_model: Qwen/Qwen2.5-14B | |
5.0 BPW EXL2 quant of https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2 | |
8bit heads. Default measurement dataset. |