MarsupialAI
/

EVA-Qwen2.5-14B-v0.2_EXL2_5.0BPW_H8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

EVA-Qwen2.5-14B-v0.2_EXL2_5.0BPW_H8 / README.md

MarsupialAI's picture

Update README.md

1257875 verified 16 days ago

|

203 Bytes

metadata

library_name: transformers
license: apache-2.0
base_model: Qwen/Qwen2.5-14B

5.0 BPW EXL2 quant of https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2

8bit heads. Default measurement dataset.