Hugging Face's logo

stan-hua
/
Qwen2-7B-Instruct-AWQ-W4A16

Safetensors
qwen2
4-bit precision
awq
Model card Files Community
Qwen2-7B-Instruct-AWQ-W4A16 / added_tokens.json
stan-hua's picture
stan-hua
AWQ model for Qwen/Qwen2-7B-Instruct: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'}
45dd1c1 verified
raw
history blame
80 Bytes
{
"<|endoftext|>": 151643,
"<|im_end|>": 151645,
"<|im_start|>": 151644
}