Yi-6B-200K - AWQ

This is a quantized (AWQ) version of Yi-6B-200K.

For more information about the model, see the original page.

It was quantized in the same way as the Yi-34B-200K: more information about it - here.

Safetensors

Model size

1.27B params

Tensor type

I32

FP16

Inference Examples

Inference API (serverless) has been turned off for this model.

Model tree for Sombressoul/Yi-6B-200K-AWQ

Base model

01-ai/Yi-6B-200K

Quantized

(11)

this model