A request for quantization.

by Kotokin - opened Feb 14

Feb 14

Hi, can you please quantize the following model into iq2_xs? Miquliz 120B v2.0

Owner Feb 14

Hello,

Ask to Artefact2 or Kooten, my current hardware is too modest to reasonably iMatrix and quantize such beasts.

Feb 16

Feb 16

Thanks

Kotokin changed discussion status to closed Feb 16

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment