Equivalent quant for the base model

by SporkySporkness - opened Jul 27

Jul 27

Would you be willing to quant the base 3.1-70B (non-instruct) model? Between 3.5 - 4.0 bpw.
That would be great of you. Thanks!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment