How can I quantify my BF16 format model into AWQ?

#25
by AlipaySimon - opened

How can I quantify my BF16 format model into AWQ?

Cognitive Computations org

By using AutoAWQ.

v2ray changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment