Can 2.35bpw be used on a single 4090 GPU?

#2
by Wizd - opened

Max 24G VRAM.

Yes. I've used up to 2.5 bpw with reduced context size.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment