FP8 or GGUF version to run on consumer GPU

by ryg81 - opened 16 days ago

ryg81

16 days ago

Hey, please release small fp8 or gguf models too.
Thanks in advance

14 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment