Spaces:

ggml-org

/

gguf-my-repo

like 1.06k

Running on A10G

After reading into these new quantization methods I have come to believe that these new quants perform better than the current implementation and are fully supported by llama.cpp as an optional parameter?
Hope I'll receive any feedback, thanks!