GGUF + quants for: https://huggingface.co/l3utterfly/tinyllama-1.1b-layla-v4
2-bit
4-bit
6-bit
8-bit
16-bit
32-bit