amanpreetsingh459
/

llama-2-7b-chat_q4_quantized_cpp

text-generation-inference

Model card Files Files and versions Community

llama-2-7b-chat_q4_quantized_cpp / ggml-model-q4_0.bin

Commit History

Add 4-bit quantized model of size 3.8 GB

5fdd3c2

amanpreetsingh459 commited on Dec 3, 2023