This is a converted model to GGUF from meta-llama/Llama-2-7b-chat-hf quantized to Q4_0 using llama.cpp library.

Downloads last month
12
GGUF
Model size
6.74B params
Architecture
llama

4-bit

Inference Examples
Unable to determine this model's library. Check the docs .