What's the difference between this and the official llama version?

#4
by chaochaoli - opened

The difference between llama-2-7b-chat and llama-2-7b-chat-hf is that the latter is in hugging-face-format. The "chat" version of the llama2 is optimized for dialogue use cases.

May I ask what is hugging-face-format?

May I ask what is hugging-face-format?

I have the same question

Is it the same model as Meta's?

It is the same model as meta's llama-2-7b-chat-hf
I hosted it myself at the time, because 2 years ago when meta published Llama2, you had to fill in a form and they had to approve your downloads of the weights.
My mirror requires no filling in any forms with meta, you can just immediately download the weights.
That being said, just use llama3, this is really outdated for most purposes.

Back in 2023, meta did not always use huggingface format for their weights:

  • llama-2-7b-chat (notice the absence of -hf at the end) you could NOT use with the huggingface transformers library. You had to convert it using a custom script.
  • llama-2-7b-chat-hf you can use with the huggingface transformers library without any extra model weight conversions.
daryl149 changed discussion status to closed

Sign up or log in to comment