Sweaterdog commited on
Commit
4c80e45
·
verified ·
1 Parent(s): e625d5c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -93,7 +93,7 @@ I'm aware it does say there are multiple Qwen2.5 files, even though there are tw
93
 
94
  #
95
 
96
- For Anybody who is wondering what the context length is, for the Hermesv1, they have a context window of 8196 tokens, but when the v2 generation drops, including LLaMa 3.2 and Gemma2, they will use a larger dataset, and have a context length of 128000 tokens
97
 
98
  #
99
 
 
93
 
94
  #
95
 
96
+ For Anybody who is wondering what the context length is, for the Hermesv1, they have a context window of 8196 tokens. For the Qwen version, it will have a length of 64000 tokens, for the Llama version, it will have 128000 tokens. they will use a larger dataset, at about 1.6 times the size of the v1 generation.
97
 
98
  #
99