Update README.md
Browse files
README.md
CHANGED
|
@@ -45,7 +45,9 @@ How it works: https://twitter.com/BlinkDL_AI/status/1685230712247795713
|
|
| 45 |
|
| 46 |
https://www.rwkv.com/
|
| 47 |
|
| 48 |
-
RWKV-6 7B MMLU =
|
|
|
|
|
|
|
| 49 |
|
| 50 |
RWKV-6 0.1B (using pythia-160m tokenizer): https://huggingface.co/BlinkDL/temp-latest-training-models/blob/main/temp/rwkv-x060-173m-pile-20240515-ctx4k.pth
|
| 51 |
|
|
|
|
| 45 |
|
| 46 |
https://www.rwkv.com/
|
| 47 |
|
| 48 |
+
RWKV-6 7B v3 MMLU = 54.2% (using the same "47.9%" code)
|
| 49 |
+
|
| 50 |
+
RWKV-6 7B v2.1 MMLU = 47.9%: https://github.com/Jellyfish042/rwkv_mmlu
|
| 51 |
|
| 52 |
RWKV-6 0.1B (using pythia-160m tokenizer): https://huggingface.co/BlinkDL/temp-latest-training-models/blob/main/temp/rwkv-x060-173m-pile-20240515-ctx4k.pth
|
| 53 |
|