Update README.md
Browse files
README.md
CHANGED
@@ -7,19 +7,21 @@ tags:
|
|
7 |
- KoRWKV
|
8 |
---
|
9 |
|
10 |
-
>
|
11 |
-
>
|
12 |
> Instruction-Finetuned model is available at [beomi/KoAlpaca-KoRWKV-1.5B](https://huggingface.co/beomi/KoAlpaca-KoRWKV-1.5B)
|
13 |
|
14 |
## Todo
|
15 |
|
16 |
-
-
|
17 |
-
-
|
|
|
|
|
18 |
|
19 |
|
20 |
# KoRWKV Model Card
|
21 |
|
22 |
-
KoRWKV (1.5B) trained on Korean dataset with RWKVv4 Neo Architecture.
|
23 |
|
24 |
## Model details
|
25 |
|
@@ -29,11 +31,11 @@ Junbum Lee (aka Beomi)
|
|
29 |
|
30 |
**Model date**
|
31 |
|
32 |
-
KoRWKV was trained between 2022.05~
|
33 |
|
34 |
**Model version**
|
35 |
|
36 |
-
This is
|
37 |
|
38 |
**Model type**
|
39 |
|
|
|
7 |
- KoRWKV
|
8 |
---
|
9 |
|
10 |
+
> Train finished ππ This version is **beta** release of KoRWKV-1.5B
|
11 |
+
>
|
12 |
> Instruction-Finetuned model is available at [beomi/KoAlpaca-KoRWKV-1.5B](https://huggingface.co/beomi/KoAlpaca-KoRWKV-1.5B)
|
13 |
|
14 |
## Todo
|
15 |
|
16 |
+
- β
Train 1.5B
|
17 |
+
- β
Beta Release (Full data train)
|
18 |
+
- β³ Final Release (Full data train + Curated data train)
|
19 |
+
- β³ Train Bigger Models (6B)
|
20 |
|
21 |
|
22 |
# KoRWKV Model Card
|
23 |
|
24 |
+
KoRWKV (1.5B params) trained on Korean dataset with RWKVv4 Neo Architecture.
|
25 |
|
26 |
## Model details
|
27 |
|
|
|
31 |
|
32 |
**Model date**
|
33 |
|
34 |
+
KoRWKV was trained between 2022.05~2022.06
|
35 |
|
36 |
**Model version**
|
37 |
|
38 |
+
This is beta version of the model.
|
39 |
|
40 |
**Model type**
|
41 |
|