yentinglin
commited on
Commit
•
6a290a7
1
Parent(s):
bbcc1a7
Update README.md
Browse files
README.md
CHANGED
@@ -50,7 +50,7 @@ A live demonstration of the model can be accessed at [Hugging Face Spaces](https
|
|
50 |
|
51 |
## Work in progress
|
52 |
- [ ] **Improved Pretraining**: A refined version of the existing pretraining approach is under development, aiming to enhance model performance.
|
53 |
-
- [ ] **Extended Model Length**: Utilizing the Rope mechanism
|
54 |
|
55 |
|
56 |
## Taiwanese Culture Examples
|
|
|
50 |
|
51 |
## Work in progress
|
52 |
- [ ] **Improved Pretraining**: A refined version of the existing pretraining approach is under development, aiming to enhance model performance.
|
53 |
+
- [ ] **Extended Model Length**: Utilizing the Rope mechanism, the model's length will be extended from 4k to 8k.
|
54 |
|
55 |
|
56 |
## Taiwanese Culture Examples
|