| language: | |
| - en | |
| tags: | |
| - pytorch | |
| - text-generation | |
| - causal-lm | |
| - rwkv | |
| license: apache-2.0 | |
| datasets: | |
| - the_pile | |
| # RWKV-4 Novel Models | |
| ## Model Description | |
| These are RWKV-4-Pile models finetuned on novels. | |
| Currently I am doing it for Chn novels. More languages to come. | |
| Use https://github.com/BlinkDL/ChatRWKV to run them. | |
| See https://github.com/BlinkDL/RWKV-LM for details on the RWKV Language Model (100% RNN). | |
| * RWKV-4-Novel-ChnEng : 50% Chinese + 50% Pile | |
| * RWKV-4-Novel-Chn : 100% Chinese | |