jono1234
/

RWKV-Decepticon

Model card Files Files and versions Community

jono1234 commited on Oct 5, 2023

Commit

ae3dda6

·

1 Parent(s): f02164a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ n_layer: 6
 n_embd: 512
 ctx_len: 1024
-rwkv-decepticon-books-140m.pth (in progress) - trained on 20gb of books.
 n_layer: 8
 n_embd: 768
 ctx_len: 1024

 n_embd: 512
 ctx_len: 1024
+rwkv-decepticon-books-140m.pth - trained on 20gb of books. Uses the 20B_tokenizer.json file.
 n_layer: 8
 n_embd: 768
 ctx_len: 1024