wilson1yan commited on
Commit
e3f71d1
1 Parent(s): 4097b00

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -1
README.md CHANGED
@@ -1,3 +1,29 @@
1
  ---
2
- license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ inference: false
3
  ---
4
+
5
+ <br>
6
+ <br>
7
+
8
+ # LWM-Text-Chat-128K Model Card
9
+
10
+ ## Model details
11
+
12
+ **Model type:**
13
+ LWM-Text-Chat-128K is an open-source model trained from LLaMA-2 on a subset of Books3 filtered data. It is an auto-regressive language model, based on the transformer architecture.
14
+
15
+ **Model date:**
16
+ LWM-Text-Chat-128K was trained in December 2023.
17
+
18
+ **Paper or resources for more information:**
19
+ https://largeworldmodel.github.io/
20
+
21
+ ## License
22
+ Llama 2 is licensed under the LLAMA 2 Community License,
23
+ Copyright (c) Meta Platforms, Inc. All Rights Reserved.
24
+
25
+ **Where to send questions or comments about the model:**
26
+ https://github.com/LargeWorldModel/lwm/issues
27
+
28
+ ## Training dataset
29
+ - 92K subset of Books3 documents with 100K to 200K tokens