DopeorNope commited on
Commit
88cc7af
1 Parent(s): f4438e1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +41 -2
README.md CHANGED
@@ -1,8 +1,47 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
4
 
5
- **Developers** SeungyooLee (DopeorNopeLee)
6
 
 
7
 
8
- It follows Apache license!!
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ # **🐻‍❄️COKAL-v1_70B🐻‍❄️**
5
+ ![img](./COKAL-DPO_bear.png)
6
 
7
+ ## Model Details
8
 
9
+ **Model Developers** Seungyoo Lee (DopeorNope)
10
 
11
+ **Input** Models input text only.
12
+
13
+ **Output** Models generate text only.
14
+
15
+ **Model Architecture**
16
+ COKAL-v1_70B is an auto-regressive 13B language model based on the LLaMA2 transformer architecture.
17
+
18
+ **Base Model**
19
+
20
+
21
+
22
+ **Training Dataset**
23
+
24
+ - SFT training dataset: [garage-bAInd/Open-Platypus](https://huggingface.co/datasets/garage-bAInd/Open-Platypus) - private
25
+
26
+
27
+ **Training**
28
+ I developed the model in an environment with A100 x 8
29
+
30
+
31
+ # Implementation Code
32
+ ```python
33
+
34
+ from transformers import AutoModelForCausalLM, AutoTokenizer
35
+ import torch
36
+
37
+ repo = "DopeorNope/COKAL-v1_70B"
38
+ model = AutoModelForCausalLM.from_pretrained(
39
+ repo,
40
+ return_dict=True,
41
+ torch_dtype=torch.float16,
42
+ device_map='auto'
43
+ )
44
+ model_tokenizer = AutoTokenizer.from_pretrained(repo)
45
+ ```
46
+
47
+ ---