DavieLion commited on
Commit
8c632ae
·
verified ·
1 Parent(s): 6a6a712

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -22
README.md CHANGED
@@ -1,42 +1,31 @@
1
  ---
2
  base_model:
3
- - DavieLion/Llama-3.2-1B-SPIN-iter0
4
  tags:
5
  - alignment-handbook
6
  - generated_from_trainer
7
  datasets:
8
- - DavieLion/SPIN_iter0
9
- - DavieLion/SPIN_iter1
10
  model-index:
11
- - name: iter1-ckpt
12
  results: []
13
- license: mit
14
  ---
15
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
- # iter1-ckpt
20
 
21
- This model is a fine-tuned version of [meta-llama/Llama-3.2-1B](https://huggingface.co/meta-llama/Llama-3.2-1B) on the DavieLion/SPIN_iter0 and DavieLion/SPIN_iter1 datasets.
22
 
23
  ## Model description
24
 
25
  - Model type: A 1B parameter GPT-like model fine-tuned on synthetic datasets.
26
  - Language(s) (NLP): Primarily English
27
- - License: MIT
28
  - Finetuned from model: meta-llama/Llama-3.2-1B
29
 
30
- ## Intended uses & limitations
31
-
32
- More information needed
33
-
34
- ## Training and evaluation data
35
-
36
- More information needed
37
-
38
- ## Training procedure
39
-
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
@@ -54,10 +43,6 @@ The following hyperparameters were used during training:
54
  - lr_scheduler_warmup_ratio: 0.1
55
  - num_epochs: 6.0
56
 
57
- ### Training results
58
-
59
-
60
-
61
  ### Framework versions
62
 
63
  - Transformers 4.37.0
 
1
  ---
2
  base_model:
3
+ - meta-llama/Llama-3.2-1B
4
  tags:
5
  - alignment-handbook
6
  - generated_from_trainer
7
  datasets:
8
+ - HuggingFaceH4/ultrachat_200k
 
9
  model-index:
10
+ - name: Llama-3.2-1B-SPIN-iter3
11
  results: []
12
+ license: llama3.2
13
  ---
14
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
18
+ # Llama-3.2-1B-SPIN-iter1
19
 
20
+ This model is a fine-tuned version of [meta-llama/Llama-3.2-1B](https://huggingface.co/meta-llama/Llama-3.2-1B) on the [HuggingFaceH4/ultrachat_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k) datasets.
21
 
22
  ## Model description
23
 
24
  - Model type: A 1B parameter GPT-like model fine-tuned on synthetic datasets.
25
  - Language(s) (NLP): Primarily English
26
+ - License: Llama 3.2 Community Lisense Agreement
27
  - Finetuned from model: meta-llama/Llama-3.2-1B
28
 
 
 
 
 
 
 
 
 
 
 
29
  ### Training hyperparameters
30
 
31
  The following hyperparameters were used during training:
 
43
  - lr_scheduler_warmup_ratio: 0.1
44
  - num_epochs: 6.0
45
 
 
 
 
 
46
  ### Framework versions
47
 
48
  - Transformers 4.37.0