Update README.md
Browse files
README.md
CHANGED
|
@@ -46,7 +46,7 @@ Training framework: [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory).
|
|
| 46 |
Training details:
|
| 47 |
|
| 48 |
- epochs: 3
|
| 49 |
-
- learning rate:
|
| 50 |
- learning rate scheduler type: cosine
|
| 51 |
- Warmup ratio: 0.1
|
| 52 |
- cutoff len (i.e. context length): 8192
|
|
|
|
| 46 |
Training details:
|
| 47 |
|
| 48 |
- epochs: 3
|
| 49 |
+
- learning rate: 1.5e-6
|
| 50 |
- learning rate scheduler type: cosine
|
| 51 |
- Warmup ratio: 0.1
|
| 52 |
- cutoff len (i.e. context length): 8192
|