Update README.md
Browse files
README.md
CHANGED
|
@@ -40,6 +40,7 @@ These are the parameters that we used :
|
|
| 40 |
- max_steps : 1000
|
| 41 |
- warmup_steps : 5
|
| 42 |
- weight_decay : 0.05
|
|
|
|
| 43 |
|
| 44 |
LORA PARAMETERS :
|
| 45 |
- r = 16
|
|
|
|
| 40 |
- max_steps : 1000
|
| 41 |
- warmup_steps : 5
|
| 42 |
- weight_decay : 0.05
|
| 43 |
+
- learning rate scheduler : cosine
|
| 44 |
|
| 45 |
LORA PARAMETERS :
|
| 46 |
- r = 16
|