Hugging Face's logo

Harshkmr
/
smollm-135-multilingual

TensorBoard
Safetensors
llama
Generated from Trainer
Model card Files Metrics Community
Harshkmr commited on
Commit
aaaf77b
·
verified ·
1 Parent(s): 60cfae6

End of training

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -32,12 +32,13 @@ More information needed
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
- - learning_rate: 5e-05
36
  - train_batch_size: 4
37
  - eval_batch_size: 8
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
 
41
  - num_epochs: 1
42
  - mixed_precision_training: Native AMP
43
 
 
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
+ - learning_rate: 0.0005
36
  - train_batch_size: 4
37
  - eval_batch_size: 8
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - lr_scheduler_warmup_steps: 50
42
  - num_epochs: 1
43
  - mixed_precision_training: Native AMP
44