Hugging Face's logo

VictorDCh
/
Llama-3-8B-Instruct-spider-4

PEFT
TensorBoard
Safetensors
llama
trl
sft
Generated from Trainer
Model card Files Metrics Community
VictorDCh commited on
Commit
5b93c7f
·
verified ·
1 Parent(s): 654048a

Model save

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -37,7 +37,7 @@ More information needed
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
- - learning_rate: 0.0002
41
  - train_batch_size: 1
42
  - eval_batch_size: 8
43
  - seed: 42
@@ -46,7 +46,7 @@ The following hyperparameters were used during training:
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: cosine
48
  - lr_scheduler_warmup_ratio: 0.03
49
- - num_epochs: 3
50
 
51
  ### Training results
52
 
 
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
+ - learning_rate: 2e-05
41
  - train_batch_size: 1
42
  - eval_batch_size: 8
43
  - seed: 42
 
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: cosine
48
  - lr_scheduler_warmup_ratio: 0.03
49
+ - num_epochs: 4
50
 
51
  ### Training results
52