Hugging Face's logo

Nbeau
/
GPT2-arithmetic-1-3digits

Text Generation
Transformers
Safetensors
gpt2
Generated from Trainer
text-generation-inference
Model card Files
xet
Community
Nbeau commited on
Commit
c98442d
·
verified ·
1 Parent(s): 17e9c6a

End of training

Browse files
Files changed (2) hide show
  1. README.md +8 -6
  2. model.safetensors +1 -1
README.md CHANGED
@@ -42,18 +42,20 @@ The following hyperparameters were used during training:
42
  - total_train_batch_size: 64
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: constant_with_warmup
45
- - num_epochs: 5
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:------:|:----:|:---------------:|
52
- | 0.1931 | 0.9984 | 156 | nan |
53
- | 0.093 | 1.9968 | 312 | nan |
54
- | 0.0822 | 2.9952 | 468 | nan |
55
- | 0.0784 | 4.0 | 625 | nan |
56
- | 0.0775 | 4.992 | 780 | nan |
 
 
57
 
58
 
59
  ### Framework versions
 
42
  - total_train_batch_size: 64
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: constant_with_warmup
45
+ - num_epochs: 7
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:------:|:----:|:---------------:|
52
+ | 0.1482 | 0.9984 | 156 | nan |
53
+ | 0.0902 | 1.9968 | 312 | nan |
54
+ | 0.0804 | 2.9952 | 468 | nan |
55
+ | 0.0789 | 4.0 | 625 | nan |
56
+ | 0.0798 | 4.9984 | 781 | nan |
57
+ | 0.0776 | 5.9968 | 937 | nan |
58
+ | 0.0773 | 6.9888 | 1092 | nan |
59
 
60
 
61
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:af0295fce5c470f92fe25bcb804dae0dd49b4e104a4ba4c42cba156164090603
3
  size 441691776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82354fe265214c419b9a3b39f7386563e686183bde97eb5a1e2fc32af01f5096
3
  size 441691776