End of training

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.7285
+- Loss: 2.7754
 
 ## Model description
 
@@ -41,13 +41,19 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_steps: 1000
-- num_epochs: 1
+- num_epochs: 5
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 3.3117 | 0.66 | 1000 | 2.7285 |
+| 3.6372 | 0.66 | 1000 | 2.8398 |
+| 3.0548 | 1.32 | 2000 | 2.7754 |
+| 3.0124 | 1.99 | 3000 | 2.7832 |
+| 3.0056 | 2.65 | 4000 | 2.8105 |
+| 2.9911 | 3.31 | 5000 | 2.7812 |
+| 2.983 | 3.97 | 6000 | 2.7676 |
+| 2.9735 | 4.64 | 7000 | 2.7754 |
 
 
 ### Framework versions

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:aae7b1c77a407bcafeee2fc69e48abddb4dc0247d43fd0e94910d3060183088a
+oid sha256:deab2a915f6881025fbc99c13f13b338d94cc8248f0076f261b80f3193525820
 size 418013

tokenizer.json

@@ -1,7 +1,19 @@
 {
  "version": "1.0",
- "truncation": null,
- "padding": null,
+ "truncation": {
+ "direction": "Right",
+ "max_length": 1024,
+ "strategy": "LongestFirst",
+ "stride": 0
+ },
+ "padding": {
+ "strategy": "BatchLongest",
+ "direction": "Right",
+ "pad_to_multiple_of": null,
+ "pad_id": 50256,
+ "pad_type_id": 0,
+ "pad_token": "<|endoftext|>"
+ },
  "added_tokens": [
  {
  "id": 50256,

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:506f6e20cd8c3db2c7ae9c5c31139cf0ee81ce8f7aa587ee77d824b22310b13b
+oid sha256:830f091b7b9ed63b66cc6d35c8205ab488e9c026944bd3b61de3c7d3896f62cb
 size 4091