End of training

README.md

@@ -1,6 +1,6 @@
 ---
 license: apache-2.0
-base_model: distilgpt2
+base_model: AlaGrine/distilgpt2-finetuned-3GPP-5G
 tags:
 - generated_from_trainer
 model-index:
@@ -13,9 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 # distilgpt2-finetuned-3GPP-5G
 
-This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on an unknown dataset.
-It achieves the following results on the evaluation set:
-- Loss: 2.8954
+This model is a fine-tuned version of [AlaGrine/distilgpt2-finetuned-3GPP-5G](https://huggingface.co/AlaGrine/distilgpt2-finetuned-3GPP-5G) on an unknown dataset.
 
 ## Model description
 
@@ -35,8 +33,8 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 16
-- eval_batch_size: 16
+- train_batch_size: 48
+- eval_batch_size: 48
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
@@ -45,14 +43,14 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step  | Validation Loss |
-|:-------------:|:-----:|:-----:|:---------------:|
-| 3.1527        | 1.0   | 12562 | 2.8954          |
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| No log        | 1.0   | 7394 | 2.7276          |
 
 
 ### Framework versions
 
-- Transformers 4.35.2
-- Pytorch 2.1.0+cu121
-- Datasets 2.16.1
+- Transformers 4.36.0
+- Pytorch 2.0.0
+- Datasets 2.1.0
 - Tokenizers 0.15.0

generation_config.json

@@ -2,5 +2,5 @@
   "_from_model_config": true,
   "bos_token_id": 50256,
   "eos_token_id": 50256,
-  "transformers_version": "4.35.2"
+  "transformers_version": "4.36.0"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0d8671750206421a7dc4655c9678eb8de92c85e1b2e9cdb53df004178a49ad77
+oid sha256:e785fe6efce1eb828d3a782457bcd314bbbc1bb5c2380d3f035842f9a9155244
 size 327657928

runs/Jan07_18-15-19_0ef9c165e940/events.out.tfevents.1704651327.0ef9c165e940.115.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0eac10fea96f5f97ea135af0349302463f845846dd1315eb50a8fff533717070
-size 4793
+oid sha256:ee05679ec86bbdd32e6bcf76ddb07c0c5fe83c17a0390e9852c1ce84e95ad649
+size 5418