End of training

README.md

@@ -16,13 +16,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [meta-llama/Llama-3.2-1B](https://huggingface.co/meta-llama/Llama-3.2-1B) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- eval_loss: 4.1457
-- eval_model_preparation_time: 0.0017
-- eval_runtime: 10.4502
-- eval_samples_per_second: 1001.317
-- eval_steps_per_second: 7.847
-- epoch: 4.7853
-- step: 20175
+- eval_loss: 4.3855
+- eval_model_preparation_time: 0.0013
+- eval_runtime: 14.0825
+- eval_samples_per_second: 743.05
+- eval_steps_per_second: 5.823
+- epoch: 1.1292
+- step: 9521
 
 ## Model description
 
@@ -45,18 +45,16 @@ The following hyperparameters were used during training:
 - train_batch_size: 128
 - eval_batch_size: 128
 - seed: 42
-- gradient_accumulation_steps: 2
-- total_train_batch_size: 256
-- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_ratio: 0.1
 - lr_scheduler_warmup_steps: 2000
-- num_epochs: 20
+- num_epochs: 16
 - mixed_precision_training: Native AMP
 
 ### Framework versions
 
-- Transformers 4.47.1
+- Transformers 4.48.0
 - Pytorch 2.5.1+cu121
 - Datasets 3.2.0
 - Tokenizers 0.21.0

generation_config.json

@@ -2,5 +2,5 @@
   "_from_model_config": true,
   "bos_token_id": 0,
   "eos_token_id": 1,
-  "transformers_version": "4.47.1"
+  "transformers_version": "4.48.0"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5926648a32c3c3d8badcef129ddcb8de7bbe505cc3e457e059a52787fe7cd3b7
+oid sha256:3114e08de9d64e190989cd8aa3ac2c0a55c2a1e8a79def84c4463811a468ca87
 size 656964248

runs/Jan16_10-04-32_81d9b8b5d266/events.out.tfevents.1737021888.81d9b8b5d266.5048.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9b06474ff9c59ca7ac8db7008b33b18715e9bc38782660c08868968cdb9ed275
-size 9816
+oid sha256:fe8c9b0e0792bbcd9f1442f80816ae1eba67f042b3fbdde08113fa67f9c2935b
+size 10701