Fine-tuned BART model for League of Legends biographies classification

README.md

@@ -3,6 +3,8 @@ license: mit
 base_model: facebook/bart-large-mnli
 tags:
 - generated_from_trainer
+metrics:
+- f1
 model-index:
 - name: bios_lol_fine-tuned
   results: []
@@ -14,6 +16,9 @@ should probably proofread and complete it, then remove this comment. -->
 # bios_lol_fine-tuned
 
 This model is a fine-tuned version of [facebook/bart-large-mnli](https://huggingface.co/facebook/bart-large-mnli) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.7373
+- F1: 0.1167
 
 ## Model description
 
@@ -33,18 +38,19 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 1
-- eval_batch_size: 1
+- train_batch_size: 3
+- eval_batch_size: 3
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 1
+- num_epochs: 2
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:------:|
-| No log        | 1.0   | 130  | 1.7029          | 0.0816 |
+| No log        | 1.0   | 44   | 1.7129          | 0.0816 |
+| No log        | 2.0   | 88   | 1.7373          | 0.1167 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ac418bf396ffe41932fcdef7ffa125a3e6bfa3cc118750943a09b3a2f3545f77
+oid sha256:0ed8ae5872ffe98b7bccbf7d4a2c7adc1079ae445e3bf601ed63000be74a2ec3
 size 1629449264

runs/Mar22_15-34-19_0c73de3e84dd/events.out.tfevents.1711121664.0c73de3e84dd.45184.8

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b07325c011c439702dfbb9cd41123112282f0cd5cee15afe86931b546d0a62cc
+size 5602

runs/Mar22_16-22-36_0c73de3e84dd/events.out.tfevents.1711124557.0c73de3e84dd.94963.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:54ee4e4d54c9a8b5e04ca00f2a72eccf64d50e221aa956749ba4f76432757a18
+size 6184

tokenizer.json

@@ -1,7 +1,21 @@
 {
   "version": "1.0",
-  "truncation": null,
-  "padding": null,
+  "truncation": {
+    "direction": "Right",
+    "max_length": 1024,
+    "strategy": "LongestFirst",
+    "stride": 0
+  },
+  "padding": {
+    "strategy": {
+      "Fixed": 1024
+    },
+    "direction": "Right",
+    "pad_to_multiple_of": null,
+    "pad_id": 1,
+    "pad_type_id": 0,
+    "pad_token": "<pad>"
+  },
   "added_tokens": [
     {
       "id": 0,

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:899bb9a8f727122ab18757d730ffdd358397c6bafe3131e3bf8cf5d7b2a3acc1
+oid sha256:e3832d83f59fef8d48a701896acf989308b15c9912513d5d4fd36af76c13433f
 size 4920