Training in progress, epoch 1

README.md

@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [dslim/distilbert-NER](https://huggingface.co/dslim/distilbert-NER) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0560
-- F1 Score: 0.9524
+- Loss: 0.0483
+- F1 Score: 0.9453
 
 ## Model description
 
@@ -42,24 +42,22 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
-- num_epochs: 12
+- num_epochs: 10
 
 ### Training results
 
 | Training Loss | Epoch | Step  | Validation Loss | F1 Score |
 |:-------------:|:-----:|:-----:|:---------------:|:--------:|
-| 0.0082        | 1.0   | 1534  | 0.0556          | 0.9337   |
-| 0.0057        | 2.0   | 3068  | 0.0626          | 0.9276   |
-| 0.0043        | 3.0   | 4602  | 0.0560          | 0.9380   |
-| 0.0036        | 4.0   | 6136  | 0.0576          | 0.9387   |
-| 0.0035        | 5.0   | 7670  | 0.0536          | 0.9437   |
-| 0.0024        | 6.0   | 9204  | 0.0564          | 0.9449   |
-| 0.0013        | 7.0   | 10738 | 0.0556          | 0.9496   |
-| 0.001         | 8.0   | 12272 | 0.0571          | 0.9490   |
-| 0.0009        | 9.0   | 13806 | 0.0570          | 0.9486   |
-| 0.0016        | 10.0  | 15340 | 0.0574          | 0.9512   |
-| 0.0002        | 11.0  | 16874 | 0.0563          | 0.9521   |
-| 0.0001        | 12.0  | 18408 | 0.0560          | 0.9524   |
+| 0.1069        | 1.0   | 1534  | 0.0825          | 0.8414   |
+| 0.0553        | 2.0   | 3068  | 0.0587          | 0.8826   |
+| 0.0369        | 3.0   | 4602  | 0.0472          | 0.9125   |
+| 0.018         | 4.0   | 6136  | 0.0465          | 0.9206   |
+| 0.0127        | 5.0   | 7670  | 0.0447          | 0.9351   |
+| 0.0057        | 6.0   | 9204  | 0.0473          | 0.9377   |
+| 0.0045        | 7.0   | 10738 | 0.0465          | 0.9427   |
+| 0.0019        | 8.0   | 12272 | 0.0500          | 0.9409   |
+| 0.0026        | 9.0   | 13806 | 0.0486          | 0.9446   |
+| 0.0015        | 10.0  | 15340 | 0.0483          | 0.9453   |
 
 
 ### Framework versions

config.json

@@ -9,6 +9,7 @@
   "dropout": 0.1,
   "hidden_dim": 3072,
   "id2label": {
+    "-100": "IGN",
     "0": "O",
     "1": "B-ALGEBRA",
     "2": "E-ALGEBRA",
@@ -127,6 +128,7 @@
     "I-PROBABILITY-AND-STATISTICS": 56,
     "I-RECREATIONAL-MATHEMATICS": 61,
     "I-TOPOLOGY": 64,
+    "IGN": -100,
     "O": 0,
     "S-ALGEBRA": 3,
     "S-APPLIED-MATHEMATICS": 7,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7215d9a7961a0b8eb9be085c6a40c5776f9ee32bb100aa26b711558a632467d5
-size 260979008
+oid sha256:30cbb99eafde96ed2ddad7245567887853341dc02ec0acd94a459d7b0a2c794d
+size 260982084

runs/Jan13_18-29-19_f45e685edae3/events.out.tfevents.1736792963.f45e685edae3.3795.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f17a5658830c0b5df3719fc5722d0b8637dab0c028b34f1fb5619113e24b7bbb
+size 15903

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:de7d2c63f873ff0d86f30f60fa870fb1f1b6416f17a033c5fd2806313b028ba3
+oid sha256:450344e98ee70535d878dcf9df9f1f58ffec52b6b7d00580af5f331d0b8a0a83
 size 5368