End of training

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [sangjeedondrub/tibetan-roberta-base](https://huggingface.co/sangjeedondrub/tibetan-roberta-base) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 6.1991
+- Loss: 4.8991
 
 ## Model description
 
@@ -40,20 +40,27 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 3
+- num_epochs: 10
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| No log        | 1.0   | 1    | 6.1538          |
-| No log        | 2.0   | 2    | 6.1843          |
-| No log        | 3.0   | 3    | 6.1991          |
+| No log        | 1.0   | 5    | 5.5555          |
+| No log        | 2.0   | 10   | 5.3387          |
+| No log        | 3.0   | 15   | 5.1786          |
+| No log        | 4.0   | 20   | 5.0714          |
+| No log        | 5.0   | 25   | 4.9988          |
+| No log        | 6.0   | 30   | 4.9522          |
+| No log        | 7.0   | 35   | 4.9231          |
+| No log        | 8.0   | 40   | 4.9101          |
+| No log        | 9.0   | 45   | 4.9019          |
+| No log        | 10.0  | 50   | 4.8991          |
 
 
 ### Framework versions
 
-- Transformers 4.40.1
+- Transformers 4.40.2
 - Pytorch 2.2.1+cu121
 - Datasets 2.19.1
 - Tokenizers 0.19.1

config.json

@@ -20,7 +20,7 @@
   "pad_token_id": 1,
   "position_embedding_type": "absolute",
   "torch_dtype": "float32",
-  "transformers_version": "4.40.1",
+  "transformers_version": "4.40.2",
   "type_vocab_size": 1,
   "use_cache": true,
   "vocab_size": 52000

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5f00ced42ff4fdcf9c81f9d308c78fbf3dd5357a0cf198ef64a4de5441be5f8e
+oid sha256:57f9b2c2e40871c10dcadb912cada5ad34c576a603fecda7022c8b0f58b64d8b
 size 331459608

runs/May09_20-37-30_f3734dc9b029/events.out.tfevents.1715287055.f3734dc9b029.7433.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc804b907ad6a4fb59d240eb420d553b446ae110aa44dbdee75cbbc0e6e782f7
+size 4705

runs/May09_20-37-30_f3734dc9b029/events.out.tfevents.1715287199.f3734dc9b029.7433.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a096618673ccd11c39ba62a87e70eee81098cd1b672610d005abebc764cc9eea
+size 7713

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:df1ef3d494651c389daa7309593b9ce2c7c968241d3aa13418c0be1964b70696
+oid sha256:e0b7803b48193d9a8481864f2c682c3eea4c5e83b2f9288d981db57f3ddd0082
 size 4984