sailendu commited on
Commit
0500e0d
·
verified ·
1 Parent(s): e2c2331

End of training

Browse files
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: google-bert/bert-base-uncased
5
+ tags:
6
+ - generated_from_trainer
7
+ metrics:
8
+ - f1
9
+ model-index:
10
+ - name: modernbert-llm-router
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # modernbert-llm-router
18
+
19
+ This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.4671
22
+ - F1: 1.0
23
+
24
+ ## Model description
25
+
26
+ More information needed
27
+
28
+ ## Intended uses & limitations
29
+
30
+ More information needed
31
+
32
+ ## Training and evaluation data
33
+
34
+ More information needed
35
+
36
+ ## Training procedure
37
+
38
+ ### Training hyperparameters
39
+
40
+ The following hyperparameters were used during training:
41
+ - learning_rate: 5e-05
42
+ - train_batch_size: 32
43
+ - eval_batch_size: 16
44
+ - seed: 42
45
+ - optimizer: Use OptimizerNames.ADAMW_HF with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
+ - lr_scheduler_type: linear
47
+ - num_epochs: 9
48
+
49
+ ### Training results
50
+
51
+ | Training Loss | Epoch | Step | Validation Loss | F1 |
52
+ |:-------------:|:-----:|:----:|:---------------:|:----:|
53
+ | No log | 1.0 | 1 | 0.7026 | 0.82 |
54
+ | No log | 2.0 | 2 | 0.6383 | 0.82 |
55
+ | No log | 3.0 | 3 | 0.5799 | 0.82 |
56
+ | No log | 4.0 | 4 | 0.4671 | 1.0 |
57
+ | No log | 5.0 | 5 | 0.4164 | 1.0 |
58
+ | No log | 6.0 | 6 | 0.4202 | 1.0 |
59
+ | No log | 7.0 | 7 | 0.3868 | 1.0 |
60
+ | No log | 8.0 | 8 | 0.3568 | 1.0 |
61
+ | No log | 9.0 | 9 | 0.3463 | 1.0 |
62
+
63
+
64
+ ### Framework versions
65
+
66
+ - Transformers 4.48.0.dev0
67
+ - Pytorch 2.4.1
68
+ - Datasets 3.1.0
69
+ - Tokenizers 0.21.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8d18587766a2d92305b034b3f0393aa81afb3b9c661678c7b9471e56c17fd01f
3
  size 437964800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32f5e1d7711f36d27da9bbaa9ddecc516dc5e116f2d06357e6f7a756861ca0c3
3
  size 437964800
runs/Jan24_00-18-04_sailendus-MacBook-Pro.local/events.out.tfevents.1737658087.sailendus-MacBook-Pro.local.42290.6 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:21e9493364219d07138d169eded4b921c664d09a32528713d0565cb51cd7ab8d
3
- size 5639
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:341d2852042d6f313911e9968b0edb74675001fa3e45201b64e7f1255c94c690
3
+ size 8475
runs/Jan24_00-18-04_sailendus-MacBook-Pro.local/events.out.tfevents.1737658235.sailendus-MacBook-Pro.local.42290.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3595a80422341dc0da3ea05d1ba674190842e7df9d3c7aed405eeb6ec8a6fcd
3
+ size 399
special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": false,
45
+ "cls_token": "[CLS]",
46
+ "do_lower_case": true,
47
+ "extra_special_tokens": {},
48
+ "mask_token": "[MASK]",
49
+ "model_max_length": 512,
50
+ "pad_token": "[PAD]",
51
+ "sep_token": "[SEP]",
52
+ "strip_accents": null,
53
+ "tokenize_chinese_chars": true,
54
+ "tokenizer_class": "BertTokenizer",
55
+ "unk_token": "[UNK]"
56
+ }
vocab.txt ADDED
The diff for this file is too large to render. See raw diff