fdaudens HF staff commited on
Commit
119c95e
·
verified ·
1 Parent(s): 5a06d90

End of training

Browse files
README.md CHANGED
@@ -1,12 +1,9 @@
1
  ---
2
  library_name: transformers
3
  license: apache-2.0
4
- base_model: MoritzLaurer/ModernBERT-large-zeroshot-v2.0
5
  tags:
6
  - generated_from_trainer
7
- metrics:
8
- - f1
9
- - accuracy
10
  model-index:
11
  - name: ModernBERT-hf-posts-classifier
12
  results: []
@@ -17,11 +14,12 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  # ModernBERT-hf-posts-classifier
19
 
20
- This model is a fine-tuned version of [MoritzLaurer/ModernBERT-large-zeroshot-v2.0](https://huggingface.co/MoritzLaurer/ModernBERT-large-zeroshot-v2.0) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.1848
23
- - F1: 0.2079
24
- - Accuracy: 0.1569
 
25
 
26
  ## Model description
27
 
@@ -53,13 +51,13 @@ The following hyperparameters were used during training:
53
 
54
  ### Training results
55
 
56
- | Training Loss | Epoch | Step | Validation Loss | F1 | Accuracy |
57
- |:-------------:|:------:|:----:|:---------------:|:------:|:--------:|
58
- | No log | 1.0 | 15 | 0.2568 | 0.0560 | 0.0196 |
59
- | No log | 2.0 | 30 | 0.2353 | 0.0665 | 0.0784 |
60
- | No log | 3.0 | 45 | 0.2007 | 0.1981 | 0.0980 |
61
- | No log | 4.0 | 60 | 0.1878 | 0.2129 | 0.0980 |
62
- | No log | 4.7018 | 70 | 0.1848 | 0.2079 | 0.1569 |
63
 
64
 
65
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
  license: apache-2.0
4
+ base_model: answerdotai/ModernBERT-base
5
  tags:
6
  - generated_from_trainer
 
 
 
7
  model-index:
8
  - name: ModernBERT-hf-posts-classifier
9
  results: []
 
14
 
15
  # ModernBERT-hf-posts-classifier
16
 
17
+ This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.2372
20
+ - Micro F1: 0.4251
21
+ - Macro F1: 0.0459
22
+ - Weighted F1: 0.2837
23
 
24
  ## Model description
25
 
 
51
 
52
  ### Training results
53
 
54
+ | Training Loss | Epoch | Step | Validation Loss | Micro F1 | Macro F1 | Weighted F1 |
55
+ |:-------------:|:------:|:----:|:---------------:|:--------:|:--------:|:-----------:|
56
+ | No log | 1.0 | 15 | 0.2547 | 0.4621 | 0.0473 | 0.2926 |
57
+ | No log | 2.0 | 30 | 0.2524 | 0.3676 | 0.0386 | 0.2377 |
58
+ | No log | 3.0 | 45 | 0.2412 | 0.4291 | 0.0491 | 0.2895 |
59
+ | No log | 4.0 | 60 | 0.2378 | 0.4291 | 0.0460 | 0.2846 |
60
+ | No log | 4.7018 | 70 | 0.2372 | 0.4251 | 0.0459 | 0.2837 |
61
 
62
 
63
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e467169057ccd60ab25a540b9a4ee9eb094305b1edf7de11543386594f101940
3
  size 598541300
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d194be30d181b8cfb9202739e9f4b26972d406990975b65d04cc0e9f175d81bb
3
  size 598541300
runs/Jan09_18-55-21_c50f821e5c9f/events.out.tfevents.1736448922.c50f821e5c9f.1900.3 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a3a51e9a3cbc2b4afc72fc3c67dab106c06f9c3b4856063ab3ffcb4f5b836ee6
3
- size 9086
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b8c3bb7c73d48a8d3d88e72a1ff73c974496148395fd13dfd4ba5bb9b8f8e9e
3
+ size 9856
tokenizer.json CHANGED
@@ -1,21 +1,7 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 512,
6
- "strategy": "LongestFirst",
7
- "stride": 0
8
- },
9
- "padding": {
10
- "strategy": {
11
- "Fixed": 512
12
- },
13
- "direction": "Right",
14
- "pad_to_multiple_of": null,
15
- "pad_id": 50283,
16
- "pad_type_id": 0,
17
- "pad_token": "[PAD]"
18
- },
19
  "added_tokens": [
20
  {
21
  "id": 0,
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
4
+ "padding": null,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  "added_tokens": [
6
  {
7
  "id": 0,
tokenizer_config.json CHANGED
@@ -937,7 +937,7 @@
937
  "input_ids",
938
  "attention_mask"
939
  ],
940
- "model_max_length": 512,
941
  "pad_token": "[PAD]",
942
  "sep_token": "[SEP]",
943
  "tokenizer_class": "PreTrainedTokenizerFast",
 
937
  "input_ids",
938
  "attention_mask"
939
  ],
940
+ "model_max_length": 1000000000000000019884624838656,
941
  "pad_token": "[PAD]",
942
  "sep_token": "[SEP]",
943
  "tokenizer_class": "PreTrainedTokenizerFast",