End of training

README.md

@@ -0,0 +1,77 @@
+---
+library_name: transformers
+base_model: KennethEnevoldsen/dfm-sentence-encoder-large-exp2-no-lang-align
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+- precision
+- recall
+- f1
+model-index:
+- name: dfm
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# dfm
+
+This model is a fine-tuned version of [KennethEnevoldsen/dfm-sentence-encoder-large-exp2-no-lang-align](https://huggingface.co/KennethEnevoldsen/dfm-sentence-encoder-large-exp2-no-lang-align) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Accuracy: 0.9981
+- Precision: 0.9980
+- Recall: 0.9981
+- F1: 0.9979
+- Loss: 0.0066
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 4
+- eval_batch_size: 4
+- seed: 42
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 8
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 10
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch  | Step | Accuracy | Precision | Recall | F1     | Validation Loss |
+|:-------------:|:------:|:----:|:--------:|:---------:|:------:|:------:|:---------------:|
+| No log        | 0.9524 | 10   | 0.9116   | 0.8719    | 0.9116 | 0.8909 | 0.3402          |
+| No log        | 2.0    | 21   | 0.9585   | 0.9581    | 0.9585 | 0.9535 | 0.1368          |
+| No log        | 2.9524 | 31   | 0.9818   | 0.9806    | 0.9818 | 0.9812 | 0.0664          |
+| No log        | 4.0    | 42   | 0.9926   | 0.9912    | 0.9926 | 0.9919 | 0.0286          |
+| No log        | 4.9524 | 52   | 0.9947   | 0.9934    | 0.9947 | 0.9940 | 0.0209          |
+| No log        | 6.0    | 63   | 0.9953   | 0.9941    | 0.9953 | 0.9946 | 0.0159          |
+| No log        | 6.9524 | 73   | 0.9967   | 0.9968    | 0.9967 | 0.9963 | 0.0107          |
+| No log        | 8.0    | 84   | 0.9977   | 0.9977    | 0.9977 | 0.9975 | 0.0082          |
+| No log        | 8.9524 | 94   | 0.9980   | 0.9979    | 0.9980 | 0.9978 | 0.0067          |
+| No log        | 9.5238 | 100  | 0.9981   | 0.9980    | 0.9981 | 0.9979 | 0.0066          |
+
+
+### Framework versions
+
+- Transformers 4.44.2
+- Pytorch 2.4.1+cu121
+- Tokenizers 0.19.1

config.json

@@ -0,0 +1,40 @@
+{
+  "_name_or_path": "KennethEnevoldsen/dfm-sentence-encoder-large-exp2-no-lang-align",
+  "architectures": [
+    "BertForTokenClassification"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "classifier_dropout": null,
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 1024,
+  "id2label": {
+    "0": "LABEL_0",
+    "1": "LABEL_1",
+    "2": "LABEL_2",
+    "3": "LABEL_3",
+    "4": "LABEL_4"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 4096,
+  "label2id": {
+    "LABEL_0": 0,
+    "LABEL_1": 1,
+    "LABEL_2": 2,
+    "LABEL_3": 3,
+    "LABEL_4": 4
+  },
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 16,
+  "num_hidden_layers": 24,
+  "pad_token_id": 0,
+  "position_embedding_type": "absolute",
+  "torch_dtype": "float32",
+  "transformers_version": "4.44.2",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 50000
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a902b63b039d601544df14e7502853ceb129d623cad057509d5c1c677366a32d
+size 1416218404

runs/Oct22_19-06-49_babc088be480/events.out.tfevents.1729624010.babc088be480.4217.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e259d56a62b4e761a8169476304d6a5261befd7221bbc3bea90d569d96a61c0d
+size 10303

runs/Oct22_19-06-49_babc088be480/events.out.tfevents.1729624115.babc088be480.4217.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:65c2328f48d3e4437b5cd65b95d56716ebe8e39c6fc39070dc384721f44d48e9
+size 551

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b62232183cae99300c88674fb43444c6df48ca32eaf25259a64f8c64f5f693db
+size 5240