Initial model push after training

README.md

@@ -0,0 +1,83 @@
+---
+library_name: transformers
+license: apache-2.0
+base_model: google-bert/bert-large-uncased
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+- precision
+- recall
+- f1
+model-index:
+- name: math_question_grade_detection_v2
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# math_question_grade_detection_v2
+
+This model is a fine-tuned version of [google-bert/bert-large-uncased](https://huggingface.co/google-bert/bert-large-uncased) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 2.1410
+- Accuracy: 0.1591
+- Precision: 0.0253
+- Recall: 0.1591
+- F1: 0.0437
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 16
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- training_steps: 850
+
+### Training results
+
+| Training Loss | Epoch  | Step | Validation Loss | Accuracy | Precision | Recall | F1     |
+|:-------------:|:------:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|
+| No log        | 0.0683 | 50   | 2.0313          | 0.2237   | 0.0856    | 0.2237 | 0.1038 |
+| No log        | 0.1366 | 100  | 2.2165          | 0.1337   | 0.0179    | 0.1337 | 0.0316 |
+| No log        | 0.2049 | 150  | 2.1366          | 0.1722   | 0.0296    | 0.1722 | 0.0506 |
+| No log        | 0.2732 | 200  | 2.1438          | 0.1722   | 0.0296    | 0.1722 | 0.0506 |
+| No log        | 0.3415 | 250  | 2.1389          | 0.1591   | 0.0253    | 0.1591 | 0.0437 |
+| No log        | 0.4098 | 300  | 2.1450          | 0.1722   | 0.0296    | 0.1722 | 0.0506 |
+| No log        | 0.4781 | 350  | 2.1456          | 0.1722   | 0.0296    | 0.1722 | 0.0506 |
+| No log        | 0.5464 | 400  | 2.1396          | 0.1722   | 0.0296    | 0.1722 | 0.0506 |
+| No log        | 0.6148 | 450  | 2.1349          | 0.1722   | 0.0296    | 0.1722 | 0.0506 |
+| 2.1632        | 0.6831 | 500  | 2.1392          | 0.1591   | 0.0253    | 0.1591 | 0.0437 |
+| 2.1632        | 0.7514 | 550  | 2.1391          | 0.1722   | 0.0296    | 0.1722 | 0.0506 |
+| 2.1632        | 0.8197 | 600  | 2.1391          | 0.1591   | 0.0253    | 0.1591 | 0.0437 |
+| 2.1632        | 0.8880 | 650  | 2.1360          | 0.1722   | 0.0296    | 0.1722 | 0.0506 |
+| 2.1632        | 0.9563 | 700  | 2.1366          | 0.1722   | 0.0296    | 0.1722 | 0.0506 |
+| 2.1632        | 1.0246 | 750  | 2.1388          | 0.1591   | 0.0253    | 0.1591 | 0.0437 |
+| 2.1632        | 1.0929 | 800  | 2.1410          | 0.1591   | 0.0253    | 0.1591 | 0.0437 |
+| 2.1632        | 1.1612 | 850  | 2.1410          | 0.1591   | 0.0253    | 0.1591 | 0.0437 |
+
+
+### Framework versions
+
+- Transformers 4.47.0
+- Pytorch 2.2.1+cu121
+- Datasets 3.2.0
+- Tokenizers 0.21.0

config.json

@@ -0,0 +1,49 @@
+{
+  "_name_or_path": "google-bert/bert-large-uncased",
+  "architectures": [
+    "BertForSequenceClassification"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "classifier_dropout": null,
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 1024,
+  "id2label": {
+    "0": "LABEL_0",
+    "1": "LABEL_1",
+    "2": "LABEL_2",
+    "3": "LABEL_3",
+    "4": "LABEL_4",
+    "5": "LABEL_5",
+    "6": "LABEL_6",
+    "7": "LABEL_7",
+    "8": "LABEL_8"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 4096,
+  "label2id": {
+    "LABEL_0": 0,
+    "LABEL_1": 1,
+    "LABEL_2": 2,
+    "LABEL_3": 3,
+    "LABEL_4": 4,
+    "LABEL_5": 5,
+    "LABEL_6": 6,
+    "LABEL_7": 7,
+    "LABEL_8": 8
+  },
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 16,
+  "num_hidden_layers": 24,
+  "pad_token_id": 0,
+  "position_embedding_type": "absolute",
+  "problem_type": "single_label_classification",
+  "torch_dtype": "float32",
+  "transformers_version": "4.47.0",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 30522
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d2ed8892ce449a673d4d7c88a6b7d0a8045af2b1ec670de6342106f66782b50
+size 1340651460

runs/Dec11_12-07-03_ip-10-192-12-207/events.out.tfevents.1733918823.ip-10-192-12-207.221781.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b8642d748db2a504e698a68cdd3e59570c3aab8ac18124f67afc54f81f6069b8
+size 5477

runs/Dec11_12-07-20_ip-10-192-12-207/events.out.tfevents.1733918841.ip-10-192-12-207.222488.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc7231b9f17694dcaa62f94f9f455abb16afeb99eb8834bd3a6feb9ac6d72d2b
+size 5477

runs/Dec11_12-07-45_ip-10-192-12-207/events.out.tfevents.1733918865.ip-10-192-12-207.222945.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a4d4f3c90d22ad7d8aa86b03161939e8a446852d81543a82f9bc6a67bea3bcc
+size 5477

runs/Dec11_12-08-12_ip-10-192-12-207/events.out.tfevents.1733918892.ip-10-192-12-207.223812.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b0d2455f7c71ceb91832ed212ffc9904a1d1a4023a9286344a90b523a85276d4
+size 14048

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ebe58f837949dfe05687db523d451be59eeae12cc93136e29dd71fc65773432d
+size 5304