Marcos12886
commited on
Upload folder using huggingface_hub
Browse files- README.md +12 -22
- checkpoint-24/config.json +4 -4
- checkpoint-24/model.safetensors +1 -1
- checkpoint-24/optimizer.pt +1 -1
- checkpoint-24/scheduler.pt +1 -1
- checkpoint-24/trainer_state.json +10 -10
- checkpoint-24/training_args.bin +1 -1
- checkpoint-48/config.json +4 -4
- checkpoint-48/model.safetensors +1 -1
- checkpoint-48/optimizer.pt +1 -1
- checkpoint-48/scheduler.pt +1 -1
- checkpoint-48/trainer_state.json +18 -18
- checkpoint-48/training_args.bin +1 -1
- checkpoint-72/config.json +4 -4
- checkpoint-72/model.safetensors +1 -1
- checkpoint-72/optimizer.pt +1 -1
- checkpoint-72/scheduler.pt +1 -1
- checkpoint-72/trainer_state.json +26 -26
- checkpoint-72/training_args.bin +1 -1
- checkpoint-97/config.json +4 -4
- checkpoint-97/model.safetensors +1 -1
- checkpoint-97/optimizer.pt +1 -1
- checkpoint-97/scheduler.pt +1 -1
- checkpoint-97/trainer_state.json +35 -35
- checkpoint-97/training_args.bin +1 -1
- config.json +4 -4
- model.safetensors +1 -1
- runs/Sep10_13-50-27_ubumarcos/events.out.tfevents.1725969028.ubumarcos +3 -0
- runs/Sep10_17-06-13_ubumarcos/events.out.tfevents.1725980774.ubumarcos +3 -0
- runs/Sep10_18-38-16_ubumarcos/events.out.tfevents.1725986297.ubumarcos +3 -0
- training_args.bin +1 -1
README.md
CHANGED
@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
|
|
21 |
|
22 |
This model is a fine-tuned version of [ntu-spml/distilhubert](https://huggingface.co/ntu-spml/distilhubert) on an unknown dataset.
|
23 |
It achieves the following results on the evaluation set:
|
24 |
-
- Loss: 0.
|
25 |
-
- Accuracy: 0.
|
26 |
-
- Precision: 0.
|
27 |
-
- Recall: 0.
|
28 |
-
- F1: 0.
|
29 |
|
30 |
## Model description
|
31 |
|
@@ -44,7 +44,7 @@ More information needed
|
|
44 |
### Training hyperparameters
|
45 |
|
46 |
The following hyperparameters were used during training:
|
47 |
-
- learning_rate: 0.
|
48 |
- train_batch_size: 8
|
49 |
- eval_batch_size: 8
|
50 |
- seed: 123
|
@@ -57,22 +57,12 @@ The following hyperparameters were used during training:
|
|
57 |
|
58 |
### Training results
|
59 |
|
60 |
-
| Training Loss | Epoch
|
61 |
-
|
62 |
-
| No log | 0.9897
|
63 |
-
| No log | 1.9794
|
64 |
-
| No log | 2.9691
|
65 |
-
| No log | 4.0
|
66 |
-
| No log | 4.9897 | 121 | 0.6242 | 0.7597 | 0.7615 | 0.7597 | 0.7448 |
|
67 |
-
| No log | 5.9794 | 145 | 0.5990 | 0.7726 | 0.8035 | 0.7726 | 0.7744 |
|
68 |
-
| No log | 6.9691 | 169 | 0.5286 | 0.7907 | 0.8075 | 0.7907 | 0.7889 |
|
69 |
-
| No log | 8.0 | 194 | 0.4616 | 0.8140 | 0.8345 | 0.8140 | 0.8191 |
|
70 |
-
| No log | 8.9897 | 218 | 0.5001 | 0.8114 | 0.8142 | 0.8114 | 0.8021 |
|
71 |
-
| No log | 9.9794 | 242 | 0.4530 | 0.8165 | 0.8131 | 0.8165 | 0.8126 |
|
72 |
-
| No log | 10.9691 | 266 | 0.4203 | 0.8553 | 0.8586 | 0.8553 | 0.8544 |
|
73 |
-
| No log | 12.0 | 291 | 0.4621 | 0.8450 | 0.8423 | 0.8450 | 0.8402 |
|
74 |
-
| No log | 12.9897 | 315 | 0.4583 | 0.8501 | 0.8493 | 0.8501 | 0.8471 |
|
75 |
-
| No log | 13.9794 | 339 | 0.4448 | 0.8553 | 0.8527 | 0.8553 | 0.8522 |
|
76 |
|
77 |
|
78 |
### Framework versions
|
|
|
21 |
|
22 |
This model is a fine-tuned version of [ntu-spml/distilhubert](https://huggingface.co/ntu-spml/distilhubert) on an unknown dataset.
|
23 |
It achieves the following results on the evaluation set:
|
24 |
+
- Loss: 0.5203
|
25 |
+
- Accuracy: 0.7881
|
26 |
+
- Precision: 0.7937
|
27 |
+
- Recall: 0.7881
|
28 |
+
- F1: 0.7617
|
29 |
|
30 |
## Model description
|
31 |
|
|
|
44 |
### Training hyperparameters
|
45 |
|
46 |
The following hyperparameters were used during training:
|
47 |
+
- learning_rate: 0.0003
|
48 |
- train_batch_size: 8
|
49 |
- eval_batch_size: 8
|
50 |
- seed: 123
|
|
|
57 |
|
58 |
### Training results
|
59 |
|
60 |
+
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 |
|
61 |
+
|:-------------:|:------:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|
|
62 |
+
| No log | 0.9897 | 24 | 1.2071 | 0.4935 | 0.2436 | 0.4935 | 0.3262 |
|
63 |
+
| No log | 1.9794 | 48 | 0.9013 | 0.6718 | 0.7410 | 0.6718 | 0.6040 |
|
64 |
+
| No log | 2.9691 | 72 | 0.6878 | 0.7235 | 0.7739 | 0.7235 | 0.6509 |
|
65 |
+
| No log | 4.0 | 97 | 0.5203 | 0.7881 | 0.7937 | 0.7881 | 0.7617 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
66 |
|
67 |
|
68 |
### Framework versions
|
checkpoint-24/config.json
CHANGED
@@ -58,10 +58,10 @@
|
|
58 |
"initializer_range": 0.02,
|
59 |
"intermediate_size": 3072,
|
60 |
"label2id": {
|
61 |
-
"
|
62 |
-
"
|
63 |
-
"
|
64 |
-
"
|
65 |
},
|
66 |
"layer_norm_eps": 1e-05,
|
67 |
"layerdrop": 0.0,
|
|
|
58 |
"initializer_range": 0.02,
|
59 |
"intermediate_size": 3072,
|
60 |
"label2id": {
|
61 |
+
"LABEL_0": 0,
|
62 |
+
"LABEL_1": 1,
|
63 |
+
"LABEL_2": 2,
|
64 |
+
"LABEL_3": 3
|
65 |
},
|
66 |
"layer_norm_eps": 1e-05,
|
67 |
"layerdrop": 0.0,
|
checkpoint-24/model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 94765560
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5fce500dc6425a6a822f0b384979a4c7071ebbc180a97b6c838222031a60dac9
|
3 |
size 94765560
|
checkpoint-24/optimizer.pt
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 189556666
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6fab2d70587dc183f5e2a49870ff4234d7b4bf45a420c5f267b8ede9ac5a3623
|
3 |
size 189556666
|
checkpoint-24/scheduler.pt
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 1064
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:57af32bddf67bff5adda87be0cda2f787985ccf5296cb80ede508b63f5913ecc
|
3 |
size 1064
|
checkpoint-24/trainer_state.json
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
{
|
2 |
-
"best_metric":
|
3 |
-
"best_model_checkpoint": "distilhubert-finetuned-mixed-data/checkpoint-24",
|
4 |
"epoch": 0.9896907216494846,
|
5 |
"eval_steps": 500,
|
6 |
"global_step": 24,
|
@@ -10,14 +10,14 @@
|
|
10 |
"log_history": [
|
11 |
{
|
12 |
"epoch": 0.9896907216494846,
|
13 |
-
"eval_accuracy": 0.
|
14 |
-
"eval_f1": 0.
|
15 |
-
"eval_loss": 1.
|
16 |
-
"eval_precision": 0.
|
17 |
-
"eval_recall": 0.
|
18 |
-
"eval_runtime": 1.
|
19 |
-
"eval_samples_per_second":
|
20 |
-
"eval_steps_per_second": 29.
|
21 |
"step": 24
|
22 |
}
|
23 |
],
|
|
|
1 |
{
|
2 |
+
"best_metric": 1.207102656364441,
|
3 |
+
"best_model_checkpoint": "A-POR-LOS-8000/distilhubert-finetuned-mixed-data/checkpoint-24",
|
4 |
"epoch": 0.9896907216494846,
|
5 |
"eval_steps": 500,
|
6 |
"global_step": 24,
|
|
|
10 |
"log_history": [
|
11 |
{
|
12 |
"epoch": 0.9896907216494846,
|
13 |
+
"eval_accuracy": 0.4935400516795866,
|
14 |
+
"eval_f1": 0.3261804493799344,
|
15 |
+
"eval_loss": 1.207102656364441,
|
16 |
+
"eval_precision": 0.243581782611889,
|
17 |
+
"eval_recall": 0.4935400516795866,
|
18 |
+
"eval_runtime": 1.6869,
|
19 |
+
"eval_samples_per_second": 229.42,
|
20 |
+
"eval_steps_per_second": 29.048,
|
21 |
"step": 24
|
22 |
}
|
23 |
],
|
checkpoint-24/training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5240
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2f9d9c0423cf26d00bbdc39011f624e8123a445e4cf0014ef3bec42d55cdd67b
|
3 |
size 5240
|
checkpoint-48/config.json
CHANGED
@@ -58,10 +58,10 @@
|
|
58 |
"initializer_range": 0.02,
|
59 |
"intermediate_size": 3072,
|
60 |
"label2id": {
|
61 |
-
"
|
62 |
-
"
|
63 |
-
"
|
64 |
-
"
|
65 |
},
|
66 |
"layer_norm_eps": 1e-05,
|
67 |
"layerdrop": 0.0,
|
|
|
58 |
"initializer_range": 0.02,
|
59 |
"intermediate_size": 3072,
|
60 |
"label2id": {
|
61 |
+
"LABEL_0": 0,
|
62 |
+
"LABEL_1": 1,
|
63 |
+
"LABEL_2": 2,
|
64 |
+
"LABEL_3": 3
|
65 |
},
|
66 |
"layer_norm_eps": 1e-05,
|
67 |
"layerdrop": 0.0,
|
checkpoint-48/model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 94765560
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ca56b35b2317f9f160fef6e50daf311eed3886663e65be7be8bbb19dad380853
|
3 |
size 94765560
|
checkpoint-48/optimizer.pt
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 189556666
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f365e5dc1a109bbd5ed1bc64a68abf502755e8730b4d807096254cdeb50f19de
|
3 |
size 189556666
|
checkpoint-48/scheduler.pt
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 1064
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1aeceec2b1eff945eda15bdef158c65cfce8b2d8246d549e4267eee6949a1678
|
3 |
size 1064
|
checkpoint-48/trainer_state.json
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
{
|
2 |
-
"best_metric":
|
3 |
-
"best_model_checkpoint": "distilhubert-finetuned-mixed-data/checkpoint-24",
|
4 |
"epoch": 1.9793814432989691,
|
5 |
"eval_steps": 500,
|
6 |
"global_step": 48,
|
@@ -10,26 +10,26 @@
|
|
10 |
"log_history": [
|
11 |
{
|
12 |
"epoch": 0.9896907216494846,
|
13 |
-
"eval_accuracy": 0.
|
14 |
-
"eval_f1": 0.
|
15 |
-
"eval_loss": 1.
|
16 |
-
"eval_precision": 0.
|
17 |
-
"eval_recall": 0.
|
18 |
-
"eval_runtime": 1.
|
19 |
-
"eval_samples_per_second":
|
20 |
-
"eval_steps_per_second": 29.
|
21 |
"step": 24
|
22 |
},
|
23 |
{
|
24 |
"epoch": 1.9793814432989691,
|
25 |
-
"eval_accuracy": 0.
|
26 |
-
"eval_f1": 0.
|
27 |
-
"eval_loss":
|
28 |
-
"eval_precision": 0.
|
29 |
-
"eval_recall": 0.
|
30 |
-
"eval_runtime": 1.
|
31 |
-
"eval_samples_per_second":
|
32 |
-
"eval_steps_per_second":
|
33 |
"step": 48
|
34 |
}
|
35 |
],
|
|
|
1 |
{
|
2 |
+
"best_metric": 1.207102656364441,
|
3 |
+
"best_model_checkpoint": "A-POR-LOS-8000/distilhubert-finetuned-mixed-data/checkpoint-24",
|
4 |
"epoch": 1.9793814432989691,
|
5 |
"eval_steps": 500,
|
6 |
"global_step": 48,
|
|
|
10 |
"log_history": [
|
11 |
{
|
12 |
"epoch": 0.9896907216494846,
|
13 |
+
"eval_accuracy": 0.4935400516795866,
|
14 |
+
"eval_f1": 0.3261804493799344,
|
15 |
+
"eval_loss": 1.207102656364441,
|
16 |
+
"eval_precision": 0.243581782611889,
|
17 |
+
"eval_recall": 0.4935400516795866,
|
18 |
+
"eval_runtime": 1.6869,
|
19 |
+
"eval_samples_per_second": 229.42,
|
20 |
+
"eval_steps_per_second": 29.048,
|
21 |
"step": 24
|
22 |
},
|
23 |
{
|
24 |
"epoch": 1.9793814432989691,
|
25 |
+
"eval_accuracy": 0.6718346253229974,
|
26 |
+
"eval_f1": 0.6039830156409437,
|
27 |
+
"eval_loss": 0.9013121724128723,
|
28 |
+
"eval_precision": 0.7410231323825577,
|
29 |
+
"eval_recall": 0.6718346253229974,
|
30 |
+
"eval_runtime": 1.6716,
|
31 |
+
"eval_samples_per_second": 231.514,
|
32 |
+
"eval_steps_per_second": 29.313,
|
33 |
"step": 48
|
34 |
}
|
35 |
],
|
checkpoint-48/training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5240
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2f9d9c0423cf26d00bbdc39011f624e8123a445e4cf0014ef3bec42d55cdd67b
|
3 |
size 5240
|
checkpoint-72/config.json
CHANGED
@@ -58,10 +58,10 @@
|
|
58 |
"initializer_range": 0.02,
|
59 |
"intermediate_size": 3072,
|
60 |
"label2id": {
|
61 |
-
"
|
62 |
-
"
|
63 |
-
"
|
64 |
-
"
|
65 |
},
|
66 |
"layer_norm_eps": 1e-05,
|
67 |
"layerdrop": 0.0,
|
|
|
58 |
"initializer_range": 0.02,
|
59 |
"intermediate_size": 3072,
|
60 |
"label2id": {
|
61 |
+
"LABEL_0": 0,
|
62 |
+
"LABEL_1": 1,
|
63 |
+
"LABEL_2": 2,
|
64 |
+
"LABEL_3": 3
|
65 |
},
|
66 |
"layer_norm_eps": 1e-05,
|
67 |
"layerdrop": 0.0,
|
checkpoint-72/model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 94765560
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bb256a2e9ff5549e9d7435a87d58b17d97a13b294f951a0b41e82fe323e3b09d
|
3 |
size 94765560
|
checkpoint-72/optimizer.pt
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 189556666
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9229e11b127df2d59bb8e6f9bc364aaddbbde7452f09f74d87f076f45f06c3bb
|
3 |
size 189556666
|
checkpoint-72/scheduler.pt
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 1064
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7e91339f08c3e7ccb77e314662990022ff26a83a700b07d616ed780ac18baa03
|
3 |
size 1064
|
checkpoint-72/trainer_state.json
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
{
|
2 |
-
"best_metric":
|
3 |
-
"best_model_checkpoint": "distilhubert-finetuned-mixed-data/checkpoint-
|
4 |
"epoch": 2.9690721649484537,
|
5 |
"eval_steps": 500,
|
6 |
"global_step": 72,
|
@@ -10,38 +10,38 @@
|
|
10 |
"log_history": [
|
11 |
{
|
12 |
"epoch": 0.9896907216494846,
|
13 |
-
"eval_accuracy": 0.
|
14 |
-
"eval_f1": 0.
|
15 |
-
"eval_loss": 1.
|
16 |
-
"eval_precision": 0.
|
17 |
-
"eval_recall": 0.
|
18 |
-
"eval_runtime": 1.
|
19 |
-
"eval_samples_per_second":
|
20 |
-
"eval_steps_per_second": 29.
|
21 |
"step": 24
|
22 |
},
|
23 |
{
|
24 |
"epoch": 1.9793814432989691,
|
25 |
-
"eval_accuracy": 0.
|
26 |
-
"eval_f1": 0.
|
27 |
-
"eval_loss":
|
28 |
-
"eval_precision": 0.
|
29 |
-
"eval_recall": 0.
|
30 |
-
"eval_runtime": 1.
|
31 |
-
"eval_samples_per_second":
|
32 |
-
"eval_steps_per_second":
|
33 |
"step": 48
|
34 |
},
|
35 |
{
|
36 |
"epoch": 2.9690721649484537,
|
37 |
-
"eval_accuracy": 0.
|
38 |
-
"eval_f1": 0.
|
39 |
-
"eval_loss": 0.
|
40 |
-
"eval_precision": 0.
|
41 |
-
"eval_recall": 0.
|
42 |
-
"eval_runtime": 1.
|
43 |
-
"eval_samples_per_second":
|
44 |
-
"eval_steps_per_second": 29.
|
45 |
"step": 72
|
46 |
}
|
47 |
],
|
|
|
1 |
{
|
2 |
+
"best_metric": 1.207102656364441,
|
3 |
+
"best_model_checkpoint": "A-POR-LOS-8000/distilhubert-finetuned-mixed-data/checkpoint-24",
|
4 |
"epoch": 2.9690721649484537,
|
5 |
"eval_steps": 500,
|
6 |
"global_step": 72,
|
|
|
10 |
"log_history": [
|
11 |
{
|
12 |
"epoch": 0.9896907216494846,
|
13 |
+
"eval_accuracy": 0.4935400516795866,
|
14 |
+
"eval_f1": 0.3261804493799344,
|
15 |
+
"eval_loss": 1.207102656364441,
|
16 |
+
"eval_precision": 0.243581782611889,
|
17 |
+
"eval_recall": 0.4935400516795866,
|
18 |
+
"eval_runtime": 1.6869,
|
19 |
+
"eval_samples_per_second": 229.42,
|
20 |
+
"eval_steps_per_second": 29.048,
|
21 |
"step": 24
|
22 |
},
|
23 |
{
|
24 |
"epoch": 1.9793814432989691,
|
25 |
+
"eval_accuracy": 0.6718346253229974,
|
26 |
+
"eval_f1": 0.6039830156409437,
|
27 |
+
"eval_loss": 0.9013121724128723,
|
28 |
+
"eval_precision": 0.7410231323825577,
|
29 |
+
"eval_recall": 0.6718346253229974,
|
30 |
+
"eval_runtime": 1.6716,
|
31 |
+
"eval_samples_per_second": 231.514,
|
32 |
+
"eval_steps_per_second": 29.313,
|
33 |
"step": 48
|
34 |
},
|
35 |
{
|
36 |
"epoch": 2.9690721649484537,
|
37 |
+
"eval_accuracy": 0.7235142118863049,
|
38 |
+
"eval_f1": 0.650883642548806,
|
39 |
+
"eval_loss": 0.6877898573875427,
|
40 |
+
"eval_precision": 0.773936678614098,
|
41 |
+
"eval_recall": 0.7235142118863049,
|
42 |
+
"eval_runtime": 1.6494,
|
43 |
+
"eval_samples_per_second": 234.63,
|
44 |
+
"eval_steps_per_second": 29.708,
|
45 |
"step": 72
|
46 |
}
|
47 |
],
|
checkpoint-72/training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5240
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2f9d9c0423cf26d00bbdc39011f624e8123a445e4cf0014ef3bec42d55cdd67b
|
3 |
size 5240
|
checkpoint-97/config.json
CHANGED
@@ -58,10 +58,10 @@
|
|
58 |
"initializer_range": 0.02,
|
59 |
"intermediate_size": 3072,
|
60 |
"label2id": {
|
61 |
-
"
|
62 |
-
"
|
63 |
-
"
|
64 |
-
"
|
65 |
},
|
66 |
"layer_norm_eps": 1e-05,
|
67 |
"layerdrop": 0.0,
|
|
|
58 |
"initializer_range": 0.02,
|
59 |
"intermediate_size": 3072,
|
60 |
"label2id": {
|
61 |
+
"LABEL_0": 0,
|
62 |
+
"LABEL_1": 1,
|
63 |
+
"LABEL_2": 2,
|
64 |
+
"LABEL_3": 3
|
65 |
},
|
66 |
"layer_norm_eps": 1e-05,
|
67 |
"layerdrop": 0.0,
|
checkpoint-97/model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 94765560
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f82ac806071eb186fa58d9e8cacbf8ddbe05b70b30809e2a5ce9e91ff025b965
|
3 |
size 94765560
|
checkpoint-97/optimizer.pt
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 189556666
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2f4d76e5e77244ac9c365bb0e2d37cbdecb4c34411b9affb43664e91e6192f6c
|
3 |
size 189556666
|
checkpoint-97/scheduler.pt
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 1064
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2de9e0c39413bbfda8d2034f14ed3494641e9851acbf5fec7301338f6f2a7973
|
3 |
size 1064
|
checkpoint-97/trainer_state.json
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
{
|
2 |
-
"best_metric":
|
3 |
-
"best_model_checkpoint": "distilhubert-finetuned-mixed-data/checkpoint-
|
4 |
"epoch": 4.0,
|
5 |
"eval_steps": 500,
|
6 |
"global_step": 97,
|
@@ -10,50 +10,50 @@
|
|
10 |
"log_history": [
|
11 |
{
|
12 |
"epoch": 0.9896907216494846,
|
13 |
-
"eval_accuracy": 0.
|
14 |
-
"eval_f1": 0.
|
15 |
-
"eval_loss": 1.
|
16 |
-
"eval_precision": 0.
|
17 |
-
"eval_recall": 0.
|
18 |
-
"eval_runtime": 1.
|
19 |
-
"eval_samples_per_second":
|
20 |
-
"eval_steps_per_second": 29.
|
21 |
"step": 24
|
22 |
},
|
23 |
{
|
24 |
"epoch": 1.9793814432989691,
|
25 |
-
"eval_accuracy": 0.
|
26 |
-
"eval_f1": 0.
|
27 |
-
"eval_loss":
|
28 |
-
"eval_precision": 0.
|
29 |
-
"eval_recall": 0.
|
30 |
-
"eval_runtime": 1.
|
31 |
-
"eval_samples_per_second":
|
32 |
-
"eval_steps_per_second":
|
33 |
"step": 48
|
34 |
},
|
35 |
{
|
36 |
"epoch": 2.9690721649484537,
|
37 |
-
"eval_accuracy": 0.
|
38 |
-
"eval_f1": 0.
|
39 |
-
"eval_loss": 0.
|
40 |
-
"eval_precision": 0.
|
41 |
-
"eval_recall": 0.
|
42 |
-
"eval_runtime": 1.
|
43 |
-
"eval_samples_per_second":
|
44 |
-
"eval_steps_per_second": 29.
|
45 |
"step": 72
|
46 |
},
|
47 |
{
|
48 |
"epoch": 4.0,
|
49 |
-
"eval_accuracy": 0.
|
50 |
-
"eval_f1": 0.
|
51 |
-
"eval_loss": 0.
|
52 |
-
"eval_precision": 0.
|
53 |
-
"eval_recall": 0.
|
54 |
-
"eval_runtime": 1.
|
55 |
-
"eval_samples_per_second":
|
56 |
-
"eval_steps_per_second": 29.
|
57 |
"step": 97
|
58 |
}
|
59 |
],
|
@@ -78,7 +78,7 @@
|
|
78 |
"should_evaluate": false,
|
79 |
"should_log": false,
|
80 |
"should_save": true,
|
81 |
-
"should_training_stop":
|
82 |
},
|
83 |
"attributes": {}
|
84 |
}
|
|
|
1 |
{
|
2 |
+
"best_metric": 1.207102656364441,
|
3 |
+
"best_model_checkpoint": "A-POR-LOS-8000/distilhubert-finetuned-mixed-data/checkpoint-24",
|
4 |
"epoch": 4.0,
|
5 |
"eval_steps": 500,
|
6 |
"global_step": 97,
|
|
|
10 |
"log_history": [
|
11 |
{
|
12 |
"epoch": 0.9896907216494846,
|
13 |
+
"eval_accuracy": 0.4935400516795866,
|
14 |
+
"eval_f1": 0.3261804493799344,
|
15 |
+
"eval_loss": 1.207102656364441,
|
16 |
+
"eval_precision": 0.243581782611889,
|
17 |
+
"eval_recall": 0.4935400516795866,
|
18 |
+
"eval_runtime": 1.6869,
|
19 |
+
"eval_samples_per_second": 229.42,
|
20 |
+
"eval_steps_per_second": 29.048,
|
21 |
"step": 24
|
22 |
},
|
23 |
{
|
24 |
"epoch": 1.9793814432989691,
|
25 |
+
"eval_accuracy": 0.6718346253229974,
|
26 |
+
"eval_f1": 0.6039830156409437,
|
27 |
+
"eval_loss": 0.9013121724128723,
|
28 |
+
"eval_precision": 0.7410231323825577,
|
29 |
+
"eval_recall": 0.6718346253229974,
|
30 |
+
"eval_runtime": 1.6716,
|
31 |
+
"eval_samples_per_second": 231.514,
|
32 |
+
"eval_steps_per_second": 29.313,
|
33 |
"step": 48
|
34 |
},
|
35 |
{
|
36 |
"epoch": 2.9690721649484537,
|
37 |
+
"eval_accuracy": 0.7235142118863049,
|
38 |
+
"eval_f1": 0.650883642548806,
|
39 |
+
"eval_loss": 0.6877898573875427,
|
40 |
+
"eval_precision": 0.773936678614098,
|
41 |
+
"eval_recall": 0.7235142118863049,
|
42 |
+
"eval_runtime": 1.6494,
|
43 |
+
"eval_samples_per_second": 234.63,
|
44 |
+
"eval_steps_per_second": 29.708,
|
45 |
"step": 72
|
46 |
},
|
47 |
{
|
48 |
"epoch": 4.0,
|
49 |
+
"eval_accuracy": 0.7881136950904393,
|
50 |
+
"eval_f1": 0.7616932056398337,
|
51 |
+
"eval_loss": 0.5203098654747009,
|
52 |
+
"eval_precision": 0.7936707258369592,
|
53 |
+
"eval_recall": 0.7881136950904393,
|
54 |
+
"eval_runtime": 1.6642,
|
55 |
+
"eval_samples_per_second": 232.546,
|
56 |
+
"eval_steps_per_second": 29.444,
|
57 |
"step": 97
|
58 |
}
|
59 |
],
|
|
|
78 |
"should_evaluate": false,
|
79 |
"should_log": false,
|
80 |
"should_save": true,
|
81 |
+
"should_training_stop": true
|
82 |
},
|
83 |
"attributes": {}
|
84 |
}
|
checkpoint-97/training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5240
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2f9d9c0423cf26d00bbdc39011f624e8123a445e4cf0014ef3bec42d55cdd67b
|
3 |
size 5240
|
config.json
CHANGED
@@ -58,10 +58,10 @@
|
|
58 |
"initializer_range": 0.02,
|
59 |
"intermediate_size": 3072,
|
60 |
"label2id": {
|
61 |
-
"
|
62 |
-
"
|
63 |
-
"
|
64 |
-
"
|
65 |
},
|
66 |
"layer_norm_eps": 1e-05,
|
67 |
"layerdrop": 0.0,
|
|
|
58 |
"initializer_range": 0.02,
|
59 |
"intermediate_size": 3072,
|
60 |
"label2id": {
|
61 |
+
"LABEL_0": 0,
|
62 |
+
"LABEL_1": 1,
|
63 |
+
"LABEL_2": 2,
|
64 |
+
"LABEL_3": 3
|
65 |
},
|
66 |
"layer_norm_eps": 1e-05,
|
67 |
"layerdrop": 0.0,
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 94765560
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5fce500dc6425a6a822f0b384979a4c7071ebbc180a97b6c838222031a60dac9
|
3 |
size 94765560
|
runs/Sep10_13-50-27_ubumarcos/events.out.tfevents.1725969028.ubumarcos
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:20b19df803d9fcef566f4cb0972b1e663ee29d1c1bd9227af59cfbbadc1f6ee6
|
3 |
+
size 5934
|
runs/Sep10_17-06-13_ubumarcos/events.out.tfevents.1725980774.ubumarcos
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f01b9b7581d6d596ea1a3a45f74541f9cf5509ed53c7b189e03ad4c23a0363b7
|
3 |
+
size 5966
|
runs/Sep10_18-38-16_ubumarcos/events.out.tfevents.1725986297.ubumarcos
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:00d30800d6b773a61839e2acdfad761002f45b75938f0b0a61e444e145182932
|
3 |
+
size 8166
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5240
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2f9d9c0423cf26d00bbdc39011f624e8123a445e4cf0014ef3bec42d55cdd67b
|
3 |
size 5240
|