Hugging Face's logo

Daniegiday
/
GPT_nyala

Question Answering
Transformers
Safetensors
xlm-roberta
Generated from Trainer
Inference Endpoints
Model card Files Community
Daniegiday commited on
Commit
4db18e8
路
verified 路
1 Parent(s): 2bd1abf

Model save

Browse files
Files changed (1) hide show
  1. README.md +25 -19
README.md CHANGED
@@ -4,8 +4,6 @@ license: mit
4
  base_model: xlm-roberta-base
5
  tags:
6
  - generated_from_trainer
7
- metrics:
8
- - f1
9
  model-index:
10
  - name: GPT_nyala
11
  results: []
@@ -18,9 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 4.3888
22
- - Exact Match: 0.0
23
- - F1: 0.0
24
 
25
  ## Model description
26
 
@@ -39,28 +35,38 @@ More information needed
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
- - learning_rate: 5e-05
43
  - train_batch_size: 8
44
  - eval_batch_size: 8
45
  - seed: 42
46
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
47
  - lr_scheduler_type: linear
48
- - num_epochs: 10
49
 
50
  ### Training results
51
 
52
- | Training Loss | Epoch | Step | Validation Loss | Exact Match | F1 |
53
- |:-------------:|:-----:|:----:|:---------------:|:-----------:|:-------:|
54
- | No log | 1.0 | 2 | 5.3929 | 0.0 | 24.9084 |
55
- | No log | 2.0 | 4 | 4.9811 | 0.0 | 35.4497 |
56
- | No log | 3.0 | 6 | 5.0173 | 0.0 | 35.4497 |
57
- | No log | 4.0 | 8 | 4.6001 | 0.0 | 18.6667 |
58
- | 4.8411 | 5.0 | 10 | 4.4303 | 0.0 | 0.0 |
59
- | 4.8411 | 6.0 | 12 | 4.4729 | 0.0 | 0.0 |
60
- | 4.8411 | 7.0 | 14 | 4.4833 | 0.0 | 0.0 |
61
- | 4.8411 | 8.0 | 16 | 4.4062 | 0.0 | 23.7037 |
62
- | 4.8411 | 9.0 | 18 | 4.3840 | 0.0 | 0.0 |
63
- | 3.0229 | 10.0 | 20 | 4.3888 | 0.0 | 0.0 |
 
 
 
 
 
 
 
 
 
 
64
 
65
 
66
  ### Framework versions
 
4
  base_model: xlm-roberta-base
5
  tags:
6
  - generated_from_trainer
 
 
7
  model-index:
8
  - name: GPT_nyala
9
  results: []
 
16
 
17
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.0000
 
 
20
 
21
  ## Model description
22
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 3e-05
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
42
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
  - lr_scheduler_type: linear
44
+ - num_epochs: 20
45
 
46
  ### Training results
47
 
48
+ | Training Loss | Epoch | Step | Validation Loss |
49
+ |:-------------:|:-----:|:----:|:---------------:|
50
+ | No log | 1.0 | 63 | 0.0981 |
51
+ | No log | 2.0 | 126 | 0.0007 |
52
+ | No log | 3.0 | 189 | 0.0002 |
53
+ | No log | 4.0 | 252 | 0.0006 |
54
+ | No log | 5.0 | 315 | 0.0169 |
55
+ | No log | 6.0 | 378 | 0.0002 |
56
+ | No log | 7.0 | 441 | 0.0001 |
57
+ | 0.3539 | 8.0 | 504 | 0.0002 |
58
+ | 0.3539 | 9.0 | 567 | 0.0001 |
59
+ | 0.3539 | 10.0 | 630 | 0.0001 |
60
+ | 0.3539 | 11.0 | 693 | 0.0001 |
61
+ | 0.3539 | 12.0 | 756 | 0.0001 |
62
+ | 0.3539 | 13.0 | 819 | 0.0001 |
63
+ | 0.3539 | 14.0 | 882 | 0.0001 |
64
+ | 0.3539 | 15.0 | 945 | 0.0001 |
65
+ | 0.0012 | 16.0 | 1008 | 0.0000 |
66
+ | 0.0012 | 17.0 | 1071 | 0.0001 |
67
+ | 0.0012 | 18.0 | 1134 | 0.0000 |
68
+ | 0.0012 | 19.0 | 1197 | 0.0000 |
69
+ | 0.0012 | 20.0 | 1260 | 0.0000 |
70
 
71
 
72
  ### Framework versions