lukeleeai commited on
Commit
bab3d73
·
verified ·
1 Parent(s): 841c70d

End of training

Browse files
README.md CHANGED
@@ -18,9 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.6368
22
- - Accuracy: {'accuracy': 0.6927570093457944}
23
- - Matthews Correlation: 0.0422
24
 
25
  ## Model description
26
 
@@ -49,10 +49,14 @@ The following hyperparameters were used during training:
49
  - total_eval_batch_size: 192
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
- - training_steps: 1
53
 
54
  ### Training results
55
 
 
 
 
 
56
 
57
 
58
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.6546
22
+ - Accuracy: {'accuracy': 0.6728971962616822}
23
+ - Matthews Correlation: -0.0184
24
 
25
  ## Model description
26
 
 
49
  - total_eval_batch_size: 192
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
+ - training_steps: 20
53
 
54
  ### Training results
55
 
56
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | Matthews Correlation |
57
+ |:-------------:|:-----:|:----:|:---------------:|:---------------------------------:|:--------------------:|
58
+ | 0.8988 | 0.12 | 10 | 0.7592 | {'accuracy': 0.47171620325982744} | -0.0379 |
59
+ | 0.6785 | 0.25 | 20 | 0.6739 | {'accuracy': 0.6653883029721956} | -0.0162 |
60
 
61
 
62
  ### Framework versions
adapter_config.json CHANGED
@@ -19,8 +19,8 @@
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
- "q_proj",
23
- "v_proj"
24
  ],
25
  "task_type": "SEQ_CLS"
26
  }
 
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
+ "v_proj",
23
+ "q_proj"
24
  ],
25
  "task_type": "SEQ_CLS"
26
  }
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:47eb986ca9d112407a3ae2c776f150282220a6182b3d33c4da58d047e63d3578
3
  size 131240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6eeebf28e598c040de22bc4d9096585640b0fc06716922817225c9646f8b8ba7
3
  size 131240
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3ad28a23dc89b5813510daf10bea949340dc4ce8fabd54a2e822cd60b07e7b04
3
  size 6008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d555edf01d3eeb928830e8a338dfd0a80901398d6421ca73e7885b390ea6013
3
  size 6008