Hugging Face's logo

irenewds
/
shawgpt-ft

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
irenewds commited on
Commit
c56fb40
·
verified ·
1 Parent(s): 2abc113

irenewds/shawgpt-ft

Browse files
Files changed (3) hide show
  1. README.md +20 -15
  2. runs/Oct24_20-37-04_1f4e1c060daf/events.out.tfevents.1729802224.1f4e1c060daf.28754.8 +3 -0
  3. training_args.bin +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [TheBloke/Mistral-7B-Instruct-v0.2-GPTQ](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GPTQ) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 3.3903
20
 
21
  ## Model description
22
 
@@ -39,8 +39,8 @@ The following hyperparameters were used during training:
39
  - train_batch_size: 4
40
  - eval_batch_size: 4
41
  - seed: 42
42
- - gradient_accumulation_steps: 8
43
- - total_train_batch_size: 32
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - lr_scheduler_warmup_steps: 2
@@ -49,18 +49,23 @@ The following hyperparameters were used during training:
49
 
50
  ### Training results
51
 
52
- | Training Loss | Epoch | Step | Validation Loss |
53
- |:-------------:|:------:|:----:|:---------------:|
54
- | 6.9703 | 0.6154 | 1 | 4.2307 |
55
- | 3.4299 | 1.8462 | 3 | 4.0954 |
56
- | 6.6315 | 2.4615 | 4 | 4.0002 |
57
- | 3.1735 | 3.6923 | 6 | 3.8260 |
58
- | 3.0824 | 4.9231 | 8 | 3.6824 |
59
- | 5.9421 | 5.5385 | 9 | 3.6204 |
60
- | 2.9008 | 6.7692 | 11 | 3.5164 |
61
- | 2.8262 | 8.0 | 13 | 3.4415 |
62
- | 5.5625 | 8.6154 | 14 | 3.4162 |
63
- | 2.334 | 9.8462 | 16 | 3.3903 |
 
 
 
 
 
64
 
65
 
66
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [TheBloke/Mistral-7B-Instruct-v0.2-GPTQ](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GPTQ) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.8528
20
 
21
  ## Model description
22
 
 
39
  - train_batch_size: 4
40
  - eval_batch_size: 4
41
  - seed: 42
42
+ - gradient_accumulation_steps: 4
43
+ - total_train_batch_size: 16
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - lr_scheduler_warmup_steps: 2
 
49
 
50
  ### Training results
51
 
52
+ | Training Loss | Epoch | Step | Validation Loss |
53
+ |:-------------:|:-------:|:----:|:---------------:|
54
+ | 4.6193 | 0.9231 | 3 | 4.1003 |
55
+ | 4.3201 | 1.8462 | 6 | 3.8086 |
56
+ | 3.9755 | 2.7692 | 9 | 3.5351 |
57
+ | 2.7376 | 4.0 | 13 | 3.1911 |
58
+ | 3.3753 | 4.9231 | 16 | 2.9601 |
59
+ | 3.0944 | 5.8462 | 19 | 2.7577 |
60
+ | 2.8686 | 6.7692 | 22 | 2.5897 |
61
+ | 2.0042 | 8.0 | 26 | 2.3885 |
62
+ | 2.4887 | 8.9231 | 29 | 2.2642 |
63
+ | 2.3262 | 9.8462 | 32 | 2.1536 |
64
+ | 2.2109 | 10.7692 | 35 | 2.0500 |
65
+ | 1.5436 | 12.0 | 39 | 1.9406 |
66
+ | 1.9916 | 12.9231 | 42 | 1.8923 |
67
+ | 1.9223 | 13.8462 | 45 | 1.8639 |
68
+ | 1.4561 | 14.7692 | 48 | 1.8528 |
69
 
70
 
71
  ### Framework versions
runs/Oct24_20-37-04_1f4e1c060daf/events.out.tfevents.1729802224.1f4e1c060daf.28754.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79b4c473f645947dcb2b0b242edcb94e7cce92691607b5fb4720f0770c69be67
3
+ size 13025
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3df52654c2125c6cc3d3a176af21eb30f2ef1fc7e01e15ed33451cef4f6c43c0
3
  size 5176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8dd5606dde3b3d0a9d92cb351e389c57acbd5f33650e941bd71a5c754645df9
3
  size 5176