Hugging Face's logo

imdatta0
/
Meta-Llama-3-8B_metamath_default

PEFT
Safetensors
unsloth
Generated from Trainer
Model card Files Community
imdatta0 commited on
Commit
28b9e00
•
1 Parent(s): 54033dd

End of training

Browse files
Files changed (2) hide show
  1. README.md +50 -50
  2. adapter_model.safetensors +1 -1
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- base_model: unsloth/llama-3-8b-bnb-4bit
3
  library_name: peft
4
  license: llama3
5
  tags:
@@ -15,9 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # Meta-Llama-3-8B_metamath_default
17
 
18
- This model is a fine-tuned version of [unsloth/llama-3-8b-bnb-4bit](https://huggingface.co/unsloth/llama-3-8b-bnb-4bit) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.5076
21
 
22
  ## Model description
23
 
@@ -51,53 +51,53 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
- | 1.1401 | 0.0211 | 13 | 0.7539 |
55
- | 0.6625 | 0.0421 | 26 | 0.6617 |
56
- | 0.6216 | 0.0632 | 39 | 0.6351 |
57
- | 0.6049 | 0.0842 | 52 | 0.6233 |
58
- | 0.5661 | 0.1053 | 65 | 0.6132 |
59
- | 0.5763 | 0.1264 | 78 | 0.6084 |
60
- | 0.5823 | 0.1474 | 91 | 0.6008 |
61
- | 0.5671 | 0.1685 | 104 | 0.5951 |
62
- | 0.5487 | 0.1896 | 117 | 0.5935 |
63
- | 0.5486 | 0.2106 | 130 | 0.5895 |
64
- | 0.5418 | 0.2317 | 143 | 0.5855 |
65
- | 0.5522 | 0.2527 | 156 | 0.5829 |
66
- | 0.547 | 0.2738 | 169 | 0.5749 |
67
- | 0.5466 | 0.2949 | 182 | 0.5722 |
68
- | 0.5369 | 0.3159 | 195 | 0.5694 |
69
- | 0.5191 | 0.3370 | 208 | 0.5668 |
70
- | 0.5274 | 0.3580 | 221 | 0.5617 |
71
- | 0.5293 | 0.3791 | 234 | 0.5595 |
72
- | 0.5384 | 0.4002 | 247 | 0.5551 |
73
- | 0.5146 | 0.4212 | 260 | 0.5532 |
74
- | 0.5283 | 0.4423 | 273 | 0.5499 |
75
- | 0.5292 | 0.4633 | 286 | 0.5467 |
76
- | 0.5305 | 0.4844 | 299 | 0.5441 |
77
- | 0.5086 | 0.5055 | 312 | 0.5398 |
78
- | 0.519 | 0.5265 | 325 | 0.5368 |
79
- | 0.5084 | 0.5476 | 338 | 0.5355 |
80
- | 0.5043 | 0.5687 | 351 | 0.5318 |
81
- | 0.483 | 0.5897 | 364 | 0.5293 |
82
- | 0.5066 | 0.6108 | 377 | 0.5257 |
83
- | 0.5004 | 0.6318 | 390 | 0.5235 |
84
- | 0.4927 | 0.6529 | 403 | 0.5226 |
85
- | 0.498 | 0.6740 | 416 | 0.5199 |
86
- | 0.4946 | 0.6950 | 429 | 0.5194 |
87
- | 0.5002 | 0.7161 | 442 | 0.5174 |
88
- | 0.49 | 0.7371 | 455 | 0.5149 |
89
- | 0.477 | 0.7582 | 468 | 0.5142 |
90
- | 0.4775 | 0.7793 | 481 | 0.5129 |
91
- | 0.4745 | 0.8003 | 494 | 0.5119 |
92
- | 0.506 | 0.8214 | 507 | 0.5105 |
93
- | 0.4922 | 0.8424 | 520 | 0.5098 |
94
- | 0.481 | 0.8635 | 533 | 0.5090 |
95
- | 0.5014 | 0.8846 | 546 | 0.5085 |
96
- | 0.4823 | 0.9056 | 559 | 0.5081 |
97
- | 0.4781 | 0.9267 | 572 | 0.5078 |
98
- | 0.4913 | 0.9478 | 585 | 0.5077 |
99
- | 0.4975 | 0.9688 | 598 | 0.5075 |
100
- | 0.4959 | 0.9899 | 611 | 0.5076 |
101
 
102
 
103
  ### Framework versions
 
1
  ---
2
+ base_model: unsloth/llama-3-8b
3
  library_name: peft
4
  license: llama3
5
  tags:
 
15
 
16
  # Meta-Llama-3-8B_metamath_default
17
 
18
+ This model is a fine-tuned version of [unsloth/llama-3-8b](https://huggingface.co/unsloth/llama-3-8b) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.5068
21
 
22
  ## Model description
23
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
+ | 0.8666 | 0.0211 | 13 | 0.7509 |
55
+ | 0.6952 | 0.0421 | 26 | 0.7368 |
56
+ | 0.7079 | 0.0632 | 39 | 0.7196 |
57
+ | 0.6922 | 0.0842 | 52 | 0.7066 |
58
+ | 0.6565 | 0.1053 | 65 | 0.7074 |
59
+ | 0.6791 | 0.1264 | 78 | 0.7263 |
60
+ | 0.6858 | 0.1474 | 91 | 0.7019 |
61
+ | 0.6693 | 0.1685 | 104 | 0.6926 |
62
+ | 0.6503 | 0.1896 | 117 | 0.6922 |
63
+ | 0.6488 | 0.2106 | 130 | 0.6925 |
64
+ | 0.6505 | 0.2317 | 143 | 0.6844 |
65
+ | 0.6533 | 0.2527 | 156 | 0.6842 |
66
+ | 0.6505 | 0.2738 | 169 | 0.6709 |
67
+ | 0.6456 | 0.2949 | 182 | 0.6661 |
68
+ | 0.6307 | 0.3159 | 195 | 0.6699 |
69
+ | 0.6144 | 0.3370 | 208 | 0.6629 |
70
+ | 0.6286 | 0.3580 | 221 | 0.6547 |
71
+ | 0.6261 | 0.3791 | 234 | 0.6469 |
72
+ | 0.6365 | 0.4002 | 247 | 0.6482 |
73
+ | 0.6108 | 0.4212 | 260 | 0.6428 |
74
+ | 0.6207 | 0.4423 | 273 | 0.6322 |
75
+ | 0.6219 | 0.4633 | 286 | 0.6265 |
76
+ | 0.6133 | 0.4844 | 299 | 0.6213 |
77
+ | 0.5944 | 0.5055 | 312 | 0.6138 |
78
+ | 0.5871 | 0.5265 | 325 | 0.6034 |
79
+ | 0.5827 | 0.5476 | 338 | 0.6013 |
80
+ | 0.5714 | 0.5687 | 351 | 0.5923 |
81
+ | 0.5512 | 0.5897 | 364 | 0.5849 |
82
+ | 0.5636 | 0.6108 | 377 | 0.5755 |
83
+ | 0.5564 | 0.6318 | 390 | 0.5684 |
84
+ | 0.5444 | 0.6529 | 403 | 0.5647 |
85
+ | 0.5431 | 0.6740 | 416 | 0.5582 |
86
+ | 0.5311 | 0.6950 | 429 | 0.5533 |
87
+ | 0.5323 | 0.7161 | 442 | 0.5458 |
88
+ | 0.5172 | 0.7371 | 455 | 0.5386 |
89
+ | 0.5113 | 0.7582 | 468 | 0.5341 |
90
+ | 0.4989 | 0.7793 | 481 | 0.5296 |
91
+ | 0.4929 | 0.8003 | 494 | 0.5264 |
92
+ | 0.5266 | 0.8214 | 507 | 0.5214 |
93
+ | 0.5075 | 0.8424 | 520 | 0.5184 |
94
+ | 0.4917 | 0.8635 | 533 | 0.5150 |
95
+ | 0.5078 | 0.8846 | 546 | 0.5124 |
96
+ | 0.4897 | 0.9056 | 559 | 0.5099 |
97
+ | 0.4879 | 0.9267 | 572 | 0.5081 |
98
+ | 0.5007 | 0.9478 | 585 | 0.5073 |
99
+ | 0.4979 | 0.9688 | 598 | 0.5071 |
100
+ | 0.4991 | 0.9899 | 611 | 0.5068 |
101
 
102
 
103
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ccfc273d4e9a38fc8e1e62e4bb70c66348df9ab3abe2946bd8262342fa243aab
3
  size 83945296
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5b4ed3c882f1b56449d92dffd9f59ad0c044a4cebf8fefe9c01c78350b2fa9a
3
  size 83945296