Hugging Face's logo

GaetanMichelet
/
Mistral-7B_task-3_180-samples_config-2

PEFT
TensorBoard
Safetensors
mistral
alignment-handbook
trl
sft
Generated from Trainer
4-bit precision
bitsandbytes
Model card Files Metrics Community
GaetanMichelet commited on
Commit
3a1486f
•
1 Parent(s): b25cf8d

Model save

Browse files
Files changed (5) hide show
  1. README.md +76 -0
  2. adapter_model.safetensors +1 -1
  3. all_results.json +9 -0
  4. train_results.json +9 -0
  5. trainer_state.json +511 -0
README.md ADDED
@@ -0,0 +1,76 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: mistralai/Mistral-7B-Instruct-v0.3
3
+ library_name: peft
4
+ license: apache-2.0
5
+ tags:
6
+ - trl
7
+ - sft
8
+ - generated_from_trainer
9
+ model-index:
10
+ - name: Mistral-7B_task-3_180-samples_config-2
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # Mistral-7B_task-3_180-samples_config-2
18
+
19
+ This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) on the None dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.7273
22
+
23
+ ## Model description
24
+
25
+ More information needed
26
+
27
+ ## Intended uses & limitations
28
+
29
+ More information needed
30
+
31
+ ## Training and evaluation data
32
+
33
+ More information needed
34
+
35
+ ## Training procedure
36
+
37
+ ### Training hyperparameters
38
+
39
+ The following hyperparameters were used during training:
40
+ - learning_rate: 0.0001
41
+ - train_batch_size: 1
42
+ - eval_batch_size: 1
43
+ - seed: 42
44
+ - distributed_type: multi-GPU
45
+ - gradient_accumulation_steps: 16
46
+ - total_train_batch_size: 16
47
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
+ - lr_scheduler_type: cosine
49
+ - lr_scheduler_warmup_ratio: 0.1
50
+ - num_epochs: 50
51
+
52
+ ### Training results
53
+
54
+ | Training Loss | Epoch | Step | Validation Loss |
55
+ |:-------------:|:-------:|:----:|:---------------:|
56
+ | 2.7267 | 0.9412 | 8 | 2.1990 |
57
+ | 0.8147 | 2.0 | 17 | 0.6679 |
58
+ | 0.4601 | 2.9412 | 25 | 0.4733 |
59
+ | 0.244 | 4.0 | 34 | 0.4196 |
60
+ | 0.2392 | 4.9412 | 42 | 0.4077 |
61
+ | 0.2333 | 6.0 | 51 | 0.4224 |
62
+ | 0.1101 | 6.9412 | 59 | 0.4903 |
63
+ | 0.0532 | 8.0 | 68 | 0.5854 |
64
+ | 0.0266 | 8.9412 | 76 | 0.6643 |
65
+ | 0.009 | 10.0 | 85 | 0.7163 |
66
+ | 0.0074 | 10.9412 | 93 | 0.7388 |
67
+ | 0.0055 | 12.0 | 102 | 0.7273 |
68
+
69
+
70
+ ### Framework versions
71
+
72
+ - PEFT 0.12.0
73
+ - Transformers 4.44.0
74
+ - Pytorch 2.1.2+cu121
75
+ - Datasets 2.20.0
76
+ - Tokenizers 0.19.1
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:329e018941d107fa86367b675dfa0ed18df97079322da1245d477aea6c83f1cf
3
  size 167832240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b73c86db5f89c0138e32a4941c45146546ddb1e72a01efb2e2a59d8b6b1e5418
3
  size 167832240
all_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 12.0,
3
+ "total_flos": 1.5906559946339123e+17,
4
+ "train_loss": 0.5047409891552639,
5
+ "train_runtime": 5898.6129,
6
+ "train_samples": 136,
7
+ "train_samples_per_second": 1.153,
8
+ "train_steps_per_second": 0.068
9
+ }
train_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 12.0,
3
+ "total_flos": 1.5906559946339123e+17,
4
+ "train_loss": 0.5047409891552639,
5
+ "train_runtime": 5898.6129,
6
+ "train_samples": 136,
7
+ "train_samples_per_second": 1.153,
8
+ "train_steps_per_second": 0.068
9
+ }
trainer_state.json ADDED
@@ -0,0 +1,511 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 0.40765851736068726,
3
+ "best_model_checkpoint": "data/Mistral-7B_task-3_180-samples_config-2/checkpoint-42",
4
+ "epoch": 12.0,
5
+ "eval_steps": 500,
6
+ "global_step": 102,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.11764705882352941,
13
+ "grad_norm": 14.504705429077148,
14
+ "learning_rate": 2.5e-06,
15
+ "loss": 3.3326,
16
+ "step": 1
17
+ },
18
+ {
19
+ "epoch": 0.23529411764705882,
20
+ "grad_norm": 20.7569580078125,
21
+ "learning_rate": 5e-06,
22
+ "loss": 4.3434,
23
+ "step": 2
24
+ },
25
+ {
26
+ "epoch": 0.47058823529411764,
27
+ "grad_norm": 15.900101661682129,
28
+ "learning_rate": 1e-05,
29
+ "loss": 3.6601,
30
+ "step": 4
31
+ },
32
+ {
33
+ "epoch": 0.7058823529411765,
34
+ "grad_norm": 11.783173561096191,
35
+ "learning_rate": 1.5e-05,
36
+ "loss": 3.1182,
37
+ "step": 6
38
+ },
39
+ {
40
+ "epoch": 0.9411764705882353,
41
+ "grad_norm": 9.379878997802734,
42
+ "learning_rate": 2e-05,
43
+ "loss": 2.7267,
44
+ "step": 8
45
+ },
46
+ {
47
+ "epoch": 0.9411764705882353,
48
+ "eval_loss": 2.1989693641662598,
49
+ "eval_runtime": 39.0777,
50
+ "eval_samples_per_second": 0.921,
51
+ "eval_steps_per_second": 0.921,
52
+ "step": 8
53
+ },
54
+ {
55
+ "epoch": 1.1764705882352942,
56
+ "grad_norm": 7.800622940063477,
57
+ "learning_rate": 2.5e-05,
58
+ "loss": 2.0051,
59
+ "step": 10
60
+ },
61
+ {
62
+ "epoch": 1.4117647058823528,
63
+ "grad_norm": 7.2994065284729,
64
+ "learning_rate": 3e-05,
65
+ "loss": 1.5395,
66
+ "step": 12
67
+ },
68
+ {
69
+ "epoch": 1.6470588235294117,
70
+ "grad_norm": 4.580909729003906,
71
+ "learning_rate": 3.5e-05,
72
+ "loss": 1.0346,
73
+ "step": 14
74
+ },
75
+ {
76
+ "epoch": 1.8823529411764706,
77
+ "grad_norm": 2.24992036819458,
78
+ "learning_rate": 4e-05,
79
+ "loss": 0.8147,
80
+ "step": 16
81
+ },
82
+ {
83
+ "epoch": 2.0,
84
+ "eval_loss": 0.6679273843765259,
85
+ "eval_runtime": 39.074,
86
+ "eval_samples_per_second": 0.921,
87
+ "eval_steps_per_second": 0.921,
88
+ "step": 17
89
+ },
90
+ {
91
+ "epoch": 2.1176470588235294,
92
+ "grad_norm": 1.516501545906067,
93
+ "learning_rate": 4.5e-05,
94
+ "loss": 0.6609,
95
+ "step": 18
96
+ },
97
+ {
98
+ "epoch": 2.3529411764705883,
99
+ "grad_norm": 0.9916050434112549,
100
+ "learning_rate": 5e-05,
101
+ "loss": 0.607,
102
+ "step": 20
103
+ },
104
+ {
105
+ "epoch": 2.588235294117647,
106
+ "grad_norm": 0.7745568752288818,
107
+ "learning_rate": 5.500000000000001e-05,
108
+ "loss": 0.4275,
109
+ "step": 22
110
+ },
111
+ {
112
+ "epoch": 2.8235294117647056,
113
+ "grad_norm": 0.7072432637214661,
114
+ "learning_rate": 6e-05,
115
+ "loss": 0.4601,
116
+ "step": 24
117
+ },
118
+ {
119
+ "epoch": 2.9411764705882355,
120
+ "eval_loss": 0.47325241565704346,
121
+ "eval_runtime": 39.0692,
122
+ "eval_samples_per_second": 0.921,
123
+ "eval_steps_per_second": 0.921,
124
+ "step": 25
125
+ },
126
+ {
127
+ "epoch": 3.0588235294117645,
128
+ "grad_norm": 0.7457287907600403,
129
+ "learning_rate": 6.500000000000001e-05,
130
+ "loss": 0.3543,
131
+ "step": 26
132
+ },
133
+ {
134
+ "epoch": 3.2941176470588234,
135
+ "grad_norm": 0.8342892527580261,
136
+ "learning_rate": 7e-05,
137
+ "loss": 0.4855,
138
+ "step": 28
139
+ },
140
+ {
141
+ "epoch": 3.5294117647058822,
142
+ "grad_norm": 0.42753827571868896,
143
+ "learning_rate": 7.500000000000001e-05,
144
+ "loss": 0.3148,
145
+ "step": 30
146
+ },
147
+ {
148
+ "epoch": 3.764705882352941,
149
+ "grad_norm": 3.2698042392730713,
150
+ "learning_rate": 8e-05,
151
+ "loss": 0.38,
152
+ "step": 32
153
+ },
154
+ {
155
+ "epoch": 4.0,
156
+ "grad_norm": 1.6027395725250244,
157
+ "learning_rate": 8.5e-05,
158
+ "loss": 0.244,
159
+ "step": 34
160
+ },
161
+ {
162
+ "epoch": 4.0,
163
+ "eval_loss": 0.4196014404296875,
164
+ "eval_runtime": 39.0757,
165
+ "eval_samples_per_second": 0.921,
166
+ "eval_steps_per_second": 0.921,
167
+ "step": 34
168
+ },
169
+ {
170
+ "epoch": 4.235294117647059,
171
+ "grad_norm": 0.6179048418998718,
172
+ "learning_rate": 9e-05,
173
+ "loss": 0.3033,
174
+ "step": 36
175
+ },
176
+ {
177
+ "epoch": 4.470588235294118,
178
+ "grad_norm": 3.261169195175171,
179
+ "learning_rate": 9.5e-05,
180
+ "loss": 0.3497,
181
+ "step": 38
182
+ },
183
+ {
184
+ "epoch": 4.705882352941177,
185
+ "grad_norm": 0.5675766468048096,
186
+ "learning_rate": 0.0001,
187
+ "loss": 0.2755,
188
+ "step": 40
189
+ },
190
+ {
191
+ "epoch": 4.9411764705882355,
192
+ "grad_norm": 0.48287370800971985,
193
+ "learning_rate": 9.999238475781957e-05,
194
+ "loss": 0.2392,
195
+ "step": 42
196
+ },
197
+ {
198
+ "epoch": 4.9411764705882355,
199
+ "eval_loss": 0.40765851736068726,
200
+ "eval_runtime": 39.0794,
201
+ "eval_samples_per_second": 0.921,
202
+ "eval_steps_per_second": 0.921,
203
+ "step": 42
204
+ },
205
+ {
206
+ "epoch": 5.176470588235294,
207
+ "grad_norm": 0.5523759722709656,
208
+ "learning_rate": 9.99695413509548e-05,
209
+ "loss": 0.2591,
210
+ "step": 44
211
+ },
212
+ {
213
+ "epoch": 5.411764705882353,
214
+ "grad_norm": 0.31405553221702576,
215
+ "learning_rate": 9.99314767377287e-05,
216
+ "loss": 0.1407,
217
+ "step": 46
218
+ },
219
+ {
220
+ "epoch": 5.647058823529412,
221
+ "grad_norm": 0.8077965974807739,
222
+ "learning_rate": 9.987820251299122e-05,
223
+ "loss": 0.1793,
224
+ "step": 48
225
+ },
226
+ {
227
+ "epoch": 5.882352941176471,
228
+ "grad_norm": 0.6415297389030457,
229
+ "learning_rate": 9.980973490458728e-05,
230
+ "loss": 0.2333,
231
+ "step": 50
232
+ },
233
+ {
234
+ "epoch": 6.0,
235
+ "eval_loss": 0.4224318265914917,
236
+ "eval_runtime": 39.0789,
237
+ "eval_samples_per_second": 0.921,
238
+ "eval_steps_per_second": 0.921,
239
+ "step": 51
240
+ },
241
+ {
242
+ "epoch": 6.117647058823529,
243
+ "grad_norm": 0.4493468701839447,
244
+ "learning_rate": 9.972609476841367e-05,
245
+ "loss": 0.1872,
246
+ "step": 52
247
+ },
248
+ {
249
+ "epoch": 6.352941176470588,
250
+ "grad_norm": 0.593795895576477,
251
+ "learning_rate": 9.962730758206611e-05,
252
+ "loss": 0.1529,
253
+ "step": 54
254
+ },
255
+ {
256
+ "epoch": 6.588235294117647,
257
+ "grad_norm": 0.7886911630630493,
258
+ "learning_rate": 9.951340343707852e-05,
259
+ "loss": 0.0964,
260
+ "step": 56
261
+ },
262
+ {
263
+ "epoch": 6.823529411764706,
264
+ "grad_norm": 1.127954363822937,
265
+ "learning_rate": 9.938441702975689e-05,
266
+ "loss": 0.1101,
267
+ "step": 58
268
+ },
269
+ {
270
+ "epoch": 6.9411764705882355,
271
+ "eval_loss": 0.4902816414833069,
272
+ "eval_runtime": 39.0736,
273
+ "eval_samples_per_second": 0.921,
274
+ "eval_steps_per_second": 0.921,
275
+ "step": 59
276
+ },
277
+ {
278
+ "epoch": 7.0588235294117645,
279
+ "grad_norm": 0.7894813418388367,
280
+ "learning_rate": 9.924038765061042e-05,
281
+ "loss": 0.1401,
282
+ "step": 60
283
+ },
284
+ {
285
+ "epoch": 7.294117647058823,
286
+ "grad_norm": 0.5589519739151001,
287
+ "learning_rate": 9.908135917238321e-05,
288
+ "loss": 0.0716,
289
+ "step": 62
290
+ },
291
+ {
292
+ "epoch": 7.529411764705882,
293
+ "grad_norm": 1.3564684391021729,
294
+ "learning_rate": 9.890738003669029e-05,
295
+ "loss": 0.0646,
296
+ "step": 64
297
+ },
298
+ {
299
+ "epoch": 7.764705882352941,
300
+ "grad_norm": 0.9714311361312866,
301
+ "learning_rate": 9.871850323926177e-05,
302
+ "loss": 0.0327,
303
+ "step": 66
304
+ },
305
+ {
306
+ "epoch": 8.0,
307
+ "grad_norm": 1.2530443668365479,
308
+ "learning_rate": 9.851478631379982e-05,
309
+ "loss": 0.0532,
310
+ "step": 68
311
+ },
312
+ {
313
+ "epoch": 8.0,
314
+ "eval_loss": 0.5853617191314697,
315
+ "eval_runtime": 39.0872,
316
+ "eval_samples_per_second": 0.921,
317
+ "eval_steps_per_second": 0.921,
318
+ "step": 68
319
+ },
320
+ {
321
+ "epoch": 8.235294117647058,
322
+ "grad_norm": 0.4537618160247803,
323
+ "learning_rate": 9.829629131445342e-05,
324
+ "loss": 0.0194,
325
+ "step": 70
326
+ },
327
+ {
328
+ "epoch": 8.470588235294118,
329
+ "grad_norm": 1.3883719444274902,
330
+ "learning_rate": 9.806308479691595e-05,
331
+ "loss": 0.0309,
332
+ "step": 72
333
+ },
334
+ {
335
+ "epoch": 8.705882352941176,
336
+ "grad_norm": 0.31875643134117126,
337
+ "learning_rate": 9.781523779815179e-05,
338
+ "loss": 0.0204,
339
+ "step": 74
340
+ },
341
+ {
342
+ "epoch": 8.941176470588236,
343
+ "grad_norm": 1.1900216341018677,
344
+ "learning_rate": 9.755282581475769e-05,
345
+ "loss": 0.0266,
346
+ "step": 76
347
+ },
348
+ {
349
+ "epoch": 8.941176470588236,
350
+ "eval_loss": 0.664294958114624,
351
+ "eval_runtime": 39.0752,
352
+ "eval_samples_per_second": 0.921,
353
+ "eval_steps_per_second": 0.921,
354
+ "step": 76
355
+ },
356
+ {
357
+ "epoch": 9.176470588235293,
358
+ "grad_norm": 0.5460513234138489,
359
+ "learning_rate": 9.727592877996585e-05,
360
+ "loss": 0.0099,
361
+ "step": 78
362
+ },
363
+ {
364
+ "epoch": 9.411764705882353,
365
+ "grad_norm": 0.4250204563140869,
366
+ "learning_rate": 9.698463103929542e-05,
367
+ "loss": 0.011,
368
+ "step": 80
369
+ },
370
+ {
371
+ "epoch": 9.647058823529411,
372
+ "grad_norm": 0.5882348418235779,
373
+ "learning_rate": 9.667902132486009e-05,
374
+ "loss": 0.0084,
375
+ "step": 82
376
+ },
377
+ {
378
+ "epoch": 9.882352941176471,
379
+ "grad_norm": 0.15863734483718872,
380
+ "learning_rate": 9.635919272833938e-05,
381
+ "loss": 0.009,
382
+ "step": 84
383
+ },
384
+ {
385
+ "epoch": 10.0,
386
+ "eval_loss": 0.7163164019584656,
387
+ "eval_runtime": 39.0742,
388
+ "eval_samples_per_second": 0.921,
389
+ "eval_steps_per_second": 0.921,
390
+ "step": 85
391
+ },
392
+ {
393
+ "epoch": 10.117647058823529,
394
+ "grad_norm": 0.20348787307739258,
395
+ "learning_rate": 9.602524267262203e-05,
396
+ "loss": 0.007,
397
+ "step": 86
398
+ },
399
+ {
400
+ "epoch": 10.352941176470589,
401
+ "grad_norm": 0.13509777188301086,
402
+ "learning_rate": 9.567727288213005e-05,
403
+ "loss": 0.0025,
404
+ "step": 88
405
+ },
406
+ {
407
+ "epoch": 10.588235294117647,
408
+ "grad_norm": 0.6861823797225952,
409
+ "learning_rate": 9.53153893518325e-05,
410
+ "loss": 0.008,
411
+ "step": 90
412
+ },
413
+ {
414
+ "epoch": 10.823529411764707,
415
+ "grad_norm": 0.32561418414115906,
416
+ "learning_rate": 9.493970231495835e-05,
417
+ "loss": 0.0074,
418
+ "step": 92
419
+ },
420
+ {
421
+ "epoch": 10.941176470588236,
422
+ "eval_loss": 0.7387914657592773,
423
+ "eval_runtime": 39.0731,
424
+ "eval_samples_per_second": 0.921,
425
+ "eval_steps_per_second": 0.921,
426
+ "step": 93
427
+ },
428
+ {
429
+ "epoch": 11.058823529411764,
430
+ "grad_norm": 0.1485217809677124,
431
+ "learning_rate": 9.45503262094184e-05,
432
+ "loss": 0.0028,
433
+ "step": 94
434
+ },
435
+ {
436
+ "epoch": 11.294117647058824,
437
+ "grad_norm": 0.41832828521728516,
438
+ "learning_rate": 9.414737964294636e-05,
439
+ "loss": 0.0047,
440
+ "step": 96
441
+ },
442
+ {
443
+ "epoch": 11.529411764705882,
444
+ "grad_norm": 0.09504914283752441,
445
+ "learning_rate": 9.373098535696979e-05,
446
+ "loss": 0.0014,
447
+ "step": 98
448
+ },
449
+ {
450
+ "epoch": 11.764705882352942,
451
+ "grad_norm": 0.6861616969108582,
452
+ "learning_rate": 9.330127018922194e-05,
453
+ "loss": 0.0072,
454
+ "step": 100
455
+ },
456
+ {
457
+ "epoch": 12.0,
458
+ "grad_norm": 0.15043994784355164,
459
+ "learning_rate": 9.285836503510562e-05,
460
+ "loss": 0.0055,
461
+ "step": 102
462
+ },
463
+ {
464
+ "epoch": 12.0,
465
+ "eval_loss": 0.7272784113883972,
466
+ "eval_runtime": 39.0768,
467
+ "eval_samples_per_second": 0.921,
468
+ "eval_steps_per_second": 0.921,
469
+ "step": 102
470
+ },
471
+ {
472
+ "epoch": 12.0,
473
+ "step": 102,
474
+ "total_flos": 1.5906559946339123e+17,
475
+ "train_loss": 0.5047409891552639,
476
+ "train_runtime": 5898.6129,
477
+ "train_samples_per_second": 1.153,
478
+ "train_steps_per_second": 0.068
479
+ }
480
+ ],
481
+ "logging_steps": 2,
482
+ "max_steps": 400,
483
+ "num_input_tokens_seen": 0,
484
+ "num_train_epochs": 50,
485
+ "save_steps": 25,
486
+ "stateful_callbacks": {
487
+ "EarlyStoppingCallback": {
488
+ "args": {
489
+ "early_stopping_patience": 7,
490
+ "early_stopping_threshold": 0.0
491
+ },
492
+ "attributes": {
493
+ "early_stopping_patience_counter": 0
494
+ }
495
+ },
496
+ "TrainerControl": {
497
+ "args": {
498
+ "should_epoch_stop": false,
499
+ "should_evaluate": false,
500
+ "should_log": false,
501
+ "should_save": true,
502
+ "should_training_stop": true
503
+ },
504
+ "attributes": {}
505
+ }
506
+ },
507
+ "total_flos": 1.5906559946339123e+17,
508
+ "train_batch_size": 1,
509
+ "trial_name": null,
510
+ "trial_params": null
511
+ }