|
Step 0 | Loss: 11.070963 | Norm: 48.8176 | LR: 8.39e-07 | Time: 00:00:02 | Remaining: 00:01:39 | Avg Time/Step: 2.03 |
|
Generated Text at Step 0: The king saidSeptemberSeptember 354 Fill ShameLots may>>>>>>>>umpyurry Apex nurses NEWS159 Vanguard FlemingictionTAJul Jihad LAR $\ underjri Columb |
|
Validating... |
|
Validation Loss: 10.916313171386719 |
|
Step 1 | Loss: 11.171237 | Norm: 45.8637 | LR: 1.68e-06 | Time: 00:00:04 | Remaining: 00:01:41 | Avg Time/Step: 2.12 |
|
Step 2 | Loss: 11.089214 | Norm: 49.5361 | LR: 2.52e-06 | Time: 00:00:04 | Remaining: 00:01:10 | Avg Time/Step: 1.50 |
|
Validating... |
|
Validation Loss: 10.893363952636719 |
|
Step 3 | Loss: 10.763819 | Norm: 52.8166 | LR: 3.36e-06 | Time: 00:00:05 | Remaining: 00:01:05 | Avg Time/Step: 1.41 |
|
Step 4 | Loss: 11.204582 | Norm: 47.4927 | LR: 4.20e-06 | Time: 00:00:06 | Remaining: 00:00:54 | Avg Time/Step: 1.21 |
|
Validating... |
|
Validation Loss: 10.86690902709961 |
|
Step 5 | Loss: 10.957478 | Norm: 41.5032 | LR: 5.03e-06 | Time: 00:00:07 | Remaining: 00:00:58 | Avg Time/Step: 1.32 |
|
Step 6 | Loss: 10.586459 | Norm: 43.5531 | LR: 5.87e-06 | Time: 00:00:08 | Remaining: 00:00:50 | Avg Time/Step: 1.18 |
|
Validating... |
|
Validation Loss: 10.835768699645996 |
|
Step 7 | Loss: 11.205253 | Norm: 44.9156 | LR: 6.71e-06 | Time: 00:00:09 | Remaining: 00:00:50 | Avg Time/Step: 1.20 |
|
Step 8 | Loss: 10.609798 | Norm: 48.2627 | LR: 7.55e-06 | Time: 00:00:09 | Remaining: 00:00:44 | Avg Time/Step: 1.10 |
|
Validating... |
|
Validation Loss: 10.792684555053711 |
|
Step 9 | Loss: 9.896498 | Norm: 43.1797 | LR: 8.39e-06 | Time: 00:00:11 | Remaining: 00:00:44 | Avg Time/Step: 1.12 |
|
Step 10 | Loss: 11.131380 | Norm: 44.4814 | LR: 9.23e-06 | Time: 00:00:11 | Remaining: 00:00:40 | Avg Time/Step: 1.04 |
|
Validating... |
|
Validation Loss: 10.749573707580566 |
|
Step 11 | Loss: 10.463729 | Norm: 47.8602 | LR: 1.01e-05 | Time: 00:00:12 | Remaining: 00:00:40 | Avg Time/Step: 1.06 |
|
Step 12 | Loss: 10.880756 | Norm: 43.9313 | LR: 1.09e-05 | Time: 00:00:12 | Remaining: 00:00:36 | Avg Time/Step: 1.00 |
|
Validating... |
|
Validation Loss: 10.712495803833008 |
|
Step 13 | Loss: 9.864075 | Norm: 42.5331 | LR: 1.17e-05 | Time: 00:00:14 | Remaining: 00:00:36 | Avg Time/Step: 1.01 |
|
Step 14 | Loss: 10.922160 | Norm: 44.6511 | LR: 1.26e-05 | Time: 00:00:14 | Remaining: 00:00:33 | Avg Time/Step: 0.96 |
|
Validating... |
|
Validation Loss: 10.67584228515625 |
|
Step 15 | Loss: 10.775851 | Norm: 44.4024 | LR: 1.34e-05 | Time: 00:00:15 | Remaining: 00:00:33 | Avg Time/Step: 0.98 |
|
Step 16 | Loss: 10.330193 | Norm: 43.8886 | LR: 1.43e-05 | Time: 00:00:15 | Remaining: 00:00:30 | Avg Time/Step: 0.94 |
|
Validating... |
|
Validation Loss: 10.615331649780273 |
|
Step 17 | Loss: 10.270191 | Norm: 44.5217 | LR: 1.51e-05 | Time: 00:00:17 | Remaining: 00:00:30 | Avg Time/Step: 0.97 |
|
Step 18 | Loss: 10.027596 | Norm: 46.1209 | LR: 1.59e-05 | Time: 00:00:17 | Remaining: 00:00:28 | Avg Time/Step: 0.93 |
|
Validating... |
|
Validation Loss: 10.553497314453125 |
|
Step 19 | Loss: 10.182181 | Norm: 40.7514 | LR: 1.68e-05 | Time: 00:00:19 | Remaining: 00:00:28 | Avg Time/Step: 0.96 |
|
Step 20 | Loss: 9.555431 | Norm: 34.3714 | LR: 1.76e-05 | Time: 00:00:19 | Remaining: 00:00:26 | Avg Time/Step: 0.93 |
|
Validating... |
|
Validation Loss: 10.458913803100586 |
|
Step 21 | Loss: 10.136066 | Norm: 35.4013 | LR: 1.85e-05 | Time: 00:00:20 | Remaining: 00:00:26 | Avg Time/Step: 0.95 |
|
Step 22 | Loss: 10.260824 | Norm: 35.9827 | LR: 1.93e-05 | Time: 00:00:21 | Remaining: 00:00:25 | Avg Time/Step: 0.93 |
|
Validating... |
|
Validation Loss: 10.345619201660156 |
|
Step 23 | Loss: 9.837000 | Norm: 34.4205 | LR: 2.01e-05 | Time: 00:00:22 | Remaining: 00:00:24 | Avg Time/Step: 0.94 |
|
Step 24 | Loss: 10.418470 | Norm: 35.1306 | LR: 2.10e-05 | Time: 00:00:22 | Remaining: 00:00:22 | Avg Time/Step: 0.92 |
|
Validating... |
|
Validation Loss: 10.242090225219727 |
|
Step 25 | Loss: 10.759716 | Norm: 34.3984 | LR: 2.18e-05 | Time: 00:00:24 | Remaining: 00:00:22 | Avg Time/Step: 0.93 |
|
Step 26 | Loss: 10.433059 | Norm: 33.6258 | LR: 2.27e-05 | Time: 00:00:24 | Remaining: 00:00:20 | Avg Time/Step: 0.91 |
|
Validating... |
|
Validation Loss: 10.15864372253418 |
|
Step 27 | Loss: 11.198073 | Norm: 33.6489 | LR: 2.35e-05 | Time: 00:00:25 | Remaining: 00:00:20 | Avg Time/Step: 0.93 |
|
Step 28 | Loss: 9.453720 | Norm: 30.4983 | LR: 2.43e-05 | Time: 00:00:26 | Remaining: 00:00:18 | Avg Time/Step: 0.90 |
|
Validating... |
|
Validation Loss: 10.089692115783691 |
|
Step 29 | Loss: 10.043849 | Norm: 30.8429 | LR: 2.52e-05 | Time: 00:00:27 | Remaining: 00:00:18 | Avg Time/Step: 0.92 |
|
Step 30 | Loss: 10.345837 | Norm: 28.3254 | LR: 2.60e-05 | Time: 00:00:27 | Remaining: 00:00:17 | Avg Time/Step: 0.90 |
|
Validating... |
|
Validation Loss: 10.014737129211426 |
|
Step 31 | Loss: 9.762772 | Norm: 28.7018 | LR: 2.69e-05 | Time: 00:00:29 | Remaining: 00:00:16 | Avg Time/Step: 0.92 |
|
Step 32 | Loss: 9.099653 | Norm: 28.1757 | LR: 2.77e-05 | Time: 00:00:30 | Remaining: 00:00:15 | Avg Time/Step: 0.91 |
|
Validating... |
|
Validation Loss: 9.956048011779785 |
|
Step 33 | Loss: 8.908812 | Norm: 25.8786 | LR: 2.85e-05 | Time: 00:00:31 | Remaining: 00:00:14 | Avg Time/Step: 0.92 |
|
Step 34 | Loss: 10.699462 | Norm: 25.3921 | LR: 2.94e-05 | Time: 00:00:31 | Remaining: 00:00:13 | Avg Time/Step: 0.90 |
|
Validating... |
|
Validation Loss: 9.902624130249023 |
|
Step 35 | Loss: 9.239347 | Norm: 25.3455 | LR: 3.02e-05 | Time: 00:00:33 | Remaining: 00:00:12 | Avg Time/Step: 0.92 |
|
Step 36 | Loss: 10.142147 | Norm: 24.3786 | LR: 3.10e-05 | Time: 00:00:33 | Remaining: 00:00:11 | Avg Time/Step: 0.90 |
|
Validating... |
|
Validation Loss: 9.841948509216309 |
|
Step 37 | Loss: 10.260188 | Norm: 23.3623 | LR: 3.19e-05 | Time: 00:00:34 | Remaining: 00:00:10 | Avg Time/Step: 0.91 |
|
Step 38 | Loss: 9.482347 | Norm: 24.0785 | LR: 3.27e-05 | Time: 00:00:35 | Remaining: 00:00:09 | Avg Time/Step: 0.90 |
|
Validating... |
|
Validation Loss: 9.79233169555664 |
|
Step 39 | Loss: 8.717162 | Norm: 23.1963 | LR: 3.36e-05 | Time: 00:00:36 | Remaining: 00:00:09 | Avg Time/Step: 0.91 |
|
Step 40 | Loss: 9.536521 | Norm: 21.8829 | LR: 3.44e-05 | Time: 00:00:36 | Remaining: 00:00:08 | Avg Time/Step: 0.89 |
|
Validating... |
|
Validation Loss: 9.746158599853516 |
|
Step 41 | Loss: 9.760999 | Norm: 21.4380 | LR: 3.52e-05 | Time: 00:00:38 | Remaining: 00:00:07 | Avg Time/Step: 0.91 |
|
Step 42 | Loss: 9.588884 | Norm: 22.2327 | LR: 3.61e-05 | Time: 00:00:38 | Remaining: 00:00:06 | Avg Time/Step: 0.89 |
|
Validating... |
|
Validation Loss: 9.688400268554688 |
|
Step 43 | Loss: 8.350541 | Norm: 20.6459 | LR: 3.69e-05 | Time: 00:00:39 | Remaining: 00:00:05 | Avg Time/Step: 0.90 |
|
Step 44 | Loss: 9.594240 | Norm: 20.0493 | LR: 3.78e-05 | Time: 00:00:39 | Remaining: 00:00:04 | Avg Time/Step: 0.89 |
|
Validating... |
|
Validation Loss: 9.622390747070312 |
|
Step 45 | Loss: 8.240631 | Norm: 20.1186 | LR: 3.86e-05 | Time: 00:00:41 | Remaining: 00:00:03 | Avg Time/Step: 0.90 |
|
Step 46 | Loss: 8.915052 | Norm: 20.4390 | LR: 3.94e-05 | Time: 00:00:41 | Remaining: 00:00:02 | Avg Time/Step: 0.88 |
|
Validating... |
|
Validation Loss: 9.558349609375 |
|
Step 47 | Loss: 8.285755 | Norm: 20.3787 | LR: 4.03e-05 | Time: 00:00:43 | Remaining: 00:00:01 | Avg Time/Step: 0.90 |
|
Step 48 | Loss: 8.551549 | Norm: 20.1920 | LR: 4.11e-05 | Time: 00:00:43 | Remaining: 00:00:00 | Avg Time/Step: 0.89 |
|
Validating... |
|
Validation Loss: 9.461584091186523 |
|
Step 49 | Loss: 9.774352 | Norm: 20.2260 | LR: 4.20e-05 | Time: 00:00:45 | Remaining: 00:00:00 | Avg Time/Step: 0.91 |
|
Step 0 | Loss: 11.070963 | Norm: 48.8176 | LR: 8.39e-07 | Time: 00:00:00 | Remaining: 00:00:46 | Avg Time/Step: 0.95 |
|
Generated Text at Step 0: The king saidSeptemberSeptember 354 Fill ShameLots may>>>>>>>>umpyurry Apex nurses NEWS159 Vanguard FlemingictionTAJul Jihad LAR $\ underjri Columb |
|
Validating... |
|
Validation Loss: 10.916313171386719 |
|
Step 1 | Loss: 11.171237 | Norm: 45.8637 | LR: 1.68e-06 | Time: 00:00:03 | Remaining: 00:01:12 | Avg Time/Step: 1.52 |
|
Step 2 | Loss: 11.089214 | Norm: 49.5361 | LR: 2.52e-06 | Time: 00:00:03 | Remaining: 00:00:51 | Avg Time/Step: 1.09 |
|
Validating... |
|
Validation Loss: 10.893363952636719 |
|
Step 3 | Loss: 10.763819 | Norm: 52.8166 | LR: 3.36e-06 | Time: 00:00:04 | Remaining: 00:00:49 | Avg Time/Step: 1.08 |
|
Step 4 | Loss: 11.204582 | Norm: 47.4927 | LR: 4.20e-06 | Time: 00:00:04 | Remaining: 00:00:41 | Avg Time/Step: 0.91 |
|
Validating... |
|
Validation Loss: 10.86690902709961 |
|
Step 5 | Loss: 10.957478 | Norm: 41.5032 | LR: 5.03e-06 | Time: 00:00:05 | Remaining: 00:00:40 | Avg Time/Step: 0.93 |
|
Step 6 | Loss: 10.586459 | Norm: 43.5531 | LR: 5.87e-06 | Time: 00:00:05 | Remaining: 00:00:35 | Avg Time/Step: 0.83 |
|
Validating... |
|
Validation Loss: 10.835768699645996 |
|
Step 7 | Loss: 11.205253 | Norm: 44.9156 | LR: 6.71e-06 | Time: 00:00:07 | Remaining: 00:00:37 | Avg Time/Step: 0.89 |
|
Step 8 | Loss: 10.609798 | Norm: 48.2627 | LR: 7.55e-06 | Time: 00:00:07 | Remaining: 00:00:33 | Avg Time/Step: 0.82 |
|
Validating... |
|
Validation Loss: 10.792684555053711 |
|
Step 9 | Loss: 9.896498 | Norm: 43.1797 | LR: 8.39e-06 | Time: 00:00:08 | Remaining: 00:00:35 | Avg Time/Step: 0.88 |
|
Step 10 | Loss: 11.131380 | Norm: 44.4814 | LR: 9.23e-06 | Time: 00:00:09 | Remaining: 00:00:31 | Avg Time/Step: 0.82 |
|
Validating... |
|
Validation Loss: 10.749573707580566 |
|
Step 11 | Loss: 10.463729 | Norm: 47.8602 | LR: 1.01e-05 | Time: 00:00:10 | Remaining: 00:00:32 | Avg Time/Step: 0.86 |
|
Step 12 | Loss: 10.880756 | Norm: 43.9313 | LR: 1.09e-05 | Time: 00:00:10 | Remaining: 00:00:30 | Avg Time/Step: 0.81 |
|
Validating... |
|
Validation Loss: 10.712495803833008 |
|
Step 13 | Loss: 9.864075 | Norm: 42.5331 | LR: 1.17e-05 | Time: 00:00:12 | Remaining: 00:00:30 | Avg Time/Step: 0.86 |
|
Step 14 | Loss: 10.922160 | Norm: 44.6511 | LR: 1.26e-05 | Time: 00:00:12 | Remaining: 00:00:28 | Avg Time/Step: 0.82 |
|
Validating... |
|
Validation Loss: 10.67584228515625 |
|
Step 15 | Loss: 10.775851 | Norm: 44.4024 | LR: 1.34e-05 | Time: 00:00:13 | Remaining: 00:00:28 | Avg Time/Step: 0.85 |
|
Step 16 | Loss: 10.330193 | Norm: 43.8886 | LR: 1.43e-05 | Time: 00:00:13 | Remaining: 00:00:26 | Avg Time/Step: 0.81 |
|
Validating... |
|
Validation Loss: 10.615331649780273 |
|
Step 17 | Loss: 10.270191 | Norm: 44.5217 | LR: 1.51e-05 | Time: 00:00:15 | Remaining: 00:00:26 | Avg Time/Step: 0.84 |
|
Step 18 | Loss: 10.027596 | Norm: 46.1209 | LR: 1.59e-05 | Time: 00:00:15 | Remaining: 00:00:25 | Avg Time/Step: 0.81 |
|
Validating... |
|
Validation Loss: 10.553497314453125 |
|
Step 19 | Loss: 10.182181 | Norm: 40.7514 | LR: 1.68e-05 | Time: 00:00:16 | Remaining: 00:00:25 | Avg Time/Step: 0.84 |
|
Step 20 | Loss: 9.555431 | Norm: 34.3714 | LR: 1.76e-05 | Time: 00:00:16 | Remaining: 00:00:23 | Avg Time/Step: 0.81 |
|
Validating... |
|
Validation Loss: 10.458913803100586 |
|
Step 21 | Loss: 10.136066 | Norm: 35.4013 | LR: 1.85e-05 | Time: 00:00:18 | Remaining: 00:00:23 | Avg Time/Step: 0.83 |
|
Step 22 | Loss: 10.260824 | Norm: 35.9827 | LR: 1.93e-05 | Time: 00:00:18 | Remaining: 00:00:21 | Avg Time/Step: 0.80 |
|
Validating... |
|
Validation Loss: 10.345619201660156 |
|
Step 23 | Loss: 9.837000 | Norm: 34.4205 | LR: 2.01e-05 | Time: 00:00:19 | Remaining: 00:00:21 | Avg Time/Step: 0.82 |
|
Step 24 | Loss: 10.418470 | Norm: 35.1306 | LR: 2.10e-05 | Time: 00:00:20 | Remaining: 00:00:20 | Avg Time/Step: 0.80 |
|
Validating... |
|
Validation Loss: 10.242090225219727 |
|
Step 25 | Loss: 10.759716 | Norm: 34.3984 | LR: 2.18e-05 | Time: 00:00:21 | Remaining: 00:00:19 | Avg Time/Step: 0.82 |
|
Step 26 | Loss: 10.433059 | Norm: 33.6258 | LR: 2.27e-05 | Time: 00:00:21 | Remaining: 00:00:18 | Avg Time/Step: 0.80 |
|
Validating... |
|
Validation Loss: 10.15864372253418 |
|
Step 27 | Loss: 11.198073 | Norm: 33.6489 | LR: 2.35e-05 | Time: 00:00:22 | Remaining: 00:00:17 | Avg Time/Step: 0.81 |
|
Step 28 | Loss: 9.453720 | Norm: 30.4983 | LR: 2.43e-05 | Time: 00:00:23 | Remaining: 00:00:16 | Avg Time/Step: 0.79 |
|
Validating... |
|
Validation Loss: 10.089692115783691 |
|
Step 29 | Loss: 10.043849 | Norm: 30.8429 | LR: 2.52e-05 | Time: 00:00:24 | Remaining: 00:00:16 | Avg Time/Step: 0.81 |
|
Step 30 | Loss: 10.345837 | Norm: 28.3254 | LR: 2.60e-05 | Time: 00:00:24 | Remaining: 00:00:15 | Avg Time/Step: 0.79 |
|
Validating... |
|
Validation Loss: 10.014737129211426 |
|
Step 31 | Loss: 9.762772 | Norm: 28.7018 | LR: 2.69e-05 | Time: 00:00:25 | Remaining: 00:00:14 | Avg Time/Step: 0.81 |
|
Step 32 | Loss: 9.099653 | Norm: 28.1757 | LR: 2.77e-05 | Time: 00:00:26 | Remaining: 00:00:13 | Avg Time/Step: 0.79 |
|
Validating... |
|
Validation Loss: 9.956048011779785 |
|
Step 33 | Loss: 8.908812 | Norm: 25.8786 | LR: 2.85e-05 | Time: 00:00:27 | Remaining: 00:00:12 | Avg Time/Step: 0.81 |
|
Step 34 | Loss: 10.699462 | Norm: 25.3921 | LR: 2.94e-05 | Time: 00:00:27 | Remaining: 00:00:11 | Avg Time/Step: 0.79 |
|
Validating... |
|
Validation Loss: 9.902624130249023 |
|
Step 35 | Loss: 9.239347 | Norm: 25.3455 | LR: 3.02e-05 | Time: 00:00:28 | Remaining: 00:00:11 | Avg Time/Step: 0.80 |
|
Step 36 | Loss: 10.142147 | Norm: 24.3786 | LR: 3.10e-05 | Time: 00:00:29 | Remaining: 00:00:10 | Avg Time/Step: 0.79 |
|
Validating... |
|
Validation Loss: 9.841948509216309 |
|
Step 37 | Loss: 10.260188 | Norm: 23.3623 | LR: 3.19e-05 | Time: 00:00:30 | Remaining: 00:00:09 | Avg Time/Step: 0.80 |
|
Step 38 | Loss: 9.482347 | Norm: 24.0785 | LR: 3.27e-05 | Time: 00:00:30 | Remaining: 00:00:08 | Avg Time/Step: 0.79 |
|
Validating... |
|
Validation Loss: 9.79233169555664 |
|
Step 39 | Loss: 8.717162 | Norm: 23.1963 | LR: 3.36e-05 | Time: 00:00:32 | Remaining: 00:00:08 | Avg Time/Step: 0.81 |
|
Step 40 | Loss: 9.536521 | Norm: 21.8829 | LR: 3.44e-05 | Time: 00:00:32 | Remaining: 00:00:07 | Avg Time/Step: 0.79 |
|
Validating... |
|
Validation Loss: 9.746158599853516 |
|
Step 41 | Loss: 9.760999 | Norm: 21.4380 | LR: 3.52e-05 | Time: 00:00:33 | Remaining: 00:00:06 | Avg Time/Step: 0.81 |
|
Step 42 | Loss: 9.588884 | Norm: 22.2327 | LR: 3.61e-05 | Time: 00:00:34 | Remaining: 00:00:05 | Avg Time/Step: 0.79 |
|
Validating... |
|
Validation Loss: 9.688400268554688 |
|
Step 43 | Loss: 8.350541 | Norm: 20.6459 | LR: 3.69e-05 | Time: 00:00:35 | Remaining: 00:00:04 | Avg Time/Step: 0.81 |
|
Step 44 | Loss: 9.594240 | Norm: 20.0493 | LR: 3.78e-05 | Time: 00:00:36 | Remaining: 00:00:04 | Avg Time/Step: 0.80 |
|
Validating... |
|
Validation Loss: 9.622390747070312 |
|
Step 45 | Loss: 8.240631 | Norm: 20.1186 | LR: 3.86e-05 | Time: 00:00:37 | Remaining: 00:00:03 | Avg Time/Step: 0.81 |
|
Step 46 | Loss: 8.915052 | Norm: 20.4390 | LR: 3.94e-05 | Time: 00:00:37 | Remaining: 00:00:02 | Avg Time/Step: 0.80 |
|
Validating... |
|
Validation Loss: 9.558349609375 |
|
Step 47 | Loss: 8.285755 | Norm: 20.3787 | LR: 4.03e-05 | Time: 00:00:39 | Remaining: 00:00:01 | Avg Time/Step: 0.81 |
|
Step 48 | Loss: 8.551549 | Norm: 20.1920 | LR: 4.11e-05 | Time: 00:00:39 | Remaining: 00:00:00 | Avg Time/Step: 0.80 |
|
Validating... |
|
Validation Loss: 9.461584091186523 |
|
Step 49 | Loss: 9.774352 | Norm: 20.2260 | LR: 4.20e-05 | Time: 00:00:40 | Remaining: 00:00:00 | Avg Time/Step: 0.81 |
|
Step 0 | Loss: 11.070963 | Norm: 48.8176 | LR: 8.39e-07 | Time: 00:00:00 | Remaining: 00:00:44 | Avg Time/Step: 0.91 |
|
Generated Text at Step 0: The king saidSeptemberSeptember 354 Fill ShameLots may>>>>>>>>umpyurry Apex nurses NEWS159 Vanguard FlemingictionTAJul Jihad LAR $\ underjri Columb |
|
Validating... |
|
Validation Loss: 10.916313171386719 |
|
Step 1 | Loss: 11.171237 | Norm: 45.8637 | LR: 1.68e-06 | Time: 00:00:02 | Remaining: 00:01:11 | Avg Time/Step: 1.50 |
|
Step 2 | Loss: 11.089214 | Norm: 49.5361 | LR: 2.52e-06 | Time: 00:00:03 | Remaining: 00:00:50 | Avg Time/Step: 1.07 |
|
Validating... |
|
Validation Loss: 10.893363952636719 |
|
Step 3 | Loss: 10.763819 | Norm: 52.8166 | LR: 3.36e-06 | Time: 00:00:04 | Remaining: 00:00:49 | Avg Time/Step: 1.08 |
|
Step 4 | Loss: 11.204582 | Norm: 47.4927 | LR: 4.20e-06 | Time: 00:00:04 | Remaining: 00:00:40 | Avg Time/Step: 0.91 |
|
Validating... |
|
Validation Loss: 10.86690902709961 |
|
Step 5 | Loss: 10.957478 | Norm: 41.5032 | LR: 5.03e-06 | Time: 00:00:05 | Remaining: 00:00:40 | Avg Time/Step: 0.92 |
|
Step 6 | Loss: 10.586459 | Norm: 43.5531 | LR: 5.87e-06 | Time: 00:00:05 | Remaining: 00:00:35 | Avg Time/Step: 0.83 |
|
Validating... |
|
Validation Loss: 10.835768699645996 |
|
Step 7 | Loss: 11.205253 | Norm: 44.9156 | LR: 6.71e-06 | Time: 00:00:07 | Remaining: 00:00:36 | Avg Time/Step: 0.88 |
|
Step 8 | Loss: 10.609798 | Norm: 48.2627 | LR: 7.55e-06 | Time: 00:00:07 | Remaining: 00:00:33 | Avg Time/Step: 0.81 |
|
Validating... |
|
Validation Loss: 10.792684555053711 |
|
Step 9 | Loss: 9.896498 | Norm: 43.1797 | LR: 8.39e-06 | Time: 00:00:08 | Remaining: 00:00:34 | Avg Time/Step: 0.86 |
|
Step 10 | Loss: 11.131380 | Norm: 44.4814 | LR: 9.23e-06 | Time: 00:00:08 | Remaining: 00:00:31 | Avg Time/Step: 0.80 |
|
Validating... |
|
Validation Loss: 10.749573707580566 |
|
Step 11 | Loss: 10.463729 | Norm: 47.8602 | LR: 1.01e-05 | Time: 00:00:10 | Remaining: 00:00:32 | Avg Time/Step: 0.84 |
|
Step 12 | Loss: 10.880756 | Norm: 43.9313 | LR: 1.09e-05 | Time: 00:00:10 | Remaining: 00:00:29 | Avg Time/Step: 0.80 |
|
Validating... |
|
Validation Loss: 10.712495803833008 |
|
Step 13 | Loss: 9.864075 | Norm: 42.5331 | LR: 1.17e-05 | Time: 00:00:11 | Remaining: 00:00:30 | Avg Time/Step: 0.85 |
|
Step 14 | Loss: 10.922160 | Norm: 44.6511 | LR: 1.26e-05 | Time: 00:00:12 | Remaining: 00:00:28 | Avg Time/Step: 0.81 |
|
Validating... |
|
Validation Loss: 10.67584228515625 |
|
Step 15 | Loss: 10.775851 | Norm: 44.4024 | LR: 1.34e-05 | Time: 00:00:13 | Remaining: 00:00:28 | Avg Time/Step: 0.84 |
|
Step 16 | Loss: 10.330193 | Norm: 43.8886 | LR: 1.43e-05 | Time: 00:00:13 | Remaining: 00:00:26 | Avg Time/Step: 0.80 |
|
Validating... |
|
Validation Loss: 10.615331649780273 |
|
Step 17 | Loss: 10.270191 | Norm: 44.5217 | LR: 1.51e-05 | Time: 00:00:15 | Remaining: 00:00:27 | Avg Time/Step: 0.84 |
|
Step 18 | Loss: 10.027596 | Norm: 46.1209 | LR: 1.59e-05 | Time: 00:00:15 | Remaining: 00:00:25 | Avg Time/Step: 0.81 |
|
Validating... |
|
Validation Loss: 10.553497314453125 |
|
Step 19 | Loss: 10.182181 | Norm: 40.7514 | LR: 1.68e-05 | Time: 00:00:16 | Remaining: 00:00:25 | Avg Time/Step: 0.85 |
|
Step 20 | Loss: 9.555431 | Norm: 34.3714 | LR: 1.76e-05 | Time: 00:00:17 | Remaining: 00:00:23 | Avg Time/Step: 0.82 |
|
Validating... |
|
Validation Loss: 10.458913803100586 |
|
Step 21 | Loss: 10.136066 | Norm: 35.4013 | LR: 1.85e-05 | Time: 00:00:18 | Remaining: 00:00:23 | Avg Time/Step: 0.84 |
|
Step 22 | Loss: 10.260824 | Norm: 35.9827 | LR: 1.93e-05 | Time: 00:00:18 | Remaining: 00:00:21 | Avg Time/Step: 0.81 |
|
Validating... |
|
Validation Loss: 10.345619201660156 |
|
Step 23 | Loss: 9.837000 | Norm: 34.4205 | LR: 2.01e-05 | Time: 00:00:20 | Remaining: 00:00:22 | Avg Time/Step: 0.85 |
|
Step 24 | Loss: 10.418470 | Norm: 35.1306 | LR: 2.10e-05 | Time: 00:00:20 | Remaining: 00:00:20 | Avg Time/Step: 0.83 |
|
Validating... |
|
Validation Loss: 10.242090225219727 |
|
Step 25 | Loss: 10.759716 | Norm: 34.3984 | LR: 2.18e-05 | Time: 00:00:22 | Remaining: 00:00:20 | Avg Time/Step: 0.85 |
|
Step 26 | Loss: 10.433059 | Norm: 33.6258 | LR: 2.27e-05 | Time: 00:00:22 | Remaining: 00:00:19 | Avg Time/Step: 0.85 |
|
Validating... |
|
Validation Loss: 10.15864372253418 |
|
Step 27 | Loss: 11.198073 | Norm: 33.6489 | LR: 2.35e-05 | Time: 00:00:24 | Remaining: 00:00:18 | Avg Time/Step: 0.86 |
|
Step 28 | Loss: 9.453720 | Norm: 30.4983 | LR: 2.43e-05 | Time: 00:00:24 | Remaining: 00:00:17 | Avg Time/Step: 0.84 |
|
Validating... |
|
Validation Loss: 10.089692115783691 |
|
Step 29 | Loss: 10.043849 | Norm: 30.8429 | LR: 2.52e-05 | Time: 00:00:25 | Remaining: 00:00:17 | Avg Time/Step: 0.86 |
|
Step 30 | Loss: 10.345837 | Norm: 28.3254 | LR: 2.60e-05 | Time: 00:00:26 | Remaining: 00:00:15 | Avg Time/Step: 0.84 |
|
Validating... |
|
Validation Loss: 10.014737129211426 |
|
Step 31 | Loss: 9.762772 | Norm: 28.7018 | LR: 2.69e-05 | Time: 00:00:27 | Remaining: 00:00:15 | Avg Time/Step: 0.86 |
|
Step 32 | Loss: 9.099653 | Norm: 28.1757 | LR: 2.77e-05 | Time: 00:00:27 | Remaining: 00:00:14 | Avg Time/Step: 0.84 |
|
Validating... |
|
Validation Loss: 9.956048011779785 |
|
Step 33 | Loss: 8.908812 | Norm: 25.8786 | LR: 2.85e-05 | Time: 00:00:29 | Remaining: 00:00:13 | Avg Time/Step: 0.87 |
|
Step 34 | Loss: 10.699462 | Norm: 25.3921 | LR: 2.94e-05 | Time: 00:00:29 | Remaining: 00:00:12 | Avg Time/Step: 0.85 |
|
Validating... |
|
Validation Loss: 9.902624130249023 |
|
Step 35 | Loss: 9.239347 | Norm: 25.3455 | LR: 3.02e-05 | Time: 00:00:31 | Remaining: 00:00:12 | Avg Time/Step: 0.87 |
|
Step 36 | Loss: 10.142147 | Norm: 24.3786 | LR: 3.10e-05 | Time: 00:00:31 | Remaining: 00:00:11 | Avg Time/Step: 0.85 |
|
Validating... |
|
Validation Loss: 9.841948509216309 |
|
Step 37 | Loss: 10.260188 | Norm: 23.3623 | LR: 3.19e-05 | Time: 00:00:32 | Remaining: 00:00:10 | Avg Time/Step: 0.87 |
|
Step 38 | Loss: 9.482347 | Norm: 24.0785 | LR: 3.27e-05 | Time: 00:00:33 | Remaining: 00:00:09 | Avg Time/Step: 0.85 |
|
Validating... |
|
Validation Loss: 9.79233169555664 |
|
Step 39 | Loss: 8.717162 | Norm: 23.1963 | LR: 3.36e-05 | Time: 00:00:34 | Remaining: 00:00:08 | Avg Time/Step: 0.86 |
|
Step 40 | Loss: 9.536521 | Norm: 21.8829 | LR: 3.44e-05 | Time: 00:00:34 | Remaining: 00:00:07 | Avg Time/Step: 0.84 |
|
Validating... |
|
Validation Loss: 9.746158599853516 |
|
Step 41 | Loss: 9.760999 | Norm: 21.4380 | LR: 3.52e-05 | Time: 00:00:35 | Remaining: 00:00:06 | Avg Time/Step: 0.85 |
|
Step 42 | Loss: 9.588884 | Norm: 22.2327 | LR: 3.61e-05 | Time: 00:00:36 | Remaining: 00:00:05 | Avg Time/Step: 0.84 |
|
Validating... |
|
Validation Loss: 9.688400268554688 |
|
Step 43 | Loss: 8.350541 | Norm: 20.6459 | LR: 3.69e-05 | Time: 00:00:37 | Remaining: 00:00:05 | Avg Time/Step: 0.85 |
|
Step 44 | Loss: 9.594240 | Norm: 20.0493 | LR: 3.78e-05 | Time: 00:00:37 | Remaining: 00:00:04 | Avg Time/Step: 0.83 |
|
Validating... |
|
Validation Loss: 9.622390747070312 |
|
Step 45 | Loss: 8.240631 | Norm: 20.1186 | LR: 3.86e-05 | Time: 00:00:38 | Remaining: 00:00:03 | Avg Time/Step: 0.84 |
|
Step 46 | Loss: 8.915052 | Norm: 20.4390 | LR: 3.94e-05 | Time: 00:00:39 | Remaining: 00:00:02 | Avg Time/Step: 0.83 |
|
Validating... |
|
Validation Loss: 9.558349609375 |
|
Step 47 | Loss: 8.285755 | Norm: 20.3787 | LR: 4.03e-05 | Time: 00:00:40 | Remaining: 00:00:01 | Avg Time/Step: 0.84 |
|
Step 48 | Loss: 8.551549 | Norm: 20.1920 | LR: 4.11e-05 | Time: 00:00:40 | Remaining: 00:00:00 | Avg Time/Step: 0.83 |
|
Validating... |
|
Validation Loss: 9.461584091186523 |
|
Step 49 | Loss: 9.774352 | Norm: 20.2260 | LR: 4.20e-05 | Time: 00:00:42 | Remaining: 00:00:00 | Avg Time/Step: 0.84 |
|
Step 0 | Loss: 11.070963 | Norm: 48.8176 | LR: 8.39e-07 | Time: 00:00:00 | Remaining: 00:00:42 | Avg Time/Step: 0.87 |
|
Generated Text at Step 0: The king saidSeptemberSeptember 354 Fill ShameLots may>>>>>>>>umpyurry Apex nurses NEWS159 Vanguard FlemingictionTAJul Jihad LAR $\ underjri Columb |
|
Validating... |
|
Validation Loss: 10.916313171386719 |
|
Step 1 | Loss: 11.171237 | Norm: 45.8637 | LR: 1.68e-06 | Time: 00:00:03 | Remaining: 00:01:12 | Avg Time/Step: 1.51 |
|
Step 2 | Loss: 11.089214 | Norm: 49.5361 | LR: 2.52e-06 | Time: 00:00:03 | Remaining: 00:00:50 | Avg Time/Step: 1.08 |
|
Step 3 | Loss: 10.763819 | Norm: 52.8166 | LR: 3.36e-06 | Time: 00:00:03 | Remaining: 00:00:40 | Avg Time/Step: 0.88 |
|
Step 4 | Loss: 11.204582 | Norm: 47.4927 | LR: 4.20e-06 | Time: 00:00:04 | Remaining: 00:00:36 | Avg Time/Step: 0.81 |
|
Step 5 | Loss: 10.957478 | Norm: 41.5032 | LR: 5.03e-06 | Time: 00:00:04 | Remaining: 00:00:32 | Avg Time/Step: 0.73 |
|
Step 6 | Loss: 10.586459 | Norm: 43.5531 | LR: 5.87e-06 | Time: 00:00:04 | Remaining: 00:00:29 | Avg Time/Step: 0.68 |
|
Step 7 | Loss: 11.205253 | Norm: 44.9156 | LR: 6.71e-06 | Time: 00:00:05 | Remaining: 00:00:26 | Avg Time/Step: 0.64 |
|
Step 8 | Loss: 10.609798 | Norm: 48.2627 | LR: 7.55e-06 | Time: 00:00:05 | Remaining: 00:00:25 | Avg Time/Step: 0.61 |
|
Step 9 | Loss: 9.896498 | Norm: 43.1797 | LR: 8.39e-06 | Time: 00:00:05 | Remaining: 00:00:23 | Avg Time/Step: 0.59 |
|
Step 10 | Loss: 11.131380 | Norm: 44.4814 | LR: 9.23e-06 | Time: 00:00:06 | Remaining: 00:00:22 | Avg Time/Step: 0.57 |
|
Validating... |
|
Validation Loss: 10.749573707580566 |
|
Step 11 | Loss: 10.463729 | Norm: 47.8602 | LR: 1.01e-05 | Time: 00:00:07 | Remaining: 00:00:23 | Avg Time/Step: 0.62 |
|
Step 12 | Loss: 10.880756 | Norm: 43.9313 | LR: 1.09e-05 | Time: 00:00:07 | Remaining: 00:00:22 | Avg Time/Step: 0.60 |
|
Step 13 | Loss: 9.864075 | Norm: 42.5331 | LR: 1.17e-05 | Time: 00:00:08 | Remaining: 00:00:20 | Avg Time/Step: 0.57 |
|
Step 14 | Loss: 10.922160 | Norm: 44.6511 | LR: 1.26e-05 | Time: 00:00:08 | Remaining: 00:00:19 | Avg Time/Step: 0.57 |
|
Step 15 | Loss: 10.775851 | Norm: 44.4024 | LR: 1.34e-05 | Time: 00:00:08 | Remaining: 00:00:18 | Avg Time/Step: 0.55 |
|
Step 16 | Loss: 10.330193 | Norm: 43.8886 | LR: 1.43e-05 | Time: 00:00:09 | Remaining: 00:00:18 | Avg Time/Step: 0.55 |
|
Step 17 | Loss: 10.270191 | Norm: 44.5217 | LR: 1.51e-05 | Time: 00:00:09 | Remaining: 00:00:17 | Avg Time/Step: 0.53 |
|
Step 18 | Loss: 10.027596 | Norm: 46.1209 | LR: 1.59e-05 | Time: 00:00:10 | Remaining: 00:00:16 | Avg Time/Step: 0.53 |
|
Step 19 | Loss: 10.182181 | Norm: 40.7514 | LR: 1.68e-05 | Time: 00:00:10 | Remaining: 00:00:15 | Avg Time/Step: 0.52 |
|
Step 20 | Loss: 9.555431 | Norm: 34.3714 | LR: 1.76e-05 | Time: 00:00:10 | Remaining: 00:00:14 | Avg Time/Step: 0.51 |
|
Validating... |
|
Validation Loss: 10.458913803100586 |
|
Step 21 | Loss: 10.136066 | Norm: 35.4013 | LR: 1.85e-05 | Time: 00:00:12 | Remaining: 00:00:15 | Avg Time/Step: 0.56 |
|
Step 22 | Loss: 10.260824 | Norm: 35.9827 | LR: 1.93e-05 | Time: 00:00:12 | Remaining: 00:00:14 | Avg Time/Step: 0.54 |
|
Step 23 | Loss: 9.837000 | Norm: 34.4205 | LR: 2.01e-05 | Time: 00:00:12 | Remaining: 00:00:14 | Avg Time/Step: 0.54 |
|
Step 24 | Loss: 10.418470 | Norm: 35.1306 | LR: 2.10e-05 | Time: 00:00:13 | Remaining: 00:00:13 | Avg Time/Step: 0.53 |
|
Step 25 | Loss: 10.759716 | Norm: 34.3984 | LR: 2.18e-05 | Time: 00:00:13 | Remaining: 00:00:12 | Avg Time/Step: 0.53 |
|
Step 26 | Loss: 10.433059 | Norm: 33.6258 | LR: 2.27e-05 | Time: 00:00:14 | Remaining: 00:00:12 | Avg Time/Step: 0.53 |
|
Step 27 | Loss: 11.198073 | Norm: 33.6489 | LR: 2.35e-05 | Time: 00:00:14 | Remaining: 00:00:11 | Avg Time/Step: 0.53 |
|
Step 28 | Loss: 9.453720 | Norm: 30.4983 | LR: 2.43e-05 | Time: 00:00:15 | Remaining: 00:00:10 | Avg Time/Step: 0.52 |
|
Step 29 | Loss: 10.043849 | Norm: 30.8429 | LR: 2.52e-05 | Time: 00:00:15 | Remaining: 00:00:10 | Avg Time/Step: 0.52 |
|
Step 30 | Loss: 10.345837 | Norm: 28.3254 | LR: 2.60e-05 | Time: 00:00:16 | Remaining: 00:00:09 | Avg Time/Step: 0.52 |
|
Validating... |
|
Validation Loss: 10.014737129211426 |
|
Step 31 | Loss: 9.762772 | Norm: 28.7018 | LR: 2.69e-05 | Time: 00:00:17 | Remaining: 00:00:09 | Avg Time/Step: 0.54 |
|
Step 32 | Loss: 9.099653 | Norm: 28.1757 | LR: 2.77e-05 | Time: 00:00:17 | Remaining: 00:00:09 | Avg Time/Step: 0.53 |
|
Step 33 | Loss: 8.908812 | Norm: 25.8786 | LR: 2.85e-05 | Time: 00:00:17 | Remaining: 00:00:08 | Avg Time/Step: 0.53 |
|
Step 34 | Loss: 10.699462 | Norm: 25.3921 | LR: 2.94e-05 | Time: 00:00:18 | Remaining: 00:00:07 | Avg Time/Step: 0.52 |
|
Step 35 | Loss: 9.239347 | Norm: 25.3455 | LR: 3.02e-05 | Time: 00:00:18 | Remaining: 00:00:07 | Avg Time/Step: 0.52 |
|
Step 36 | Loss: 10.142147 | Norm: 24.3786 | LR: 3.10e-05 | Time: 00:00:19 | Remaining: 00:00:06 | Avg Time/Step: 0.52 |
|
Step 37 | Loss: 10.260188 | Norm: 23.3623 | LR: 3.19e-05 | Time: 00:00:19 | Remaining: 00:00:06 | Avg Time/Step: 0.52 |
|
Step 38 | Loss: 9.482347 | Norm: 24.0785 | LR: 3.27e-05 | Time: 00:00:20 | Remaining: 00:00:05 | Avg Time/Step: 0.52 |
|
Step 39 | Loss: 8.717162 | Norm: 23.1963 | LR: 3.36e-05 | Time: 00:00:20 | Remaining: 00:00:05 | Avg Time/Step: 0.52 |
|
Step 40 | Loss: 9.536521 | Norm: 21.8829 | LR: 3.44e-05 | Time: 00:00:21 | Remaining: 00:00:04 | Avg Time/Step: 0.51 |
|
Validating... |
|
Validation Loss: 9.746158599853516 |
|
Step 41 | Loss: 9.760999 | Norm: 21.4380 | LR: 3.52e-05 | Time: 00:00:22 | Remaining: 00:00:04 | Avg Time/Step: 0.53 |
|
Step 42 | Loss: 9.588884 | Norm: 22.2327 | LR: 3.61e-05 | Time: 00:00:22 | Remaining: 00:00:03 | Avg Time/Step: 0.53 |
|
Step 43 | Loss: 8.350541 | Norm: 20.6459 | LR: 3.69e-05 | Time: 00:00:23 | Remaining: 00:00:03 | Avg Time/Step: 0.53 |
|
Step 44 | Loss: 9.594240 | Norm: 20.0493 | LR: 3.78e-05 | Time: 00:00:23 | Remaining: 00:00:02 | Avg Time/Step: 0.52 |
|
Step 45 | Loss: 8.240631 | Norm: 20.1186 | LR: 3.86e-05 | Time: 00:00:23 | Remaining: 00:00:02 | Avg Time/Step: 0.52 |
|
Step 46 | Loss: 8.915052 | Norm: 20.4390 | LR: 3.94e-05 | Time: 00:00:24 | Remaining: 00:00:01 | Avg Time/Step: 0.51 |
|
Step 47 | Loss: 8.285755 | Norm: 20.3787 | LR: 4.03e-05 | Time: 00:00:24 | Remaining: 00:00:01 | Avg Time/Step: 0.51 |
|
Step 48 | Loss: 8.551549 | Norm: 20.1920 | LR: 4.11e-05 | Time: 00:00:24 | Remaining: 00:00:00 | Avg Time/Step: 0.51 |
|
Step 49 | Loss: 9.774352 | Norm: 20.2260 | LR: 4.20e-05 | Time: 00:00:25 | Remaining: 00:00:00 | Avg Time/Step: 0.51 |
|
Step 0 | Loss: 11.633898 | Norm: 44.3633 | LR: 8.39e-07 | Time: 00:00:00 | Remaining: 00:00:42 | Avg Time/Step: 0.86 |
|
Generated Text at Step 0: The king said ginger stupid 194 idi shrugged outperPLIC Pitch chapter chapter 169 Drac darkest darkesttic Suk encrypted outperGraphics bisexual PitchBC1987 Cobra drives |
|
Validating... |
|
Validation Loss: 10.924361228942871 |
|
Step 1 | Loss: 10.875149 | Norm: 51.7900 | LR: 1.68e-06 | Time: 00:00:02 | Remaining: 00:01:09 | Avg Time/Step: 1.45 |
|
Step 2 | Loss: 10.981276 | Norm: 44.8046 | LR: 2.52e-06 | Time: 00:00:03 | Remaining: 00:00:49 | Avg Time/Step: 1.06 |
|
Step 3 | Loss: 10.517224 | Norm: 49.3383 | LR: 3.36e-06 | Time: 00:00:03 | Remaining: 00:00:39 | Avg Time/Step: 0.86 |
|
Step 4 | Loss: 11.220371 | Norm: 50.4130 | LR: 4.20e-06 | Time: 00:00:03 | Remaining: 00:00:32 | Avg Time/Step: 0.73 |
|
Step 5 | Loss: 11.176923 | Norm: 47.4072 | LR: 5.03e-06 | Time: 00:00:03 | Remaining: 00:00:28 | Avg Time/Step: 0.65 |
|
Step 6 | Loss: 10.935453 | Norm: 45.3805 | LR: 5.87e-06 | Time: 00:00:04 | Remaining: 00:00:25 | Avg Time/Step: 0.59 |
|
Step 7 | Loss: 10.582232 | Norm: 46.3087 | LR: 6.71e-06 | Time: 00:00:04 | Remaining: 00:00:23 | Avg Time/Step: 0.56 |
|
Step 8 | Loss: 11.022345 | Norm: 43.2213 | LR: 7.55e-06 | Time: 00:00:04 | Remaining: 00:00:22 | Avg Time/Step: 0.55 |
|
Step 9 | Loss: 10.926727 | Norm: 44.3769 | LR: 8.39e-06 | Time: 00:00:05 | Remaining: 00:00:21 | Avg Time/Step: 0.53 |
|
Step 10 | Loss: 10.986204 | Norm: 45.1195 | LR: 9.23e-06 | Time: 00:00:05 | Remaining: 00:00:20 | Avg Time/Step: 0.52 |
|
Validating... |
|
Validation Loss: 10.735955238342285 |
|
Step 11 | Loss: 11.179207 | Norm: 47.9544 | LR: 1.01e-05 | Time: 00:00:07 | Remaining: 00:00:22 | Avg Time/Step: 0.59 |
|
Step 12 | Loss: 10.763081 | Norm: 43.9656 | LR: 1.09e-05 | Time: 00:00:07 | Remaining: 00:00:20 | Avg Time/Step: 0.56 |
|
Step 13 | Loss: 10.720469 | Norm: 43.3385 | LR: 1.17e-05 | Time: 00:00:07 | Remaining: 00:00:19 | Avg Time/Step: 0.54 |
|
Step 14 | Loss: 11.064083 | Norm: 43.1475 | LR: 1.26e-05 | Time: 00:00:07 | Remaining: 00:00:18 | Avg Time/Step: 0.53 |
|
Step 15 | Loss: 10.534277 | Norm: 44.0213 | LR: 1.34e-05 | Time: 00:00:08 | Remaining: 00:00:17 | Avg Time/Step: 0.52 |
|
Step 16 | Loss: 10.638024 | Norm: 42.8165 | LR: 1.43e-05 | Time: 00:00:08 | Remaining: 00:00:16 | Avg Time/Step: 0.51 |
|
Step 17 | Loss: 11.247206 | Norm: 39.1321 | LR: 1.51e-05 | Time: 00:00:09 | Remaining: 00:00:16 | Avg Time/Step: 0.51 |
|
Step 18 | Loss: 10.615942 | Norm: 45.8611 | LR: 1.59e-05 | Time: 00:00:09 | Remaining: 00:00:15 | Avg Time/Step: 0.50 |
|
Step 19 | Loss: 10.434818 | Norm: 35.2029 | LR: 1.68e-05 | Time: 00:00:09 | Remaining: 00:00:14 | Avg Time/Step: 0.49 |
|
Step 20 | Loss: 9.872961 | Norm: 37.0101 | LR: 1.76e-05 | Time: 00:00:10 | Remaining: 00:00:14 | Avg Time/Step: 0.49 |
|
Validating... |
|
Validation Loss: 10.45177936553955 |
|
Step 21 | Loss: 10.303642 | Norm: 38.1966 | LR: 1.85e-05 | Time: 00:00:11 | Remaining: 00:00:14 | Avg Time/Step: 0.53 |
|
Step 22 | Loss: 10.344124 | Norm: 36.7267 | LR: 1.93e-05 | Time: 00:00:11 | Remaining: 00:00:13 | Avg Time/Step: 0.51 |
|
Step 23 | Loss: 10.358528 | Norm: 33.4473 | LR: 2.01e-05 | Time: 00:00:12 | Remaining: 00:00:13 | Avg Time/Step: 0.50 |
|
Step 24 | Loss: 10.899721 | Norm: 33.1147 | LR: 2.10e-05 | Time: 00:00:12 | Remaining: 00:00:12 | Avg Time/Step: 0.50 |
|
Step 25 | Loss: 10.167845 | Norm: 32.0061 | LR: 2.18e-05 | Time: 00:00:12 | Remaining: 00:00:11 | Avg Time/Step: 0.50 |
|
Step 26 | Loss: 10.658374 | Norm: 32.8027 | LR: 2.27e-05 | Time: 00:00:13 | Remaining: 00:00:11 | Avg Time/Step: 0.49 |
|
Step 27 | Loss: 11.409204 | Norm: 32.2853 | LR: 2.35e-05 | Time: 00:00:13 | Remaining: 00:00:10 | Avg Time/Step: 0.49 |
|
Step 28 | Loss: 9.699551 | Norm: 28.3168 | LR: 2.43e-05 | Time: 00:00:14 | Remaining: 00:00:10 | Avg Time/Step: 0.48 |
|
Step 29 | Loss: 10.293508 | Norm: 29.6286 | LR: 2.52e-05 | Time: 00:00:14 | Remaining: 00:00:09 | Avg Time/Step: 0.48 |
|
Step 30 | Loss: 10.796824 | Norm: 32.4335 | LR: 2.60e-05 | Time: 00:00:14 | Remaining: 00:00:09 | Avg Time/Step: 0.48 |
|
Validating... |
|
Validation Loss: 10.094558715820312 |
|
Step 31 | Loss: 9.871226 | Norm: 29.4167 | LR: 2.69e-05 | Time: 00:00:16 | Remaining: 00:00:09 | Avg Time/Step: 0.50 |
|
Step 32 | Loss: 9.355142 | Norm: 29.9377 | LR: 2.77e-05 | Time: 00:00:16 | Remaining: 00:00:08 | Avg Time/Step: 0.49 |
|
Step 33 | Loss: 9.169601 | Norm: 28.7526 | LR: 2.85e-05 | Time: 00:00:16 | Remaining: 00:00:07 | Avg Time/Step: 0.49 |
|
Step 34 | Loss: 11.027575 | Norm: 25.0330 | LR: 2.94e-05 | Time: 00:00:17 | Remaining: 00:00:07 | Avg Time/Step: 0.49 |
|
Step 35 | Loss: 9.624268 | Norm: 26.2367 | LR: 3.02e-05 | Time: 00:00:17 | Remaining: 00:00:06 | Avg Time/Step: 0.48 |
|
Step 36 | Loss: 10.801857 | Norm: 26.3915 | LR: 3.10e-05 | Time: 00:00:17 | Remaining: 00:00:06 | Avg Time/Step: 0.48 |
|
Step 37 | Loss: 10.625546 | Norm: 24.5588 | LR: 3.19e-05 | Time: 00:00:18 | Remaining: 00:00:05 | Avg Time/Step: 0.48 |
|
Step 38 | Loss: 9.325054 | Norm: 23.9140 | LR: 3.27e-05 | Time: 00:00:18 | Remaining: 00:00:05 | Avg Time/Step: 0.48 |
|
Step 39 | Loss: 8.672618 | Norm: 22.6858 | LR: 3.36e-05 | Time: 00:00:18 | Remaining: 00:00:04 | Avg Time/Step: 0.47 |
|
Step 40 | Loss: 9.316482 | Norm: 23.7950 | LR: 3.44e-05 | Time: 00:00:19 | Remaining: 00:00:04 | Avg Time/Step: 0.47 |
|
Validating... |
|
Validation Loss: 9.847529411315918 |
|
Step 41 | Loss: 9.895099 | Norm: 22.9021 | LR: 3.52e-05 | Time: 00:00:20 | Remaining: 00:00:03 | Avg Time/Step: 0.49 |
|
Step 42 | Loss: 9.908270 | Norm: 22.2757 | LR: 3.61e-05 | Time: 00:00:20 | Remaining: 00:00:03 | Avg Time/Step: 0.48 |
|
Step 43 | Loss: 8.863647 | Norm: 21.6877 | LR: 3.69e-05 | Time: 00:00:21 | Remaining: 00:00:02 | Avg Time/Step: 0.48 |
|
Step 44 | Loss: 9.615014 | Norm: 22.1502 | LR: 3.78e-05 | Time: 00:00:21 | Remaining: 00:00:02 | Avg Time/Step: 0.48 |
|
Step 45 | Loss: 7.558504 | Norm: 20.6337 | LR: 3.86e-05 | Time: 00:00:21 | Remaining: 00:00:01 | Avg Time/Step: 0.48 |
|
Step 46 | Loss: 9.626184 | Norm: 22.2072 | LR: 3.94e-05 | Time: 00:00:22 | Remaining: 00:00:01 | Avg Time/Step: 0.47 |
|
Step 47 | Loss: 8.649675 | Norm: 21.2089 | LR: 4.03e-05 | Time: 00:00:22 | Remaining: 00:00:00 | Avg Time/Step: 0.47 |
|
Step 48 | Loss: 8.570056 | Norm: 21.1816 | LR: 4.11e-05 | Time: 00:00:23 | Remaining: 00:00:00 | Avg Time/Step: 0.47 |
|
Step 49 | Loss: 9.796856 | Norm: 20.8208 | LR: 4.20e-05 | Time: 00:00:23 | Remaining: 00:00:00 | Avg Time/Step: 0.47 |
|
Step 0 | Loss: 11.633898 | Norm: 44.3633 | LR: 8.39e-07 | Time: 00:00:00 | Remaining: 00:00:44 | Avg Time/Step: 0.91 |
|
Generated Text at Step 0: The king said ginger stupid 194 idi shrugged outperPLIC Pitch chapter chapter 169 Drac darkest darkesttic Suk encrypted outperGraphics bisexual PitchBC1987 Cobra drives |
|
Validating... |
|
Validation Loss: 10.924361228942871 |
|
Step 1 | Loss: 10.875149 | Norm: 51.7900 | LR: 1.68e-06 | Time: 00:00:03 | Remaining: 00:01:34 | Avg Time/Step: 1.97 |
|
Step 2 | Loss: 10.981276 | Norm: 44.8046 | LR: 2.52e-06 | Time: 00:00:04 | Remaining: 00:01:05 | Avg Time/Step: 1.39 |
|
Step 3 | Loss: 10.517224 | Norm: 49.3383 | LR: 3.36e-06 | Time: 00:00:04 | Remaining: 00:00:50 | Avg Time/Step: 1.10 |
|
Step 4 | Loss: 11.220371 | Norm: 50.4130 | LR: 4.20e-06 | Time: 00:00:04 | Remaining: 00:00:41 | Avg Time/Step: 0.92 |
|
Step 5 | Loss: 11.176923 | Norm: 47.4072 | LR: 5.03e-06 | Time: 00:00:04 | Remaining: 00:00:35 | Avg Time/Step: 0.80 |
|
Step 6 | Loss: 10.935453 | Norm: 45.3805 | LR: 5.87e-06 | Time: 00:00:05 | Remaining: 00:00:31 | Avg Time/Step: 0.72 |
|
Step 7 | Loss: 10.582232 | Norm: 46.3087 | LR: 6.71e-06 | Time: 00:00:05 | Remaining: 00:00:27 | Avg Time/Step: 0.66 |
|
Step 8 | Loss: 11.022345 | Norm: 43.2213 | LR: 7.55e-06 | Time: 00:00:05 | Remaining: 00:00:25 | Avg Time/Step: 0.62 |
|
Step 9 | Loss: 10.926727 | Norm: 44.3769 | LR: 8.39e-06 | Time: 00:00:06 | Remaining: 00:00:24 | Avg Time/Step: 0.61 |
|
Step 10 | Loss: 10.986204 | Norm: 45.1195 | LR: 9.23e-06 | Time: 00:00:06 | Remaining: 00:00:22 | Avg Time/Step: 0.59 |
|
Validating... |
|
Validation Loss: 10.735955238342285 |
|
Step 11 | Loss: 11.179207 | Norm: 47.9544 | LR: 1.01e-05 | Time: 00:00:07 | Remaining: 00:00:25 | Avg Time/Step: 0.66 |
|
Step 12 | Loss: 10.763081 | Norm: 43.9656 | LR: 1.09e-05 | Time: 00:00:08 | Remaining: 00:00:23 | Avg Time/Step: 0.63 |
|
Step 13 | Loss: 10.720469 | Norm: 43.3385 | LR: 1.17e-05 | Time: 00:00:08 | Remaining: 00:00:22 | Avg Time/Step: 0.63 |
|
Step 14 | Loss: 11.064083 | Norm: 43.1475 | LR: 1.26e-05 | Time: 00:00:09 | Remaining: 00:00:21 | Avg Time/Step: 0.62 |
|
Step 15 | Loss: 10.534277 | Norm: 44.0213 | LR: 1.34e-05 | Time: 00:00:09 | Remaining: 00:00:20 | Avg Time/Step: 0.60 |
|
Step 16 | Loss: 10.638024 | Norm: 42.8165 | LR: 1.43e-05 | Time: 00:00:10 | Remaining: 00:00:20 | Avg Time/Step: 0.61 |
|
Step 17 | Loss: 11.247206 | Norm: 39.1321 | LR: 1.51e-05 | Time: 00:00:10 | Remaining: 00:00:18 | Avg Time/Step: 0.59 |
|
Step 18 | Loss: 10.615942 | Norm: 45.8611 | LR: 1.59e-05 | Time: 00:00:11 | Remaining: 00:00:18 | Avg Time/Step: 0.59 |
|
Step 19 | Loss: 10.434818 | Norm: 35.2029 | LR: 1.68e-05 | Time: 00:00:11 | Remaining: 00:00:17 | Avg Time/Step: 0.58 |
|
Step 20 | Loss: 9.872961 | Norm: 37.0101 | LR: 1.76e-05 | Time: 00:00:11 | Remaining: 00:00:16 | Avg Time/Step: 0.57 |
|
Validating... |
|
Validation Loss: 10.45177936553955 |
|
Step 21 | Loss: 10.303642 | Norm: 38.1966 | LR: 1.85e-05 | Time: 00:00:13 | Remaining: 00:00:16 | Avg Time/Step: 0.60 |
|
Step 22 | Loss: 10.344124 | Norm: 36.7267 | LR: 1.93e-05 | Time: 00:00:13 | Remaining: 00:00:15 | Avg Time/Step: 0.59 |
|
Step 23 | Loss: 10.358528 | Norm: 33.4473 | LR: 2.01e-05 | Time: 00:00:14 | Remaining: 00:00:15 | Avg Time/Step: 0.59 |
|
Step 24 | Loss: 10.899721 | Norm: 33.1147 | LR: 2.10e-05 | Time: 00:00:14 | Remaining: 00:00:14 | Avg Time/Step: 0.59 |
|
Step 25 | Loss: 10.167845 | Norm: 32.0061 | LR: 2.18e-05 | Time: 00:00:14 | Remaining: 00:00:13 | Avg Time/Step: 0.58 |
|
Step 26 | Loss: 10.658374 | Norm: 32.8027 | LR: 2.27e-05 | Time: 00:00:15 | Remaining: 00:00:13 | Avg Time/Step: 0.59 |
|
Step 27 | Loss: 11.409204 | Norm: 32.2853 | LR: 2.35e-05 | Time: 00:00:16 | Remaining: 00:00:12 | Avg Time/Step: 0.58 |
|
Step 28 | Loss: 9.699551 | Norm: 28.3168 | LR: 2.43e-05 | Time: 00:00:16 | Remaining: 00:00:12 | Avg Time/Step: 0.58 |
|
Step 29 | Loss: 10.293508 | Norm: 29.6286 | LR: 2.52e-05 | Time: 00:00:17 | Remaining: 00:00:11 | Avg Time/Step: 0.58 |
|
Step 30 | Loss: 10.796824 | Norm: 32.4335 | LR: 2.60e-05 | Time: 00:00:17 | Remaining: 00:00:10 | Avg Time/Step: 0.57 |
|
Validating... |
|
Validation Loss: 10.094558715820312 |
|
Step 31 | Loss: 9.871226 | Norm: 29.4167 | LR: 2.69e-05 | Time: 00:00:19 | Remaining: 00:00:10 | Avg Time/Step: 0.60 |
|
Step 32 | Loss: 9.355142 | Norm: 29.9377 | LR: 2.77e-05 | Time: 00:00:19 | Remaining: 00:00:09 | Avg Time/Step: 0.58 |
|
Step 33 | Loss: 9.169601 | Norm: 28.7526 | LR: 2.85e-05 | Time: 00:00:19 | Remaining: 00:00:09 | Avg Time/Step: 0.58 |
|
Step 34 | Loss: 11.027575 | Norm: 25.0330 | LR: 2.94e-05 | Time: 00:00:20 | Remaining: 00:00:08 | Avg Time/Step: 0.58 |
|
Step 35 | Loss: 9.624268 | Norm: 26.2367 | LR: 3.02e-05 | Time: 00:00:20 | Remaining: 00:00:08 | Avg Time/Step: 0.58 |
|
Step 36 | Loss: 10.801857 | Norm: 26.3915 | LR: 3.10e-05 | Time: 00:00:21 | Remaining: 00:00:07 | Avg Time/Step: 0.58 |
|
Step 37 | Loss: 10.625546 | Norm: 24.5588 | LR: 3.19e-05 | Time: 00:00:22 | Remaining: 00:00:06 | Avg Time/Step: 0.58 |
|
Step 38 | Loss: 9.325054 | Norm: 23.9140 | LR: 3.27e-05 | Time: 00:00:22 | Remaining: 00:00:06 | Avg Time/Step: 0.57 |
|
Step 39 | Loss: 8.672618 | Norm: 22.6858 | LR: 3.36e-05 | Time: 00:00:22 | Remaining: 00:00:05 | Avg Time/Step: 0.57 |
|
Step 40 | Loss: 9.316482 | Norm: 23.7950 | LR: 3.44e-05 | Time: 00:00:23 | Remaining: 00:00:05 | Avg Time/Step: 0.56 |
|
Validating... |
|
Validation Loss: 9.847529411315918 |
|
Step 41 | Loss: 9.895099 | Norm: 22.9021 | LR: 3.52e-05 | Time: 00:00:24 | Remaining: 00:00:04 | Avg Time/Step: 0.58 |
|
Step 42 | Loss: 9.908270 | Norm: 22.2757 | LR: 3.61e-05 | Time: 00:00:24 | Remaining: 00:00:04 | Avg Time/Step: 0.57 |
|
Step 43 | Loss: 8.863647 | Norm: 21.6877 | LR: 3.69e-05 | Time: 00:00:25 | Remaining: 00:00:03 | Avg Time/Step: 0.57 |
|
Step 44 | Loss: 9.615014 | Norm: 22.1502 | LR: 3.78e-05 | Time: 00:00:25 | Remaining: 00:00:02 | Avg Time/Step: 0.57 |
|
Step 45 | Loss: 7.558504 | Norm: 20.6337 | LR: 3.86e-05 | Time: 00:00:25 | Remaining: 00:00:02 | Avg Time/Step: 0.56 |
|
Step 46 | Loss: 9.626184 | Norm: 22.2072 | LR: 3.94e-05 | Time: 00:00:26 | Remaining: 00:00:01 | Avg Time/Step: 0.56 |
|
Step 47 | Loss: 8.649675 | Norm: 21.2089 | LR: 4.03e-05 | Time: 00:00:26 | Remaining: 00:00:01 | Avg Time/Step: 0.55 |
|
Step 48 | Loss: 8.570056 | Norm: 21.1816 | LR: 4.11e-05 | Time: 00:00:27 | Remaining: 00:00:00 | Avg Time/Step: 0.55 |
|
Step 49 | Loss: 9.796856 | Norm: 20.8208 | LR: 4.20e-05 | Time: 00:00:27 | Remaining: 00:00:00 | Avg Time/Step: 0.55 |
|
Step 0 | Loss: 11.633898 | Norm: 44.3633 | LR: 8.39e-07 | Time: 00:00:00 | Remaining: 00:00:42 | Avg Time/Step: 0.86 |
|
Generated Text at Step 0: The king said ginger stupid 194 idi shrugged outperPLIC Pitch chapter chapter 169 Drac darkest darkesttic Suk encrypted outperGraphics bisexual PitchBC1987 Cobra drives |
|
Validating... |
|
Validation Loss: 10.924361228942871 |
|
Step 1 | Loss: 10.875149 | Norm: 51.7900 | LR: 1.68e-06 | Time: 00:00:03 | Remaining: 00:01:29 | Avg Time/Step: 1.87 |
|
Step 2 | Loss: 10.981276 | Norm: 44.8046 | LR: 2.52e-06 | Time: 00:00:03 | Remaining: 00:01:01 | Avg Time/Step: 1.32 |
|
Step 3 | Loss: 10.517224 | Norm: 49.3383 | LR: 3.36e-06 | Time: 00:00:04 | Remaining: 00:00:48 | Avg Time/Step: 1.04 |
|
Step 4 | Loss: 11.220371 | Norm: 50.4130 | LR: 4.20e-06 | Time: 00:00:04 | Remaining: 00:00:39 | Avg Time/Step: 0.88 |
|
Step 5 | Loss: 11.176923 | Norm: 47.4072 | LR: 5.03e-06 | Time: 00:00:04 | Remaining: 00:00:33 | Avg Time/Step: 0.77 |
|
Step 6 | Loss: 10.935453 | Norm: 45.3805 | LR: 5.87e-06 | Time: 00:00:05 | Remaining: 00:00:35 | Avg Time/Step: 0.82 |
|
Step 7 | Loss: 10.582232 | Norm: 46.3087 | LR: 6.71e-06 | Time: 00:00:05 | Remaining: 00:00:31 | Avg Time/Step: 0.74 |
|
Step 8 | Loss: 11.022345 | Norm: 43.2213 | LR: 7.55e-06 | Time: 00:00:06 | Remaining: 00:00:28 | Avg Time/Step: 0.68 |
|
Step 9 | Loss: 10.926727 | Norm: 44.3769 | LR: 8.39e-06 | Time: 00:00:06 | Remaining: 00:00:25 | Avg Time/Step: 0.64 |
|
Step 10 | Loss: 10.986204 | Norm: 45.1195 | LR: 9.23e-06 | Time: 00:00:06 | Remaining: 00:00:23 | Avg Time/Step: 0.60 |
|
Validating... |
|
Validation Loss: 10.735955238342285 |
|
Step 11 | Loss: 11.179207 | Norm: 47.9544 | LR: 1.01e-05 | Time: 00:00:08 | Remaining: 00:00:27 | Avg Time/Step: 0.72 |
|
Step 12 | Loss: 10.763081 | Norm: 43.9656 | LR: 1.09e-05 | Time: 00:00:08 | Remaining: 00:00:25 | Avg Time/Step: 0.68 |
|
Step 13 | Loss: 10.720469 | Norm: 43.3385 | LR: 1.17e-05 | Time: 00:00:09 | Remaining: 00:00:23 | Avg Time/Step: 0.65 |
|
Step 14 | Loss: 11.064083 | Norm: 43.1475 | LR: 1.26e-05 | Time: 00:00:09 | Remaining: 00:00:22 | Avg Time/Step: 0.64 |
|
Step 15 | Loss: 10.534277 | Norm: 44.0213 | LR: 1.34e-05 | Time: 00:00:09 | Remaining: 00:00:21 | Avg Time/Step: 0.62 |
|
Step 16 | Loss: 10.638024 | Norm: 42.8165 | LR: 1.43e-05 | Time: 00:00:11 | Remaining: 00:00:22 | Avg Time/Step: 0.67 |
|
Step 17 | Loss: 11.247206 | Norm: 39.1321 | LR: 1.51e-05 | Time: 00:00:11 | Remaining: 00:00:20 | Avg Time/Step: 0.65 |
|
Step 18 | Loss: 10.615942 | Norm: 45.8611 | LR: 1.59e-05 | Time: 00:00:12 | Remaining: 00:00:19 | Avg Time/Step: 0.64 |
|
Step 19 | Loss: 10.434818 | Norm: 35.2029 | LR: 1.68e-05 | Time: 00:00:12 | Remaining: 00:00:19 | Avg Time/Step: 0.64 |
|
Step 20 | Loss: 9.872961 | Norm: 37.0101 | LR: 1.76e-05 | Time: 00:00:13 | Remaining: 00:00:18 | Avg Time/Step: 0.63 |
|
Validating... |
|
Validation Loss: 10.45177936553955 |
|
Step 21 | Loss: 10.303642 | Norm: 38.1966 | LR: 1.85e-05 | Time: 00:00:15 | Remaining: 00:00:19 | Avg Time/Step: 0.70 |
|
Step 22 | Loss: 10.344124 | Norm: 36.7267 | LR: 1.93e-05 | Time: 00:00:15 | Remaining: 00:00:18 | Avg Time/Step: 0.68 |
|
Step 23 | Loss: 10.358528 | Norm: 33.4473 | LR: 2.01e-05 | Time: 00:00:16 | Remaining: 00:00:17 | Avg Time/Step: 0.67 |
|
Step 24 | Loss: 10.899721 | Norm: 33.1147 | LR: 2.10e-05 | Time: 00:00:16 | Remaining: 00:00:16 | Avg Time/Step: 0.66 |
|
Step 25 | Loss: 10.167845 | Norm: 32.0061 | LR: 2.18e-05 | Time: 00:00:16 | Remaining: 00:00:15 | Avg Time/Step: 0.65 |
|
Step 26 | Loss: 10.658374 | Norm: 32.8027 | LR: 2.27e-05 | Time: 00:00:18 | Remaining: 00:00:15 | Avg Time/Step: 0.68 |
|
Step 27 | Loss: 11.409204 | Norm: 32.2853 | LR: 2.35e-05 | Time: 00:00:18 | Remaining: 00:00:14 | Avg Time/Step: 0.66 |
|
Step 28 | Loss: 9.699551 | Norm: 28.3168 | LR: 2.43e-05 | Time: 00:00:18 | Remaining: 00:00:13 | Avg Time/Step: 0.65 |
|
Step 29 | Loss: 10.293508 | Norm: 29.6286 | LR: 2.52e-05 | Time: 00:00:19 | Remaining: 00:00:12 | Avg Time/Step: 0.64 |
|
Step 30 | Loss: 10.796824 | Norm: 32.4335 | LR: 2.60e-05 | Time: 00:00:19 | Remaining: 00:00:12 | Avg Time/Step: 0.63 |
|
Validating... |
|
Validation Loss: 10.094558715820312 |
|
Step 31 | Loss: 9.871226 | Norm: 29.4167 | LR: 2.69e-05 | Time: 00:00:21 | Remaining: 00:00:12 | Avg Time/Step: 0.68 |
|
Step 32 | Loss: 9.355142 | Norm: 29.9377 | LR: 2.77e-05 | Time: 00:00:22 | Remaining: 00:00:11 | Avg Time/Step: 0.67 |
|
Step 33 | Loss: 9.169601 | Norm: 28.7526 | LR: 2.85e-05 | Time: 00:00:22 | Remaining: 00:00:10 | Avg Time/Step: 0.66 |
|
Step 34 | Loss: 11.027575 | Norm: 25.0330 | LR: 2.94e-05 | Time: 00:00:22 | Remaining: 00:00:09 | Avg Time/Step: 0.65 |
|
Step 35 | Loss: 9.624268 | Norm: 26.2367 | LR: 3.02e-05 | Time: 00:00:23 | Remaining: 00:00:08 | Avg Time/Step: 0.64 |
|
Step 36 | Loss: 10.801857 | Norm: 26.3915 | LR: 3.10e-05 | Time: 00:00:24 | Remaining: 00:00:08 | Avg Time/Step: 0.66 |
|
Step 37 | Loss: 10.625546 | Norm: 24.5588 | LR: 3.19e-05 | Time: 00:00:24 | Remaining: 00:00:07 | Avg Time/Step: 0.66 |
|
Step 38 | Loss: 9.325054 | Norm: 23.9140 | LR: 3.27e-05 | Time: 00:00:25 | Remaining: 00:00:07 | Avg Time/Step: 0.65 |
|
Step 39 | Loss: 8.672618 | Norm: 22.6858 | LR: 3.36e-05 | Time: 00:00:26 | Remaining: 00:00:06 | Avg Time/Step: 0.65 |
|
Step 40 | Loss: 9.316482 | Norm: 23.7950 | LR: 3.44e-05 | Time: 00:00:26 | Remaining: 00:00:05 | Avg Time/Step: 0.65 |
|
Validating... |
|
Validation Loss: 9.847529411315918 |
|
Step 41 | Loss: 9.895099 | Norm: 22.9021 | LR: 3.52e-05 | Time: 00:00:28 | Remaining: 00:00:05 | Avg Time/Step: 0.68 |
|
Step 42 | Loss: 9.908270 | Norm: 22.2757 | LR: 3.61e-05 | Time: 00:00:28 | Remaining: 00:00:04 | Avg Time/Step: 0.67 |
|
Step 43 | Loss: 8.863647 | Norm: 21.6877 | LR: 3.69e-05 | Time: 00:00:29 | Remaining: 00:00:03 | Avg Time/Step: 0.66 |
|
Step 44 | Loss: 9.615014 | Norm: 22.1502 | LR: 3.78e-05 | Time: 00:00:29 | Remaining: 00:00:03 | Avg Time/Step: 0.65 |
|
Step 45 | Loss: 7.558504 | Norm: 20.6337 | LR: 3.86e-05 | Time: 00:00:29 | Remaining: 00:00:02 | Avg Time/Step: 0.65 |
|
Step 46 | Loss: 9.626184 | Norm: 22.2072 | LR: 3.94e-05 | Time: 00:00:31 | Remaining: 00:00:01 | Avg Time/Step: 0.66 |
|
Step 47 | Loss: 8.649675 | Norm: 21.2089 | LR: 4.03e-05 | Time: 00:00:31 | Remaining: 00:00:01 | Avg Time/Step: 0.66 |
|
Step 48 | Loss: 8.570056 | Norm: 21.1816 | LR: 4.11e-05 | Time: 00:00:32 | Remaining: 00:00:00 | Avg Time/Step: 0.66 |
|
Step 49 | Loss: 9.796856 | Norm: 20.8208 | LR: 4.20e-05 | Time: 00:00:32 | Remaining: 00:00:00 | Avg Time/Step: 0.66 |
|
Step 0 | Loss: 11.633898 | Norm: 44.3633 | LR: 8.39e-07 | Time: 00:00:00 | Remaining: 00:00:42 | Avg Time/Step: 0.87 |
|
Generated Text at Step 0: The king said ginger stupid 194 idi shrugged outperPLIC Pitch chapter chapter 169 Drac darkest darkesttic Suk encrypted outperGraphics bisexual PitchBC1987 Cobra drives |
|
Validating... |
|
Validation Loss: 10.924361228942871 |
|
Step 1 | Loss: 10.875149 | Norm: 51.7900 | LR: 1.68e-06 | Time: 00:00:03 | Remaining: 00:01:31 | Avg Time/Step: 1.91 |
|
Step 2 | Loss: 10.981276 | Norm: 44.8046 | LR: 2.52e-06 | Time: 00:00:04 | Remaining: 00:01:03 | Avg Time/Step: 1.35 |
|
Step 3 | Loss: 10.517224 | Norm: 49.3383 | LR: 3.36e-06 | Time: 00:00:04 | Remaining: 00:00:49 | Avg Time/Step: 1.07 |
|
Step 4 | Loss: 11.220371 | Norm: 50.4130 | LR: 4.20e-06 | Time: 00:00:04 | Remaining: 00:00:40 | Avg Time/Step: 0.90 |
|
Step 5 | Loss: 11.176923 | Norm: 47.4072 | LR: 5.03e-06 | Time: 00:00:04 | Remaining: 00:00:34 | Avg Time/Step: 0.79 |
|
Step 6 | Loss: 10.935453 | Norm: 45.3805 | LR: 5.87e-06 | Time: 00:00:05 | Remaining: 00:00:35 | Avg Time/Step: 0.83 |
|
Step 7 | Loss: 10.582232 | Norm: 46.3087 | LR: 6.71e-06 | Time: 00:00:06 | Remaining: 00:00:31 | Avg Time/Step: 0.75 |
|
Step 8 | Loss: 11.022345 | Norm: 43.2213 | LR: 7.55e-06 | Time: 00:00:06 | Remaining: 00:00:28 | Avg Time/Step: 0.70 |
|
Step 9 | Loss: 10.926727 | Norm: 44.3769 | LR: 8.39e-06 | Time: 00:00:06 | Remaining: 00:00:25 | Avg Time/Step: 0.65 |
|
Step 10 | Loss: 10.986204 | Norm: 45.1195 | LR: 9.23e-06 | Time: 00:00:06 | Remaining: 00:00:23 | Avg Time/Step: 0.61 |
|
Validating... |
|
Validation Loss: 10.735955238342285 |
|
Step 11 | Loss: 11.179207 | Norm: 47.9544 | LR: 1.01e-05 | Time: 00:00:08 | Remaining: 00:00:28 | Avg Time/Step: 0.75 |
|
Step 12 | Loss: 10.763081 | Norm: 43.9656 | LR: 1.09e-05 | Time: 00:00:09 | Remaining: 00:00:26 | Avg Time/Step: 0.71 |
|
Step 13 | Loss: 10.720469 | Norm: 43.3385 | LR: 1.17e-05 | Time: 00:00:09 | Remaining: 00:00:24 | Avg Time/Step: 0.67 |
|
Step 14 | Loss: 11.064083 | Norm: 43.1475 | LR: 1.26e-05 | Time: 00:00:09 | Remaining: 00:00:22 | Avg Time/Step: 0.65 |
|
Step 15 | Loss: 10.534277 | Norm: 44.0213 | LR: 1.34e-05 | Time: 00:00:10 | Remaining: 00:00:21 | Avg Time/Step: 0.63 |
|
Step 16 | Loss: 10.638024 | Norm: 42.8165 | LR: 1.43e-05 | Time: 00:00:11 | Remaining: 00:00:22 | Avg Time/Step: 0.68 |
|
Step 17 | Loss: 11.247206 | Norm: 39.1321 | LR: 1.51e-05 | Time: 00:00:11 | Remaining: 00:00:20 | Avg Time/Step: 0.65 |
|
Step 18 | Loss: 10.615942 | Norm: 45.8611 | LR: 1.59e-05 | Time: 00:00:11 | Remaining: 00:00:19 | Avg Time/Step: 0.63 |
|
Step 19 | Loss: 10.434818 | Norm: 35.2029 | LR: 1.68e-05 | Time: 00:00:12 | Remaining: 00:00:18 | Avg Time/Step: 0.63 |
|
Step 20 | Loss: 9.872961 | Norm: 37.0101 | LR: 1.76e-05 | Time: 00:00:12 | Remaining: 00:00:17 | Avg Time/Step: 0.61 |
|
Validating... |
|
Validation Loss: 10.45177936553955 |
|
Step 21 | Loss: 10.303642 | Norm: 38.1966 | LR: 1.85e-05 | Time: 00:00:15 | Remaining: 00:00:19 | Avg Time/Step: 0.69 |
|
Step 22 | Loss: 10.344124 | Norm: 36.7267 | LR: 1.93e-05 | Time: 00:00:15 | Remaining: 00:00:18 | Avg Time/Step: 0.67 |
|
Step 23 | Loss: 10.358528 | Norm: 33.4473 | LR: 2.01e-05 | Time: 00:00:15 | Remaining: 00:00:16 | Avg Time/Step: 0.65 |
|
Step 24 | Loss: 10.899721 | Norm: 33.1147 | LR: 2.10e-05 | Time: 00:00:15 | Remaining: 00:00:15 | Avg Time/Step: 0.64 |
|
Step 25 | Loss: 10.167845 | Norm: 32.0061 | LR: 2.18e-05 | Time: 00:00:16 | Remaining: 00:00:15 | Avg Time/Step: 0.63 |
|
Step 26 | Loss: 10.658374 | Norm: 32.8027 | LR: 2.27e-05 | Time: 00:00:17 | Remaining: 00:00:14 | Avg Time/Step: 0.65 |
|
Step 27 | Loss: 11.409204 | Norm: 32.2853 | LR: 2.35e-05 | Time: 00:00:17 | Remaining: 00:00:14 | Avg Time/Step: 0.64 |
|
Step 28 | Loss: 9.699551 | Norm: 28.3168 | LR: 2.43e-05 | Time: 00:00:18 | Remaining: 00:00:13 | Avg Time/Step: 0.62 |
|
Step 29 | Loss: 10.293508 | Norm: 29.6286 | LR: 2.52e-05 | Time: 00:00:18 | Remaining: 00:00:12 | Avg Time/Step: 0.62 |
|
Step 30 | Loss: 10.796824 | Norm: 32.4335 | LR: 2.60e-05 | Time: 00:00:18 | Remaining: 00:00:11 | Avg Time/Step: 0.61 |
|
Validating... |
|
Validation Loss: 10.094558715820312 |
|
Step 31 | Loss: 9.871226 | Norm: 29.4167 | LR: 2.69e-05 | Time: 00:00:21 | Remaining: 00:00:11 | Avg Time/Step: 0.66 |
|
Step 32 | Loss: 9.355142 | Norm: 29.9377 | LR: 2.77e-05 | Time: 00:00:21 | Remaining: 00:00:10 | Avg Time/Step: 0.65 |
|
Step 33 | Loss: 9.169601 | Norm: 28.7526 | LR: 2.85e-05 | Time: 00:00:21 | Remaining: 00:00:10 | Avg Time/Step: 0.63 |
|
Step 34 | Loss: 11.027575 | Norm: 25.0330 | LR: 2.94e-05 | Time: 00:00:21 | Remaining: 00:00:09 | Avg Time/Step: 0.62 |
|
Step 35 | Loss: 9.624268 | Norm: 26.2367 | LR: 3.02e-05 | Time: 00:00:22 | Remaining: 00:00:08 | Avg Time/Step: 0.62 |
|
Step 36 | Loss: 10.801857 | Norm: 26.3915 | LR: 3.10e-05 | Time: 00:00:23 | Remaining: 00:00:08 | Avg Time/Step: 0.64 |
|
Step 37 | Loss: 10.625546 | Norm: 24.5588 | LR: 3.19e-05 | Time: 00:00:23 | Remaining: 00:00:07 | Avg Time/Step: 0.63 |
|
Step 38 | Loss: 9.325054 | Norm: 23.9140 | LR: 3.27e-05 | Time: 00:00:24 | Remaining: 00:00:06 | Avg Time/Step: 0.62 |
|
Step 39 | Loss: 8.672618 | Norm: 22.6858 | LR: 3.36e-05 | Time: 00:00:24 | Remaining: 00:00:06 | Avg Time/Step: 0.61 |
|
Step 40 | Loss: 9.316482 | Norm: 23.7950 | LR: 3.44e-05 | Time: 00:00:24 | Remaining: 00:00:05 | Avg Time/Step: 0.60 |
|
Validating... |
|
Validation Loss: 9.847529411315918 |
|
Step 41 | Loss: 9.895099 | Norm: 22.9021 | LR: 3.52e-05 | Time: 00:00:26 | Remaining: 00:00:05 | Avg Time/Step: 0.64 |
|
Step 42 | Loss: 9.908270 | Norm: 22.2757 | LR: 3.61e-05 | Time: 00:00:27 | Remaining: 00:00:04 | Avg Time/Step: 0.63 |
|
Step 43 | Loss: 8.863647 | Norm: 21.6877 | LR: 3.69e-05 | Time: 00:00:27 | Remaining: 00:00:03 | Avg Time/Step: 0.62 |
|
Step 44 | Loss: 9.615014 | Norm: 22.1502 | LR: 3.78e-05 | Time: 00:00:27 | Remaining: 00:00:03 | Avg Time/Step: 0.62 |
|
Step 45 | Loss: 7.558504 | Norm: 20.6337 | LR: 3.86e-05 | Time: 00:00:28 | Remaining: 00:00:02 | Avg Time/Step: 0.61 |
|
Step 46 | Loss: 9.626184 | Norm: 22.2072 | LR: 3.94e-05 | Time: 00:00:29 | Remaining: 00:00:01 | Avg Time/Step: 0.63 |
|
Step 47 | Loss: 8.649675 | Norm: 21.2089 | LR: 4.03e-05 | Time: 00:00:29 | Remaining: 00:00:01 | Avg Time/Step: 0.62 |
|
Step 48 | Loss: 8.570056 | Norm: 21.1816 | LR: 4.11e-05 | Time: 00:00:30 | Remaining: 00:00:00 | Avg Time/Step: 0.61 |
|
Step 49 | Loss: 9.796856 | Norm: 20.8208 | LR: 4.20e-05 | Time: 00:00:30 | Remaining: 00:00:00 | Avg Time/Step: 0.61 |
|
|