kertob commited on
Commit
d95ee88
1 Parent(s): 1fa12ea

Training in progress, step 80

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a4c79267ebfa8a920151c34ada1ab0892488cb5051725b369830b338e72e7665
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abb174e7051e7123e8a1f799d8bc50c50f81bfa5d7d44be2837c4f8330113226
3
  size 261131840
runs/Mar08_13-48-53_4997a2709b0f/events.out.tfevents.1709905734.4997a2709b0f.35964.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c45e11e4cdf511edd44d447b868dbfd171f89f42f9ee552866178755eac00313
3
- size 7181
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63df73605e69c21a5d850966d6e998b0530337493116e3e0fe4647f6cfe1c880
3
+ size 7388
wandb/debug-internal.log CHANGED
@@ -368,3 +368,52 @@
368
  2024-03-08 13:59:53,925 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
369
  2024-03-08 13:59:58,926 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
370
  2024-03-08 14:00:03,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
368
  2024-03-08 13:59:53,925 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
369
  2024-03-08 13:59:58,926 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
370
  2024-03-08 14:00:03,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
371
+ 2024-03-08 14:00:07,186 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
372
+ 2024-03-08 14:00:07,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
373
+ 2024-03-08 14:00:07,655 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
374
+ 2024-03-08 14:00:07,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
375
+ 2024-03-08 14:00:09,863 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
376
+ 2024-03-08 14:00:14,864 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
377
+ 2024-03-08 14:00:19,865 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
378
+ 2024-03-08 14:00:22,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
379
+ 2024-03-08 14:00:22,655 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
380
+ 2024-03-08 14:00:22,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
381
+ 2024-03-08 14:00:24,932 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
382
+ 2024-03-08 14:00:29,933 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
383
+ 2024-03-08 14:00:34,934 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
384
+ 2024-03-08 14:00:37,187 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
385
+ 2024-03-08 14:00:37,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
386
+ 2024-03-08 14:00:37,656 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
387
+ 2024-03-08 14:00:37,696 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
388
+ 2024-03-08 14:00:40,925 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
389
+ 2024-03-08 14:00:45,926 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
390
+ 2024-03-08 14:00:50,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
391
+ 2024-03-08 14:00:52,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
392
+ 2024-03-08 14:00:52,656 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
393
+ 2024-03-08 14:00:52,696 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
394
+ 2024-03-08 14:00:56,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
395
+ 2024-03-08 14:01:01,928 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
396
+ 2024-03-08 14:01:06,929 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
397
+ 2024-03-08 14:01:07,187 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
398
+ 2024-03-08 14:01:07,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
399
+ 2024-03-08 14:01:07,656 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
400
+ 2024-03-08 14:01:07,696 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
401
+ 2024-03-08 14:01:12,835 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
402
+ 2024-03-08 14:01:17,836 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
403
+ 2024-03-08 14:01:21,426 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
404
+ 2024-03-08 14:01:21,428 DEBUG SenderThread:37167 [sender.py:send():378] send: history
405
+ 2024-03-08 14:01:21,428 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
406
+ 2024-03-08 14:01:21,429 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
407
+ 2024-03-08 14:01:22,216 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
408
+ 2024-03-08 14:01:22,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
409
+ 2024-03-08 14:01:22,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
410
+ 2024-03-08 14:01:22,806 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
411
+ 2024-03-08 14:01:23,007 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
412
+ 2024-03-08 14:01:28,008 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
413
+ 2024-03-08 14:01:33,010 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
414
+ 2024-03-08 14:01:37,188 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
415
+ 2024-03-08 14:01:37,803 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
416
+ 2024-03-08 14:01:37,804 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
417
+ 2024-03-08 14:01:37,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
418
+ 2024-03-08 14:01:38,021 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
419
+ 2024-03-08 14:01:43,022 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.3484, "train/grad_norm": 0.6353679299354553, "train/learning_rate": 7.546600811643816e-05, "train/epoch": 5.6, "train/global_step": 70, "_timestamp": 1709906385.4299374, "_runtime": 644.009640455246, "_step": 6}
 
1
+ {"train/loss": 0.2768, "train/grad_norm": 0.6020347476005554, "train/learning_rate": 6.819524684817438e-05, "train/epoch": 6.4, "train/global_step": 80, "_timestamp": 1709906481.4263425, "_runtime": 740.0060455799103, "_step": 7}
wandb/run-20240308_134901-hlg2f18u/logs/debug-internal.log CHANGED
@@ -368,3 +368,52 @@
368
  2024-03-08 13:59:53,925 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
369
  2024-03-08 13:59:58,926 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
370
  2024-03-08 14:00:03,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
368
  2024-03-08 13:59:53,925 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
369
  2024-03-08 13:59:58,926 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
370
  2024-03-08 14:00:03,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
371
+ 2024-03-08 14:00:07,186 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
372
+ 2024-03-08 14:00:07,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
373
+ 2024-03-08 14:00:07,655 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
374
+ 2024-03-08 14:00:07,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
375
+ 2024-03-08 14:00:09,863 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
376
+ 2024-03-08 14:00:14,864 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
377
+ 2024-03-08 14:00:19,865 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
378
+ 2024-03-08 14:00:22,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
379
+ 2024-03-08 14:00:22,655 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
380
+ 2024-03-08 14:00:22,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
381
+ 2024-03-08 14:00:24,932 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
382
+ 2024-03-08 14:00:29,933 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
383
+ 2024-03-08 14:00:34,934 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
384
+ 2024-03-08 14:00:37,187 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
385
+ 2024-03-08 14:00:37,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
386
+ 2024-03-08 14:00:37,656 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
387
+ 2024-03-08 14:00:37,696 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
388
+ 2024-03-08 14:00:40,925 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
389
+ 2024-03-08 14:00:45,926 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
390
+ 2024-03-08 14:00:50,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
391
+ 2024-03-08 14:00:52,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
392
+ 2024-03-08 14:00:52,656 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
393
+ 2024-03-08 14:00:52,696 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
394
+ 2024-03-08 14:00:56,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
395
+ 2024-03-08 14:01:01,928 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
396
+ 2024-03-08 14:01:06,929 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
397
+ 2024-03-08 14:01:07,187 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
398
+ 2024-03-08 14:01:07,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
399
+ 2024-03-08 14:01:07,656 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
400
+ 2024-03-08 14:01:07,696 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
401
+ 2024-03-08 14:01:12,835 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
402
+ 2024-03-08 14:01:17,836 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
403
+ 2024-03-08 14:01:21,426 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
404
+ 2024-03-08 14:01:21,428 DEBUG SenderThread:37167 [sender.py:send():378] send: history
405
+ 2024-03-08 14:01:21,428 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
406
+ 2024-03-08 14:01:21,429 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
407
+ 2024-03-08 14:01:22,216 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
408
+ 2024-03-08 14:01:22,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
409
+ 2024-03-08 14:01:22,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
410
+ 2024-03-08 14:01:22,806 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
411
+ 2024-03-08 14:01:23,007 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
412
+ 2024-03-08 14:01:28,008 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
413
+ 2024-03-08 14:01:33,010 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
414
+ 2024-03-08 14:01:37,188 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
415
+ 2024-03-08 14:01:37,803 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
416
+ 2024-03-08 14:01:37,804 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
417
+ 2024-03-08 14:01:37,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
418
+ 2024-03-08 14:01:38,021 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
419
+ 2024-03-08 14:01:43,022 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb CHANGED
Binary files a/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb and b/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb differ