kertob commited on
Commit
a4cf05b
1 Parent(s): 5258762

Training in progress, step 100

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:133efd191748a04f73604a4ca37ab1480ac1f0d474c7a9b5db5fa9299a0d240a
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:079d947ec94dea77f6d5345419779f4de30d94eb8a91c8951f5b0882e1ab7edf
3
  size 261131840
runs/Mar08_13-48-53_4997a2709b0f/events.out.tfevents.1709905734.4997a2709b0f.35964.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9e6585a4a33f921b3c2f96435a8ce79c937d5c6934b80e6499db4767b2eaff34
3
- size 7595
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a60d899a24f7a5ec3d3b5d87f7f89c1c8bc9466574801991e8c0341807526fd3
3
+ size 7802
wandb/debug-internal.log CHANGED
@@ -460,3 +460,47 @@
460
  2024-03-08 14:03:07,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
461
  2024-03-08 14:03:07,806 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
462
  2024-03-08 14:03:12,003 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
460
  2024-03-08 14:03:07,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
461
  2024-03-08 14:03:07,806 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
462
  2024-03-08 14:03:12,003 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
463
+ 2024-03-08 14:03:17,004 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
464
+ 2024-03-08 14:03:22,005 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
465
+ 2024-03-08 14:03:22,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
466
+ 2024-03-08 14:03:22,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
467
+ 2024-03-08 14:03:22,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
468
+ 2024-03-08 14:03:27,229 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
469
+ 2024-03-08 14:03:32,230 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
470
+ 2024-03-08 14:03:37,198 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
471
+ 2024-03-08 14:03:37,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
472
+ 2024-03-08 14:03:37,812 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
473
+ 2024-03-08 14:03:37,852 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
474
+ 2024-03-08 14:03:38,060 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
475
+ 2024-03-08 14:03:43,061 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
476
+ 2024-03-08 14:03:48,062 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
477
+ 2024-03-08 14:03:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
478
+ 2024-03-08 14:03:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
479
+ 2024-03-08 14:03:52,811 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
480
+ 2024-03-08 14:03:53,098 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
481
+ 2024-03-08 14:03:58,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
482
+ 2024-03-08 14:04:03,100 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
483
+ 2024-03-08 14:04:07,192 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
484
+ 2024-03-08 14:04:07,810 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
485
+ 2024-03-08 14:04:07,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
486
+ 2024-03-08 14:04:07,812 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
487
+ 2024-03-08 14:04:09,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
488
+ 2024-03-08 14:04:14,100 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
489
+ 2024-03-08 14:04:19,101 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
490
+ 2024-03-08 14:04:22,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
491
+ 2024-03-08 14:04:22,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
492
+ 2024-03-08 14:04:22,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
493
+ 2024-03-08 14:04:25,051 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
494
+ 2024-03-08 14:04:30,052 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
495
+ 2024-03-08 14:04:30,686 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
496
+ 2024-03-08 14:04:30,688 DEBUG SenderThread:37167 [sender.py:send():378] send: history
497
+ 2024-03-08 14:04:30,688 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
498
+ 2024-03-08 14:04:30,690 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
499
+ 2024-03-08 14:04:31,288 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
500
+ 2024-03-08 14:04:35,691 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
501
+ 2024-03-08 14:04:37,193 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
502
+ 2024-03-08 14:04:37,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
503
+ 2024-03-08 14:04:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
504
+ 2024-03-08 14:04:37,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
505
+ 2024-03-08 14:04:41,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
506
+ 2024-03-08 14:04:46,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.2518, "train/grad_norm": 0.5438580513000488, "train/learning_rate": 6.044837815156377e-05, "train/epoch": 7.2, "train/global_step": 90, "_timestamp": 1709906577.0865047, "_runtime": 835.6662077903748, "_step": 8}
 
1
+ {"train/loss": 0.2186, "train/grad_norm": 0.9412707686424255, "train/learning_rate": 5.242811110572242e-05, "train/epoch": 8.0, "train/global_step": 100, "_timestamp": 1709906670.6863587, "_runtime": 929.2660617828369, "_step": 9}
wandb/run-20240308_134901-hlg2f18u/logs/debug-internal.log CHANGED
@@ -460,3 +460,47 @@
460
  2024-03-08 14:03:07,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
461
  2024-03-08 14:03:07,806 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
462
  2024-03-08 14:03:12,003 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
460
  2024-03-08 14:03:07,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
461
  2024-03-08 14:03:07,806 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
462
  2024-03-08 14:03:12,003 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
463
+ 2024-03-08 14:03:17,004 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
464
+ 2024-03-08 14:03:22,005 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
465
+ 2024-03-08 14:03:22,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
466
+ 2024-03-08 14:03:22,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
467
+ 2024-03-08 14:03:22,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
468
+ 2024-03-08 14:03:27,229 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
469
+ 2024-03-08 14:03:32,230 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
470
+ 2024-03-08 14:03:37,198 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
471
+ 2024-03-08 14:03:37,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
472
+ 2024-03-08 14:03:37,812 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
473
+ 2024-03-08 14:03:37,852 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
474
+ 2024-03-08 14:03:38,060 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
475
+ 2024-03-08 14:03:43,061 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
476
+ 2024-03-08 14:03:48,062 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
477
+ 2024-03-08 14:03:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
478
+ 2024-03-08 14:03:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
479
+ 2024-03-08 14:03:52,811 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
480
+ 2024-03-08 14:03:53,098 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
481
+ 2024-03-08 14:03:58,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
482
+ 2024-03-08 14:04:03,100 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
483
+ 2024-03-08 14:04:07,192 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
484
+ 2024-03-08 14:04:07,810 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
485
+ 2024-03-08 14:04:07,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
486
+ 2024-03-08 14:04:07,812 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
487
+ 2024-03-08 14:04:09,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
488
+ 2024-03-08 14:04:14,100 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
489
+ 2024-03-08 14:04:19,101 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
490
+ 2024-03-08 14:04:22,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
491
+ 2024-03-08 14:04:22,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
492
+ 2024-03-08 14:04:22,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
493
+ 2024-03-08 14:04:25,051 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
494
+ 2024-03-08 14:04:30,052 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
495
+ 2024-03-08 14:04:30,686 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
496
+ 2024-03-08 14:04:30,688 DEBUG SenderThread:37167 [sender.py:send():378] send: history
497
+ 2024-03-08 14:04:30,688 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
498
+ 2024-03-08 14:04:30,690 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
499
+ 2024-03-08 14:04:31,288 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
500
+ 2024-03-08 14:04:35,691 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
501
+ 2024-03-08 14:04:37,193 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
502
+ 2024-03-08 14:04:37,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
503
+ 2024-03-08 14:04:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
504
+ 2024-03-08 14:04:37,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
505
+ 2024-03-08 14:04:41,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
506
+ 2024-03-08 14:04:46,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb CHANGED
Binary files a/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb and b/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb differ