kertob commited on
Commit
2f0da9c
1 Parent(s): c5e8cd9

Training in progress, step 120

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:da052247fb87db66508319e513c5212cd5d5ca6cc1a7e7f7ab1e73d004efaecf
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bda6d4ffc8b1eebfd73b5c4bf9b72ee031731524c652667f0eff4c106821a633
3
  size 261131840
runs/Mar08_13-48-53_4997a2709b0f/events.out.tfevents.1709905734.4997a2709b0f.35964.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61b6c277f36bcdf41b5f01f389eeb349ab7118aaf9d55729b92ddb85fb4c1fbc
3
- size 8009
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25d7c6231d6c6be46390c01ee54ba2de08c3373feb93f6656a2b3d09b789842f
3
+ size 8216
wandb/debug-internal.log CHANGED
@@ -558,3 +558,46 @@
558
  2024-03-08 14:06:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
559
  2024-03-08 14:06:37,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
560
  2024-03-08 14:06:37,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
558
  2024-03-08 14:06:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
559
  2024-03-08 14:06:37,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
560
  2024-03-08 14:06:37,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
561
+ 2024-03-08 14:06:40,085 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
562
+ 2024-03-08 14:06:45,086 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
563
+ 2024-03-08 14:06:50,087 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
564
+ 2024-03-08 14:06:52,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
565
+ 2024-03-08 14:06:52,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
566
+ 2024-03-08 14:06:52,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
567
+ 2024-03-08 14:06:55,974 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
568
+ 2024-03-08 14:07:00,976 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
569
+ 2024-03-08 14:07:05,976 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
570
+ 2024-03-08 14:07:07,198 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
571
+ 2024-03-08 14:07:07,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
572
+ 2024-03-08 14:07:07,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
573
+ 2024-03-08 14:07:07,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
574
+ 2024-03-08 14:07:11,047 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
575
+ 2024-03-08 14:07:16,048 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
576
+ 2024-03-08 14:07:21,049 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
577
+ 2024-03-08 14:07:22,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
578
+ 2024-03-08 14:07:22,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
579
+ 2024-03-08 14:07:22,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
580
+ 2024-03-08 14:07:27,035 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
581
+ 2024-03-08 14:07:32,036 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
582
+ 2024-03-08 14:07:37,037 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
583
+ 2024-03-08 14:07:37,198 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
584
+ 2024-03-08 14:07:37,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
585
+ 2024-03-08 14:07:37,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
586
+ 2024-03-08 14:07:37,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
587
+ 2024-03-08 14:07:43,025 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
588
+ 2024-03-08 14:07:43,356 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
589
+ 2024-03-08 14:07:43,358 DEBUG SenderThread:37167 [sender.py:send():378] send: history
590
+ 2024-03-08 14:07:43,358 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
591
+ 2024-03-08 14:07:43,359 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
592
+ 2024-03-08 14:07:43,363 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
593
+ 2024-03-08 14:07:48,360 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
594
+ 2024-03-08 14:07:52,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
595
+ 2024-03-08 14:07:52,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
596
+ 2024-03-08 14:07:52,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
597
+ 2024-03-08 14:07:54,095 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
598
+ 2024-03-08 14:07:59,096 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
599
+ 2024-03-08 14:08:04,097 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
600
+ 2024-03-08 14:08:07,199 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
601
+ 2024-03-08 14:08:07,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
602
+ 2024-03-08 14:08:07,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
603
+ 2024-03-08 14:08:07,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.2003, "train/grad_norm": 0.5707725882530212, "train/learning_rate": 4.434430869023579e-05, "train/epoch": 8.8, "train/global_step": 110, "_timestamp": 1709906768.2287428, "_runtime": 1026.808445930481, "_step": 10}
 
1
+ {"train/loss": 0.1857, "train/grad_norm": 0.6209361553192139, "train/learning_rate": 3.640849638818286e-05, "train/epoch": 9.6, "train/global_step": 120, "_timestamp": 1709906863.356232, "_runtime": 1121.9359350204468, "_step": 11}
wandb/run-20240308_134901-hlg2f18u/logs/debug-internal.log CHANGED
@@ -558,3 +558,46 @@
558
  2024-03-08 14:06:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
559
  2024-03-08 14:06:37,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
560
  2024-03-08 14:06:37,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
558
  2024-03-08 14:06:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
559
  2024-03-08 14:06:37,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
560
  2024-03-08 14:06:37,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
561
+ 2024-03-08 14:06:40,085 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
562
+ 2024-03-08 14:06:45,086 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
563
+ 2024-03-08 14:06:50,087 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
564
+ 2024-03-08 14:06:52,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
565
+ 2024-03-08 14:06:52,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
566
+ 2024-03-08 14:06:52,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
567
+ 2024-03-08 14:06:55,974 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
568
+ 2024-03-08 14:07:00,976 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
569
+ 2024-03-08 14:07:05,976 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
570
+ 2024-03-08 14:07:07,198 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
571
+ 2024-03-08 14:07:07,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
572
+ 2024-03-08 14:07:07,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
573
+ 2024-03-08 14:07:07,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
574
+ 2024-03-08 14:07:11,047 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
575
+ 2024-03-08 14:07:16,048 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
576
+ 2024-03-08 14:07:21,049 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
577
+ 2024-03-08 14:07:22,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
578
+ 2024-03-08 14:07:22,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
579
+ 2024-03-08 14:07:22,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
580
+ 2024-03-08 14:07:27,035 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
581
+ 2024-03-08 14:07:32,036 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
582
+ 2024-03-08 14:07:37,037 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
583
+ 2024-03-08 14:07:37,198 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
584
+ 2024-03-08 14:07:37,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
585
+ 2024-03-08 14:07:37,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
586
+ 2024-03-08 14:07:37,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
587
+ 2024-03-08 14:07:43,025 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
588
+ 2024-03-08 14:07:43,356 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
589
+ 2024-03-08 14:07:43,358 DEBUG SenderThread:37167 [sender.py:send():378] send: history
590
+ 2024-03-08 14:07:43,358 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
591
+ 2024-03-08 14:07:43,359 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
592
+ 2024-03-08 14:07:43,363 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
593
+ 2024-03-08 14:07:48,360 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
594
+ 2024-03-08 14:07:52,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
595
+ 2024-03-08 14:07:52,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
596
+ 2024-03-08 14:07:52,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
597
+ 2024-03-08 14:07:54,095 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
598
+ 2024-03-08 14:07:59,096 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
599
+ 2024-03-08 14:08:04,097 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
600
+ 2024-03-08 14:08:07,199 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
601
+ 2024-03-08 14:08:07,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
602
+ 2024-03-08 14:08:07,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
603
+ 2024-03-08 14:08:07,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb CHANGED
Binary files a/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb and b/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb differ