kertob commited on
Commit
c5e8cd9
1 Parent(s): a4cf05b

Training in progress, step 110

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:079d947ec94dea77f6d5345419779f4de30d94eb8a91c8951f5b0882e1ab7edf
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da052247fb87db66508319e513c5212cd5d5ca6cc1a7e7f7ab1e73d004efaecf
3
  size 261131840
runs/Mar08_13-48-53_4997a2709b0f/events.out.tfevents.1709905734.4997a2709b0f.35964.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a60d899a24f7a5ec3d3b5d87f7f89c1c8bc9466574801991e8c0341807526fd3
3
- size 7802
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61b6c277f36bcdf41b5f01f389eeb349ab7118aaf9d55729b92ddb85fb4c1fbc
3
+ size 8009
wandb/debug-internal.log CHANGED
@@ -504,3 +504,57 @@
504
  2024-03-08 14:04:37,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
505
  2024-03-08 14:04:41,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
506
  2024-03-08 14:04:46,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
504
  2024-03-08 14:04:37,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
505
  2024-03-08 14:04:41,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
506
  2024-03-08 14:04:46,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
507
+ 2024-03-08 14:04:51,111 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
508
+ 2024-03-08 14:04:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
509
+ 2024-03-08 14:04:52,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
510
+ 2024-03-08 14:04:52,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
511
+ 2024-03-08 14:04:57,104 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
512
+ 2024-03-08 14:05:02,105 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
513
+ 2024-03-08 14:05:07,106 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
514
+ 2024-03-08 14:05:07,195 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
515
+ 2024-03-08 14:05:07,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
516
+ 2024-03-08 14:05:07,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
517
+ 2024-03-08 14:05:07,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
518
+ 2024-03-08 14:05:13,031 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
519
+ 2024-03-08 14:05:18,032 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
520
+ 2024-03-08 14:05:22,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
521
+ 2024-03-08 14:05:22,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
522
+ 2024-03-08 14:05:22,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
523
+ 2024-03-08 14:05:23,061 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
524
+ 2024-03-08 14:05:28,062 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
525
+ 2024-03-08 14:05:33,063 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
526
+ 2024-03-08 14:05:37,195 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
527
+ 2024-03-08 14:05:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
528
+ 2024-03-08 14:05:37,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
529
+ 2024-03-08 14:05:37,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
530
+ 2024-03-08 14:05:38,324 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
531
+ 2024-03-08 14:05:43,325 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
532
+ 2024-03-08 14:05:48,326 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
533
+ 2024-03-08 14:05:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
534
+ 2024-03-08 14:05:52,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
535
+ 2024-03-08 14:05:52,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
536
+ 2024-03-08 14:05:53,998 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
537
+ 2024-03-08 14:05:58,999 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
538
+ 2024-03-08 14:06:04,000 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
539
+ 2024-03-08 14:06:07,196 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
540
+ 2024-03-08 14:06:07,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
541
+ 2024-03-08 14:06:07,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
542
+ 2024-03-08 14:06:07,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
543
+ 2024-03-08 14:06:08,229 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
544
+ 2024-03-08 14:06:08,230 DEBUG SenderThread:37167 [sender.py:send():378] send: history
545
+ 2024-03-08 14:06:08,231 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
546
+ 2024-03-08 14:06:08,231 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
547
+ 2024-03-08 14:06:08,326 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
548
+ 2024-03-08 14:06:09,232 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
549
+ 2024-03-08 14:06:14,233 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
550
+ 2024-03-08 14:06:19,234 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
551
+ 2024-03-08 14:06:22,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
552
+ 2024-03-08 14:06:22,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
553
+ 2024-03-08 14:06:22,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
554
+ 2024-03-08 14:06:24,469 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
555
+ 2024-03-08 14:06:29,470 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
556
+ 2024-03-08 14:06:34,471 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
557
+ 2024-03-08 14:06:37,197 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
558
+ 2024-03-08 14:06:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
559
+ 2024-03-08 14:06:37,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
560
+ 2024-03-08 14:06:37,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.2186, "train/grad_norm": 0.9412707686424255, "train/learning_rate": 5.242811110572242e-05, "train/epoch": 8.0, "train/global_step": 100, "_timestamp": 1709906670.6863587, "_runtime": 929.2660617828369, "_step": 9}
 
1
+ {"train/loss": 0.2003, "train/grad_norm": 0.5707725882530212, "train/learning_rate": 4.434430869023579e-05, "train/epoch": 8.8, "train/global_step": 110, "_timestamp": 1709906768.2287428, "_runtime": 1026.808445930481, "_step": 10}
wandb/run-20240308_134901-hlg2f18u/logs/debug-internal.log CHANGED
@@ -504,3 +504,57 @@
504
  2024-03-08 14:04:37,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
505
  2024-03-08 14:04:41,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
506
  2024-03-08 14:04:46,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
504
  2024-03-08 14:04:37,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
505
  2024-03-08 14:04:41,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
506
  2024-03-08 14:04:46,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
507
+ 2024-03-08 14:04:51,111 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
508
+ 2024-03-08 14:04:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
509
+ 2024-03-08 14:04:52,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
510
+ 2024-03-08 14:04:52,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
511
+ 2024-03-08 14:04:57,104 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
512
+ 2024-03-08 14:05:02,105 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
513
+ 2024-03-08 14:05:07,106 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
514
+ 2024-03-08 14:05:07,195 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
515
+ 2024-03-08 14:05:07,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
516
+ 2024-03-08 14:05:07,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
517
+ 2024-03-08 14:05:07,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
518
+ 2024-03-08 14:05:13,031 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
519
+ 2024-03-08 14:05:18,032 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
520
+ 2024-03-08 14:05:22,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
521
+ 2024-03-08 14:05:22,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
522
+ 2024-03-08 14:05:22,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
523
+ 2024-03-08 14:05:23,061 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
524
+ 2024-03-08 14:05:28,062 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
525
+ 2024-03-08 14:05:33,063 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
526
+ 2024-03-08 14:05:37,195 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
527
+ 2024-03-08 14:05:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
528
+ 2024-03-08 14:05:37,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
529
+ 2024-03-08 14:05:37,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
530
+ 2024-03-08 14:05:38,324 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
531
+ 2024-03-08 14:05:43,325 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
532
+ 2024-03-08 14:05:48,326 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
533
+ 2024-03-08 14:05:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
534
+ 2024-03-08 14:05:52,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
535
+ 2024-03-08 14:05:52,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
536
+ 2024-03-08 14:05:53,998 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
537
+ 2024-03-08 14:05:58,999 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
538
+ 2024-03-08 14:06:04,000 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
539
+ 2024-03-08 14:06:07,196 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
540
+ 2024-03-08 14:06:07,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
541
+ 2024-03-08 14:06:07,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
542
+ 2024-03-08 14:06:07,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
543
+ 2024-03-08 14:06:08,229 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
544
+ 2024-03-08 14:06:08,230 DEBUG SenderThread:37167 [sender.py:send():378] send: history
545
+ 2024-03-08 14:06:08,231 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
546
+ 2024-03-08 14:06:08,231 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
547
+ 2024-03-08 14:06:08,326 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
548
+ 2024-03-08 14:06:09,232 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
549
+ 2024-03-08 14:06:14,233 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
550
+ 2024-03-08 14:06:19,234 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
551
+ 2024-03-08 14:06:22,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
552
+ 2024-03-08 14:06:22,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
553
+ 2024-03-08 14:06:22,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
554
+ 2024-03-08 14:06:24,469 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
555
+ 2024-03-08 14:06:29,470 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
556
+ 2024-03-08 14:06:34,471 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
557
+ 2024-03-08 14:06:37,197 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
558
+ 2024-03-08 14:06:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
559
+ 2024-03-08 14:06:37,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
560
+ 2024-03-08 14:06:37,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb CHANGED
Binary files a/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb and b/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb differ