kertob commited on
Commit
5258762
1 Parent(s): d95ee88

Training in progress, step 90

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:abb174e7051e7123e8a1f799d8bc50c50f81bfa5d7d44be2837c4f8330113226
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:133efd191748a04f73604a4ca37ab1480ac1f0d474c7a9b5db5fa9299a0d240a
3
  size 261131840
runs/Mar08_13-48-53_4997a2709b0f/events.out.tfevents.1709905734.4997a2709b0f.35964.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:63df73605e69c21a5d850966d6e998b0530337493116e3e0fe4647f6cfe1c880
3
- size 7388
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e6585a4a33f921b3c2f96435a8ce79c937d5c6934b80e6499db4767b2eaff34
3
+ size 7595
wandb/debug-internal.log CHANGED
@@ -417,3 +417,46 @@
417
  2024-03-08 14:01:37,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
418
  2024-03-08 14:01:38,021 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
419
  2024-03-08 14:01:43,022 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
417
  2024-03-08 14:01:37,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
418
  2024-03-08 14:01:38,021 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
419
  2024-03-08 14:01:43,022 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
420
+ 2024-03-08 14:01:48,023 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
421
+ 2024-03-08 14:01:52,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
422
+ 2024-03-08 14:01:52,804 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
423
+ 2024-03-08 14:01:52,844 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
424
+ 2024-03-08 14:01:54,321 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
425
+ 2024-03-08 14:01:59,322 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
426
+ 2024-03-08 14:02:04,323 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
427
+ 2024-03-08 14:02:07,189 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
428
+ 2024-03-08 14:02:07,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
429
+ 2024-03-08 14:02:07,804 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
430
+ 2024-03-08 14:02:07,844 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
431
+ 2024-03-08 14:02:10,091 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
432
+ 2024-03-08 14:02:15,092 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
433
+ 2024-03-08 14:02:20,093 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
434
+ 2024-03-08 14:02:22,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
435
+ 2024-03-08 14:02:22,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
436
+ 2024-03-08 14:02:22,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
437
+ 2024-03-08 14:02:25,388 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
438
+ 2024-03-08 14:02:30,390 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
439
+ 2024-03-08 14:02:35,391 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
440
+ 2024-03-08 14:02:37,190 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
441
+ 2024-03-08 14:02:37,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
442
+ 2024-03-08 14:02:37,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
443
+ 2024-03-08 14:02:37,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
444
+ 2024-03-08 14:02:41,023 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
445
+ 2024-03-08 14:02:46,024 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
446
+ 2024-03-08 14:02:51,025 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
447
+ 2024-03-08 14:02:52,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
448
+ 2024-03-08 14:02:52,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
449
+ 2024-03-08 14:02:52,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
450
+ 2024-03-08 14:02:56,052 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
451
+ 2024-03-08 14:02:57,087 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
452
+ 2024-03-08 14:02:57,088 DEBUG SenderThread:37167 [sender.py:send():378] send: history
453
+ 2024-03-08 14:02:57,088 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
454
+ 2024-03-08 14:02:57,089 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
455
+ 2024-03-08 14:02:57,252 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
456
+ 2024-03-08 14:03:01,090 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
457
+ 2024-03-08 14:03:06,091 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
458
+ 2024-03-08 14:03:07,191 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
459
+ 2024-03-08 14:03:07,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
460
+ 2024-03-08 14:03:07,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
461
+ 2024-03-08 14:03:07,806 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
462
+ 2024-03-08 14:03:12,003 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.2768, "train/grad_norm": 0.6020347476005554, "train/learning_rate": 6.819524684817438e-05, "train/epoch": 6.4, "train/global_step": 80, "_timestamp": 1709906481.4263425, "_runtime": 740.0060455799103, "_step": 7}
 
1
+ {"train/loss": 0.2518, "train/grad_norm": 0.5438580513000488, "train/learning_rate": 6.044837815156377e-05, "train/epoch": 7.2, "train/global_step": 90, "_timestamp": 1709906577.0865047, "_runtime": 835.6662077903748, "_step": 8}
wandb/run-20240308_134901-hlg2f18u/logs/debug-internal.log CHANGED
@@ -417,3 +417,46 @@
417
  2024-03-08 14:01:37,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
418
  2024-03-08 14:01:38,021 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
419
  2024-03-08 14:01:43,022 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
417
  2024-03-08 14:01:37,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
418
  2024-03-08 14:01:38,021 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
419
  2024-03-08 14:01:43,022 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
420
+ 2024-03-08 14:01:48,023 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
421
+ 2024-03-08 14:01:52,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
422
+ 2024-03-08 14:01:52,804 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
423
+ 2024-03-08 14:01:52,844 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
424
+ 2024-03-08 14:01:54,321 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
425
+ 2024-03-08 14:01:59,322 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
426
+ 2024-03-08 14:02:04,323 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
427
+ 2024-03-08 14:02:07,189 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
428
+ 2024-03-08 14:02:07,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
429
+ 2024-03-08 14:02:07,804 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
430
+ 2024-03-08 14:02:07,844 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
431
+ 2024-03-08 14:02:10,091 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
432
+ 2024-03-08 14:02:15,092 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
433
+ 2024-03-08 14:02:20,093 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
434
+ 2024-03-08 14:02:22,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
435
+ 2024-03-08 14:02:22,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
436
+ 2024-03-08 14:02:22,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
437
+ 2024-03-08 14:02:25,388 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
438
+ 2024-03-08 14:02:30,390 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
439
+ 2024-03-08 14:02:35,391 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
440
+ 2024-03-08 14:02:37,190 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
441
+ 2024-03-08 14:02:37,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
442
+ 2024-03-08 14:02:37,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
443
+ 2024-03-08 14:02:37,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
444
+ 2024-03-08 14:02:41,023 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
445
+ 2024-03-08 14:02:46,024 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
446
+ 2024-03-08 14:02:51,025 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
447
+ 2024-03-08 14:02:52,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
448
+ 2024-03-08 14:02:52,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
449
+ 2024-03-08 14:02:52,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
450
+ 2024-03-08 14:02:56,052 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
451
+ 2024-03-08 14:02:57,087 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
452
+ 2024-03-08 14:02:57,088 DEBUG SenderThread:37167 [sender.py:send():378] send: history
453
+ 2024-03-08 14:02:57,088 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
454
+ 2024-03-08 14:02:57,089 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
455
+ 2024-03-08 14:02:57,252 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
456
+ 2024-03-08 14:03:01,090 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
457
+ 2024-03-08 14:03:06,091 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
458
+ 2024-03-08 14:03:07,191 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
459
+ 2024-03-08 14:03:07,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
460
+ 2024-03-08 14:03:07,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
461
+ 2024-03-08 14:03:07,806 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
462
+ 2024-03-08 14:03:12,003 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb CHANGED
Binary files a/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb and b/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb differ