Hugging Face's logo

rabby33
/
working

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
rabby33 commited on
Commit
51da067
•
1 Parent(s): e956d37

Model save

Browse files
Files changed (12) hide show
  1. README.md +64 -0
  2. generation_config.json +6 -0
  3. model.safetensors +1 -1
  4. runs/Feb26_09-23-32_d79522c38279/events.out.tfevents.1708939413.d79522c38279.34.5 +2 -2
  5. wandb/debug-internal.log +153 -0
  6. wandb/debug.log +3 -0
  7. wandb/run-20240226_092105-91uhs91a/files/config.yaml +20 -0
  8. wandb/run-20240226_092105-91uhs91a/files/output.log +4 -0
  9. wandb/run-20240226_092105-91uhs91a/files/wandb-summary.json +1 -1
  10. wandb/run-20240226_092105-91uhs91a/logs/debug-internal.log +153 -0
  11. wandb/run-20240226_092105-91uhs91a/logs/debug.log +3 -0
  12. wandb/run-20240226_092105-91uhs91a/run-91uhs91a.wandb +0 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: csebuetnlp/banglat5
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - bleu
7
+ model-index:
8
+ - name: working
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # working
16
+
17
+ This model is a fine-tuned version of [csebuetnlp/banglat5](https://huggingface.co/csebuetnlp/banglat5) on the None dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 1.7567
20
+ - Bleu: 16.8754
21
+ - Gen Len: 11.7975
22
+
23
+ ## Model description
24
+
25
+ More information needed
26
+
27
+ ## Intended uses & limitations
28
+
29
+ More information needed
30
+
31
+ ## Training and evaluation data
32
+
33
+ More information needed
34
+
35
+ ## Training procedure
36
+
37
+ ### Training hyperparameters
38
+
39
+ The following hyperparameters were used during training:
40
+ - learning_rate: 0.0005
41
+ - train_batch_size: 16
42
+ - eval_batch_size: 16
43
+ - seed: 42
44
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
+ - lr_scheduler_type: linear
46
+ - num_epochs: 5
47
+
48
+ ### Training results
49
+
50
+ | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
51
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|
52
+ | No log | 1.0 | 450 | 1.7403 | 14.5679 | 11.9038 |
53
+ | 2.1563 | 2.0 | 900 | 1.6685 | 15.1417 | 11.7188 |
54
+ | 1.5765 | 3.0 | 1350 | 1.6712 | 16.0438 | 11.7525 |
55
+ | 1.2297 | 4.0 | 1800 | 1.7176 | 16.9394 | 11.8238 |
56
+ | 1.0072 | 5.0 | 2250 | 1.7567 | 16.8754 | 11.7975 |
57
+
58
+
59
+ ### Framework versions
60
+
61
+ - Transformers 4.37.0
62
+ - Pytorch 1.13.1+cu117
63
+ - Datasets 2.1.0
64
+ - Tokenizers 0.15.1
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.37.0"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6fa01ed62056a0c4963040de3d44a8711f219d2509e9833786372f6566ee7e57
3
  size 990345064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38da7c5ac205db5d89d83d070f955c5906da91595557960c541d69bfe9a0bed0
3
  size 990345064
runs/Feb26_09-23-32_d79522c38279/events.out.tfevents.1708939413.d79522c38279.34.5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:66ff0d405bf89528179fb7b9cef4b925039008554ae30c44a0fb2e99ac3d114c
3
- size 6280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ee620a2acddddf46fc56ea3c92c6323da95551d181d8b277589ef7953eefdd1
3
+ size 7531
wandb/debug-internal.log CHANGED
@@ -470,3 +470,156 @@
470
  2024-02-26 09:31:02,498 DEBUG SenderThread:196 [sender.py:send():382] send: stats
471
  2024-02-26 09:31:03,372 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
472
  2024-02-26 09:31:05,499 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
470
  2024-02-26 09:31:02,498 DEBUG SenderThread:196 [sender.py:send():382] send: stats
471
  2024-02-26 09:31:03,372 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
472
  2024-02-26 09:31:05,499 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
473
+ 2024-02-26 09:31:08,378 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
474
+ 2024-02-26 09:31:10,500 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
475
+ 2024-02-26 09:31:13,379 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
476
+ 2024-02-26 09:31:15,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
477
+ 2024-02-26 09:31:18,385 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
478
+ 2024-02-26 09:31:20,502 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
479
+ 2024-02-26 09:31:23,386 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
480
+ 2024-02-26 09:31:25,503 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
481
+ 2024-02-26 09:31:28,388 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
482
+ 2024-02-26 09:31:30,504 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
483
+ 2024-02-26 09:31:32,498 DEBUG SenderThread:196 [sender.py:send():382] send: stats
484
+ 2024-02-26 09:31:33,390 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
485
+ 2024-02-26 09:31:36,500 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
486
+ 2024-02-26 09:31:38,391 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
487
+ 2024-02-26 09:31:41,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
488
+ 2024-02-26 09:31:43,392 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
489
+ 2024-02-26 09:31:46,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
490
+ 2024-02-26 09:31:48,393 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
491
+ 2024-02-26 09:31:51,502 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
492
+ 2024-02-26 09:31:53,394 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
493
+ 2024-02-26 09:31:55,626 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/output.log
494
+ 2024-02-26 09:31:56,960 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
495
+ 2024-02-26 09:31:58,395 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
496
+ 2024-02-26 09:32:01,961 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
497
+ 2024-02-26 09:32:02,499 DEBUG SenderThread:196 [sender.py:send():382] send: stats
498
+ 2024-02-26 09:32:03,396 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
499
+ 2024-02-26 09:32:07,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
500
+ 2024-02-26 09:32:08,398 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
501
+ 2024-02-26 09:32:12,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
502
+ 2024-02-26 09:32:13,419 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
503
+ 2024-02-26 09:32:17,502 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
504
+ 2024-02-26 09:32:18,456 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
505
+ 2024-02-26 09:32:19,249 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: partial_history
506
+ 2024-02-26 09:32:19,251 DEBUG SenderThread:196 [sender.py:send():382] send: history
507
+ 2024-02-26 09:32:19,251 DEBUG SenderThread:196 [sender.py:send_request():409] send_request: summary_record
508
+ 2024-02-26 09:32:19,252 INFO SenderThread:196 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
509
+ 2024-02-26 09:32:19,636 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/wandb-summary.json
510
+ 2024-02-26 09:32:23,253 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
511
+ 2024-02-26 09:32:23,472 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
512
+ 2024-02-26 09:32:28,254 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
513
+ 2024-02-26 09:32:28,475 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
514
+ 2024-02-26 09:32:32,500 DEBUG SenderThread:196 [sender.py:send():382] send: stats
515
+ 2024-02-26 09:32:33,476 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
516
+ 2024-02-26 09:32:33,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
517
+ 2024-02-26 09:32:38,477 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
518
+ 2024-02-26 09:32:38,502 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
519
+ 2024-02-26 09:32:43,478 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
520
+ 2024-02-26 09:32:43,503 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
521
+ 2024-02-26 09:32:48,479 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
522
+ 2024-02-26 09:32:48,504 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
523
+ 2024-02-26 09:32:53,481 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
524
+ 2024-02-26 09:32:53,505 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
525
+ 2024-02-26 09:32:58,482 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
526
+ 2024-02-26 09:32:58,505 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
527
+ 2024-02-26 09:33:01,315 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: partial_history
528
+ 2024-02-26 09:33:01,317 DEBUG SenderThread:196 [sender.py:send():382] send: history
529
+ 2024-02-26 09:33:01,317 DEBUG SenderThread:196 [sender.py:send_request():409] send_request: summary_record
530
+ 2024-02-26 09:33:01,317 INFO SenderThread:196 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
531
+ 2024-02-26 09:33:01,652 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/wandb-summary.json
532
+ 2024-02-26 09:33:02,501 DEBUG SenderThread:196 [sender.py:send():382] send: stats
533
+ 2024-02-26 09:33:04,296 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
534
+ 2024-02-26 09:33:04,502 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
535
+ 2024-02-26 09:33:09,307 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
536
+ 2024-02-26 09:33:09,503 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
537
+ 2024-02-26 09:33:14,308 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
538
+ 2024-02-26 09:33:14,504 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
539
+ 2024-02-26 09:33:19,309 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
540
+ 2024-02-26 09:33:19,505 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
541
+ 2024-02-26 09:33:24,312 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
542
+ 2024-02-26 09:33:24,506 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
543
+ 2024-02-26 09:33:29,313 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
544
+ 2024-02-26 09:33:29,507 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
545
+ 2024-02-26 09:33:32,502 DEBUG SenderThread:196 [sender.py:send():382] send: stats
546
+ 2024-02-26 09:33:34,314 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
547
+ 2024-02-26 09:33:35,503 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
548
+ 2024-02-26 09:33:39,315 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
549
+ 2024-02-26 09:33:40,504 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
550
+ 2024-02-26 09:33:44,317 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
551
+ 2024-02-26 09:33:45,505 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
552
+ 2024-02-26 09:33:49,318 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
553
+ 2024-02-26 09:33:50,506 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
554
+ 2024-02-26 09:33:54,319 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
555
+ 2024-02-26 09:33:55,507 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
556
+ 2024-02-26 09:33:59,320 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
557
+ 2024-02-26 09:34:00,508 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
558
+ 2024-02-26 09:34:02,503 DEBUG SenderThread:196 [sender.py:send():382] send: stats
559
+ 2024-02-26 09:34:04,321 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
560
+ 2024-02-26 09:34:06,504 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
561
+ 2024-02-26 09:34:09,322 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
562
+ 2024-02-26 09:34:11,659 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
563
+ 2024-02-26 09:34:11,678 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/output.log
564
+ 2024-02-26 09:34:14,323 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
565
+ 2024-02-26 09:34:16,660 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
566
+ 2024-02-26 09:34:19,324 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
567
+ 2024-02-26 09:34:21,661 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
568
+ 2024-02-26 09:34:24,325 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
569
+ 2024-02-26 09:34:26,662 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
570
+ 2024-02-26 09:34:29,336 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
571
+ 2024-02-26 09:34:31,663 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
572
+ 2024-02-26 09:34:32,504 DEBUG SenderThread:196 [sender.py:send():382] send: stats
573
+ 2024-02-26 09:34:34,368 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
574
+ 2024-02-26 09:34:36,005 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: partial_history
575
+ 2024-02-26 09:34:36,007 DEBUG SenderThread:196 [sender.py:send():382] send: history
576
+ 2024-02-26 09:34:36,007 DEBUG SenderThread:196 [sender.py:send_request():409] send_request: summary_record
577
+ 2024-02-26 09:34:36,007 INFO SenderThread:196 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
578
+ 2024-02-26 09:34:36,009 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: partial_history
579
+ 2024-02-26 09:34:36,011 DEBUG SenderThread:196 [sender.py:send():382] send: metric
580
+ 2024-02-26 09:34:36,011 DEBUG SenderThread:196 [sender.py:send():382] send: metric
581
+ 2024-02-26 09:34:36,011 DEBUG SenderThread:196 [sender.py:send():382] send: metric
582
+ 2024-02-26 09:34:36,012 DEBUG SenderThread:196 [sender.py:send():382] send: metric
583
+ 2024-02-26 09:34:36,012 DEBUG SenderThread:196 [sender.py:send():382] send: metric
584
+ 2024-02-26 09:34:36,012 DEBUG SenderThread:196 [sender.py:send():382] send: history
585
+ 2024-02-26 09:34:36,012 DEBUG SenderThread:196 [sender.py:send_request():409] send_request: summary_record
586
+ 2024-02-26 09:34:36,013 INFO SenderThread:196 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
587
+ 2024-02-26 09:34:36,014 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: pause
588
+ 2024-02-26 09:34:36,014 INFO HandlerThread:196 [handler.py:handle_request_pause():708] stopping system metrics thread
589
+ 2024-02-26 09:34:36,014 INFO HandlerThread:196 [system_monitor.py:finish():203] Stopping system monitor
590
+ 2024-02-26 09:34:36,015 INFO HandlerThread:196 [interfaces.py:finish():202] Joined cpu monitor
591
+ 2024-02-26 09:34:36,015 DEBUG SystemMonitor:196 [system_monitor.py:_start():179] Finished system metrics aggregation loop
592
+ 2024-02-26 09:34:36,015 INFO HandlerThread:196 [interfaces.py:finish():202] Joined disk monitor
593
+ 2024-02-26 09:34:36,016 DEBUG SystemMonitor:196 [system_monitor.py:_start():183] Publishing last batch of metrics
594
+ 2024-02-26 09:34:36,023 INFO HandlerThread:196 [interfaces.py:finish():202] Joined gpu monitor
595
+ 2024-02-26 09:34:36,023 INFO HandlerThread:196 [interfaces.py:finish():202] Joined memory monitor
596
+ 2024-02-26 09:34:36,023 INFO HandlerThread:196 [interfaces.py:finish():202] Joined network monitor
597
+ 2024-02-26 09:34:36,024 DEBUG SenderThread:196 [sender.py:send():382] send: stats
598
+ 2024-02-26 09:34:36,688 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/wandb-summary.json
599
+ 2024-02-26 09:34:37,024 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
600
+ 2024-02-26 09:34:39,379 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
601
+ 2024-02-26 09:34:42,025 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
602
+ 2024-02-26 09:34:43,927 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: resume
603
+ 2024-02-26 09:34:43,928 INFO HandlerThread:196 [handler.py:handle_request_resume():699] starting system metrics thread
604
+ 2024-02-26 09:34:43,928 INFO HandlerThread:196 [system_monitor.py:start():194] Starting system monitor
605
+ 2024-02-26 09:34:43,928 INFO SystemMonitor:196 [system_monitor.py:_start():158] Starting system asset monitoring threads
606
+ 2024-02-26 09:34:43,929 INFO SystemMonitor:196 [interfaces.py:start():190] Started cpu monitoring
607
+ 2024-02-26 09:34:43,929 INFO SystemMonitor:196 [interfaces.py:start():190] Started disk monitoring
608
+ 2024-02-26 09:34:43,930 INFO SystemMonitor:196 [interfaces.py:start():190] Started gpu monitoring
609
+ 2024-02-26 09:34:43,931 INFO SystemMonitor:196 [interfaces.py:start():190] Started memory monitoring
610
+ 2024-02-26 09:34:43,931 INFO SystemMonitor:196 [interfaces.py:start():190] Started network monitoring
611
+ 2024-02-26 09:34:44,384 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
612
+ 2024-02-26 09:34:47,026 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
613
+ 2024-02-26 09:34:49,915 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
614
+ 2024-02-26 09:34:52,027 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
615
+ 2024-02-26 09:34:54,917 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
616
+ 2024-02-26 09:34:57,033 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
617
+ 2024-02-26 09:34:57,695 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/config.yaml
618
+ 2024-02-26 09:34:59,918 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
619
+ 2024-02-26 09:35:02,160 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
620
+ 2024-02-26 09:35:04,919 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
621
+ 2024-02-26 09:35:07,160 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
622
+ 2024-02-26 09:35:09,920 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
623
+ 2024-02-26 09:35:12,161 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
624
+ 2024-02-26 09:35:14,921 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
625
+ 2024-02-26 09:35:17,163 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
wandb/debug.log CHANGED
@@ -49,3 +49,6 @@ config: {}
49
  2024-02-26 09:23:19,820 INFO MainThread:34 [wandb_init.py:_pause_backend():437] pausing backend
50
  2024-02-26 09:23:32,480 INFO MainThread:34 [wandb_init.py:_resume_backend():442] resuming backend
51
  2024-02-26 09:23:33,079 INFO MainThread:34 [wandb_run.py:_config_callback():1342] config_cb None None {'vocab_size': 32128, 'd_model': 768, 'd_kv': 64, 'd_ff': 2048, 'num_layers': 12, 'num_decoder_layers': 12, 'num_heads': 12, 'relative_attention_num_buckets': 32, 'relative_attention_max_distance': 128, 'dropout_rate': 0.1, 'classifier_dropout': 0.0, 'layer_norm_epsilon': 1e-06, 'initializer_factor': 1.0, 'feed_forward_proj': 'gated-gelu', 'use_cache': True, 'dense_act_fn': 'gelu_new', 'is_gated_act': True, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': False, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['T5ForConditionalGeneration'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': 1, 'sep_token_id': None, 'decoder_start_token_id': 0, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'csebuetnlp/banglat5', 'transformers_version': '4.37.0', 'gradient_checkpointing': False, 'model_type': 't5', 'output_past': True, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 16, 'per_device_eval_batch_size': 16, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 0.0005, 'weight_decay': 0.1, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 5, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Feb26_09-23-32_d79522c38279', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 3, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': None, 'generation_num_beams': None, 'generation_config': None}
 
 
 
 
49
  2024-02-26 09:23:19,820 INFO MainThread:34 [wandb_init.py:_pause_backend():437] pausing backend
50
  2024-02-26 09:23:32,480 INFO MainThread:34 [wandb_init.py:_resume_backend():442] resuming backend
51
  2024-02-26 09:23:33,079 INFO MainThread:34 [wandb_run.py:_config_callback():1342] config_cb None None {'vocab_size': 32128, 'd_model': 768, 'd_kv': 64, 'd_ff': 2048, 'num_layers': 12, 'num_decoder_layers': 12, 'num_heads': 12, 'relative_attention_num_buckets': 32, 'relative_attention_max_distance': 128, 'dropout_rate': 0.1, 'classifier_dropout': 0.0, 'layer_norm_epsilon': 1e-06, 'initializer_factor': 1.0, 'feed_forward_proj': 'gated-gelu', 'use_cache': True, 'dense_act_fn': 'gelu_new', 'is_gated_act': True, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': False, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['T5ForConditionalGeneration'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': 1, 'sep_token_id': None, 'decoder_start_token_id': 0, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'csebuetnlp/banglat5', 'transformers_version': '4.37.0', 'gradient_checkpointing': False, 'model_type': 't5', 'output_past': True, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 16, 'per_device_eval_batch_size': 16, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 0.0005, 'weight_decay': 0.1, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 5, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Feb26_09-23-32_d79522c38279', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 3, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': None, 'generation_num_beams': None, 'generation_config': None}
52
+ 2024-02-26 09:34:36,014 INFO MainThread:34 [jupyter.py:save_ipynb():373] not saving jupyter notebook
53
+ 2024-02-26 09:34:36,014 INFO MainThread:34 [wandb_init.py:_pause_backend():437] pausing backend
54
+ 2024-02-26 09:34:43,927 INFO MainThread:34 [wandb_init.py:_resume_backend():442] resuming backend
wandb/run-20240226_092105-91uhs91a/files/config.yaml CHANGED
@@ -92,6 +92,26 @@ _wandb:
92
  5: 1
93
  6:
94
  - 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
95
  vocab_size:
96
  desc: null
97
  value: 32128
 
92
  5: 1
93
  6:
94
  - 1
95
+ - 1: train/train_runtime
96
+ 5: 1
97
+ 6:
98
+ - 1
99
+ - 1: train/train_samples_per_second
100
+ 5: 1
101
+ 6:
102
+ - 1
103
+ - 1: train/train_steps_per_second
104
+ 5: 1
105
+ 6:
106
+ - 1
107
+ - 1: train/total_flos
108
+ 5: 1
109
+ 6:
110
+ - 1
111
+ - 1: train/train_loss
112
+ 5: 1
113
+ 6:
114
+ - 1
115
  vocab_size:
116
  desc: null
117
  value: 32128
wandb/run-20240226_092105-91uhs91a/files/output.log CHANGED
@@ -1,3 +1,7 @@
 
 
 
 
1
  /opt/conda/lib/python3.10/site-packages/transformers/generation/utils.py:1128: UserWarning: Using the model-agnostic default `max_length` (=20) to control the generation length. We recommend setting `max_new_tokens` to control the maximum length of the generation.
2
  warnings.warn(
3
  /opt/conda/lib/python3.10/site-packages/transformers/generation/utils.py:1128: UserWarning: Using the model-agnostic default `max_length` (=20) to control the generation length. We recommend setting `max_new_tokens` to control the maximum length of the generation.
 
1
+ /opt/conda/lib/python3.10/site-packages/transformers/generation/utils.py:1128: UserWarning: Using the model-agnostic default `max_length` (=20) to control the generation length. We recommend setting `max_new_tokens` to control the maximum length of the generation.
2
+ warnings.warn(
3
+ /opt/conda/lib/python3.10/site-packages/transformers/generation/utils.py:1128: UserWarning: Using the model-agnostic default `max_length` (=20) to control the generation length. We recommend setting `max_new_tokens` to control the maximum length of the generation.
4
+ warnings.warn(
5
  /opt/conda/lib/python3.10/site-packages/transformers/generation/utils.py:1128: UserWarning: Using the model-agnostic default `max_length` (=20) to control the generation length. We recommend setting `max_new_tokens` to control the maximum length of the generation.
6
  warnings.warn(
7
  /opt/conda/lib/python3.10/site-packages/transformers/generation/utils.py:1128: UserWarning: Using the model-agnostic default `max_length` (=20) to control the generation length. We recommend setting `max_new_tokens` to control the maximum length of the generation.
wandb/run-20240226_092105-91uhs91a/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"eval/loss": 1.6712268590927124, "eval/bleu": 16.0438, "eval/gen_len": 11.7525, "eval/runtime": 26.0944, "eval/samples_per_second": 30.658, "eval/steps_per_second": 1.916, "train/epoch": 3.33, "train/global_step": 1500, "_timestamp": 1708939833.4617436, "_runtime": 567.9294855594635, "_step": 5, "train/loss": 1.2297, "train/learning_rate": 0.00016666666666666666}
 
1
+ {"eval/loss": 1.756656289100647, "eval/bleu": 16.8754, "eval/gen_len": 11.7975, "eval/runtime": 26.3625, "eval/samples_per_second": 30.346, "eval/steps_per_second": 1.897, "train/epoch": 5.0, "train/global_step": 2250, "_timestamp": 1708940076.0092342, "_runtime": 810.4769761562347, "_step": 9, "train/loss": 1.0072, "train/learning_rate": 5.555555555555555e-05, "train/train_runtime": 662.9427, "train/train_samples_per_second": 54.303, "train/train_steps_per_second": 3.394, "train/total_flos": 1551274984636416.0, "train/train_loss": 1.4285807630750869}
wandb/run-20240226_092105-91uhs91a/logs/debug-internal.log CHANGED
@@ -470,3 +470,156 @@
470
  2024-02-26 09:31:02,498 DEBUG SenderThread:196 [sender.py:send():382] send: stats
471
  2024-02-26 09:31:03,372 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
472
  2024-02-26 09:31:05,499 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
470
  2024-02-26 09:31:02,498 DEBUG SenderThread:196 [sender.py:send():382] send: stats
471
  2024-02-26 09:31:03,372 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
472
  2024-02-26 09:31:05,499 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
473
+ 2024-02-26 09:31:08,378 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
474
+ 2024-02-26 09:31:10,500 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
475
+ 2024-02-26 09:31:13,379 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
476
+ 2024-02-26 09:31:15,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
477
+ 2024-02-26 09:31:18,385 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
478
+ 2024-02-26 09:31:20,502 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
479
+ 2024-02-26 09:31:23,386 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
480
+ 2024-02-26 09:31:25,503 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
481
+ 2024-02-26 09:31:28,388 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
482
+ 2024-02-26 09:31:30,504 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
483
+ 2024-02-26 09:31:32,498 DEBUG SenderThread:196 [sender.py:send():382] send: stats
484
+ 2024-02-26 09:31:33,390 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
485
+ 2024-02-26 09:31:36,500 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
486
+ 2024-02-26 09:31:38,391 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
487
+ 2024-02-26 09:31:41,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
488
+ 2024-02-26 09:31:43,392 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
489
+ 2024-02-26 09:31:46,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
490
+ 2024-02-26 09:31:48,393 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
491
+ 2024-02-26 09:31:51,502 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
492
+ 2024-02-26 09:31:53,394 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
493
+ 2024-02-26 09:31:55,626 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/output.log
494
+ 2024-02-26 09:31:56,960 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
495
+ 2024-02-26 09:31:58,395 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
496
+ 2024-02-26 09:32:01,961 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
497
+ 2024-02-26 09:32:02,499 DEBUG SenderThread:196 [sender.py:send():382] send: stats
498
+ 2024-02-26 09:32:03,396 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
499
+ 2024-02-26 09:32:07,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
500
+ 2024-02-26 09:32:08,398 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
501
+ 2024-02-26 09:32:12,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
502
+ 2024-02-26 09:32:13,419 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
503
+ 2024-02-26 09:32:17,502 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
504
+ 2024-02-26 09:32:18,456 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
505
+ 2024-02-26 09:32:19,249 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: partial_history
506
+ 2024-02-26 09:32:19,251 DEBUG SenderThread:196 [sender.py:send():382] send: history
507
+ 2024-02-26 09:32:19,251 DEBUG SenderThread:196 [sender.py:send_request():409] send_request: summary_record
508
+ 2024-02-26 09:32:19,252 INFO SenderThread:196 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
509
+ 2024-02-26 09:32:19,636 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/wandb-summary.json
510
+ 2024-02-26 09:32:23,253 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
511
+ 2024-02-26 09:32:23,472 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
512
+ 2024-02-26 09:32:28,254 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
513
+ 2024-02-26 09:32:28,475 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
514
+ 2024-02-26 09:32:32,500 DEBUG SenderThread:196 [sender.py:send():382] send: stats
515
+ 2024-02-26 09:32:33,476 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
516
+ 2024-02-26 09:32:33,501 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
517
+ 2024-02-26 09:32:38,477 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
518
+ 2024-02-26 09:32:38,502 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
519
+ 2024-02-26 09:32:43,478 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
520
+ 2024-02-26 09:32:43,503 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
521
+ 2024-02-26 09:32:48,479 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
522
+ 2024-02-26 09:32:48,504 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
523
+ 2024-02-26 09:32:53,481 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
524
+ 2024-02-26 09:32:53,505 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
525
+ 2024-02-26 09:32:58,482 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
526
+ 2024-02-26 09:32:58,505 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
527
+ 2024-02-26 09:33:01,315 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: partial_history
528
+ 2024-02-26 09:33:01,317 DEBUG SenderThread:196 [sender.py:send():382] send: history
529
+ 2024-02-26 09:33:01,317 DEBUG SenderThread:196 [sender.py:send_request():409] send_request: summary_record
530
+ 2024-02-26 09:33:01,317 INFO SenderThread:196 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
531
+ 2024-02-26 09:33:01,652 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/wandb-summary.json
532
+ 2024-02-26 09:33:02,501 DEBUG SenderThread:196 [sender.py:send():382] send: stats
533
+ 2024-02-26 09:33:04,296 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
534
+ 2024-02-26 09:33:04,502 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
535
+ 2024-02-26 09:33:09,307 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
536
+ 2024-02-26 09:33:09,503 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
537
+ 2024-02-26 09:33:14,308 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
538
+ 2024-02-26 09:33:14,504 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
539
+ 2024-02-26 09:33:19,309 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
540
+ 2024-02-26 09:33:19,505 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
541
+ 2024-02-26 09:33:24,312 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
542
+ 2024-02-26 09:33:24,506 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
543
+ 2024-02-26 09:33:29,313 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
544
+ 2024-02-26 09:33:29,507 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
545
+ 2024-02-26 09:33:32,502 DEBUG SenderThread:196 [sender.py:send():382] send: stats
546
+ 2024-02-26 09:33:34,314 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
547
+ 2024-02-26 09:33:35,503 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
548
+ 2024-02-26 09:33:39,315 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
549
+ 2024-02-26 09:33:40,504 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
550
+ 2024-02-26 09:33:44,317 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
551
+ 2024-02-26 09:33:45,505 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
552
+ 2024-02-26 09:33:49,318 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
553
+ 2024-02-26 09:33:50,506 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
554
+ 2024-02-26 09:33:54,319 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
555
+ 2024-02-26 09:33:55,507 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
556
+ 2024-02-26 09:33:59,320 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
557
+ 2024-02-26 09:34:00,508 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
558
+ 2024-02-26 09:34:02,503 DEBUG SenderThread:196 [sender.py:send():382] send: stats
559
+ 2024-02-26 09:34:04,321 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
560
+ 2024-02-26 09:34:06,504 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
561
+ 2024-02-26 09:34:09,322 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
562
+ 2024-02-26 09:34:11,659 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
563
+ 2024-02-26 09:34:11,678 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/output.log
564
+ 2024-02-26 09:34:14,323 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
565
+ 2024-02-26 09:34:16,660 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
566
+ 2024-02-26 09:34:19,324 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
567
+ 2024-02-26 09:34:21,661 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
568
+ 2024-02-26 09:34:24,325 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
569
+ 2024-02-26 09:34:26,662 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
570
+ 2024-02-26 09:34:29,336 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
571
+ 2024-02-26 09:34:31,663 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
572
+ 2024-02-26 09:34:32,504 DEBUG SenderThread:196 [sender.py:send():382] send: stats
573
+ 2024-02-26 09:34:34,368 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
574
+ 2024-02-26 09:34:36,005 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: partial_history
575
+ 2024-02-26 09:34:36,007 DEBUG SenderThread:196 [sender.py:send():382] send: history
576
+ 2024-02-26 09:34:36,007 DEBUG SenderThread:196 [sender.py:send_request():409] send_request: summary_record
577
+ 2024-02-26 09:34:36,007 INFO SenderThread:196 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
578
+ 2024-02-26 09:34:36,009 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: partial_history
579
+ 2024-02-26 09:34:36,011 DEBUG SenderThread:196 [sender.py:send():382] send: metric
580
+ 2024-02-26 09:34:36,011 DEBUG SenderThread:196 [sender.py:send():382] send: metric
581
+ 2024-02-26 09:34:36,011 DEBUG SenderThread:196 [sender.py:send():382] send: metric
582
+ 2024-02-26 09:34:36,012 DEBUG SenderThread:196 [sender.py:send():382] send: metric
583
+ 2024-02-26 09:34:36,012 DEBUG SenderThread:196 [sender.py:send():382] send: metric
584
+ 2024-02-26 09:34:36,012 DEBUG SenderThread:196 [sender.py:send():382] send: history
585
+ 2024-02-26 09:34:36,012 DEBUG SenderThread:196 [sender.py:send_request():409] send_request: summary_record
586
+ 2024-02-26 09:34:36,013 INFO SenderThread:196 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
587
+ 2024-02-26 09:34:36,014 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: pause
588
+ 2024-02-26 09:34:36,014 INFO HandlerThread:196 [handler.py:handle_request_pause():708] stopping system metrics thread
589
+ 2024-02-26 09:34:36,014 INFO HandlerThread:196 [system_monitor.py:finish():203] Stopping system monitor
590
+ 2024-02-26 09:34:36,015 INFO HandlerThread:196 [interfaces.py:finish():202] Joined cpu monitor
591
+ 2024-02-26 09:34:36,015 DEBUG SystemMonitor:196 [system_monitor.py:_start():179] Finished system metrics aggregation loop
592
+ 2024-02-26 09:34:36,015 INFO HandlerThread:196 [interfaces.py:finish():202] Joined disk monitor
593
+ 2024-02-26 09:34:36,016 DEBUG SystemMonitor:196 [system_monitor.py:_start():183] Publishing last batch of metrics
594
+ 2024-02-26 09:34:36,023 INFO HandlerThread:196 [interfaces.py:finish():202] Joined gpu monitor
595
+ 2024-02-26 09:34:36,023 INFO HandlerThread:196 [interfaces.py:finish():202] Joined memory monitor
596
+ 2024-02-26 09:34:36,023 INFO HandlerThread:196 [interfaces.py:finish():202] Joined network monitor
597
+ 2024-02-26 09:34:36,024 DEBUG SenderThread:196 [sender.py:send():382] send: stats
598
+ 2024-02-26 09:34:36,688 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/wandb-summary.json
599
+ 2024-02-26 09:34:37,024 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
600
+ 2024-02-26 09:34:39,379 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
601
+ 2024-02-26 09:34:42,025 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
602
+ 2024-02-26 09:34:43,927 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: resume
603
+ 2024-02-26 09:34:43,928 INFO HandlerThread:196 [handler.py:handle_request_resume():699] starting system metrics thread
604
+ 2024-02-26 09:34:43,928 INFO HandlerThread:196 [system_monitor.py:start():194] Starting system monitor
605
+ 2024-02-26 09:34:43,928 INFO SystemMonitor:196 [system_monitor.py:_start():158] Starting system asset monitoring threads
606
+ 2024-02-26 09:34:43,929 INFO SystemMonitor:196 [interfaces.py:start():190] Started cpu monitoring
607
+ 2024-02-26 09:34:43,929 INFO SystemMonitor:196 [interfaces.py:start():190] Started disk monitoring
608
+ 2024-02-26 09:34:43,930 INFO SystemMonitor:196 [interfaces.py:start():190] Started gpu monitoring
609
+ 2024-02-26 09:34:43,931 INFO SystemMonitor:196 [interfaces.py:start():190] Started memory monitoring
610
+ 2024-02-26 09:34:43,931 INFO SystemMonitor:196 [interfaces.py:start():190] Started network monitoring
611
+ 2024-02-26 09:34:44,384 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
612
+ 2024-02-26 09:34:47,026 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
613
+ 2024-02-26 09:34:49,915 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
614
+ 2024-02-26 09:34:52,027 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
615
+ 2024-02-26 09:34:54,917 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
616
+ 2024-02-26 09:34:57,033 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
617
+ 2024-02-26 09:34:57,695 INFO Thread-12 :196 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240226_092105-91uhs91a/files/config.yaml
618
+ 2024-02-26 09:34:59,918 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
619
+ 2024-02-26 09:35:02,160 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
620
+ 2024-02-26 09:35:04,919 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
621
+ 2024-02-26 09:35:07,160 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
622
+ 2024-02-26 09:35:09,920 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
623
+ 2024-02-26 09:35:12,161 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
624
+ 2024-02-26 09:35:14,921 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: keepalive
625
+ 2024-02-26 09:35:17,163 DEBUG HandlerThread:196 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240226_092105-91uhs91a/logs/debug.log CHANGED
@@ -49,3 +49,6 @@ config: {}
49
  2024-02-26 09:23:19,820 INFO MainThread:34 [wandb_init.py:_pause_backend():437] pausing backend
50
  2024-02-26 09:23:32,480 INFO MainThread:34 [wandb_init.py:_resume_backend():442] resuming backend
51
  2024-02-26 09:23:33,079 INFO MainThread:34 [wandb_run.py:_config_callback():1342] config_cb None None {'vocab_size': 32128, 'd_model': 768, 'd_kv': 64, 'd_ff': 2048, 'num_layers': 12, 'num_decoder_layers': 12, 'num_heads': 12, 'relative_attention_num_buckets': 32, 'relative_attention_max_distance': 128, 'dropout_rate': 0.1, 'classifier_dropout': 0.0, 'layer_norm_epsilon': 1e-06, 'initializer_factor': 1.0, 'feed_forward_proj': 'gated-gelu', 'use_cache': True, 'dense_act_fn': 'gelu_new', 'is_gated_act': True, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': False, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['T5ForConditionalGeneration'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': 1, 'sep_token_id': None, 'decoder_start_token_id': 0, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'csebuetnlp/banglat5', 'transformers_version': '4.37.0', 'gradient_checkpointing': False, 'model_type': 't5', 'output_past': True, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 16, 'per_device_eval_batch_size': 16, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 0.0005, 'weight_decay': 0.1, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 5, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Feb26_09-23-32_d79522c38279', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 3, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': None, 'generation_num_beams': None, 'generation_config': None}
 
 
 
 
49
  2024-02-26 09:23:19,820 INFO MainThread:34 [wandb_init.py:_pause_backend():437] pausing backend
50
  2024-02-26 09:23:32,480 INFO MainThread:34 [wandb_init.py:_resume_backend():442] resuming backend
51
  2024-02-26 09:23:33,079 INFO MainThread:34 [wandb_run.py:_config_callback():1342] config_cb None None {'vocab_size': 32128, 'd_model': 768, 'd_kv': 64, 'd_ff': 2048, 'num_layers': 12, 'num_decoder_layers': 12, 'num_heads': 12, 'relative_attention_num_buckets': 32, 'relative_attention_max_distance': 128, 'dropout_rate': 0.1, 'classifier_dropout': 0.0, 'layer_norm_epsilon': 1e-06, 'initializer_factor': 1.0, 'feed_forward_proj': 'gated-gelu', 'use_cache': True, 'dense_act_fn': 'gelu_new', 'is_gated_act': True, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': False, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': True, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['T5ForConditionalGeneration'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': 1, 'sep_token_id': None, 'decoder_start_token_id': 0, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'csebuetnlp/banglat5', 'transformers_version': '4.37.0', 'gradient_checkpointing': False, 'model_type': 't5', 'output_past': True, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 16, 'per_device_eval_batch_size': 16, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 0.0005, 'weight_decay': 0.1, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 5, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Feb26_09-23-32_d79522c38279', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': 3, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'sortish_sampler': False, 'predict_with_generate': True, 'generation_max_length': None, 'generation_num_beams': None, 'generation_config': None}
52
+ 2024-02-26 09:34:36,014 INFO MainThread:34 [jupyter.py:save_ipynb():373] not saving jupyter notebook
53
+ 2024-02-26 09:34:36,014 INFO MainThread:34 [wandb_init.py:_pause_backend():437] pausing backend
54
+ 2024-02-26 09:34:43,927 INFO MainThread:34 [wandb_init.py:_resume_backend():442] resuming backend
wandb/run-20240226_092105-91uhs91a/run-91uhs91a.wandb CHANGED
Binary files a/wandb/run-20240226_092105-91uhs91a/run-91uhs91a.wandb and b/wandb/run-20240226_092105-91uhs91a/run-91uhs91a.wandb differ