anindya-hf-2002 commited on
Commit
2a70d27
1 Parent(s): 41b5f61

delete wandb file

Browse files
src/wandb/run-20240511_204545-zlcauue2/files/code/src/pipeline.py DELETED
@@ -1,32 +0,0 @@
1
- import argparse
2
-
3
- from train import train_classifier, train_cyclegan
4
-
5
- def main():
6
- parser = argparse.ArgumentParser(description="Pipeline for training classifier or CycleGAN")
7
- parser.add_argument("--model_type", type=str, choices=["classifier", "cycle-gan"], help="Type of model to train")
8
- parser.add_argument("--image_size", type=int, default=512, help="Size of input images")
9
- parser.add_argument("--batch_size", type=int, default=4, help="Batch size for training")
10
- parser.add_argument("--epochs", type=int, default=10, help="Number of epochs for training")
11
- parser.add_argument("--resume_ckpt_path", type=str, default=None, help="Checkpoint path for resuming the training")
12
- parser.add_argument("--train_dir", type=str, required=True, help="Path to training data directory")
13
- parser.add_argument("--val_dir", type=str, required=True, help="Path to validation data directory")
14
- parser.add_argument("--test_dir", type=str, required=True, help="Path to test data directory (for CycleGAN)")
15
- parser.add_argument("--project", type=str, default="CycleGAN-CounterFactual Explanation", help="Name of the project (for logging)")
16
- parser.add_argument("--job_name", type=str, default="training", help="Name of the training job (for logging)")
17
- parser.add_argument("--checkpoint_dir", type=str, default="./models", help="Directory to save model checkpoints")
18
- parser.add_argument("--classifier_path", type=str, default=None, help="Path to pre-trained classifier model (for CycleGAN)")
19
-
20
- args = parser.parse_args()
21
-
22
- if args.model_type == "classifier":
23
- train_classifier(args.image_size, args.batch_size, args.epochs, args.resume_ckpt_path, args.train_dir, args.val_dir, args.checkpoint_dir, args.project, args.job_name)
24
- elif args.model_type == "cycle-gan":
25
- if args.classifier_path == None:
26
- raise ValueError("Please provide the 'classifier checkpoint path' to train the cyle GAN model")
27
- train_cyclegan(args.image_size, args.batch_size, args.epochs, args.classifier_path, args.resume_ckpt_path, args.train_dir, args.val_dir, args.test_dir, args.checkpoint_dir, args.project, args.job_name)
28
- else:
29
- print("Invalid model type. Choose either 'classifier' or 'cycle-gan'.")
30
-
31
- if __name__ == "__main__":
32
- main()
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
src/wandb/run-20240511_204545-zlcauue2/files/config.yaml DELETED
@@ -1,37 +0,0 @@
1
- wandb_version: 1
2
-
3
- _wandb:
4
- desc: null
5
- value:
6
- code_path: code/src/pipeline.py
7
- python_version: 3.11.7
8
- cli_version: 0.17.0
9
- framework: torch
10
- is_jupyter_run: false
11
- is_kaggle_kernel: false
12
- start_time: 1715440545
13
- t:
14
- 1:
15
- - 1
16
- - 41
17
- - 55
18
- 2:
19
- - 1
20
- - 41
21
- - 55
22
- 3:
23
- - 2
24
- - 7
25
- - 13
26
- - 23
27
- - 66
28
- 4: 3.11.7
29
- 5: 0.17.0
30
- 8:
31
- - 3
32
- - 5
33
- 13: windows-amd64
34
- m:
35
- - 1: trainer/global_step
36
- 6:
37
- - 3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
src/wandb/run-20240511_204545-zlcauue2/files/diff.patch DELETED
@@ -1,27 +0,0 @@
1
- diff --git a/.gitignore b/.gitignore
2
- index 68bc17f..cdb9062 100644
3
- --- a/.gitignore
4
- +++ b/.gitignore
5
- @@ -2,6 +2,7 @@
6
- __pycache__/
7
- *.py[cod]
8
- *$py.class
9
- +cfe/
10
-
11
- # C extensions
12
- *.so
13
- diff --git a/README.md b/README.md
14
- index 0c0d28c..82d90e4 100644
15
- --- a/README.md
16
- +++ b/README.md
17
- @@ -5,3 +5,10 @@ This project addresses the critical need for transparent and interpretable decis
18
- The primary objective is to generate realistic counterfactual images for image classifiers operating in medical contexts. By harnessing advanced techniques from adversarial learning, the project seeks to overcome the challenges associated with existing methods, such as saliency maps, which may not effectively capture the intricate nuances of decision-making processes rooted in texture and structure.
19
-
20
- The proposed approach holds promise for enhancing the interpretability of deep learning models, especially in high-stakes domains like healthcare, where transparent decision-making is paramount. By providing realistic counterfactual explanations, the project aims to empower clinicians and stakeholders with insights into classifier decisions, thereby fostering trust and facilitating more informed medical interventions.
21
- +
22
- +
23
- +### Python 3.11.0 recommended
24
- +```
25
- +python -m venv myenv
26
- +.\myenv\Scripts\activate
27
- +```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
src/wandb/run-20240511_204545-zlcauue2/files/output.log DELETED
@@ -1,31 +0,0 @@
1
- D:\Official\Reseach Projects\Personal Projects\Machine Learning\Deep Learning\Counterfactual-Image-Generation-using-CycleGAN\cfe\Lib\site-packages\torch\optim\lr_scheduler.py:28: UserWarning: The verbose parameter is deprecated. Please use get_last_lr() to access the learning rate.
2
- warnings.warn("The verbose parameter is deprecated. Please use get_last_lr() "
3
- | Name | Type | Params
4
- ----------------------------------------------------
5
- 0 | conv | Conv2d | 30
6
- 1 | model | SwinTransformer | 27.7 M
7
- 2 | criterion | CrossEntropyLoss | 0
8
- 3 | train_accuracy | BinaryAccuracy | 0
9
- 4 | val_accuracy | BinaryAccuracy | 0
10
- ----------------------------------------------------
11
- 197 K Trainable params
12
- 27.5 M Non-trainable params
13
- 27.7 M Total params
14
- 110.867 Total estimated model params size (MB)
15
- D:\Official\Reseach Projects\Personal Projects\Machine Learning\Deep Learning\Counterfactual-Image-Generation-using-CycleGAN\cfe\Lib\site-packages\lightning\pytorch\trainer\connectors\data_connector.py:436: Consider setting `persistent_workers=True` in 'val_dataloader' to speed up the dataloader worker initialization.
16
-
17
-
18
-
19
-
20
- D:\Official\Reseach Projects\Personal Projects\Machine Learning\Deep Learning\Counterfactual-Image-Generation-using-CycleGAN\cfe\Lib\site-packages\lightning\pytorch\trainer\connectors\data_connector.py:436: Consider setting `persistent_workers=True` in 'train_dataloader' to speed up the dataloader worker initialization.
21
-
22
-
23
-
24
-
25
-
26
-
27
-
28
-
29
-
30
- Epoch 0: 0%|▏ | 9/4185 [02:58<23:03:15, 0.05it/s, v_num=uue2, train_acc=0.250]
31
- D:\Official\Reseach Projects\Personal Projects\Machine Learning\Deep Learning\Counterfactual-Image-Generation-using-CycleGAN\cfe\Lib\site-packages\lightning\pytorch\trainer\call.py:54: Detected KeyboardInterrupt, attempting graceful shutdown...
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
src/wandb/run-20240511_204545-zlcauue2/files/requirements.txt DELETED
@@ -1,61 +0,0 @@
1
- GitPython==3.1.43
2
- Jinja2==3.1.4
3
- MarkupSafe==2.1.5
4
- PyYAML==6.0.1
5
- aiohttp==3.9.5
6
- aiosignal==1.3.1
7
- attrs==23.2.0
8
- certifi==2024.2.2
9
- charset-normalizer==3.3.2
10
- click==8.1.7
11
- colorama==0.4.6
12
- contourpy==1.2.1
13
- cycler==0.12.1
14
- docker-pycreds==0.4.0
15
- filelock==3.14.0
16
- fonttools==4.51.0
17
- frozenlist==1.4.1
18
- fsspec==2024.3.1
19
- gitdb==4.0.11
20
- idna==3.7
21
- intel-openmp==2021.4.0
22
- kiwisolver==1.4.5
23
- lightning-utilities==0.11.2
24
- lightning==2.2.3
25
- matplotlib==3.8.4
26
- mkl==2021.4.0
27
- mpmath==1.3.0
28
- multidict==6.0.5
29
- networkx==3.3
30
- numpy==1.26.4
31
- packaging==24.0
32
- pandas==2.2.2
33
- pillow==10.3.0
34
- pip==23.2.1
35
- platformdirs==4.2.1
36
- pretty-errors==1.2.25
37
- protobuf==4.25.3
38
- psutil==5.9.8
39
- pydicom==2.4.4
40
- pyparsing==3.1.2
41
- python-dateutil==2.9.0.post0
42
- pytorch-lightning==2.2.4
43
- pytz==2024.1
44
- requests==2.31.0
45
- sentry-sdk==2.1.1
46
- setproctitle==1.3.3
47
- setuptools==65.5.0
48
- six==1.16.0
49
- smmap==5.0.1
50
- sympy==1.12
51
- tbb==2021.12.0
52
- torch==2.3.0
53
- torchmetrics==1.4.0
54
- torchsummary==1.5.1
55
- torchvision==0.18.0
56
- tqdm==4.66.4
57
- typing_extensions==4.11.0
58
- tzdata==2024.1
59
- urllib3==2.2.1
60
- wandb==0.17.0
61
- yarl==1.9.4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
src/wandb/run-20240511_204545-zlcauue2/files/wandb-metadata.json DELETED
@@ -1,66 +0,0 @@
1
- {
2
- "os": "Windows-10-10.0.22631-SP0",
3
- "python": "3.11.7",
4
- "heartbeatAt": "2024-05-11T15:15:48.651401",
5
- "startedAt": "2024-05-11T15:15:45.805161",
6
- "docker": null,
7
- "cuda": null,
8
- "args": [
9
- "--model_type",
10
- "classifier",
11
- "--image_size",
12
- "512",
13
- "--batch_size",
14
- "4",
15
- "--epochs",
16
- "10",
17
- "--train_dir",
18
- "D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\data\\rsna-pneumonia-dataset\\train",
19
- "--val_dir",
20
- "D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\data\\rsna-pneumonia-dataset\\val",
21
- "--project",
22
- "CycleGAN-CFE",
23
- "--job_name",
24
- "swin_t-classifier-training",
25
- "--checkpoint_dir",
26
- "D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\models",
27
- "--test_dir",
28
- "D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\data\\rsna-pneumonia-dataset\\test"
29
- ],
30
- "state": "running",
31
- "program": "D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\src\\pipeline.py",
32
- "codePathLocal": "pipeline.py",
33
- "codePath": "src\\pipeline.py",
34
- "git": {
35
- "remote": "https://github.com/anindyamitra2002/Counterfactual-Image-Generation-using-CycleGAN.git",
36
- "commit": "a695a29e7ffc4a52a3e7abedae76632e7849a680"
37
- },
38
- "email": "[email protected]",
39
- "root": "D:/Official/Reseach Projects/Personal Projects/Machine Learning/Deep Learning/Counterfactual-Image-Generation-using-CycleGAN",
40
- "host": "LAPTOP-0QSMFF19",
41
- "username": "Anind",
42
- "executable": "D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\cfe\\Scripts\\python.exe",
43
- "cpu_count": 2,
44
- "cpu_count_logical": 4,
45
- "cpu_freq": {
46
- "current": 1190.0,
47
- "min": 0.0,
48
- "max": 1190.0
49
- },
50
- "cpu_freq_per_core": [
51
- {
52
- "current": 1190.0,
53
- "min": 0.0,
54
- "max": 1190.0
55
- }
56
- ],
57
- "disk": {
58
- "/": {
59
- "total": 244.38378524780273,
60
- "used": 121.69070053100586
61
- }
62
- },
63
- "memory": {
64
- "total": 7.7869110107421875
65
- }
66
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
src/wandb/run-20240511_204545-zlcauue2/files/wandb-summary.json DELETED
@@ -1 +0,0 @@
1
- {"_wandb": {"runtime": 374}}
 
 
src/wandb/run-20240511_204545-zlcauue2/logs/debug-internal.log DELETED
@@ -1,279 +0,0 @@
1
- 2024-05-11 20:45:45,839 INFO StreamThr :1724 [internal.py:wandb_internal():85] W&B internal server running at pid: 1724, started at: 2024-05-11 20:45:45.837157
2
- 2024-05-11 20:45:45,867 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status
3
- 2024-05-11 20:45:45,869 INFO WriterThread:1724 [datastore.py:open_for_write():87] open: .\wandb\run-20240511_204545-zlcauue2\run-zlcauue2.wandb
4
- 2024-05-11 20:45:45,871 DEBUG SenderThread:1724 [sender.py:send():378] send: header
5
- 2024-05-11 20:45:45,971 DEBUG SenderThread:1724 [sender.py:send():378] send: run
6
- 2024-05-11 20:45:45,977 INFO SenderThread:1724 [sender.py:_setup_resume():748] checking resume status for None/CycleGAN-CFE/zlcauue2
7
- 2024-05-11 20:45:47,872 INFO SenderThread:1724 [dir_watcher.py:__init__():211] watching files in: .\wandb\run-20240511_204545-zlcauue2\files
8
- 2024-05-11 20:45:47,872 INFO SenderThread:1724 [sender.py:_start_run_threads():1123] run started: zlcauue2 with start time 1715440545.843265
9
- 2024-05-11 20:45:47,887 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: check_version
10
- 2024-05-11 20:45:47,887 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: check_version
11
- 2024-05-11 20:45:48,619 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: run_start
12
- 2024-05-11 20:45:48,641 DEBUG HandlerThread:1724 [system_info.py:__init__():26] System info init
13
- 2024-05-11 20:45:48,641 DEBUG HandlerThread:1724 [system_info.py:__init__():41] System info init done
14
- 2024-05-11 20:45:48,641 INFO HandlerThread:1724 [system_monitor.py:start():194] Starting system monitor
15
- 2024-05-11 20:45:48,641 INFO SystemMonitor:1724 [system_monitor.py:_start():158] Starting system asset monitoring threads
16
- 2024-05-11 20:45:48,641 INFO HandlerThread:1724 [system_monitor.py:probe():214] Collecting system info
17
- 2024-05-11 20:45:48,646 DEBUG HandlerThread:1724 [system_info.py:probe():150] Probing system
18
- 2024-05-11 20:45:48,651 INFO SystemMonitor:1724 [interfaces.py:start():188] Started cpu monitoring
19
- 2024-05-11 20:45:48,652 DEBUG HandlerThread:1724 [system_info.py:_probe_git():135] Probing git
20
- 2024-05-11 20:45:48,655 INFO SystemMonitor:1724 [interfaces.py:start():188] Started disk monitoring
21
- 2024-05-11 20:45:48,669 INFO SystemMonitor:1724 [interfaces.py:start():188] Started memory monitoring
22
- 2024-05-11 20:45:48,684 INFO SystemMonitor:1724 [interfaces.py:start():188] Started network monitoring
23
- 2024-05-11 20:45:48,766 DEBUG HandlerThread:1724 [system_info.py:_probe_git():143] Probing git done
24
- 2024-05-11 20:45:48,766 DEBUG HandlerThread:1724 [system_info.py:probe():198] Probing system done
25
- 2024-05-11 20:45:48,766 DEBUG HandlerThread:1724 [system_monitor.py:probe():223] {'os': 'Windows-10-10.0.22631-SP0', 'python': '3.11.7', 'heartbeatAt': '2024-05-11T15:15:48.651401', 'startedAt': '2024-05-11T15:15:45.805161', 'docker': None, 'cuda': None, 'args': ('--model_type', 'classifier', '--image_size', '512', '--batch_size', '4', '--epochs', '10', '--train_dir', 'D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\data\\rsna-pneumonia-dataset\\train', '--val_dir', 'D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\data\\rsna-pneumonia-dataset\\val', '--project', 'CycleGAN-CFE', '--job_name', 'swin_t-classifier-training', '--checkpoint_dir', 'D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\models', '--test_dir', 'D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\data\\rsna-pneumonia-dataset\\test'), 'state': 'running', 'program': 'D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\src\\pipeline.py', 'codePathLocal': 'pipeline.py', 'codePath': 'src\\pipeline.py', 'git': {'remote': 'https://github.com/anindyamitra2002/Counterfactual-Image-Generation-using-CycleGAN.git', 'commit': 'a695a29e7ffc4a52a3e7abedae76632e7849a680'}, 'email': '[email protected]', 'root': 'D:/Official/Reseach Projects/Personal Projects/Machine Learning/Deep Learning/Counterfactual-Image-Generation-using-CycleGAN', 'host': 'LAPTOP-0QSMFF19', 'username': 'Anind', 'executable': 'D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\cfe\\Scripts\\python.exe', 'cpu_count': 2, 'cpu_count_logical': 4, 'cpu_freq': {'current': 1190.0, 'min': 0.0, 'max': 1190.0}, 'cpu_freq_per_core': [{'current': 1190.0, 'min': 0.0, 'max': 1190.0}], 'disk': {'/': {'total': 244.38378524780273, 'used': 121.69070053100586}}, 'memory': {'total': 7.7869110107421875}}
26
- 2024-05-11 20:45:48,766 INFO HandlerThread:1724 [system_monitor.py:probe():224] Finished collecting system info
27
- 2024-05-11 20:45:48,766 INFO HandlerThread:1724 [system_monitor.py:probe():227] Publishing system info
28
- 2024-05-11 20:45:48,767 DEBUG HandlerThread:1724 [system_info.py:_save_code():44] Saving code
29
- 2024-05-11 20:45:48,825 DEBUG HandlerThread:1724 [system_info.py:_save_code():65] Saving code done
30
- 2024-05-11 20:45:48,826 DEBUG HandlerThread:1724 [system_info.py:_save_patches():82] Saving git patches
31
- 2024-05-11 20:45:48,888 INFO Thread-16 :1724 [dir_watcher.py:_on_file_created():271] file/dir created: .\wandb\run-20240511_204545-zlcauue2\files\code\src\pipeline.py
32
- 2024-05-11 20:45:48,889 INFO Thread-16 :1724 [dir_watcher.py:_on_file_created():271] file/dir created: .\wandb\run-20240511_204545-zlcauue2\files\code
33
- 2024-05-11 20:45:48,889 INFO Thread-16 :1724 [dir_watcher.py:_on_file_created():271] file/dir created: .\wandb\run-20240511_204545-zlcauue2\files\code\src
34
- 2024-05-11 20:45:49,294 DEBUG HandlerThread:1724 [system_info.py:_save_patches():124] Saving git patches done
35
- 2024-05-11 20:45:49,296 INFO HandlerThread:1724 [system_monitor.py:probe():229] Finished publishing system info
36
- 2024-05-11 20:45:49,309 DEBUG SenderThread:1724 [sender.py:send():378] send: files
37
- 2024-05-11 20:45:49,309 INFO SenderThread:1724 [sender.py:_save_file():1389] saving file wandb-metadata.json with policy now
38
- 2024-05-11 20:45:49,311 INFO SenderThread:1724 [sender.py:_save_file():1389] saving file code\src\pipeline.py with policy now
39
- 2024-05-11 20:45:49,312 INFO SenderThread:1724 [sender.py:_save_file():1389] saving file diff.patch with policy now
40
- 2024-05-11 20:45:49,799 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: python_packages
41
- 2024-05-11 20:45:49,799 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: python_packages
42
- 2024-05-11 20:45:49,805 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
43
- 2024-05-11 20:45:49,805 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
44
- 2024-05-11 20:45:49,915 INFO Thread-16 :1724 [dir_watcher.py:_on_file_created():271] file/dir created: .\wandb\run-20240511_204545-zlcauue2\files\wandb-metadata.json
45
- 2024-05-11 20:45:49,916 INFO Thread-16 :1724 [dir_watcher.py:_on_file_created():271] file/dir created: .\wandb\run-20240511_204545-zlcauue2\files\diff.patch
46
- 2024-05-11 20:45:49,916 INFO Thread-16 :1724 [dir_watcher.py:_on_file_created():271] file/dir created: .\wandb\run-20240511_204545-zlcauue2\files\requirements.txt
47
- 2024-05-11 20:45:51,321 DEBUG SenderThread:1724 [sender.py:send():378] send: telemetry
48
- 2024-05-11 20:45:51,321 DEBUG SenderThread:1724 [sender.py:send():378] send: metric
49
- 2024-05-11 20:45:51,321 DEBUG SenderThread:1724 [sender.py:send():378] send: telemetry
50
- 2024-05-11 20:45:51,321 DEBUG SenderThread:1724 [sender.py:send():378] send: telemetry
51
- 2024-05-11 20:45:51,321 DEBUG SenderThread:1724 [sender.py:send():378] send: metric
52
- 2024-05-11 20:45:51,321 WARNING SenderThread:1724 [sender.py:send_metric():1340] Seen metric with glob (shouldn't happen)
53
- 2024-05-11 20:45:51,323 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
54
- 2024-05-11 20:45:51,525 INFO wandb-upload_0:1724 [upload_job.py:push():130] Uploaded file C:\Users\Anind\AppData\Local\Temp\tmp1u335h0vwandb\wd17oylj-wandb-metadata.json
55
- 2024-05-11 20:45:51,933 INFO Thread-16 :1724 [dir_watcher.py:_on_file_created():271] file/dir created: .\wandb\run-20240511_204545-zlcauue2\files\output.log
56
- 2024-05-11 20:45:52,357 INFO wandb-upload_1:1724 [upload_job.py:push():130] Uploaded file C:\Users\Anind\AppData\Local\Temp\tmp1u335h0vwandb\ahqjl4rf-code/src/pipeline.py
57
- 2024-05-11 20:45:52,411 INFO wandb-upload_2:1724 [upload_job.py:push():130] Uploaded file C:\Users\Anind\AppData\Local\Temp\tmp1u335h0vwandb\fxguvjri-diff.patch
58
- 2024-05-11 20:45:53,972 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
59
- 2024-05-11 20:45:56,496 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
60
- 2024-05-11 20:46:01,533 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
61
- 2024-05-11 20:46:04,813 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
62
- 2024-05-11 20:46:04,814 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
63
- 2024-05-11 20:46:07,254 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
64
- 2024-05-11 20:46:12,293 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
65
- 2024-05-11 20:46:17,404 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
66
- 2024-05-11 20:46:18,520 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\config.yaml
67
- 2024-05-11 20:46:19,837 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
68
- 2024-05-11 20:46:19,838 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
69
- 2024-05-11 20:46:23,324 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
70
- 2024-05-11 20:46:28,378 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
71
- 2024-05-11 20:46:33,431 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
72
- 2024-05-11 20:46:34,853 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
73
- 2024-05-11 20:46:34,854 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
74
- 2024-05-11 20:46:39,564 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
75
- 2024-05-11 20:46:44,737 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
76
- 2024-05-11 20:46:46,336 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
77
- 2024-05-11 20:46:48,718 DEBUG SystemMonitor:1724 [system_monitor.py:_start():172] Starting system metrics aggregation loop
78
- 2024-05-11 20:46:48,719 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
79
- 2024-05-11 20:46:49,863 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
80
- 2024-05-11 20:46:49,884 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
81
- 2024-05-11 20:46:49,884 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
82
- 2024-05-11 20:46:55,357 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
83
- 2024-05-11 20:47:00,459 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
84
- 2024-05-11 20:47:04,899 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
85
- 2024-05-11 20:47:04,900 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
86
- 2024-05-11 20:47:06,361 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
87
- 2024-05-11 20:47:08,942 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
88
- 2024-05-11 20:47:12,327 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
89
- 2024-05-11 20:47:17,418 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
90
- 2024-05-11 20:47:18,731 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
91
- 2024-05-11 20:47:19,917 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
92
- 2024-05-11 20:47:19,918 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
93
- 2024-05-11 20:47:23,380 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
94
- 2024-05-11 20:47:28,435 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
95
- 2024-05-11 20:47:28,528 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
96
- 2024-05-11 20:47:33,489 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
97
- 2024-05-11 20:47:34,924 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
98
- 2024-05-11 20:47:34,927 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
99
- 2024-05-11 20:47:39,395 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
100
- 2024-05-11 20:47:44,444 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
101
- 2024-05-11 20:47:48,741 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
102
- 2024-05-11 20:47:49,747 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
103
- 2024-05-11 20:47:49,920 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
104
- 2024-05-11 20:47:49,920 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
105
- 2024-05-11 20:47:55,514 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
106
- 2024-05-11 20:48:00,570 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
107
- 2024-05-11 20:48:04,918 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
108
- 2024-05-11 20:48:04,920 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
109
- 2024-05-11 20:48:06,371 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
110
- 2024-05-11 20:48:11,439 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
111
- 2024-05-11 20:48:16,477 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
112
- 2024-05-11 20:48:18,755 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
113
- 2024-05-11 20:48:19,914 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
114
- 2024-05-11 20:48:19,915 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
115
- 2024-05-11 20:48:22,425 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
116
- 2024-05-11 20:48:27,482 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
117
- 2024-05-11 20:48:32,598 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
118
- 2024-05-11 20:48:34,923 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
119
- 2024-05-11 20:48:34,925 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
120
- 2024-05-11 20:48:38,385 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
121
- 2024-05-11 20:48:42,903 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
122
- 2024-05-11 20:48:44,016 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
123
- 2024-05-11 20:48:48,770 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
124
- 2024-05-11 20:48:49,775 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
125
- 2024-05-11 20:48:49,950 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
126
- 2024-05-11 20:48:49,953 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
127
- 2024-05-11 20:48:55,460 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
128
- 2024-05-11 20:49:00,494 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
129
- 2024-05-11 20:49:04,962 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
130
- 2024-05-11 20:49:04,962 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
131
- 2024-05-11 20:49:06,480 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
132
- 2024-05-11 20:49:07,254 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
133
- 2024-05-11 20:49:11,530 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
134
- 2024-05-11 20:49:16,589 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
135
- 2024-05-11 20:49:18,784 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
136
- 2024-05-11 20:49:19,971 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
137
- 2024-05-11 20:49:19,972 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
138
- 2024-05-11 20:49:22,423 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
139
- 2024-05-11 20:49:26,515 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
140
- 2024-05-11 20:49:28,221 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
141
- 2024-05-11 20:49:33,271 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
142
- 2024-05-11 20:49:34,974 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
143
- 2024-05-11 20:49:34,975 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
144
- 2024-05-11 20:49:38,424 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
145
- 2024-05-11 20:49:43,452 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
146
- 2024-05-11 20:49:46,746 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
147
- 2024-05-11 20:49:48,587 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
148
- 2024-05-11 20:49:48,792 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
149
- 2024-05-11 20:49:49,992 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
150
- 2024-05-11 20:49:49,998 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
151
- 2024-05-11 20:49:54,455 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
152
- 2024-05-11 20:49:59,499 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
153
- 2024-05-11 20:50:04,888 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
154
- 2024-05-11 20:50:05,003 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
155
- 2024-05-11 20:50:05,003 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
156
- 2024-05-11 20:50:05,004 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
157
- 2024-05-11 20:50:10,414 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
158
- 2024-05-11 20:50:15,453 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
159
- 2024-05-11 20:50:18,806 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
160
- 2024-05-11 20:50:20,001 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
161
- 2024-05-11 20:50:20,002 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
162
- 2024-05-11 20:50:21,432 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
163
- 2024-05-11 20:50:25,236 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
164
- 2024-05-11 20:50:27,247 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
165
- 2024-05-11 20:50:32,292 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
166
- 2024-05-11 20:50:35,008 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
167
- 2024-05-11 20:50:35,008 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
168
- 2024-05-11 20:50:37,519 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
169
- 2024-05-11 20:50:43,192 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
170
- 2024-05-11 20:50:45,409 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
171
- 2024-05-11 20:50:48,234 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
172
- 2024-05-11 20:50:48,836 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
173
- 2024-05-11 20:50:50,024 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
174
- 2024-05-11 20:50:50,031 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
175
- 2024-05-11 20:50:53,458 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
176
- 2024-05-11 20:50:58,491 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
177
- 2024-05-11 20:51:02,543 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
178
- 2024-05-11 20:51:04,405 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
179
- 2024-05-11 20:51:05,036 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
180
- 2024-05-11 20:51:05,037 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
181
- 2024-05-11 20:51:09,525 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
182
- 2024-05-11 20:51:14,547 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
183
- 2024-05-11 20:51:18,842 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
184
- 2024-05-11 20:51:19,854 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
185
- 2024-05-11 20:51:20,061 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
186
- 2024-05-11 20:51:20,062 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
187
- 2024-05-11 20:51:22,715 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
188
- 2024-05-11 20:51:24,898 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
189
- 2024-05-11 20:51:29,926 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
190
- 2024-05-11 20:51:34,977 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
191
- 2024-05-11 20:51:35,067 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
192
- 2024-05-11 20:51:35,068 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
193
- 2024-05-11 20:51:40,678 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
194
- 2024-05-11 20:51:40,943 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
195
- 2024-05-11 20:51:45,745 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
196
- 2024-05-11 20:51:48,852 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
197
- 2024-05-11 20:51:50,087 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: stop_status
198
- 2024-05-11 20:51:50,087 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: stop_status
199
- 2024-05-11 20:51:51,458 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
200
- 2024-05-11 20:51:56,515 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
201
- 2024-05-11 20:52:01,988 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
202
- 2024-05-11 20:52:03,507 DEBUG SenderThread:1724 [sender.py:send():378] send: telemetry
203
- 2024-05-11 20:52:03,532 DEBUG SenderThread:1724 [sender.py:send():378] send: exit
204
- 2024-05-11 20:52:03,533 INFO SenderThread:1724 [sender.py:send_exit():585] handling exit code: 0
205
- 2024-05-11 20:52:03,563 INFO SenderThread:1724 [sender.py:send_exit():587] handling runtime: 374
206
- 2024-05-11 20:52:03,566 INFO SenderThread:1724 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
207
- 2024-05-11 20:52:03,571 INFO SenderThread:1724 [sender.py:send_exit():593] send defer
208
- 2024-05-11 20:52:03,573 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: defer
209
- 2024-05-11 20:52:03,575 INFO HandlerThread:1724 [handler.py:handle_request_defer():184] handle defer: 0
210
- 2024-05-11 20:52:03,577 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: defer
211
- 2024-05-11 20:52:03,577 INFO SenderThread:1724 [sender.py:send_request_defer():609] handle sender defer: 0
212
- 2024-05-11 20:52:03,577 INFO SenderThread:1724 [sender.py:transition_state():613] send defer: 1
213
- 2024-05-11 20:52:03,578 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: defer
214
- 2024-05-11 20:52:03,578 INFO HandlerThread:1724 [handler.py:handle_request_defer():184] handle defer: 1
215
- 2024-05-11 20:52:03,579 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: defer
216
- 2024-05-11 20:52:03,579 INFO SenderThread:1724 [sender.py:send_request_defer():609] handle sender defer: 1
217
- 2024-05-11 20:52:03,579 INFO SenderThread:1724 [sender.py:transition_state():613] send defer: 2
218
- 2024-05-11 20:52:03,579 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: defer
219
- 2024-05-11 20:52:03,580 INFO HandlerThread:1724 [handler.py:handle_request_defer():184] handle defer: 2
220
- 2024-05-11 20:52:03,582 INFO HandlerThread:1724 [system_monitor.py:finish():203] Stopping system monitor
221
- 2024-05-11 20:52:03,584 DEBUG SystemMonitor:1724 [system_monitor.py:_start():179] Finished system metrics aggregation loop
222
- 2024-05-11 20:52:03,584 DEBUG SystemMonitor:1724 [system_monitor.py:_start():183] Publishing last batch of metrics
223
- 2024-05-11 20:52:03,585 INFO HandlerThread:1724 [interfaces.py:finish():200] Joined cpu monitor
224
- 2024-05-11 20:52:03,585 INFO HandlerThread:1724 [interfaces.py:finish():200] Joined disk monitor
225
- 2024-05-11 20:52:03,586 INFO HandlerThread:1724 [interfaces.py:finish():200] Joined memory monitor
226
- 2024-05-11 20:52:03,586 INFO HandlerThread:1724 [interfaces.py:finish():200] Joined network monitor
227
- 2024-05-11 20:52:03,589 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: defer
228
- 2024-05-11 20:52:03,589 INFO SenderThread:1724 [sender.py:send_request_defer():609] handle sender defer: 2
229
- 2024-05-11 20:52:03,589 INFO SenderThread:1724 [sender.py:transition_state():613] send defer: 3
230
- 2024-05-11 20:52:03,589 DEBUG SenderThread:1724 [sender.py:send():378] send: stats
231
- 2024-05-11 20:52:03,589 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: defer
232
- 2024-05-11 20:52:03,589 INFO HandlerThread:1724 [handler.py:handle_request_defer():184] handle defer: 3
233
- 2024-05-11 20:52:03,591 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: defer
234
- 2024-05-11 20:52:03,591 INFO SenderThread:1724 [sender.py:send_request_defer():609] handle sender defer: 3
235
- 2024-05-11 20:52:03,591 INFO SenderThread:1724 [sender.py:transition_state():613] send defer: 4
236
- 2024-05-11 20:52:03,592 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: defer
237
- 2024-05-11 20:52:03,592 INFO HandlerThread:1724 [handler.py:handle_request_defer():184] handle defer: 4
238
- 2024-05-11 20:52:03,592 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: defer
239
- 2024-05-11 20:52:03,592 INFO SenderThread:1724 [sender.py:send_request_defer():609] handle sender defer: 4
240
- 2024-05-11 20:52:03,592 INFO SenderThread:1724 [sender.py:transition_state():613] send defer: 5
241
- 2024-05-11 20:52:03,592 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: defer
242
- 2024-05-11 20:52:03,592 INFO HandlerThread:1724 [handler.py:handle_request_defer():184] handle defer: 5
243
- 2024-05-11 20:52:03,594 DEBUG SenderThread:1724 [sender.py:send():378] send: summary
244
- 2024-05-11 20:52:03,594 INFO SenderThread:1724 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
245
- 2024-05-11 20:52:03,596 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: defer
246
- 2024-05-11 20:52:03,596 INFO SenderThread:1724 [sender.py:send_request_defer():609] handle sender defer: 5
247
- 2024-05-11 20:52:03,596 INFO SenderThread:1724 [sender.py:transition_state():613] send defer: 6
248
- 2024-05-11 20:52:03,596 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: defer
249
- 2024-05-11 20:52:03,596 INFO HandlerThread:1724 [handler.py:handle_request_defer():184] handle defer: 6
250
- 2024-05-11 20:52:03,597 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: defer
251
- 2024-05-11 20:52:03,597 INFO SenderThread:1724 [sender.py:send_request_defer():609] handle sender defer: 6
252
- 2024-05-11 20:52:03,603 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: status_report
253
- 2024-05-11 20:52:03,970 INFO SenderThread:1724 [sender.py:transition_state():613] send defer: 7
254
- 2024-05-11 20:52:03,970 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: defer
255
- 2024-05-11 20:52:03,970 INFO HandlerThread:1724 [handler.py:handle_request_defer():184] handle defer: 7
256
- 2024-05-11 20:52:03,971 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: defer
257
- 2024-05-11 20:52:03,971 INFO SenderThread:1724 [sender.py:send_request_defer():609] handle sender defer: 7
258
- 2024-05-11 20:52:04,463 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\config.yaml
259
- 2024-05-11 20:52:04,464 INFO Thread-16 :1724 [dir_watcher.py:_on_file_created():271] file/dir created: .\wandb\run-20240511_204545-zlcauue2\files\wandb-summary.json
260
- 2024-05-11 20:52:04,536 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: poll_exit
261
- 2024-05-11 20:52:05,475 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
262
- 2024-05-11 20:52:06,606 INFO SenderThread:1724 [sender.py:transition_state():613] send defer: 8
263
- 2024-05-11 20:52:06,607 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: poll_exit
264
- 2024-05-11 20:52:06,607 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: defer
265
- 2024-05-11 20:52:06,615 INFO HandlerThread:1724 [handler.py:handle_request_defer():184] handle defer: 8
266
- 2024-05-11 20:52:06,616 DEBUG SenderThread:1724 [sender.py:send_request():405] send_request: defer
267
- 2024-05-11 20:52:06,616 INFO SenderThread:1724 [sender.py:send_request_defer():609] handle sender defer: 8
268
- 2024-05-11 20:52:06,619 INFO SenderThread:1724 [job_builder.py:build():432] Attempting to build job artifact
269
- 2024-05-11 20:52:06,627 INFO SenderThread:1724 [job_builder.py:_get_source_type():565] is repo sourced job
270
- 2024-05-11 20:52:06,772 INFO SenderThread:1724 [job_builder.py:build():541] adding wandb-job metadata file
271
- 2024-05-11 20:52:06,866 INFO SenderThread:1724 [sender.py:transition_state():613] send defer: 9
272
- 2024-05-11 20:52:06,866 DEBUG HandlerThread:1724 [handler.py:handle_request():158] handle_request: defer
273
- 2024-05-11 20:52:06,867 INFO HandlerThread:1724 [handler.py:handle_request_defer():184] handle defer: 9
274
- 2024-05-11 20:52:06,867 DEBUG SenderThread:1724 [sender.py:send():378] send: artifact
275
- 2024-05-11 20:52:07,493 INFO Thread-16 :1724 [dir_watcher.py:_on_file_modified():288] file/dir modified: .\wandb\run-20240511_204545-zlcauue2\files\output.log
276
- 2024-05-11 20:52:10,528 INFO wandb-upload_0:1724 [upload_job.py:push():88] Uploaded file C:\Users\Anind\AppData\Local\wandb\wandb\artifacts\staging\tmp9k54y15w
277
- 2024-05-11 20:52:10,571 INFO wandb-upload_2:1724 [upload_job.py:push():88] Uploaded file C:\Users\Anind\AppData\Local\Temp\tmp2n1y9k3m\wandb-job.json
278
- 2024-05-11 20:52:10,577 INFO wandb-upload_1:1724 [upload_job.py:push():88] Uploaded file C:\Users\Anind\AppData\Local\wandb\wandb\artifacts\staging\tmplrk1vi94
279
- 2024-05-11 20:52:10,580 INFO MainThread:1724 [internal.py:handle_exit():75] Internal process exited
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
src/wandb/run-20240511_204545-zlcauue2/logs/debug.log DELETED
@@ -1,31 +0,0 @@
1
- 2024-05-11 20:45:45,821 INFO MainThread:12220 [wandb_setup.py:_flush():76] Current SDK version is 0.17.0
2
- 2024-05-11 20:45:45,822 INFO MainThread:12220 [wandb_setup.py:_flush():76] Configure stats pid to 12220
3
- 2024-05-11 20:45:45,822 INFO MainThread:12220 [wandb_setup.py:_flush():76] Loading settings from C:\Users\Anind\.config\wandb\settings
4
- 2024-05-11 20:45:45,822 INFO MainThread:12220 [wandb_setup.py:_flush():76] Loading settings from D:\Official\Reseach Projects\Personal Projects\Machine Learning\Deep Learning\Counterfactual-Image-Generation-using-CycleGAN\src\wandb\settings
5
- 2024-05-11 20:45:45,822 INFO MainThread:12220 [wandb_setup.py:_flush():76] Loading settings from environment variables: {}
6
- 2024-05-11 20:45:45,823 INFO MainThread:12220 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False}
7
- 2024-05-11 20:45:45,823 INFO MainThread:12220 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program_relpath': 'src\\pipeline.py', 'program_abspath': 'D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\src\\pipeline.py', 'program': 'D:\\Official\\Reseach Projects\\Personal Projects\\Machine Learning\\Deep Learning\\Counterfactual-Image-Generation-using-CycleGAN\\src\\pipeline.py'}
8
- 2024-05-11 20:45:45,824 INFO MainThread:12220 [wandb_setup.py:_flush():76] Applying login settings: {}
9
- 2024-05-11 20:45:45,825 INFO MainThread:12220 [wandb_init.py:_log_setup():520] Logging user logs to .\wandb\run-20240511_204545-zlcauue2\logs\debug.log
10
- 2024-05-11 20:45:45,825 INFO MainThread:12220 [wandb_init.py:_log_setup():521] Logging internal logs to .\wandb\run-20240511_204545-zlcauue2\logs\debug-internal.log
11
- 2024-05-11 20:45:45,826 INFO MainThread:12220 [wandb_init.py:init():560] calling init triggers
12
- 2024-05-11 20:45:45,826 INFO MainThread:12220 [wandb_init.py:init():567] wandb.init called with sweep_config: {}
13
- config: {}
14
- 2024-05-11 20:45:45,826 INFO MainThread:12220 [wandb_init.py:init():610] starting backend
15
- 2024-05-11 20:45:45,826 INFO MainThread:12220 [wandb_init.py:init():614] setting up manager
16
- 2024-05-11 20:45:45,833 INFO MainThread:12220 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=spawn, using: spawn
17
- 2024-05-11 20:45:45,842 INFO MainThread:12220 [wandb_init.py:init():622] backend started and connected
18
- 2024-05-11 20:45:45,852 INFO MainThread:12220 [wandb_init.py:init():711] updated telemetry
19
- 2024-05-11 20:45:45,969 INFO MainThread:12220 [wandb_init.py:init():744] communicating run to backend with 90.0 second timeout
20
- 2024-05-11 20:45:47,886 INFO MainThread:12220 [wandb_run.py:_on_init():2396] communicating current version
21
- 2024-05-11 20:45:48,608 INFO MainThread:12220 [wandb_run.py:_on_init():2405] got version response
22
- 2024-05-11 20:45:48,608 INFO MainThread:12220 [wandb_init.py:init():795] starting run threads in backend
23
- 2024-05-11 20:45:49,815 INFO MainThread:12220 [wandb_run.py:_console_start():2374] atexit reg
24
- 2024-05-11 20:45:49,816 INFO MainThread:12220 [wandb_run.py:_redirect():2229] redirect: wrap_raw
25
- 2024-05-11 20:45:49,816 INFO MainThread:12220 [wandb_run.py:_redirect():2294] Wrapping output streams.
26
- 2024-05-11 20:45:49,816 INFO MainThread:12220 [wandb_run.py:_redirect():2319] Redirects installed.
27
- 2024-05-11 20:45:49,820 INFO MainThread:12220 [wandb_init.py:init():838] run started, returning control to user process
28
- 2024-05-11 20:52:03,512 INFO MainThread:12220 [wandb_run.py:_finish():2103] finishing run anindyamitra2018/CycleGAN-CFE/zlcauue2
29
- 2024-05-11 20:52:03,519 INFO MainThread:12220 [wandb_run.py:_atexit_cleanup():2343] got exitcode: 0
30
- 2024-05-11 20:52:03,527 INFO MainThread:12220 [wandb_run.py:_restore():2326] restore
31
- 2024-05-11 20:52:03,529 INFO MainThread:12220 [wandb_run.py:_restore():2332] restore done
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
src/wandb/run-20240511_204545-zlcauue2/run-zlcauue2.wandb DELETED
Binary file (15.4 kB)