| 2024-07-20 03:04:39,456 INFO StreamThr :151 [internal.py:wandb_internal():85] W&B internal server running at pid: 151, started at: 2024-07-20 03:04:39.455815 | |
| 2024-07-20 03:04:39,458 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status | |
| 2024-07-20 03:04:40,058 INFO WriterThread:151 [datastore.py:open_for_write():87] open: /kaggle/working/wandb/run-20240720_030439-i2zat45f/run-i2zat45f.wandb | |
| 2024-07-20 03:04:40,060 DEBUG SenderThread:151 [sender.py:send():379] send: header | |
| 2024-07-20 03:04:40,062 DEBUG SenderThread:151 [sender.py:send():379] send: run | |
| 2024-07-20 03:04:40,574 INFO SenderThread:151 [dir_watcher.py:__init__():211] watching files in: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files | |
| 2024-07-20 03:04:40,574 INFO SenderThread:151 [sender.py:_start_run_threads():1188] run started: i2zat45f with start time 1721444679.456622 | |
| 2024-07-20 03:04:40,584 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: check_version | |
| 2024-07-20 03:04:40,584 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: check_version | |
| 2024-07-20 03:04:40,659 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: run_start | |
| 2024-07-20 03:04:40,671 DEBUG HandlerThread:151 [system_info.py:__init__():26] System info init | |
| 2024-07-20 03:04:40,671 DEBUG HandlerThread:151 [system_info.py:__init__():41] System info init done | |
| 2024-07-20 03:04:40,671 INFO HandlerThread:151 [system_monitor.py:start():194] Starting system monitor | |
| 2024-07-20 03:04:40,672 INFO SystemMonitor:151 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2024-07-20 03:04:40,672 INFO HandlerThread:151 [system_monitor.py:probe():214] Collecting system info | |
| 2024-07-20 03:04:40,672 INFO SystemMonitor:151 [interfaces.py:start():188] Started cpu monitoring | |
| 2024-07-20 03:04:40,673 INFO SystemMonitor:151 [interfaces.py:start():188] Started disk monitoring | |
| 2024-07-20 03:04:40,675 INFO SystemMonitor:151 [interfaces.py:start():188] Started gpu monitoring | |
| 2024-07-20 03:04:40,675 INFO SystemMonitor:151 [interfaces.py:start():188] Started memory monitoring | |
| 2024-07-20 03:04:40,676 INFO SystemMonitor:151 [interfaces.py:start():188] Started network monitoring | |
| 2024-07-20 03:04:40,686 DEBUG HandlerThread:151 [system_info.py:probe():152] Probing system | |
| 2024-07-20 03:04:40,688 DEBUG HandlerThread:151 [gitlib.py:_init_repo():56] git repository is invalid | |
| 2024-07-20 03:04:40,688 DEBUG HandlerThread:151 [system_info.py:probe():200] Probing system done | |
| 2024-07-20 03:04:40,688 DEBUG HandlerThread:151 [system_monitor.py:probe():223] {'os': 'Linux-5.15.154+-x86_64-with-glibc2.31', 'python': '3.10.13', 'heartbeatAt': '2024-07-20T03:04:40.686502', 'startedAt': '2024-07-20T03:04:39.447455', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'kaggle.ipynb', 'codePathLocal': None, 'root': '/kaggle/working', 'host': '6748368f09b6', 'username': 'root', 'executable': '/opt/conda/bin/python3.10', 'cpu_count': 2, 'cpu_count_logical': 4, 'cpu_freq': {'current': 2000.162, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2000.162, 'min': 0.0, 'max': 0.0}, {'current': 2000.162, 'min': 0.0, 'max': 0.0}, {'current': 2000.162, 'min': 0.0, 'max': 0.0}, {'current': 2000.162, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 8062.387607574463, 'used': 5777.482231140137}}, 'gpu': 'Tesla P100-PCIE-16GB', 'gpu_count': 1, 'gpu_devices': [{'name': 'Tesla P100-PCIE-16GB', 'memory_total': 17179869184}], 'memory': {'total': 31.35757827758789}} | |
| 2024-07-20 03:04:40,688 INFO HandlerThread:151 [system_monitor.py:probe():224] Finished collecting system info | |
| 2024-07-20 03:04:40,688 INFO HandlerThread:151 [system_monitor.py:probe():227] Publishing system info | |
| 2024-07-20 03:04:40,688 DEBUG HandlerThread:151 [system_info.py:_save_conda():209] Saving list of conda packages installed into the current environment | |
| 2024-07-20 03:04:41,576 INFO Thread-12 :151 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/conda-environment.yaml | |
| 2024-07-20 03:04:55,703 ERROR HandlerThread:151 [system_info.py:_save_conda():223] Error saving conda packages: Command '['conda', 'env', 'export']' timed out after 15 seconds | |
| Traceback (most recent call last): | |
| File "/opt/conda/lib/python3.10/site-packages/wandb/sdk/internal/system/system_info.py", line 216, in _save_conda | |
| subprocess.call( | |
| File "/opt/conda/lib/python3.10/subprocess.py", line 347, in call | |
| return p.wait(timeout=timeout) | |
| File "/opt/conda/lib/python3.10/subprocess.py", line 1209, in wait | |
| return self._wait(timeout=timeout) | |
| File "/opt/conda/lib/python3.10/subprocess.py", line 1951, in _wait | |
| raise TimeoutExpired(self.args, timeout) | |
| subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after 15 seconds | |
| 2024-07-20 03:04:55,706 DEBUG HandlerThread:151 [system_info.py:_save_conda():224] Saving conda packages done | |
| 2024-07-20 03:04:55,706 INFO HandlerThread:151 [system_monitor.py:probe():229] Finished publishing system info | |
| 2024-07-20 03:04:55,714 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:04:55,714 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: keepalive | |
| 2024-07-20 03:04:55,714 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:04:55,714 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: keepalive | |
| 2024-07-20 03:04:55,714 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:04:55,714 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: keepalive | |
| 2024-07-20 03:04:55,715 DEBUG SenderThread:151 [sender.py:send():379] send: files | |
| 2024-07-20 03:04:55,715 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-metadata.json with policy now | |
| 2024-07-20 03:04:56,579 INFO Thread-12 :151 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-metadata.json | |
| 2024-07-20 03:04:56,688 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: python_packages | |
| 2024-07-20 03:04:56,689 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: python_packages | |
| 2024-07-20 03:04:56,691 DEBUG SenderThread:151 [sender.py:send():379] send: telemetry | |
| 2024-07-20 03:04:56,692 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:04:56,693 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:04:56,693 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:04:56,698 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: pause | |
| 2024-07-20 03:04:56,698 INFO HandlerThread:151 [handler.py:handle_request_pause():724] stopping system metrics thread | |
| 2024-07-20 03:04:56,698 INFO HandlerThread:151 [system_monitor.py:finish():203] Stopping system monitor | |
| 2024-07-20 03:04:56,699 DEBUG SystemMonitor:151 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2024-07-20 03:04:56,699 DEBUG SystemMonitor:151 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2024-07-20 03:04:56,699 DEBUG SystemMonitor:151 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2024-07-20 03:04:56,700 INFO HandlerThread:151 [interfaces.py:finish():200] Joined cpu monitor | |
| 2024-07-20 03:04:56,700 INFO HandlerThread:151 [interfaces.py:finish():200] Joined disk monitor | |
| 2024-07-20 03:04:56,706 INFO HandlerThread:151 [interfaces.py:finish():200] Joined gpu monitor | |
| 2024-07-20 03:04:56,706 INFO HandlerThread:151 [interfaces.py:finish():200] Joined memory monitor | |
| 2024-07-20 03:04:56,706 INFO HandlerThread:151 [interfaces.py:finish():200] Joined network monitor | |
| 2024-07-20 03:04:56,739 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: resume | |
| 2024-07-20 03:04:56,739 INFO HandlerThread:151 [handler.py:handle_request_resume():715] starting system metrics thread | |
| 2024-07-20 03:04:56,739 INFO HandlerThread:151 [system_monitor.py:start():194] Starting system monitor | |
| 2024-07-20 03:04:56,739 INFO SystemMonitor:151 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2024-07-20 03:04:56,740 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: pause | |
| 2024-07-20 03:04:56,740 INFO HandlerThread:151 [handler.py:handle_request_pause():724] stopping system metrics thread | |
| 2024-07-20 03:04:56,740 INFO SystemMonitor:151 [interfaces.py:start():188] Started cpu monitoring | |
| 2024-07-20 03:04:56,740 INFO HandlerThread:151 [system_monitor.py:finish():203] Stopping system monitor | |
| 2024-07-20 03:04:56,741 INFO SystemMonitor:151 [interfaces.py:start():188] Started disk monitoring | |
| 2024-07-20 03:04:56,742 DEBUG SystemMonitor:151 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2024-07-20 03:04:56,742 DEBUG SystemMonitor:151 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2024-07-20 03:04:56,742 DEBUG SystemMonitor:151 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2024-07-20 03:04:56,743 INFO HandlerThread:151 [interfaces.py:finish():200] Joined cpu monitor | |
| 2024-07-20 03:04:56,745 INFO HandlerThread:151 [interfaces.py:finish():200] Joined disk monitor | |
| 2024-07-20 03:04:56,745 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: resume | |
| 2024-07-20 03:04:56,745 INFO HandlerThread:151 [handler.py:handle_request_resume():715] starting system metrics thread | |
| 2024-07-20 03:04:56,745 INFO HandlerThread:151 [system_monitor.py:start():194] Starting system monitor | |
| 2024-07-20 03:04:56,745 INFO SystemMonitor:151 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2024-07-20 03:04:56,746 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: pause | |
| 2024-07-20 03:04:56,746 INFO HandlerThread:151 [handler.py:handle_request_pause():724] stopping system metrics thread | |
| 2024-07-20 03:04:56,746 INFO HandlerThread:151 [system_monitor.py:finish():203] Stopping system monitor | |
| 2024-07-20 03:04:56,746 WARNING HandlerThread:151 [interfaces.py:finish():205] Failed to finish cpu monitoring: cannot join thread before it is started | |
| 2024-07-20 03:04:56,746 INFO SystemMonitor:151 [interfaces.py:start():188] Started cpu monitoring | |
| 2024-07-20 03:04:56,746 DEBUG SystemMonitor:151 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2024-07-20 03:04:56,746 DEBUG SystemMonitor:151 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2024-07-20 03:04:56,746 DEBUG SystemMonitor:151 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2024-07-20 03:04:56,747 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: resume | |
| 2024-07-20 03:04:56,747 INFO HandlerThread:151 [handler.py:handle_request_resume():715] starting system metrics thread | |
| 2024-07-20 03:04:56,747 INFO HandlerThread:151 [system_monitor.py:start():194] Starting system monitor | |
| 2024-07-20 03:04:56,747 INFO SystemMonitor:151 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2024-07-20 03:04:56,748 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: pause | |
| 2024-07-20 03:04:56,748 INFO SystemMonitor:151 [interfaces.py:start():188] Started cpu monitoring | |
| 2024-07-20 03:04:56,749 INFO HandlerThread:151 [handler.py:handle_request_pause():724] stopping system metrics thread | |
| 2024-07-20 03:04:56,750 INFO HandlerThread:151 [system_monitor.py:finish():203] Stopping system monitor | |
| 2024-07-20 03:04:56,750 INFO SystemMonitor:151 [interfaces.py:start():188] Started disk monitoring | |
| 2024-07-20 03:04:56,750 DEBUG SystemMonitor:151 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2024-07-20 03:04:56,750 DEBUG SystemMonitor:151 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2024-07-20 03:04:56,750 DEBUG SystemMonitor:151 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2024-07-20 03:04:56,753 INFO HandlerThread:151 [interfaces.py:finish():200] Joined cpu monitor | |
| 2024-07-20 03:04:56,753 INFO HandlerThread:151 [interfaces.py:finish():200] Joined disk monitor | |
| 2024-07-20 03:04:56,756 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: resume | |
| 2024-07-20 03:04:56,756 INFO HandlerThread:151 [handler.py:handle_request_resume():715] starting system metrics thread | |
| 2024-07-20 03:04:56,757 INFO HandlerThread:151 [system_monitor.py:start():194] Starting system monitor | |
| 2024-07-20 03:04:56,757 INFO SystemMonitor:151 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2024-07-20 03:04:56,757 INFO SystemMonitor:151 [interfaces.py:start():188] Started cpu monitoring | |
| 2024-07-20 03:04:56,757 INFO SystemMonitor:151 [interfaces.py:start():188] Started disk monitoring | |
| 2024-07-20 03:04:56,758 INFO SystemMonitor:151 [interfaces.py:start():188] Started gpu monitoring | |
| 2024-07-20 03:04:56,758 INFO SystemMonitor:151 [interfaces.py:start():188] Started memory monitoring | |
| 2024-07-20 03:04:56,759 INFO SystemMonitor:151 [interfaces.py:start():188] Started network monitoring | |
| 2024-07-20 03:04:56,762 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: pause | |
| 2024-07-20 03:04:56,762 INFO HandlerThread:151 [handler.py:handle_request_pause():724] stopping system metrics thread | |
| 2024-07-20 03:04:56,762 INFO HandlerThread:151 [system_monitor.py:finish():203] Stopping system monitor | |
| 2024-07-20 03:04:56,763 DEBUG SystemMonitor:151 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2024-07-20 03:04:56,763 DEBUG SystemMonitor:151 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2024-07-20 03:04:56,763 DEBUG SystemMonitor:151 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2024-07-20 03:04:56,764 INFO HandlerThread:151 [interfaces.py:finish():200] Joined cpu monitor | |
| 2024-07-20 03:04:56,765 INFO HandlerThread:151 [interfaces.py:finish():200] Joined disk monitor | |
| 2024-07-20 03:04:56,773 INFO HandlerThread:151 [interfaces.py:finish():200] Joined gpu monitor | |
| 2024-07-20 03:04:56,773 INFO HandlerThread:151 [interfaces.py:finish():200] Joined memory monitor | |
| 2024-07-20 03:04:56,773 INFO HandlerThread:151 [interfaces.py:finish():200] Joined network monitor | |
| 2024-07-20 03:04:56,774 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: resume | |
| 2024-07-20 03:04:56,774 INFO HandlerThread:151 [handler.py:handle_request_resume():715] starting system metrics thread | |
| 2024-07-20 03:04:56,774 INFO HandlerThread:151 [system_monitor.py:start():194] Starting system monitor | |
| 2024-07-20 03:04:56,774 INFO SystemMonitor:151 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2024-07-20 03:04:56,774 INFO SystemMonitor:151 [interfaces.py:start():188] Started cpu monitoring | |
| 2024-07-20 03:04:56,775 INFO SystemMonitor:151 [interfaces.py:start():188] Started disk monitoring | |
| 2024-07-20 03:04:56,775 INFO SystemMonitor:151 [interfaces.py:start():188] Started gpu monitoring | |
| 2024-07-20 03:04:56,776 INFO SystemMonitor:151 [interfaces.py:start():188] Started memory monitoring | |
| 2024-07-20 03:04:56,777 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: pause | |
| 2024-07-20 03:04:56,778 INFO HandlerThread:151 [handler.py:handle_request_pause():724] stopping system metrics thread | |
| 2024-07-20 03:04:56,778 INFO HandlerThread:151 [system_monitor.py:finish():203] Stopping system monitor | |
| 2024-07-20 03:04:56,778 INFO SystemMonitor:151 [interfaces.py:start():188] Started network monitoring | |
| 2024-07-20 03:04:56,779 DEBUG SystemMonitor:151 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2024-07-20 03:04:56,779 INFO HandlerThread:151 [interfaces.py:finish():200] Joined cpu monitor | |
| 2024-07-20 03:04:56,779 DEBUG SystemMonitor:151 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2024-07-20 03:04:56,780 DEBUG SystemMonitor:151 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2024-07-20 03:04:56,784 INFO HandlerThread:151 [interfaces.py:finish():200] Joined disk monitor | |
| 2024-07-20 03:04:56,789 INFO HandlerThread:151 [interfaces.py:finish():200] Joined gpu monitor | |
| 2024-07-20 03:04:56,789 INFO HandlerThread:151 [interfaces.py:finish():200] Joined memory monitor | |
| 2024-07-20 03:04:56,789 INFO HandlerThread:151 [interfaces.py:finish():200] Joined network monitor | |
| 2024-07-20 03:04:56,789 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: resume | |
| 2024-07-20 03:04:56,789 INFO HandlerThread:151 [handler.py:handle_request_resume():715] starting system metrics thread | |
| 2024-07-20 03:04:56,789 INFO HandlerThread:151 [system_monitor.py:start():194] Starting system monitor | |
| 2024-07-20 03:04:56,790 INFO SystemMonitor:151 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2024-07-20 03:04:56,790 INFO SystemMonitor:151 [interfaces.py:start():188] Started cpu monitoring | |
| 2024-07-20 03:04:56,791 INFO SystemMonitor:151 [interfaces.py:start():188] Started disk monitoring | |
| 2024-07-20 03:04:56,791 INFO SystemMonitor:151 [interfaces.py:start():188] Started gpu monitoring | |
| 2024-07-20 03:04:56,792 INFO SystemMonitor:151 [interfaces.py:start():188] Started memory monitoring | |
| 2024-07-20 03:04:56,793 INFO SystemMonitor:151 [interfaces.py:start():188] Started network monitoring | |
| 2024-07-20 03:04:56,988 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:04:56,989 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:04:56,990 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:04:56,990 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:04:56,990 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:04:57,228 INFO wandb-upload_0:151 [upload_job.py:push():130] Uploaded file /tmp/tmpe1k00dp5wandb/1l73g1q4-wandb-metadata.json | |
| 2024-07-20 03:04:57,398 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: pause | |
| 2024-07-20 03:04:57,398 INFO HandlerThread:151 [handler.py:handle_request_pause():724] stopping system metrics thread | |
| 2024-07-20 03:04:57,398 INFO HandlerThread:151 [system_monitor.py:finish():203] Stopping system monitor | |
| 2024-07-20 03:04:57,399 DEBUG SystemMonitor:151 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2024-07-20 03:04:57,399 INFO HandlerThread:151 [interfaces.py:finish():200] Joined cpu monitor | |
| 2024-07-20 03:04:57,399 DEBUG SystemMonitor:151 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2024-07-20 03:04:57,399 INFO HandlerThread:151 [interfaces.py:finish():200] Joined disk monitor | |
| 2024-07-20 03:04:57,400 DEBUG SystemMonitor:151 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2024-07-20 03:04:57,406 INFO HandlerThread:151 [interfaces.py:finish():200] Joined gpu monitor | |
| 2024-07-20 03:04:57,407 INFO HandlerThread:151 [interfaces.py:finish():200] Joined memory monitor | |
| 2024-07-20 03:04:57,407 INFO HandlerThread:151 [interfaces.py:finish():200] Joined network monitor | |
| 2024-07-20 03:04:57,407 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: resume | |
| 2024-07-20 03:04:57,407 INFO HandlerThread:151 [handler.py:handle_request_resume():715] starting system metrics thread | |
| 2024-07-20 03:04:57,407 INFO HandlerThread:151 [system_monitor.py:start():194] Starting system monitor | |
| 2024-07-20 03:04:57,407 INFO SystemMonitor:151 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2024-07-20 03:04:57,408 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:04:57,409 INFO SystemMonitor:151 [interfaces.py:start():188] Started cpu monitoring | |
| 2024-07-20 03:04:57,409 INFO SystemMonitor:151 [interfaces.py:start():188] Started disk monitoring | |
| 2024-07-20 03:04:57,409 INFO SystemMonitor:151 [interfaces.py:start():188] Started gpu monitoring | |
| 2024-07-20 03:04:57,410 INFO SystemMonitor:151 [interfaces.py:start():188] Started memory monitoring | |
| 2024-07-20 03:04:57,411 INFO SystemMonitor:151 [interfaces.py:start():188] Started network monitoring | |
| 2024-07-20 03:04:57,579 INFO Thread-12 :151 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/output.log | |
| 2024-07-20 03:04:57,579 INFO Thread-12 :151 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/requirements.txt | |
| 2024-07-20 03:04:57,761 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:04:57,950 DEBUG SenderThread:151 [sender.py:send():379] send: config | |
| 2024-07-20 03:04:57,951 DEBUG SenderThread:151 [sender.py:send():379] send: telemetry | |
| 2024-07-20 03:04:57,951 DEBUG SenderThread:151 [sender.py:send():379] send: metric | |
| 2024-07-20 03:04:57,952 DEBUG SenderThread:151 [sender.py:send():379] send: telemetry | |
| 2024-07-20 03:04:57,952 DEBUG SenderThread:151 [sender.py:send():379] send: metric | |
| 2024-07-20 03:04:57,952 WARNING SenderThread:151 [sender.py:send_metric():1405] Seen metric with glob (shouldn't happen) | |
| 2024-07-20 03:04:57,952 DEBUG SenderThread:151 [sender.py:send():379] send: telemetry | |
| 2024-07-20 03:04:58,243 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: log_artifact | |
| 2024-07-20 03:04:58,243 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: log_artifact | |
| 2024-07-20 03:04:58,484 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: log_artifact | |
| 2024-07-20 03:04:58,748 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:04:59,580 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/output.log | |
| 2024-07-20 03:04:59,749 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:00,749 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:00,854 INFO wandb-upload_0:151 [upload_job.py:push():88] Uploaded file /tmp/tmp3l8cxe4y/model_architecture.txt | |
| 2024-07-20 03:05:01,698 INFO SenderThread:151 [sender.py:send_request_log_artifact():1518] logged artifact model-i2zat45f - {'id': 'QXJ0aWZhY3Q6MTAwNDY3MDUwMw==', 'state': 'PENDING', 'artifactSequence': {'id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjI5MzU1MTIxMA==', 'latestArtifact': None}} | |
| 2024-07-20 03:05:01,698 DEBUG SenderThread:151 [sender.py:send():379] send: config | |
| 2024-07-20 03:05:01,699 DEBUG SenderThread:151 [sender.py:send():379] send: metric | |
| 2024-07-20 03:05:01,700 DEBUG SenderThread:151 [sender.py:send():379] send: metric | |
| 2024-07-20 03:05:01,700 WARNING SenderThread:151 [sender.py:send_metric():1405] Seen metric with glob (shouldn't happen) | |
| 2024-07-20 03:05:01,700 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: log_artifact | |
| 2024-07-20 03:05:01,705 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:01,749 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:01,950 INFO SenderThread:151 [sender.py:send_request_log_artifact():1518] logged artifact model-i2zat45f - {'id': 'QXJ0aWZhY3Q6MTAwNDY3MDUwMw==', 'state': 'COMMITTED', 'artifactSequence': {'id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjI5MzU1MTIxMA==', 'latestArtifact': {'id': 'QXJ0aWZhY3Q6MTAwNDY3MDUwMw==', 'versionIndex': 0}}} | |
| 2024-07-20 03:05:02,749 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:03,124 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:03,126 DEBUG SenderThread:151 [sender.py:send():379] send: metric | |
| 2024-07-20 03:05:03,126 DEBUG SenderThread:151 [sender.py:send():379] send: metric | |
| 2024-07-20 03:05:03,126 DEBUG SenderThread:151 [sender.py:send():379] send: metric | |
| 2024-07-20 03:05:03,127 DEBUG SenderThread:151 [sender.py:send():379] send: metric | |
| 2024-07-20 03:05:03,127 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:03,127 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:03,129 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:03,164 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:03,165 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:03,165 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:03,165 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:03,581 INFO Thread-12 :151 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:03,749 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:04,749 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:05,129 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:05,130 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:05,130 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:05,133 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:05,170 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:05,171 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:05,171 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:05,171 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:05,582 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:05,749 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:06,749 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:07,115 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:07,116 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:07,117 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:07,117 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:07,117 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:07,156 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:07,157 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:07,157 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:07,158 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:07,583 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:07,750 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:08,750 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:09,467 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:09,468 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:09,468 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:09,470 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:09,508 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:09,509 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:09,509 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:09,509 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:09,584 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:09,750 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:10,753 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:11,649 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:11,650 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:11,651 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:11,653 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:11,690 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:11,690 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:05:11,691 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:11,691 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:11,691 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:11,692 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:05:11,753 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:12,585 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:12,753 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:12,932 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:13,586 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/config.yaml | |
| 2024-07-20 03:05:13,753 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:13,918 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:13,919 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:13,919 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:13,920 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:13,959 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:13,959 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:13,960 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:13,960 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:14,586 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:14,754 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:15,754 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:15,901 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:15,902 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:15,902 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:15,904 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:15,942 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:15,943 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:15,943 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:15,943 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:16,587 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:16,754 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:17,754 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:17,871 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:17,872 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:17,872 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:17,872 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:17,911 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:17,912 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:17,912 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:17,914 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:18,588 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:18,754 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:18,914 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:19,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:20,179 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:20,180 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:20,180 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:20,182 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:20,219 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:20,220 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:20,220 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:20,220 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:20,589 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:20,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:21,071 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:21,072 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:21,072 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:21,073 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:21,111 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:21,112 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:05:21,112 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:21,112 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:05:21,590 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:21,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:22,791 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:23,791 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:24,692 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:24,960 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:25,968 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:26,689 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:05:26,690 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:05:27,785 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:29,996 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:32,541 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:34,892 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:35,541 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:38,733 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:38,990 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:39,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:40,625 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:40,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:41,690 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:05:41,690 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:05:41,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:42,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:43,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:44,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:45,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:46,163 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:46,755 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:47,756 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:48,756 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:49,756 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:50,756 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:51,163 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:51,756 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:52,756 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:53,757 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:54,757 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:55,757 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:56,163 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:05:56,690 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:05:56,690 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:05:56,757 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:57,231 DEBUG SenderThread:151 [sender.py:send():379] send: telemetry | |
| 2024-07-20 03:05:57,273 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:57,274 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: partial_history | |
| 2024-07-20 03:05:57,276 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:05:57,411 DEBUG SystemMonitor:151 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2024-07-20 03:05:57,604 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:05:57,757 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:58,757 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:05:59,757 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:00,757 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:01,757 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:02,758 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:03,758 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:04,758 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:05,758 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:06,758 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:07,758 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:08,758 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:09,758 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:10,759 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:11,690 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:06:11,759 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:12,759 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:13,759 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:14,759 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:15,275 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,276 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,278 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,278 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,279 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:06:15,318 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,318 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,319 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,319 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,324 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,324 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:06:15,324 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,510 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,511 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,511 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,512 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,516 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,517 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,553 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,554 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,554 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,554 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,557 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,557 DEBUG SenderThread:151 [sender.py:send():379] send: history | |
| 2024-07-20 03:06:15,557 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: summary_record | |
| 2024-07-20 03:06:15,593 INFO SenderThread:151 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end | |
| 2024-07-20 03:06:15,594 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:06:15,594 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:06:15,611 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/wandb-summary.json | |
| 2024-07-20 03:06:15,759 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:16,759 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:17,760 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:18,760 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:19,760 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:20,760 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:20,881 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:06:21,613 INFO Thread-12 :151 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240720_030439-i2zat45f/files/config.yaml | |
| 2024-07-20 03:06:21,760 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:22,760 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:23,760 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:24,761 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:25,761 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:26,378 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:06:26,690 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:06:26,690 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:06:26,761 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:27,413 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:06:27,761 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:28,761 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:29,761 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:30,761 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:31,414 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:06:31,762 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:32,762 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:33,762 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:34,762 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:35,762 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:36,415 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:06:36,762 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:37,763 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:38,763 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:39,763 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:40,763 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:41,417 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:06:41,690 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:06:41,691 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:06:41,763 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:42,763 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:43,763 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:44,764 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:45,764 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:46,764 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:46,919 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:06:47,764 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:48,764 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:49,765 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:50,765 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:51,765 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:51,921 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:06:52,765 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:53,765 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:54,765 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:55,766 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:56,690 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:06:56,691 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:06:56,766 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:56,996 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:06:57,414 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:06:57,766 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:58,766 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:06:59,766 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:00,766 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:01,767 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:02,415 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:02,767 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:03,767 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:04,767 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:05,767 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:06,767 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:07,416 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:07,767 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:08,768 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:09,768 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:10,768 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:11,690 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:07:11,691 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:07:11,768 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:12,768 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:12,948 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:13,769 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:14,769 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:15,769 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:16,769 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:17,769 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:17,949 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:18,773 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:19,770 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:20,770 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:21,770 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:22,770 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:22,950 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:23,771 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:24,771 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:25,771 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:26,691 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:07:26,691 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:07:26,771 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:27,415 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:07:27,771 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:28,415 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:28,772 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:29,772 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:30,772 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:31,772 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:32,772 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:33,416 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:33,772 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:34,773 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:35,773 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:36,773 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:37,773 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:38,417 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:38,773 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:39,773 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:40,774 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:41,691 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:07:41,691 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:07:41,774 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:42,774 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:43,774 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:43,985 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:44,774 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:45,774 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:46,774 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:47,775 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:48,775 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:48,986 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:49,775 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:50,775 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:51,775 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:52,776 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:53,776 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:53,987 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:54,776 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:55,776 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:56,691 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:07:56,691 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:07:56,776 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:57,422 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:07:57,777 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:58,777 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:07:59,423 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:07:59,777 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:00,777 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:01,778 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:02,778 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:03,778 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:04,424 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:08:04,778 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:05,778 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:06,778 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:07,778 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:08,779 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:09,425 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:08:09,779 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:10,779 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:11,691 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:08:11,692 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:08:11,779 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:12,779 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:13,779 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:14,780 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:14,927 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:08:15,780 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:16,780 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:17,780 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:18,780 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:19,780 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:19,928 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:08:20,781 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:21,781 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:22,781 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:23,781 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:24,781 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:24,929 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:08:25,782 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:26,691 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:08:26,692 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:08:26,782 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:27,416 DEBUG SenderThread:151 [sender.py:send():379] send: stats | |
| 2024-07-20 03:08:27,782 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:28,783 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:29,782 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:30,417 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:08:30,783 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:31,783 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:32,783 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:33,783 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:34,784 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:35,418 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:08:35,783 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:36,784 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:37,784 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:38,784 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:39,784 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:40,419 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:08:40,784 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:41,692 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: stop_status | |
| 2024-07-20 03:08:41,692 DEBUG SenderThread:151 [sender.py:send_request():406] send_request: stop_status | |
| 2024-07-20 03:08:41,785 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:42,785 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:43,785 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:44,785 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:45,785 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:45,924 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: status_report | |
| 2024-07-20 03:08:46,785 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |
| 2024-07-20 03:08:47,786 DEBUG HandlerThread:151 [handler.py:handle_request():158] handle_request: internal_messages | |