2024-07-23 05:35:19,421 INFO StreamThr :143 [internal.py:wandb_internal():85] W&B internal server running at pid: 143, started at: 2024-07-23 05:35:19.420639 2024-07-23 05:35:19,423 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status 2024-07-23 05:35:20,821 INFO WriterThread:143 [datastore.py:open_for_write():87] open: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/run-y8n6g3ud.wandb 2024-07-23 05:35:20,823 DEBUG SenderThread:143 [sender.py:send():379] send: header 2024-07-23 05:35:20,825 DEBUG SenderThread:143 [sender.py:send():379] send: run 2024-07-23 05:35:21,254 INFO SenderThread:143 [dir_watcher.py:__init__():211] watching files in: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files 2024-07-23 05:35:21,254 INFO SenderThread:143 [sender.py:_start_run_threads():1188] run started: y8n6g3ud with start time 1721712919.421739 2024-07-23 05:35:21,265 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: check_version 2024-07-23 05:35:21,265 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: check_version 2024-07-23 05:35:21,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: run_start 2024-07-23 05:35:21,367 DEBUG HandlerThread:143 [system_info.py:__init__():26] System info init 2024-07-23 05:35:21,367 DEBUG HandlerThread:143 [system_info.py:__init__():41] System info init done 2024-07-23 05:35:21,367 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor 2024-07-23 05:35:21,367 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-07-23 05:35:21,367 INFO HandlerThread:143 [system_monitor.py:probe():214] Collecting system info 2024-07-23 05:35:21,368 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring 2024-07-23 05:35:21,368 INFO SystemMonitor:143 [interfaces.py:start():188] Started disk monitoring 2024-07-23 05:35:21,370 INFO SystemMonitor:143 [interfaces.py:start():188] Started gpu monitoring 2024-07-23 05:35:21,370 INFO SystemMonitor:143 [interfaces.py:start():188] Started memory monitoring 2024-07-23 05:35:21,371 INFO SystemMonitor:143 [interfaces.py:start():188] Started network monitoring 2024-07-23 05:35:21,375 DEBUG HandlerThread:143 [system_info.py:probe():152] Probing system 2024-07-23 05:35:21,378 DEBUG HandlerThread:143 [gitlib.py:_init_repo():56] git repository is invalid 2024-07-23 05:35:21,378 DEBUG HandlerThread:143 [system_info.py:probe():200] Probing system done 2024-07-23 05:35:21,378 DEBUG HandlerThread:143 [system_monitor.py:probe():223] {'os': 'Linux-5.15.154+-x86_64-with-glibc2.31', 'python': '3.10.13', 'heartbeatAt': '2024-07-23T05:35:21.376053', 'startedAt': '2024-07-23T05:35:19.411966', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'kaggle.ipynb', 'codePathLocal': None, 'root': '/kaggle/working', 'host': '44256026bb01', 'username': 'root', 'executable': '/opt/conda/bin/python3.10', 'cpu_count': 2, 'cpu_count_logical': 4, 'cpu_freq': {'current': 2000.188, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2000.188, 'min': 0.0, 'max': 0.0}, {'current': 2000.188, 'min': 0.0, 'max': 0.0}, {'current': 2000.188, 'min': 0.0, 'max': 0.0}, {'current': 2000.188, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 8062.387607574463, 'used': 5777.482234954834}}, 'gpu': 'Tesla P100-PCIE-16GB', 'gpu_count': 1, 'gpu_devices': [{'name': 'Tesla P100-PCIE-16GB', 'memory_total': 17179869184}], 'memory': {'total': 31.357574462890625}} 2024-07-23 05:35:21,378 INFO HandlerThread:143 [system_monitor.py:probe():224] Finished collecting system info 2024-07-23 05:35:21,378 INFO HandlerThread:143 [system_monitor.py:probe():227] Publishing system info 2024-07-23 05:35:21,378 DEBUG HandlerThread:143 [system_info.py:_save_conda():209] Saving list of conda packages installed into the current environment 2024-07-23 05:35:22,256 INFO Thread-12 :143 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/conda-environment.yaml 2024-07-23 05:35:36,392 ERROR HandlerThread:143 [system_info.py:_save_conda():223] Error saving conda packages: Command '['conda', 'env', 'export']' timed out after 15 seconds Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/wandb/sdk/internal/system/system_info.py", line 216, in _save_conda subprocess.call( File "/opt/conda/lib/python3.10/subprocess.py", line 347, in call return p.wait(timeout=timeout) File "/opt/conda/lib/python3.10/subprocess.py", line 1209, in wait return self._wait(timeout=timeout) File "/opt/conda/lib/python3.10/subprocess.py", line 1951, in _wait raise TimeoutExpired(self.args, timeout) subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after 15 seconds 2024-07-23 05:35:36,394 DEBUG HandlerThread:143 [system_info.py:_save_conda():224] Saving conda packages done 2024-07-23 05:35:36,395 INFO HandlerThread:143 [system_monitor.py:probe():229] Finished publishing system info 2024-07-23 05:35:36,402 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:35:36,402 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: keepalive 2024-07-23 05:35:36,403 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:35:36,403 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: keepalive 2024-07-23 05:35:36,403 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:35:36,403 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: keepalive 2024-07-23 05:35:36,403 DEBUG SenderThread:143 [sender.py:send():379] send: files 2024-07-23 05:35:36,404 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-metadata.json with policy now 2024-07-23 05:35:37,260 INFO Thread-12 :143 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/wandb-metadata.json 2024-07-23 05:35:37,349 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: python_packages 2024-07-23 05:35:37,349 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: python_packages 2024-07-23 05:35:37,351 DEBUG SenderThread:143 [sender.py:send():379] send: telemetry 2024-07-23 05:35:37,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:35:37,353 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:35:37,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:37,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: pause 2024-07-23 05:35:37,359 INFO HandlerThread:143 [handler.py:handle_request_pause():724] stopping system metrics thread 2024-07-23 05:35:37,359 INFO HandlerThread:143 [system_monitor.py:finish():203] Stopping system monitor 2024-07-23 05:35:37,359 DEBUG SystemMonitor:143 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-07-23 05:35:37,359 DEBUG SystemMonitor:143 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-07-23 05:35:37,359 DEBUG SystemMonitor:143 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-07-23 05:35:37,359 INFO HandlerThread:143 [interfaces.py:finish():200] Joined cpu monitor 2024-07-23 05:35:37,362 INFO HandlerThread:143 [interfaces.py:finish():200] Joined disk monitor 2024-07-23 05:35:37,365 INFO HandlerThread:143 [interfaces.py:finish():200] Joined gpu monitor 2024-07-23 05:35:37,366 INFO HandlerThread:143 [interfaces.py:finish():200] Joined memory monitor 2024-07-23 05:35:37,366 INFO HandlerThread:143 [interfaces.py:finish():200] Joined network monitor 2024-07-23 05:35:37,399 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: resume 2024-07-23 05:35:37,399 INFO HandlerThread:143 [handler.py:handle_request_resume():715] starting system metrics thread 2024-07-23 05:35:37,399 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor 2024-07-23 05:35:37,399 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-07-23 05:35:37,400 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring 2024-07-23 05:35:37,400 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: pause 2024-07-23 05:35:37,400 INFO HandlerThread:143 [handler.py:handle_request_pause():724] stopping system metrics thread 2024-07-23 05:35:37,400 INFO HandlerThread:143 [system_monitor.py:finish():203] Stopping system monitor 2024-07-23 05:35:37,400 INFO SystemMonitor:143 [interfaces.py:start():188] Started disk monitoring 2024-07-23 05:35:37,400 DEBUG SystemMonitor:143 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-07-23 05:35:37,400 DEBUG SystemMonitor:143 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-07-23 05:35:37,401 DEBUG SystemMonitor:143 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-07-23 05:35:37,402 INFO HandlerThread:143 [interfaces.py:finish():200] Joined cpu monitor 2024-07-23 05:35:37,403 INFO HandlerThread:143 [interfaces.py:finish():200] Joined disk monitor 2024-07-23 05:35:37,403 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: resume 2024-07-23 05:35:37,403 INFO HandlerThread:143 [handler.py:handle_request_resume():715] starting system metrics thread 2024-07-23 05:35:37,404 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor 2024-07-23 05:35:37,404 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-07-23 05:35:37,404 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: pause 2024-07-23 05:35:37,404 INFO HandlerThread:143 [handler.py:handle_request_pause():724] stopping system metrics thread 2024-07-23 05:35:37,404 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring 2024-07-23 05:35:37,404 INFO HandlerThread:143 [system_monitor.py:finish():203] Stopping system monitor 2024-07-23 05:35:37,405 INFO SystemMonitor:143 [interfaces.py:start():188] Started disk monitoring 2024-07-23 05:35:37,407 DEBUG SystemMonitor:143 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-07-23 05:35:37,407 DEBUG SystemMonitor:143 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-07-23 05:35:37,407 INFO HandlerThread:143 [interfaces.py:finish():200] Joined cpu monitor 2024-07-23 05:35:37,408 DEBUG SystemMonitor:143 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-07-23 05:35:37,408 INFO HandlerThread:143 [interfaces.py:finish():200] Joined disk monitor 2024-07-23 05:35:37,409 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: resume 2024-07-23 05:35:37,409 INFO HandlerThread:143 [handler.py:handle_request_resume():715] starting system metrics thread 2024-07-23 05:35:37,409 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor 2024-07-23 05:35:37,409 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-07-23 05:35:37,410 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: pause 2024-07-23 05:35:37,410 INFO HandlerThread:143 [handler.py:handle_request_pause():724] stopping system metrics thread 2024-07-23 05:35:37,410 INFO HandlerThread:143 [system_monitor.py:finish():203] Stopping system monitor 2024-07-23 05:35:37,410 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring 2024-07-23 05:35:37,410 DEBUG SystemMonitor:143 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-07-23 05:35:37,411 DEBUG SystemMonitor:143 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-07-23 05:35:37,411 DEBUG SystemMonitor:143 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-07-23 05:35:37,411 INFO HandlerThread:143 [interfaces.py:finish():200] Joined cpu monitor 2024-07-23 05:35:37,417 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: resume 2024-07-23 05:35:37,417 INFO HandlerThread:143 [handler.py:handle_request_resume():715] starting system metrics thread 2024-07-23 05:35:37,418 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor 2024-07-23 05:35:37,418 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-07-23 05:35:37,418 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring 2024-07-23 05:35:37,419 INFO SystemMonitor:143 [interfaces.py:start():188] Started disk monitoring 2024-07-23 05:35:37,420 INFO SystemMonitor:143 [interfaces.py:start():188] Started gpu monitoring 2024-07-23 05:35:37,420 INFO SystemMonitor:143 [interfaces.py:start():188] Started memory monitoring 2024-07-23 05:35:37,421 INFO SystemMonitor:143 [interfaces.py:start():188] Started network monitoring 2024-07-23 05:35:37,422 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: pause 2024-07-23 05:35:37,422 INFO HandlerThread:143 [handler.py:handle_request_pause():724] stopping system metrics thread 2024-07-23 05:35:37,422 INFO HandlerThread:143 [system_monitor.py:finish():203] Stopping system monitor 2024-07-23 05:35:37,423 INFO HandlerThread:143 [interfaces.py:finish():200] Joined cpu monitor 2024-07-23 05:35:37,423 INFO HandlerThread:143 [interfaces.py:finish():200] Joined disk monitor 2024-07-23 05:35:37,424 DEBUG SystemMonitor:143 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-07-23 05:35:37,424 DEBUG SystemMonitor:143 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-07-23 05:35:37,424 DEBUG SystemMonitor:143 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-07-23 05:35:37,432 INFO HandlerThread:143 [interfaces.py:finish():200] Joined gpu monitor 2024-07-23 05:35:37,432 INFO HandlerThread:143 [interfaces.py:finish():200] Joined memory monitor 2024-07-23 05:35:37,433 INFO HandlerThread:143 [interfaces.py:finish():200] Joined network monitor 2024-07-23 05:35:37,433 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: resume 2024-07-23 05:35:37,433 INFO HandlerThread:143 [handler.py:handle_request_resume():715] starting system metrics thread 2024-07-23 05:35:37,433 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor 2024-07-23 05:35:37,433 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-07-23 05:35:37,434 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring 2024-07-23 05:35:37,434 INFO SystemMonitor:143 [interfaces.py:start():188] Started disk monitoring 2024-07-23 05:35:37,435 INFO SystemMonitor:143 [interfaces.py:start():188] Started gpu monitoring 2024-07-23 05:35:37,436 INFO SystemMonitor:143 [interfaces.py:start():188] Started memory monitoring 2024-07-23 05:35:37,436 INFO SystemMonitor:143 [interfaces.py:start():188] Started network monitoring 2024-07-23 05:35:37,436 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: pause 2024-07-23 05:35:37,437 INFO HandlerThread:143 [handler.py:handle_request_pause():724] stopping system metrics thread 2024-07-23 05:35:37,437 INFO HandlerThread:143 [system_monitor.py:finish():203] Stopping system monitor 2024-07-23 05:35:37,437 DEBUG SystemMonitor:143 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-07-23 05:35:37,437 DEBUG SystemMonitor:143 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-07-23 05:35:37,439 DEBUG SystemMonitor:143 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-07-23 05:35:37,442 INFO HandlerThread:143 [interfaces.py:finish():200] Joined cpu monitor 2024-07-23 05:35:37,444 INFO HandlerThread:143 [interfaces.py:finish():200] Joined disk monitor 2024-07-23 05:35:37,453 INFO HandlerThread:143 [interfaces.py:finish():200] Joined gpu monitor 2024-07-23 05:35:37,453 INFO HandlerThread:143 [interfaces.py:finish():200] Joined memory monitor 2024-07-23 05:35:37,454 INFO HandlerThread:143 [interfaces.py:finish():200] Joined network monitor 2024-07-23 05:35:37,454 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: resume 2024-07-23 05:35:37,454 INFO HandlerThread:143 [handler.py:handle_request_resume():715] starting system metrics thread 2024-07-23 05:35:37,454 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor 2024-07-23 05:35:37,454 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-07-23 05:35:37,455 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring 2024-07-23 05:35:37,455 INFO SystemMonitor:143 [interfaces.py:start():188] Started disk monitoring 2024-07-23 05:35:37,455 INFO SystemMonitor:143 [interfaces.py:start():188] Started gpu monitoring 2024-07-23 05:35:37,456 INFO SystemMonitor:143 [interfaces.py:start():188] Started memory monitoring 2024-07-23 05:35:37,457 INFO SystemMonitor:143 [interfaces.py:start():188] Started network monitoring 2024-07-23 05:35:37,626 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:35:37,627 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:35:37,627 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:35:37,627 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:35:37,744 INFO wandb-upload_0:143 [upload_job.py:push():130] Uploaded file /tmp/tmp_xp_ohlkwandb/ulmawbjs-wandb-metadata.json 2024-07-23 05:35:38,042 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: pause 2024-07-23 05:35:38,042 INFO HandlerThread:143 [handler.py:handle_request_pause():724] stopping system metrics thread 2024-07-23 05:35:38,042 INFO HandlerThread:143 [system_monitor.py:finish():203] Stopping system monitor 2024-07-23 05:35:38,043 INFO HandlerThread:143 [interfaces.py:finish():200] Joined cpu monitor 2024-07-23 05:35:38,043 DEBUG SystemMonitor:143 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-07-23 05:35:38,043 INFO HandlerThread:143 [interfaces.py:finish():200] Joined disk monitor 2024-07-23 05:35:38,043 DEBUG SystemMonitor:143 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-07-23 05:35:38,044 DEBUG SystemMonitor:143 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-07-23 05:35:38,050 INFO HandlerThread:143 [interfaces.py:finish():200] Joined gpu monitor 2024-07-23 05:35:38,050 INFO HandlerThread:143 [interfaces.py:finish():200] Joined memory monitor 2024-07-23 05:35:38,050 INFO HandlerThread:143 [interfaces.py:finish():200] Joined network monitor 2024-07-23 05:35:38,050 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: resume 2024-07-23 05:35:38,051 INFO HandlerThread:143 [handler.py:handle_request_resume():715] starting system metrics thread 2024-07-23 05:35:38,051 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor 2024-07-23 05:35:38,051 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:35:38,052 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-07-23 05:35:38,052 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring 2024-07-23 05:35:38,052 INFO SystemMonitor:143 [interfaces.py:start():188] Started disk monitoring 2024-07-23 05:35:38,053 INFO SystemMonitor:143 [interfaces.py:start():188] Started gpu monitoring 2024-07-23 05:35:38,054 INFO SystemMonitor:143 [interfaces.py:start():188] Started memory monitoring 2024-07-23 05:35:38,055 INFO SystemMonitor:143 [interfaces.py:start():188] Started network monitoring 2024-07-23 05:35:38,260 INFO Thread-12 :143 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/output.log 2024-07-23 05:35:38,260 INFO Thread-12 :143 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/requirements.txt 2024-07-23 05:35:38,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:38,902 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: pause 2024-07-23 05:35:38,902 INFO HandlerThread:143 [handler.py:handle_request_pause():724] stopping system metrics thread 2024-07-23 05:35:38,902 INFO HandlerThread:143 [system_monitor.py:finish():203] Stopping system monitor 2024-07-23 05:35:38,902 DEBUG SystemMonitor:143 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-07-23 05:35:38,902 DEBUG SystemMonitor:143 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-07-23 05:35:38,902 DEBUG SystemMonitor:143 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-07-23 05:35:38,903 INFO HandlerThread:143 [interfaces.py:finish():200] Joined cpu monitor 2024-07-23 05:35:38,904 INFO HandlerThread:143 [interfaces.py:finish():200] Joined disk monitor 2024-07-23 05:35:38,909 INFO HandlerThread:143 [interfaces.py:finish():200] Joined gpu monitor 2024-07-23 05:35:38,909 INFO HandlerThread:143 [interfaces.py:finish():200] Joined memory monitor 2024-07-23 05:35:38,910 INFO HandlerThread:143 [interfaces.py:finish():200] Joined network monitor 2024-07-23 05:35:38,910 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:35:39,350 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:40,261 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/output.log 2024-07-23 05:35:40,350 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:40,911 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:35:41,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:42,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:43,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:44,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:45,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:46,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:35:46,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:47,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:48,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:49,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:50,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:51,356 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:35:51,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:52,265 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/config.yaml 2024-07-23 05:35:52,350 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:35:52,350 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:35:52,390 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:53,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:54,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:55,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:56,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:57,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:35:57,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:58,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:35:59,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:00,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:01,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:02,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:03,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:03,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:04,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:05,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:06,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:07,350 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:36:07,350 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:36:07,390 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:08,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:08,577 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:09,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:10,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:11,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:12,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:13,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:14,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:14,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:15,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:16,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:17,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:18,356 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:19,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:19,356 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:20,356 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:21,356 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:22,350 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:36:22,350 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:36:22,390 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:23,356 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:24,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:24,571 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:25,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:26,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:27,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:28,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:29,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:30,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:30,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:31,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:32,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:33,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:34,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:35,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:36,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:36,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:37,350 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:36:37,350 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:36:37,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:38,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:39,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:40,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:41,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:41,615 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:42,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:43,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:44,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:45,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:46,360 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:47,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:47,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:48,360 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:49,360 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:50,360 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:51,360 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:52,350 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:36:52,351 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:36:52,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:52,554 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:53,360 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:54,360 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:55,361 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:56,361 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:57,361 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:58,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:36:58,361 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:36:59,361 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:00,361 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:01,361 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:02,361 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:03,362 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:04,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:04,362 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:05,362 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:06,362 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:07,350 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:37:07,351 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:37:07,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:08,362 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:09,363 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:09,551 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:10,363 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:11,363 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:12,363 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:13,363 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:14,363 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:15,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:15,363 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:16,364 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:17,364 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:18,364 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:19,364 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:20,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:20,364 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:21,364 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:22,350 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:37:22,351 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:37:22,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:23,365 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:24,365 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:25,365 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:25,618 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:26,365 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:27,365 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:28,366 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:29,366 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:30,366 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:31,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:31,366 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:32,366 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:33,366 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:34,367 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:35,367 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:36,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:36,367 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:37,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:37:37,351 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:37:37,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:38,367 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:39,367 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:40,367 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:41,368 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:41,587 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:42,368 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:43,368 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:44,368 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:45,368 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:46,368 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:47,354 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:47,368 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:48,368 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:49,368 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:50,369 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:51,369 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:52,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:37:52,351 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:37:52,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:52,643 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:53,369 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:54,369 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:55,369 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:56,370 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:57,370 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:58,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:37:58,370 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:37:59,370 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:00,370 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:01,370 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:02,371 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:03,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:03,371 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:04,371 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:05,371 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:06,371 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:07,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:38:07,351 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:38:07,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:08,372 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:08,634 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:09,372 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:10,372 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:11,372 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:12,372 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:13,373 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:14,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:14,373 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:15,373 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:16,373 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:17,373 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:18,374 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:19,355 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:19,374 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:20,374 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:21,374 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:22,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:38:22,351 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:38:22,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:23,374 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:24,375 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:24,556 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:25,375 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:26,375 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:27,375 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:28,375 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:29,376 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:30,356 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:30,376 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:31,376 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:32,376 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:33,376 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:34,377 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:35,377 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:36,356 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:36,377 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:37,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:38:37,352 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:38:37,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:38,377 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:39,377 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:40,378 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:41,378 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:41,618 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:42,378 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:43,378 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:44,378 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:45,378 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:46,379 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:47,356 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:47,379 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:48,379 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:49,379 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:50,379 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:51,379 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:52,351 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:38:52,352 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:38:52,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:52,557 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:53,380 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:54,380 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:55,380 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:56,380 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:57,380 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:58,356 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:38:58,380 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:38:59,381 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:00,381 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:01,381 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:02,381 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:03,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:03,381 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:04,381 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:05,382 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:06,382 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:07,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:39:07,352 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:39:07,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:08,382 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:08,561 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:09,382 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:10,382 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:11,382 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:12,382 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:13,383 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:14,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:14,383 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:15,383 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:16,383 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:17,383 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:18,383 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:19,357 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:19,383 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:20,384 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:21,384 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:22,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:39:22,352 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:39:22,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:23,384 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:24,384 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:24,557 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:25,385 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:26,385 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:27,385 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:28,385 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:29,385 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:30,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:30,385 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:31,385 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:32,386 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:33,386 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:34,386 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:35,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:35,386 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:36,386 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:37,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:39:37,352 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:39:37,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:38,386 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:39,387 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:40,387 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:40,550 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:41,387 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:42,387 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:43,387 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:44,387 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:45,387 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:46,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:46,387 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:47,388 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:48,388 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:49,388 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:50,388 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:51,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:51,388 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:52,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:39:52,353 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:39:52,393 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:53,388 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:54,388 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:55,389 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:56,389 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:56,636 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:39:57,389 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:58,389 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:39:59,389 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:00,390 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:01,390 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:02,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:40:02,390 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:03,390 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:04,390 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:05,390 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:06,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:07,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:40:07,352 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:40:07,393 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:07,620 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:40:08,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:09,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:10,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:11,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:12,391 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:13,358 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:40:13,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:14,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:15,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:16,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:17,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:18,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:40:18,392 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:19,393 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:20,393 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:21,393 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:22,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:40:22,353 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:40:22,393 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:23,393 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:23,607 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:40:24,393 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:25,393 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:26,394 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:27,393 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:28,394 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:29,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:40:29,394 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:30,394 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:31,394 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:32,394 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:33,394 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:33,770 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: resume 2024-07-23 05:40:33,770 INFO HandlerThread:143 [handler.py:handle_request_resume():715] starting system metrics thread 2024-07-23 05:40:33,770 INFO HandlerThread:143 [system_monitor.py:start():194] Starting system monitor 2024-07-23 05:40:33,771 INFO SystemMonitor:143 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-07-23 05:40:33,771 INFO SystemMonitor:143 [interfaces.py:start():188] Started cpu monitoring 2024-07-23 05:40:33,772 INFO SystemMonitor:143 [interfaces.py:start():188] Started disk monitoring 2024-07-23 05:40:33,772 INFO SystemMonitor:143 [interfaces.py:start():188] Started gpu monitoring 2024-07-23 05:40:33,773 INFO SystemMonitor:143 [interfaces.py:start():188] Started memory monitoring 2024-07-23 05:40:33,774 INFO SystemMonitor:143 [interfaces.py:start():188] Started network monitoring 2024-07-23 05:40:34,298 DEBUG SenderThread:143 [sender.py:send():379] send: config 2024-07-23 05:40:34,299 DEBUG SenderThread:143 [sender.py:send():379] send: telemetry 2024-07-23 05:40:34,300 DEBUG SenderThread:143 [sender.py:send():379] send: metric 2024-07-23 05:40:34,301 DEBUG SenderThread:143 [sender.py:send():379] send: telemetry 2024-07-23 05:40:34,301 DEBUG SenderThread:143 [sender.py:send():379] send: metric 2024-07-23 05:40:34,301 WARNING SenderThread:143 [sender.py:send_metric():1405] Seen metric with glob (shouldn't happen) 2024-07-23 05:40:34,301 DEBUG SenderThread:143 [sender.py:send():379] send: telemetry 2024-07-23 05:40:34,394 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:34,605 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: log_artifact 2024-07-23 05:40:34,606 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: log_artifact 2024-07-23 05:40:34,821 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: log_artifact 2024-07-23 05:40:35,394 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:36,360 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/output.log 2024-07-23 05:40:36,395 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:37,040 INFO wandb-upload_0:143 [upload_job.py:push():88] Uploaded file /tmp/tmpym3521s5/model_architecture.txt 2024-07-23 05:40:37,352 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:40:37,395 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:37,872 INFO SenderThread:143 [sender.py:send_request_log_artifact():1518] logged artifact model-y8n6g3ud - {'id': 'QXJ0aWZhY3Q6MTAyMjA3MDA4OA==', 'state': 'PENDING', 'artifactSequence': {'id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjMwOTEwNjM5Ng==', 'latestArtifact': None}} 2024-07-23 05:40:37,872 DEBUG SenderThread:143 [sender.py:send():379] send: config 2024-07-23 05:40:37,873 DEBUG SenderThread:143 [sender.py:send():379] send: metric 2024-07-23 05:40:37,873 DEBUG SenderThread:143 [sender.py:send():379] send: metric 2024-07-23 05:40:37,873 WARNING SenderThread:143 [sender.py:send_metric():1405] Seen metric with glob (shouldn't happen) 2024-07-23 05:40:37,873 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: log_artifact 2024-07-23 05:40:37,879 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:40:38,135 INFO SenderThread:143 [sender.py:send_request_log_artifact():1518] logged artifact model-y8n6g3ud - {'id': 'QXJ0aWZhY3Q6MTAyMjA3MDA4OA==', 'state': 'COMMITTED', 'artifactSequence': {'id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjMwOTEwNjM5Ng==', 'latestArtifact': {'id': 'QXJ0aWZhY3Q6MTAyMjA3MDA4OA==', 'versionIndex': 0}}} 2024-07-23 05:40:38,136 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:40:38,395 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:39,395 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:40,395 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:41,395 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:42,395 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:43,364 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:40:43,396 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:44,367 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/config.yaml 2024-07-23 05:40:44,396 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:45,396 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:46,396 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:47,396 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:48,396 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:49,359 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:40:49,396 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:50,396 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:51,396 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:52,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:40:52,353 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:40:52,396 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:53,397 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:53,667 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: partial_history 2024-07-23 05:40:53,669 DEBUG SenderThread:143 [sender.py:send():379] send: metric 2024-07-23 05:40:53,669 DEBUG SenderThread:143 [sender.py:send():379] send: metric 2024-07-23 05:40:53,669 DEBUG SenderThread:143 [sender.py:send():379] send: metric 2024-07-23 05:40:53,669 DEBUG SenderThread:143 [sender.py:send():379] send: metric 2024-07-23 05:40:53,670 DEBUG SenderThread:143 [sender.py:send():379] send: history 2024-07-23 05:40:53,670 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:40:53,670 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:40:53,707 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: partial_history 2024-07-23 05:40:53,708 DEBUG SenderThread:143 [sender.py:send():379] send: history 2024-07-23 05:40:53,708 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:40:53,708 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:40:54,370 INFO Thread-12 :143 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/wandb-summary.json 2024-07-23 05:40:54,397 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:54,709 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:40:55,397 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:56,397 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:57,397 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:58,397 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:40:59,398 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:00,360 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:41:00,398 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:01,398 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:02,398 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:03,398 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:04,398 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:05,398 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:06,360 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:41:06,398 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:07,353 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:41:07,353 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:41:07,399 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:08,330 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: partial_history 2024-07-23 05:41:08,331 DEBUG SenderThread:143 [sender.py:send():379] send: history 2024-07-23 05:41:08,331 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:41:08,333 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:41:08,370 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: partial_history 2024-07-23 05:41:08,371 DEBUG SenderThread:143 [sender.py:send():379] send: history 2024-07-23 05:41:08,371 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:41:08,371 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:41:08,375 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/wandb-summary.json 2024-07-23 05:41:08,399 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:09,399 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:10,399 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:11,372 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:41:11,399 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:12,399 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:13,399 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:14,400 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:15,651 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:16,651 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:17,366 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:41:17,797 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:18,379 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/config.yaml 2024-07-23 05:41:18,796 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:20,604 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:22,798 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:41:25,339 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:25,340 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:41:25,341 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:41:27,812 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:28,532 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:41:32,467 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:33,250 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:33,774 DEBUG SystemMonitor:143 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-07-23 05:41:33,775 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:41:33,776 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:41:34,395 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:34,947 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:35,751 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:36,751 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:37,751 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:38,752 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:38,917 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:41:39,752 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:40,337 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:41:40,338 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:41:40,752 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:41,752 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:42,752 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:43,752 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:43,917 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:41:44,753 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:45,753 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:46,753 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:47,753 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:48,753 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:49,716 DEBUG SenderThread:143 [sender.py:send():379] send: telemetry 2024-07-23 05:41:49,722 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:41:49,757 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: partial_history 2024-07-23 05:41:49,758 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: partial_history 2024-07-23 05:41:49,759 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:50,392 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/config.yaml 2024-07-23 05:41:50,754 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:51,754 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:52,754 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:53,754 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:54,754 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:55,337 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:41:55,754 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:56,754 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:57,754 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:58,755 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:41:59,755 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:00,755 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:01,755 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:02,755 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:03,755 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:04,755 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:05,503 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,504 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,504 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,506 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,506 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,543 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,543 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,544 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,544 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,548 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,548 DEBUG SenderThread:143 [sender.py:send():379] send: history 2024-07-23 05:42:05,548 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,730 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,730 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,731 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,731 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,733 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,733 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,756 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:05,771 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,771 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,771 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,772 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,775 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,776 DEBUG SenderThread:143 [sender.py:send():379] send: history 2024-07-23 05:42:05,776 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: summary_record 2024-07-23 05:42:05,812 INFO SenderThread:143 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-07-23 05:42:05,812 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:42:06,023 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:42:06,399 INFO Thread-12 :143 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240723_053519-y8n6g3ud/files/wandb-summary.json 2024-07-23 05:42:06,756 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:07,756 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:08,756 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:09,756 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:10,337 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:42:10,338 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:42:10,599 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:42:10,757 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:11,757 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:12,757 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:13,757 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:14,757 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:15,599 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:42:15,757 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:16,758 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:17,758 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:18,758 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:19,758 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:20,600 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:42:20,758 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:21,758 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:22,759 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:23,759 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:24,759 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:25,338 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:42:25,338 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:42:25,759 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:26,570 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:42:26,759 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:27,759 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:28,760 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:29,760 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:30,760 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:31,571 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:42:31,760 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:32,760 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:33,760 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:33,777 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:42:34,761 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:35,761 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:36,761 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:36,777 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:42:37,761 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:38,761 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:39,761 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:40,338 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:42:40,338 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:42:40,761 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:41,762 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:42,524 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:42:42,762 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:43,762 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:44,762 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:45,762 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:46,762 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:47,525 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:42:47,762 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:48,763 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:49,763 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:50,763 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:51,763 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:52,526 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:42:52,763 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:53,763 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:54,763 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:55,338 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:42:55,338 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:42:55,764 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:56,764 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:57,534 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:42:57,764 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:58,764 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:42:59,764 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:00,764 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:01,764 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:02,536 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:02,765 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:03,765 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:03,777 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:43:04,765 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:05,765 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:06,765 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:07,765 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:07,779 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:08,765 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:09,766 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:10,338 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:43:10,338 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:43:10,766 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:11,766 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:12,766 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:13,623 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:13,766 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:14,766 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:15,767 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:16,767 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:17,767 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:18,624 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:18,767 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:19,767 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:20,768 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:21,768 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:22,768 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:23,625 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:23,768 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:24,768 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:25,338 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:43:25,338 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:43:25,769 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:26,769 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:27,769 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:28,769 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:29,618 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:29,769 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:30,770 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:31,770 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:32,770 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:33,770 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:33,783 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:43:34,770 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:34,783 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:35,770 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:36,771 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:37,771 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:38,771 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:39,771 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:39,785 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:40,338 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:43:40,339 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:43:40,771 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:41,772 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:42,772 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:43,772 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:44,772 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:45,578 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:45,772 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:46,773 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:47,773 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:48,773 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:49,773 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:50,579 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:50,773 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:51,773 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:52,774 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:53,774 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:54,774 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:55,339 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:43:55,339 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:43:55,774 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:56,539 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:43:56,774 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:57,775 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:58,775 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:43:59,775 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:00,775 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:01,540 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:44:01,775 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:02,776 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:03,776 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:03,779 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:44:04,776 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:05,776 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:06,776 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:06,779 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:44:07,777 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:08,777 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:09,777 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:10,339 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:44:10,339 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:44:10,777 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:11,778 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:12,585 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:44:12,778 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:13,778 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:14,778 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:15,778 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:16,779 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:17,586 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:44:17,779 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:18,779 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:19,779 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:20,779 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:21,779 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:22,587 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:44:22,779 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:23,780 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:24,780 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:25,339 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:44:25,339 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:44:25,780 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:26,780 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:27,780 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:28,529 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:44:28,781 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:29,781 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:30,781 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:31,781 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:32,781 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:33,530 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:44:33,781 DEBUG SenderThread:143 [sender.py:send():379] send: stats 2024-07-23 05:44:33,781 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:34,781 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:35,782 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:36,782 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:37,782 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:38,782 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:38,783 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: status_report 2024-07-23 05:44:39,782 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:40,339 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: stop_status 2024-07-23 05:44:40,339 DEBUG SenderThread:143 [sender.py:send_request():406] send_request: stop_status 2024-07-23 05:44:40,782 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:41,783 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages 2024-07-23 05:44:42,783 DEBUG HandlerThread:143 [handler.py:handle_request():158] handle_request: internal_messages