Spaces:
Runtime error
Runtime error
| 2023-04-21 22:55:40,325 INFO StreamThr :13736 [internal.py:wandb_internal():86] W&B internal server running at pid: 13736, started at: 2023-04-21 22:55:40.324419 | |
| 2023-04-21 22:55:40,326 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: status | |
| 2023-04-21 22:55:40,328 INFO WriterThread:13736 [datastore.py:open_for_write():85] open: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\run-uxlxnflu.wandb | |
| 2023-04-21 22:55:40,332 DEBUG SenderThread:13736 [sender.py:send():375] send: header | |
| 2023-04-21 22:55:40,395 DEBUG SenderThread:13736 [sender.py:send():375] send: run | |
| 2023-04-21 22:55:41,218 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: check_version | |
| 2023-04-21 22:55:41,220 INFO SenderThread:13736 [dir_watcher.py:__init__():219] watching files in: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files | |
| 2023-04-21 22:55:41,220 INFO SenderThread:13736 [sender.py:_start_run_threads():1124] run started: uxlxnflu with start time 1682088940.325418 | |
| 2023-04-21 22:55:41,220 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: summary_record | |
| 2023-04-21 22:55:41,220 INFO SenderThread:13736 [sender.py:_save_file():1378] saving file wandb-summary.json with policy end | |
| 2023-04-21 22:55:41,222 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: check_version | |
| 2023-04-21 22:55:42,138 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: run_start | |
| 2023-04-21 22:55:42,189 DEBUG HandlerThread:13736 [system_info.py:__init__():31] System info init | |
| 2023-04-21 22:55:42,189 DEBUG HandlerThread:13736 [system_info.py:__init__():46] System info init done | |
| 2023-04-21 22:55:42,189 INFO HandlerThread:13736 [system_monitor.py:start():181] Starting system monitor | |
| 2023-04-21 22:55:42,190 INFO SystemMonitor:13736 [system_monitor.py:_start():145] Starting system asset monitoring threads | |
| 2023-04-21 22:55:42,190 INFO HandlerThread:13736 [system_monitor.py:probe():201] Collecting system info | |
| 2023-04-21 22:55:42,196 INFO SystemMonitor:13736 [interfaces.py:start():190] Started cpu monitoring | |
| 2023-04-21 22:55:42,197 INFO SystemMonitor:13736 [interfaces.py:start():190] Started disk monitoring | |
| 2023-04-21 22:55:42,197 INFO SystemMonitor:13736 [interfaces.py:start():190] Started gpu monitoring | |
| 2023-04-21 22:55:42,209 INFO SystemMonitor:13736 [interfaces.py:start():190] Started memory monitoring | |
| 2023-04-21 22:55:42,243 INFO SystemMonitor:13736 [interfaces.py:start():190] Started network monitoring | |
| 2023-04-21 22:55:42,244 INFO Thread-16 :13736 [dir_watcher.py:_on_file_created():278] file/dir created: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\wandb-summary.json | |
| 2023-04-21 22:55:42,258 DEBUG HandlerThread:13736 [system_info.py:probe():195] Probing system | |
| 2023-04-21 22:55:42,261 DEBUG HandlerThread:13736 [system_info.py:_probe_git():180] Probing git | |
| 2023-04-21 22:55:42,263 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:55:42,374 DEBUG HandlerThread:13736 [system_info.py:_probe_git():188] Probing git done | |
| 2023-04-21 22:55:42,374 DEBUG HandlerThread:13736 [system_info.py:probe():240] Probing system done | |
| 2023-04-21 22:55:42,374 DEBUG HandlerThread:13736 [system_monitor.py:probe():210] {'os': 'Windows-10-10.0.19041-SP0', 'python': '3.8.10', 'heartbeatAt': '2023-04-21T14:55:42.258743', 'startedAt': '2023-04-21T14:55:40.285418', 'docker': None, 'cuda': None, 'args': ('--do_train', '--train_file', '.\\datasets\\chat\\train.json', '--validation_file', '.\\datasets\\chat\\dev.json', '--prompt_column', 'content', '--response_column', 'summary', '--overwrite_cache', '--model_name_or_path', '..\\models\\chatglm-6b-int4', '--output_dir', 'output\\adgen-chatglm-6b-pt-128-2e-2', '--overwrite_output_dir', '--max_source_length', '64', '--max_target_length', '64', '--per_device_train_batch_size', '1', '--per_device_eval_batch_size', '1', '--gradient_accumulation_steps', '16', '--predict_with_generate', '--max_steps', '1000', '--logging_steps', '10', '--save_steps', '100', '--learning_rate', '2e-2', '--pre_seq_len', '128', '--quantization_bit', '4'), 'state': 'running', 'program': 'main.py', 'codePath': 'ptuning\\main.py', 'git': {'remote': 'https://github.com/THUDM/ChatGLM-6B', 'commit': '01e6313abf4122d789d6e68128856af52847b355'}, 'cpu_count': 6, 'cpu_count_logical': 12, 'cpu_freq': {'current': 2592.0, 'min': 0.0, 'max': 2592.0}, 'cpu_freq_per_core': [{'current': 2592.0, 'min': 0.0, 'max': 2592.0}], 'disk': {'total': 500.32030868530273, 'used': 236.0998077392578}, 'gpu': 'NVIDIA GeForce RTX 2060', 'gpu_count': 1, 'gpu_devices': [{'name': 'NVIDIA GeForce RTX 2060', 'memory_total': 6442450944}], 'memory': {'total': 63.87089538574219}} | |
| 2023-04-21 22:55:42,374 INFO HandlerThread:13736 [system_monitor.py:probe():211] Finished collecting system info | |
| 2023-04-21 22:55:42,374 INFO HandlerThread:13736 [system_monitor.py:probe():214] Publishing system info | |
| 2023-04-21 22:55:42,374 DEBUG HandlerThread:13736 [system_info.py:_save_pip():51] Saving list of pip packages installed into the current environment | |
| 2023-04-21 22:55:42,375 DEBUG HandlerThread:13736 [system_info.py:_save_pip():67] Saving pip packages done | |
| 2023-04-21 22:55:42,377 INFO HandlerThread:13736 [system_monitor.py:probe():216] Finished publishing system info | |
| 2023-04-21 22:55:42,390 DEBUG SenderThread:13736 [sender.py:send():375] send: files | |
| 2023-04-21 22:55:42,390 INFO SenderThread:13736 [sender.py:_save_file():1378] saving file wandb-metadata.json with policy now | |
| 2023-04-21 22:55:42,402 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: stop_status | |
| 2023-04-21 22:55:42,402 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: stop_status | |
| 2023-04-21 22:55:42,798 DEBUG SenderThread:13736 [sender.py:send():375] send: telemetry | |
| 2023-04-21 22:55:42,798 DEBUG SenderThread:13736 [sender.py:send():375] send: config | |
| 2023-04-21 22:55:42,799 DEBUG SenderThread:13736 [sender.py:send():375] send: metric | |
| 2023-04-21 22:55:42,799 DEBUG SenderThread:13736 [sender.py:send():375] send: telemetry | |
| 2023-04-21 22:55:42,799 DEBUG SenderThread:13736 [sender.py:send():375] send: metric | |
| 2023-04-21 22:55:42,799 WARNING SenderThread:13736 [sender.py:send_metric():1329] Seen metric with glob (shouldn't happen) | |
| 2023-04-21 22:55:43,256 INFO Thread-16 :13736 [dir_watcher.py:_on_file_created():278] file/dir created: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\wandb-metadata.json | |
| 2023-04-21 22:55:43,257 INFO Thread-16 :13736 [dir_watcher.py:_on_file_created():278] file/dir created: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\requirements.txt | |
| 2023-04-21 22:55:43,257 INFO Thread-16 :13736 [dir_watcher.py:_on_file_created():278] file/dir created: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\output.log | |
| 2023-04-21 22:55:43,498 INFO wandb-upload_0:13736 [upload_job.py:push():137] Uploaded file C:\Users\Lenovo\AppData\Local\Temp\tmp2okrjzy_wandb\julsuqja-wandb-metadata.json | |
| 2023-04-21 22:55:44,292 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:55:45,288 INFO Thread-16 :13736 [dir_watcher.py:_on_file_modified():295] file/dir modified: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\output.log | |
| 2023-04-21 22:55:45,859 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: status_report | |
| 2023-04-21 22:55:46,330 INFO Thread-16 :13736 [dir_watcher.py:_on_file_modified():295] file/dir modified: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\output.log | |
| 2023-04-21 22:55:46,341 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:55:48,394 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:55:50,428 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:55:50,902 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: status_report | |
| 2023-04-21 22:55:52,473 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:55:54,507 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:55:55,945 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: status_report | |
| 2023-04-21 22:55:56,551 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:55:57,421 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: stop_status | |
| 2023-04-21 22:55:57,422 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: stop_status | |
| 2023-04-21 22:55:58,582 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:55:59,592 INFO Thread-16 :13736 [dir_watcher.py:_on_file_modified():295] file/dir modified: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\output.log | |
| 2023-04-21 22:56:00,629 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:56:01,838 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: status_report | |
| 2023-04-21 22:56:02,675 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:56:04,710 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:56:06,754 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:56:06,865 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: status_report | |
| 2023-04-21 22:56:08,794 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:56:10,845 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:56:11,852 INFO Thread-16 :13736 [dir_watcher.py:_on_file_modified():295] file/dir modified: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\output.log | |
| 2023-04-21 22:56:12,389 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: status_report | |
| 2023-04-21 22:56:12,430 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: stop_status | |
| 2023-04-21 22:56:13,027 ERROR gpu :13736 [interfaces.py:monitor():144] Failed to sample metric: Not Supported | |
| 2023-04-21 22:56:13,553 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: stop_status | |
| 2023-04-21 22:56:13,873 DEBUG SenderThread:13736 [sender.py:send():375] send: exit | |
| 2023-04-21 22:56:13,873 INFO SenderThread:13736 [sender.py:send_exit():598] handling exit code: 255 | |
| 2023-04-21 22:56:13,873 INFO SenderThread:13736 [sender.py:send_exit():600] handling runtime: 31 | |
| 2023-04-21 22:56:13,875 INFO SenderThread:13736 [sender.py:_save_file():1378] saving file wandb-summary.json with policy end | |
| 2023-04-21 22:56:13,876 INFO SenderThread:13736 [sender.py:send_exit():606] send defer | |
| 2023-04-21 22:56:13,877 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:13,877 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 0 | |
| 2023-04-21 22:56:13,878 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:13,878 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 0 | |
| 2023-04-21 22:56:13,878 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 1 | |
| 2023-04-21 22:56:13,878 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:13,878 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 1 | |
| 2023-04-21 22:56:13,878 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:13,878 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 1 | |
| 2023-04-21 22:56:13,878 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 2 | |
| 2023-04-21 22:56:13,879 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:13,879 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 2 | |
| 2023-04-21 22:56:13,879 INFO HandlerThread:13736 [system_monitor.py:finish():190] Stopping system monitor | |
| 2023-04-21 22:56:13,879 DEBUG SystemMonitor:13736 [system_monitor.py:_start():159] Starting system metrics aggregation loop | |
| 2023-04-21 22:56:13,879 INFO HandlerThread:13736 [interfaces.py:finish():202] Joined cpu monitor | |
| 2023-04-21 22:56:13,879 DEBUG SystemMonitor:13736 [system_monitor.py:_start():166] Finished system metrics aggregation loop | |
| 2023-04-21 22:56:13,891 INFO HandlerThread:13736 [interfaces.py:finish():202] Joined disk monitor | |
| 2023-04-21 22:56:13,892 DEBUG SystemMonitor:13736 [system_monitor.py:_start():170] Publishing last batch of metrics | |
| 2023-04-21 22:56:13,946 INFO HandlerThread:13736 [interfaces.py:finish():202] Joined gpu monitor | |
| 2023-04-21 22:56:13,946 INFO HandlerThread:13736 [interfaces.py:finish():202] Joined memory monitor | |
| 2023-04-21 22:56:13,946 INFO HandlerThread:13736 [interfaces.py:finish():202] Joined network monitor | |
| 2023-04-21 22:56:13,947 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:13,947 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 2 | |
| 2023-04-21 22:56:13,947 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 3 | |
| 2023-04-21 22:56:13,947 DEBUG SenderThread:13736 [sender.py:send():375] send: stats | |
| 2023-04-21 22:56:13,947 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:13,948 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 3 | |
| 2023-04-21 22:56:13,948 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:13,948 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 3 | |
| 2023-04-21 22:56:13,948 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 4 | |
| 2023-04-21 22:56:13,948 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:13,949 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 4 | |
| 2023-04-21 22:56:13,949 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:13,949 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 4 | |
| 2023-04-21 22:56:13,949 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 5 | |
| 2023-04-21 22:56:13,949 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:13,949 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 5 | |
| 2023-04-21 22:56:13,950 DEBUG SenderThread:13736 [sender.py:send():375] send: summary | |
| 2023-04-21 22:56:13,950 INFO SenderThread:13736 [sender.py:_save_file():1378] saving file wandb-summary.json with policy end | |
| 2023-04-21 22:56:13,951 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:13,951 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 5 | |
| 2023-04-21 22:56:13,951 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 6 | |
| 2023-04-21 22:56:13,951 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:13,951 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 6 | |
| 2023-04-21 22:56:13,951 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:13,951 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 6 | |
| 2023-04-21 22:56:13,952 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 7 | |
| 2023-04-21 22:56:13,952 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: status_report | |
| 2023-04-21 22:56:13,952 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:13,952 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 7 | |
| 2023-04-21 22:56:13,952 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:13,952 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 7 | |
| 2023-04-21 22:56:13,955 INFO Thread-16 :13736 [dir_watcher.py:_on_file_modified():295] file/dir modified: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\config.yaml | |
| 2023-04-21 22:56:13,955 INFO Thread-16 :13736 [dir_watcher.py:_on_file_modified():295] file/dir modified: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\wandb-summary.json | |
| 2023-04-21 22:56:14,157 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: poll_exit | |
| 2023-04-21 22:56:14,969 INFO Thread-16 :13736 [dir_watcher.py:_on_file_modified():295] file/dir modified: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\output.log | |
| 2023-04-21 22:56:16,025 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 8 | |
| 2023-04-21 22:56:16,025 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: poll_exit | |
| 2023-04-21 22:56:16,025 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:16,026 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 8 | |
| 2023-04-21 22:56:16,026 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:16,026 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 8 | |
| 2023-04-21 22:56:16,051 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 9 | |
| 2023-04-21 22:56:16,051 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:16,051 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 9 | |
| 2023-04-21 22:56:16,051 DEBUG SenderThread:13736 [sender.py:send():375] send: artifact | |
| 2023-04-21 22:56:16,982 INFO Thread-16 :13736 [dir_watcher.py:_on_file_modified():295] file/dir modified: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\output.log | |
| 2023-04-21 22:56:17,671 INFO SenderThread:13736 [sender.py:send_artifact():1474] sent artifact job-https___github.com_THUDM_ChatGLM-6B_ptuning_main.py - {'id': 'QXJ0aWZhY3Q6NDI5NzAxNTEw', 'digest': '1077e319ad39e537c1ccc8f9a5c233bc', 'state': 'COMMITTED', 'aliases': [{'artifactCollectionName': 'job-https___github.com_THUDM_ChatGLM-6B_ptuning_main.py', 'alias': 'latest'}, {'artifactCollectionName': 'job-https___github.com_THUDM_ChatGLM-6B_ptuning_main.py', 'alias': 'v4'}], 'artifactSequence': {'id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjYzNDcyMzc3', 'latestArtifact': {'id': 'QXJ0aWZhY3Q6NDI5NzAxNTEw', 'versionIndex': 4}}, 'version': 'v4'} | |
| 2023-04-21 22:56:17,671 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:17,671 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 9 | |
| 2023-04-21 22:56:17,671 INFO SenderThread:13736 [dir_watcher.py:finish():365] shutting down directory watcher | |
| 2023-04-21 22:56:17,994 INFO SenderThread:13736 [dir_watcher.py:finish():395] scan: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files | |
| 2023-04-21 22:56:17,994 INFO SenderThread:13736 [dir_watcher.py:finish():409] scan save: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\config.yaml config.yaml | |
| 2023-04-21 22:56:17,995 INFO SenderThread:13736 [dir_watcher.py:finish():409] scan save: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\output.log output.log | |
| 2023-04-21 22:56:17,997 INFO SenderThread:13736 [dir_watcher.py:finish():409] scan save: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\requirements.txt requirements.txt | |
| 2023-04-21 22:56:17,999 INFO SenderThread:13736 [dir_watcher.py:finish():409] scan save: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\wandb-metadata.json wandb-metadata.json | |
| 2023-04-21 22:56:18,001 INFO SenderThread:13736 [dir_watcher.py:finish():409] scan save: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\wandb-summary.json wandb-summary.json | |
| 2023-04-21 22:56:18,002 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 10 | |
| 2023-04-21 22:56:18,003 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:18,003 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 10 | |
| 2023-04-21 22:56:18,005 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:18,005 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 10 | |
| 2023-04-21 22:56:18,005 INFO SenderThread:13736 [file_pusher.py:finish():168] shutting down file pusher | |
| 2023-04-21 22:56:19,006 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: status_report | |
| 2023-04-21 22:56:19,186 INFO wandb-upload_0:13736 [upload_job.py:push():137] Uploaded file E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\config.yaml | |
| 2023-04-21 22:56:19,195 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: keepalive | |
| 2023-04-21 22:56:19,224 INFO wandb-upload_3:13736 [upload_job.py:push():137] Uploaded file E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\wandb-summary.json | |
| 2023-04-21 22:56:19,294 INFO wandb-upload_2:13736 [upload_job.py:push():137] Uploaded file E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\requirements.txt | |
| 2023-04-21 22:56:20,158 INFO wandb-upload_1:13736 [upload_job.py:push():137] Uploaded file E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\files\output.log | |
| 2023-04-21 22:56:20,366 INFO Thread-15 :13736 [sender.py:transition_state():626] send defer: 11 | |
| 2023-04-21 22:56:20,366 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:20,366 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 11 | |
| 2023-04-21 22:56:20,367 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:20,367 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 11 | |
| 2023-04-21 22:56:20,367 INFO SenderThread:13736 [file_pusher.py:join():173] waiting for file pusher | |
| 2023-04-21 22:56:20,367 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 12 | |
| 2023-04-21 22:56:20,367 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:20,367 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 12 | |
| 2023-04-21 22:56:20,367 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:20,367 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 12 | |
| 2023-04-21 22:56:20,941 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 13 | |
| 2023-04-21 22:56:20,942 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:20,942 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 13 | |
| 2023-04-21 22:56:20,942 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:20,942 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 13 | |
| 2023-04-21 22:56:20,942 INFO SenderThread:13736 [sender.py:transition_state():626] send defer: 14 | |
| 2023-04-21 22:56:20,942 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: defer | |
| 2023-04-21 22:56:20,942 INFO HandlerThread:13736 [handler.py:handle_request_defer():170] handle defer: 14 | |
| 2023-04-21 22:56:20,943 DEBUG SenderThread:13736 [sender.py:send():375] send: final | |
| 2023-04-21 22:56:20,943 DEBUG SenderThread:13736 [sender.py:send():375] send: footer | |
| 2023-04-21 22:56:20,943 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: defer | |
| 2023-04-21 22:56:20,943 INFO SenderThread:13736 [sender.py:send_request_defer():622] handle sender defer: 14 | |
| 2023-04-21 22:56:20,944 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: poll_exit | |
| 2023-04-21 22:56:20,945 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: server_info | |
| 2023-04-21 22:56:20,945 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: get_summary | |
| 2023-04-21 22:56:20,945 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: poll_exit | |
| 2023-04-21 22:56:20,945 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: sampled_history | |
| 2023-04-21 22:56:20,945 DEBUG SenderThread:13736 [sender.py:send_request():402] send_request: server_info | |
| 2023-04-21 22:56:21,184 INFO MainThread:13736 [wandb_run.py:_footer_history_summary_info():3476] rendering history | |
| 2023-04-21 22:56:21,184 INFO MainThread:13736 [wandb_run.py:_footer_history_summary_info():3508] rendering summary | |
| 2023-04-21 22:56:21,184 INFO MainThread:13736 [wandb_run.py:_footer_sync_info():3434] logging synced files | |
| 2023-04-21 22:56:21,185 DEBUG HandlerThread:13736 [handler.py:handle_request():144] handle_request: shutdown | |
| 2023-04-21 22:56:21,186 INFO HandlerThread:13736 [handler.py:finish():845] shutting down handler | |
| 2023-04-21 22:56:21,953 INFO WriterThread:13736 [datastore.py:close():298] close: E:\Documents\Desktop\ChatGLM-6B\ptuning\wandb\run-20230421_225540-uxlxnflu\run-uxlxnflu.wandb | |
| 2023-04-21 22:56:22,187 INFO SenderThread:13736 [sender.py:finish():1550] shutting down sender | |
| 2023-04-21 22:56:22,187 INFO SenderThread:13736 [file_pusher.py:finish():168] shutting down file pusher | |
| 2023-04-21 22:56:22,187 INFO SenderThread:13736 [file_pusher.py:join():173] waiting for file pusher | |