Hugging Face's logo

kupru
/
poca-SoccerTwos-2

Reinforcement Learning
ml-agents
TensorBoard
ONNX
SoccerTwos
deep-reinforcement-learning
ML-Agents-SoccerTwos
Model card Files Metrics Community
kupru commited on
Commit
c48e90d
•
1 Parent(s): 5f8e08c

first run

Browse files
Files changed (30) hide show
  1. README.md +35 -0
  2. SoccerTwos.onnx +3 -0
  3. SoccerTwos/SoccerTwos-0.onnx +3 -0
  4. SoccerTwos/SoccerTwos-0.pt +3 -0
  5. SoccerTwos/SoccerTwos-11511746.onnx +3 -0
  6. SoccerTwos/SoccerTwos-11511746.pt +3 -0
  7. SoccerTwos/SoccerTwos-11532376.onnx +3 -0
  8. SoccerTwos/SoccerTwos-11532376.pt +3 -0
  9. SoccerTwos/SoccerTwos-11552976.onnx +3 -0
  10. SoccerTwos/SoccerTwos-11552976.pt +3 -0
  11. SoccerTwos/SoccerTwos-8499942.onnx +3 -0
  12. SoccerTwos/SoccerTwos-8499942.pt +3 -0
  13. SoccerTwos/SoccerTwos-8999964.onnx +3 -0
  14. SoccerTwos/SoccerTwos-8999964.pt +3 -0
  15. SoccerTwos/SoccerTwos-9499768.onnx +3 -0
  16. SoccerTwos/SoccerTwos-9499768.pt +3 -0
  17. SoccerTwos/SoccerTwos-9761498.onnx +3 -0
  18. SoccerTwos/SoccerTwos-9761498.pt +3 -0
  19. SoccerTwos/SoccerTwos-9782042.onnx +3 -0
  20. SoccerTwos/SoccerTwos-9782042.pt +3 -0
  21. SoccerTwos/checkpoint.pt +3 -0
  22. SoccerTwos/events.out.tfevents.1696665728.mylly.96808.0 +3 -0
  23. SoccerTwos/events.out.tfevents.1696764051.mylly.125712.0 +3 -0
  24. SoccerTwos/events.out.tfevents.1696764080.mylly.125799.0 +3 -0
  25. SoccerTwos/events.out.tfevents.1696783898.mylly.134872.0 +3 -0
  26. config.json +1 -0
  27. configuration.yaml +82 -0
  28. run_logs/Player-0.log +258 -0
  29. run_logs/timers.json +571 -0
  30. run_logs/training_status.json +66 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: ml-agents
3
+ tags:
4
+ - SoccerTwos
5
+ - deep-reinforcement-learning
6
+ - reinforcement-learning
7
+ - ML-Agents-SoccerTwos
8
+ ---
9
+
10
+ # **poca** Agent playing **SoccerTwos**
11
+ This is a trained model of a **poca** agent playing **SoccerTwos**
12
+ using the [Unity ML-Agents Library](https://github.com/Unity-Technologies/ml-agents).
13
+
14
+ ## Usage (with ML-Agents)
15
+ The Documentation: https://unity-technologies.github.io/ml-agents/ML-Agents-Toolkit-Documentation/
16
+
17
+ We wrote a complete tutorial to learn to train your first agent using ML-Agents and publish it to the Hub:
18
+ - A *short tutorial* where you teach Huggy the Dog 🐶 to fetch the stick and then play with him directly in your
19
+ browser: https://huggingface.co/learn/deep-rl-course/unitbonus1/introduction
20
+ - A *longer tutorial* to understand how works ML-Agents:
21
+ https://huggingface.co/learn/deep-rl-course/unit5/introduction
22
+
23
+ ### Resume the training
24
+ ```bash
25
+ mlagents-learn <your_configuration_file_path.yaml> --run-id=<run_id> --resume
26
+ ```
27
+
28
+ ### Watch your Agent play
29
+ You can watch your agent **playing directly in your browser**
30
+
31
+ 1. If the environment is part of ML-Agents official environments, go to https://huggingface.co/unity
32
+ 2. Step 1: Find your model_id: kupru/poca-SoccerTwos-2
33
+ 3. Step 2: Select your *.nn /*.onnx file
34
+ 4. Click on Watch the agent play 👀
35
+
SoccerTwos.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b33b23d3893ad9b8575d79b4382d7fa028c763d6dc6d55dc8aebbec1862db3be
3
+ size 1764633
SoccerTwos/SoccerTwos-0.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b70108372f4159a5f8695808b281b77363da23e69fcca2e3220070c1e3ddb547
3
+ size 1764633
SoccerTwos/SoccerTwos-0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee7c42c6889a1b7d81bde593bf8ef5483cabc084fc5d53611538a53aded75812
3
+ size 9478265
SoccerTwos/SoccerTwos-11511746.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca238cceeb15b69ca0a74448d1db5ef65798ea99ad1aed510778fffef9e4c676
3
+ size 1764633
SoccerTwos/SoccerTwos-11511746.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8de6349ccdd90539a3629ddea8e6373d4da7a1108396f7180587c2be14d58ad4
3
+ size 28421201
SoccerTwos/SoccerTwos-11532376.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:503ec012397c3730ad86bcf11d4d02b337f5d33247ef49b0f6a44cf32c5e32cd
3
+ size 1764633
SoccerTwos/SoccerTwos-11532376.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b07ada1cd71f50308018787c2f29c44ea7651e5d3f7f399bf913058531081f2
3
+ size 28421201
SoccerTwos/SoccerTwos-11552976.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66d4b2f7f0c50a409a5d22e72ec0d1a3add1377192fab612f230b94b3cedb915
3
+ size 1764633
SoccerTwos/SoccerTwos-11552976.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4bbb9cb46b19f9d566cceaae5626ed1eb6f2c2a3c8b932203a92bd8547c56ad9
3
+ size 28421201
SoccerTwos/SoccerTwos-8499942.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7255e555afdfa2cfeb0ced187812cf1ac8798e877dfa585b4e278c45d528c39
3
+ size 1764633
SoccerTwos/SoccerTwos-8499942.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:331de0f0df8593ae44bad291e5199f9fe99b0f364f0a157140c9e4d2c0e7465f
3
+ size 28421201
SoccerTwos/SoccerTwos-8999964.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37c1cf054bedf4f8d9d8f48393d71a8be01c1fa5cc7a751ec4b61b717f0cc43f
3
+ size 1764633
SoccerTwos/SoccerTwos-8999964.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0bfa2e73a1f48cd49444665fa572fbde68181f5b39583aae2b2fbd2bb059114
3
+ size 28421201
SoccerTwos/SoccerTwos-9499768.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f875a8df023d70a511a59f9985161bbe3056d785e8655f23c07414e0710e1a7
3
+ size 1764633
SoccerTwos/SoccerTwos-9499768.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8764a63aa4cb2c384e2a87fe4d5015fd1186eec53c7c9def43819c2d9973b2a7
3
+ size 28421201
SoccerTwos/SoccerTwos-9761498.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ef73307fec2f0e75dee7f1520c9f34209d155f4b2f45095d26bec878c3fec29
3
+ size 1764633
SoccerTwos/SoccerTwos-9761498.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd5551c428b7dc3dfcc1e698ba6c3f8549729ba8243b4e805cb6a677bf4ebbb3
3
+ size 28421201
SoccerTwos/SoccerTwos-9782042.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b33b23d3893ad9b8575d79b4382d7fa028c763d6dc6d55dc8aebbec1862db3be
3
+ size 1764633
SoccerTwos/SoccerTwos-9782042.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9a6f243c0d31a7fa14319a0f9737fe1c072465e53087a51a12ff736cce6daf2
3
+ size 28421201
SoccerTwos/checkpoint.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9a6f243c0d31a7fa14319a0f9737fe1c072465e53087a51a12ff736cce6daf2
3
+ size 28421201
SoccerTwos/events.out.tfevents.1696665728.mylly.96808.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4c1223c67524a9015f24be1f9f4dc23076f6d9d6795f5912cf6985e1b0b217b
3
+ size 3869214
SoccerTwos/events.out.tfevents.1696764051.mylly.125712.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70720858bb5bb091751630ca97c47b567536586855b22f59ae1450b4311f10c2
3
+ size 1239
SoccerTwos/events.out.tfevents.1696764080.mylly.125799.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02ba37bdaa45956bb6abd84823c13b2cca9c5b33bf65660e6b77a21e0820207a
3
+ size 4893526
SoccerTwos/events.out.tfevents.1696783898.mylly.134872.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27a65819c7a957b461e390c803d6d6d3b0207fb37e57c79817bb6202d2b1d8f5
3
+ size 21460
config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"default_settings": null, "behaviors": {"SoccerTwos": {"trainer_type": "poca", "hyperparameters": {"batch_size": 2048, "buffer_size": 20480, "learning_rate": 0.0003, "beta": 0.01, "epsilon": 0.2, "lambd": 0.95, "num_epoch": 3, "learning_rate_schedule": "constant", "beta_schedule": "constant", "epsilon_schedule": "constant"}, "checkpoint_interval": 500000, "network_settings": {"normalize": false, "hidden_units": 512, "num_layers": 2, "vis_encode_type": "simple", "memory": null, "goal_conditioning_type": "hyper", "deterministic": false}, "reward_signals": {"extrinsic": {"gamma": 0.99, "strength": 1.0, "network_settings": {"normalize": false, "hidden_units": 128, "num_layers": 2, "vis_encode_type": "simple", "memory": null, "goal_conditioning_type": "hyper", "deterministic": false}}}, "init_path": null, "keep_checkpoints": 5, "even_checkpoints": false, "max_steps": 10000000, "time_horizon": 1000, "summary_freq": 10000, "threaded": false, "self_play": {"save_steps": 50000, "team_change": 200000, "swap_steps": 2000, "window": 10, "play_against_latest_model_ratio": 0.5, "initial_elo": 1200.0}, "behavioral_cloning": null}}, "env_settings": {"env_path": "./training-envs-executables/SoccerTwos.x86_64", "env_args": null, "base_port": 5005, "num_envs": 1, "num_areas": 1, "seed": -1, "max_lifetime_restarts": 10, "restarts_rate_limit_n": 1, "restarts_rate_limit_period_s": 60}, "engine_settings": {"width": 84, "height": 84, "quality_level": 5, "time_scale": 20, "target_frame_rate": -1, "capture_frame_rate": 60, "no_graphics": false}, "environment_parameters": null, "checkpoint_settings": {"run_id": "SoccerTwos", "initialize_from": null, "load_model": false, "resume": true, "force": false, "train_model": false, "inference": false, "results_dir": "results"}, "torch_settings": {"device": null}, "debug": false}
configuration.yaml ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ default_settings: null
2
+ behaviors:
3
+ SoccerTwos:
4
+ trainer_type: poca
5
+ hyperparameters:
6
+ batch_size: 2048
7
+ buffer_size: 20480
8
+ learning_rate: 0.0003
9
+ beta: 0.01
10
+ epsilon: 0.2
11
+ lambd: 0.95
12
+ num_epoch: 3
13
+ learning_rate_schedule: constant
14
+ beta_schedule: constant
15
+ epsilon_schedule: constant
16
+ checkpoint_interval: 500000
17
+ network_settings:
18
+ normalize: false
19
+ hidden_units: 512
20
+ num_layers: 2
21
+ vis_encode_type: simple
22
+ memory: null
23
+ goal_conditioning_type: hyper
24
+ deterministic: false
25
+ reward_signals:
26
+ extrinsic:
27
+ gamma: 0.99
28
+ strength: 1.0
29
+ network_settings:
30
+ normalize: false
31
+ hidden_units: 128
32
+ num_layers: 2
33
+ vis_encode_type: simple
34
+ memory: null
35
+ goal_conditioning_type: hyper
36
+ deterministic: false
37
+ init_path: null
38
+ keep_checkpoints: 5
39
+ even_checkpoints: false
40
+ max_steps: 10000000
41
+ time_horizon: 1000
42
+ summary_freq: 10000
43
+ threaded: false
44
+ self_play:
45
+ save_steps: 50000
46
+ team_change: 200000
47
+ swap_steps: 2000
48
+ window: 10
49
+ play_against_latest_model_ratio: 0.5
50
+ initial_elo: 1200.0
51
+ behavioral_cloning: null
52
+ env_settings:
53
+ env_path: ./training-envs-executables/SoccerTwos.x86_64
54
+ env_args: null
55
+ base_port: 5005
56
+ num_envs: 1
57
+ num_areas: 1
58
+ seed: -1
59
+ max_lifetime_restarts: 10
60
+ restarts_rate_limit_n: 1
61
+ restarts_rate_limit_period_s: 60
62
+ engine_settings:
63
+ width: 84
64
+ height: 84
65
+ quality_level: 5
66
+ time_scale: 20
67
+ target_frame_rate: -1
68
+ capture_frame_rate: 60
69
+ no_graphics: false
70
+ environment_parameters: null
71
+ checkpoint_settings:
72
+ run_id: SoccerTwos
73
+ initialize_from: null
74
+ load_model: false
75
+ resume: true
76
+ force: false
77
+ train_model: false
78
+ inference: false
79
+ results_dir: results
80
+ torch_settings:
81
+ device: null
82
+ debug: false
run_logs/Player-0.log ADDED
@@ -0,0 +1,258 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Mono path[0] = '/home/ana/Projektit/hugging/soccertwos/ml-agents/training-envs-executables/SoccerTwos_Data/Managed'
2
+ Mono config path = '/home/ana/Projektit/hugging/soccertwos/ml-agents/training-envs-executables/SoccerTwos_Data/MonoBleedingEdge/etc'
3
+ Preloaded 'lib_burst_generated.so'
4
+ Preloaded 'libgrpc_csharp_ext.x64.so'
5
+ Display 0 'XWAYLAND0 24"': 1920x1200 (primary device).
6
+ Desktop is 1920 x 1200 @ 60 Hz
7
+ Initialize engine version: 2021.3.14f1 (eee1884e7226)
8
+ [Subsystems] Discovering subsystems at path /home/ana/Projektit/hugging/soccertwos/ml-agents/training-envs-executables/SoccerTwos_Data/UnitySubsystems
9
+ GfxDevice: creating device client; threaded=1; jobified=0
10
+ Renderer: Mesa Intel(R) HD Graphics 2500 (IVB GT1)
11
+ Vendor: Intel
12
+ Version: 4.2 (Core Profile) Mesa 23.0.4-0ubuntu1~22.04.1
13
+ GLES: 0
14
+ GL_3DFX_texture_compression_FXT1 GL_AMD_conservative_depth GL_AMD_draw_buffers_blend GL_AMD_multi_draw_indirect GL_AMD_performance_monitor GL_AMD_pinned_memory GL_AMD_seamless_cubemap_per_texture GL_AMD_shader_trinary_minmax GL_AMD_texture_texture4 GL_AMD_vertex_shader_layer GL_AMD_vertex_shader_viewport_index GL_ANGLE_texture_compression_dxt3 GL_ANGLE_texture_compression_dxt5 GL_ARB_ES2_compatibility GL_ARB_ES3_compatibility GL_ARB_arrays_of_arrays GL_ARB_base_instance GL_ARB_blend_func_extended GL_ARB_buffer_storage GL_ARB_clear_buffer_object GL_ARB_clear_texture GL_ARB_clip_control GL_ARB_compressed_texture_pixel_storage GL_ARB_compute_shader GL_ARB_compute_variable_group_size GL_ARB_conditional_render_inverted GL_ARB_conservative_depth GL_ARB_copy_buffer GL_ARB_copy_image GL_ARB_cull_distance GL_ARB_debug_output GL_ARB_depth_buffer_float GL_ARB_depth_clamp GL_ARB_derivative_control GL_ARB_direct_state_access GL_ARB_draw_buffers GL_ARB_draw_buffers_blend GL_ARB_draw_elements_base_vertex GL_ARB_draw_indir
15
+ ect GL_ARB_draw_instanced GL_ARB_enhanced_layouts GL_ARB_explicit_attrib_location GL_ARB_explicit_uniform_location GL_ARB_fragment_coord_conventions GL_ARB_fragment_layer_viewport GL_ARB_fragment_shader GL_ARB_framebuffer_no_attachments GL_ARB_framebuffer_object GL_ARB_framebuffer_sRGB GL_ARB_get_program_binary GL_ARB_get_texture_sub_image GL_ARB_gl_spirv GL_ARB_gpu_shader5 GL_ARB_gpu_shader_fp64 GL_ARB_half_float_pixel GL_ARB_half_float_vertex GL_ARB_indirect_parameters GL_ARB_instanced_arrays GL_ARB_internalformat_query GL_ARB_internalformat_query2 GL_ARB_invalidate_subdata GL_ARB_map_buffer_alignment GL_ARB_map_buffer_range GL_ARB_multi_bind GL_ARB_multi_draw_indirect GL_ARB_occlusion_query2 GL_ARB_parallel_shader_compile GL_ARB_pipeline_statistics_query GL_ARB_pixel_buffer_object GL_ARB_point_sprite GL_ARB_polygon_offset_clamp GL_ARB_program_interface_query GL_ARB_provoking_vertex GL_ARB_robustness GL_ARB_sample_shading GL_ARB_sampler_objects GL_ARB_seamless_cube_map GL_ARB_seamless_cubemap_per_texture G
16
+ L_ARB_separate_shader_objects GL_ARB_shader_atomic_counter_ops GL_ARB_shader_atomic_counters GL_ARB_shader_bit_encoding GL_ARB_shader_clock GL_ARB_shader_draw_parameters GL_ARB_shader_group_vote GL_ARB_shader_image_load_store GL_ARB_shader_image_size GL_ARB_shader_objects GL_ARB_shader_precision GL_ARB_shader_storage_buffer_object GL_ARB_shader_subroutine GL_ARB_shader_texture_image_samples GL_ARB_shader_texture_lod GL_ARB_shader_viewport_layer_array GL_ARB_shading_language_420pack GL_ARB_shading_language_include GL_ARB_shading_language_packing GL_ARB_spirv_extensions GL_ARB_sync GL_ARB_tessellation_shader GL_ARB_texture_barrier GL_ARB_texture_buffer_object GL_ARB_texture_buffer_object_rgb32 GL_ARB_texture_buffer_range GL_ARB_texture_compression_bptc GL_ARB_texture_compression_rgtc GL_ARB_texture_cube_map_array GL_ARB_texture_filter_anisotropic GL_ARB_texture_float GL_ARB_texture_gather GL_ARB_texture_mirror_clamp_to_edge GL_ARB_texture_multisample GL_ARB_texture_non_power_of_two GL_ARB_texture_query_levels
17
+ GL_ARB_texture_query_lod GL_ARB_texture_rectangle GL_ARB_texture_rg GL_ARB_texture_rgb10_a2ui GL_ARB_texture_storage GL_ARB_texture_storage_multisample GL_ARB_texture_swizzle GL_ARB_texture_view GL_ARB_timer_query GL_ARB_transform_feedback2 GL_ARB_transform_feedback3 GL_ARB_transform_feedback_instanced GL_ARB_transform_feedback_overflow_query GL_ARB_uniform_buffer_object GL_ARB_vertex_array_bgra GL_ARB_vertex_array_object GL_ARB_vertex_attrib_64bit GL_ARB_vertex_attrib_binding GL_ARB_vertex_buffer_object GL_ARB_vertex_shader GL_ARB_vertex_type_10f_11f_11f_rev GL_ARB_vertex_type_2_10_10_10_rev GL_ARB_viewport_array GL_ATI_blend_equation_separate GL_ATI_texture_float GL_EXT_EGL_image_storage GL_EXT_EGL_sync GL_EXT_abgr GL_EXT_blend_equation_separate GL_EXT_debug_label GL_EXT_demote_to_helper_invocation GL_EXT_draw_buffers2 GL_EXT_draw_instanced GL_EXT_framebuffer_blit GL_EXT_framebuffer_multisample GL_EXT_framebuffer_multisample_blit_scaled GL_EXT_framebuffer_object GL_EXT_framebuffer_sRGB GL_EXT_memory_object
18
+ GL_EXT_memory_object_fd GL_EXT_packed_depth_stencil GL_EXT_packed_float GL_EXT_pixel_buffer_object GL_EXT_polygon_offset_clamp GL_EXT_provoking_vertex GL_EXT_semaphore GL_EXT_semaphore_fd GL_EXT_shader_framebuffer_fetch_non_coherent GL_EXT_shader_integer_mix GL_EXT_shader_samples_identical GL_EXT_texture_array GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_rgtc GL_EXT_texture_compression_s3tc GL_EXT_texture_filter_anisotropic GL_EXT_texture_integer GL_EXT_texture_sRGB GL_EXT_texture_sRGB_R8 GL_EXT_texture_sRGB_decode GL_EXT_texture_shadow_lod GL_EXT_texture_shared_exponent GL_EXT_texture_snorm GL_EXT_texture_swizzle GL_EXT_timer_query GL_EXT_transform_feedback GL_EXT_vertex_array_bgra GL_EXT_vertex_attrib_64bit GL_IBM_multimode_draw_arrays GL_INTEL_blackhole_render GL_INTEL_performance_query GL_KHR_blend_equation_advanced GL_KHR_context_flush_control GL_KHR_debug GL_KHR_no_error GL_KHR_parallel_shader_compile GL_KHR_texture_compression_astc_ldr GL_KHR_texture_compression_astc_sliced_3d GL_MESA_p
19
+ ack_invert GL_MESA_shader_integer_functions GL_MESA_texture_signed_rgba GL_NV_alpha_to_coverage_dither_control GL_NV_compute_shader_derivatives GL_NV_conditional_render GL_NV_copy_image GL_NV_depth_clamp GL_NV_packed_depth_stencil GL_NV_texture_barrier GL_OES_EGL_image GL_S3_s3tc
20
+ OPENGL LOG: Creating OpenGL 4.2 graphics device ; Context level <OpenGL 4.2> ; Context handle 8746912
21
+ Begin MonoManager ReloadAssembly
22
+ - Completed reload, in 0.084 seconds
23
+ Default vsync count 1
24
+ requesting resize 1850 x 1136
25
+ resizing window to 1850 x 1136
26
+ Desktop is 1920 x 1200 @ 60 Hz
27
+ UnloadTime: 0.954918 ms
28
+ Registered Communicator in Agent.
29
+ Setting up 2 worker threads for Enlighten.
30
+ requesting resize 84 x 84
31
+ resizing window to 84 x 84
32
+ Desktop is 1920 x 1200 @ 60 Hz
33
+ Memory Statistics:
34
+ [ALLOC_TEMP_TLS] TLS Allocator
35
+ StackAllocators :
36
+ [ALLOC_TEMP_MAIN]
37
+ Peak usage frame count: [8.0 KB-16.0 KB]: 78 frames, [2.0 MB-4.0 MB]: 1 frames
38
+ Initial Block Size 4.0 MB
39
+ Current Block Size 4.0 MB
40
+ Peak Allocated Bytes 2.1 MB
41
+ Overflow Count 0
42
+ [ALLOC_TEMP_Loading.AsyncRead]
43
+ Initial Block Size 64.0 KB
44
+ Current Block Size 64.0 KB
45
+ Peak Allocated Bytes 128 B
46
+ Overflow Count 0
47
+ [ALLOC_TEMP_Loading.PreloadManager]
48
+ Initial Block Size 256.0 KB
49
+ Current Block Size 300.0 KB
50
+ Peak Allocated Bytes 249.6 KB
51
+ Overflow Count 4
52
+ [ALLOC_TEMP_Background Job.Worker 8]
53
+ Initial Block Size 32.0 KB
54
+ Current Block Size 32.0 KB
55
+ Peak Allocated Bytes 0 B
56
+ Overflow Count 0
57
+ [ALLOC_TEMP_Background Job.Worker 9]
58
+ Initial Block Size 32.0 KB
59
+ Current Block Size 32.0 KB
60
+ Peak Allocated Bytes 0 B
61
+ Overflow Count 0
62
+ [ALLOC_TEMP_Job.Worker 0]
63
+ Initial Block Size 256.0 KB
64
+ Current Block Size 256.0 KB
65
+ Peak Allocated Bytes 1.5 KB
66
+ Overflow Count 0
67
+ [ALLOC_TEMP_Background Job.Worker 10]
68
+ Initial Block Size 32.0 KB
69
+ Current Block Size 32.0 KB
70
+ Peak Allocated Bytes 0 B
71
+ Overflow Count 0
72
+ [ALLOC_TEMP_Background Job.Worker 14]
73
+ Initial Block Size 32.0 KB
74
+ Current Block Size 32.0 KB
75
+ Peak Allocated Bytes 0 B
76
+ Overflow Count 0
77
+ [ALLOC_TEMP_Background Job.Worker 6]
78
+ Initial Block Size 32.0 KB
79
+ Current Block Size 32.0 KB
80
+ Peak Allocated Bytes 0 B
81
+ Overflow Count 0
82
+ [ALLOC_TEMP_Background Job.Worker 12]
83
+ Initial Block Size 32.0 KB
84
+ Current Block Size 32.0 KB
85
+ Peak Allocated Bytes 0 B
86
+ Overflow Count 0
87
+ [ALLOC_TEMP_EnlightenWorker] x 2
88
+ Initial Block Size 64.0 KB
89
+ Current Block Size 64.0 KB
90
+ Peak Allocated Bytes 0 B
91
+ Overflow Count 0
92
+ [ALLOC_TEMP_Background Job.Worker 15]
93
+ Initial Block Size 32.0 KB
94
+ Current Block Size 32.0 KB
95
+ Peak Allocated Bytes 0 B
96
+ Overflow Count 0
97
+ [ALLOC_TEMP_Background Job.Worker 1]
98
+ Initial Block Size 32.0 KB
99
+ Current Block Size 32.0 KB
100
+ Peak Allocated Bytes 0 B
101
+ Overflow Count 0
102
+ [ALLOC_TEMP_Background Job.Worker 2]
103
+ Initial Block Size 32.0 KB
104
+ Current Block Size 32.0 KB
105
+ Peak Allocated Bytes 0 B
106
+ Overflow Count 0
107
+ [ALLOC_TEMP_Background Job.Worker 7]
108
+ Initial Block Size 32.0 KB
109
+ Current Block Size 32.0 KB
110
+ Peak Allocated Bytes 0 B
111
+ Overflow Count 0
112
+ [ALLOC_TEMP_UnityGfxDeviceWorker]
113
+ Initial Block Size 256.0 KB
114
+ Current Block Size 256.0 KB
115
+ Peak Allocated Bytes 45.5 KB
116
+ Overflow Count 0
117
+ [ALLOC_TEMP_AssetGarbageCollectorHelper] x 3
118
+ Initial Block Size 64.0 KB
119
+ Current Block Size 64.0 KB
120
+ Peak Allocated Bytes 0 B
121
+ Overflow Count 0
122
+ [ALLOC_TEMP_Background Job.Worker 5]
123
+ Initial Block Size 32.0 KB
124
+ Current Block Size 32.0 KB
125
+ Peak Allocated Bytes 0 B
126
+ Overflow Count 0
127
+ [ALLOC_TEMP_Background Job.Worker 13]
128
+ Initial Block Size 32.0 KB
129
+ Current Block Size 32.0 KB
130
+ Peak Allocated Bytes 0 B
131
+ Overflow Count 0
132
+ [ALLOC_TEMP_Job.Worker 1]
133
+ Initial Block Size 256.0 KB
134
+ Current Block Size 256.0 KB
135
+ Peak Allocated Bytes 0.8 KB
136
+ Overflow Count 0
137
+ [ALLOC_TEMP_Job.Worker 2]
138
+ Initial Block Size 256.0 KB
139
+ Current Block Size 256.0 KB
140
+ Peak Allocated Bytes 0.8 KB
141
+ Overflow Count 0
142
+ [ALLOC_TEMP_Background Job.Worker 3]
143
+ Initial Block Size 32.0 KB
144
+ Current Block Size 32.0 KB
145
+ Peak Allocated Bytes 0 B
146
+ Overflow Count 0
147
+ [ALLOC_TEMP_Background Job.Worker 11]
148
+ Initial Block Size 32.0 KB
149
+ Current Block Size 32.0 KB
150
+ Peak Allocated Bytes 0 B
151
+ Overflow Count 0
152
+ [ALLOC_TEMP_Background Job.Worker 0]
153
+ Initial Block Size 32.0 KB
154
+ Current Block Size 32.0 KB
155
+ Peak Allocated Bytes 0 B
156
+ Overflow Count 0
157
+ [ALLOC_TEMP_Background Job.Worker 4]
158
+ Initial Block Size 32.0 KB
159
+ Current Block Size 32.0 KB
160
+ Peak Allocated Bytes 0 B
161
+ Overflow Count 0
162
+ [ALLOC_TEMP_BatchDeleteObjects]
163
+ Initial Block Size 64.0 KB
164
+ Current Block Size 64.0 KB
165
+ Peak Allocated Bytes 0 B
166
+ Overflow Count 0
167
+ [ALLOC_DEFAULT] Dual Thread Allocator
168
+ Peak main deferred allocation count 27
169
+ [ALLOC_BUCKET]
170
+ Large Block size 4.0 MB
171
+ Used Block count 1
172
+ Peak Allocated bytes 1.3 MB
173
+ [ALLOC_DEFAULT_MAIN]
174
+ Peak usage frame count: [8.0 MB-16.0 MB]: 79 frames
175
+ Requested Block Size 16.0 MB
176
+ Peak Block count 1
177
+ Peak Allocated memory 12.9 MB
178
+ Peak Large allocation bytes 0 B
179
+ [ALLOC_DEFAULT_THREAD]
180
+ Peak usage frame count: [16.0 MB-32.0 MB]: 79 frames
181
+ Requested Block Size 16.0 MB
182
+ Peak Block count 1
183
+ Peak Allocated memory 17.4 MB
184
+ Peak Large allocation bytes 16.0 MB
185
+ [ALLOC_TEMP_JOB_1_FRAME]
186
+ Initial Block Size 2.0 MB
187
+ Used Block Count 1
188
+ Overflow Count (too large) 0
189
+ Overflow Count (full) 0
190
+ [ALLOC_TEMP_JOB_2_FRAMES]
191
+ Initial Block Size 2.0 MB
192
+ Used Block Count 1
193
+ Overflow Count (too large) 0
194
+ Overflow Count (full) 0
195
+ [ALLOC_TEMP_JOB_4_FRAMES (JobTemp)]
196
+ Initial Block Size 2.0 MB
197
+ Used Block Count 2
198
+ Overflow Count (too large) 0
199
+ Overflow Count (full) 0
200
+ [ALLOC_TEMP_JOB_ASYNC (Background)]
201
+ Initial Block Size 1.0 MB
202
+ Used Block Count 3
203
+ Overflow Count (too large) 0
204
+ Overflow Count (full) 0
205
+ [ALLOC_GFX] Dual Thread Allocator
206
+ Peak main deferred allocation count 1
207
+ [ALLOC_BUCKET]
208
+ Large Block size 4.0 MB
209
+ Used Block count 1
210
+ Peak Allocated bytes 1.3 MB
211
+ [ALLOC_GFX_MAIN]
212
+ Peak usage frame count: [32.0 KB-64.0 KB]: 78 frames, [2.0 MB-4.0 MB]: 1 frames
213
+ Requested Block Size 16.0 MB
214
+ Peak Block count 1
215
+ Peak Allocated memory 2.7 MB
216
+ Peak Large allocation bytes 0 B
217
+ [ALLOC_GFX_THREAD]
218
+ Peak usage frame count: [128.0 KB-256.0 KB]: 79 frames
219
+ Requested Block Size 16.0 MB
220
+ Peak Block count 1
221
+ Peak Allocated memory 175.2 KB
222
+ Peak Large allocation bytes 0 B
223
+ [ALLOC_CACHEOBJECTS] Dual Thread Allocator
224
+ Peak main deferred allocation count 0
225
+ [ALLOC_BUCKET]
226
+ Large Block size 4.0 MB
227
+ Used Block count 1
228
+ Peak Allocated bytes 1.3 MB
229
+ [ALLOC_CACHEOBJECTS_MAIN]
230
+ Peak usage frame count: [0.5 MB-1.0 MB]: 78 frames, [1.0 MB-2.0 MB]: 1 frames
231
+ Requested Block Size 4.0 MB
232
+ Peak Block count 1
233
+ Peak Allocated memory 1.2 MB
234
+ Peak Large allocation bytes 0 B
235
+ [ALLOC_CACHEOBJECTS_THREAD]
236
+ Peak usage frame count: [4.0 MB-8.0 MB]: 78 frames, [8.0 MB-16.0 MB]: 1 frames
237
+ Requested Block Size 4.0 MB
238
+ Peak Block count 3
239
+ Peak Allocated memory 9.3 MB
240
+ Peak Large allocation bytes 0 B
241
+ [ALLOC_TYPETREE] Dual Thread Allocator
242
+ Peak main deferred allocation count 0
243
+ [ALLOC_BUCKET]
244
+ Large Block size 4.0 MB
245
+ Used Block count 1
246
+ Peak Allocated bytes 1.3 MB
247
+ [ALLOC_TYPETREE_MAIN]
248
+ Peak usage frame count: [0-1.0 KB]: 79 frames
249
+ Requested Block Size 2.0 MB
250
+ Peak Block count 1
251
+ Peak Allocated memory 1.0 KB
252
+ Peak Large allocation bytes 0 B
253
+ [ALLOC_TYPETREE_THREAD]
254
+ Peak usage frame count: [1.0 KB-2.0 KB]: 78 frames, [2.0 KB-4.0 KB]: 1 frames
255
+ Requested Block Size 2.0 MB
256
+ Peak Block count 1
257
+ Peak Allocated memory 2.2 KB
258
+ Peak Large allocation bytes 0 B
run_logs/timers.json ADDED
@@ -0,0 +1,571 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "name": "root",
3
+ "gauges": {
4
+ "SoccerTwos.Policy.Entropy.mean": {
5
+ "value": 2.5402047634124756,
6
+ "min": 2.5402047634124756,
7
+ "max": 2.5498669147491455,
8
+ "count": 2
9
+ },
10
+ "SoccerTwos.Policy.Entropy.sum": {
11
+ "value": 58607.6015625,
12
+ "min": 47733.5078125,
13
+ "max": 58607.6015625,
14
+ "count": 2
15
+ },
16
+ "SoccerTwos.Environment.EpisodeLength.mean": {
17
+ "value": 55.48863636363637,
18
+ "min": 55.48863636363637,
19
+ "max": 64.36363636363636,
20
+ "count": 2
21
+ },
22
+ "SoccerTwos.Environment.EpisodeLength.sum": {
23
+ "value": 19532.0,
24
+ "min": 16992.0,
25
+ "max": 19532.0,
26
+ "count": 2
27
+ },
28
+ "SoccerTwos.Self-play.ELO.mean": {
29
+ "value": 1537.4520934807072,
30
+ "min": 1534.3935281677052,
31
+ "max": 1537.4520934807072,
32
+ "count": 2
33
+ },
34
+ "SoccerTwos.Self-play.ELO.sum": {
35
+ "value": 270591.56845260446,
36
+ "min": 202539.94571813708,
37
+ "max": 270591.56845260446,
38
+ "count": 2
39
+ },
40
+ "SoccerTwos.Step.mean": {
41
+ "value": 9779987.0,
42
+ "min": 9769992.0,
43
+ "max": 9779987.0,
44
+ "count": 2
45
+ },
46
+ "SoccerTwos.Step.sum": {
47
+ "value": 9779987.0,
48
+ "min": 9769992.0,
49
+ "max": 9779987.0,
50
+ "count": 2
51
+ },
52
+ "SoccerTwos.Policy.ExtrinsicBaselineEstimate.mean": {
53
+ "value": -0.0544770322740078,
54
+ "min": -0.0544770322740078,
55
+ "max": -0.028912479057908058,
56
+ "count": 2
57
+ },
58
+ "SoccerTwos.Policy.ExtrinsicBaselineEstimate.sum": {
59
+ "value": -9.587957382202148,
60
+ "min": -9.587957382202148,
61
+ "max": -3.787534713745117,
62
+ "count": 2
63
+ },
64
+ "SoccerTwos.Policy.ExtrinsicValueEstimate.mean": {
65
+ "value": -0.05579162761569023,
66
+ "min": -0.05579162761569023,
67
+ "max": -0.031879957765340805,
68
+ "count": 2
69
+ },
70
+ "SoccerTwos.Policy.ExtrinsicValueEstimate.sum": {
71
+ "value": -9.819326400756836,
72
+ "min": -9.819326400756836,
73
+ "max": -4.176274299621582,
74
+ "count": 2
75
+ },
76
+ "SoccerTwos.Environment.CumulativeReward.mean": {
77
+ "value": 0.0,
78
+ "min": 0.0,
79
+ "max": 0.0,
80
+ "count": 2
81
+ },
82
+ "SoccerTwos.Environment.CumulativeReward.sum": {
83
+ "value": 0.0,
84
+ "min": 0.0,
85
+ "max": 0.0,
86
+ "count": 2
87
+ },
88
+ "SoccerTwos.Policy.ExtrinsicReward.mean": {
89
+ "value": -0.048363634808496994,
90
+ "min": -0.08014656296213164,
91
+ "max": -0.048363634808496994,
92
+ "count": 2
93
+ },
94
+ "SoccerTwos.Policy.ExtrinsicReward.sum": {
95
+ "value": -8.511999726295471,
96
+ "min": -10.499199748039246,
97
+ "max": -8.511999726295471,
98
+ "count": 2
99
+ },
100
+ "SoccerTwos.Environment.GroupCumulativeReward.mean": {
101
+ "value": -0.048363634808496994,
102
+ "min": -0.08014656296213164,
103
+ "max": -0.048363634808496994,
104
+ "count": 2
105
+ },
106
+ "SoccerTwos.Environment.GroupCumulativeReward.sum": {
107
+ "value": -8.511999726295471,
108
+ "min": -10.499199748039246,
109
+ "max": -8.511999726295471,
110
+ "count": 2
111
+ },
112
+ "SoccerTwos.IsTraining.mean": {
113
+ "value": 1.0,
114
+ "min": 1.0,
115
+ "max": 1.0,
116
+ "count": 2
117
+ },
118
+ "SoccerTwos.IsTraining.sum": {
119
+ "value": 1.0,
120
+ "min": 1.0,
121
+ "max": 1.0,
122
+ "count": 2
123
+ }
124
+ },
125
+ "metadata": {
126
+ "timer_format_version": "0.1.0",
127
+ "start_time_seconds": "1696783892",
128
+ "python_version": "3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0]",
129
+ "command_line_arguments": "/home/ana/Projektit/hugging/soccertwos/venv/bin/mlagents-learn ./config/poca/SoccerTwos.yaml --env=./training-envs-executables/SoccerTwos.x86_64 --run-id=SoccerTwos --resume",
130
+ "mlagents_version": "0.31.0.dev0",
131
+ "mlagents_envs_version": "0.31.0.dev0",
132
+ "communication_protocol_version": "1.5.0",
133
+ "pytorch_version": "1.11.0+cu102",
134
+ "numpy_version": "1.21.2",
135
+ "end_time_seconds": "1696783950"
136
+ },
137
+ "total": 57.42563396994956,
138
+ "count": 1,
139
+ "self": 0.006208683946169913,
140
+ "children": {
141
+ "run_training.setup": {
142
+ "total": 0.11949111899593845,
143
+ "count": 1,
144
+ "self": 0.11949111899593845
145
+ },
146
+ "TrainerController.start_learning": {
147
+ "total": 57.29993416700745,
148
+ "count": 1,
149
+ "self": 0.040766926133073866,
150
+ "children": {
151
+ "TrainerController._reset_env": {
152
+ "total": 5.705403263971675,
153
+ "count": 2,
154
+ "self": 5.705403263971675
155
+ },
156
+ "TrainerController.advance": {
157
+ "total": 50.94050173991127,
158
+ "count": 1530,
159
+ "self": 0.034535818558651954,
160
+ "children": {
161
+ "env_step": {
162
+ "total": 34.55547925073188,
163
+ "count": 1530,
164
+ "self": 27.685120858834125,
165
+ "children": {
166
+ "SubprocessEnvManager._take_step": {
167
+ "total": 6.847566052514594,
168
+ "count": 1531,
169
+ "self": 0.20769104413921013,
170
+ "children": {
171
+ "TorchPolicy.evaluate": {
172
+ "total": 6.639875008375384,
173
+ "count": 2798,
174
+ "self": 6.639875008375384
175
+ }
176
+ }
177
+ },
178
+ "workers": {
179
+ "total": 0.022792339383158833,
180
+ "count": 1530,
181
+ "self": 0.0,
182
+ "children": {
183
+ "worker_root": {
184
+ "total": 87.61538019235013,
185
+ "count": 1530,
186
+ "is_parallel": true,
187
+ "self": 68.35553965624422,
188
+ "children": {
189
+ "run_training.setup": {
190
+ "total": 0.11949111899593845,
191
+ "count": 1,
192
+ "is_parallel": true,
193
+ "self": 0.08583508693845943,
194
+ "children": {
195
+ "steps_from_proto": {
196
+ "total": 0.005766789021436125,
197
+ "count": 2,
198
+ "is_parallel": true,
199
+ "self": 0.0014531869674101472,
200
+ "children": {
201
+ "_process_rank_one_or_two_observation": {
202
+ "total": 0.004313602054025978,
203
+ "count": 8,
204
+ "is_parallel": true,
205
+ "self": 0.004313602054025978
206
+ }
207
+ }
208
+ },
209
+ "UnityEnvironment.step": {
210
+ "total": 0.0278892430360429,
211
+ "count": 1,
212
+ "is_parallel": true,
213
+ "self": 0.0007742461166344583,
214
+ "children": {
215
+ "UnityEnvironment._generate_step_input": {
216
+ "total": 0.0008806539699435234,
217
+ "count": 1,
218
+ "is_parallel": true,
219
+ "self": 0.0008806539699435234
220
+ },
221
+ "communicator.exchange": {
222
+ "total": 0.023792159976437688,
223
+ "count": 1,
224
+ "is_parallel": true,
225
+ "self": 0.023792159976437688
226
+ },
227
+ "steps_from_proto": {
228
+ "total": 0.0024421829730272293,
229
+ "count": 2,
230
+ "is_parallel": true,
231
+ "self": 0.0005407399730756879,
232
+ "children": {
233
+ "_process_rank_one_or_two_observation": {
234
+ "total": 0.0019014429999515414,
235
+ "count": 8,
236
+ "is_parallel": true,
237
+ "self": 0.0019014429999515414
238
+ }
239
+ }
240
+ }
241
+ }
242
+ }
243
+ }
244
+ },
245
+ "steps_from_proto": {
246
+ "total": 0.004452660970855504,
247
+ "count": 2,
248
+ "is_parallel": true,
249
+ "self": 0.0009618738549761474,
250
+ "children": {
251
+ "_process_rank_one_or_two_observation": {
252
+ "total": 0.003490787115879357,
253
+ "count": 8,
254
+ "is_parallel": true,
255
+ "self": 0.003490787115879357
256
+ }
257
+ }
258
+ },
259
+ "UnityEnvironment.step": {
260
+ "total": 19.13589675613912,
261
+ "count": 1528,
262
+ "is_parallel": true,
263
+ "self": 1.0241968964110129,
264
+ "children": {
265
+ "UnityEnvironment._generate_step_input": {
266
+ "total": 1.0250182411400601,
267
+ "count": 1528,
268
+ "is_parallel": true,
269
+ "self": 1.0250182411400601
270
+ },
271
+ "communicator.exchange": {
272
+ "total": 13.89324302377645,
273
+ "count": 1528,
274
+ "is_parallel": true,
275
+ "self": 13.89324302377645
276
+ },
277
+ "steps_from_proto": {
278
+ "total": 3.193438594811596,
279
+ "count": 3056,
280
+ "is_parallel": true,
281
+ "self": 0.7139255938818678,
282
+ "children": {
283
+ "_process_rank_one_or_two_observation": {
284
+ "total": 2.479513000929728,
285
+ "count": 12224,
286
+ "is_parallel": true,
287
+ "self": 2.479513000929728
288
+ }
289
+ }
290
+ }
291
+ }
292
+ },
293
+ "TrainerController.start_learning": {
294
+ "total": 0.0,
295
+ "count": 0,
296
+ "is_parallel": true,
297
+ "self": 0.0,
298
+ "children": {
299
+ "TrainerController._reset_env": {
300
+ "total": 5.705403263971675,
301
+ "count": 2,
302
+ "is_parallel": true,
303
+ "self": 5.705403263971675
304
+ },
305
+ "TrainerController.advance": {
306
+ "total": 32.185165390896145,
307
+ "count": 1235,
308
+ "is_parallel": true,
309
+ "self": 0.027747171348892152,
310
+ "children": {
311
+ "env_step": {
312
+ "total": 24.84874262235826,
313
+ "count": 1235,
314
+ "is_parallel": true,
315
+ "self": 19.25259252556134,
316
+ "children": {
317
+ "SubprocessEnvManager._take_step": {
318
+ "total": 5.5482283955207095,
319
+ "count": 1236,
320
+ "is_parallel": true,
321
+ "self": 0.16566000110469759,
322
+ "children": {
323
+ "TorchPolicy.evaluate": {
324
+ "total": 5.382568394416012,
325
+ "count": 2274,
326
+ "is_parallel": true,
327
+ "self": 5.382568394416012
328
+ }
329
+ }
330
+ },
331
+ "workers": {
332
+ "total": 0.01835254131583497,
333
+ "count": 1235,
334
+ "is_parallel": true,
335
+ "self": 0.0,
336
+ "children": {
337
+ "worker_root": {
338
+ "total": 37.98809464479564,
339
+ "count": 1235,
340
+ "is_parallel": true,
341
+ "self": 22.408434155222494,
342
+ "children": {
343
+ "run_training.setup": {
344
+ "total": 0.0,
345
+ "count": 0,
346
+ "is_parallel": true,
347
+ "self": 0.0,
348
+ "children": {
349
+ "steps_from_proto": {
350
+ "total": 0.005766789021436125,
351
+ "count": 2,
352
+ "is_parallel": true,
353
+ "self": 0.0014531869674101472,
354
+ "children": {
355
+ "_process_rank_one_or_two_observation": {
356
+ "total": 0.004313602054025978,
357
+ "count": 8,
358
+ "is_parallel": true,
359
+ "self": 0.004313602054025978
360
+ }
361
+ }
362
+ },
363
+ "UnityEnvironment.step": {
364
+ "total": 0.0278892430360429,
365
+ "count": 1,
366
+ "is_parallel": true,
367
+ "self": 0.0007742461166344583,
368
+ "children": {
369
+ "UnityEnvironment._generate_step_input": {
370
+ "total": 0.0008806539699435234,
371
+ "count": 1,
372
+ "is_parallel": true,
373
+ "self": 0.0008806539699435234
374
+ },
375
+ "communicator.exchange": {
376
+ "total": 0.023792159976437688,
377
+ "count": 1,
378
+ "is_parallel": true,
379
+ "self": 0.023792159976437688
380
+ },
381
+ "steps_from_proto": {
382
+ "total": 0.0024421829730272293,
383
+ "count": 2,
384
+ "is_parallel": true,
385
+ "self": 0.0005407399730756879,
386
+ "children": {
387
+ "_process_rank_one_or_two_observation": {
388
+ "total": 0.0019014429999515414,
389
+ "count": 8,
390
+ "is_parallel": true,
391
+ "self": 0.0019014429999515414
392
+ }
393
+ }
394
+ }
395
+ }
396
+ }
397
+ }
398
+ },
399
+ "steps_from_proto": {
400
+ "total": 0.004452660970855504,
401
+ "count": 2,
402
+ "is_parallel": true,
403
+ "self": 0.0009618738549761474,
404
+ "children": {
405
+ "_process_rank_one_or_two_observation": {
406
+ "total": 0.003490787115879357,
407
+ "count": 8,
408
+ "is_parallel": true,
409
+ "self": 0.003490787115879357
410
+ }
411
+ }
412
+ },
413
+ "UnityEnvironment.step": {
414
+ "total": 15.575207828602288,
415
+ "count": 1234,
416
+ "is_parallel": true,
417
+ "self": 0.8268890920444392,
418
+ "children": {
419
+ "UnityEnvironment._generate_step_input": {
420
+ "total": 0.8285353232058696,
421
+ "count": 1234,
422
+ "is_parallel": true,
423
+ "self": 0.8285353232058696
424
+ },
425
+ "communicator.exchange": {
426
+ "total": 11.338853520981502,
427
+ "count": 1234,
428
+ "is_parallel": true,
429
+ "self": 11.338853520981502
430
+ },
431
+ "steps_from_proto": {
432
+ "total": 2.5809298923704773,
433
+ "count": 2468,
434
+ "is_parallel": true,
435
+ "self": 0.5749322547926567,
436
+ "children": {
437
+ "_process_rank_one_or_two_observation": {
438
+ "total": 2.0059976375778206,
439
+ "count": 9872,
440
+ "is_parallel": true,
441
+ "self": 2.0059976375778206
442
+ }
443
+ }
444
+ }
445
+ }
446
+ }
447
+ }
448
+ }
449
+ }
450
+ },
451
+ "steps_from_proto": {
452
+ "total": 0.003886807942762971,
453
+ "count": 2,
454
+ "is_parallel": true,
455
+ "self": 0.0009482309687882662,
456
+ "children": {
457
+ "_process_rank_one_or_two_observation": {
458
+ "total": 0.0029385769739747047,
459
+ "count": 8,
460
+ "is_parallel": true,
461
+ "self": 0.0029385769739747047
462
+ }
463
+ }
464
+ },
465
+ "UnityEnvironment.step": {
466
+ "total": 0.025682352017611265,
467
+ "count": 1,
468
+ "is_parallel": true,
469
+ "self": 0.000759823014959693,
470
+ "children": {
471
+ "UnityEnvironment._generate_step_input": {
472
+ "total": 0.0007638870156370103,
473
+ "count": 1,
474
+ "is_parallel": true,
475
+ "self": 0.0007638870156370103
476
+ },
477
+ "communicator.exchange": {
478
+ "total": 0.021930588991381228,
479
+ "count": 1,
480
+ "is_parallel": true,
481
+ "self": 0.021930588991381228
482
+ },
483
+ "steps_from_proto": {
484
+ "total": 0.002228052995633334,
485
+ "count": 2,
486
+ "is_parallel": true,
487
+ "self": 0.0005018569645471871,
488
+ "children": {
489
+ "_process_rank_one_or_two_observation": {
490
+ "total": 0.0017261960310861468,
491
+ "count": 8,
492
+ "is_parallel": true,
493
+ "self": 0.0017261960310861468
494
+ }
495
+ }
496
+ }
497
+ }
498
+ }
499
+ }
500
+ },
501
+ "trainer_advance": {
502
+ "total": 7.308675597188994,
503
+ "count": 1235,
504
+ "is_parallel": true,
505
+ "self": 0.19045817520236596,
506
+ "children": {
507
+ "process_trajectory": {
508
+ "total": 7.118217421986628,
509
+ "count": 1235,
510
+ "is_parallel": true,
511
+ "self": 7.118217421986628
512
+ }
513
+ }
514
+ }
515
+ }
516
+ }
517
+ }
518
+ }
519
+ }
520
+ }
521
+ }
522
+ }
523
+ }
524
+ },
525
+ "trainer_advance": {
526
+ "total": 16.35048667062074,
527
+ "count": 1530,
528
+ "self": 0.23428562824847177,
529
+ "children": {
530
+ "process_trajectory": {
531
+ "total": 9.00634833337972,
532
+ "count": 1530,
533
+ "self": 9.00634833337972
534
+ },
535
+ "_update_policy": {
536
+ "total": 7.109852708992548,
537
+ "count": 1,
538
+ "self": 1.325621280062478,
539
+ "children": {
540
+ "TorchPOCAOptimizer.update": {
541
+ "total": 5.78423142893007,
542
+ "count": 5,
543
+ "self": 5.78423142893007
544
+ }
545
+ }
546
+ }
547
+ }
548
+ }
549
+ }
550
+ },
551
+ "trainer_threads": {
552
+ "total": 1.6560079529881477e-06,
553
+ "count": 1,
554
+ "self": 1.6560079529881477e-06
555
+ },
556
+ "TrainerController._save_models": {
557
+ "total": 0.6132605809834786,
558
+ "count": 1,
559
+ "self": 0.0025487419916316867,
560
+ "children": {
561
+ "RLTrainer._checkpoint": {
562
+ "total": 0.6107118389918469,
563
+ "count": 1,
564
+ "self": 0.6107118389918469
565
+ }
566
+ }
567
+ }
568
+ }
569
+ }
570
+ }
571
+ }
run_logs/training_status.json ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "SoccerTwos": {
3
+ "checkpoints": [
4
+ {
5
+ "steps": 8499942,
6
+ "file_path": "results/SoccerTwos/SoccerTwos/SoccerTwos-8499942.onnx",
7
+ "reward": 0.0,
8
+ "creation_time": 1696778823.3498056,
9
+ "auxillary_file_paths": [
10
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-8499942.pt"
11
+ ]
12
+ },
13
+ {
14
+ "steps": 8999964,
15
+ "file_path": "results/SoccerTwos/SoccerTwos/SoccerTwos-8999964.onnx",
16
+ "reward": 0.0,
17
+ "creation_time": 1696780857.3625648,
18
+ "auxillary_file_paths": [
19
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-8999964.pt"
20
+ ]
21
+ },
22
+ {
23
+ "steps": 9499768,
24
+ "file_path": "results/SoccerTwos/SoccerTwos/SoccerTwos-9499768.onnx",
25
+ "reward": 0.0,
26
+ "creation_time": 1696782815.581065,
27
+ "auxillary_file_paths": [
28
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-9499768.pt"
29
+ ]
30
+ },
31
+ {
32
+ "steps": 9761498,
33
+ "file_path": "results/SoccerTwos/SoccerTwos/SoccerTwos-9761498.onnx",
34
+ "reward": 0.0,
35
+ "creation_time": 1696783852.5849328,
36
+ "auxillary_file_paths": [
37
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-9761498.pt"
38
+ ]
39
+ },
40
+ {
41
+ "steps": 9782042,
42
+ "file_path": "results/SoccerTwos/SoccerTwos/SoccerTwos-9782042.onnx",
43
+ "reward": null,
44
+ "creation_time": 1696783950.2721186,
45
+ "auxillary_file_paths": [
46
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-9782042.pt"
47
+ ]
48
+ }
49
+ ],
50
+ "elo": 1539.1817062749371,
51
+ "final_checkpoint": {
52
+ "steps": 9782042,
53
+ "file_path": "results/SoccerTwos/SoccerTwos.onnx",
54
+ "reward": null,
55
+ "creation_time": 1696783950.2721186,
56
+ "auxillary_file_paths": [
57
+ "results/SoccerTwos/SoccerTwos/SoccerTwos-9782042.pt"
58
+ ]
59
+ }
60
+ },
61
+ "metadata": {
62
+ "stats_format_version": "0.3.0",
63
+ "mlagents_version": "0.31.0.dev0",
64
+ "torch_version": "1.11.0+cu102"
65
+ }
66
+ }