Duckietown Challenges Home Challenges Submissions

Evaluator 5130

ID5130
evaluatorgpu-production-spot-0-04
ownerI don't have one ๐Ÿ˜€
machinegpu-prod_fe743c83d2b2
processgpu-production-spot-0-04_fe743c83d2b2
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success12 66407
# timeout
# failed1 66444
# error
# aborted1 66367
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)249.0 GB
RAM free (MB)239.6 GB
Disk (MB)969.3 GB
Disk available (MB)871.4 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6661914158Kiyo Kuniiexercises_braitenbergmooc-BV1488successyesgpu-production-spot-0-040:05:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.011989986047266655
agent_compute-ego0_mean0.011989986047266655
agent_compute-ego0_median0.011989986047266655
agent_compute-ego0_min0.011989986047266655
complete-iteration_max0.31149515942092937
complete-iteration_mean0.31149515942092937
complete-iteration_median0.31149515942092937
complete-iteration_min0.31149515942092937
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max1.4609135362983796
driven_any_mean1.4609135362983796
driven_any_median1.4609135362983796
driven_any_min1.4609135362983796
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.12774020197523614
get_duckie_state_mean0.12774020197523614
get_duckie_state_median0.12774020197523614
get_duckie_state_min0.12774020197523614
get_robot_state_max0.004075787627288094
get_robot_state_mean0.004075787627288094
get_robot_state_median0.004075787627288094
get_robot_state_min0.004075787627288094
get_state_dump_max0.025535231215343627
get_state_dump_mean0.025535231215343627
get_state_dump_median0.025535231215343627
get_state_dump_min0.025535231215343627
get_ui_image_max0.03777445400610448
get_ui_image_mean0.03777445400610448
get_ui_image_median0.03777445400610448
get_ui_image_min0.03777445400610448
in-drivable-lane_max18.900000000000137
in-drivable-lane_mean18.900000000000137
in-drivable-lane_median18.900000000000137
in-drivable-lane_min18.900000000000137
per-episodes
details{"d60-ego0": {"driven_any": 1.4609135362983796, "get_ui_image": 0.03777445400610448, "step_physics": 0.08414295543781371, "survival_time": 18.900000000000137, "driven_lanedir": 0.0, "get_state_dump": 0.025535231215343627, "get_robot_state": 0.004075787627288094, "sim_render-ego0": 0.0038725272961216426, "get_duckie_state": 0.12774020197523614, "in-drivable-lane": 18.900000000000137, "deviation-heading": 0.0, "agent_compute-ego0": 0.011989986047266655, "complete-iteration": 0.31149515942092937, "set_robot_commands": 0.0023082768382371886, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.011901829676766508, "sim_compute_performance-ego0": 0.0020546548284767173}}
set_robot_commands_max0.0023082768382371886
set_robot_commands_mean0.0023082768382371886
set_robot_commands_median0.0023082768382371886
set_robot_commands_min0.0023082768382371886
sim_compute_performance-ego0_max0.0020546548284767173
sim_compute_performance-ego0_mean0.0020546548284767173
sim_compute_performance-ego0_median0.0020546548284767173
sim_compute_performance-ego0_min0.0020546548284767173
sim_compute_sim_state_max0.011901829676766508
sim_compute_sim_state_mean0.011901829676766508
sim_compute_sim_state_median0.011901829676766508
sim_compute_sim_state_min0.011901829676766508
sim_render-ego0_max0.0038725272961216426
sim_render-ego0_mean0.0038725272961216426
sim_render-ego0_median0.0038725272961216426
sim_render-ego0_min0.0038725272961216426
simulation-passed1
step_physics_max0.08414295543781371
step_physics_mean0.08414295543781371
step_physics_median0.08414295543781371
step_physics_min0.08414295543781371
survival_time_max18.900000000000137
survival_time_mean18.900000000000137
survival_time_median18.900000000000137
survival_time_min18.900000000000137
No reset possible
6654614145Scott Vangexercises_braitenbergmooc-BV1489successyesgpu-production-spot-0-040:07:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.011176636219024658
agent_compute-ego0_mean0.011176636219024658
agent_compute-ego0_median0.011176636219024658
agent_compute-ego0_min0.011176636219024658
complete-iteration_max0.23536301851272584
complete-iteration_mean0.23536301851272584
complete-iteration_median0.23536301851272584
complete-iteration_min0.23536301851272584
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max2.409180684127623
driven_any_mean2.409180684127623
driven_any_median2.409180684127623
driven_any_min2.409180684127623
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08235325166157313
get_duckie_state_mean0.08235325166157313
get_duckie_state_median0.08235325166157313
get_duckie_state_min0.08235325166157313
get_robot_state_max0.003709077494485038
get_robot_state_mean0.003709077494485038
get_robot_state_median0.003709077494485038
get_robot_state_min0.003709077494485038
get_state_dump_max0.017558321271623885
get_state_dump_mean0.017558321271623885
get_state_dump_median0.017558321271623885
get_state_dump_min0.017558321271623885
get_ui_image_max0.030302731309618268
get_ui_image_mean0.030302731309618268
get_ui_image_median0.030302731309618268
get_ui_image_min0.030302731309618268
in-drivable-lane_max34.95000000000015
in-drivable-lane_mean34.95000000000015
in-drivable-lane_median34.95000000000015
in-drivable-lane_min34.95000000000015
per-episodes
details{"d40-ego0": {"driven_any": 2.409180684127623, "get_ui_image": 0.030302731309618268, "step_physics": 0.0702428092275347, "survival_time": 34.95000000000015, "driven_lanedir": 0.0, "get_state_dump": 0.017558321271623885, "get_robot_state": 0.003709077494485038, "sim_render-ego0": 0.003660024234226772, "get_duckie_state": 0.08235325166157313, "in-drivable-lane": 34.95000000000015, "deviation-heading": 0.0, "agent_compute-ego0": 0.011176636219024658, "complete-iteration": 0.23536301851272584, "set_robot_commands": 0.0022657312665666854, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.012070321696145194, "sim_compute_performance-ego0": 0.001942399569920131}}
set_robot_commands_max0.0022657312665666854
set_robot_commands_mean0.0022657312665666854
set_robot_commands_median0.0022657312665666854
set_robot_commands_min0.0022657312665666854
sim_compute_performance-ego0_max0.001942399569920131
sim_compute_performance-ego0_mean0.001942399569920131
sim_compute_performance-ego0_median0.001942399569920131
sim_compute_performance-ego0_min0.001942399569920131
sim_compute_sim_state_max0.012070321696145194
sim_compute_sim_state_mean0.012070321696145194
sim_compute_sim_state_median0.012070321696145194
sim_compute_sim_state_min0.012070321696145194
sim_render-ego0_max0.003660024234226772
sim_render-ego0_mean0.003660024234226772
sim_render-ego0_median0.003660024234226772
sim_render-ego0_min0.003660024234226772
simulation-passed1
step_physics_max0.0702428092275347
step_physics_mean0.0702428092275347
step_physics_median0.0702428092275347
step_physics_min0.0702428092275347
survival_time_max34.95000000000015
survival_time_mean34.95000000000015
survival_time_median34.95000000000015
survival_time_min34.95000000000015
No reset possible
6653514142Andrew Marinexercises_braitenbergmooc-BV1488successyesgpu-production-spot-0-040:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.011489670199177326
agent_compute-ego0_mean0.011489670199177326
agent_compute-ego0_median0.011489670199177326
agent_compute-ego0_min0.011489670199177326
complete-iteration_max0.30346941259363497
complete-iteration_mean0.30346941259363497
complete-iteration_median0.30346941259363497
complete-iteration_min0.30346941259363497
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max1.2712723470977942
driven_any_mean1.2712723470977942
driven_any_median1.2712723470977942
driven_any_min1.2712723470977942
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.12498733627236708
get_duckie_state_mean0.12498733627236708
get_duckie_state_median0.12498733627236708
get_duckie_state_min0.12498733627236708
get_robot_state_max0.003924566055463109
get_robot_state_mean0.003924566055463109
get_robot_state_median0.003924566055463109
get_robot_state_min0.003924566055463109
get_state_dump_max0.025040356260774797
get_state_dump_mean0.025040356260774797
get_state_dump_median0.025040356260774797
get_state_dump_min0.025040356260774797
get_ui_image_max0.03738707583733845
get_ui_image_mean0.03738707583733845
get_ui_image_median0.03738707583733845
get_ui_image_min0.03738707583733845
in-drivable-lane_max13.80000000000006
in-drivable-lane_mean13.80000000000006
in-drivable-lane_median13.80000000000006
in-drivable-lane_min13.80000000000006
per-episodes
details{"d60-ego0": {"driven_any": 1.2712723470977942, "get_ui_image": 0.03738707583733845, "step_physics": 0.0805316152125059, "survival_time": 13.80000000000006, "driven_lanedir": 0.0, "get_state_dump": 0.025040356260774797, "get_robot_state": 0.003924566055463109, "sim_render-ego0": 0.0038311584761857127, "get_duckie_state": 0.12498733627236708, "in-drivable-lane": 13.80000000000006, "deviation-heading": 0.0, "agent_compute-ego0": 0.011489670199177326, "complete-iteration": 0.30346941259363497, "set_robot_commands": 0.002259173548178552, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01192383387458884, "sim_compute_performance-ego0": 0.0020014619999413888}}
set_robot_commands_max0.002259173548178552
set_robot_commands_mean0.002259173548178552
set_robot_commands_median0.002259173548178552
set_robot_commands_min0.002259173548178552
sim_compute_performance-ego0_max0.0020014619999413888
sim_compute_performance-ego0_mean0.0020014619999413888
sim_compute_performance-ego0_median0.0020014619999413888
sim_compute_performance-ego0_min0.0020014619999413888
sim_compute_sim_state_max0.01192383387458884
sim_compute_sim_state_mean0.01192383387458884
sim_compute_sim_state_median0.01192383387458884
sim_compute_sim_state_min0.01192383387458884
sim_render-ego0_max0.0038311584761857127
sim_render-ego0_mean0.0038311584761857127
sim_render-ego0_median0.0038311584761857127
sim_render-ego0_min0.0038311584761857127
simulation-passed1
step_physics_max0.0805316152125059
step_physics_mean0.0805316152125059
step_physics_median0.0805316152125059
step_physics_min0.0805316152125059
survival_time_max13.80000000000006
survival_time_mean13.80000000000006
survival_time_median13.80000000000006
survival_time_min13.80000000000006
No reset possible
6652714140Pedro Fillastreexercises_braitenbergmooc-BV1489successyesgpu-production-spot-0-040:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.011012545653751918
agent_compute-ego0_mean0.011012545653751918
agent_compute-ego0_median0.011012545653751918
agent_compute-ego0_min0.011012545653751918
complete-iteration_max0.23182024558385217
complete-iteration_mean0.23182024558385217
complete-iteration_median0.23182024558385217
complete-iteration_min0.23182024558385217
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max1.4373614397214176
driven_any_mean1.4373614397214176
driven_any_median1.4373614397214176
driven_any_min1.4373614397214176
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08016473693507058
get_duckie_state_mean0.08016473693507058
get_duckie_state_median0.08016473693507058
get_duckie_state_min0.08016473693507058
get_robot_state_max0.003598838334991818
get_robot_state_mean0.003598838334991818
get_robot_state_median0.003598838334991818
get_robot_state_min0.003598838334991818
get_state_dump_max0.017414192358652752
get_state_dump_mean0.017414192358652752
get_state_dump_median0.017414192358652752
get_state_dump_min0.017414192358652752
get_ui_image_max0.03092358154909951
get_ui_image_mean0.03092358154909951
get_ui_image_median0.03092358154909951
get_ui_image_min0.03092358154909951
in-drivable-lane_max16.750000000000103
in-drivable-lane_mean16.750000000000103
in-drivable-lane_median16.750000000000103
in-drivable-lane_min16.750000000000103
per-episodes
details{"d40-ego0": {"driven_any": 1.4373614397214176, "get_ui_image": 0.03092358154909951, "step_physics": 0.0703763763109843, "survival_time": 16.750000000000103, "driven_lanedir": 0.0, "get_state_dump": 0.017414192358652752, "get_robot_state": 0.003598838334991818, "sim_render-ego0": 0.003660131778035845, "get_duckie_state": 0.08016473693507058, "in-drivable-lane": 16.750000000000103, "deviation-heading": 0.0, "agent_compute-ego0": 0.011012545653751918, "complete-iteration": 0.23182024558385217, "set_robot_commands": 0.002163977140472049, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010510668868110293, "sim_compute_performance-ego0": 0.001911298150107974}}
set_robot_commands_max0.002163977140472049
set_robot_commands_mean0.002163977140472049
set_robot_commands_median0.002163977140472049
set_robot_commands_min0.002163977140472049
sim_compute_performance-ego0_max0.001911298150107974
sim_compute_performance-ego0_mean0.001911298150107974
sim_compute_performance-ego0_median0.001911298150107974
sim_compute_performance-ego0_min0.001911298150107974
sim_compute_sim_state_max0.010510668868110293
sim_compute_sim_state_mean0.010510668868110293
sim_compute_sim_state_median0.010510668868110293
sim_compute_sim_state_min0.010510668868110293
sim_render-ego0_max0.003660131778035845
sim_render-ego0_mean0.003660131778035845
sim_render-ego0_median0.003660131778035845
sim_render-ego0_min0.003660131778035845
simulation-passed1
step_physics_max0.0703763763109843
step_physics_mean0.0703763763109843
step_physics_median0.0703763763109843
step_physics_min0.0703763763109843
survival_time_max16.750000000000103
survival_time_mean16.750000000000103
survival_time_median16.750000000000103
survival_time_min16.750000000000103
No reset possible
6652314139Marin Dantchevexercises_braitenbergmooc-BV1488successyesgpu-production-spot-0-040:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.011811923199012631
agent_compute-ego0_mean0.011811923199012631
agent_compute-ego0_median0.011811923199012631
agent_compute-ego0_min0.011811923199012631
complete-iteration_max0.2964477406173456
complete-iteration_mean0.2964477406173456
complete-iteration_median0.2964477406173456
complete-iteration_min0.2964477406173456
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max1.3122614559448564
driven_any_mean1.3122614559448564
driven_any_median1.3122614559448564
driven_any_min1.3122614559448564
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1247377333093862
get_duckie_state_mean0.1247377333093862
get_duckie_state_median0.1247377333093862
get_duckie_state_min0.1247377333093862
get_robot_state_max0.003741368309396212
get_robot_state_mean0.003741368309396212
get_robot_state_median0.003741368309396212
get_robot_state_min0.003741368309396212
get_state_dump_max0.02419330252975714
get_state_dump_mean0.02419330252975714
get_state_dump_median0.02419330252975714
get_state_dump_min0.02419330252975714
get_ui_image_max0.03733783002759589
get_ui_image_mean0.03733783002759589
get_ui_image_median0.03733783002759589
get_ui_image_min0.03733783002759589
in-drivable-lane_max15.20000000000008
in-drivable-lane_mean15.20000000000008
in-drivable-lane_median15.20000000000008
in-drivable-lane_min15.20000000000008
per-episodes
details{"d60-ego0": {"driven_any": 1.3122614559448564, "get_ui_image": 0.03733783002759589, "step_physics": 0.07557805014438317, "survival_time": 15.20000000000008, "driven_lanedir": 0.0, "get_state_dump": 0.02419330252975714, "get_robot_state": 0.003741368309396212, "sim_render-ego0": 0.0037421461011542647, "get_duckie_state": 0.1247377333093862, "in-drivable-lane": 15.20000000000008, "deviation-heading": 0.0, "agent_compute-ego0": 0.011811923199012631, "complete-iteration": 0.2964477406173456, "set_robot_commands": 0.0022284413947433724, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.011015455840063876, "sim_compute_performance-ego0": 0.001971328453939469}}
set_robot_commands_max0.0022284413947433724
set_robot_commands_mean0.0022284413947433724
set_robot_commands_median0.0022284413947433724
set_robot_commands_min0.0022284413947433724
sim_compute_performance-ego0_max0.001971328453939469
sim_compute_performance-ego0_mean0.001971328453939469
sim_compute_performance-ego0_median0.001971328453939469
sim_compute_performance-ego0_min0.001971328453939469
sim_compute_sim_state_max0.011015455840063876
sim_compute_sim_state_mean0.011015455840063876
sim_compute_sim_state_median0.011015455840063876
sim_compute_sim_state_min0.011015455840063876
sim_render-ego0_max0.0037421461011542647
sim_render-ego0_mean0.0037421461011542647
sim_render-ego0_median0.0037421461011542647
sim_render-ego0_min0.0037421461011542647
simulation-passed1
step_physics_max0.07557805014438317
step_physics_mean0.07557805014438317
step_physics_median0.07557805014438317
step_physics_min0.07557805014438317
survival_time_max15.20000000000008
survival_time_mean15.20000000000008
survival_time_median15.20000000000008
survival_time_min15.20000000000008
No reset possible
6650014136Marin Dantchevexercises_braitenbergmooc-BV1489successyesgpu-production-spot-0-040:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.011937805905817656
agent_compute-ego0_mean0.011937805905817656
agent_compute-ego0_median0.011937805905817656
agent_compute-ego0_min0.011937805905817656
complete-iteration_max0.25158076594782003
complete-iteration_mean0.25158076594782003
complete-iteration_median0.25158076594782003
complete-iteration_min0.25158076594782003
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max1.214431800110747
driven_any_mean1.214431800110747
driven_any_median1.214431800110747
driven_any_min1.214431800110747
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0872066779278038
get_duckie_state_mean0.0872066779278038
get_duckie_state_median0.0872066779278038
get_duckie_state_min0.0872066779278038
get_robot_state_max0.004009138220404036
get_robot_state_mean0.004009138220404036
get_robot_state_median0.004009138220404036
get_robot_state_min0.004009138220404036
get_state_dump_max0.01884562178763418
get_state_dump_mean0.01884562178763418
get_state_dump_median0.01884562178763418
get_state_dump_min0.01884562178763418
get_ui_image_max0.031940446709686855
get_ui_image_mean0.031940446709686855
get_ui_image_median0.031940446709686855
get_ui_image_min0.031940446709686855
in-drivable-lane_max18.500000000000128
in-drivable-lane_mean18.500000000000128
in-drivable-lane_median18.500000000000128
in-drivable-lane_min18.500000000000128
per-episodes
details{"d40-ego0": {"driven_any": 1.214431800110747, "get_ui_image": 0.031940446709686855, "step_physics": 0.07753674874729866, "survival_time": 18.500000000000128, "driven_lanedir": 0.0, "get_state_dump": 0.01884562178763418, "get_robot_state": 0.004009138220404036, "sim_render-ego0": 0.003999511507964841, "get_duckie_state": 0.0872066779278038, "in-drivable-lane": 18.500000000000128, "deviation-heading": 0.0, "agent_compute-ego0": 0.011937805905817656, "complete-iteration": 0.25158076594782003, "set_robot_commands": 0.002470959228968042, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.011401528618085096, "sim_compute_performance-ego0": 0.0021238282041729623}}
set_robot_commands_max0.002470959228968042
set_robot_commands_mean0.002470959228968042
set_robot_commands_median0.002470959228968042
set_robot_commands_min0.002470959228968042
sim_compute_performance-ego0_max0.0021238282041729623
sim_compute_performance-ego0_mean0.0021238282041729623
sim_compute_performance-ego0_median0.0021238282041729623
sim_compute_performance-ego0_min0.0021238282041729623
sim_compute_sim_state_max0.011401528618085096
sim_compute_sim_state_mean0.011401528618085096
sim_compute_sim_state_median0.011401528618085096
sim_compute_sim_state_min0.011401528618085096
sim_render-ego0_max0.003999511507964841
sim_render-ego0_mean0.003999511507964841
sim_render-ego0_median0.003999511507964841
sim_render-ego0_min0.003999511507964841
simulation-passed1
step_physics_max0.07753674874729866
step_physics_mean0.07753674874729866
step_physics_median0.07753674874729866
step_physics_min0.07753674874729866
survival_time_max18.500000000000128
survival_time_mean18.500000000000128
survival_time_median18.500000000000128
survival_time_min18.500000000000128
No reset possible
6649114134Michal Wรณjcikexercises_braitenbergmooc-BV1488successyesgpu-production-spot-0-040:07:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.011832682212980668
agent_compute-ego0_mean0.011832682212980668
agent_compute-ego0_median0.011832682212980668
agent_compute-ego0_min0.011832682212980668
complete-iteration_max0.29361533371135345
complete-iteration_mean0.29361533371135345
complete-iteration_median0.29361533371135345
complete-iteration_min0.29361533371135345
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max2.615347083180961
driven_any_mean2.615347083180961
driven_any_median2.615347083180961
driven_any_min2.615347083180961
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1221911057387248
get_duckie_state_mean0.1221911057387248
get_duckie_state_median0.1221911057387248
get_duckie_state_min0.1221911057387248
get_robot_state_max0.0037124566119102753
get_robot_state_mean0.0037124566119102753
get_robot_state_median0.0037124566119102753
get_robot_state_min0.0037124566119102753
get_state_dump_max0.024440603681129984
get_state_dump_mean0.024440603681129984
get_state_dump_median0.024440603681129984
get_state_dump_min0.024440603681129984
get_ui_image_max0.03692413241949805
get_ui_image_mean0.03692413241949805
get_ui_image_median0.03692413241949805
get_ui_image_min0.03692413241949805
in-drivable-lane_max30.250000000000295
in-drivable-lane_mean30.250000000000295
in-drivable-lane_median30.250000000000295
in-drivable-lane_min30.250000000000295
per-episodes
details{"d60-ego0": {"driven_any": 2.615347083180961, "get_ui_image": 0.03692413241949805, "step_physics": 0.07388351065884328, "survival_time": 30.250000000000295, "driven_lanedir": 0.0, "get_state_dump": 0.024440603681129984, "get_robot_state": 0.0037124566119102753, "sim_render-ego0": 0.0037484676531045744, "get_duckie_state": 0.1221911057387248, "in-drivable-lane": 30.250000000000295, "deviation-heading": 0.0, "agent_compute-ego0": 0.011832682212980668, "complete-iteration": 0.29361533371135345, "set_robot_commands": 0.002266010042070949, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.012558630197355062, "sim_compute_performance-ego0": 0.0019658910165918937}}
set_robot_commands_max0.002266010042070949
set_robot_commands_mean0.002266010042070949
set_robot_commands_median0.002266010042070949
set_robot_commands_min0.002266010042070949
sim_compute_performance-ego0_max0.0019658910165918937
sim_compute_performance-ego0_mean0.0019658910165918937
sim_compute_performance-ego0_median0.0019658910165918937
sim_compute_performance-ego0_min0.0019658910165918937
sim_compute_sim_state_max0.012558630197355062
sim_compute_sim_state_mean0.012558630197355062
sim_compute_sim_state_median0.012558630197355062
sim_compute_sim_state_min0.012558630197355062
sim_render-ego0_max0.0037484676531045744
sim_render-ego0_mean0.0037484676531045744
sim_render-ego0_median0.0037484676531045744
sim_render-ego0_min0.0037484676531045744
simulation-passed1
step_physics_max0.07388351065884328
step_physics_mean0.07388351065884328
step_physics_median0.07388351065884328
step_physics_min0.07388351065884328
survival_time_max30.250000000000295
survival_time_mean30.250000000000295
survival_time_median30.250000000000295
survival_time_min30.250000000000295
No reset possible
6648614133Pedro Fillastreexercises_braitenbergmooc-BV1490successyesgpu-production-spot-0-040:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.011851287887481871
agent_compute-ego0_mean0.011851287887481871
agent_compute-ego0_median0.011851287887481871
agent_compute-ego0_min0.011851287887481871
complete-iteration_max0.2043658259386074
complete-iteration_mean0.2043658259386074
complete-iteration_median0.2043658259386074
complete-iteration_min0.2043658259386074
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max0.6401503259524821
driven_any_mean0.6401503259524821
driven_any_median0.6401503259524821
driven_any_min0.6401503259524821
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.06107985330912881
get_duckie_state_mean0.06107985330912881
get_duckie_state_median0.06107985330912881
get_duckie_state_min0.06107985330912881
get_robot_state_max0.0036322028337124578
get_robot_state_mean0.0036322028337124578
get_robot_state_median0.0036322028337124578
get_robot_state_min0.0036322028337124578
get_state_dump_max0.014288077097453044
get_state_dump_mean0.014288077097453044
get_state_dump_median0.014288077097453044
get_state_dump_min0.014288077097453044
get_ui_image_max0.02657891747480381
get_ui_image_mean0.02657891747480381
get_ui_image_median0.02657891747480381
get_ui_image_min0.02657891747480381
in-drivable-lane_max8.299999999999983
in-drivable-lane_mean8.299999999999983
in-drivable-lane_median8.299999999999983
in-drivable-lane_min8.299999999999983
per-episodes
details{"d30-ego0": {"driven_any": 0.6401503259524821, "get_ui_image": 0.02657891747480381, "step_physics": 0.06871827348263677, "survival_time": 8.299999999999983, "driven_lanedir": 0.0, "get_state_dump": 0.014288077097453044, "get_robot_state": 0.0036322028337124578, "sim_render-ego0": 0.003685721380268028, "get_duckie_state": 0.06107985330912881, "in-drivable-lane": 8.299999999999983, "deviation-heading": 0.0, "agent_compute-ego0": 0.011851287887481871, "complete-iteration": 0.2043658259386074, "set_robot_commands": 0.002190063099661273, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0103462955908861, "sim_compute_performance-ego0": 0.0019092417048836895}}
set_robot_commands_max0.002190063099661273
set_robot_commands_mean0.002190063099661273
set_robot_commands_median0.002190063099661273
set_robot_commands_min0.002190063099661273
sim_compute_performance-ego0_max0.0019092417048836895
sim_compute_performance-ego0_mean0.0019092417048836895
sim_compute_performance-ego0_median0.0019092417048836895
sim_compute_performance-ego0_min0.0019092417048836895
sim_compute_sim_state_max0.0103462955908861
sim_compute_sim_state_mean0.0103462955908861
sim_compute_sim_state_median0.0103462955908861
sim_compute_sim_state_min0.0103462955908861
sim_render-ego0_max0.003685721380268028
sim_render-ego0_mean0.003685721380268028
sim_render-ego0_median0.003685721380268028
sim_render-ego0_min0.003685721380268028
simulation-passed1
step_physics_max0.06871827348263677
step_physics_mean0.06871827348263677
step_physics_median0.06871827348263677
step_physics_min0.06871827348263677
survival_time_max8.299999999999983
survival_time_mean8.299999999999983
survival_time_median8.299999999999983
survival_time_min8.299999999999983
No reset possible
6647714132Mark Goodallexercises_braitenbergmooc-BV1489successyesgpu-production-spot-0-040:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.011889219284057615
agent_compute-ego0_mean0.011889219284057615
agent_compute-ego0_median0.011889219284057615
agent_compute-ego0_min0.011889219284057615
complete-iteration_max0.2419594384500109
complete-iteration_mean0.2419594384500109
complete-iteration_median0.2419594384500109
complete-iteration_min0.2419594384500109
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max1.7975601428703305
driven_any_mean1.7975601428703305
driven_any_median1.7975601428703305
driven_any_min1.7975601428703305
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08303399653161675
get_duckie_state_mean0.08303399653161675
get_duckie_state_median0.08303399653161675
get_duckie_state_min0.08303399653161675
get_robot_state_max0.003832396431641431
get_robot_state_mean0.003832396431641431
get_robot_state_median0.003832396431641431
get_robot_state_min0.003832396431641431
get_state_dump_max0.018321291990742283
get_state_dump_mean0.018321291990742283
get_state_dump_median0.018321291990742283
get_state_dump_min0.018321291990742283
get_ui_image_max0.03116778235078383
get_ui_image_mean0.03116778235078383
get_ui_image_median0.03116778235078383
get_ui_image_min0.03116778235078383
in-drivable-lane_max22.650000000000187
in-drivable-lane_mean22.650000000000187
in-drivable-lane_median22.650000000000187
in-drivable-lane_min22.650000000000187
per-episodes
details{"d40-ego0": {"driven_any": 1.7975601428703305, "get_ui_image": 0.03116778235078383, "step_physics": 0.07303434058958214, "survival_time": 22.650000000000187, "driven_lanedir": 0.0, "get_state_dump": 0.018321291990742283, "get_robot_state": 0.003832396431641431, "sim_render-ego0": 0.003723945386609317, "get_duckie_state": 0.08303399653161675, "in-drivable-lane": 22.650000000000187, "deviation-heading": 0.0, "agent_compute-ego0": 0.011889219284057615, "complete-iteration": 0.2419594384500109, "set_robot_commands": 0.002266569809766593, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.012604036520231138, "sim_compute_performance-ego0": 0.0019908413487909125}}
set_robot_commands_max0.002266569809766593
set_robot_commands_mean0.002266569809766593
set_robot_commands_median0.002266569809766593
set_robot_commands_min0.002266569809766593
sim_compute_performance-ego0_max0.0019908413487909125
sim_compute_performance-ego0_mean0.0019908413487909125
sim_compute_performance-ego0_median0.0019908413487909125
sim_compute_performance-ego0_min0.0019908413487909125
sim_compute_sim_state_max0.012604036520231138
sim_compute_sim_state_mean0.012604036520231138
sim_compute_sim_state_median0.012604036520231138
sim_compute_sim_state_min0.012604036520231138
sim_render-ego0_max0.003723945386609317
sim_render-ego0_mean0.003723945386609317
sim_render-ego0_median0.003723945386609317
sim_render-ego0_min0.003723945386609317
simulation-passed1
step_physics_max0.07303434058958214
step_physics_mean0.07303434058958214
step_physics_median0.07303434058958214
step_physics_min0.07303434058958214
survival_time_max22.650000000000187
survival_time_mean22.650000000000187
survival_time_median22.650000000000187
survival_time_min22.650000000000187
No reset possible
6646514129Mark Goodallexercises_braitenbergmooc-BV1488successyesgpu-production-spot-0-040:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.012362341255304964
agent_compute-ego0_mean0.012362341255304964
agent_compute-ego0_median0.012362341255304964
agent_compute-ego0_min0.012362341255304964
complete-iteration_max0.31124072018027105
complete-iteration_mean0.31124072018027105
complete-iteration_median0.31124072018027105
complete-iteration_min0.31124072018027105
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max2.2682290538244247
driven_any_mean2.2682290538244247
driven_any_median2.2682290538244247
driven_any_min2.2682290538244247
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.12894248678087172
get_duckie_state_mean0.12894248678087172
get_duckie_state_median0.12894248678087172
get_duckie_state_min0.12894248678087172
get_robot_state_max0.004093785911443083
get_robot_state_mean0.004093785911443083
get_robot_state_median0.004093785911443083
get_robot_state_min0.004093785911443083
get_state_dump_max0.025637115286805966
get_state_dump_mean0.025637115286805966
get_state_dump_median0.025637115286805966
get_state_dump_min0.025637115286805966
get_ui_image_max0.03787708282470703
get_ui_image_mean0.03787708282470703
get_ui_image_median0.03787708282470703
get_ui_image_min0.03787708282470703
in-drivable-lane_max29.30000000000028
in-drivable-lane_mean29.30000000000028
in-drivable-lane_median29.30000000000028
in-drivable-lane_min29.30000000000028
per-episodes
details{"d60-ego0": {"driven_any": 2.2682290538244247, "get_ui_image": 0.03787708282470703, "step_physics": 0.08310610431625652, "survival_time": 29.30000000000028, "driven_lanedir": 0.0, "get_state_dump": 0.025637115286805966, "get_robot_state": 0.004093785911443083, "sim_render-ego0": 0.0039409526974419715, "get_duckie_state": 0.12894248678087172, "in-drivable-lane": 29.30000000000028, "deviation-heading": 0.0, "agent_compute-ego0": 0.012362341255304964, "complete-iteration": 0.31124072018027105, "set_robot_commands": 0.002335669437908842, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01070826504462013, "sim_compute_performance-ego0": 0.002123436286055453}}
set_robot_commands_max0.002335669437908842
set_robot_commands_mean0.002335669437908842
set_robot_commands_median0.002335669437908842
set_robot_commands_min0.002335669437908842
sim_compute_performance-ego0_max0.002123436286055453
sim_compute_performance-ego0_mean0.002123436286055453
sim_compute_performance-ego0_median0.002123436286055453
sim_compute_performance-ego0_min0.002123436286055453
sim_compute_sim_state_max0.01070826504462013
sim_compute_sim_state_mean0.01070826504462013
sim_compute_sim_state_median0.01070826504462013
sim_compute_sim_state_min0.01070826504462013
sim_render-ego0_max0.0039409526974419715
sim_render-ego0_mean0.0039409526974419715
sim_render-ego0_median0.0039409526974419715
sim_render-ego0_min0.0039409526974419715
simulation-passed1
step_physics_max0.08310610431625652
step_physics_mean0.08310610431625652
step_physics_median0.08310610431625652
step_physics_min0.08310610431625652
survival_time_max29.30000000000028
survival_time_mean29.30000000000028
survival_time_median29.30000000000028
survival_time_min29.30000000000028
No reset possible
6645614128Anil Kumar Chavaliexercises_braitenbergmooc-BV1490successyesgpu-production-spot-0-040:08:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.011753031519614682
agent_compute-ego0_mean0.011753031519614682
agent_compute-ego0_median0.011753031519614682
agent_compute-ego0_min0.011753031519614682
complete-iteration_max0.2165427967057286
complete-iteration_mean0.2165427967057286
complete-iteration_median0.2165427967057286
complete-iteration_min0.2165427967057286
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max3.4095966963219593
driven_any_mean3.4095966963219593
driven_any_median3.4095966963219593
driven_any_min3.4095966963219593
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.06417661710502276
get_duckie_state_mean0.06417661710502276
get_duckie_state_median0.06417661710502276
get_duckie_state_min0.06417661710502276
get_robot_state_max0.0039058223603263735
get_robot_state_mean0.0039058223603263735
get_robot_state_median0.0039058223603263735
get_robot_state_min0.0039058223603263735
get_state_dump_max0.014697513660462964
get_state_dump_mean0.014697513660462964
get_state_dump_median0.014697513660462964
get_state_dump_min0.014697513660462964
get_ui_image_max0.02745467496741942
get_ui_image_mean0.02745467496741942
get_ui_image_median0.02745467496741942
get_ui_image_min0.02745467496741942
in-drivable-lane_max53.4999999999991
in-drivable-lane_mean53.4999999999991
in-drivable-lane_median53.4999999999991
in-drivable-lane_min53.4999999999991
per-episodes
details{"d30-ego0": {"driven_any": 3.4095966963219593, "get_ui_image": 0.02745467496741942, "step_physics": 0.07420392909081154, "survival_time": 53.4999999999991, "driven_lanedir": 0.0, "get_state_dump": 0.014697513660462964, "get_robot_state": 0.0039058223603263735, "sim_render-ego0": 0.003746844362032736, "get_duckie_state": 0.06417661710502276, "in-drivable-lane": 53.4999999999991, "deviation-heading": 0.0, "agent_compute-ego0": 0.011753031519614682, "complete-iteration": 0.2165427967057286, "set_robot_commands": 0.0022911204009496864, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.012191655811698052, "sim_compute_performance-ego0": 0.00203613918813782}}
set_robot_commands_max0.0022911204009496864
set_robot_commands_mean0.0022911204009496864
set_robot_commands_median0.0022911204009496864
set_robot_commands_min0.0022911204009496864
sim_compute_performance-ego0_max0.00203613918813782
sim_compute_performance-ego0_mean0.00203613918813782
sim_compute_performance-ego0_median0.00203613918813782
sim_compute_performance-ego0_min0.00203613918813782
sim_compute_sim_state_max0.012191655811698052
sim_compute_sim_state_mean0.012191655811698052
sim_compute_sim_state_median0.012191655811698052
sim_compute_sim_state_min0.012191655811698052
sim_render-ego0_max0.003746844362032736
sim_render-ego0_mean0.003746844362032736
sim_render-ego0_median0.003746844362032736
sim_render-ego0_min0.003746844362032736
simulation-passed1
step_physics_max0.07420392909081154
step_physics_mean0.07420392909081154
step_physics_median0.07420392909081154
step_physics_min0.07420392909081154
survival_time_max53.4999999999991
survival_time_mean53.4999999999991
survival_time_median53.4999999999991
survival_time_min53.4999999999991
No reset possible
6644414127Anil Kumar Chavaliexercises_braitenbergmooc-BV1489failedyesgpu-production-spot-0-040:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 589, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/agent/solution/agent.py", line 111, in on_received_get_commands
              ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
              ||   File "<string>", line 5, in __init__
              ||   File "/usr/local/lib/python3.8/dist-packages/aido_schemas/schemas.py", line 68, in __post_init__
              ||     raise ValueError(msg)
              || ValueError: Expected values to be between -1 and 1. Obtained 10.0, 10.0
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 312, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 593, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6640714117Jacopo Taniexercises_braitenbergmooc-BV1488successyesgpu-production-spot-0-040:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.013355441310659149
agent_compute-ego0_mean0.013355441310659149
agent_compute-ego0_median0.013355441310659149
agent_compute-ego0_min0.013355441310659149
complete-iteration_max0.3102545210699714
complete-iteration_mean0.3102545210699714
complete-iteration_median0.3102545210699714
complete-iteration_min0.3102545210699714
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max1.3176000000000092
driven_any_mean1.3176000000000092
driven_any_median1.3176000000000092
driven_any_min1.3176000000000092
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1279397895175826
get_duckie_state_mean0.1279397895175826
get_duckie_state_median0.1279397895175826
get_duckie_state_min0.1279397895175826
get_robot_state_max0.003971605652583654
get_robot_state_mean0.003971605652583654
get_robot_state_median0.003971605652583654
get_robot_state_min0.003971605652583654
get_state_dump_max0.0257714006750806
get_state_dump_mean0.0257714006750806
get_state_dump_median0.0257714006750806
get_state_dump_min0.0257714006750806
get_ui_image_max0.037524018525560095
get_ui_image_mean0.037524018525560095
get_ui_image_median0.037524018525560095
get_ui_image_min0.037524018525560095
in-drivable-lane_max23.000000000000192
in-drivable-lane_mean23.000000000000192
in-drivable-lane_median23.000000000000192
in-drivable-lane_min23.000000000000192
per-episodes
details{"d60-ego0": {"driven_any": 1.3176000000000092, "get_ui_image": 0.037524018525560095, "step_physics": 0.08118978239709022, "survival_time": 23.000000000000192, "driven_lanedir": 0.0, "get_state_dump": 0.0257714006750806, "get_robot_state": 0.003971605652583654, "sim_render-ego0": 0.003941120139430247, "get_duckie_state": 0.1279397895175826, "in-drivable-lane": 23.000000000000192, "deviation-heading": 0.0, "agent_compute-ego0": 0.013355441310659149, "complete-iteration": 0.3102545210699714, "set_robot_commands": 0.00235835021592014, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.012010570720581584, "sim_compute_performance-ego0": 0.002090495475719394}}
set_robot_commands_max0.00235835021592014
set_robot_commands_mean0.00235835021592014
set_robot_commands_median0.00235835021592014
set_robot_commands_min0.00235835021592014
sim_compute_performance-ego0_max0.002090495475719394
sim_compute_performance-ego0_mean0.002090495475719394
sim_compute_performance-ego0_median0.002090495475719394
sim_compute_performance-ego0_min0.002090495475719394
sim_compute_sim_state_max0.012010570720581584
sim_compute_sim_state_mean0.012010570720581584
sim_compute_sim_state_median0.012010570720581584
sim_compute_sim_state_min0.012010570720581584
sim_render-ego0_max0.003941120139430247
sim_render-ego0_mean0.003941120139430247
sim_render-ego0_median0.003941120139430247
sim_render-ego0_min0.003941120139430247
simulation-passed1
step_physics_max0.08118978239709022
step_physics_mean0.08118978239709022
step_physics_median0.08118978239709022
step_physics_min0.08118978239709022
survival_time_max23.000000000000192
survival_time_mean23.000000000000192
survival_time_median23.000000000000192
survival_time_min23.000000000000192
No reset possible
6636713798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-0-040:00:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible