Duckietown Challenges Home Challenges Submissions

Evaluator 5288

ID5288
evaluatorgpu-production-spot-0-02
ownerI don't have one 😀
machinegpu-prod_ecf1031c5f93
processgpu-production-spot-0-02_ecf1031c5f93
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success17 78688
# timeout
# failed1 79276
# error
# aborted4 78645
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)249.0 GB
RAM free (MB)232.3 GB
Disk (MB)969.3 GB
Disk available (MB)808.1 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7958216074Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-020:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.43805466691779


other stats
agent_compute-ego0_max0.011293020422600176
agent_compute-ego0_mean0.011293020422600176
agent_compute-ego0_median0.011293020422600176
agent_compute-ego0_min0.011293020422600176
complete-iteration_max0.2281058302753048
complete-iteration_mean0.2281058302753048
complete-iteration_median0.2281058302753048
complete-iteration_min0.2281058302753048
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.43805466691779
distance-from-start_median5.43805466691779
distance-from-start_min5.43805466691779
driven_any_max5.519532356650648
driven_any_mean5.519532356650648
driven_any_median5.519532356650648
driven_any_min5.519532356650648
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09640338649488477
get_duckie_state_mean0.09640338649488477
get_duckie_state_median0.09640338649488477
get_duckie_state_min0.09640338649488477
get_robot_state_max0.003546200930800068
get_robot_state_mean0.003546200930800068
get_robot_state_median0.003546200930800068
get_robot_state_min0.003546200930800068
get_state_dump_max0.020069665560439296
get_state_dump_mean0.020069665560439296
get_state_dump_median0.020069665560439296
get_state_dump_min0.020069665560439296
get_ui_image_max0.014984640356612532
get_ui_image_mean0.014984640356612532
get_ui_image_median0.014984640356612532
get_ui_image_min0.014984640356612532
in-drivable-lane_max10.90000000000002
in-drivable-lane_mean10.90000000000002
in-drivable-lane_median10.90000000000002
in-drivable-lane_min10.90000000000002
per-episodes
details{"d50-ego0": {"driven_any": 5.519532356650648, "get_ui_image": 0.014984640356612532, "step_physics": 0.06634647225680416, "survival_time": 10.90000000000002, "driven_lanedir": 0.0, "get_state_dump": 0.020069665560439296, "get_robot_state": 0.003546200930800068, "sim_render-ego0": 0.003483132140277183, "get_duckie_state": 0.09640338649488477, "in-drivable-lane": 10.90000000000002, "deviation-heading": 0.0, "agent_compute-ego0": 0.011293020422600176, "complete-iteration": 0.2281058302753048, "set_robot_commands": 0.002157313638626168, "distance-from-start": 5.43805466691779, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007901805720917166, "sim_compute_performance-ego0": 0.0018406915882406712}}
set_robot_commands_max0.002157313638626168
set_robot_commands_mean0.002157313638626168
set_robot_commands_median0.002157313638626168
set_robot_commands_min0.002157313638626168
sim_compute_performance-ego0_max0.0018406915882406712
sim_compute_performance-ego0_mean0.0018406915882406712
sim_compute_performance-ego0_median0.0018406915882406712
sim_compute_performance-ego0_min0.0018406915882406712
sim_compute_sim_state_max0.007901805720917166
sim_compute_sim_state_mean0.007901805720917166
sim_compute_sim_state_median0.007901805720917166
sim_compute_sim_state_min0.007901805720917166
sim_render-ego0_max0.003483132140277183
sim_render-ego0_mean0.003483132140277183
sim_render-ego0_median0.003483132140277183
sim_render-ego0_min0.003483132140277183
simulation-passed1
step_physics_max0.06634647225680416
step_physics_mean0.06634647225680416
step_physics_median0.06634647225680416
step_physics_min0.06634647225680416
survival_time_max10.90000000000002
survival_time_mean10.90000000000002
survival_time_median10.90000000000002
survival_time_min10.90000000000002
No reset possible
7956316072Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-020:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.152271318084441


other stats
agent_compute-ego0_max0.011180884910352304
agent_compute-ego0_mean0.011180884910352304
agent_compute-ego0_median0.011180884910352304
agent_compute-ego0_min0.011180884910352304
complete-iteration_max0.18245805909623317
complete-iteration_mean0.18245805909623317
complete-iteration_median0.18245805909623317
complete-iteration_min0.18245805909623317
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.152271318084441
distance-from-start_median6.152271318084441
distance-from-start_min6.152271318084441
driven_any_max6.202399720318142
driven_any_mean6.202399720318142
driven_any_median6.202399720318142
driven_any_min6.202399720318142
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05851149249386478
get_duckie_state_mean0.05851149249386478
get_duckie_state_median0.05851149249386478
get_duckie_state_min0.05851149249386478
get_robot_state_max0.0035147109589019378
get_robot_state_mean0.0035147109589019378
get_robot_state_median0.0035147109589019378
get_robot_state_min0.0035147109589019378
get_state_dump_max0.013700631789830857
get_state_dump_mean0.013700631789830857
get_state_dump_median0.013700631789830857
get_state_dump_min0.013700631789830857
get_ui_image_max0.01351787517597149
get_ui_image_mean0.01351787517597149
get_ui_image_median0.01351787517597149
get_ui_image_min0.01351787517597149
in-drivable-lane_max11.500000000000028
in-drivable-lane_mean11.500000000000028
in-drivable-lane_median11.500000000000028
in-drivable-lane_min11.500000000000028
per-episodes
details{"d30-ego0": {"driven_any": 6.202399720318142, "get_ui_image": 0.01351787517597149, "step_physics": 0.06693212707321365, "survival_time": 11.500000000000028, "driven_lanedir": 0.0, "get_state_dump": 0.013700631789830857, "get_robot_state": 0.0035147109589019378, "sim_render-ego0": 0.003463701768354936, "get_duckie_state": 0.05851149249386478, "in-drivable-lane": 11.500000000000028, "deviation-heading": 0.0, "agent_compute-ego0": 0.011180884910352304, "complete-iteration": 0.18245805909623317, "set_robot_commands": 0.002168394270397368, "distance-from-start": 6.152271318084441, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0075500372684363165, "sim_compute_performance-ego0": 0.001840582141628513}}
set_robot_commands_max0.002168394270397368
set_robot_commands_mean0.002168394270397368
set_robot_commands_median0.002168394270397368
set_robot_commands_min0.002168394270397368
sim_compute_performance-ego0_max0.001840582141628513
sim_compute_performance-ego0_mean0.001840582141628513
sim_compute_performance-ego0_median0.001840582141628513
sim_compute_performance-ego0_min0.001840582141628513
sim_compute_sim_state_max0.0075500372684363165
sim_compute_sim_state_mean0.0075500372684363165
sim_compute_sim_state_median0.0075500372684363165
sim_compute_sim_state_min0.0075500372684363165
sim_render-ego0_max0.003463701768354936
sim_render-ego0_mean0.003463701768354936
sim_render-ego0_median0.003463701768354936
sim_render-ego0_min0.003463701768354936
simulation-passed1
step_physics_max0.06693212707321365
step_physics_mean0.06693212707321365
step_physics_median0.06693212707321365
step_physics_min0.06693212707321365
survival_time_max11.500000000000028
survival_time_mean11.500000000000028
survival_time_median11.500000000000028
survival_time_min11.500000000000028
No reset possible
7953916071Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-020:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.266339073454027


other stats
agent_compute-ego0_max0.01182042498921239
agent_compute-ego0_mean0.01182042498921239
agent_compute-ego0_median0.01182042498921239
agent_compute-ego0_min0.01182042498921239
complete-iteration_max0.2639383837234142
complete-iteration_mean0.2639383837234142
complete-iteration_median0.2639383837234142
complete-iteration_min0.2639383837234142
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.266339073454027
distance-from-start_median5.266339073454027
distance-from-start_min5.266339073454027
driven_any_max5.394387765776252
driven_any_mean5.394387765776252
driven_any_median5.394387765776252
driven_any_min5.394387765776252
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.12111468426016872
get_duckie_state_mean0.12111468426016872
get_duckie_state_median0.12111468426016872
get_duckie_state_min0.12111468426016872
get_robot_state_max0.003858755910119345
get_robot_state_mean0.003858755910119345
get_robot_state_median0.003858755910119345
get_robot_state_min0.003858755910119345
get_state_dump_max0.02410184505373933
get_state_dump_mean0.02410184505373933
get_state_dump_median0.02410184505373933
get_state_dump_min0.02410184505373933
get_ui_image_max0.016217646487923554
get_ui_image_mean0.016217646487923554
get_ui_image_median0.016217646487923554
get_ui_image_min0.016217646487923554
in-drivable-lane_max10.700000000000015
in-drivable-lane_mean10.700000000000015
in-drivable-lane_median10.700000000000015
in-drivable-lane_min10.700000000000015
per-episodes
details{"d60-ego0": {"driven_any": 5.394387765776252, "get_ui_image": 0.016217646487923554, "step_physics": 0.0698245691698651, "survival_time": 10.700000000000015, "driven_lanedir": 0.0, "get_state_dump": 0.02410184505373933, "get_robot_state": 0.003858755910119345, "sim_render-ego0": 0.003611543566681618, "get_duckie_state": 0.12111468426016872, "in-drivable-lane": 10.700000000000015, "deviation-heading": 0.0, "agent_compute-ego0": 0.01182042498921239, "complete-iteration": 0.2639383837234142, "set_robot_commands": 0.002276839766391488, "distance-from-start": 5.266339073454027, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00906760858934979, "sim_compute_performance-ego0": 0.001949416759402253}}
set_robot_commands_max0.002276839766391488
set_robot_commands_mean0.002276839766391488
set_robot_commands_median0.002276839766391488
set_robot_commands_min0.002276839766391488
sim_compute_performance-ego0_max0.001949416759402253
sim_compute_performance-ego0_mean0.001949416759402253
sim_compute_performance-ego0_median0.001949416759402253
sim_compute_performance-ego0_min0.001949416759402253
sim_compute_sim_state_max0.00906760858934979
sim_compute_sim_state_mean0.00906760858934979
sim_compute_sim_state_median0.00906760858934979
sim_compute_sim_state_min0.00906760858934979
sim_render-ego0_max0.003611543566681618
sim_render-ego0_mean0.003611543566681618
sim_render-ego0_median0.003611543566681618
sim_render-ego0_min0.003611543566681618
simulation-passed1
step_physics_max0.0698245691698651
step_physics_mean0.0698245691698651
step_physics_median0.0698245691698651
step_physics_min0.0698245691698651
survival_time_max10.700000000000015
survival_time_mean10.700000000000015
survival_time_median10.700000000000015
survival_time_min10.700000000000015
No reset possible
7953316067Huy Tran Tienexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-020:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.1711549984872225


other stats
agent_compute-ego0_max0.011144764815704733
agent_compute-ego0_mean0.011144764815704733
agent_compute-ego0_median0.011144764815704733
agent_compute-ego0_min0.011144764815704733
complete-iteration_max0.23139817352536357
complete-iteration_mean0.23139817352536357
complete-iteration_median0.23139817352536357
complete-iteration_min0.23139817352536357
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.1711549984872225
distance-from-start_median1.1711549984872225
distance-from-start_min1.1711549984872225
driven_any_max1.237883169015991
driven_any_mean1.237883169015991
driven_any_median1.237883169015991
driven_any_min1.237883169015991
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09724713579008852
get_duckie_state_mean0.09724713579008852
get_duckie_state_median0.09724713579008852
get_duckie_state_min0.09724713579008852
get_robot_state_max0.0035687707647492615
get_robot_state_mean0.0035687707647492615
get_robot_state_median0.0035687707647492615
get_robot_state_min0.0035687707647492615
get_state_dump_max0.019839601426184933
get_state_dump_mean0.019839601426184933
get_state_dump_median0.019839601426184933
get_state_dump_min0.019839601426184933
get_ui_image_max0.015088921106314357
get_ui_image_mean0.015088921106314357
get_ui_image_median0.015088921106314357
get_ui_image_min0.015088921106314357
in-drivable-lane_max15.750000000000089
in-drivable-lane_mean15.750000000000089
in-drivable-lane_median15.750000000000089
in-drivable-lane_min15.750000000000089
per-episodes
details{"d50-ego0": {"driven_any": 1.237883169015991, "get_ui_image": 0.015088921106314357, "step_physics": 0.06668154574647735, "survival_time": 15.750000000000089, "driven_lanedir": 0.0, "get_state_dump": 0.019839601426184933, "get_robot_state": 0.0035687707647492615, "sim_render-ego0": 0.0034839012954808487, "get_duckie_state": 0.09724713579008852, "in-drivable-lane": 15.750000000000089, "deviation-heading": 0.0, "agent_compute-ego0": 0.011144764815704733, "complete-iteration": 0.23139817352536357, "set_robot_commands": 0.002155804935889908, "distance-from-start": 1.1711549984872225, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010278474680985077, "sim_compute_performance-ego0": 0.001820886436896988}}
set_robot_commands_max0.002155804935889908
set_robot_commands_mean0.002155804935889908
set_robot_commands_median0.002155804935889908
set_robot_commands_min0.002155804935889908
sim_compute_performance-ego0_max0.001820886436896988
sim_compute_performance-ego0_mean0.001820886436896988
sim_compute_performance-ego0_median0.001820886436896988
sim_compute_performance-ego0_min0.001820886436896988
sim_compute_sim_state_max0.010278474680985077
sim_compute_sim_state_mean0.010278474680985077
sim_compute_sim_state_median0.010278474680985077
sim_compute_sim_state_min0.010278474680985077
sim_render-ego0_max0.0034839012954808487
sim_render-ego0_mean0.0034839012954808487
sim_render-ego0_median0.0034839012954808487
sim_render-ego0_min0.0034839012954808487
simulation-passed1
step_physics_max0.06668154574647735
step_physics_mean0.06668154574647735
step_physics_median0.06668154574647735
step_physics_min0.06668154574647735
survival_time_max15.750000000000089
survival_time_mean15.750000000000089
survival_time_median15.750000000000089
survival_time_min15.750000000000089
No reset possible
7951516060Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-020:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.160229187822932


other stats
agent_compute-ego0_max0.01141881691782098
agent_compute-ego0_mean0.01141881691782098
agent_compute-ego0_median0.01141881691782098
agent_compute-ego0_min0.01141881691782098
complete-iteration_max0.2087130170119436
complete-iteration_mean0.2087130170119436
complete-iteration_median0.2087130170119436
complete-iteration_min0.2087130170119436
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.160229187822932
distance-from-start_median2.160229187822932
distance-from-start_min2.160229187822932
driven_any_max2.160583140298909
driven_any_mean2.160583140298909
driven_any_median2.160583140298909
driven_any_min2.160583140298909
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07786368570829692
get_duckie_state_mean0.07786368570829692
get_duckie_state_median0.07786368570829692
get_duckie_state_min0.07786368570829692
get_robot_state_max0.003554554989463405
get_robot_state_mean0.003554554989463405
get_robot_state_median0.003554554989463405
get_robot_state_min0.003554554989463405
get_state_dump_max0.01685689374020225
get_state_dump_mean0.01685689374020225
get_state_dump_median0.01685689374020225
get_state_dump_min0.01685689374020225
get_ui_image_max0.014071597551044665
get_ui_image_mean0.014071597551044665
get_ui_image_median0.014071597551044665
get_ui_image_min0.014071597551044665
in-drivable-lane_max4.699999999999991
in-drivable-lane_mean4.699999999999991
in-drivable-lane_median4.699999999999991
in-drivable-lane_min4.699999999999991
per-episodes
details{"d40-ego0": {"driven_any": 2.160583140298909, "get_ui_image": 0.014071597551044665, "step_physics": 0.0685599778827868, "survival_time": 4.699999999999991, "driven_lanedir": 0.0, "get_state_dump": 0.01685689374020225, "get_robot_state": 0.003554554989463405, "sim_render-ego0": 0.0035324473130075554, "get_duckie_state": 0.07786368570829692, "in-drivable-lane": 4.699999999999991, "deviation-heading": 0.0, "agent_compute-ego0": 0.01141881691782098, "complete-iteration": 0.2087130170119436, "set_robot_commands": 0.00220881512290553, "distance-from-start": 2.160229187822932, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008731576016074733, "sim_compute_performance-ego0": 0.001828765869140625}}
set_robot_commands_max0.00220881512290553
set_robot_commands_mean0.00220881512290553
set_robot_commands_median0.00220881512290553
set_robot_commands_min0.00220881512290553
sim_compute_performance-ego0_max0.001828765869140625
sim_compute_performance-ego0_mean0.001828765869140625
sim_compute_performance-ego0_median0.001828765869140625
sim_compute_performance-ego0_min0.001828765869140625
sim_compute_sim_state_max0.008731576016074733
sim_compute_sim_state_mean0.008731576016074733
sim_compute_sim_state_median0.008731576016074733
sim_compute_sim_state_min0.008731576016074733
sim_render-ego0_max0.0035324473130075554
sim_render-ego0_mean0.0035324473130075554
sim_render-ego0_median0.0035324473130075554
sim_render-ego0_min0.0035324473130075554
simulation-passed1
step_physics_max0.0685599778827868
step_physics_mean0.0685599778827868
step_physics_median0.0685599778827868
step_physics_min0.0685599778827868
survival_time_max4.699999999999991
survival_time_mean4.699999999999991
survival_time_median4.699999999999991
survival_time_min4.699999999999991
No reset possible
7950616060Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1602037706281947


other stats
agent_compute-ego0_max0.011765954368992856
agent_compute-ego0_mean0.011765954368992856
agent_compute-ego0_median0.011765954368992856
agent_compute-ego0_min0.011765954368992856
complete-iteration_max0.20861224626239977
complete-iteration_mean0.20861224626239977
complete-iteration_median0.20861224626239977
complete-iteration_min0.20861224626239977
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1602037706281947
distance-from-start_median2.1602037706281947
distance-from-start_min2.1602037706281947
driven_any_max2.160560621617894
driven_any_mean2.160560621617894
driven_any_median2.160560621617894
driven_any_min2.160560621617894
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0786763166126452
get_duckie_state_mean0.0786763166126452
get_duckie_state_median0.0786763166126452
get_duckie_state_min0.0786763166126452
get_robot_state_max0.0036232044822291326
get_robot_state_mean0.0036232044822291326
get_robot_state_median0.0036232044822291326
get_robot_state_min0.0036232044822291326
get_state_dump_max0.01717842503597862
get_state_dump_mean0.01717842503597862
get_state_dump_median0.01717842503597862
get_state_dump_min0.01717842503597862
get_ui_image_max0.014555025100708009
get_ui_image_mean0.014555025100708009
get_ui_image_median0.014555025100708009
get_ui_image_min0.014555025100708009
in-drivable-lane_max4.699999999999991
in-drivable-lane_mean4.699999999999991
in-drivable-lane_median4.699999999999991
in-drivable-lane_min4.699999999999991
per-episodes
details{"d40-ego0": {"driven_any": 2.160560621617894, "get_ui_image": 0.014555025100708009, "step_physics": 0.0659569263458252, "survival_time": 4.699999999999991, "driven_lanedir": 0.0, "get_state_dump": 0.01717842503597862, "get_robot_state": 0.0036232044822291326, "sim_render-ego0": 0.003580951690673828, "get_duckie_state": 0.0786763166126452, "in-drivable-lane": 4.699999999999991, "deviation-heading": 0.0, "agent_compute-ego0": 0.011765954368992856, "complete-iteration": 0.20861224626239977, "set_robot_commands": 0.0023336410522460938, "distance-from-start": 2.1602037706281947, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008967655583431846, "sim_compute_performance-ego0": 0.0018800208443089535}}
set_robot_commands_max0.0023336410522460938
set_robot_commands_mean0.0023336410522460938
set_robot_commands_median0.0023336410522460938
set_robot_commands_min0.0023336410522460938
sim_compute_performance-ego0_max0.0018800208443089535
sim_compute_performance-ego0_mean0.0018800208443089535
sim_compute_performance-ego0_median0.0018800208443089535
sim_compute_performance-ego0_min0.0018800208443089535
sim_compute_sim_state_max0.008967655583431846
sim_compute_sim_state_mean0.008967655583431846
sim_compute_sim_state_median0.008967655583431846
sim_compute_sim_state_min0.008967655583431846
sim_render-ego0_max0.003580951690673828
sim_render-ego0_mean0.003580951690673828
sim_render-ego0_median0.003580951690673828
sim_render-ego0_min0.003580951690673828
simulation-passed1
step_physics_max0.0659569263458252
step_physics_mean0.0659569263458252
step_physics_median0.0659569263458252
step_physics_min0.0659569263458252
survival_time_max4.699999999999991
survival_time_mean4.699999999999991
survival_time_median4.699999999999991
survival_time_min4.699999999999991
No reset possible
7942916046Zoe Nolanexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-020:10:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.849395471089927


other stats
agent_compute-ego0_max0.01132054829180588
agent_compute-ego0_mean0.01132054829180588
agent_compute-ego0_median0.01132054829180588
agent_compute-ego0_min0.01132054829180588
complete-iteration_max0.2407647693881782
complete-iteration_mean0.2407647693881782
complete-iteration_median0.2407647693881782
complete-iteration_min0.2407647693881782
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.849395471089927
distance-from-start_median2.849395471089927
distance-from-start_min2.849395471089927
driven_any_max4.109796360682017
driven_any_mean4.109796360682017
driven_any_median4.109796360682017
driven_any_min4.109796360682017
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0995172529196759
get_duckie_state_mean0.0995172529196759
get_duckie_state_median0.0995172529196759
get_duckie_state_min0.0995172529196759
get_robot_state_max0.003741184341024102
get_robot_state_mean0.003741184341024102
get_robot_state_median0.003741184341024102
get_robot_state_min0.003741184341024102
get_state_dump_max0.02068353155868238
get_state_dump_mean0.02068353155868238
get_state_dump_median0.02068353155868238
get_state_dump_min0.02068353155868238
get_ui_image_max0.01528844210031527
get_ui_image_mean0.01528844210031527
get_ui_image_median0.01528844210031527
get_ui_image_min0.01528844210031527
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 4.109796360682017, "get_ui_image": 0.01528844210031527, "step_physics": 0.07268076395611282, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.02068353155868238, "get_robot_state": 0.003741184341024102, "sim_render-ego0": 0.0036119892634916663, "get_duckie_state": 0.0995172529196759, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.01132054829180588, "complete-iteration": 0.2407647693881782, "set_robot_commands": 0.002237505162387565, "distance-from-start": 2.849395471089927, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009701615070720994, "sim_compute_performance-ego0": 0.0018875426197925472}}
set_robot_commands_max0.002237505162387565
set_robot_commands_mean0.002237505162387565
set_robot_commands_median0.002237505162387565
set_robot_commands_min0.002237505162387565
sim_compute_performance-ego0_max0.0018875426197925472
sim_compute_performance-ego0_mean0.0018875426197925472
sim_compute_performance-ego0_median0.0018875426197925472
sim_compute_performance-ego0_min0.0018875426197925472
sim_compute_sim_state_max0.009701615070720994
sim_compute_sim_state_mean0.009701615070720994
sim_compute_sim_state_median0.009701615070720994
sim_compute_sim_state_min0.009701615070720994
sim_render-ego0_max0.0036119892634916663
sim_render-ego0_mean0.0036119892634916663
sim_render-ego0_median0.0036119892634916663
sim_render-ego0_min0.0036119892634916663
simulation-passed1
step_physics_max0.07268076395611282
step_physics_mean0.07268076395611282
step_physics_median0.07268076395611282
step_physics_min0.07268076395611282
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7942316045Zoe Nolanexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-020:10:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.107005323234506


other stats
agent_compute-ego0_max0.011387425705902558
agent_compute-ego0_mean0.011387425705902558
agent_compute-ego0_median0.011387425705902558
agent_compute-ego0_min0.011387425705902558
complete-iteration_max0.2255985346951879
complete-iteration_mean0.2255985346951879
complete-iteration_median0.2255985346951879
complete-iteration_min0.2255985346951879
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.107005323234506
distance-from-start_median3.107005323234506
distance-from-start_min3.107005323234506
driven_any_max3.168748421212761
driven_any_mean3.168748421212761
driven_any_median3.168748421212761
driven_any_min3.168748421212761
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0897206079242821
get_duckie_state_mean0.0897206079242821
get_duckie_state_median0.0897206079242821
get_duckie_state_min0.0897206079242821
get_robot_state_max0.0037147420689575654
get_robot_state_mean0.0037147420689575654
get_robot_state_median0.0037147420689575654
get_robot_state_min0.0037147420689575654
get_state_dump_max0.01885608421232467
get_state_dump_mean0.01885608421232467
get_state_dump_median0.01885608421232467
get_state_dump_min0.01885608421232467
get_ui_image_max0.015112207348185374
get_ui_image_mean0.015112207348185374
get_ui_image_median0.015112207348185374
get_ui_image_min0.015112207348185374
in-drivable-lane_max53.14999999999912
in-drivable-lane_mean53.14999999999912
in-drivable-lane_median53.14999999999912
in-drivable-lane_min53.14999999999912
per-episodes
details{"d45-ego0": {"driven_any": 3.168748421212761, "get_ui_image": 0.015112207348185374, "step_physics": 0.06926867164167247, "survival_time": 53.14999999999912, "driven_lanedir": 0.0, "get_state_dump": 0.01885608421232467, "get_robot_state": 0.0037147420689575654, "sim_render-ego0": 0.0035968700745948276, "get_duckie_state": 0.0897206079242821, "in-drivable-lane": 53.14999999999912, "deviation-heading": 0.0, "agent_compute-ego0": 0.011387425705902558, "complete-iteration": 0.2255985346951879, "set_robot_commands": 0.0022149186833460527, "distance-from-start": 3.107005323234506, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00970851613166637, "sim_compute_performance-ego0": 0.0019226983973854464}}
set_robot_commands_max0.0022149186833460527
set_robot_commands_mean0.0022149186833460527
set_robot_commands_median0.0022149186833460527
set_robot_commands_min0.0022149186833460527
sim_compute_performance-ego0_max0.0019226983973854464
sim_compute_performance-ego0_mean0.0019226983973854464
sim_compute_performance-ego0_median0.0019226983973854464
sim_compute_performance-ego0_min0.0019226983973854464
sim_compute_sim_state_max0.00970851613166637
sim_compute_sim_state_mean0.00970851613166637
sim_compute_sim_state_median0.00970851613166637
sim_compute_sim_state_min0.00970851613166637
sim_render-ego0_max0.0035968700745948276
sim_render-ego0_mean0.0035968700745948276
sim_render-ego0_median0.0035968700745948276
sim_render-ego0_min0.0035968700745948276
simulation-passed1
step_physics_max0.06926867164167247
step_physics_mean0.06926867164167247
step_physics_median0.06926867164167247
step_physics_min0.06926867164167247
survival_time_max53.14999999999912
survival_time_mean53.14999999999912
survival_time_median53.14999999999912
survival_time_min53.14999999999912
No reset possible
7940716042Zoe Nolanexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-020:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.9006758345214276


other stats
agent_compute-ego0_max0.011548667924719438
agent_compute-ego0_mean0.011548667924719438
agent_compute-ego0_median0.011548667924719438
agent_compute-ego0_min0.011548667924719438
complete-iteration_max0.22697412099739064
complete-iteration_mean0.22697412099739064
complete-iteration_median0.22697412099739064
complete-iteration_min0.22697412099739064
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.9006758345214276
distance-from-start_median2.9006758345214276
distance-from-start_min2.9006758345214276
driven_any_max2.9563964865885985
driven_any_mean2.9563964865885985
driven_any_median2.9563964865885985
driven_any_min2.9563964865885985
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08894661277045467
get_duckie_state_mean0.08894661277045467
get_duckie_state_median0.08894661277045467
get_duckie_state_min0.08894661277045467
get_robot_state_max0.003678636777631241
get_robot_state_mean0.003678636777631241
get_robot_state_median0.003678636777631241
get_robot_state_min0.003678636777631241
get_state_dump_max0.018718104128674622
get_state_dump_mean0.018718104128674622
get_state_dump_median0.018718104128674622
get_state_dump_min0.018718104128674622
get_ui_image_max0.014922467241669835
get_ui_image_mean0.014922467241669835
get_ui_image_median0.014922467241669835
get_ui_image_min0.014922467241669835
in-drivable-lane_max33.60000000000023
in-drivable-lane_mean33.60000000000023
in-drivable-lane_median33.60000000000023
in-drivable-lane_min33.60000000000023
per-episodes
details{"d45-ego0": {"driven_any": 2.9563964865885985, "get_ui_image": 0.014922467241669835, "step_physics": 0.0716227773040046, "survival_time": 33.60000000000023, "driven_lanedir": 0.0, "get_state_dump": 0.018718104128674622, "get_robot_state": 0.003678636777631241, "sim_render-ego0": 0.0035869607599493653, "get_duckie_state": 0.08894661277045467, "in-drivable-lane": 33.60000000000023, "deviation-heading": 0.0, "agent_compute-ego0": 0.011548667924719438, "complete-iteration": 0.22697412099739064, "set_robot_commands": 0.002225810315952613, "distance-from-start": 2.9006758345214276, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009724235109553118, "sim_compute_performance-ego0": 0.001905422154011379}}
set_robot_commands_max0.002225810315952613
set_robot_commands_mean0.002225810315952613
set_robot_commands_median0.002225810315952613
set_robot_commands_min0.002225810315952613
sim_compute_performance-ego0_max0.001905422154011379
sim_compute_performance-ego0_mean0.001905422154011379
sim_compute_performance-ego0_median0.001905422154011379
sim_compute_performance-ego0_min0.001905422154011379
sim_compute_sim_state_max0.009724235109553118
sim_compute_sim_state_mean0.009724235109553118
sim_compute_sim_state_median0.009724235109553118
sim_compute_sim_state_min0.009724235109553118
sim_render-ego0_max0.0035869607599493653
sim_render-ego0_mean0.0035869607599493653
sim_render-ego0_median0.0035869607599493653
sim_render-ego0_min0.0035869607599493653
simulation-passed1
step_physics_max0.0716227773040046
step_physics_mean0.0716227773040046
step_physics_median0.0716227773040046
step_physics_min0.0716227773040046
survival_time_max33.60000000000023
survival_time_mean33.60000000000023
survival_time_median33.60000000000023
survival_time_min33.60000000000023
No reset possible
7935516027Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-020:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.076696278047918


other stats
agent_compute-ego0_max0.011808506373701424
agent_compute-ego0_mean0.011808506373701424
agent_compute-ego0_median0.011808506373701424
agent_compute-ego0_min0.011808506373701424
complete-iteration_max0.264507951407597
complete-iteration_mean0.264507951407597
complete-iteration_median0.264507951407597
complete-iteration_min0.264507951407597
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.076696278047918
distance-from-start_median1.076696278047918
distance-from-start_min1.076696278047918
driven_any_max1.0766982919364438
driven_any_mean1.0766982919364438
driven_any_median1.0766982919364438
driven_any_min1.0766982919364438
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11963744821219607
get_duckie_state_mean0.11963744821219607
get_duckie_state_median0.11963744821219607
get_duckie_state_min0.11963744821219607
get_robot_state_max0.0038535183873669855
get_robot_state_mean0.0038535183873669855
get_robot_state_median0.0038535183873669855
get_robot_state_min0.0038535183873669855
get_state_dump_max0.024065732955932617
get_state_dump_mean0.024065732955932617
get_state_dump_median0.024065732955932617
get_state_dump_min0.024065732955932617
get_ui_image_max0.016075611114501953
get_ui_image_mean0.016075611114501953
get_ui_image_median0.016075611114501953
get_ui_image_min0.016075611114501953
in-drivable-lane_max2.849999999999998
in-drivable-lane_mean2.849999999999998
in-drivable-lane_median2.849999999999998
in-drivable-lane_min2.849999999999998
per-episodes
details{"d60-ego0": {"driven_any": 1.0766982919364438, "get_ui_image": 0.016075611114501953, "step_physics": 0.07204804749324403, "survival_time": 2.849999999999998, "driven_lanedir": 0.0, "get_state_dump": 0.024065732955932617, "get_robot_state": 0.0038535183873669855, "sim_render-ego0": 0.003626424690772747, "get_duckie_state": 0.11963744821219607, "in-drivable-lane": 2.849999999999998, "deviation-heading": 0.0, "agent_compute-ego0": 0.011808506373701424, "complete-iteration": 0.264507951407597, "set_robot_commands": 0.002240579703758503, "distance-from-start": 1.076696278047918, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009132348257919838, "sim_compute_performance-ego0": 0.001926524885769548}}
set_robot_commands_max0.002240579703758503
set_robot_commands_mean0.002240579703758503
set_robot_commands_median0.002240579703758503
set_robot_commands_min0.002240579703758503
sim_compute_performance-ego0_max0.001926524885769548
sim_compute_performance-ego0_mean0.001926524885769548
sim_compute_performance-ego0_median0.001926524885769548
sim_compute_performance-ego0_min0.001926524885769548
sim_compute_sim_state_max0.009132348257919838
sim_compute_sim_state_mean0.009132348257919838
sim_compute_sim_state_median0.009132348257919838
sim_compute_sim_state_min0.009132348257919838
sim_render-ego0_max0.003626424690772747
sim_render-ego0_mean0.003626424690772747
sim_render-ego0_median0.003626424690772747
sim_render-ego0_min0.003626424690772747
simulation-passed1
step_physics_max0.07204804749324403
step_physics_mean0.07204804749324403
step_physics_median0.07204804749324403
step_physics_min0.07204804749324403
survival_time_max2.849999999999998
survival_time_mean2.849999999999998
survival_time_median2.849999999999998
survival_time_min2.849999999999998
No reset possible
7927615987Ivan Danovobjdet exercisemooc-objdetsimfailednogpu-production-spot-0-020:05:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 12 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7924615969Rayed Wahedexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-020:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.6131281292102746


other stats
agent_compute-ego0_max0.011629505896232498
agent_compute-ego0_mean0.011629505896232498
agent_compute-ego0_median0.011629505896232498
agent_compute-ego0_min0.011629505896232498
complete-iteration_max0.2330713926906317
complete-iteration_mean0.2330713926906317
complete-iteration_median0.2330713926906317
complete-iteration_min0.2330713926906317
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.6131281292102746
distance-from-start_median1.6131281292102746
distance-from-start_min1.6131281292102746
driven_any_max1.87619498021765
driven_any_mean1.87619498021765
driven_any_median1.87619498021765
driven_any_min1.87619498021765
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09767089763157805
get_duckie_state_mean0.09767089763157805
get_duckie_state_median0.09767089763157805
get_duckie_state_min0.09767089763157805
get_robot_state_max0.0035884665771269463
get_robot_state_mean0.0035884665771269463
get_robot_state_median0.0035884665771269463
get_robot_state_min0.0035884665771269463
get_state_dump_max0.02011444199253136
get_state_dump_mean0.02011444199253136
get_state_dump_median0.02011444199253136
get_state_dump_min0.02011444199253136
get_ui_image_max0.01525578364520006
get_ui_image_mean0.01525578364520006
get_ui_image_median0.01525578364520006
get_ui_image_min0.01525578364520006
in-drivable-lane_max7.049999999999983
in-drivable-lane_mean7.049999999999983
in-drivable-lane_median7.049999999999983
in-drivable-lane_min7.049999999999983
per-episodes
details{"d50-ego0": {"driven_any": 1.87619498021765, "get_ui_image": 0.01525578364520006, "step_physics": 0.06775304465226724, "survival_time": 7.049999999999983, "driven_lanedir": 0.0, "get_state_dump": 0.02011444199253136, "get_robot_state": 0.0035884665771269463, "sim_render-ego0": 0.0034939990916722256, "get_duckie_state": 0.09767089763157805, "in-drivable-lane": 7.049999999999983, "deviation-heading": 0.0, "agent_compute-ego0": 0.011629505896232498, "complete-iteration": 0.2330713926906317, "set_robot_commands": 0.002239947587671414, "distance-from-start": 1.6131281292102746, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00938232683799636, "sim_compute_performance-ego0": 0.0018590873395892937}}
set_robot_commands_max0.002239947587671414
set_robot_commands_mean0.002239947587671414
set_robot_commands_median0.002239947587671414
set_robot_commands_min0.002239947587671414
sim_compute_performance-ego0_max0.0018590873395892937
sim_compute_performance-ego0_mean0.0018590873395892937
sim_compute_performance-ego0_median0.0018590873395892937
sim_compute_performance-ego0_min0.0018590873395892937
sim_compute_sim_state_max0.00938232683799636
sim_compute_sim_state_mean0.00938232683799636
sim_compute_sim_state_median0.00938232683799636
sim_compute_sim_state_min0.00938232683799636
sim_render-ego0_max0.0034939990916722256
sim_render-ego0_mean0.0034939990916722256
sim_render-ego0_median0.0034939990916722256
sim_render-ego0_min0.0034939990916722256
simulation-passed1
step_physics_max0.06775304465226724
step_physics_mean0.06775304465226724
step_physics_median0.06775304465226724
step_physics_min0.06775304465226724
survival_time_max7.049999999999983
survival_time_mean7.049999999999983
survival_time_median7.049999999999983
survival_time_min7.049999999999983
No reset possible
7923915962Manuel HerediaRun 1: nice graphmooc-modconsimsuccessnogpu-production-spot-0-020:12:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median23.900000000000055
deviation-center-line_median0.6294328436567379
driven_lanedir_consec_median0.3966003947571839
survival_time_median30.425000000000097


other stats
agent_compute-ego0_max0.016374571231573543
agent_compute-ego0_mean0.011381798854849166
agent_compute-ego0_median0.011381798854849166
agent_compute-ego0_min0.0063890264781247905
complete-iteration_max0.1894030127708972
complete-iteration_mean0.18402850841756896
complete-iteration_median0.18402850841756896
complete-iteration_min0.17865400406424067
deviation-center-line_max0.7109849358773996
deviation-center-line_mean0.6294328436567379
deviation-center-line_min0.5478807514360762
deviation-heading_max8.960937499728873
deviation-heading_mean7.240957448548626
deviation-heading_median7.240957448548626
deviation-heading_min5.520977397368379
distance-from-start_max2.957764435917696
distance-from-start_mean2.689645671419098
distance-from-start_median2.689645671419098
distance-from-start_min2.4215269069205005
driven_any_max5.10962079022256
driven_any_mean4.099864462230278
driven_any_median4.099864462230278
driven_any_min3.090108134237997
driven_lanedir_consec_max0.46594732018428053
driven_lanedir_consec_mean0.3966003947571839
driven_lanedir_consec_min0.32725346933008725
driven_lanedir_max0.46594732018428053
driven_lanedir_mean0.3966003947571839
driven_lanedir_median0.3966003947571839
driven_lanedir_min0.32725346933008725
get_duckie_state_max1.268837073330204e-06
get_duckie_state_mean1.2627607282016898e-06
get_duckie_state_median1.2627607282016898e-06
get_duckie_state_min1.256684383073176e-06
get_robot_state_max0.0034542938158747464
get_robot_state_mean0.003428322520378154
get_robot_state_median0.003428322520378154
get_robot_state_min0.003402351224881561
get_state_dump_max0.004390919509320303
get_state_dump_mean0.004384765985164265
get_state_dump_median0.004384765985164265
get_state_dump_min0.004378612461008228
get_ui_image_max0.04747088496903499
get_ui_image_mean0.04718762492480455
get_ui_image_median0.04718762492480455
get_ui_image_min0.04690436488057411
in-drivable-lane_max30.34999999999996
in-drivable-lane_mean23.900000000000055
in-drivable-lane_min17.450000000000152
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.090108134237997, "get_ui_image": 0.04690436488057411, "step_physics": 0.07850222986655174, "survival_time": 23.250000000000195, "driven_lanedir": 0.46594732018428053, "get_state_dump": 0.004378612461008228, "get_robot_state": 0.0034542938158747464, "sim_render-ego0": 0.003680944442749023, "get_duckie_state": 1.268837073330204e-06, "in-drivable-lane": 17.450000000000152, "deviation-heading": 5.520977397368379, "agent_compute-ego0": 0.0063890264781247905, "complete-iteration": 0.17865400406424067, "set_robot_commands": 0.0021631267449374876, "distance-from-start": 2.4215269069205005, "deviation-center-line": 0.5478807514360762, "driven_lanedir_consec": 0.46594732018428053, "sim_compute_sim_state": 0.031175587821927704, "sim_compute_performance-ego0": 0.001926350491241324}, "LF-full-loop-001-ego0": {"driven_any": 5.10962079022256, "get_ui_image": 0.04747088496903499, "step_physics": 0.07845258206168652, "survival_time": 37.6, "driven_lanedir": 0.32725346933008725, "get_state_dump": 0.004390919509320303, "get_robot_state": 0.003402351224881561, "sim_render-ego0": 0.003634149809757552, "get_duckie_state": 1.256684383073176e-06, "in-drivable-lane": 30.34999999999996, "deviation-heading": 8.960937499728873, "agent_compute-ego0": 0.016374571231573543, "complete-iteration": 0.1894030127708972, "set_robot_commands": 0.0020614772203908973, "distance-from-start": 2.957764435917696, "deviation-center-line": 0.7109849358773996, "driven_lanedir_consec": 0.32725346933008725, "sim_compute_sim_state": 0.03158418875766465, "sim_compute_performance-ego0": 0.0019521197158185292}}
set_robot_commands_max0.0021631267449374876
set_robot_commands_mean0.0021123019826641927
set_robot_commands_median0.0021123019826641927
set_robot_commands_min0.0020614772203908973
sim_compute_performance-ego0_max0.0019521197158185292
sim_compute_performance-ego0_mean0.0019392351035299267
sim_compute_performance-ego0_median0.0019392351035299267
sim_compute_performance-ego0_min0.001926350491241324
sim_compute_sim_state_max0.03158418875766465
sim_compute_sim_state_mean0.03137988828979618
sim_compute_sim_state_median0.03137988828979618
sim_compute_sim_state_min0.031175587821927704
sim_render-ego0_max0.003680944442749023
sim_render-ego0_mean0.003657547126253288
sim_render-ego0_median0.003657547126253288
sim_render-ego0_min0.003634149809757552
simulation-passed1
step_physics_max0.07850222986655174
step_physics_mean0.07847740596411913
step_physics_median0.07847740596411913
step_physics_min0.07845258206168652
survival_time_max37.6
survival_time_mean30.425000000000097
survival_time_min23.250000000000195
No reset possible
7896615876b mcgexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-020:12:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.658808852354501


other stats
agent_compute-ego0_max0.011411913427881754
agent_compute-ego0_mean0.011411913427881754
agent_compute-ego0_median0.011411913427881754
agent_compute-ego0_min0.011411913427881754
complete-iteration_max0.2679709677493741
complete-iteration_mean0.2679709677493741
complete-iteration_median0.2679709677493741
complete-iteration_min0.2679709677493741
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.658808852354501
distance-from-start_median3.658808852354501
distance-from-start_min3.658808852354501
driven_any_max3.8390313138139858
driven_any_mean3.8390313138139858
driven_any_median3.8390313138139858
driven_any_min3.8390313138139858
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.12102145279178413
get_duckie_state_mean0.12102145279178413
get_duckie_state_median0.12102145279178413
get_duckie_state_min0.12102145279178413
get_robot_state_max0.003863932389601581
get_robot_state_mean0.003863932389601581
get_robot_state_median0.003863932389601581
get_robot_state_min0.003863932389601581
get_state_dump_max0.023918312058460706
get_state_dump_mean0.023918312058460706
get_state_dump_median0.023918312058460706
get_state_dump_min0.023918312058460706
get_ui_image_max0.015928428040058985
get_ui_image_mean0.015928428040058985
get_ui_image_median0.015928428040058985
get_ui_image_min0.015928428040058985
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 3.8390313138139858, "get_ui_image": 0.015928428040058985, "step_physics": 0.07402439697100459, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.023918312058460706, "get_robot_state": 0.003863932389601581, "sim_render-ego0": 0.0036342126145946494, "get_duckie_state": 0.12102145279178413, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.011411913427881754, "complete-iteration": 0.2679709677493741, "set_robot_commands": 0.002232781457067231, "distance-from-start": 3.658808852354501, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009908110573329496, "sim_compute_performance-ego0": 0.0019357416850144817}}
set_robot_commands_max0.002232781457067231
set_robot_commands_mean0.002232781457067231
set_robot_commands_median0.002232781457067231
set_robot_commands_min0.002232781457067231
sim_compute_performance-ego0_max0.0019357416850144817
sim_compute_performance-ego0_mean0.0019357416850144817
sim_compute_performance-ego0_median0.0019357416850144817
sim_compute_performance-ego0_min0.0019357416850144817
sim_compute_sim_state_max0.009908110573329496
sim_compute_sim_state_mean0.009908110573329496
sim_compute_sim_state_median0.009908110573329496
sim_compute_sim_state_min0.009908110573329496
sim_render-ego0_max0.0036342126145946494
sim_render-ego0_mean0.0036342126145946494
sim_render-ego0_median0.0036342126145946494
sim_render-ego0_min0.0036342126145946494
simulation-passed1
step_physics_max0.07402439697100459
step_physics_mean0.07402439697100459
step_physics_median0.07402439697100459
step_physics_min0.07402439697100459
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7895315870Bea Baselines 🐤baseline-solutionmooc-collision-check-valistep1successnogpu-production-spot-0-020:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.005
false_positive_rate0.005


other stats
nsamples400
No reset possible
7894015872Bea Baselines 🐤dummy_collision_checkermooc-collision-check-valistep1successnogpu-production-spot-0-020:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.53
false_positive_rate0.49


other stats
nsamples400
No reset possible
7870715847Juan Ramirezexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-020:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.882848699475867


other stats
agent_compute-ego0_max0.010037584738297895
agent_compute-ego0_mean0.010037584738297895
agent_compute-ego0_median0.010037584738297895
agent_compute-ego0_min0.010037584738297895
complete-iteration_max0.2151169408451427
complete-iteration_mean0.2151169408451427
complete-iteration_median0.2151169408451427
complete-iteration_min0.2151169408451427
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.882848699475867
distance-from-start_median1.882848699475867
distance-from-start_min1.882848699475867
driven_any_max2.1075638892031447
driven_any_mean2.1075638892031447
driven_any_median2.1075638892031447
driven_any_min2.1075638892031447
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08530414537949996
get_duckie_state_mean0.08530414537949996
get_duckie_state_median0.08530414537949996
get_duckie_state_min0.08530414537949996
get_robot_state_max0.003498255122791637
get_robot_state_mean0.003498255122791637
get_robot_state_median0.003498255122791637
get_robot_state_min0.003498255122791637
get_state_dump_max0.017996712164445358
get_state_dump_mean0.017996712164445358
get_state_dump_median0.017996712164445358
get_state_dump_min0.017996712164445358
get_ui_image_max0.014529516480185767
get_ui_image_mean0.014529516480185767
get_ui_image_median0.014529516480185767
get_ui_image_min0.014529516480185767
in-drivable-lane_max5.449999999999989
in-drivable-lane_mean5.449999999999989
in-drivable-lane_median5.449999999999989
in-drivable-lane_min5.449999999999989
per-episodes
details{"d45-ego0": {"driven_any": 2.1075638892031447, "get_ui_image": 0.014529516480185767, "step_physics": 0.0664843125776811, "survival_time": 5.449999999999989, "driven_lanedir": 0.0, "get_state_dump": 0.017996712164445358, "get_robot_state": 0.003498255122791637, "sim_render-ego0": 0.0034119519320401277, "get_duckie_state": 0.08530414537949996, "in-drivable-lane": 5.449999999999989, "deviation-heading": 0.0, "agent_compute-ego0": 0.010037584738297895, "complete-iteration": 0.2151169408451427, "set_robot_commands": 0.0020548668774691497, "distance-from-start": 1.882848699475867, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009901408715681596, "sim_compute_performance-ego0": 0.0018227252093228428}}
set_robot_commands_max0.0020548668774691497
set_robot_commands_mean0.0020548668774691497
set_robot_commands_median0.0020548668774691497
set_robot_commands_min0.0020548668774691497
sim_compute_performance-ego0_max0.0018227252093228428
sim_compute_performance-ego0_mean0.0018227252093228428
sim_compute_performance-ego0_median0.0018227252093228428
sim_compute_performance-ego0_min0.0018227252093228428
sim_compute_sim_state_max0.009901408715681596
sim_compute_sim_state_mean0.009901408715681596
sim_compute_sim_state_median0.009901408715681596
sim_compute_sim_state_min0.009901408715681596
sim_render-ego0_max0.0034119519320401277
sim_render-ego0_mean0.0034119519320401277
sim_render-ego0_median0.0034119519320401277
sim_render-ego0_min0.0034119519320401277
simulation-passed1
step_physics_max0.0664843125776811
step_physics_mean0.0664843125776811
step_physics_median0.0664843125776811
step_physics_min0.0664843125776811
survival_time_max5.449999999999989
survival_time_mean5.449999999999989
survival_time_median5.449999999999989
survival_time_min5.449999999999989
No reset possible
7868815840SEYEONG JANGtemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-020:09:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median15.624999999999998
deviation-center-line_median1.3319110390231972
driven_lanedir_consec_median1.7957730900087625
survival_time_median28.500000000000043


other stats
agent_compute-ego0_max0.029516716157236406
agent_compute-ego0_mean0.023782356079023258
agent_compute-ego0_median0.023782356079023258
agent_compute-ego0_min0.018047996000810106
complete-iteration_max0.1989272961052515
complete-iteration_mean0.1953475373747828
complete-iteration_median0.1953475373747828
complete-iteration_min0.19176777864431405
deviation-center-line_max2.6638220780463944
deviation-center-line_mean1.3319110390231972
deviation-center-line_min0.0
deviation-heading_max1.5765407969373098
deviation-heading_mean0.7882703984686549
deviation-heading_median0.7882703984686549
deviation-heading_min0.0
distance-from-start_max5.213456113835739
distance-from-start_mean3.8177832415448423
distance-from-start_median3.8177832415448423
distance-from-start_min2.422110369253945
driven_any_max5.214535229531051
driven_any_mean3.8308873289746703
driven_any_median3.8308873289746703
driven_any_min2.447239428418291
driven_lanedir_consec_max3.591546180017525
driven_lanedir_consec_mean1.7957730900087625
driven_lanedir_consec_min0.0
driven_lanedir_max3.591546180017525
driven_lanedir_mean1.7957730900087625
driven_lanedir_median1.7957730900087625
driven_lanedir_min0.0
get_duckie_state_max1.1920928955078125e-06
get_duckie_state_mean1.1780045249245385e-06
get_duckie_state_median1.1780045249245385e-06
get_duckie_state_min1.1639161543412642e-06
get_robot_state_max0.0035337624611792625
get_robot_state_mean0.003476480238431993
get_robot_state_median0.003476480238431993
get_robot_state_min0.003419198015684722
get_state_dump_max0.004542520448759004
get_state_dump_mean0.004484210202787496
get_state_dump_median0.004484210202787496
get_state_dump_min0.004425899956815986
get_ui_image_max0.047020861080714633
get_ui_image_mean0.04691039531644771
get_ui_image_median0.04691039531644771
get_ui_image_min0.04679992955218079
in-drivable-lane_max18.55000000000013
in-drivable-lane_mean15.624999999999998
in-drivable-lane_min12.699999999999868
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 5.214535229531051, "get_ui_image": 0.047020861080714633, "step_physics": 0.08026081524886094, "survival_time": 38.44999999999995, "driven_lanedir": 3.591546180017525, "get_state_dump": 0.004542520448759004, "get_robot_state": 0.0035337624611792625, "sim_render-ego0": 0.0035975926882260804, "get_duckie_state": 1.1639161543412642e-06, "in-drivable-lane": 12.699999999999868, "deviation-heading": 1.5765407969373098, "agent_compute-ego0": 0.018047996000810106, "complete-iteration": 0.19176777864431405, "set_robot_commands": 0.0021764151461712727, "distance-from-start": 5.213456113835739, "deviation-center-line": 2.6638220780463944, "driven_lanedir_consec": 3.591546180017525, "sim_compute_sim_state": 0.030594230936719227, "sim_compute_performance-ego0": 0.001912861985045594}, "LF-full-loop-001-ego0": {"driven_any": 2.447239428418291, "get_ui_image": 0.04679992955218079, "step_physics": 0.0798634438104527, "survival_time": 18.55000000000013, "driven_lanedir": 0.0, "get_state_dump": 0.004425899956815986, "get_robot_state": 0.003419198015684722, "sim_render-ego0": 0.0036360506088502944, "get_duckie_state": 1.1920928955078125e-06, "in-drivable-lane": 18.55000000000013, "deviation-heading": 0.0, "agent_compute-ego0": 0.029516716157236406, "complete-iteration": 0.1989272961052515, "set_robot_commands": 0.0021141703410815166, "distance-from-start": 2.422110369253945, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02718889392832274, "sim_compute_performance-ego0": 0.0018826819235278711}}
set_robot_commands_max0.0021764151461712727
set_robot_commands_mean0.002145292743626395
set_robot_commands_median0.002145292743626395
set_robot_commands_min0.0021141703410815166
sim_compute_performance-ego0_max0.001912861985045594
sim_compute_performance-ego0_mean0.0018977719542867329
sim_compute_performance-ego0_median0.0018977719542867329
sim_compute_performance-ego0_min0.0018826819235278711
sim_compute_sim_state_max0.030594230936719227
sim_compute_sim_state_mean0.028891562432520983
sim_compute_sim_state_median0.028891562432520983
sim_compute_sim_state_min0.02718889392832274
sim_render-ego0_max0.0036360506088502944
sim_render-ego0_mean0.003616821648538188
sim_render-ego0_median0.003616821648538188
sim_render-ego0_min0.0035975926882260804
simulation-passed1
step_physics_max0.08026081524886094
step_physics_mean0.08006212952965683
step_physics_median0.08006212952965683
step_physics_min0.0798634438104527
survival_time_max38.44999999999995
survival_time_mean28.500000000000043
survival_time_min18.55000000000013
No reset possible
7866415800Andrea Daniele 🇮🇹baseline-duckietownaido-LFru-real-validationeval0-visualizeabortedyesgpu-production-spot-0-020:03:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7864913798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-0-020:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7864813798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-0-020:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7864513798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-0-020:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible