Duckietown Challenges Home Challenges Submissions

Evaluator 5286

ID5286
evaluatorgpu-production-spot-0-03
ownerI don't have one 😀
machinegpu-prod_cc3c98fa58cd
processgpu-production-spot-0-03_cc3c98fa58cd
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success13 78694
# timeout
# failed1 79285
# error1 78867
# aborted2 78647
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)249.0 GB
RAM free (MB)232.0 GB
Disk (MB)969.3 GB
Disk available (MB)808.1 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7955916073Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-030:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.0890305545314898


other stats
agent_compute-ego0_max0.011771701997326266
agent_compute-ego0_mean0.011771701997326266
agent_compute-ego0_median0.011771701997326266
agent_compute-ego0_min0.011771701997326266
complete-iteration_max0.2694540600622854
complete-iteration_mean0.2694540600622854
complete-iteration_median0.2694540600622854
complete-iteration_min0.2694540600622854
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.0890305545314898
distance-from-start_median1.0890305545314898
distance-from-start_min1.0890305545314898
driven_any_max1.08905202303078
driven_any_mean1.08905202303078
driven_any_median1.08905202303078
driven_any_min1.08905202303078
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11876784601519184
get_duckie_state_mean0.11876784601519184
get_duckie_state_median0.11876784601519184
get_duckie_state_min0.11876784601519184
get_robot_state_max0.0038437228049001382
get_robot_state_mean0.0038437228049001382
get_robot_state_median0.0038437228049001382
get_robot_state_min0.0038437228049001382
get_state_dump_max0.024296787477308703
get_state_dump_mean0.024296787477308703
get_state_dump_median0.024296787477308703
get_state_dump_min0.024296787477308703
get_ui_image_max0.016353711005180113
get_ui_image_mean0.016353711005180113
get_ui_image_median0.016353711005180113
get_ui_image_min0.016353711005180113
in-drivable-lane_max3.049999999999997
in-drivable-lane_mean3.049999999999997
in-drivable-lane_median3.049999999999997
in-drivable-lane_min3.049999999999997
per-episodes
details{"d60-ego0": {"driven_any": 1.08905202303078, "get_ui_image": 0.016353711005180113, "step_physics": 0.07708904435557704, "survival_time": 3.049999999999997, "driven_lanedir": 0.0, "get_state_dump": 0.024296787477308703, "get_robot_state": 0.0038437228049001382, "sim_render-ego0": 0.003662670812299175, "get_duckie_state": 0.11876784601519184, "in-drivable-lane": 3.049999999999997, "deviation-heading": 0.0, "agent_compute-ego0": 0.011771701997326266, "complete-iteration": 0.2694540600622854, "set_robot_commands": 0.002277358885734312, "distance-from-start": 1.0890305545314898, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00936938101245511, "sim_compute_performance-ego0": 0.0019240994607248611}}
set_robot_commands_max0.002277358885734312
set_robot_commands_mean0.002277358885734312
set_robot_commands_median0.002277358885734312
set_robot_commands_min0.002277358885734312
sim_compute_performance-ego0_max0.0019240994607248611
sim_compute_performance-ego0_mean0.0019240994607248611
sim_compute_performance-ego0_median0.0019240994607248611
sim_compute_performance-ego0_min0.0019240994607248611
sim_compute_sim_state_max0.00936938101245511
sim_compute_sim_state_mean0.00936938101245511
sim_compute_sim_state_median0.00936938101245511
sim_compute_sim_state_min0.00936938101245511
sim_render-ego0_max0.003662670812299175
sim_render-ego0_mean0.003662670812299175
sim_render-ego0_median0.003662670812299175
sim_render-ego0_min0.003662670812299175
simulation-passed1
step_physics_max0.07708904435557704
step_physics_mean0.07708904435557704
step_physics_median0.07708904435557704
step_physics_min0.07708904435557704
survival_time_max3.049999999999997
survival_time_mean3.049999999999997
survival_time_median3.049999999999997
survival_time_min3.049999999999997
No reset possible
7954116071Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-030:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.26943484238784


other stats
agent_compute-ego0_max0.011698044562826353
agent_compute-ego0_mean0.011698044562826353
agent_compute-ego0_median0.011698044562826353
agent_compute-ego0_min0.011698044562826353
complete-iteration_max0.20971616238963847
complete-iteration_mean0.20971616238963847
complete-iteration_median0.20971616238963847
complete-iteration_min0.20971616238963847
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.26943484238784
distance-from-start_median6.26943484238784
distance-from-start_min6.26943484238784
driven_any_max6.282916194939762
driven_any_mean6.282916194939762
driven_any_median6.282916194939762
driven_any_min6.282916194939762
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07847432311700316
get_duckie_state_mean0.07847432311700316
get_duckie_state_median0.07847432311700316
get_duckie_state_min0.07847432311700316
get_robot_state_max0.0036552594632518537
get_robot_state_mean0.0036552594632518537
get_robot_state_median0.0036552594632518537
get_robot_state_min0.0036552594632518537
get_state_dump_max0.017190239380817023
get_state_dump_mean0.017190239380817023
get_state_dump_median0.017190239380817023
get_state_dump_min0.017190239380817023
get_ui_image_max0.014653862739095882
get_ui_image_mean0.014653862739095882
get_ui_image_median0.014653862739095882
get_ui_image_min0.014653862739095882
in-drivable-lane_max12.200000000000038
in-drivable-lane_mean12.200000000000038
in-drivable-lane_median12.200000000000038
in-drivable-lane_min12.200000000000038
per-episodes
details{"d40-ego0": {"driven_any": 6.282916194939762, "get_ui_image": 0.014653862739095882, "step_physics": 0.06839858366518604, "survival_time": 12.200000000000038, "driven_lanedir": 0.0, "get_state_dump": 0.017190239380817023, "get_robot_state": 0.0036552594632518537, "sim_render-ego0": 0.0035354954855782647, "get_duckie_state": 0.07847432311700316, "in-drivable-lane": 12.200000000000038, "deviation-heading": 0.0, "agent_compute-ego0": 0.011698044562826353, "complete-iteration": 0.20971616238963847, "set_robot_commands": 0.0022440277800268057, "distance-from-start": 6.26943484238784, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007936080621213329, "sim_compute_performance-ego0": 0.0018434271520497848}}
set_robot_commands_max0.0022440277800268057
set_robot_commands_mean0.0022440277800268057
set_robot_commands_median0.0022440277800268057
set_robot_commands_min0.0022440277800268057
sim_compute_performance-ego0_max0.0018434271520497848
sim_compute_performance-ego0_mean0.0018434271520497848
sim_compute_performance-ego0_median0.0018434271520497848
sim_compute_performance-ego0_min0.0018434271520497848
sim_compute_sim_state_max0.007936080621213329
sim_compute_sim_state_mean0.007936080621213329
sim_compute_sim_state_median0.007936080621213329
sim_compute_sim_state_min0.007936080621213329
sim_render-ego0_max0.0035354954855782647
sim_render-ego0_mean0.0035354954855782647
sim_render-ego0_median0.0035354954855782647
sim_render-ego0_min0.0035354954855782647
simulation-passed1
step_physics_max0.06839858366518604
step_physics_mean0.06839858366518604
step_physics_median0.06839858366518604
step_physics_min0.06839858366518604
survival_time_max12.200000000000038
survival_time_mean12.200000000000038
survival_time_median12.200000000000038
survival_time_min12.200000000000038
No reset possible
7953616067Huy Tran Tienexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-030:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.679309025500533


other stats
agent_compute-ego0_max0.011203352202717056
agent_compute-ego0_mean0.011203352202717056
agent_compute-ego0_median0.011203352202717056
agent_compute-ego0_min0.011203352202717056
complete-iteration_max0.2203841688286545
complete-iteration_mean0.2203841688286545
complete-iteration_median0.2203841688286545
complete-iteration_min0.2203841688286545
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.679309025500533
distance-from-start_median1.679309025500533
distance-from-start_min1.679309025500533
driven_any_max1.8504249076533892
driven_any_mean1.8504249076533892
driven_any_median1.8504249076533892
driven_any_min1.8504249076533892
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08783634503682454
get_duckie_state_mean0.08783634503682454
get_duckie_state_median0.08783634503682454
get_duckie_state_min0.08783634503682454
get_robot_state_max0.003586313153943445
get_robot_state_mean0.003586313153943445
get_robot_state_median0.003586313153943445
get_robot_state_min0.003586313153943445
get_state_dump_max0.018405146578438263
get_state_dump_mean0.018405146578438263
get_state_dump_median0.018405146578438263
get_state_dump_min0.018405146578438263
get_ui_image_max0.014529860936678372
get_ui_image_mean0.014529860936678372
get_ui_image_median0.014529860936678372
get_ui_image_min0.014529860936678372
in-drivable-lane_max23.350000000000197
in-drivable-lane_mean23.350000000000197
in-drivable-lane_median23.350000000000197
in-drivable-lane_min23.350000000000197
per-episodes
details{"d45-ego0": {"driven_any": 1.8504249076533892, "get_ui_image": 0.014529860936678372, "step_physics": 0.06739870910970573, "survival_time": 23.350000000000197, "driven_lanedir": 0.0, "get_state_dump": 0.018405146578438263, "get_robot_state": 0.003586313153943445, "sim_render-ego0": 0.003530395336640186, "get_duckie_state": 0.08783634503682454, "in-drivable-lane": 23.350000000000197, "deviation-heading": 0.0, "agent_compute-ego0": 0.011203352202717056, "complete-iteration": 0.2203841688286545, "set_robot_commands": 0.0021624875883770804, "distance-from-start": 1.679309025500533, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009772152982206428, "sim_compute_performance-ego0": 0.0018711614812541213}}
set_robot_commands_max0.0021624875883770804
set_robot_commands_mean0.0021624875883770804
set_robot_commands_median0.0021624875883770804
set_robot_commands_min0.0021624875883770804
sim_compute_performance-ego0_max0.0018711614812541213
sim_compute_performance-ego0_mean0.0018711614812541213
sim_compute_performance-ego0_median0.0018711614812541213
sim_compute_performance-ego0_min0.0018711614812541213
sim_compute_sim_state_max0.009772152982206428
sim_compute_sim_state_mean0.009772152982206428
sim_compute_sim_state_median0.009772152982206428
sim_compute_sim_state_min0.009772152982206428
sim_render-ego0_max0.003530395336640186
sim_render-ego0_mean0.003530395336640186
sim_render-ego0_median0.003530395336640186
sim_render-ego0_min0.003530395336640186
simulation-passed1
step_physics_max0.06739870910970573
step_physics_mean0.06739870910970573
step_physics_median0.06739870910970573
step_physics_min0.06739870910970573
survival_time_max23.350000000000197
survival_time_mean23.350000000000197
survival_time_median23.350000000000197
survival_time_min23.350000000000197
No reset possible
7948416057Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-030:03:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.1026254904905852


other stats
agent_compute-ego0_max0.011715290910106594
agent_compute-ego0_mean0.011715290910106594
agent_compute-ego0_median0.011715290910106594
agent_compute-ego0_min0.011715290910106594
complete-iteration_max0.26457356598417636
complete-iteration_mean0.26457356598417636
complete-iteration_median0.26457356598417636
complete-iteration_min0.26457356598417636
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.1026254904905852
distance-from-start_median1.1026254904905852
distance-from-start_min1.1026254904905852
driven_any_max1.1026394224335991
driven_any_mean1.1026394224335991
driven_any_median1.1026394224335991
driven_any_min1.1026394224335991
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11785096233173951
get_duckie_state_mean0.11785096233173951
get_duckie_state_median0.11785096233173951
get_duckie_state_min0.11785096233173951
get_robot_state_max0.0038561699754100735
get_robot_state_mean0.0038561699754100735
get_robot_state_median0.0038561699754100735
get_robot_state_min0.0038561699754100735
get_state_dump_max0.02357200040655621
get_state_dump_mean0.02357200040655621
get_state_dump_median0.02357200040655621
get_state_dump_min0.02357200040655621
get_ui_image_max0.015915571633031814
get_ui_image_mean0.015915571633031814
get_ui_image_median0.015915571633031814
get_ui_image_min0.015915571633031814
in-drivable-lane_max2.8999999999999977
in-drivable-lane_mean2.8999999999999977
in-drivable-lane_median2.8999999999999977
in-drivable-lane_min2.8999999999999977
per-episodes
details{"d60-ego0": {"driven_any": 1.1026394224335991, "get_ui_image": 0.015915571633031814, "step_physics": 0.07458485587168548, "survival_time": 2.8999999999999977, "driven_lanedir": 0.0, "get_state_dump": 0.02357200040655621, "get_robot_state": 0.0038561699754100735, "sim_render-ego0": 0.003608295473001771, "get_duckie_state": 0.11785096233173951, "in-drivable-lane": 2.8999999999999977, "deviation-heading": 0.0, "agent_compute-ego0": 0.011715290910106594, "complete-iteration": 0.26457356598417636, "set_robot_commands": 0.0022263082407288633, "distance-from-start": 1.1026254904905852, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00924605434223757, "sim_compute_performance-ego0": 0.0018993030160160387}}
set_robot_commands_max0.0022263082407288633
set_robot_commands_mean0.0022263082407288633
set_robot_commands_median0.0022263082407288633
set_robot_commands_min0.0022263082407288633
sim_compute_performance-ego0_max0.0018993030160160387
sim_compute_performance-ego0_mean0.0018993030160160387
sim_compute_performance-ego0_median0.0018993030160160387
sim_compute_performance-ego0_min0.0018993030160160387
sim_compute_sim_state_max0.00924605434223757
sim_compute_sim_state_mean0.00924605434223757
sim_compute_sim_state_median0.00924605434223757
sim_compute_sim_state_min0.00924605434223757
sim_render-ego0_max0.003608295473001771
sim_render-ego0_mean0.003608295473001771
sim_render-ego0_median0.003608295473001771
sim_render-ego0_min0.003608295473001771
simulation-passed1
step_physics_max0.07458485587168548
step_physics_mean0.07458485587168548
step_physics_median0.07458485587168548
step_physics_min0.07458485587168548
survival_time_max2.8999999999999977
survival_time_mean2.8999999999999977
survival_time_median2.8999999999999977
survival_time_min2.8999999999999977
No reset possible
7942716045Zoe Nolanexercises_braitenbergmooc-BV1sim-3of5successnogpu-production-spot-0-030:10:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.579600000000537


other stats
agent_compute-ego0_max0.01129938382888019
agent_compute-ego0_mean0.01129938382888019
agent_compute-ego0_median0.01129938382888019
agent_compute-ego0_min0.01129938382888019
complete-iteration_max0.1892124653656616
complete-iteration_mean0.1892124653656616
complete-iteration_median0.1892124653656616
complete-iteration_min0.1892124653656616
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.579600000000537
distance-from-start_median3.579600000000537
distance-from-start_min3.579600000000537
driven_any_max3.5796000000006214
driven_any_mean3.5796000000006214
driven_any_median3.5796000000006214
driven_any_min3.5796000000006214
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.06061958154968973
get_duckie_state_mean0.06061958154968973
get_duckie_state_median0.06061958154968973
get_duckie_state_min0.06061958154968973
get_robot_state_max0.003723065521595976
get_robot_state_mean0.003723065521595976
get_robot_state_median0.003723065521595976
get_robot_state_min0.003723065521595976
get_state_dump_max0.014298542651606044
get_state_dump_mean0.014298542651606044
get_state_dump_median0.014298542651606044
get_state_dump_min0.014298542651606044
get_ui_image_max0.01387651496683926
get_ui_image_mean0.01387651496683926
get_ui_image_median0.01387651496683926
get_ui_image_min0.01387651496683926
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 3.5796000000006214, "get_ui_image": 0.01387651496683926, "step_physics": 0.06829357266326828, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.014298542651606044, "get_robot_state": 0.003723065521595976, "sim_render-ego0": 0.003612573498194661, "get_duckie_state": 0.06061958154968973, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.01129938382888019, "complete-iteration": 0.1892124653656616, "set_robot_commands": 0.002267631067026664, "distance-from-start": 3.579600000000537, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00923008525699104, "sim_compute_performance-ego0": 0.001902009525664343}}
set_robot_commands_max0.002267631067026664
set_robot_commands_mean0.002267631067026664
set_robot_commands_median0.002267631067026664
set_robot_commands_min0.002267631067026664
sim_compute_performance-ego0_max0.001902009525664343
sim_compute_performance-ego0_mean0.001902009525664343
sim_compute_performance-ego0_median0.001902009525664343
sim_compute_performance-ego0_min0.001902009525664343
sim_compute_sim_state_max0.00923008525699104
sim_compute_sim_state_mean0.00923008525699104
sim_compute_sim_state_median0.00923008525699104
sim_compute_sim_state_min0.00923008525699104
sim_render-ego0_max0.003612573498194661
sim_render-ego0_mean0.003612573498194661
sim_render-ego0_median0.003612573498194661
sim_render-ego0_min0.003612573498194661
simulation-passed1
step_physics_max0.06829357266326828
step_physics_mean0.06829357266326828
step_physics_median0.06829357266326828
step_physics_min0.06829357266326828
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7938316038Jerry Kuchexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-030:10:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.9416156018416246


other stats
agent_compute-ego0_max0.011221488846231758
agent_compute-ego0_mean0.011221488846231758
agent_compute-ego0_median0.011221488846231758
agent_compute-ego0_min0.011221488846231758
complete-iteration_max0.2348348020415421
complete-iteration_mean0.2348348020415421
complete-iteration_median0.2348348020415421
complete-iteration_min0.2348348020415421
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.9416156018416246
distance-from-start_median3.9416156018416246
distance-from-start_min3.9416156018416246
driven_any_max4.18155090257171
driven_any_mean4.18155090257171
driven_any_median4.18155090257171
driven_any_min4.18155090257171
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09828637025437684
get_duckie_state_mean0.09828637025437684
get_duckie_state_median0.09828637025437684
get_duckie_state_min0.09828637025437684
get_robot_state_max0.003622559484693033
get_robot_state_mean0.003622559484693033
get_robot_state_median0.003622559484693033
get_robot_state_min0.003622559484693033
get_state_dump_max0.020110702633758467
get_state_dump_mean0.020110702633758467
get_state_dump_median0.020110702633758467
get_state_dump_min0.020110702633758467
get_ui_image_max0.015067380234958926
get_ui_image_mean0.015067380234958926
get_ui_image_median0.015067380234958926
get_ui_image_min0.015067380234958926
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 4.18155090257171, "get_ui_image": 0.015067380234958926, "step_physics": 0.06821923073285029, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.020110702633758467, "get_robot_state": 0.003622559484693033, "sim_render-ego0": 0.003528123294979607, "get_duckie_state": 0.09828637025437684, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.011221488846231758, "complete-iteration": 0.2348348020415421, "set_robot_commands": 0.0021683453123932774, "distance-from-start": 3.9416156018416246, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010655810294996989, "sim_compute_performance-ego0": 0.0018639624069175752}}
set_robot_commands_max0.0021683453123932774
set_robot_commands_mean0.0021683453123932774
set_robot_commands_median0.0021683453123932774
set_robot_commands_min0.0021683453123932774
sim_compute_performance-ego0_max0.0018639624069175752
sim_compute_performance-ego0_mean0.0018639624069175752
sim_compute_performance-ego0_median0.0018639624069175752
sim_compute_performance-ego0_min0.0018639624069175752
sim_compute_sim_state_max0.010655810294996989
sim_compute_sim_state_mean0.010655810294996989
sim_compute_sim_state_median0.010655810294996989
sim_compute_sim_state_min0.010655810294996989
sim_render-ego0_max0.003528123294979607
sim_render-ego0_mean0.003528123294979607
sim_render-ego0_median0.003528123294979607
sim_render-ego0_min0.003528123294979607
simulation-passed1
step_physics_max0.06821923073285029
step_physics_mean0.06821923073285029
step_physics_median0.06821923073285029
step_physics_min0.06821923073285029
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7934516026Ethan Frankcollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-030:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.09
false_positive_rate0.01


other stats
nsamples200
No reset possible
7928515995N ? RO botobjdet exercisemooc-objdetsimfailednogpu-production-spot-0-030:06:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 162 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7927115982Richard Belangertemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-030:11:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median20.95000000000006
deviation-center-line_median0.8298263631904162
driven_lanedir_consec_median1.1217706965576872
survival_time_median29.600000000000016


other stats
agent_compute-ego0_max0.016338011439965695
agent_compute-ego0_mean0.011144311342093286
agent_compute-ego0_median0.011144311342093286
agent_compute-ego0_min0.005950611244220878
complete-iteration_max0.18949031343265457
complete-iteration_mean0.18009605182447097
complete-iteration_median0.18009605182447097
complete-iteration_min0.17070179021628737
deviation-center-line_max1.3656091321882378
deviation-center-line_mean0.8298263631904162
deviation-center-line_min0.2940435941925948
deviation-heading_max4.827905540560873
deviation-heading_mean3.2414500954080636
deviation-heading_median3.2414500954080636
deviation-heading_min1.6549946502552542
distance-from-start_max5.21188736737725
distance-from-start_mean3.847867887442396
distance-from-start_median3.847867887442396
distance-from-start_min2.483848407507541
driven_any_max5.3822478383075945
driven_any_mean3.9846235667143626
driven_any_median3.9846235667143626
driven_any_min2.586999295121131
driven_lanedir_consec_max1.870669761159789
driven_lanedir_consec_mean1.1217706965576872
driven_lanedir_consec_min0.3728716319555861
driven_lanedir_max1.870669761159789
driven_lanedir_mean1.1217706965576872
driven_lanedir_median1.1217706965576872
driven_lanedir_min0.3728716319555861
get_duckie_state_max1.3009626038220464e-06
get_duckie_state_mean1.2061407233561636e-06
get_duckie_state_median1.2061407233561636e-06
get_duckie_state_min1.1113188428902806e-06
get_robot_state_max0.003361321225458262
get_robot_state_mean0.0033562467186235125
get_robot_state_median0.0033562467186235125
get_robot_state_min0.0033511722117887635
get_state_dump_max0.004315521644086254
get_state_dump_mean0.004245199709295743
get_state_dump_median0.004245199709295743
get_state_dump_min0.004174877774505231
get_ui_image_max0.04638819880689722
get_ui_image_mean0.0462296199010821
get_ui_image_median0.0462296199010821
get_ui_image_min0.046071040995266974
in-drivable-lane_max25.450000000000017
in-drivable-lane_mean20.95000000000006
in-drivable-lane_min16.4500000000001
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 5.3822478383075945, "get_ui_image": 0.04638819880689722, "step_physics": 0.0728175829279633, "survival_time": 39.649999999999885, "driven_lanedir": 1.870669761159789, "get_state_dump": 0.004174877774505231, "get_robot_state": 0.0033511722117887635, "sim_render-ego0": 0.0035040492675166286, "get_duckie_state": 1.1113188428902806e-06, "in-drivable-lane": 25.450000000000017, "deviation-heading": 4.827905540560873, "agent_compute-ego0": 0.005950611244220878, "complete-iteration": 0.17070179021628737, "set_robot_commands": 0.0020486452717624923, "distance-from-start": 5.21188736737725, "deviation-center-line": 1.3656091321882378, "driven_lanedir_consec": 1.870669761159789, "sim_compute_sim_state": 0.030618905720842877, "sim_compute_performance-ego0": 0.001776492865920367}, "LF-full-loop-001-ego0": {"driven_any": 2.586999295121131, "get_ui_image": 0.046071040995266974, "step_physics": 0.08134485507497982, "survival_time": 19.550000000000143, "driven_lanedir": 0.3728716319555861, "get_state_dump": 0.004315521644086254, "get_robot_state": 0.003361321225458262, "sim_render-ego0": 0.003555355631575293, "get_duckie_state": 1.3009626038220464e-06, "in-drivable-lane": 16.4500000000001, "deviation-heading": 1.6549946502552542, "agent_compute-ego0": 0.016338011439965695, "complete-iteration": 0.18949031343265457, "set_robot_commands": 0.0020681783861043503, "distance-from-start": 2.483848407507541, "deviation-center-line": 0.2940435941925948, "driven_lanedir_consec": 0.3728716319555861, "sim_compute_sim_state": 0.030567188043983617, "sim_compute_performance-ego0": 0.0017973950931004115}}
set_robot_commands_max0.0020681783861043503
set_robot_commands_mean0.0020584118289334215
set_robot_commands_median0.0020584118289334215
set_robot_commands_min0.0020486452717624923
sim_compute_performance-ego0_max0.0017973950931004115
sim_compute_performance-ego0_mean0.0017869439795103893
sim_compute_performance-ego0_median0.0017869439795103893
sim_compute_performance-ego0_min0.001776492865920367
sim_compute_sim_state_max0.030618905720842877
sim_compute_sim_state_mean0.030593046882413245
sim_compute_sim_state_median0.030593046882413245
sim_compute_sim_state_min0.030567188043983617
sim_render-ego0_max0.003555355631575293
sim_render-ego0_mean0.0035297024495459604
sim_render-ego0_median0.0035297024495459604
sim_render-ego0_min0.0035040492675166286
simulation-passed1
step_physics_max0.08134485507497982
step_physics_mean0.07708121900147155
step_physics_median0.07708121900147155
step_physics_min0.0728175829279633
survival_time_max39.649999999999885
survival_time_mean29.600000000000016
survival_time_min19.550000000000143
No reset possible
7925815972N ? RO botbase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-030:16:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median0.0
deviation-center-line_median2.3949535344996873
driven_lanedir_consec_median6.146726129591372
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.018418081197810115
agent_compute-ego0_mean0.012634978207025204
agent_compute-ego0_median0.012634978207025204
agent_compute-ego0_min0.006851875216240292
complete-iteration_max0.1303383952672039
complete-iteration_mean0.12069855055940044
complete-iteration_median0.12069855055940044
complete-iteration_min0.11105870585159695
deviation-center-line_max2.5261985684525805
deviation-center-line_mean2.3949535344996873
deviation-center-line_min2.263708500546794
deviation-heading_max10.10202368090631
deviation-heading_mean8.574353181229288
deviation-heading_median8.574353181229288
deviation-heading_min7.046682681552267
distance-from-start_max1.5442620409839705
distance-from-start_mean1.3168821599790044
distance-from-start_median1.3168821599790044
distance-from-start_min1.0895022789740385
driven_any_max6.248401836000219
driven_any_mean6.245774773008488
driven_any_median6.245774773008488
driven_any_min6.243147710016759
driven_lanedir_consec_max6.184958366028848
driven_lanedir_consec_mean6.146726129591372
driven_lanedir_consec_min6.108493893153897
driven_lanedir_max6.184958366028848
driven_lanedir_mean6.146726129591372
driven_lanedir_median6.146726129591372
driven_lanedir_min6.108493893153897
get_duckie_state_max1.1668812722389546e-06
get_duckie_state_mean1.1555658192757662e-06
get_duckie_state_median1.1555658192757662e-06
get_duckie_state_min1.144250366312578e-06
get_robot_state_max0.0035857072380758343
get_robot_state_mean0.003573659953229334
get_robot_state_median0.003573659953229334
get_robot_state_min0.0035616126683828335
get_state_dump_max0.004420832928570978
get_state_dump_mean0.004408816016782432
get_state_dump_median0.004408816016782432
get_state_dump_min0.004396799104993885
get_ui_image_max0.028103394869662245
get_ui_image_mean0.028018444999866342
get_ui_image_median0.028018444999866342
get_ui_image_min0.02793349513007044
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.243147710016759, "get_ui_image": 0.02793349513007044, "step_physics": 0.056806302487502784, "survival_time": 59.99999999999873, "driven_lanedir": 6.108493893153897, "get_state_dump": 0.004396799104993885, "get_robot_state": 0.0035616126683828335, "sim_render-ego0": 0.0035838989492856296, "get_duckie_state": 1.144250366312578e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.10202368090631, "agent_compute-ego0": 0.006851875216240292, "complete-iteration": 0.11105870585159695, "set_robot_commands": 0.00233073953188627, "distance-from-start": 1.0895022789740385, "deviation-center-line": 2.263708500546794, "driven_lanedir_consec": 6.108493893153897, "sim_compute_sim_state": 0.003625114990412246, "sim_compute_performance-ego0": 0.0018913174151977232}, "LF-small-loop-001-ego0": {"driven_any": 6.248401836000219, "get_ui_image": 0.028103394869662245, "step_physics": 0.0641526693507694, "survival_time": 59.99999999999873, "driven_lanedir": 6.184958366028848, "get_state_dump": 0.004420832928570978, "get_robot_state": 0.0035857072380758343, "sim_render-ego0": 0.003581348009450946, "get_duckie_state": 1.1668812722389546e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.046682681552267, "agent_compute-ego0": 0.018418081197810115, "complete-iteration": 0.1303383952672039, "set_robot_commands": 0.0022218838817968057, "distance-from-start": 1.5442620409839705, "deviation-center-line": 2.5261985684525805, "driven_lanedir_consec": 6.184958366028848, "sim_compute_sim_state": 0.003884770491041807, "sim_compute_performance-ego0": 0.001896089558597409}}
set_robot_commands_max0.00233073953188627
set_robot_commands_mean0.002276311706841538
set_robot_commands_median0.002276311706841538
set_robot_commands_min0.0022218838817968057
sim_compute_performance-ego0_max0.001896089558597409
sim_compute_performance-ego0_mean0.0018937034868975664
sim_compute_performance-ego0_median0.0018937034868975664
sim_compute_performance-ego0_min0.0018913174151977232
sim_compute_sim_state_max0.003884770491041807
sim_compute_sim_state_mean0.003754942740727027
sim_compute_sim_state_median0.003754942740727027
sim_compute_sim_state_min0.003625114990412246
sim_render-ego0_max0.0035838989492856296
sim_render-ego0_mean0.0035826234793682877
sim_render-ego0_median0.0035826234793682877
sim_render-ego0_min0.003581348009450946
simulation-passed1
step_physics_max0.0641526693507694
step_physics_mean0.060479485919136086
step_physics_median0.060479485919136086
step_physics_min0.056806302487502784
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7909415918Chinmay Samakexercises_braitenbergmooc-BV1sim-0of5successnogpu-production-spot-0-030:10:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.928987220890631


other stats
agent_compute-ego0_max0.011125717471799409
agent_compute-ego0_mean0.011125717471799409
agent_compute-ego0_median0.011125717471799409
agent_compute-ego0_min0.011125717471799409
complete-iteration_max0.21937668229651264
complete-iteration_mean0.21937668229651264
complete-iteration_median0.21937668229651264
complete-iteration_min0.21937668229651264
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.928987220890631
distance-from-start_median4.928987220890631
distance-from-start_min4.928987220890631
driven_any_max5.233906961711369
driven_any_mean5.233906961711369
driven_any_median5.233906961711369
driven_any_min5.233906961711369
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08759972012470608
get_duckie_state_mean0.08759972012470608
get_duckie_state_median0.08759972012470608
get_duckie_state_min0.08759972012470608
get_robot_state_max0.003599056317320229
get_robot_state_mean0.003599056317320229
get_robot_state_median0.003599056317320229
get_robot_state_min0.003599056317320229
get_state_dump_max0.01856006078311256
get_state_dump_mean0.01856006078311256
get_state_dump_median0.01856006078311256
get_state_dump_min0.01856006078311256
get_ui_image_max0.014822199797275708
get_ui_image_mean0.014822199797275708
get_ui_image_median0.014822199797275708
get_ui_image_min0.014822199797275708
in-drivable-lane_max57.09999999999889
in-drivable-lane_mean57.09999999999889
in-drivable-lane_median57.09999999999889
in-drivable-lane_min57.09999999999889
per-episodes
details{"d45-ego0": {"driven_any": 5.233906961711369, "get_ui_image": 0.014822199797275708, "step_physics": 0.06658409545010678, "survival_time": 57.09999999999889, "driven_lanedir": 0.0, "get_state_dump": 0.01856006078311256, "get_robot_state": 0.003599056317320229, "sim_render-ego0": 0.0035111854082643204, "get_duckie_state": 0.08759972012470608, "in-drivable-lane": 57.09999999999889, "deviation-heading": 0.0, "agent_compute-ego0": 0.011125717471799409, "complete-iteration": 0.21937668229651264, "set_robot_commands": 0.0021166859857887944, "distance-from-start": 4.928987220890631, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00949945725168143, "sim_compute_performance-ego0": 0.0018688818914058016}}
set_robot_commands_max0.0021166859857887944
set_robot_commands_mean0.0021166859857887944
set_robot_commands_median0.0021166859857887944
set_robot_commands_min0.0021166859857887944
sim_compute_performance-ego0_max0.0018688818914058016
sim_compute_performance-ego0_mean0.0018688818914058016
sim_compute_performance-ego0_median0.0018688818914058016
sim_compute_performance-ego0_min0.0018688818914058016
sim_compute_sim_state_max0.00949945725168143
sim_compute_sim_state_mean0.00949945725168143
sim_compute_sim_state_median0.00949945725168143
sim_compute_sim_state_min0.00949945725168143
sim_render-ego0_max0.0035111854082643204
sim_render-ego0_mean0.0035111854082643204
sim_render-ego0_median0.0035111854082643204
sim_render-ego0_min0.0035111854082643204
simulation-passed1
step_physics_max0.06658409545010678
step_physics_mean0.06658409545010678
step_physics_median0.06658409545010678
step_physics_min0.06658409545010678
survival_time_max57.09999999999889
survival_time_mean57.09999999999889
survival_time_median57.09999999999889
survival_time_min57.09999999999889
No reset possible
7888615864Bea Baselines 🐤dummy_collision_checkermooc-collision-check-teststep1successnogpu-production-spot-0-030:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
performance0.5
No reset possible
7887515863Bea Baselines 🐤dummy_collision_checkermooc-collision-check-valistep1abortednogpu-production-spot-0-030:00:26
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7886715863Bea Baselines 🐤dummy_collision_checkermooc-collision-check-valistep1errornogpu-production-spot-0-030:00:58
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 124, in planning_checker_main
    _.set_evaluation_dir('results', d_results)
AttributeError: 'str' object has no attribute 'set_evaluation_dir'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
performance0.5
No reset possible
7871715848Juan Ramirezexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-030:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.6017516287924048


other stats
agent_compute-ego0_max0.011239536346927766
agent_compute-ego0_mean0.011239536346927766
agent_compute-ego0_median0.011239536346927766
agent_compute-ego0_min0.011239536346927766
complete-iteration_max0.2596383633152131
complete-iteration_mean0.2596383633152131
complete-iteration_median0.2596383633152131
complete-iteration_min0.2596383633152131
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.6017516287924048
distance-from-start_median0.6017516287924048
distance-from-start_min0.6017516287924048
driven_any_max0.7055112479569257
driven_any_mean0.7055112479569257
driven_any_median0.7055112479569257
driven_any_min0.7055112479569257
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11635395403831236
get_duckie_state_mean0.11635395403831236
get_duckie_state_median0.11635395403831236
get_duckie_state_min0.11635395403831236
get_robot_state_max0.0037664059669740737
get_robot_state_mean0.0037664059669740737
get_robot_state_median0.0037664059669740737
get_robot_state_min0.0037664059669740737
get_state_dump_max0.023340752047877156
get_state_dump_mean0.023340752047877156
get_state_dump_median0.023340752047877156
get_state_dump_min0.023340752047877156
get_ui_image_max0.015789543428728656
get_ui_image_mean0.015789543428728656
get_ui_image_median0.015789543428728656
get_ui_image_min0.015789543428728656
in-drivable-lane_max3.049999999999997
in-drivable-lane_mean3.049999999999997
in-drivable-lane_median3.049999999999997
in-drivable-lane_min3.049999999999997
per-episodes
details{"d60-ego0": {"driven_any": 0.7055112479569257, "get_ui_image": 0.015789543428728656, "step_physics": 0.07197373528634349, "survival_time": 3.049999999999997, "driven_lanedir": 0.0, "get_state_dump": 0.023340752047877156, "get_robot_state": 0.0037664059669740737, "sim_render-ego0": 0.003523130570688555, "get_duckie_state": 0.11635395403831236, "in-drivable-lane": 3.049999999999997, "deviation-heading": 0.0, "agent_compute-ego0": 0.011239536346927766, "complete-iteration": 0.2596383633152131, "set_robot_commands": 0.0022470835716493667, "distance-from-start": 0.6017516287924048, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009341566793380244, "sim_compute_performance-ego0": 0.001968568371188256}}
set_robot_commands_max0.0022470835716493667
set_robot_commands_mean0.0022470835716493667
set_robot_commands_median0.0022470835716493667
set_robot_commands_min0.0022470835716493667
sim_compute_performance-ego0_max0.001968568371188256
sim_compute_performance-ego0_mean0.001968568371188256
sim_compute_performance-ego0_median0.001968568371188256
sim_compute_performance-ego0_min0.001968568371188256
sim_compute_sim_state_max0.009341566793380244
sim_compute_sim_state_mean0.009341566793380244
sim_compute_sim_state_median0.009341566793380244
sim_compute_sim_state_min0.009341566793380244
sim_render-ego0_max0.003523130570688555
sim_render-ego0_mean0.003523130570688555
sim_render-ego0_median0.003523130570688555
sim_render-ego0_min0.003523130570688555
simulation-passed1
step_physics_max0.07197373528634349
step_physics_mean0.07197373528634349
step_physics_median0.07197373528634349
step_physics_min0.07197373528634349
survival_time_max3.049999999999997
survival_time_mean3.049999999999997
survival_time_median3.049999999999997
survival_time_min3.049999999999997
No reset possible
7869415845Liam Paull 🇨🇦objdet exercisemooc-objdetsimsuccessnogpu-production-spot-0-030:13:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median35.69999999999938
driven_lanedir_consec_median2.252367998934723


other stats
agent_compute-ego0_max0.01820344175313758
agent_compute-ego0_mean0.017837802639144675
agent_compute-ego0_median0.017837802639144675
agent_compute-ego0_min0.017472163525151768
complete-iteration_max0.18150244946042524
complete-iteration_mean0.1783816779868562
complete-iteration_median0.1783816779868562
complete-iteration_min0.17526090651328716
deviation-center-line_max0.3897409915923899
deviation-center-line_mean0.3293319039344703
deviation-center-line_median0.3293319039344703
deviation-center-line_min0.26892281627655074
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.881900720596483
distance-from-start_mean2.252271101474829
distance-from-start_median2.252271101474829
distance-from-start_min1.6226414823531743
driven_any_max2.881900720596483
driven_any_mean2.252271101474829
driven_any_median2.252271101474829
driven_any_min1.6226414823531743
driven_lanedir_consec_max2.8819189882516576
driven_lanedir_consec_mean2.252367998934723
driven_lanedir_consec_min1.6228170096177883
driven_lanedir_max2.8819189882516576
driven_lanedir_mean2.252367998934723
driven_lanedir_median2.252367998934723
driven_lanedir_min1.6228170096177883
get_duckie_state_max0.019156044667011297
get_duckie_state_mean0.019148606359992243
get_duckie_state_median0.019148606359992243
get_duckie_state_min0.019141168052973185
get_robot_state_max0.003416320642529617
get_robot_state_mean0.0034100342244361157
get_robot_state_median0.0034100342244361157
get_robot_state_min0.003403747806342615
get_state_dump_max0.007301332551573437
get_state_dump_mean0.007292198253377754
get_state_dump_median0.007292198253377754
get_state_dump_min0.007283063955182072
get_ui_image_max0.02912912618645414
get_ui_image_mean0.02898792065022684
get_ui_image_median0.02898792065022684
get_ui_image_min0.028846715113999544
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 1.6226414823531743, "get_ui_image": 0.028846715113999544, "step_physics": 0.06498783871494265, "survival_time": 59.99999999999873, "driven_lanedir": 1.6228170096177883, "get_state_dump": 0.007301332551573437, "get_robot_state": 0.003403747806342615, "sim_render-ego0": 0.00342624630161765, "get_duckie_state": 0.019156044667011297, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.017472163525151768, "complete-iteration": 0.17526090651328716, "set_robot_commands": 0.0020514346479277726, "distance-from-start": 1.6226414823531743, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 1.6228170096177883, "sim_compute_sim_state": 0.02673819539548952, "sim_compute_performance-ego0": 0.001800952803383858}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.881900720596483, "get_ui_image": 0.02912912618645414, "step_physics": 0.06576084465959707, "survival_time": 11.400000000000029, "driven_lanedir": 2.8819189882516576, "get_state_dump": 0.007283063955182072, "get_robot_state": 0.003416320642529617, "sim_render-ego0": 0.003492157532138075, "get_duckie_state": 0.019141168052973185, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.01820344175313758, "complete-iteration": 0.18150244946042524, "set_robot_commands": 0.002063854292490597, "distance-from-start": 2.881900720596483, "deviation-center-line": 0.26892281627655074, "driven_lanedir_consec": 2.8819189882516576, "sim_compute_sim_state": 0.031129124903783008, "sim_compute_performance-ego0": 0.0018031940710076075}}
set_robot_commands_max0.002063854292490597
set_robot_commands_mean0.002057644470209185
set_robot_commands_median0.002057644470209185
set_robot_commands_min0.0020514346479277726
sim_compute_performance-ego0_max0.0018031940710076075
sim_compute_performance-ego0_mean0.001802073437195733
sim_compute_performance-ego0_median0.001802073437195733
sim_compute_performance-ego0_min0.001800952803383858
sim_compute_sim_state_max0.031129124903783008
sim_compute_sim_state_mean0.02893366014963626
sim_compute_sim_state_median0.02893366014963626
sim_compute_sim_state_min0.02673819539548952
sim_render-ego0_max0.003492157532138075
sim_render-ego0_mean0.0034592019168778626
sim_render-ego0_median0.0034592019168778626
sim_render-ego0_min0.00342624630161765
simulation-passed1
step_physics_max0.06576084465959707
step_physics_mean0.06537434168726985
step_physics_median0.06537434168726985
step_physics_min0.06498783871494265
survival_time_max59.99999999999873
survival_time_mean35.69999999999938
survival_time_min11.400000000000029
No reset possible
7864713798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-0-030:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible