Duckietown Challenges Home Challenges Submissions

Job 34937

Job ID34937
submission9752
userBea Baselines 🐤
user labelstraight
challengeaido5-LFV-sim-validation
stepLFVv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg01-6849899a1b0a-1
date started
date completed
duration0:28:57
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.600415295980429
survival_time_median14.050000000000065
deviation-center-line_median0.48858441008520503
in-drivable-lane_median7.10000000000001


other stats
agent_compute-ego_max0.03958497285842896
agent_compute-ego_mean0.0386136796589556
agent_compute-ego_median0.038331034744936474
agent_compute-ego_min0.03757934924984766
complete-iteration_max0.4537963104248046
complete-iteration_mean0.4268213961251421
complete-iteration_median0.4222474951365378
complete-iteration_min0.404111828000742
deviation-center-line_max0.6289467607006275
deviation-center-line_mean0.4600994128665998
deviation-center-line_min0.30179964180390495
deviation-heading_max2.304159408917883
deviation-heading_mean1.4144108056433355
deviation-heading_median1.416716347207803
deviation-heading_min0.46435470820567976
driven_any_max2.407403600555989
driven_any_mean1.9781117477727463
driven_any_median2.265643781552277
driven_any_min0.9433201151220528
driven_lanedir_consec_max2.39276724961448
driven_lanedir_consec_mean0.9682090906721778
driven_lanedir_consec_min0.3479029848353281
driven_lanedir_max2.39276724961448
driven_lanedir_mean0.9682090906721778
driven_lanedir_median0.600415295980429
driven_lanedir_min0.3479029848353281
get_state_dump_max0.03822020248130516
get_state_dump_mean0.03791991023016137
get_state_dump_median0.03800429451958097
get_state_dump_min0.03743535916010539
get_ui_image_max0.0753274414597488
get_ui_image_mean0.07397996962070089
get_ui_image_median0.07392307454889471
get_ui_image_min0.07280681610107421
in-drivable-lane_max10.700000000000076
in-drivable-lane_mean5.665000000000026
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.29945636568878, "get_ui_image": 0.0753274414597488, "step_physics": 0.1497291515513164, "survival_time": 8.199999999999982, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.03809636685906387, "sim_render-ego": 0.010243319883579162, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.03805368847963286, "deviation-heading": 0.656882474004175, "complete-iteration": 0.4259441974686413, "set_robot_commands": 0.008390480425299668, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.02247860809651817, "sim_compute_performance-ego": 0.007211923599243164, "sim_compute_robot_state-ego": 0.01292462029108187, "sim_compute_robot_state-npc0": 0.01272566144059344, "sim_compute_robot_state-npc1": 0.01260853540606615, "sim_compute_robot_state-npc2": 0.012522101402282717, "sim_compute_robot_state-npc3": 0.012732686066045992, "sim_compute_robot_state-parked0": 0.01252774203695902}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.9433201151220528, "get_ui_image": 0.07280874646399632, "step_physics": 0.15206885928950034, "survival_time": 6.0499999999999865, "driven_lanedir": 0.9403789868663692, "get_state_dump": 0.03780570109028462, "sim_render-ego": 0.009598469931232045, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03757934924984766, "deviation-heading": 0.46435470820567976, "complete-iteration": 0.4185507928044343, "set_robot_commands": 0.0078985257582231, "deviation-center-line": 0.48980241394661056, "driven_lanedir_consec": 0.9403789868663692, "sim_compute_sim_state": 0.021602549828773687, "sim_compute_performance-ego": 0.006882023220219888, "sim_compute_robot_state-ego": 0.01228818814616558, "sim_compute_robot_state-npc0": 0.011896730454500057, "sim_compute_robot_state-npc1": 0.011948323446857045, "sim_compute_robot_state-npc2": 0.011845533512840586, "sim_compute_robot_state-npc3": 0.012070214452822348, "sim_compute_robot_state-parked0": 0.011905754893279273}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 2.387496207289894, "get_ui_image": 0.07482645076674384, "step_physics": 0.1736127919441945, "survival_time": 14.800000000000075, "driven_lanedir": 2.3822953151098836, "get_state_dump": 0.03807851349985277, "sim_render-ego": 0.009833140147698892, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03804025617805687, "deviation-heading": 0.6246959190942224, "complete-iteration": 0.44293036412548376, "set_robot_commands": 0.007844406205254633, "deviation-center-line": 0.5464362396156924, "driven_lanedir_consec": 2.3822953151098836, "sim_compute_sim_state": 0.020907611460299104, "sim_compute_performance-ego": 0.006969693544748667, "sim_compute_robot_state-ego": 0.01211657395233979, "sim_compute_robot_state-npc0": 0.011955574557587906, "sim_compute_robot_state-npc1": 0.01200540565155648, "sim_compute_robot_state-npc2": 0.01203772022917464, "sim_compute_robot_state-npc3": 0.01222177453943201, "sim_compute_robot_state-parked0": 0.01210902671556215}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.3993972968350845, "get_ui_image": 0.07399546016346324, "step_physics": 0.17454959406997217, "survival_time": 14.850000000000076, "driven_lanedir": 2.39276724961448, "get_state_dump": 0.03822020248130516, "sim_render-ego": 0.009729742602467137, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03808288301281656, "deviation-heading": 0.7132262893800697, "complete-iteration": 0.4421020806437791, "set_robot_commands": 0.007732287801877417, "deviation-center-line": 0.6289467607006275, "driven_lanedir_consec": 2.39276724961448, "sim_compute_sim_state": 0.02058730382309217, "sim_compute_performance-ego": 0.006921430228133796, "sim_compute_robot_state-ego": 0.012405753537059232, "sim_compute_robot_state-npc0": 0.011961479379673196, "sim_compute_robot_state-npc1": 0.011713080936008029, "sim_compute_robot_state-npc2": 0.011916968156191636, "sim_compute_robot_state-npc3": 0.011978346089321357, "sim_compute_robot_state-parked0": 0.011945448339186131}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.2507122712214302, "get_ui_image": 0.07299915351320765, "step_physics": 0.1417248419963331, "survival_time": 13.950000000000063, "driven_lanedir": 0.6134250925103875, "get_state_dump": 0.03807579061036469, "sim_render-ego": 0.009169917807356858, "in-drivable-lane": 9.150000000000045, "agent_compute-ego": 0.03837835745999463, "deviation-heading": 2.130804073594577, "complete-iteration": 0.404111828000742, "set_robot_commands": 0.006960083506867877, "deviation-center-line": 0.5189072793178615, "driven_lanedir_consec": 0.6134250925103875, "sim_compute_sim_state": 0.02284834120008681, "sim_compute_performance-ego": 0.006378171264484364, "sim_compute_robot_state-ego": 0.010981294843885634, "sim_compute_robot_state-npc0": 0.011130459419715362, "sim_compute_robot_state-npc1": 0.011023582096168218, "sim_compute_robot_state-npc2": 0.011389558887823508, "sim_compute_robot_state-npc3": 0.011311599430644812, "sim_compute_robot_state-parked0": 0.011387627611878098}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.2805752918831232, "get_ui_image": 0.07376551375372249, "step_physics": 0.14374059754631124, "survival_time": 14.150000000000066, "driven_lanedir": 0.5675947043573228, "get_state_dump": 0.038056661720410674, "sim_render-ego": 0.00937730431977936, "in-drivable-lane": 9.550000000000049, "agent_compute-ego": 0.038283712029878326, "deviation-heading": 2.1335627884436654, "complete-iteration": 0.40446554055904754, "set_robot_commands": 0.006761787636962459, "deviation-center-line": 0.4873664062237995, "driven_lanedir_consec": 0.5675947043573228, "sim_compute_sim_state": 0.022798443851538345, "sim_compute_performance-ego": 0.006283846002585475, "sim_compute_robot_state-ego": 0.010730268255981876, "sim_compute_robot_state-npc0": 0.01092235528116934, "sim_compute_robot_state-npc1": 0.01073188158311608, "sim_compute_robot_state-npc2": 0.010752173278862511, "sim_compute_robot_state-npc3": 0.010950910750210496, "sim_compute_robot_state-parked0": 0.01095399249990079}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.406139339379617, "get_ui_image": 0.07280681610107421, "step_physics": 0.1906036376953125, "survival_time": 14.950000000000076, "driven_lanedir": 0.5869709972457224, "get_state_dump": 0.03743535916010539, "sim_render-ego": 0.009592494169871011, "in-drivable-lane": 10.600000000000076, "agent_compute-ego": 0.0394579807917277, "deviation-heading": 1.493166132952402, "complete-iteration": 0.45085126558939614, "set_robot_commands": 0.007167363166809082, "deviation-center-line": 0.32345508309186644, "driven_lanedir_consec": 0.5869709972457224, "sim_compute_sim_state": 0.020169038772583008, "sim_compute_performance-ego": 0.006406419277191162, "sim_compute_robot_state-ego": 0.011168299516042072, "sim_compute_robot_state-npc0": 0.011163875261942546, "sim_compute_robot_state-npc1": 0.011092554728190105, "sim_compute_robot_state-npc2": 0.011033498446146648, "sim_compute_robot_state-npc3": 0.011180518468221028, "sim_compute_robot_state-parked0": 0.011229406197865804}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.407403600555989, "get_ui_image": 0.07385068893432617, "step_physics": 0.19087850411732993, "survival_time": 14.950000000000076, "driven_lanedir": 0.5874054994504705, "get_state_dump": 0.03789720853169759, "sim_render-ego": 0.009740211963653564, "in-drivable-lane": 10.700000000000076, "agent_compute-ego": 0.03958497285842896, "deviation-heading": 1.340266561463204, "complete-iteration": 0.4537963104248046, "set_robot_commands": 0.007115840117136637, "deviation-center-line": 0.30179964180390495, "driven_lanedir_consec": 0.5874054994504705, "sim_compute_sim_state": 0.020375852584838868, "sim_compute_performance-ego": 0.006550716559092204, "sim_compute_robot_state-ego": 0.01152296543121338, "sim_compute_robot_state-npc0": 0.011264296372731526, "sim_compute_robot_state-npc1": 0.011241833368937174, "sim_compute_robot_state-npc2": 0.0111733873685201, "sim_compute_robot_state-npc3": 0.011127495765686037, "sim_compute_robot_state-parked0": 0.01110837459564209}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.705101879425747, "get_ui_image": 0.07502130704505422, "step_physics": 0.14677724882821055, "survival_time": 10.700000000000015, "driven_lanedir": 0.3479029848353281, "get_state_dump": 0.03795192731875126, "sim_render-ego": 0.010028165077494685, "in-drivable-lane": 7.200000000000009, "agent_compute-ego": 0.0394073379373996, "deviation-heading": 2.304159408917883, "complete-iteration": 0.415186091004131, "set_robot_commands": 0.007794003620325962, "deviation-center-line": 0.3694589514572386, "driven_lanedir_consec": 0.3479029848353281, "sim_compute_sim_state": 0.018412622335915257, "sim_compute_performance-ego": 0.006951539315909983, "sim_compute_robot_state-ego": 0.012421235859951129, "sim_compute_robot_state-npc0": 0.011822686017116654, "sim_compute_robot_state-npc1": 0.0120655498772024, "sim_compute_robot_state-npc2": 0.012098131892837096, "sim_compute_robot_state-npc3": 0.01194521088466466, "sim_compute_robot_state-parked0": 0.012138356672269162}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.7015151103257478, "get_ui_image": 0.07439811800567198, "step_physics": 0.14590141918737565, "survival_time": 10.650000000000016, "driven_lanedir": 0.3758337411997157, "get_state_dump": 0.0375813710297777, "sim_render-ego": 0.009853103351145283, "in-drivable-lane": 7.000000000000011, "agent_compute-ego": 0.039268258591772805, "deviation-heading": 2.2829897003774757, "complete-iteration": 0.41027549063096025, "set_robot_commands": 0.007600343283353277, "deviation-center-line": 0.3905982479176758, "driven_lanedir_consec": 0.3758337411997157, "sim_compute_sim_state": 0.018176087751075137, "sim_compute_performance-ego": 0.006666100640811831, "sim_compute_robot_state-ego": 0.01172200838724772, "sim_compute_robot_state-npc0": 0.011809766572406037, "sim_compute_robot_state-npc1": 0.011597896405788654, "sim_compute_robot_state-npc2": 0.011675961140735608, "sim_compute_robot_state-npc3": 0.01165255694322183, "sim_compute_robot_state-parked0": 0.012020271149039828}}
set_robot_commands_max0.008390480425299668
set_robot_commands_mean0.007526512152211012
set_robot_commands_median0.007666315542615347
set_robot_commands_min0.006761787636962459
sim_compute_performance-ego_max0.007211923599243164
sim_compute_performance-ego_mean0.006722186365242054
sim_compute_performance-ego_median0.006774061930515859
sim_compute_performance-ego_min0.006283846002585475
sim_compute_robot_state-ego_max0.01292462029108187
sim_compute_robot_state-ego_mean0.011828120822096827
sim_compute_robot_state-ego_median0.011919291169793756
sim_compute_robot_state-ego_min0.010730268255981876
sim_compute_robot_state-npc0_max0.01272566144059344
sim_compute_robot_state-npc0_mean0.011665288475743609
sim_compute_robot_state-npc0_median0.011816226294761345
sim_compute_robot_state-npc0_min0.01092235528116934
sim_compute_robot_state-npc1_max0.01260853540606615
sim_compute_robot_state-npc1_mean0.011602864349989032
sim_compute_robot_state-npc1_median0.011655488670898342
sim_compute_robot_state-npc1_min0.01073188158311608
sim_compute_robot_state-npc2_max0.012522101402282717
sim_compute_robot_state-npc2_mean0.011644503431541504
sim_compute_robot_state-npc2_median0.011760747326788097
sim_compute_robot_state-npc2_min0.010752173278862511
sim_compute_robot_state-npc3_max0.012732686066045992
sim_compute_robot_state-npc3_mean0.011717131339027057
sim_compute_robot_state-npc3_median0.011798883913943244
sim_compute_robot_state-npc3_min0.010950910750210496
sim_compute_robot_state-parked0_max0.01252774203695902
sim_compute_robot_state-parked0_mean0.011732600071158231
sim_compute_robot_state-parked0_median0.0119256016162327
sim_compute_robot_state-parked0_min0.01095399249990079
sim_compute_sim_state_max0.02284834120008681
sim_compute_sim_state_mean0.020835645970472057
sim_compute_sim_state_median0.02074745764169564
sim_compute_sim_state_min0.018176087751075137
sim_render-ego_max0.010243319883579162
sim_render-ego_mean0.0097165869254278
sim_render-ego_median0.00973497728306035
sim_render-ego_min0.009169917807356858
simulation-passed1
step_physics_max0.19087850411732993
step_physics_mean0.16095866462258565
step_physics_median0.15089900542040838
step_physics_min0.1417248419963331
survival_time_max14.950000000000076
survival_time_mean12.325000000000044
survival_time_min6.0499999999999865

Highlights

34937

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.