Duckietown Challenges Home Challenges Submissions

Job 34392

Job ID34392
submission9196
userBea Baselines 🐤
user labeltemplate-random
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg01-43ac583c2714-1
date started
date completed
duration0:36:42
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3853719842517749
survival_time_median14.950000000000076
deviation-center-line_median0.27966104289415994
in-drivable-lane_median8.000000000000053


other stats
agent_compute-ego_max0.06141242822011312
agent_compute-ego_mean0.05998296800692629
agent_compute-ego_median0.06063907623291016
agent_compute-ego_min0.05632811784744263
complete-iteration_max0.5381667033831279
complete-iteration_mean0.5162687116883619
complete-iteration_median0.5198247106870015
complete-iteration_min0.49066415919533257
deviation-center-line_max0.9708397098960404
deviation-center-line_mean0.3738311222004077
deviation-center-line_min0.06877112420442885
deviation-heading_max4.3134340587244795
deviation-heading_mean2.2425666857479336
deviation-heading_median1.6863725496831878
deviation-heading_min0.46804858055741577
driven_any_max1.939697060383743
driven_any_mean1.6453735978559791
driven_any_median1.939228289263196
driven_any_min0.46617149519376055
driven_lanedir_consec_max1.134016883428718
driven_lanedir_consec_mean0.48854848436010895
driven_lanedir_consec_min0.0637785074644377
driven_lanedir_max1.3530402585799823
driven_lanedir_mean0.5329911070714213
driven_lanedir_median0.43675429882481465
driven_lanedir_min0.0637785074644377
get_state_dump_max0.03532665093739828
get_state_dump_mean0.03485785533703937
get_state_dump_median0.034786373376846313
get_state_dump_min0.034523980617523195
get_ui_image_max0.09817227522532145
get_ui_image_mean0.0932901705442386
get_ui_image_median0.0926143193244934
get_ui_image_min0.08781439917428153
in-drivable-lane_max13.900000000000077
in-drivable-lane_mean7.475000000000044
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 1.9328488429165656, "get_ui_image": 0.0954606556892395, "step_physics": 0.23318166494369508, "survival_time": 14.950000000000076, "driven_lanedir": 0.8447231804526516, "get_state_dump": 0.03527228911717733, "sim_render-ego": 0.007291912237803141, "in-drivable-lane": 6.550000000000055, "agent_compute-ego": 0.05632811784744263, "deviation-heading": 3.9751504647469313, "complete-iteration": 0.5252120137214661, "set_robot_commands": 0.00663622776667277, "deviation-center-line": 0.3180069855218593, "driven_lanedir_consec": 0.8447231804526516, "sim_compute_sim_state": 0.02279933214187622, "sim_compute_performance-ego": 0.005891268253326416, "sim_compute_robot_state-ego": 0.01064730167388916, "sim_compute_robot_state-npc0": 0.010418725808461508, "sim_compute_robot_state-npc1": 0.010241148471832277, "sim_compute_robot_state-npc2": 0.01034533421198527, "sim_compute_robot_state-npc3": 0.010099000930786133, "sim_compute_robot_state-parked0": 0.010312432448069255}, "udem1-0-1-ego": {"driven_any": 1.9392550701102171, "get_ui_image": 0.09636721452077228, "step_physics": 0.2331820591290792, "survival_time": 14.950000000000076, "driven_lanedir": 0.318575905497557, "get_state_dump": 0.0346806009610494, "sim_render-ego": 0.00768569548924764, "in-drivable-lane": 11.500000000000082, "agent_compute-ego": 0.06118590593338013, "deviation-heading": 1.760806084175668, "complete-iteration": 0.5310820364952087, "set_robot_commands": 0.0065285023053487145, "deviation-center-line": 0.23281975757430132, "driven_lanedir_consec": 0.318575905497557, "sim_compute_sim_state": 0.023109334309895833, "sim_compute_performance-ego": 0.0060083866119384766, "sim_compute_robot_state-ego": 0.01048812468846639, "sim_compute_robot_state-npc0": 0.010240437984466551, "sim_compute_robot_state-npc1": 0.010174135367075602, "sim_compute_robot_state-npc2": 0.010269001324971517, "sim_compute_robot_state-npc3": 0.010554680824279784, "sim_compute_robot_state-parked0": 0.010280733903249104}, "udem1-1-0-ego": {"driven_any": 1.9391780343421163, "get_ui_image": 0.09817227522532145, "step_physics": 0.23120327393213908, "survival_time": 14.950000000000076, "driven_lanedir": 0.0637785074644377, "get_state_dump": 0.03532665093739828, "sim_render-ego": 0.007775753339131673, "in-drivable-lane": 13.900000000000077, "agent_compute-ego": 0.06141242822011312, "deviation-heading": 0.502231134438907, "complete-iteration": 0.5381667033831279, "set_robot_commands": 0.0065602628389994306, "deviation-center-line": 0.06877112420442885, "driven_lanedir_consec": 0.0637785074644377, "sim_compute_sim_state": 0.02819539785385132, "sim_compute_performance-ego": 0.006137491861979167, "sim_compute_robot_state-ego": 0.010664188067118326, "sim_compute_robot_state-npc0": 0.010619975725809734, "sim_compute_robot_state-npc1": 0.010595829486846923, "sim_compute_robot_state-npc2": 0.010410157839457194, "sim_compute_robot_state-npc3": 0.010330447355906169, "sim_compute_robot_state-parked0": 0.01045002539952596}, "udem1-1-1-ego": {"driven_any": 1.939201508416175, "get_ui_image": 0.09424592971801758, "step_physics": 0.21780473391215008, "survival_time": 14.950000000000076, "driven_lanedir": 0.14630653780790137, "get_state_dump": 0.03490272442499796, "sim_render-ego": 0.007565972010294597, "in-drivable-lane": 13.250000000000076, "agent_compute-ego": 0.060981194178263344, "deviation-heading": 0.7235199505078624, "complete-iteration": 0.516872124671936, "set_robot_commands": 0.006772550741831461, "deviation-center-line": 0.1428893659120759, "driven_lanedir_consec": 0.14630653780790137, "sim_compute_sim_state": 0.02576269547144572, "sim_compute_performance-ego": 0.006080827713012695, "sim_compute_robot_state-ego": 0.010511120955149332, "sim_compute_robot_state-npc0": 0.01047404686609904, "sim_compute_robot_state-npc1": 0.010282349586486815, "sim_compute_robot_state-npc2": 0.010497283935546876, "sim_compute_robot_state-npc3": 0.01041250467300415, "sim_compute_robot_state-parked0": 0.010280182361602785}, "udem1-2-0-ego": {"driven_any": 1.9392639500347175, "get_ui_image": 0.09252001603444417, "step_physics": 0.2317963178952535, "survival_time": 14.950000000000076, "driven_lanedir": 0.4213405346436365, "get_state_dump": 0.034523980617523195, "sim_render-ego": 0.007552689711252849, "in-drivable-lane": 9.45000000000005, "agent_compute-ego": 0.06072059790293376, "deviation-heading": 4.3134340587244795, "complete-iteration": 0.5211721754074097, "set_robot_commands": 0.006487835248311361, "deviation-center-line": 0.5643437128653573, "driven_lanedir_consec": 0.1959376826817778, "sim_compute_sim_state": 0.01934425195058187, "sim_compute_performance-ego": 0.005999566713968913, "sim_compute_robot_state-ego": 0.010631601810455322, "sim_compute_robot_state-npc0": 0.010237013498942056, "sim_compute_robot_state-npc1": 0.010223464171091715, "sim_compute_robot_state-npc2": 0.0104158353805542, "sim_compute_robot_state-npc3": 0.0102079176902771, "sim_compute_robot_state-parked0": 0.010213731129964192}, "udem1-2-1-ego": {"driven_any": 1.939288300979644, "get_ui_image": 0.09270862261454264, "step_physics": 0.2161032700538635, "survival_time": 14.950000000000076, "driven_lanedir": 0.15329135534890548, "get_state_dump": 0.03456227064132691, "sim_render-ego": 0.007405806382497152, "in-drivable-lane": 12.700000000000076, "agent_compute-ego": 0.06055755456288656, "deviation-heading": 1.6119390151907076, "complete-iteration": 0.5050376224517822, "set_robot_commands": 0.006700093746185303, "deviation-center-line": 0.2668080164018017, "driven_lanedir_consec": 0.15329135534890548, "sim_compute_sim_state": 0.01900087277094523, "sim_compute_performance-ego": 0.005799594720204671, "sim_compute_robot_state-ego": 0.01043069044748942, "sim_compute_robot_state-npc0": 0.01022012710571289, "sim_compute_robot_state-npc1": 0.010235148270924886, "sim_compute_robot_state-npc2": 0.010434159437815348, "sim_compute_robot_state-npc3": 0.010275647640228272, "sim_compute_robot_state-parked0": 0.010308169523874918}, "udem1-3-0-ego": {"driven_any": 1.939363654241701, "get_ui_image": 0.09229706843694052, "step_physics": 0.22136629581451417, "survival_time": 14.950000000000076, "driven_lanedir": 1.3530402585799823, "get_state_dump": 0.034694094657897946, "sim_render-ego": 0.007482674916585287, "in-drivable-lane": 2.8000000000000176, "agent_compute-ego": 0.06035122076670329, "deviation-heading": 4.294282365613492, "complete-iteration": 0.5184772459665934, "set_robot_commands": 0.006533535321553549, "deviation-center-line": 0.7506359039886357, "driven_lanedir_consec": 1.134016883428718, "sim_compute_sim_state": 0.02776082754135132, "sim_compute_performance-ego": 0.00609813133875529, "sim_compute_robot_state-ego": 0.010360992749532064, "sim_compute_robot_state-npc0": 0.010235203901926676, "sim_compute_robot_state-npc1": 0.01029029925664266, "sim_compute_robot_state-npc2": 0.01034091075261434, "sim_compute_robot_state-npc3": 0.010200824737548828, "sim_compute_robot_state-parked0": 0.01013622760772705}, "udem1-3-1-ego": {"driven_any": 1.939697060383743, "get_ui_image": 0.09139360904693604, "step_physics": 0.2231798815727234, "survival_time": 14.950000000000076, "driven_lanedir": 1.1011647349646634, "get_state_dump": 0.03487865209579468, "sim_render-ego": 0.007692939440409343, "in-drivable-lane": 4.6000000000000085, "agent_compute-ego": 0.061239213943481446, "deviation-heading": 4.179674960455908, "complete-iteration": 0.5228696950276692, "set_robot_commands": 0.006666411558787028, "deviation-center-line": 0.9708397098960404, "driven_lanedir_consec": 1.1011647349646634, "sim_compute_sim_state": 0.02837338447570801, "sim_compute_performance-ego": 0.0061166644096374515, "sim_compute_robot_state-ego": 0.01080314556757609, "sim_compute_robot_state-npc0": 0.010474521319071452, "sim_compute_robot_state-npc1": 0.010470210711161295, "sim_compute_robot_state-npc2": 0.010431537628173828, "sim_compute_robot_state-npc3": 0.010432441234588623, "sim_compute_robot_state-parked0": 0.010384603341420492}, "udem1-4-0-ego": {"driven_any": 0.46617149519376055, "get_ui_image": 0.08781439917428153, "step_physics": 0.20988853566058271, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4521680630059928, "get_state_dump": 0.034662023767248376, "sim_render-ego": 0.007373351555366021, "in-drivable-lane": 0.0, "agent_compute-ego": 0.057524256892018504, "deviation-heading": 0.596580243067965, "complete-iteration": 0.49313334056309294, "set_robot_commands": 0.006412521585241541, "deviation-center-line": 0.29251406938651814, "driven_lanedir_consec": 0.4521680630059928, "sim_compute_sim_state": 0.021712058550351625, "sim_compute_performance-ego": 0.005992013138610047, "sim_compute_robot_state-ego": 0.010805597553005466, "sim_compute_robot_state-npc0": 0.010415163907137783, "sim_compute_robot_state-npc1": 0.010383283937132204, "sim_compute_robot_state-npc2": 0.009860013986562754, "sim_compute_robot_state-npc3": 0.010123686356977983, "sim_compute_robot_state-parked0": 0.009882991964166817}, "udem1-4-1-ego": {"driven_any": 0.4794680619411486, "get_ui_image": 0.09192191498189033, "step_physics": 0.19884348519240755, "survival_time": 3.949999999999994, "driven_lanedir": 0.4755219929484844, "get_state_dump": 0.035075266149979606, "sim_render-ego": 0.00754097745388369, "in-drivable-lane": 0.0, "agent_compute-ego": 0.05952918982204003, "deviation-heading": 0.46804858055741577, "complete-iteration": 0.49066415919533257, "set_robot_commands": 0.00673292256608794, "deviation-center-line": 0.13068257625305882, "driven_lanedir_consec": 0.4755219929484844, "sim_compute_sim_state": 0.021448482440996775, "sim_compute_performance-ego": 0.0061596496195732795, "sim_compute_robot_state-ego": 0.010780518568014796, "sim_compute_robot_state-npc0": 0.010415345807618734, "sim_compute_robot_state-npc1": 0.010497560983971704, "sim_compute_robot_state-npc2": 0.010289119768746292, "sim_compute_robot_state-npc3": 0.010495807551130464, "sim_compute_robot_state-parked0": 0.01062854030464269}}
set_robot_commands_max0.006772550741831461
set_robot_commands_mean0.00660308636790191
set_robot_commands_median0.006598245302836101
set_robot_commands_min0.006412521585241541
sim_compute_performance-ego_max0.0061596496195732795
sim_compute_performance-ego_mean0.0060283594381006405
sim_compute_performance-ego_median0.0060446071624755855
sim_compute_performance-ego_min0.005799594720204671
sim_compute_robot_state-ego_max0.010805597553005466
sim_compute_robot_state-ego_mean0.010612328208069635
sim_compute_robot_state-ego_median0.01063945174217224
sim_compute_robot_state-ego_min0.010360992749532064
sim_compute_robot_state-npc0_max0.010619975725809734
sim_compute_robot_state-npc0_mean0.010375056192524644
sim_compute_robot_state-npc0_median0.01041525485737826
sim_compute_robot_state-npc0_min0.01022012710571289
sim_compute_robot_state-npc1_max0.010595829486846923
sim_compute_robot_state-npc1_mean0.010339343024316609
sim_compute_robot_state-npc1_median0.010286324421564736
sim_compute_robot_state-npc1_min0.010174135367075602
sim_compute_robot_state-npc2_max0.010497283935546876
sim_compute_robot_state-npc2_mean0.01032933542664276
sim_compute_robot_state-npc2_median0.010377746025721233
sim_compute_robot_state-npc2_min0.009860013986562754
sim_compute_robot_state-npc3_max0.010554680824279784
sim_compute_robot_state-npc3_mean0.01031329589947275
sim_compute_robot_state-npc3_median0.01030304749806722
sim_compute_robot_state-npc3_min0.010099000930786133
sim_compute_robot_state-parked0_max0.01062854030464269
sim_compute_robot_state-parked0_mean0.010287763798424329
sim_compute_robot_state-parked0_median0.010294451713562011
sim_compute_robot_state-parked0_min0.009882991964166817
sim_compute_sim_state_max0.02837338447570801
sim_compute_sim_state_mean0.023750663750700392
sim_compute_sim_state_median0.022954333225886026
sim_compute_sim_state_min0.01900087277094523
sim_render-ego_max0.007775753339131673
sim_render-ego_mean0.007536777253647138
sim_render-ego_median0.007546833582568269
sim_render-ego_min0.007291912237803141
simulation-passed1
step_physics_max0.2331820591290792
step_physics_mean0.22165495181064085
step_physics_median0.2222730886936188
step_physics_min0.19884348519240755
survival_time_max14.950000000000076
survival_time_mean12.74000000000006
survival_time_min3.8499999999999943

Highlights

34392

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.