Duckietown Challenges Home Challenges Submissions

Submission 2754

Submission2754
Competingyes
Challengeaido2-LF-sim-testing
UserBhairav Mehta
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22791
Next
User labelchallenge-aido_LF-template-ros - Template solution using ROS
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22791step1-simulationsuccessyes0:15:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4126113388371666
survival_time_median2.6999999999999984
deviation-center-line_median0.11871775985231396
in-drivable-lane_median0.9499999999999976


other stats
agent_compute-ego_max0.09334176381429037
agent_compute-ego_mean0.06307417156415215
agent_compute-ego_median0.060917873492186095
agent_compute-ego_min0.042298351015363424
deviation-center-line_max0.2616199012603187
deviation-center-line_mean0.12663752615997417
deviation-center-line_min0.07143676193760398
deviation-heading_max1.4563581054905994
deviation-heading_mean0.5551840294909584
deviation-heading_median0.55940705176748
deviation-heading_min0.2596285487829774
driven_any_max1.6839250134630197
driven_any_mean0.7327294413370017
driven_any_median0.7309130538792373
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.9416535020294268
driven_lanedir_consec_mean0.4469104002974222
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.9416535020294268
driven_lanedir_mean0.4469104002974222
driven_lanedir_median0.4126113388371666
driven_lanedir_min0.2221238695940002
in-drivable-lane_max2.1499999999999924
in-drivable-lane_mean0.8233333333333307
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.08699881862586653, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.04776946255858515, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.0529491599176971, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.07126130184657137, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.02946349600671043, "sim_compute_performance-ego": 0.05647001803760797, "sim_compute_robot_state-ego": 0.0564642523376035}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.14628276824951172, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.06436090469360352, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09334176381429037, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.11633018652598064, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.0459917147954305, "sim_compute_performance-ego": 0.07905261913935344, "sim_compute_robot_state-ego": 0.092208202679952}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.0698591253974221, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.03800857067108154, "in-drivable-lane": 0, "agent_compute-ego": 0.04253717986020175, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.05812524665485729, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.024246941913257943, "sim_compute_performance-ego": 0.04133977673270486, "sim_compute_robot_state-ego": 0.044428229331970215}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.08250038822491963, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.04506258169809977, "in-drivable-lane": 0, "agent_compute-ego": 0.05151469508806864, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.07042579849561055, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.02917337914307912, "sim_compute_performance-ego": 0.04943455755710602, "sim_compute_robot_state-ego": 0.05521536866823832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.07575164152228314, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.04774337747822637, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.05201359417127526, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.06321318253226903, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.03172426120094631, "sim_compute_performance-ego": 0.05304265540579091, "sim_compute_robot_state-ego": 0.07120410255763841}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.06808024644851685, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.04289453228314718, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.049532165129979454, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.06795849402745564, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.027759979168574016, "sim_compute_performance-ego": 0.04627335071563721, "sim_compute_robot_state-ego": 0.049128939708073936}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.05483752641922388, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.0353005268634894, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.04521560974610157, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.05353235892760448, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.02300859414614164, "sim_compute_performance-ego": 0.03834956425886888, "sim_compute_robot_state-ego": 0.0402368032015287}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.06214954171861921, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.03616715754781451, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.042298351015363424, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.054484320538384576, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.023121280329568044, "sim_compute_performance-ego": 0.03927615284919739, "sim_compute_robot_state-ego": 0.041196508066994805}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.10097110956564716, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.05548786568915707, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.060917873492186095, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.08320942144284303, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.03555542573161509, "sim_compute_performance-ego": 0.061913597172704234, "sim_compute_robot_state-ego": 0.06625576128904846}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.14686742695895108, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.06865748058665883, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08102627450769598, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.108070293339816, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.04271366162733598, "sim_compute_performance-ego": 0.0824317455291748, "sim_compute_robot_state-ego": 0.09029148491946132}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.14281814297040304, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.06885078549385071, "in-drivable-lane": 0, "agent_compute-ego": 0.07861332098642985, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.1072155733903249, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.046645681063334145, "sim_compute_performance-ego": 0.07552722096443176, "sim_compute_robot_state-ego": 0.08181244134902954}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.12133136043300875, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.06469099242965896, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07373788449671362, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.1031774328900622, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.04129406074424843, "sim_compute_performance-ego": 0.0725489684513637, "sim_compute_robot_state-ego": 0.077300805550117}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.11820222854614258, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.06765528678894044, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.07008903980255127, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.0975852870941162, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.04008932590484619, "sim_compute_performance-ego": 0.07243114471435547, "sim_compute_robot_state-ego": 0.07954689025878907}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.1271915894288283, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.06645137530106765, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07445968114412747, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.1002655212695782, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.0428534929568951, "sim_compute_performance-ego": 0.07041814694037804, "sim_compute_robot_state-ego": 0.07791085426624005}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.1285004218419393, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.07044598791334364, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.07786598028960051, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.11132287979125977, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.043861450972380464, "sim_compute_performance-ego": 0.07565736770629883, "sim_compute_robot_state-ego": 0.08322817749447292}}
set_robot_commands_max0.11633018652598064
set_robot_commands_mean0.08441181991778227
set_robot_commands_median0.08320942144284303
set_robot_commands_min0.05353235892760448
sim_compute_performance-ego_max0.0824317455291748
sim_compute_performance-ego_mean0.06094445907833157
sim_compute_performance-ego_median0.061913597172704234
sim_compute_performance-ego_min0.03834956425886888
sim_compute_robot_state-ego_max0.092208202679952
sim_compute_robot_state-ego_mean0.06709525477861054
sim_compute_robot_state-ego_median0.07120410255763841
sim_compute_robot_state-ego_min0.0402368032015287
sim_compute_sim_state_max0.046645681063334145
sim_compute_sim_state_mean0.03516684971362423
sim_compute_sim_state_median0.03555542573161509
sim_compute_sim_state_min0.02300859414614164
sim_physics_max0.14686742695895108
sim_physics_mean0.1021561557567522
sim_physics_median0.10097110956564716
sim_physics_min0.05483752641922388
sim_render-ego_max0.07044598791334364
sim_render-ego_mean0.05463645919978165
sim_render-ego_median0.05548786568915707
sim_render-ego_min0.0353005268634894
simulation-passed1
survival_time_max5.4999999999999885
survival_time_mean2.7766666666666637
survival_time_min1.1000000000000003
No reset possible