Duckietown Challenges Home Challenges Submissions

Submission 11415

Submission11415
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 55038
Next
User labelchallenge-aido_LF-baseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

55038

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
55038LFVmultibodyv-simsuccessyes1:35:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.244289278462052
survival_time_median59.99999999999873
deviation-center-line_median2.7851021330871504
in-drivable-lane_median2.499999999999976


other stats
agent_compute-ego0_max0.04280074113215336
agent_compute-ego0_mean0.04012849073148732
agent_compute-ego0_median0.03963584844317663
agent_compute-ego0_min0.03840351835521245
agent_compute-ego1_max0.04465970151331105
agent_compute-ego1_mean0.04087310454687377
agent_compute-ego1_median0.040881661749402255
agent_compute-ego1_min0.03814038767516233
complete-iteration_max0.7447455040521169
complete-iteration_mean0.6280893740319655
complete-iteration_median0.734565913528328
complete-iteration_min0.2895664209607004
deviation-center-line_max3.299444983280622
deviation-center-line_mean2.7884613735760526
deviation-center-line_min1.6753504117871665
deviation-heading_max14.319529764639462
deviation-heading_mean10.90168755738816
deviation-heading_median11.311138086962345
deviation-heading_min5.458199613473701
driven_any_max14.590320002142294
driven_any_mean13.835539790139306
driven_any_median14.590151130839264
driven_any_min9.307535393842445
driven_lanedir_consec_max14.240157955669602
driven_lanedir_consec_mean12.416747527068113
driven_lanedir_consec_min6.987901081338952
driven_lanedir_max14.240157955669602
driven_lanedir_mean12.514092587997352
driven_lanedir_median13.244289278462052
driven_lanedir_min6.987901081338952
get_duckie_state_max2.414558848969446e-06
get_duckie_state_mean2.054936957568142e-06
get_duckie_state_median2.1171808044281134e-06
get_duckie_state_min1.6616222045430737e-06
get_robot_state_max0.014300804551098369
get_robot_state_mean0.012601294551799888
get_robot_state_median0.013466643254822438
get_robot_state_min0.006329593378313047
get_state_dump_max0.009693506258314196
get_state_dump_mean0.008520606819078846
get_state_dump_median0.008789010091586275
get_state_dump_min0.005384637021470344
get_ui_image_max0.04342994463632347
get_ui_image_mean0.03878156592721666
get_ui_image_median0.04336506560085021
get_ui_image_min0.025426786673632313
in-drivable-lane_max9.499999999999968
in-drivable-lane_mean3.3749999999999423
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 14.5902730432591, "get_ui_image": 0.03622707717126851, "step_physics": 0.3054925079250415, "survival_time": 59.99999999999873, "driven_lanedir": 14.141441985241428, "get_state_dump": 0.00864728900614031, "get_robot_state": 0.013172286436222275, "sim_render-ego0": 0.003516741537432389, "sim_render-ego1": 0.003475773443687369, "sim_render-ego2": 0.0034482038388343574, "sim_render-ego3": 0.00338045961156078, "get_duckie_state": 1.8297285958194016e-06, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 8.910538068363719, "agent_compute-ego0": 0.038811368807269375, "agent_compute-ego1": 0.0384443088137637, "agent_compute-ego2": 0.03857007927938266, "agent_compute-ego3": 0.03877812599163071, "complete-iteration": 0.5742181810510844, "set_robot_commands": 0.0019900681672743417, "deviation-center-line": 2.733821751657914, "driven_lanedir_consec": 14.141441985241428, "sim_compute_sim_state": 0.02690810883273491, "sim_compute_performance-ego0": 0.0018857984519024672, "sim_compute_performance-ego1": 0.001821323993501814, "sim_compute_performance-ego2": 0.0017482293436271166, "sim_compute_performance-ego3": 0.0017418926899677313}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 14.590315637034868, "get_ui_image": 0.03622707717126851, "step_physics": 0.3054925079250415, "survival_time": 59.99999999999873, "driven_lanedir": 14.22893005474485, "get_state_dump": 0.00864728900614031, "get_robot_state": 0.013172286436222275, "sim_render-ego0": 0.003516741537432389, "sim_render-ego1": 0.003475773443687369, "sim_render-ego2": 0.0034482038388343574, "sim_render-ego3": 0.00338045961156078, "get_duckie_state": 1.8297285958194016e-06, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 8.144409722198054, "agent_compute-ego0": 0.038811368807269375, "agent_compute-ego1": 0.0384443088137637, "agent_compute-ego2": 0.03857007927938266, "agent_compute-ego3": 0.03877812599163071, "complete-iteration": 0.5742181810510844, "set_robot_commands": 0.0019900681672743417, "deviation-center-line": 2.55476947818271, "driven_lanedir_consec": 14.22893005474485, "sim_compute_sim_state": 0.02690810883273491, "sim_compute_performance-ego0": 0.0018857984519024672, "sim_compute_performance-ego1": 0.001821323993501814, "sim_compute_performance-ego2": 0.0017482293436271166, "sim_compute_performance-ego3": 0.0017418926899677313}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 14.590127640767218, "get_ui_image": 0.03622707717126851, "step_physics": 0.3054925079250415, "survival_time": 59.99999999999873, "driven_lanedir": 12.625761572714728, "get_state_dump": 0.00864728900614031, "get_robot_state": 0.013172286436222275, "sim_render-ego0": 0.003516741537432389, "sim_render-ego1": 0.003475773443687369, "sim_render-ego2": 0.0034482038388343574, "sim_render-ego3": 0.00338045961156078, "get_duckie_state": 1.8297285958194016e-06, "in-drivable-lane": 5.849999999999839, "deviation-heading": 11.342340466666103, "agent_compute-ego0": 0.038811368807269375, "agent_compute-ego1": 0.0384443088137637, "agent_compute-ego2": 0.03857007927938266, "agent_compute-ego3": 0.03877812599163071, "complete-iteration": 0.5742181810510844, "set_robot_commands": 0.0019900681672743417, "deviation-center-line": 2.5598726661459428, "driven_lanedir_consec": 12.625761572714728, "sim_compute_sim_state": 0.02690810883273491, "sim_compute_performance-ego0": 0.0018857984519024672, "sim_compute_performance-ego1": 0.001821323993501814, "sim_compute_performance-ego2": 0.0017482293436271166, "sim_compute_performance-ego3": 0.0017418926899677313}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 14.590320002142294, "get_ui_image": 0.03622707717126851, "step_physics": 0.3054925079250415, "survival_time": 59.99999999999873, "driven_lanedir": 14.240157955669602, "get_state_dump": 0.00864728900614031, "get_robot_state": 0.013172286436222275, "sim_render-ego0": 0.003516741537432389, "sim_render-ego1": 0.003475773443687369, "sim_render-ego2": 0.0034482038388343574, "sim_render-ego3": 0.00338045961156078, "get_duckie_state": 1.8297285958194016e-06, "in-drivable-lane": 0.4499999999999744, "deviation-heading": 7.700365314146502, "agent_compute-ego0": 0.038811368807269375, "agent_compute-ego1": 0.0384443088137637, "agent_compute-ego2": 0.03857007927938266, "agent_compute-ego3": 0.03877812599163071, "complete-iteration": 0.5742181810510844, "set_robot_commands": 0.0019900681672743417, "deviation-center-line": 2.5378176698404205, "driven_lanedir_consec": 14.240157955669602, "sim_compute_sim_state": 0.02690810883273491, "sim_compute_performance-ego0": 0.0018857984519024672, "sim_compute_performance-ego1": 0.001821323993501814, "sim_compute_performance-ego2": 0.0017482293436271166, "sim_compute_performance-ego3": 0.0017418926899677313}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 14.590144647585197, "get_ui_image": 0.04336506560085021, "step_physics": 0.43474072461124263, "survival_time": 59.99999999999873, "driven_lanedir": 13.258694451344738, "get_state_dump": 0.008789010091586275, "get_robot_state": 0.013466643254822438, "sim_render-ego0": 0.0035883574362698444, "sim_render-ego1": 0.003555331599404671, "sim_render-ego2": 0.0034987237630140573, "sim_render-ego3": 0.0034926179842984647, "get_duckie_state": 2.1171808044281134e-06, "in-drivable-lane": 2.7999999999999776, "deviation-heading": 13.120754353129335, "agent_compute-ego0": 0.03963584844317663, "agent_compute-ego1": 0.040881661749402255, "agent_compute-ego2": 0.04043443375681957, "agent_compute-ego3": 0.04052336487940805, "complete-iteration": 0.734565913528328, "set_robot_commands": 0.002043631551267702, "deviation-center-line": 3.2048200089630243, "driven_lanedir_consec": 13.258694451344738, "sim_compute_sim_state": 0.04275098768102438, "sim_compute_performance-ego0": 0.001983456766476342, "sim_compute_performance-ego1": 0.0018396433148157784, "sim_compute_performance-ego2": 0.001805966938663581, "sim_compute_performance-ego3": 0.0018014375812108077}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 14.590111097542447, "get_ui_image": 0.04336506560085021, "step_physics": 0.43474072461124263, "survival_time": 59.99999999999873, "driven_lanedir": 13.229884105579366, "get_state_dump": 0.008789010091586275, "get_robot_state": 0.013466643254822438, "sim_render-ego0": 0.0035883574362698444, "sim_render-ego1": 0.003555331599404671, "sim_render-ego2": 0.0034987237630140573, "sim_render-ego3": 0.0034926179842984647, "get_duckie_state": 2.1171808044281134e-06, "in-drivable-lane": 2.8999999999999195, "deviation-heading": 13.335821685212204, "agent_compute-ego0": 0.03963584844317663, "agent_compute-ego1": 0.040881661749402255, "agent_compute-ego2": 0.04043443375681957, "agent_compute-ego3": 0.04052336487940805, "complete-iteration": 0.734565913528328, "set_robot_commands": 0.002043631551267702, "deviation-center-line": 3.282022719765582, "driven_lanedir_consec": 13.229884105579366, "sim_compute_sim_state": 0.04275098768102438, "sim_compute_performance-ego0": 0.001983456766476342, "sim_compute_performance-ego1": 0.0018396433148157784, "sim_compute_performance-ego2": 0.001805966938663581, "sim_compute_performance-ego3": 0.0018014375812108077}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.590157614093332, "get_ui_image": 0.04336506560085021, "step_physics": 0.43474072461124263, "survival_time": 59.99999999999873, "driven_lanedir": 13.226162819960347, "get_state_dump": 0.008789010091586275, "get_robot_state": 0.013466643254822438, "sim_render-ego0": 0.0035883574362698444, "sim_render-ego1": 0.003555331599404671, "sim_render-ego2": 0.0034987237630140573, "sim_render-ego3": 0.0034926179842984647, "get_duckie_state": 2.1171808044281134e-06, "in-drivable-lane": 3.0999999999998913, "deviation-heading": 12.503919157748056, "agent_compute-ego0": 0.03963584844317663, "agent_compute-ego1": 0.040881661749402255, "agent_compute-ego2": 0.04043443375681957, "agent_compute-ego3": 0.04052336487940805, "complete-iteration": 0.734565913528328, "set_robot_commands": 0.002043631551267702, "deviation-center-line": 3.1046431577056612, "driven_lanedir_consec": 13.226162819960347, "sim_compute_sim_state": 0.04275098768102438, "sim_compute_performance-ego0": 0.001983456766476342, "sim_compute_performance-ego1": 0.0018396433148157784, "sim_compute_performance-ego2": 0.001805966938663581, "sim_compute_performance-ego3": 0.0018014375812108077}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 14.590136745179713, "get_ui_image": 0.04336506560085021, "step_physics": 0.43474072461124263, "survival_time": 59.99999999999873, "driven_lanedir": 11.589663841250047, "get_state_dump": 0.008789010091586275, "get_robot_state": 0.013466643254822438, "sim_render-ego0": 0.0035883574362698444, "sim_render-ego1": 0.003555331599404671, "sim_render-ego2": 0.0034987237630140573, "sim_render-ego3": 0.0034926179842984647, "get_duckie_state": 2.1171808044281134e-06, "in-drivable-lane": 9.499999999999968, "deviation-heading": 12.44061494097976, "agent_compute-ego0": 0.03963584844317663, "agent_compute-ego1": 0.040881661749402255, "agent_compute-ego2": 0.04043443375681957, "agent_compute-ego3": 0.04052336487940805, "complete-iteration": 0.734565913528328, "set_robot_commands": 0.002043631551267702, "deviation-center-line": 2.917440862836468, "driven_lanedir_consec": 10.226832988240714, "sim_compute_sim_state": 0.04275098768102438, "sim_compute_performance-ego0": 0.001983456766476342, "sim_compute_performance-ego1": 0.0018396433148157784, "sim_compute_performance-ego2": 0.001805966938663581, "sim_compute_performance-ego3": 0.0018014375812108077}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 14.590206502494386, "get_ui_image": 0.04342994463632347, "step_physics": 0.4271796555642184, "survival_time": 59.99999999999873, "driven_lanedir": 13.517497854581212, "get_state_dump": 0.009693506258314196, "get_robot_state": 0.014300804551098369, "sim_render-ego0": 0.0038003167145258185, "sim_render-ego1": 0.003764321266066323, "sim_render-ego2": 0.003727689770040266, "sim_render-ego3": 0.003707726333262422, "get_duckie_state": 2.414558848969446e-06, "in-drivable-lane": 2.1999999999999744, "deviation-heading": 11.279935707258588, "agent_compute-ego0": 0.04280074113215336, "agent_compute-ego1": 0.04465970151331105, "agent_compute-ego2": 0.044310664852691826, "agent_compute-ego3": 0.04454951937450755, "complete-iteration": 0.7447455040521169, "set_robot_commands": 0.002273552026677191, "deviation-center-line": 2.6897199215108163, "driven_lanedir_consec": 13.517497854581212, "sim_compute_sim_state": 0.04152280662974946, "sim_compute_performance-ego0": 0.002158097482343002, "sim_compute_performance-ego1": 0.0019694446624069785, "sim_compute_performance-ego2": 0.0019447454107889624, "sim_compute_performance-ego3": 0.0019523666661347477}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 14.59016984366639, "get_ui_image": 0.04342994463632347, "step_physics": 0.4271796555642184, "survival_time": 59.99999999999873, "driven_lanedir": 13.526076540391545, "get_state_dump": 0.009693506258314196, "get_robot_state": 0.014300804551098369, "sim_render-ego0": 0.0038003167145258185, "sim_render-ego1": 0.003764321266066323, "sim_render-ego2": 0.003727689770040266, "sim_render-ego3": 0.003707726333262422, "get_duckie_state": 2.414558848969446e-06, "in-drivable-lane": 1.5499999999999226, "deviation-heading": 13.13727829701193, "agent_compute-ego0": 0.04280074113215336, "agent_compute-ego1": 0.04465970151331105, "agent_compute-ego2": 0.044310664852691826, "agent_compute-ego3": 0.04454951937450755, "complete-iteration": 0.7447455040521169, "set_robot_commands": 0.002273552026677191, "deviation-center-line": 3.299444983280622, "driven_lanedir_consec": 13.526076540391545, "sim_compute_sim_state": 0.04152280662974946, "sim_compute_performance-ego0": 0.002158097482343002, "sim_compute_performance-ego1": 0.0019694446624069785, "sim_compute_performance-ego2": 0.0019447454107889624, "sim_compute_performance-ego3": 0.0019523666661347477}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 14.590082601501043, "get_ui_image": 0.04342994463632347, "step_physics": 0.4271796555642184, "survival_time": 59.99999999999873, "driven_lanedir": 11.878561574193691, "get_state_dump": 0.009693506258314196, "get_robot_state": 0.014300804551098369, "sim_render-ego0": 0.0038003167145258185, "sim_render-ego1": 0.003764321266066323, "sim_render-ego2": 0.003727689770040266, "sim_render-ego3": 0.003707726333262422, "get_duckie_state": 2.414558848969446e-06, "in-drivable-lane": 7.6499999999998, "deviation-heading": 14.319529764639462, "agent_compute-ego0": 0.04280074113215336, "agent_compute-ego1": 0.04465970151331105, "agent_compute-ego2": 0.044310664852691826, "agent_compute-ego3": 0.04454951937450755, "complete-iteration": 0.7447455040521169, "set_robot_commands": 0.002273552026677191, "deviation-center-line": 3.0937875330855116, "driven_lanedir_consec": 11.878561574193691, "sim_compute_sim_state": 0.04152280662974946, "sim_compute_performance-ego0": 0.002158097482343002, "sim_compute_performance-ego1": 0.0019694446624069785, "sim_compute_performance-ego2": 0.0019447454107889624, "sim_compute_performance-ego3": 0.0019523666661347477}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 14.590176137778675, "get_ui_image": 0.04342994463632347, "step_physics": 0.4271796555642184, "survival_time": 59.99999999999873, "driven_lanedir": 13.568402421526724, "get_state_dump": 0.009693506258314196, "get_robot_state": 0.014300804551098369, "sim_render-ego0": 0.0038003167145258185, "sim_render-ego1": 0.003764321266066323, "sim_render-ego2": 0.003727689770040266, "sim_render-ego3": 0.003707726333262422, "get_duckie_state": 2.414558848969446e-06, "in-drivable-lane": 2.149999999999981, "deviation-heading": 10.885772063859266, "agent_compute-ego0": 0.04280074113215336, "agent_compute-ego1": 0.04465970151331105, "agent_compute-ego2": 0.044310664852691826, "agent_compute-ego3": 0.04454951937450755, "complete-iteration": 0.7447455040521169, "set_robot_commands": 0.002273552026677191, "deviation-center-line": 2.8363825145163872, "driven_lanedir_consec": 13.568402421526724, "sim_compute_sim_state": 0.04152280662974946, "sim_compute_performance-ego0": 0.002158097482343002, "sim_compute_performance-ego1": 0.0019694446624069785, "sim_compute_performance-ego2": 0.0019447454107889624, "sim_compute_performance-ego3": 0.0019523666661347477}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 9.307800155063164, "get_ui_image": 0.025426786673632313, "step_physics": 0.15333890184132076, "survival_time": 39.09999999999992, "driven_lanedir": 9.178159973425672, "get_state_dump": 0.005384637021470344, "get_robot_state": 0.006329593378313047, "sim_render-ego0": 0.003295522996749001, "sim_render-ego1": 0.0032774981867764643, "get_duckie_state": 1.6616222045430737e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.458199613473701, "agent_compute-ego0": 0.03840351835521245, "agent_compute-ego1": 0.03814038767516233, "complete-iteration": 0.2895664209607004, "set_robot_commands": 0.0018350109743432523, "deviation-center-line": 1.6753504117871665, "driven_lanedir_consec": 9.178159973425672, "sim_compute_sim_state": 0.008795502846572895, "sim_compute_performance-ego0": 0.001675008052762593, "sim_compute_performance-ego1": 0.001653117695073972}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 9.307535393842445, "get_ui_image": 0.025426786673632313, "step_physics": 0.15333890184132076, "survival_time": 39.09999999999992, "driven_lanedir": 6.987901081338952, "get_state_dump": 0.005384637021470344, "get_robot_state": 0.006329593378313047, "sim_render-ego0": 0.003295522996749001, "sim_render-ego1": 0.0032774981867764643, "get_duckie_state": 1.6616222045430737e-06, "in-drivable-lane": 8.099999999999937, "deviation-heading": 10.044146648747548, "agent_compute-ego0": 0.03840351835521245, "agent_compute-ego1": 0.03814038767516233, "complete-iteration": 0.2895664209607004, "set_robot_commands": 0.0018350109743432523, "deviation-center-line": 2.548565550786516, "driven_lanedir_consec": 6.987901081338952, "sim_compute_sim_state": 0.008795502846572895, "sim_compute_performance-ego0": 0.001675008052762593, "sim_compute_performance-ego1": 0.001653117695073972}}
set_robot_commands_max0.002273552026677191
set_robot_commands_mean0.0020642163521116747
set_robot_commands_median0.002043631551267702
set_robot_commands_min0.0018350109743432523
sim_compute_performance-ego0_max0.002158097482343002
sim_compute_performance-ego0_mean0.0019613876363151735
sim_compute_performance-ego0_median0.001983456766476342
sim_compute_performance-ego0_min0.001675008052762593
sim_compute_performance-ego1_max0.0019694446624069785
sim_compute_performance-ego1_mean0.001844848805217588
sim_compute_performance-ego1_median0.0018396433148157784
sim_compute_performance-ego1_min0.001653117695073972
sim_compute_sim_state_max0.04275098768102438
sim_compute_sim_state_mean0.03302275844765577
sim_compute_sim_state_median0.04152280662974946
sim_compute_sim_state_min0.008795502846572895
sim_render-ego0_max0.0038003167145258185
sim_render-ego0_mean0.003586622053315014
sim_render-ego0_median0.0035883574362698444
sim_render-ego0_min0.003295522996749001
sim_render-ego1_max0.003764321266066323
sim_render-ego1_mean0.003552621543584741
sim_render-ego1_median0.003555331599404671
sim_render-ego1_min0.0032774981867764643
simulation-passed1
step_physics_max0.43474072461124263
step_physics_mean0.35545209686318946
step_physics_median0.4271796555642184
step_physics_min0.15333890184132076
survival_time_max59.99999999999873
survival_time_mean57.01428571428461
survival_time_min39.09999999999992
No reset possible
55029LFVmultibodyv-simsuccessyes1:37:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55025LFVmultibodyv-simsuccessyes1:35:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55017LFVmultibodyv-simsuccessyes1:40:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55003LFVmultibodyv-simsuccessyes1:37:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible