Duckietown Challenges Home Challenges Submissions

Submission 13064

Submission13064
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserAyman Shams 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60337
Next
User labelreal-exercise-2
Admin priority50
Blessingn/a
User priority50

60337

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60337LFVmultibodyv-simsuccessyes0:56:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6159823161170095
survival_time_median27.20000000000025
deviation-center-line_median0.4334305115607264
in-drivable-lane_median21.725000000000264


other stats
agent_compute-ego0_max0.01185155562564904
agent_compute-ego0_mean0.01109417915162682
agent_compute-ego0_median0.011002636467164068
agent_compute-ego0_min0.010488877602673452
agent_compute-ego1_max0.011524915055998527
agent_compute-ego1_mean0.011256482132541145
agent_compute-ego1_median0.01146117044151376
agent_compute-ego1_min0.010817084244583742
complete-iteration_max1.2687391947959712
complete-iteration_mean0.9996622699307378
complete-iteration_median1.0974267080289508
complete-iteration_min0.3622772588834658
deviation-center-line_max0.7703242993996497
deviation-center-line_mean0.47022895311547097
deviation-center-line_min0.1539497893664548
deviation-heading_max3.3337862630861927
deviation-heading_mean2.0048059722450673
deviation-heading_median2.38245594154103
deviation-heading_min0.6990342654374911
driven_any_max4.987002030365986
driven_any_mean2.0370420021921944
driven_any_median1.67760305302765
driven_any_min0.8112508621974219
driven_lanedir_consec_max0.8869518370293116
driven_lanedir_consec_mean0.5762324610131679
driven_lanedir_consec_min0.1893515937569612
driven_lanedir_max0.8869518370293116
driven_lanedir_mean0.5762324610131679
driven_lanedir_median0.6159823161170095
driven_lanedir_min0.1893515937569612
get_duckie_state_max1.4209235960932264e-06
get_duckie_state_mean1.2973043815885797e-06
get_duckie_state_median1.22577772227996e-06
get_duckie_state_min1.1930181940036789e-06
get_robot_state_max0.014206209387280668
get_robot_state_mean0.012390610385704003
get_robot_state_median0.012828759049073844
get_robot_state_min0.007052860853872893
get_state_dump_max0.008738421882445307
get_state_dump_mean0.008081235679870137
get_state_dump_median0.008322152869359025
get_state_dump_min0.005930456923041152
get_ui_image_max0.042620702671973855
get_ui_image_mean0.03859647752748461
get_ui_image_median0.041784568226665535
get_ui_image_min0.02691503671499399
in-drivable-lane_max32.64999999999996
in-drivable-lane_mean20.77500000000011
in-drivable-lane_min9.000000000000068
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.6809224114058263, "get_ui_image": 0.037224882090059745, "step_physics": 0.7925935008890188, "survival_time": 18.60000000000013, "driven_lanedir": 0.8000444076112045, "get_state_dump": 0.008738421882445307, "get_robot_state": 0.014206209387280668, "sim_render-ego0": 0.0034964033489892055, "sim_render-ego1": 0.003782807342488389, "sim_render-ego2": 0.003608604538536583, "sim_render-ego3": 0.003754132554614193, "get_duckie_state": 1.4209235960932264e-06, "in-drivable-lane": 11.550000000000146, "deviation-heading": 2.6806652135313183, "agent_compute-ego0": 0.011002636467164068, "agent_compute-ego1": 0.011524915055998527, "agent_compute-ego2": 0.011733229614135088, "agent_compute-ego3": 0.01220438883068095, "complete-iteration": 0.9515134124909266, "set_robot_commands": 0.0020058468263845983, "deviation-center-line": 0.6722867594017995, "driven_lanedir_consec": 0.8000444076112045, "sim_compute_sim_state": 0.022717959120190496, "sim_compute_performance-ego0": 0.0018770701124585024, "sim_compute_performance-ego1": 0.0017325373181708696, "sim_compute_performance-ego2": 0.0016442278435019322, "sim_compute_performance-ego3": 0.0016841568831783835}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.9863032595362533, "get_ui_image": 0.037224882090059745, "step_physics": 0.7925935008890188, "survival_time": 18.60000000000013, "driven_lanedir": 0.3226614222997488, "get_state_dump": 0.008738421882445307, "get_robot_state": 0.014206209387280668, "sim_render-ego0": 0.0034964033489892055, "sim_render-ego1": 0.003782807342488389, "sim_render-ego2": 0.003608604538536583, "sim_render-ego3": 0.003754132554614193, "get_duckie_state": 1.4209235960932264e-06, "in-drivable-lane": 14.500000000000105, "deviation-heading": 2.9248469790780702, "agent_compute-ego0": 0.011002636467164068, "agent_compute-ego1": 0.011524915055998527, "agent_compute-ego2": 0.011733229614135088, "agent_compute-ego3": 0.01220438883068095, "complete-iteration": 0.9515134124909266, "set_robot_commands": 0.0020058468263845983, "deviation-center-line": 0.42945973080891775, "driven_lanedir_consec": 0.3226614222997488, "sim_compute_sim_state": 0.022717959120190496, "sim_compute_performance-ego0": 0.0018770701124585024, "sim_compute_performance-ego1": 0.0017325373181708696, "sim_compute_performance-ego2": 0.0016442278435019322, "sim_compute_performance-ego3": 0.0016841568831783835}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.3315163933112952, "get_ui_image": 0.037224882090059745, "step_physics": 0.7925935008890188, "survival_time": 18.60000000000013, "driven_lanedir": 0.42652634664716427, "get_state_dump": 0.008738421882445307, "get_robot_state": 0.014206209387280668, "sim_render-ego0": 0.0034964033489892055, "sim_render-ego1": 0.003782807342488389, "sim_render-ego2": 0.003608604538536583, "sim_render-ego3": 0.003754132554614193, "get_duckie_state": 1.4209235960932264e-06, "in-drivable-lane": 14.900000000000134, "deviation-heading": 1.1005490667361884, "agent_compute-ego0": 0.011002636467164068, "agent_compute-ego1": 0.011524915055998527, "agent_compute-ego2": 0.011733229614135088, "agent_compute-ego3": 0.01220438883068095, "complete-iteration": 0.9515134124909266, "set_robot_commands": 0.0020058468263845983, "deviation-center-line": 0.28646499164467637, "driven_lanedir_consec": 0.42652634664716427, "sim_compute_sim_state": 0.022717959120190496, "sim_compute_performance-ego0": 0.0018770701124585024, "sim_compute_performance-ego1": 0.0017325373181708696, "sim_compute_performance-ego2": 0.0016442278435019322, "sim_compute_performance-ego3": 0.0016841568831783835}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.1830188531238297, "get_ui_image": 0.037224882090059745, "step_physics": 0.7925935008890188, "survival_time": 18.60000000000013, "driven_lanedir": 0.8869518370293116, "get_state_dump": 0.008738421882445307, "get_robot_state": 0.014206209387280668, "sim_render-ego0": 0.0034964033489892055, "sim_render-ego1": 0.003782807342488389, "sim_render-ego2": 0.003608604538536583, "sim_render-ego3": 0.003754132554614193, "get_duckie_state": 1.4209235960932264e-06, "in-drivable-lane": 11.00000000000015, "deviation-heading": 2.5154540794802576, "agent_compute-ego0": 0.011002636467164068, "agent_compute-ego1": 0.011524915055998527, "agent_compute-ego2": 0.011733229614135088, "agent_compute-ego3": 0.01220438883068095, "complete-iteration": 0.9515134124909266, "set_robot_commands": 0.0020058468263845983, "deviation-center-line": 0.5981447797351478, "driven_lanedir_consec": 0.8869518370293116, "sim_compute_sim_state": 0.022717959120190496, "sim_compute_performance-ego0": 0.0018770701124585024, "sim_compute_performance-ego1": 0.0017325373181708696, "sim_compute_performance-ego2": 0.0016442278435019322, "sim_compute_performance-ego3": 0.0016841568831783835}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.315793135382431, "get_ui_image": 0.042620702671973855, "step_physics": 1.1098978824788202, "survival_time": 38.599999999999945, "driven_lanedir": 0.6368216939293483, "get_state_dump": 0.008322152869359025, "get_robot_state": 0.012828759049073844, "sim_render-ego0": 0.003439560590401042, "sim_render-ego1": 0.003544484504906974, "sim_render-ego2": 0.0035350433759208178, "sim_render-ego3": 0.003691882704701492, "get_duckie_state": 1.1930181940036789e-06, "in-drivable-lane": 32.64999999999996, "deviation-heading": 2.7857199684524874, "agent_compute-ego0": 0.01185155562564904, "agent_compute-ego1": 0.010817084244583742, "agent_compute-ego2": 0.010894586938164676, "agent_compute-ego3": 0.011784495542459625, "complete-iteration": 1.2687391947959712, "set_robot_commands": 0.0019949719329083876, "deviation-center-line": 0.5540777145286429, "driven_lanedir_consec": 0.6368216939293483, "sim_compute_sim_state": 0.020861500139224113, "sim_compute_performance-ego0": 0.0017918809419461704, "sim_compute_performance-ego1": 0.001630542811878594, "sim_compute_performance-ego2": 0.0016202389962614585, "sim_compute_performance-ego3": 0.0016958608664331277}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.987002030365986, "get_ui_image": 0.042620702671973855, "step_physics": 1.1098978824788202, "survival_time": 38.599999999999945, "driven_lanedir": 0.6460457051611788, "get_state_dump": 0.008322152869359025, "get_robot_state": 0.012828759049073844, "sim_render-ego0": 0.003439560590401042, "sim_render-ego1": 0.003544484504906974, "sim_render-ego2": 0.0035350433759208178, "sim_render-ego3": 0.003691882704701492, "get_duckie_state": 1.1930181940036789e-06, "in-drivable-lane": 32.299999999999876, "deviation-heading": 3.3337862630861927, "agent_compute-ego0": 0.01185155562564904, "agent_compute-ego1": 0.010817084244583742, "agent_compute-ego2": 0.010894586938164676, "agent_compute-ego3": 0.011784495542459625, "complete-iteration": 1.2687391947959712, "set_robot_commands": 0.0019949719329083876, "deviation-center-line": 0.7527317046762384, "driven_lanedir_consec": 0.6460457051611788, "sim_compute_sim_state": 0.020861500139224113, "sim_compute_performance-ego0": 0.0017918809419461704, "sim_compute_performance-ego1": 0.001630542811878594, "sim_compute_performance-ego2": 0.0016202389962614585, "sim_compute_performance-ego3": 0.0016958608664331277}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.8867225479577487, "get_ui_image": 0.042620702671973855, "step_physics": 1.1098978824788202, "survival_time": 38.599999999999945, "driven_lanedir": 0.8793985505703721, "get_state_dump": 0.008322152869359025, "get_robot_state": 0.012828759049073844, "sim_render-ego0": 0.003439560590401042, "sim_render-ego1": 0.003544484504906974, "sim_render-ego2": 0.0035350433759208178, "sim_render-ego3": 0.003691882704701492, "get_duckie_state": 1.1930181940036789e-06, "in-drivable-lane": 30.999999999999964, "deviation-heading": 2.54346259041514, "agent_compute-ego0": 0.01185155562564904, "agent_compute-ego1": 0.010817084244583742, "agent_compute-ego2": 0.010894586938164676, "agent_compute-ego3": 0.011784495542459625, "complete-iteration": 1.2687391947959712, "set_robot_commands": 0.0019949719329083876, "deviation-center-line": 0.7703242993996497, "driven_lanedir_consec": 0.8793985505703721, "sim_compute_sim_state": 0.020861500139224113, "sim_compute_performance-ego0": 0.0017918809419461704, "sim_compute_performance-ego1": 0.001630542811878594, "sim_compute_performance-ego2": 0.0016202389962614585, "sim_compute_performance-ego3": 0.0016958608664331277}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.315793135829556, "get_ui_image": 0.042620702671973855, "step_physics": 1.1098978824788202, "survival_time": 38.599999999999945, "driven_lanedir": 0.6297085691659969, "get_state_dump": 0.008322152869359025, "get_robot_state": 0.012828759049073844, "sim_render-ego0": 0.003439560590401042, "sim_render-ego1": 0.003544484504906974, "sim_render-ego2": 0.0035350433759208178, "sim_render-ego3": 0.003691882704701492, "get_duckie_state": 1.1930181940036789e-06, "in-drivable-lane": 32.64999999999996, "deviation-heading": 2.2494578036018007, "agent_compute-ego0": 0.01185155562564904, "agent_compute-ego1": 0.010817084244583742, "agent_compute-ego2": 0.010894586938164676, "agent_compute-ego3": 0.011784495542459625, "complete-iteration": 1.2687391947959712, "set_robot_commands": 0.0019949719329083876, "deviation-center-line": 0.5662381529974343, "driven_lanedir_consec": 0.6297085691659969, "sim_compute_sim_state": 0.020861500139224113, "sim_compute_performance-ego0": 0.0017918809419461704, "sim_compute_performance-ego1": 0.001630542811878594, "sim_compute_performance-ego2": 0.0016202389962614585, "sim_compute_performance-ego3": 0.0016958608664331277}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8112508621974219, "get_ui_image": 0.041784568226665535, "step_physics": 0.941810355492688, "survival_time": 27.20000000000025, "driven_lanedir": 0.1893515937569612, "get_state_dump": 0.00825852166622057, "get_robot_state": 0.012805737486673055, "sim_render-ego0": 0.003405758219027738, "sim_render-ego1": 0.003664731979370117, "sim_render-ego2": 0.0035738288809400087, "sim_render-ego3": 0.003515836295731571, "get_duckie_state": 1.22577772227996e-06, "in-drivable-lane": 25.05000000000025, "deviation-heading": 1.3462294997893187, "agent_compute-ego0": 0.010488877602673452, "agent_compute-ego1": 0.01146117044151376, "agent_compute-ego2": 0.01116919211291392, "agent_compute-ego3": 0.010281307325450652, "complete-iteration": 1.0974267080289508, "set_robot_commands": 0.001933563739881603, "deviation-center-line": 0.1539497893664548, "driven_lanedir_consec": 0.1893515937569612, "sim_compute_sim_state": 0.02073794111199335, "sim_compute_performance-ego0": 0.001772240979955831, "sim_compute_performance-ego1": 0.001634689646029691, "sim_compute_performance-ego2": 0.0016276779524776917, "sim_compute_performance-ego3": 0.0016652759062040837}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.902445802118091, "get_ui_image": 0.041784568226665535, "step_physics": 0.941810355492688, "survival_time": 27.20000000000025, "driven_lanedir": 0.7141180881562581, "get_state_dump": 0.00825852166622057, "get_robot_state": 0.012805737486673055, "sim_render-ego0": 0.003405758219027738, "sim_render-ego1": 0.003664731979370117, "sim_render-ego2": 0.0035738288809400087, "sim_render-ego3": 0.003515836295731571, "get_duckie_state": 1.22577772227996e-06, "in-drivable-lane": 21.300000000000264, "deviation-heading": 0.8662248720020801, "agent_compute-ego0": 0.010488877602673452, "agent_compute-ego1": 0.01146117044151376, "agent_compute-ego2": 0.01116919211291392, "agent_compute-ego3": 0.010281307325450652, "complete-iteration": 1.0974267080289508, "set_robot_commands": 0.001933563739881603, "deviation-center-line": 0.24866538745971212, "driven_lanedir_consec": 0.7141180881562581, "sim_compute_sim_state": 0.02073794111199335, "sim_compute_performance-ego0": 0.001772240979955831, "sim_compute_performance-ego1": 0.001634689646029691, "sim_compute_performance-ego2": 0.0016276779524776917, "sim_compute_performance-ego3": 0.0016652759062040837}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.466736499840758, "get_ui_image": 0.041784568226665535, "step_physics": 0.941810355492688, "survival_time": 27.20000000000025, "driven_lanedir": 0.3979839924255508, "get_state_dump": 0.00825852166622057, "get_robot_state": 0.012805737486673055, "sim_render-ego0": 0.003405758219027738, "sim_render-ego1": 0.003664731979370117, "sim_render-ego2": 0.0035738288809400087, "sim_render-ego3": 0.003515836295731571, "get_duckie_state": 1.22577772227996e-06, "in-drivable-lane": 23.750000000000256, "deviation-heading": 0.6990342654374911, "agent_compute-ego0": 0.010488877602673452, "agent_compute-ego1": 0.01146117044151376, "agent_compute-ego2": 0.01116919211291392, "agent_compute-ego3": 0.010281307325450652, "complete-iteration": 1.0974267080289508, "set_robot_commands": 0.001933563739881603, "deviation-center-line": 0.3838834081940501, "driven_lanedir_consec": 0.3979839924255508, "sim_compute_sim_state": 0.02073794111199335, "sim_compute_performance-ego0": 0.001772240979955831, "sim_compute_performance-ego1": 0.001634689646029691, "sim_compute_performance-ego2": 0.0016276779524776917, "sim_compute_performance-ego3": 0.0016652759062040837}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.6742836946494737, "get_ui_image": 0.041784568226665535, "step_physics": 0.941810355492688, "survival_time": 27.20000000000025, "driven_lanedir": 0.602256063068022, "get_state_dump": 0.00825852166622057, "get_robot_state": 0.012805737486673055, "sim_render-ego0": 0.003405758219027738, "sim_render-ego1": 0.003664731979370117, "sim_render-ego2": 0.0035738288809400087, "sim_render-ego3": 0.003515836295731571, "get_duckie_state": 1.22577772227996e-06, "in-drivable-lane": 22.15000000000026, "deviation-heading": 1.1086578158262552, "agent_compute-ego0": 0.010488877602673452, "agent_compute-ego1": 0.01146117044151376, "agent_compute-ego2": 0.01116919211291392, "agent_compute-ego3": 0.010281307325450652, "complete-iteration": 1.0974267080289508, "set_robot_commands": 0.001933563739881603, "deviation-center-line": 0.3285012478804115, "driven_lanedir_consec": 0.602256063068022, "sim_compute_sim_state": 0.02073794111199335, "sim_compute_performance-ego0": 0.001772240979955831, "sim_compute_performance-ego1": 0.001634689646029691, "sim_compute_performance-ego2": 0.0016276779524776917, "sim_compute_performance-ego3": 0.0016652759062040837}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.6676449836977776, "get_ui_image": 0.02691503671499399, "step_physics": 0.2782688219468672, "survival_time": 13.600000000000058, "driven_lanedir": 0.5491027625932092, "get_state_dump": 0.005930456923041152, "get_robot_state": 0.007052860853872893, "sim_render-ego0": 0.0035238685188712653, "sim_render-ego1": 0.0037211585830856154, "get_duckie_state": 1.401691646366329e-06, "in-drivable-lane": 9.050000000000066, "deviation-heading": 0.8409724712897904, "agent_compute-ego0": 0.010973114670414627, "agent_compute-ego1": 0.011189035443595912, "complete-iteration": 0.3622772588834658, "set_robot_commands": 0.001889233187441424, "deviation-center-line": 0.40107608521092286, "driven_lanedir_consec": 0.5491027625932092, "sim_compute_sim_state": 0.007264468259427137, "sim_compute_performance-ego0": 0.0017985013815072866, "sim_compute_performance-ego1": 0.0017194922590430405}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.3091544212742745, "get_ui_image": 0.02691503671499399, "step_physics": 0.2782688219468672, "survival_time": 13.600000000000058, "driven_lanedir": 0.3862834217700226, "get_state_dump": 0.005930456923041152, "get_robot_state": 0.007052860853872893, "sim_render-ego0": 0.0035238685188712653, "sim_render-ego1": 0.0037211585830856154, "get_duckie_state": 1.401691646366329e-06, "in-drivable-lane": 9.000000000000068, "deviation-heading": 3.072222722704548, "agent_compute-ego0": 0.010973114670414627, "agent_compute-ego1": 0.011189035443595912, "complete-iteration": 0.3622772588834658, "set_robot_commands": 0.001889233187441424, "deviation-center-line": 0.4374012923125352, "driven_lanedir_consec": 0.3862834217700226, "sim_compute_sim_state": 0.007264468259427137, "sim_compute_performance-ego0": 0.0017985013815072866, "sim_compute_performance-ego1": 0.0017194922590430405}}
set_robot_commands_max0.0020058468263845983
set_robot_commands_mean0.0019654283122558
set_robot_commands_median0.0019949719329083876
set_robot_commands_min0.001889233187441424
sim_compute_performance-ego0_max0.0018770701124585024
sim_compute_performance-ego0_mean0.0018115550643183272
sim_compute_performance-ego0_median0.0017918809419461704
sim_compute_performance-ego0_min0.001772240979955831
sim_compute_performance-ego1_max0.0017325373181708696
sim_compute_performance-ego1_mean0.0016735759730287642
sim_compute_performance-ego1_median0.001634689646029691
sim_compute_performance-ego1_min0.001630542811878594
sim_compute_sim_state_max0.022717959120190496
sim_compute_sim_state_mean0.019414181286034723
sim_compute_sim_state_median0.020861500139224113
sim_compute_sim_state_min0.007264468259427137
sim_render-ego0_max0.0035238685188712653
sim_render-ego0_mean0.0034581875479581764
sim_render-ego0_median0.003439560590401042
sim_render-ego0_min0.003405758219027738
sim_render-ego1_max0.003782807342488389
sim_render-ego1_mean0.0036721723195166545
sim_render-ego1_median0.003664731979370117
sim_render-ego1_min0.003544484504906974
simulation-passed1
step_physics_max1.1098978824788202
step_physics_mean0.8524103285239889
step_physics_median0.941810355492688
step_physics_min0.2782688219468672
survival_time_max38.599999999999945
survival_time_mean26.057142857142964
survival_time_min13.600000000000058
No reset possible