Duckietown Challenges Home Challenges Submissions

Submission 12743

Submission12743
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserThomas Wiggers 🇳🇱
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58781
Next
User labelppo_v1
Admin priority50
Blessingn/a
User priority50

58781

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
58781LFVmultibodyv-simsuccessyes1:42:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7491156901518217
survival_time_median39.449999999999896
deviation-center-line_median0.8960956005557277
in-drivable-lane_median10.650000000000151


other stats
agent_compute-ego0_max0.12278539215297524
agent_compute-ego0_mean0.10240486049894812
agent_compute-ego0_median0.12104851332577792
agent_compute-ego0_min0.06244896571900227
agent_compute-ego1_max0.1098143691366369
agent_compute-ego1_mean0.08709341366990231
agent_compute-ego1_median0.10448226087000052
agent_compute-ego1_min0.048425019928855166
complete-iteration_max1.638804584220486
complete-iteration_mean1.1302340827692994
complete-iteration_median1.2036432840607385
complete-iteration_min0.31229825381136855
deviation-center-line_max8.796106473823361
deviation-center-line_mean1.6756680454865482
deviation-center-line_min0.24483774931298496
deviation-heading_max58.96659180193302
deviation-heading_mean8.406703212259545
deviation-heading_median2.922721038446036
deviation-heading_min0.9724363906685346
driven_any_max8.122975368545765
driven_any_mean4.025435936177793
driven_any_median3.3373557622593766
driven_any_min1.384968791323554
driven_lanedir_consec_max8.078717944796239
driven_lanedir_consec_mean3.0927309783791403
driven_lanedir_consec_min0.7621630419939149
driven_lanedir_max8.078717944796239
driven_lanedir_mean3.2177574060115246
driven_lanedir_median2.7491156901518217
driven_lanedir_min0.7621630419939149
get_duckie_state_max1.699501628383411e-06
get_duckie_state_mean1.6107471466434662e-06
get_duckie_state_median1.6444846044612837e-06
get_duckie_state_min1.3729416262001717e-06
get_robot_state_max0.016299285130067304
get_robot_state_mean0.014560975733224886
get_robot_state_median0.01602197169860535
get_robot_state_min0.0071959956103220864
get_state_dump_max0.01062485088001598
get_state_dump_mean0.009672268659544929
get_state_dump_median0.010226013459929024
get_state_dump_min0.006172278441556983
get_ui_image_max0.05741012860694396
get_ui_image_mean0.04891119437407383
get_ui_image_median0.055140233581716366
get_ui_image_min0.02943315097037005
in-drivable-lane_max53.599999999998744
in-drivable-lane_mean12.774999999999862
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 4.422615861090419, "get_ui_image": 0.04392224263541306, "step_physics": 0.5631245006488849, "survival_time": 39.449999999999896, "driven_lanedir": 3.209785288833963, "get_state_dump": 0.009915936747683754, "get_robot_state": 0.015044160432453395, "sim_render-ego0": 0.003998038134997404, "sim_render-ego1": 0.003815651845328415, "sim_render-ego2": 0.003779975070229059, "sim_render-ego3": 0.0037223254578023016, "get_duckie_state": 1.6444846044612837e-06, "in-drivable-lane": 16.2499999999997, "deviation-heading": 3.0414895270380513, "agent_compute-ego0": 0.08335862340806406, "agent_compute-ego1": 0.06631780787359311, "agent_compute-ego2": 0.06140965147863461, "agent_compute-ego3": 0.05850374547741081, "complete-iteration": 0.9572222945056384, "set_robot_commands": 0.002197786222530317, "deviation-center-line": 0.9175361336833738, "driven_lanedir_consec": 3.209785288833963, "sim_compute_sim_state": 0.022572899166541763, "sim_compute_performance-ego0": 0.0021572592892224276, "sim_compute_performance-ego1": 0.00201096444190303, "sim_compute_performance-ego2": 0.0020302292666857756, "sim_compute_performance-ego3": 0.002009467535381076}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.863975570493555, "get_ui_image": 0.04392224263541306, "step_physics": 0.5631245006488849, "survival_time": 39.449999999999896, "driven_lanedir": 2.853864423971562, "get_state_dump": 0.009915936747683754, "get_robot_state": 0.015044160432453395, "sim_render-ego0": 0.003998038134997404, "sim_render-ego1": 0.003815651845328415, "sim_render-ego2": 0.003779975070229059, "sim_render-ego3": 0.0037223254578023016, "get_duckie_state": 1.6444846044612837e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.699511208393638, "agent_compute-ego0": 0.08335862340806406, "agent_compute-ego1": 0.06631780787359311, "agent_compute-ego2": 0.06140965147863461, "agent_compute-ego3": 0.05850374547741081, "complete-iteration": 0.9572222945056384, "set_robot_commands": 0.002197786222530317, "deviation-center-line": 0.8746550674280816, "driven_lanedir_consec": 2.853864423971562, "sim_compute_sim_state": 0.022572899166541763, "sim_compute_performance-ego0": 0.0021572592892224276, "sim_compute_performance-ego1": 0.00201096444190303, "sim_compute_performance-ego2": 0.0020302292666857756, "sim_compute_performance-ego3": 0.002009467535381076}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.6091208920498885, "get_ui_image": 0.04392224263541306, "step_physics": 0.5631245006488849, "survival_time": 39.449999999999896, "driven_lanedir": 1.2901537917122912, "get_state_dump": 0.009915936747683754, "get_robot_state": 0.015044160432453395, "sim_render-ego0": 0.003998038134997404, "sim_render-ego1": 0.003815651845328415, "sim_render-ego2": 0.003779975070229059, "sim_render-ego3": 0.0037223254578023016, "get_duckie_state": 1.6444846044612837e-06, "in-drivable-lane": 31.44999999999992, "deviation-heading": 1.457760299758182, "agent_compute-ego0": 0.08335862340806406, "agent_compute-ego1": 0.06631780787359311, "agent_compute-ego2": 0.06140965147863461, "agent_compute-ego3": 0.05850374547741081, "complete-iteration": 0.9572222945056384, "set_robot_commands": 0.002197786222530317, "deviation-center-line": 0.24483774931298496, "driven_lanedir_consec": 1.2901537917122912, "sim_compute_sim_state": 0.022572899166541763, "sim_compute_performance-ego0": 0.0021572592892224276, "sim_compute_performance-ego1": 0.00201096444190303, "sim_compute_performance-ego2": 0.0020302292666857756, "sim_compute_performance-ego3": 0.002009467535381076}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 6.454611530063694, "get_ui_image": 0.04392224263541306, "step_physics": 0.5631245006488849, "survival_time": 39.449999999999896, "driven_lanedir": 6.425434072112547, "get_state_dump": 0.009915936747683754, "get_robot_state": 0.015044160432453395, "sim_render-ego0": 0.003998038134997404, "sim_render-ego1": 0.003815651845328415, "sim_render-ego2": 0.003779975070229059, "sim_render-ego3": 0.0037223254578023016, "get_duckie_state": 1.6444846044612837e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.654384697424287, "agent_compute-ego0": 0.08335862340806406, "agent_compute-ego1": 0.06631780787359311, "agent_compute-ego2": 0.06140965147863461, "agent_compute-ego3": 0.05850374547741081, "complete-iteration": 0.9572222945056384, "set_robot_commands": 0.002197786222530317, "deviation-center-line": 1.2684194916489198, "driven_lanedir_consec": 6.425434072112547, "sim_compute_sim_state": 0.022572899166541763, "sim_compute_performance-ego0": 0.0021572592892224276, "sim_compute_performance-ego1": 0.00201096444190303, "sim_compute_performance-ego2": 0.0020302292666857756, "sim_compute_performance-ego3": 0.002009467535381076}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.384968791323554, "get_ui_image": 0.05741012860694396, "step_physics": 1.0697397016466508, "survival_time": 59.99999999999873, "driven_lanedir": 1.33346205541883, "get_state_dump": 0.010226013459929024, "get_robot_state": 0.01602197169860535, "sim_render-ego0": 0.004265157705937496, "sim_render-ego1": 0.0039961419435067536, "sim_render-ego2": 0.00397654377749123, "sim_render-ego3": 0.0039055792120076737, "get_duckie_state": 1.699501628383411e-06, "in-drivable-lane": 0.0, "deviation-heading": 58.96659180193302, "agent_compute-ego0": 0.12278539215297524, "agent_compute-ego1": 0.10448226087000052, "agent_compute-ego2": 0.09994118318867426, "agent_compute-ego3": 0.09725084094381849, "complete-iteration": 1.638804584220486, "set_robot_commands": 0.0025471509445914617, "deviation-center-line": 8.796106473823361, "driven_lanedir_consec": 1.33346205541883, "sim_compute_sim_state": 0.02561945244235659, "sim_compute_performance-ego0": 0.0023608912436987933, "sim_compute_performance-ego1": 0.0022087478320068563, "sim_compute_performance-ego2": 0.0021529932204730107, "sim_compute_performance-ego3": 0.0020974589624968695}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.8096235564474625, "get_ui_image": 0.05741012860694396, "step_physics": 1.0697397016466508, "survival_time": 59.99999999999873, "driven_lanedir": 2.6443669563320813, "get_state_dump": 0.010226013459929024, "get_robot_state": 0.01602197169860535, "sim_render-ego0": 0.004265157705937496, "sim_render-ego1": 0.0039961419435067536, "sim_render-ego2": 0.00397654377749123, "sim_render-ego3": 0.0039055792120076737, "get_duckie_state": 1.699501628383411e-06, "in-drivable-lane": 12.35000000000011, "deviation-heading": 18.06517821592198, "agent_compute-ego0": 0.12278539215297524, "agent_compute-ego1": 0.10448226087000052, "agent_compute-ego2": 0.09994118318867426, "agent_compute-ego3": 0.09725084094381849, "complete-iteration": 1.638804584220486, "set_robot_commands": 0.0025471509445914617, "deviation-center-line": 3.21414722747503, "driven_lanedir_consec": 2.6443669563320813, "sim_compute_sim_state": 0.02561945244235659, "sim_compute_performance-ego0": 0.0023608912436987933, "sim_compute_performance-ego1": 0.0022087478320068563, "sim_compute_performance-ego2": 0.0021529932204730107, "sim_compute_performance-ego3": 0.0020974589624968695}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 6.547737499130556, "get_ui_image": 0.05741012860694396, "step_physics": 1.0697397016466508, "survival_time": 59.99999999999873, "driven_lanedir": 3.1583450944270517, "get_state_dump": 0.010226013459929024, "get_robot_state": 0.01602197169860535, "sim_render-ego0": 0.004265157705937496, "sim_render-ego1": 0.0039961419435067536, "sim_render-ego2": 0.00397654377749123, "sim_render-ego3": 0.0039055792120076737, "get_duckie_state": 1.699501628383411e-06, "in-drivable-lane": 28.29999999999908, "deviation-heading": 9.624458584063971, "agent_compute-ego0": 0.12278539215297524, "agent_compute-ego1": 0.10448226087000052, "agent_compute-ego2": 0.09994118318867426, "agent_compute-ego3": 0.09725084094381849, "complete-iteration": 1.638804584220486, "set_robot_commands": 0.0025471509445914617, "deviation-center-line": 1.8022123565377328, "driven_lanedir_consec": 2.8719080654965605, "sim_compute_sim_state": 0.02561945244235659, "sim_compute_performance-ego0": 0.0023608912436987933, "sim_compute_performance-ego1": 0.0022087478320068563, "sim_compute_performance-ego2": 0.0021529932204730107, "sim_compute_performance-ego3": 0.0020974589624968695}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.7833068677956116, "get_ui_image": 0.05741012860694396, "step_physics": 1.0697397016466508, "survival_time": 59.99999999999873, "driven_lanedir": 0.7621630419939149, "get_state_dump": 0.010226013459929024, "get_robot_state": 0.01602197169860535, "sim_render-ego0": 0.004265157705937496, "sim_render-ego1": 0.0039961419435067536, "sim_render-ego2": 0.00397654377749123, "sim_render-ego3": 0.0039055792120076737, "get_duckie_state": 1.699501628383411e-06, "in-drivable-lane": 53.599999999998744, "deviation-heading": 0.9724363906685346, "agent_compute-ego0": 0.12278539215297524, "agent_compute-ego1": 0.10448226087000052, "agent_compute-ego2": 0.09994118318867426, "agent_compute-ego3": 0.09725084094381849, "complete-iteration": 1.638804584220486, "set_robot_commands": 0.0025471509445914617, "deviation-center-line": 0.3057421051683838, "driven_lanedir_consec": 0.7621630419939149, "sim_compute_sim_state": 0.02561945244235659, "sim_compute_performance-ego0": 0.0023608912436987933, "sim_compute_performance-ego1": 0.0022087478320068563, "sim_compute_performance-ego2": 0.0021529932204730107, "sim_compute_performance-ego3": 0.0020974589624968695}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 3.8107359540251977, "get_ui_image": 0.055140233581716366, "step_physics": 0.6280290386893532, "survival_time": 21.950000000000177, "driven_lanedir": 3.7210224382974033, "get_state_dump": 0.01062485088001598, "get_robot_state": 0.016299285130067304, "sim_render-ego0": 0.004282177036458796, "sim_render-ego1": 0.004166202653538097, "sim_render-ego2": 0.004104839671741832, "sim_render-ego3": 0.004022305661981756, "get_duckie_state": 1.607157967307351e-06, "in-drivable-lane": 0.9000000000000128, "deviation-heading": 2.8039525498540203, "agent_compute-ego0": 0.12104851332577792, "agent_compute-ego1": 0.1098143691366369, "agent_compute-ego2": 0.09537547826766968, "agent_compute-ego3": 0.0930974461815574, "complete-iteration": 1.2036432840607385, "set_robot_commands": 0.002604220130226829, "deviation-center-line": 0.6532651893315038, "driven_lanedir_consec": 3.7210224382974033, "sim_compute_sim_state": 0.037855934013019905, "sim_compute_performance-ego0": 0.0024318023161454634, "sim_compute_performance-ego1": 0.0022571455348621714, "sim_compute_performance-ego2": 0.0022592425346374513, "sim_compute_performance-ego3": 0.002193563634699041}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.751474887481989, "get_ui_image": 0.055140233581716366, "step_physics": 0.6280290386893532, "survival_time": 21.950000000000177, "driven_lanedir": 1.3500840920438852, "get_state_dump": 0.01062485088001598, "get_robot_state": 0.016299285130067304, "sim_render-ego0": 0.004282177036458796, "sim_render-ego1": 0.004166202653538097, "sim_render-ego2": 0.004104839671741832, "sim_render-ego3": 0.004022305661981756, "get_duckie_state": 1.607157967307351e-06, "in-drivable-lane": 10.800000000000152, "deviation-heading": 2.148267147562104, "agent_compute-ego0": 0.12104851332577792, "agent_compute-ego1": 0.1098143691366369, "agent_compute-ego2": 0.09537547826766968, "agent_compute-ego3": 0.0930974461815574, "complete-iteration": 1.2036432840607385, "set_robot_commands": 0.002604220130226829, "deviation-center-line": 0.5264316891648982, "driven_lanedir_consec": 1.3500840920438852, "sim_compute_sim_state": 0.037855934013019905, "sim_compute_performance-ego0": 0.0024318023161454634, "sim_compute_performance-ego1": 0.0022571455348621714, "sim_compute_performance-ego2": 0.0022592425346374513, "sim_compute_performance-ego3": 0.002193563634699041}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 2.5686597430667115, "get_ui_image": 0.055140233581716366, "step_physics": 0.6280290386893532, "survival_time": 21.950000000000177, "driven_lanedir": 2.4193967340202995, "get_state_dump": 0.01062485088001598, "get_robot_state": 0.016299285130067304, "sim_render-ego0": 0.004282177036458796, "sim_render-ego1": 0.004166202653538097, "sim_render-ego2": 0.004104839671741832, "sim_render-ego3": 0.004022305661981756, "get_duckie_state": 1.607157967307351e-06, "in-drivable-lane": 10.50000000000015, "deviation-heading": 1.6480249190201737, "agent_compute-ego0": 0.12104851332577792, "agent_compute-ego1": 0.1098143691366369, "agent_compute-ego2": 0.09537547826766968, "agent_compute-ego3": 0.0930974461815574, "complete-iteration": 1.2036432840607385, "set_robot_commands": 0.002604220130226829, "deviation-center-line": 0.3177081861133231, "driven_lanedir_consec": 2.4193967340202995, "sim_compute_sim_state": 0.037855934013019905, "sim_compute_performance-ego0": 0.0024318023161454634, "sim_compute_performance-ego1": 0.0022571455348621714, "sim_compute_performance-ego2": 0.0022592425346374513, "sim_compute_performance-ego3": 0.002193563634699041}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.7764357252579712, "get_ui_image": 0.055140233581716366, "step_physics": 0.6280290386893532, "survival_time": 21.950000000000177, "driven_lanedir": 1.7691701648294758, "get_state_dump": 0.01062485088001598, "get_robot_state": 0.016299285130067304, "sim_render-ego0": 0.004282177036458796, "sim_render-ego1": 0.004166202653538097, "sim_render-ego2": 0.004104839671741832, "sim_render-ego3": 0.004022305661981756, "get_duckie_state": 1.607157967307351e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.6416025231958618, "agent_compute-ego0": 0.12104851332577792, "agent_compute-ego1": 0.1098143691366369, "agent_compute-ego2": 0.09537547826766968, "agent_compute-ego3": 0.0930974461815574, "complete-iteration": 1.2036432840607385, "set_robot_commands": 0.002604220130226829, "deviation-center-line": 0.511230055667571, "driven_lanedir_consec": 1.7691701648294758, "sim_compute_sim_state": 0.037855934013019905, "sim_compute_performance-ego0": 0.0024318023161454634, "sim_compute_performance-ego1": 0.0022571455348621714, "sim_compute_performance-ego2": 0.0022592425346374513, "sim_compute_performance-ego3": 0.002193563634699041}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 8.122975368545765, "get_ui_image": 0.02943315097037005, "step_physics": 0.1327472715751019, "survival_time": 59.99999999999873, "driven_lanedir": 8.078717944796239, "get_state_dump": 0.006172278441556983, "get_robot_state": 0.0071959956103220864, "sim_render-ego0": 0.0037454171144992087, "sim_render-ego1": 0.003632383283032267, "get_duckie_state": 1.3729416262001717e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.873258308055944, "agent_compute-ego0": 0.06244896571900227, "agent_compute-ego1": 0.048425019928855166, "complete-iteration": 0.31229825381136855, "set_robot_commands": 0.0021178462324690363, "deviation-center-line": 2.0449062705758037, "driven_lanedir_consec": 8.078717944796239, "sim_compute_sim_state": 0.010260011036132, "sim_compute_performance-ego0": 0.001989532767684136, "sim_compute_performance-ego1": 0.0018936408548728312}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 7.449860859716718, "get_ui_image": 0.02943315097037005, "step_physics": 0.1327472715751019, "survival_time": 59.99999999999873, "driven_lanedir": 6.032637585371792, "get_state_dump": 0.006172278441556983, "get_robot_state": 0.0071959956103220864, "sim_render-ego0": 0.0037454171144992087, "sim_render-ego1": 0.003632383283032267, "get_duckie_state": 1.3729416262001717e-06, "in-drivable-lane": 14.700000000000188, "deviation-heading": 6.0969287987438765, "agent_compute-ego0": 0.06244896571900227, "agent_compute-ego1": 0.048425019928855166, "complete-iteration": 0.31229825381136855, "set_robot_commands": 0.0021178462324690363, "deviation-center-line": 1.9821546408807051, "driven_lanedir_consec": 4.568704627448911, "sim_compute_sim_state": 0.010260011036132, "sim_compute_performance-ego0": 0.001989532767684136, "sim_compute_performance-ego1": 0.0018936408548728312}}
set_robot_commands_max0.002604220130226829
set_robot_commands_mean0.002402308689595179
set_robot_commands_median0.0025471509445914617
set_robot_commands_min0.0021178462324690363
sim_compute_performance-ego0_max0.0024318023161454634
sim_compute_performance-ego0_mean0.002269919780831073
sim_compute_performance-ego0_median0.0023608912436987933
sim_compute_performance-ego0_min0.001989532767684136
sim_compute_performance-ego1_max0.0022571455348621714
sim_compute_performance-ego1_mean0.002121050924630992
sim_compute_performance-ego1_median0.0022087478320068563
sim_compute_performance-ego1_min0.0018936408548728312
sim_compute_sim_state_max0.037855934013019905
sim_compute_sim_state_mean0.026050940325709787
sim_compute_sim_state_median0.02561945244235659
sim_compute_sim_state_min0.010260011036132
sim_render-ego0_max0.004282177036458796
sim_render-ego0_mean0.004119451838469515
sim_render-ego0_median0.004265157705937496
sim_render-ego0_min0.0037454171144992087
sim_render-ego1_max0.004166202653538097
sim_render-ego1_mean0.0039411965953969706
sim_render-ego1_median0.0039961419435067536
sim_render-ego1_min0.003632383283032267
simulation-passed1
step_physics_max1.0697397016466508
step_physics_mean0.6649333933635543
step_physics_median0.6280290386893532
step_physics_min0.1327472715751019
survival_time_max59.99999999999873
survival_time_mean43.257142857142334
survival_time_min21.950000000000177
No reset possible
58778LFVmultibodyv-simsuccessyes1:54:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58771LFVmultibodyv-simsuccessyes2:05:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible