Duckietown Challenges Home Challenges Submissions

Submission 12876

Submission12876
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58885
Next
User labelsim-exercise-2
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58885LFVmultibodyv-simsuccessyes1:48:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.593524725591202
survival_time_median59.99999999999873
deviation-center-line_median3.110059343939171
in-drivable-lane_median1.1749999999999894


other stats
agent_compute-ego0_max0.04270911772582652
agent_compute-ego0_mean0.017171571634303488
agent_compute-ego0_median0.01291465143875516
agent_compute-ego0_min0.012901444907026416
agent_compute-ego1_max0.014093514207194792
agent_compute-ego1_mean0.01318741333071826
agent_compute-ego1_median0.01297740138242088
agent_compute-ego1_min0.012263751049819933
complete-iteration_max1.0502970000313516
complete-iteration_mean0.9148492789295048
complete-iteration_median1.036288352135715
complete-iteration_min0.34053595238780104
deviation-center-line_max4.046871807753416
deviation-center-line_mean2.7537169942697326
deviation-center-line_min0.4998554164393033
deviation-heading_max15.506588548942458
deviation-heading_mean9.215048588257378
deviation-heading_median11.407902072236492
deviation-heading_min2.618076613014012
driven_any_max15.941792818776308
driven_any_mean10.160114663808216
driven_any_median13.291598577800109
driven_any_min2.079585212239126
driven_lanedir_consec_max15.48010917382283
driven_lanedir_consec_mean9.099436457940154
driven_lanedir_consec_min1.780188781616216
driven_lanedir_max15.48010917382283
driven_lanedir_mean9.156305162461004
driven_lanedir_median11.80695844367282
driven_lanedir_min1.780188781616216
get_duckie_state_max1.752704108982261e-06
get_duckie_state_mean1.6493288840566131e-06
get_duckie_state_median1.7337291948552325e-06
get_duckie_state_min1.4275337238295889e-06
get_robot_state_max0.01552128791809082
get_robot_state_mean0.0143212878766041
get_robot_state_median0.015484971468097264
get_robot_state_min0.0075539903378705
get_state_dump_max0.010098545279332145
get_state_dump_mean0.009552090295368751
get_state_dump_median0.010065574630114756
get_state_dump_min0.006481903975055577
get_ui_image_max0.052066680692216934
get_ui_image_mean0.046301921525820806
get_ui_image_median0.049070495848453216
get_ui_image_min0.03125535478996893
in-drivable-lane_max51.499999999998735
in-drivable-lane_mean8.096428571428339
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.258602744373124, "get_ui_image": 0.04529187140471826, "step_physics": 0.8724006800038776, "survival_time": 33.80000000000022, "driven_lanedir": 2.2131234738725793, "get_state_dump": 0.010027244136815938, "get_robot_state": 0.015341253012991022, "sim_render-ego0": 0.00420839677357075, "sim_render-ego1": 0.004408321493309393, "sim_render-ego2": 0.004304792539407795, "sim_render-ego3": 0.004360746949955138, "get_duckie_state": 1.7337291948552325e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.565941417454233, "agent_compute-ego0": 0.012901444907026416, "agent_compute-ego1": 0.014093514207194792, "agent_compute-ego2": 0.01266263225053931, "agent_compute-ego3": 0.012959840554782524, "complete-iteration": 1.0502970000313516, "set_robot_commands": 0.002370032813383522, "deviation-center-line": 4.046871807753416, "driven_lanedir_consec": 2.2131234738725793, "sim_compute_sim_state": 0.01802590713895406, "sim_compute_performance-ego0": 0.002218562707943261, "sim_compute_performance-ego1": 0.0022345976780225115, "sim_compute_performance-ego2": 0.0021953223551041618, "sim_compute_performance-ego3": 0.002195332568012277}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.079585212239126, "get_ui_image": 0.04529187140471826, "step_physics": 0.8724006800038776, "survival_time": 33.80000000000022, "driven_lanedir": 2.0125157397189706, "get_state_dump": 0.010027244136815938, "get_robot_state": 0.015341253012991022, "sim_render-ego0": 0.00420839677357075, "sim_render-ego1": 0.004408321493309393, "sim_render-ego2": 0.004304792539407795, "sim_render-ego3": 0.004360746949955138, "get_duckie_state": 1.7337291948552325e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.324368505674822, "agent_compute-ego0": 0.012901444907026416, "agent_compute-ego1": 0.014093514207194792, "agent_compute-ego2": 0.01266263225053931, "agent_compute-ego3": 0.012959840554782524, "complete-iteration": 1.0502970000313516, "set_robot_commands": 0.002370032813383522, "deviation-center-line": 2.0177256390931855, "driven_lanedir_consec": 2.0125157397189706, "sim_compute_sim_state": 0.01802590713895406, "sim_compute_performance-ego0": 0.002218562707943261, "sim_compute_performance-ego1": 0.0022345976780225115, "sim_compute_performance-ego2": 0.0021953223551041618, "sim_compute_performance-ego3": 0.002195332568012277}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 4.279397372324807, "get_ui_image": 0.04529187140471826, "step_physics": 0.8724006800038776, "survival_time": 33.80000000000022, "driven_lanedir": 4.179911913847808, "get_state_dump": 0.010027244136815938, "get_robot_state": 0.015341253012991022, "sim_render-ego0": 0.00420839677357075, "sim_render-ego1": 0.004408321493309393, "sim_render-ego2": 0.004304792539407795, "sim_render-ego3": 0.004360746949955138, "get_duckie_state": 1.7337291948552325e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.06121930836402, "agent_compute-ego0": 0.012901444907026416, "agent_compute-ego1": 0.014093514207194792, "agent_compute-ego2": 0.01266263225053931, "agent_compute-ego3": 0.012959840554782524, "complete-iteration": 1.0502970000313516, "set_robot_commands": 0.002370032813383522, "deviation-center-line": 2.670585160054118, "driven_lanedir_consec": 4.179911913847808, "sim_compute_sim_state": 0.01802590713895406, "sim_compute_performance-ego0": 0.002218562707943261, "sim_compute_performance-ego1": 0.0022345976780225115, "sim_compute_performance-ego2": 0.0021953223551041618, "sim_compute_performance-ego3": 0.002195332568012277}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.65417060103268, "get_ui_image": 0.04529187140471826, "step_physics": 0.8724006800038776, "survival_time": 33.80000000000022, "driven_lanedir": 8.462580048561783, "get_state_dump": 0.010027244136815938, "get_robot_state": 0.015341253012991022, "sim_render-ego0": 0.00420839677357075, "sim_render-ego1": 0.004408321493309393, "sim_render-ego2": 0.004304792539407795, "sim_render-ego3": 0.004360746949955138, "get_duckie_state": 1.7337291948552325e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.742169325481726, "agent_compute-ego0": 0.012901444907026416, "agent_compute-ego1": 0.014093514207194792, "agent_compute-ego2": 0.01266263225053931, "agent_compute-ego3": 0.012959840554782524, "complete-iteration": 1.0502970000313516, "set_robot_commands": 0.002370032813383522, "deviation-center-line": 1.6194595605803506, "driven_lanedir_consec": 8.462580048561783, "sim_compute_sim_state": 0.01802590713895406, "sim_compute_performance-ego0": 0.002218562707943261, "sim_compute_performance-ego1": 0.0022345976780225115, "sim_compute_performance-ego2": 0.0021953223551041618, "sim_compute_performance-ego3": 0.002195332568012277}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 13.261651064928415, "get_ui_image": 0.052066680692216934, "step_physics": 0.8255462138281575, "survival_time": 59.99999999999873, "driven_lanedir": 12.780234269107847, "get_state_dump": 0.010065574630114756, "get_robot_state": 0.015484971468097264, "sim_render-ego0": 0.004246012356557219, "sim_render-ego1": 0.00432755647352792, "sim_render-ego2": 0.004372098463758838, "sim_render-ego3": 0.004498180402109367, "get_duckie_state": 1.752704108982261e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.265747722366427, "agent_compute-ego0": 0.01291465143875516, "agent_compute-ego1": 0.012953155542988265, "agent_compute-ego2": 0.01326615129481942, "agent_compute-ego3": 0.01432060917450129, "complete-iteration": 1.036288352135715, "set_robot_commands": 0.002608459061329609, "deviation-center-line": 3.7498881414711542, "driven_lanedir_consec": 12.780234269107847, "sim_compute_sim_state": 0.04313638625196573, "sim_compute_performance-ego0": 0.0023063745824224643, "sim_compute_performance-ego1": 0.0021874763685698117, "sim_compute_performance-ego2": 0.002195917894997069, "sim_compute_performance-ego3": 0.0022104036599571364}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 13.3215460906718, "get_ui_image": 0.052066680692216934, "step_physics": 0.8255462138281575, "survival_time": 59.99999999999873, "driven_lanedir": 12.122287585748392, "get_state_dump": 0.010065574630114756, "get_robot_state": 0.015484971468097264, "sim_render-ego0": 0.004246012356557219, "sim_render-ego1": 0.00432755647352792, "sim_render-ego2": 0.004372098463758838, "sim_render-ego3": 0.004498180402109367, "get_duckie_state": 1.752704108982261e-06, "in-drivable-lane": 2.4499999999999793, "deviation-heading": 15.506588548942458, "agent_compute-ego0": 0.01291465143875516, "agent_compute-ego1": 0.012953155542988265, "agent_compute-ego2": 0.01326615129481942, "agent_compute-ego3": 0.01432060917450129, "complete-iteration": 1.036288352135715, "set_robot_commands": 0.002608459061329609, "deviation-center-line": 3.710291781154801, "driven_lanedir_consec": 11.695420149585155, "sim_compute_sim_state": 0.04313638625196573, "sim_compute_performance-ego0": 0.0023063745824224643, "sim_compute_performance-ego1": 0.0021874763685698117, "sim_compute_performance-ego2": 0.002195917894997069, "sim_compute_performance-ego3": 0.0022104036599571364}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.098293968864445, "get_ui_image": 0.052066680692216934, "step_physics": 0.8255462138281575, "survival_time": 59.99999999999873, "driven_lanedir": 13.01204977267921, "get_state_dump": 0.010065574630114756, "get_robot_state": 0.015484971468097264, "sim_render-ego0": 0.004246012356557219, "sim_render-ego1": 0.00432755647352792, "sim_render-ego2": 0.004372098463758838, "sim_render-ego3": 0.004498180402109367, "get_duckie_state": 1.752704108982261e-06, "in-drivable-lane": 2.049999999999996, "deviation-heading": 14.532363783016692, "agent_compute-ego0": 0.01291465143875516, "agent_compute-ego1": 0.012953155542988265, "agent_compute-ego2": 0.01326615129481942, "agent_compute-ego3": 0.01432060917450129, "complete-iteration": 1.036288352135715, "set_robot_commands": 0.002608459061329609, "deviation-center-line": 3.4423044073567763, "driven_lanedir_consec": 12.642755345550553, "sim_compute_sim_state": 0.04313638625196573, "sim_compute_performance-ego0": 0.0023063745824224643, "sim_compute_performance-ego1": 0.0021874763685698117, "sim_compute_performance-ego2": 0.002195917894997069, "sim_compute_performance-ego3": 0.0022104036599571364}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 4.604172408607651, "get_ui_image": 0.052066680692216934, "step_physics": 0.8255462138281575, "survival_time": 59.99999999999873, "driven_lanedir": 3.9526795417501934, "get_state_dump": 0.010065574630114756, "get_robot_state": 0.015484971468097264, "sim_render-ego0": 0.004246012356557219, "sim_render-ego1": 0.00432755647352792, "sim_render-ego2": 0.004372098463758838, "sim_render-ego3": 0.004498180402109367, "get_duckie_state": 1.752704108982261e-06, "in-drivable-lane": 43.04999999999862, "deviation-heading": 4.476642450643562, "agent_compute-ego0": 0.01291465143875516, "agent_compute-ego1": 0.012953155542988265, "agent_compute-ego2": 0.01326615129481942, "agent_compute-ego3": 0.01432060917450129, "complete-iteration": 1.036288352135715, "set_robot_commands": 0.002608459061329609, "deviation-center-line": 0.9878688650127324, "driven_lanedir_consec": 3.9526795417501934, "sim_compute_sim_state": 0.04313638625196573, "sim_compute_performance-ego0": 0.0023063745824224643, "sim_compute_performance-ego1": 0.0021874763685698117, "sim_compute_performance-ego2": 0.002195917894997069, "sim_compute_performance-ego3": 0.0022104036599571364}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 14.436769639098724, "get_ui_image": 0.049070495848453216, "step_physics": 0.7405420864352974, "survival_time": 59.99999999999873, "driven_lanedir": 12.999693240369783, "get_state_dump": 0.010098545279332145, "get_robot_state": 0.01552128791809082, "sim_render-ego0": 0.00423308236712123, "sim_render-ego1": 0.0043127014674711585, "sim_render-ego2": 0.004403262809353208, "sim_render-ego3": 0.004350219539162718, "get_duckie_state": 1.572450928445859e-06, "in-drivable-lane": 5.149999999999917, "deviation-heading": 11.340877255111875, "agent_compute-ego0": 0.012929845511367378, "agent_compute-ego1": 0.01297740138242088, "agent_compute-ego2": 0.013747618855485116, "agent_compute-ego3": 0.01296011831837828, "complete-iteration": 0.9451191478923, "set_robot_commands": 0.002395147685702893, "deviation-center-line": 2.9166480638138186, "driven_lanedir_consec": 12.999693240369783, "sim_compute_sim_state": 0.040904044707947035, "sim_compute_performance-ego0": 0.0023258284267835276, "sim_compute_performance-ego1": 0.0021725570430962075, "sim_compute_performance-ego2": 0.002203728733809167, "sim_compute_performance-ego3": 0.0022278767044994854}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 14.672091865016284, "get_ui_image": 0.049070495848453216, "step_physics": 0.7405420864352974, "survival_time": 59.99999999999873, "driven_lanedir": 14.169556661948198, "get_state_dump": 0.010098545279332145, "get_robot_state": 0.01552128791809082, "sim_render-ego0": 0.00423308236712123, "sim_render-ego1": 0.0043127014674711585, "sim_render-ego2": 0.004403262809353208, "sim_render-ego3": 0.004350219539162718, "get_duckie_state": 1.572450928445859e-06, "in-drivable-lane": 0.29999999999998295, "deviation-heading": 12.809997961261752, "agent_compute-ego0": 0.012929845511367378, "agent_compute-ego1": 0.01297740138242088, "agent_compute-ego2": 0.013747618855485116, "agent_compute-ego3": 0.01296011831837828, "complete-iteration": 0.9451191478923, "set_robot_commands": 0.002395147685702893, "deviation-center-line": 3.327150205409289, "driven_lanedir_consec": 14.169556661948198, "sim_compute_sim_state": 0.040904044707947035, "sim_compute_performance-ego0": 0.0023258284267835276, "sim_compute_performance-ego1": 0.0021725570430962075, "sim_compute_performance-ego2": 0.002203728733809167, "sim_compute_performance-ego3": 0.0022278767044994854}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 6.658750942430847, "get_ui_image": 0.049070495848453216, "step_physics": 0.7405420864352974, "survival_time": 59.99999999999873, "driven_lanedir": 1.780188781616216, "get_state_dump": 0.010098545279332145, "get_robot_state": 0.01552128791809082, "sim_render-ego0": 0.00423308236712123, "sim_render-ego1": 0.0043127014674711585, "sim_render-ego2": 0.004403262809353208, "sim_render-ego3": 0.004350219539162718, "get_duckie_state": 1.572450928445859e-06, "in-drivable-lane": 51.499999999998735, "deviation-heading": 2.618076613014012, "agent_compute-ego0": 0.012929845511367378, "agent_compute-ego1": 0.01297740138242088, "agent_compute-ego2": 0.013747618855485116, "agent_compute-ego3": 0.01296011831837828, "complete-iteration": 0.9451191478923, "set_robot_commands": 0.002395147685702893, "deviation-center-line": 0.4998554164393033, "driven_lanedir_consec": 1.780188781616216, "sim_compute_sim_state": 0.040904044707947035, "sim_compute_performance-ego0": 0.0023258284267835276, "sim_compute_performance-ego1": 0.0021725570430962075, "sim_compute_performance-ego2": 0.002203728733809167, "sim_compute_performance-ego3": 0.0022278767044994854}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 14.41874990792748, "get_ui_image": 0.049070495848453216, "step_physics": 0.7405420864352974, "survival_time": 59.99999999999873, "driven_lanedir": 13.531712769813003, "get_state_dump": 0.010098545279332145, "get_robot_state": 0.01552128791809082, "sim_render-ego0": 0.00423308236712123, "sim_render-ego1": 0.0043127014674711585, "sim_render-ego2": 0.004403262809353208, "sim_render-ego3": 0.004350219539162718, "get_duckie_state": 1.572450928445859e-06, "in-drivable-lane": 2.4499999999998607, "deviation-heading": 11.503123349662603, "agent_compute-ego0": 0.012929845511367378, "agent_compute-ego1": 0.01297740138242088, "agent_compute-ego2": 0.013747618855485116, "agent_compute-ego3": 0.01296011831837828, "complete-iteration": 0.9451191478923, "set_robot_commands": 0.002395147685702893, "deviation-center-line": 3.2462632305276538, "driven_lanedir_consec": 13.531712769813003, "sim_compute_sim_state": 0.040904044707947035, "sim_compute_performance-ego0": 0.0023258284267835276, "sim_compute_performance-ego1": 0.0021725570430962075, "sim_compute_performance-ego2": 0.002203728733809167, "sim_compute_performance-ego3": 0.0022278767044994854}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 15.941792818776308, "get_ui_image": 0.03125535478996893, "step_physics": 0.212129476366194, "survival_time": 59.99999999999873, "driven_lanedir": 15.48010917382283, "get_state_dump": 0.006481903975055577, "get_robot_state": 0.0075539903378705, "sim_render-ego0": 0.004055779939090878, "sim_render-ego1": 0.0041124036568189835, "get_duckie_state": 1.4275337238295889e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.788637105247997, "agent_compute-ego0": 0.04270911772582652, "agent_compute-ego1": 0.012263751049819933, "complete-iteration": 0.34053595238780104, "set_robot_commands": 0.002351595499831175, "deviation-center-line": 2.973855457350689, "driven_lanedir_consec": 15.48010917382283, "sim_compute_sim_state": 0.010854830650564634, "sim_compute_performance-ego0": 0.0021135590654130184, "sim_compute_performance-ego1": 0.0021060144375206332}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 13.556030657023358, "get_ui_image": 0.03125535478996893, "step_physics": 0.212129476366194, "survival_time": 59.99999999999873, "driven_lanedir": 11.491629301597248, "get_state_dump": 0.006481903975055577, "get_robot_state": 0.0075539903378705, "sim_render-ego0": 0.004055779939090878, "sim_render-ego1": 0.0041124036568189835, "get_duckie_state": 1.4275337238295889e-06, "in-drivable-lane": 6.399999999999672, "deviation-heading": 11.474926889361106, "agent_compute-ego0": 0.04270911772582652, "agent_compute-ego1": 0.012263751049819933, "complete-iteration": 0.34053595238780104, "set_robot_commands": 0.002351595499831175, "deviation-center-line": 3.3432701837589707, "driven_lanedir_consec": 11.491629301597248, "sim_compute_sim_state": 0.010854830650564634, "sim_compute_performance-ego0": 0.0021135590654130184, "sim_compute_performance-ego1": 0.0021060144375206332}}
set_robot_commands_max0.002608459061329609
set_robot_commands_mean0.0024426963743804605
set_robot_commands_median0.002395147685702893
set_robot_commands_min0.002351595499831175
sim_compute_performance-ego0_max0.0023258284267835276
sim_compute_performance-ego0_mean0.002259298642815932
sim_compute_performance-ego0_median0.0023063745824224643
sim_compute_performance-ego0_min0.0021135590654130184
sim_compute_performance-ego1_max0.0022345976780225115
sim_compute_performance-ego1_mean0.00218503951669967
sim_compute_performance-ego1_median0.0021874763685698117
sim_compute_performance-ego1_min0.0021060144375206332
sim_compute_sim_state_max0.04313638625196573
sim_compute_sim_state_mean0.030712500978328332
sim_compute_sim_state_median0.040904044707947035
sim_compute_sim_state_min0.010854830650564634
sim_render-ego0_max0.004246012356557219
sim_render-ego0_mean0.004204394704798469
sim_render-ego0_median0.00423308236712123
sim_render-ego0_min0.004055779939090878
sim_render-ego1_max0.004408321493309393
sim_render-ego1_mean0.004315651789347989
sim_render-ego1_median0.00432755647352792
sim_render-ego1_min0.0041124036568189835
simulation-passed1
step_physics_max0.8724006800038776
step_physics_mean0.7270153481286942
step_physics_median0.8255462138281575
step_physics_min0.212129476366194
survival_time_max59.99999999999873
survival_time_mean52.51428571428487
survival_time_min33.80000000000022
No reset possible
58884LFVmultibodyv-simsuccessyes1:36:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58883LFVmultibodyv-simsuccessyes1:45:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58882LFVmultibodyv-simsuccessyes1:50:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible