Duckietown Challenges Home Challenges Submissions

Submission 12568

Submission12568
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53434
Next
User labelstraight
Admin priority50
Blessingn/a
User priority50

53434

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53434LFVmultibodyv-simsuccessyes0:40:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5845020784009587
survival_time_median22.05000000000018
deviation-center-line_median0.36159514613690735
in-drivable-lane_median17.650000000000187


other stats
agent_compute-ego0_max0.01035323294039765
agent_compute-ego0_mean0.0100236053700205
agent_compute-ego0_median0.010079280448592211
agent_compute-ego0_min0.009611218675921853
agent_compute-ego1_max0.010822211994844323
agent_compute-ego1_mean0.010364875457079231
agent_compute-ego1_median0.010256705901552102
agent_compute-ego1_min0.010020415775059868
complete-iteration_max1.087747699570916
complete-iteration_mean0.7702870974164207
complete-iteration_median0.8247339984410489
complete-iteration_min0.29169612910066334
deviation-center-line_max0.6128060296104244
deviation-center-line_mean0.37163603052463456
deviation-center-line_min0.13131467496691465
deviation-heading_max3.914823649869822
deviation-heading_mean1.69923675229233
deviation-heading_median1.7837659422502474
deviation-heading_min0.5703639195063125
driven_any_max5.114746336331455
driven_any_mean2.0430849429179028
driven_any_median1.672675359708932
driven_any_min0.8124423795237465
driven_lanedir_consec_max0.977662661166671
driven_lanedir_consec_mean0.5932421336189245
driven_lanedir_consec_min0.1964323403421724
driven_lanedir_max0.977662661166671
driven_lanedir_mean0.5932421336189245
driven_lanedir_median0.5845020784009587
driven_lanedir_min0.1964323403421724
get_duckie_state_max1.6020433935104992e-06
get_duckie_state_mean1.5491032901865524e-06
get_duckie_state_median1.5778028276892794e-06
get_duckie_state_min1.4656356402805874e-06
get_robot_state_max0.014802392251890707
get_robot_state_mean0.013472602900557002
get_robot_state_median0.01436708497926709
get_robot_state_min0.007462177957807269
get_state_dump_max0.009708128363838024
get_state_dump_mean0.009119676478516326
get_state_dump_median0.009543407868237383
get_state_dump_min0.006384094910962241
get_ui_image_max0.04818449303066117
get_ui_image_mean0.04380514697638016
get_ui_image_median0.04775691463936508
get_ui_image_min0.031816939158099036
in-drivable-lane_max27.550000000000328
in-drivable-lane_mean16.92142857142874
in-drivable-lane_min7.300000000000029
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.669702128629466, "get_ui_image": 0.04146813716825479, "step_physics": 0.47593435202494705, "survival_time": 15.10000000000008, "driven_lanedir": 0.8756474193632071, "get_state_dump": 0.009543407868237383, "get_robot_state": 0.014253543941888084, "sim_render-ego0": 0.0035851662701899462, "sim_render-ego1": 0.0036004840737522237, "sim_render-ego2": 0.0035511518862381235, "sim_render-ego3": 0.0037299917869441975, "get_duckie_state": 1.509197474312861e-06, "in-drivable-lane": 8.900000000000095, "deviation-heading": 2.1492018701903586, "agent_compute-ego0": 0.009611218675921853, "agent_compute-ego1": 0.010020415775059868, "agent_compute-ego2": 0.010008899292143264, "agent_compute-ego3": 0.0098346743253198, "complete-iteration": 0.6376750783951762, "set_robot_commands": 0.002182024146857435, "deviation-center-line": 0.6128060296104244, "driven_lanedir_consec": 0.8756474193632071, "sim_compute_sim_state": 0.02598439348806249, "sim_compute_performance-ego0": 0.0019798743055992, "sim_compute_performance-ego1": 0.0019516464900655717, "sim_compute_performance-ego2": 0.0021153464175686977, "sim_compute_performance-ego3": 0.0018333121888314931}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.97804980373683, "get_ui_image": 0.04146813716825479, "step_physics": 0.47593435202494705, "survival_time": 15.10000000000008, "driven_lanedir": 0.3294444869160553, "get_state_dump": 0.009543407868237383, "get_robot_state": 0.014253543941888084, "sim_render-ego0": 0.0035851662701899462, "sim_render-ego1": 0.0036004840737522237, "sim_render-ego2": 0.0035511518862381235, "sim_render-ego3": 0.0037299917869441975, "get_duckie_state": 1.509197474312861e-06, "in-drivable-lane": 11.70000000000006, "deviation-heading": 2.3793594057095864, "agent_compute-ego0": 0.009611218675921853, "agent_compute-ego1": 0.010020415775059868, "agent_compute-ego2": 0.010008899292143264, "agent_compute-ego3": 0.0098346743253198, "complete-iteration": 0.6376750783951762, "set_robot_commands": 0.002182024146857435, "deviation-center-line": 0.35672508523152285, "driven_lanedir_consec": 0.3294444869160553, "sim_compute_sim_state": 0.02598439348806249, "sim_compute_performance-ego0": 0.0019798743055992, "sim_compute_performance-ego1": 0.0019516464900655717, "sim_compute_performance-ego2": 0.0021153464175686977, "sim_compute_performance-ego3": 0.0018333121888314931}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.317023512748307, "get_ui_image": 0.04146813716825479, "step_physics": 0.47593435202494705, "survival_time": 15.10000000000008, "driven_lanedir": 0.44477401954845086, "get_state_dump": 0.009543407868237383, "get_robot_state": 0.014253543941888084, "sim_render-ego0": 0.0035851662701899462, "sim_render-ego1": 0.0036004840737522237, "sim_render-ego2": 0.0035511518862381235, "sim_render-ego3": 0.0037299917869441975, "get_duckie_state": 1.509197474312861e-06, "in-drivable-lane": 11.950000000000085, "deviation-heading": 0.9068102341402988, "agent_compute-ego0": 0.009611218675921853, "agent_compute-ego1": 0.010020415775059868, "agent_compute-ego2": 0.010008899292143264, "agent_compute-ego3": 0.0098346743253198, "complete-iteration": 0.6376750783951762, "set_robot_commands": 0.002182024146857435, "deviation-center-line": 0.24865738990220165, "driven_lanedir_consec": 0.44477401954845086, "sim_compute_sim_state": 0.02598439348806249, "sim_compute_performance-ego0": 0.0019798743055992, "sim_compute_performance-ego1": 0.0019516464900655717, "sim_compute_performance-ego2": 0.0021153464175686977, "sim_compute_performance-ego3": 0.0018333121888314931}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.1779115194823089, "get_ui_image": 0.04146813716825479, "step_physics": 0.47593435202494705, "survival_time": 15.10000000000008, "driven_lanedir": 0.8739655144399272, "get_state_dump": 0.009543407868237383, "get_robot_state": 0.014253543941888084, "sim_render-ego0": 0.0035851662701899462, "sim_render-ego1": 0.0036004840737522237, "sim_render-ego2": 0.0035511518862381235, "sim_render-ego3": 0.0037299917869441975, "get_duckie_state": 1.509197474312861e-06, "in-drivable-lane": 9.000000000000092, "deviation-heading": 1.968896617771691, "agent_compute-ego0": 0.009611218675921853, "agent_compute-ego1": 0.010020415775059868, "agent_compute-ego2": 0.010008899292143264, "agent_compute-ego3": 0.0098346743253198, "complete-iteration": 0.6376750783951762, "set_robot_commands": 0.002182024146857435, "deviation-center-line": 0.456487134836235, "driven_lanedir_consec": 0.8739655144399272, "sim_compute_sim_state": 0.02598439348806249, "sim_compute_performance-ego0": 0.0019798743055992, "sim_compute_performance-ego1": 0.0019516464900655717, "sim_compute_performance-ego2": 0.0021153464175686977, "sim_compute_performance-ego3": 0.0018333121888314931}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.3087345789536873, "get_ui_image": 0.04818449303066117, "step_physics": 0.9184016303599531, "survival_time": 32.00000000000032, "driven_lanedir": 0.5568351699536372, "get_state_dump": 0.009475283987250603, "get_robot_state": 0.01436708497926709, "sim_render-ego0": 0.003795448219906335, "sim_render-ego1": 0.0038082860003395497, "sim_render-ego2": 0.003722058815442828, "sim_render-ego3": 0.003714289196567862, "get_duckie_state": 1.5778028276892794e-06, "in-drivable-lane": 27.550000000000328, "deviation-heading": 2.2820480631587916, "agent_compute-ego0": 0.010079280448592211, "agent_compute-ego1": 0.010256705901552102, "agent_compute-ego2": 0.009924352633971692, "agent_compute-ego3": 0.009904967827283648, "complete-iteration": 1.087747699570916, "set_robot_commands": 0.0023286907981598806, "deviation-center-line": 0.39832275630911695, "driven_lanedir_consec": 0.5568351699536372, "sim_compute_sim_state": 0.02467671422616182, "sim_compute_performance-ego0": 0.002114420562006196, "sim_compute_performance-ego1": 0.0019848900912518433, "sim_compute_performance-ego2": 0.0019426111498042685, "sim_compute_performance-ego3": 0.0019648752048867357}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 5.114746336331455, "get_ui_image": 0.04818449303066117, "step_physics": 0.9184016303599531, "survival_time": 32.00000000000032, "driven_lanedir": 0.977662661166671, "get_state_dump": 0.009475283987250603, "get_robot_state": 0.01436708497926709, "sim_render-ego0": 0.003795448219906335, "sim_render-ego1": 0.0038082860003395497, "sim_render-ego2": 0.003722058815442828, "sim_render-ego3": 0.003714289196567862, "get_duckie_state": 1.5778028276892794e-06, "in-drivable-lane": 24.600000000000232, "deviation-heading": 3.914823649869822, "agent_compute-ego0": 0.010079280448592211, "agent_compute-ego1": 0.010256705901552102, "agent_compute-ego2": 0.009924352633971692, "agent_compute-ego3": 0.009904967827283648, "complete-iteration": 1.087747699570916, "set_robot_commands": 0.0023286907981598806, "deviation-center-line": 0.5935504233433263, "driven_lanedir_consec": 0.977662661166671, "sim_compute_sim_state": 0.02467671422616182, "sim_compute_performance-ego0": 0.002114420562006196, "sim_compute_performance-ego1": 0.0019848900912518433, "sim_compute_performance-ego2": 0.0019426111498042685, "sim_compute_performance-ego3": 0.0019648752048867357}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.87895973253482, "get_ui_image": 0.04818449303066117, "step_physics": 0.9184016303599531, "survival_time": 32.00000000000032, "driven_lanedir": 0.7157696938306048, "get_state_dump": 0.009475283987250603, "get_robot_state": 0.01436708497926709, "sim_render-ego0": 0.003795448219906335, "sim_render-ego1": 0.0038082860003395497, "sim_render-ego2": 0.003722058815442828, "sim_render-ego3": 0.003714289196567862, "get_duckie_state": 1.5778028276892794e-06, "in-drivable-lane": 26.70000000000033, "deviation-heading": 2.165863847567469, "agent_compute-ego0": 0.010079280448592211, "agent_compute-ego1": 0.010256705901552102, "agent_compute-ego2": 0.009924352633971692, "agent_compute-ego3": 0.009904967827283648, "complete-iteration": 1.087747699570916, "set_robot_commands": 0.0023286907981598806, "deviation-center-line": 0.5082735897475552, "driven_lanedir_consec": 0.7157696938306048, "sim_compute_sim_state": 0.02467671422616182, "sim_compute_performance-ego0": 0.002114420562006196, "sim_compute_performance-ego1": 0.0019848900912518433, "sim_compute_performance-ego2": 0.0019426111498042685, "sim_compute_performance-ego3": 0.0019648752048867357}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.308734578953583, "get_ui_image": 0.04818449303066117, "step_physics": 0.9184016303599531, "survival_time": 32.00000000000032, "driven_lanedir": 0.640366633236193, "get_state_dump": 0.009475283987250603, "get_robot_state": 0.01436708497926709, "sim_render-ego0": 0.003795448219906335, "sim_render-ego1": 0.0038082860003395497, "sim_render-ego2": 0.003722058815442828, "sim_render-ego3": 0.003714289196567862, "get_duckie_state": 1.5778028276892794e-06, "in-drivable-lane": 27.15000000000033, "deviation-heading": 1.598635266728804, "agent_compute-ego0": 0.010079280448592211, "agent_compute-ego1": 0.010256705901552102, "agent_compute-ego2": 0.009924352633971692, "agent_compute-ego3": 0.009904967827283648, "complete-iteration": 1.087747699570916, "set_robot_commands": 0.0023286907981598806, "deviation-center-line": 0.41851362224089594, "driven_lanedir_consec": 0.640366633236193, "sim_compute_sim_state": 0.02467671422616182, "sim_compute_performance-ego0": 0.002114420562006196, "sim_compute_performance-ego1": 0.0019848900912518433, "sim_compute_performance-ego2": 0.0019426111498042685, "sim_compute_performance-ego3": 0.0019648752048867357}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8124423795237465, "get_ui_image": 0.04775691463936508, "step_physics": 0.6540558257254001, "survival_time": 22.05000000000018, "driven_lanedir": 0.1964323403421724, "get_state_dump": 0.009708128363838024, "get_robot_state": 0.014802392251890707, "sim_render-ego0": 0.003885873842023616, "sim_render-ego1": 0.003938963510332064, "sim_render-ego2": 0.003809336623455065, "sim_render-ego3": 0.003775372764104093, "get_duckie_state": 1.6020433935104992e-06, "in-drivable-lane": 20.250000000000178, "deviation-heading": 1.1184016962214265, "agent_compute-ego0": 0.01035323294039765, "agent_compute-ego1": 0.010822211994844323, "agent_compute-ego2": 0.010315133975102352, "agent_compute-ego3": 0.009542302308578837, "complete-iteration": 0.8247339984410489, "set_robot_commands": 0.002343024603381955, "deviation-center-line": 0.13131467496691465, "driven_lanedir_consec": 0.1964323403421724, "sim_compute_sim_state": 0.024465307930475987, "sim_compute_performance-ego0": 0.0021328990815451783, "sim_compute_performance-ego1": 0.001995089366964625, "sim_compute_performance-ego2": 0.001966290344479936, "sim_compute_performance-ego3": 0.0019950257167557247}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.9049025830341053, "get_ui_image": 0.04775691463936508, "step_physics": 0.6540558257254001, "survival_time": 22.05000000000018, "driven_lanedir": 0.7138391578639616, "get_state_dump": 0.009708128363838024, "get_robot_state": 0.014802392251890707, "sim_render-ego0": 0.003885873842023616, "sim_render-ego1": 0.003938963510332064, "sim_render-ego2": 0.003809336623455065, "sim_render-ego3": 0.003775372764104093, "get_duckie_state": 1.6020433935104992e-06, "in-drivable-lane": 17.30000000000019, "deviation-heading": 0.6949919463848312, "agent_compute-ego0": 0.01035323294039765, "agent_compute-ego1": 0.010822211994844323, "agent_compute-ego2": 0.010315133975102352, "agent_compute-ego3": 0.009542302308578837, "complete-iteration": 0.8247339984410489, "set_robot_commands": 0.002343024603381955, "deviation-center-line": 0.203718891398521, "driven_lanedir_consec": 0.7138391578639616, "sim_compute_sim_state": 0.024465307930475987, "sim_compute_performance-ego0": 0.0021328990815451783, "sim_compute_performance-ego1": 0.001995089366964625, "sim_compute_performance-ego2": 0.001966290344479936, "sim_compute_performance-ego3": 0.0019950257167557247}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.4749354803211023, "get_ui_image": 0.04775691463936508, "step_physics": 0.6540558257254001, "survival_time": 22.05000000000018, "driven_lanedir": 0.4065491678439639, "get_state_dump": 0.009708128363838024, "get_robot_state": 0.014802392251890707, "sim_render-ego0": 0.003885873842023616, "sim_render-ego1": 0.003938963510332064, "sim_render-ego2": 0.003809336623455065, "sim_render-ego3": 0.003775372764104093, "get_duckie_state": 1.6020433935104992e-06, "in-drivable-lane": 19.20000000000018, "deviation-heading": 0.5703639195063125, "agent_compute-ego0": 0.01035323294039765, "agent_compute-ego1": 0.010822211994844323, "agent_compute-ego2": 0.010315133975102352, "agent_compute-ego3": 0.009542302308578837, "complete-iteration": 0.8247339984410489, "set_robot_commands": 0.002343024603381955, "deviation-center-line": 0.3154125566925224, "driven_lanedir_consec": 0.4065491678439639, "sim_compute_sim_state": 0.024465307930475987, "sim_compute_performance-ego0": 0.0021328990815451783, "sim_compute_performance-ego1": 0.001995089366964625, "sim_compute_performance-ego2": 0.001966290344479936, "sim_compute_performance-ego3": 0.0019950257167557247}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.675648590788398, "get_ui_image": 0.04775691463936508, "step_physics": 0.6540558257254001, "survival_time": 22.05000000000018, "driven_lanedir": 0.5989210039901636, "get_state_dump": 0.009708128363838024, "get_robot_state": 0.014802392251890707, "sim_render-ego0": 0.003885873842023616, "sim_render-ego1": 0.003938963510332064, "sim_render-ego2": 0.003809336623455065, "sim_render-ego3": 0.003775372764104093, "get_duckie_state": 1.6020433935104992e-06, "in-drivable-lane": 18.000000000000185, "deviation-heading": 0.8842272187908944, "agent_compute-ego0": 0.01035323294039765, "agent_compute-ego1": 0.010822211994844323, "agent_compute-ego2": 0.010315133975102352, "agent_compute-ego3": 0.009542302308578837, "complete-iteration": 0.8247339984410489, "set_robot_commands": 0.002343024603381955, "deviation-center-line": 0.26360175582853124, "driven_lanedir_consec": 0.5989210039901636, "sim_compute_sim_state": 0.024465307930475987, "sim_compute_performance-ego0": 0.0021328990815451783, "sim_compute_performance-ego1": 0.001995089366964625, "sim_compute_performance-ego2": 0.001966290344479936, "sim_compute_performance-ego3": 0.0019950257167557247}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.668306262235915, "get_ui_image": 0.031816939158099036, "step_physics": 0.20099382315363204, "survival_time": 11.150000000000023, "driven_lanedir": 0.5700831528117538, "get_state_dump": 0.006384094910962241, "get_robot_state": 0.007462177957807269, "sim_render-ego0": 0.003931536206177303, "sim_render-ego1": 0.003795501376901354, "get_duckie_state": 1.4656356402805874e-06, "in-drivable-lane": 7.300000000000029, "deviation-heading": 0.6911789472101965, "agent_compute-ego0": 0.010077773460320063, "agent_compute-ego1": 0.010355460856642042, "complete-iteration": 0.29169612910066334, "set_robot_commands": 0.0022255246128354755, "deviation-center-line": 0.3290553101948258, "driven_lanedir_consec": 0.5700831528117538, "sim_compute_sim_state": 0.008371936423437936, "sim_compute_performance-ego0": 0.0020431035331317355, "sim_compute_performance-ego1": 0.0019458872931344168}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.313091713576913, "get_ui_image": 0.031816939158099036, "step_physics": 0.20099382315363204, "survival_time": 11.150000000000023, "driven_lanedir": 0.40509944935818054, "get_state_dump": 0.006384094910962241, "get_robot_state": 0.007462177957807269, "sim_render-ego0": 0.003931536206177303, "sim_render-ego1": 0.003795501376901354, "get_duckie_state": 1.4656356402805874e-06, "in-drivable-lane": 7.300000000000029, "deviation-heading": 2.4645118488421347, "agent_compute-ego0": 0.010077773460320063, "agent_compute-ego1": 0.010355460856642042, "complete-iteration": 0.29169612910066334, "set_robot_commands": 0.0022255246128354755, "deviation-center-line": 0.36646520704229185, "driven_lanedir_consec": 0.40509944935818054, "sim_compute_sim_state": 0.008371936423437936, "sim_compute_performance-ego0": 0.0020431035331317355, "sim_compute_performance-ego1": 0.0019458872931344168}}
set_robot_commands_max0.002343024603381955
set_robot_commands_mean0.0022761433870905736
set_robot_commands_median0.0023286907981598806
set_robot_commands_min0.002182024146857435
sim_compute_performance-ego0_max0.0021328990815451783
sim_compute_performance-ego0_mean0.0020710702044904115
sim_compute_performance-ego0_median0.002114420562006196
sim_compute_performance-ego0_min0.0019798743055992
sim_compute_performance-ego1_max0.001995089366964625
sim_compute_performance-ego1_mean0.001972734169956928
sim_compute_performance-ego1_median0.0019848900912518433
sim_compute_performance-ego1_min0.0019458872931344168
sim_compute_sim_state_max0.02598439348806249
sim_compute_sim_state_mean0.02266068110183407
sim_compute_sim_state_median0.02467671422616182
sim_compute_sim_state_min0.008371936423437936
sim_render-ego0_max0.003931536206177303
sim_render-ego0_mean0.003780644695773872
sim_render-ego0_median0.003795448219906335
sim_render-ego0_min0.0035851662701899462
sim_render-ego1_max0.003938963510332064
sim_render-ego1_mean0.003784424077964146
sim_render-ego1_median0.0038082860003395497
sim_render-ego1_min0.0036004840737522237
simulation-passed1
step_physics_max0.9184016303599531
step_physics_mean0.6139682056248904
step_physics_median0.6540558257254001
step_physics_min0.20099382315363204
survival_time_max32.00000000000032
survival_time_mean21.35000000000017
survival_time_min11.150000000000023
No reset possible
53424LFVmultibodyv-simsuccessyes0:40:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53417LFVmultibodyv-simsuccessyes0:40:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible