Duckietown Challenges Home Challenges Submissions

Job 62080

Job ID62080
submission13593
userAndras Beres
user label202-1
challengeaido-LFV_multi-sim-validation
step356
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg03
date started
date completed
duration2:08:01
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.099999999999405
in-drivable-lane_median0.8249999999999775
driven_lanedir_consec_median11.24945630082728
deviation-center-line_median3.5277656208580748


other stats
agent_compute-ego0_max0.16530507004520975
agent_compute-ego0_mean0.14212139750806987
agent_compute-ego0_median0.14769655632805992
agent_compute-ego0_min0.1188771546997639
agent_compute-ego1_max0.13735119501749674
agent_compute-ego1_mean0.12082389076912269
agent_compute-ego1_median0.1279688706764808
agent_compute-ego1_min0.099689211164202
complete-iteration_max2.004817672483894
complete-iteration_mean1.601487025075233
complete-iteration_median1.6510869533448786
complete-iteration_min0.7147099320192515
deviation-center-line_max4.685258885331869
deviation-center-line_mean3.0426271518368098
deviation-center-line_min0.46580390692958307
deviation-heading_max14.88277701798551
deviation-heading_mean6.322111661266745
deviation-heading_median6.233915208011564
deviation-heading_min1.1525089054371125
driven_any_max29.20828378181021
driven_any_mean14.110970101674184
driven_any_median11.883478357218692
driven_any_min3.222519519891979
driven_lanedir_consec_max28.706154623169397
driven_lanedir_consec_mean13.589882170274077
driven_lanedir_consec_min3.060634333986818
driven_lanedir_max28.706154623169397
driven_lanedir_mean13.589882170274077
driven_lanedir_median11.24945630082728
driven_lanedir_min3.060634333986818
get_duckie_state_max6.24494119123979e-06
get_duckie_state_mean5.143031309278026e-06
get_duckie_state_median4.818294846148407e-06
get_duckie_state_min4.620566917728412e-06
get_robot_state_max0.06392154837199338
get_robot_state_mean0.05461528978505048
get_robot_state_median0.06263587504000097
get_robot_state_min0.0225176411385862
get_state_dump_max0.06036328823766976
get_state_dump_mean0.042512298782613936
get_state_dump_median0.04317080307673741
get_state_dump_min0.025753663933795433
get_ui_image_max0.10957153464898638
get_ui_image_mean0.0880638301080795
get_ui_image_median0.0864875324956187
get_ui_image_min0.053927317909572434
in-drivable-lane_max7.0000000000000995
in-drivable-lane_mean1.2571428571428611
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 23.51849450538836, "get_ui_image": 0.0864875324956187, "step_physics": 0.7537210446137649, "survival_time": 57.14999999999889, "driven_lanedir": 22.95129863414075, "get_state_dump": 0.04317080307673741, "get_robot_state": 0.06263587504000097, "sim_render-ego0": 0.011428422235942388, "sim_render-ego1": 0.010208649026764023, "sim_render-ego2": 0.010639146908179863, "sim_render-ego3": 0.011578824345048491, "get_duckie_state": 6.24494119123979e-06, "in-drivable-lane": 0.7499999999999956, "deviation-heading": 5.836490774739006, "agent_compute-ego0": 0.14769655632805992, "agent_compute-ego1": 0.1279688706764808, "agent_compute-ego2": 0.1298599868387609, "agent_compute-ego3": 0.13256980280776123, "complete-iteration": 1.6510869533448786, "set_robot_commands": 0.009578250713281698, "deviation-center-line": 4.618808585950046, "driven_lanedir_consec": 22.95129863414075, "sim_compute_sim_state": 0.058252138691348626, "sim_compute_performance-ego0": 0.008446869525042448, "sim_compute_performance-ego1": 0.0057178960813509, "sim_compute_performance-ego2": 0.006718705792527099, "sim_compute_performance-ego3": 0.006245054981925271}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 25.744558861163444, "get_ui_image": 0.0864875324956187, "step_physics": 0.7537210446137649, "survival_time": 57.14999999999889, "driven_lanedir": 25.24639331623892, "get_state_dump": 0.04317080307673741, "get_robot_state": 0.06263587504000097, "sim_render-ego0": 0.011428422235942388, "sim_render-ego1": 0.010208649026764023, "sim_render-ego2": 0.010639146908179863, "sim_render-ego3": 0.011578824345048491, "get_duckie_state": 6.24494119123979e-06, "in-drivable-lane": 0.5500000000000043, "deviation-heading": 5.832214683695627, "agent_compute-ego0": 0.14769655632805992, "agent_compute-ego1": 0.1279688706764808, "agent_compute-ego2": 0.1298599868387609, "agent_compute-ego3": 0.13256980280776123, "complete-iteration": 1.6510869533448786, "set_robot_commands": 0.009578250713281698, "deviation-center-line": 4.3898458000283105, "driven_lanedir_consec": 25.24639331623892, "sim_compute_sim_state": 0.058252138691348626, "sim_compute_performance-ego0": 0.008446869525042448, "sim_compute_performance-ego1": 0.0057178960813509, "sim_compute_performance-ego2": 0.006718705792527099, "sim_compute_performance-ego3": 0.006245054981925271}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 22.86534595524438, "get_ui_image": 0.0864875324956187, "step_physics": 0.7537210446137649, "survival_time": 57.14999999999889, "driven_lanedir": 22.2395083974466, "get_state_dump": 0.04317080307673741, "get_robot_state": 0.06263587504000097, "sim_render-ego0": 0.011428422235942388, "sim_render-ego1": 0.010208649026764023, "sim_render-ego2": 0.010639146908179863, "sim_render-ego3": 0.011578824345048491, "get_duckie_state": 6.24494119123979e-06, "in-drivable-lane": 0.8999999999999595, "deviation-heading": 8.309142689338856, "agent_compute-ego0": 0.14769655632805992, "agent_compute-ego1": 0.1279688706764808, "agent_compute-ego2": 0.1298599868387609, "agent_compute-ego3": 0.13256980280776123, "complete-iteration": 1.6510869533448786, "set_robot_commands": 0.009578250713281698, "deviation-center-line": 4.262418335816962, "driven_lanedir_consec": 22.2395083974466, "sim_compute_sim_state": 0.058252138691348626, "sim_compute_performance-ego0": 0.008446869525042448, "sim_compute_performance-ego1": 0.0057178960813509, "sim_compute_performance-ego2": 0.006718705792527099, "sim_compute_performance-ego3": 0.006245054981925271}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 29.20828378181021, "get_ui_image": 0.0864875324956187, "step_physics": 0.7537210446137649, "survival_time": 57.14999999999889, "driven_lanedir": 28.706154623169397, "get_state_dump": 0.04317080307673741, "get_robot_state": 0.06263587504000097, "sim_render-ego0": 0.011428422235942388, "sim_render-ego1": 0.010208649026764023, "sim_render-ego2": 0.010639146908179863, "sim_render-ego3": 0.011578824345048491, "get_duckie_state": 6.24494119123979e-06, "in-drivable-lane": 0.39999999999997726, "deviation-heading": 6.854436321029747, "agent_compute-ego0": 0.14769655632805992, "agent_compute-ego1": 0.1279688706764808, "agent_compute-ego2": 0.1298599868387609, "agent_compute-ego3": 0.13256980280776123, "complete-iteration": 1.6510869533448786, "set_robot_commands": 0.009578250713281698, "deviation-center-line": 3.746403378710675, "driven_lanedir_consec": 28.706154623169397, "sim_compute_sim_state": 0.058252138691348626, "sim_compute_performance-ego0": 0.008446869525042448, "sim_compute_performance-ego1": 0.0057178960813509, "sim_compute_performance-ego2": 0.006718705792527099, "sim_compute_performance-ego3": 0.006245054981925271}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 22.4584202936406, "get_ui_image": 0.10957153464898638, "step_physics": 0.9630887746068176, "survival_time": 48.099999999999405, "driven_lanedir": 21.08988072347855, "get_state_dump": 0.06036328823766976, "get_robot_state": 0.06392154837199338, "sim_render-ego0": 0.01373268535451602, "sim_render-ego1": 0.01033455090111785, "sim_render-ego2": 0.011251350305781062, "sim_render-ego3": 0.011453701823423708, "get_duckie_state": 4.620566917728412e-06, "in-drivable-lane": 2.599999999999987, "deviation-heading": 7.488414182630852, "agent_compute-ego0": 0.16530507004520975, "agent_compute-ego1": 0.13735119501749674, "agent_compute-ego2": 0.14489576378344005, "agent_compute-ego3": 0.14760318178749282, "complete-iteration": 2.004817672483894, "set_robot_commands": 0.01492683612668997, "deviation-center-line": 3.5117593562722984, "driven_lanedir_consec": 21.08988072347855, "sim_compute_sim_state": 0.08519932909299033, "sim_compute_performance-ego0": 0.011180515972624686, "sim_compute_performance-ego1": 0.006615780100520403, "sim_compute_performance-ego2": 0.006866799708096037, "sim_compute_performance-ego3": 0.0068686171855510585}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.600709578828434, "get_ui_image": 0.10957153464898638, "step_physics": 0.9630887746068176, "survival_time": 48.099999999999405, "driven_lanedir": 10.92528890466095, "get_state_dump": 0.06036328823766976, "get_robot_state": 0.06392154837199338, "sim_render-ego0": 0.01373268535451602, "sim_render-ego1": 0.01033455090111785, "sim_render-ego2": 0.011251350305781062, "sim_render-ego3": 0.011453701823423708, "get_duckie_state": 4.620566917728412e-06, "in-drivable-lane": 1.2500000000000044, "deviation-heading": 14.88277701798551, "agent_compute-ego0": 0.16530507004520975, "agent_compute-ego1": 0.13735119501749674, "agent_compute-ego2": 0.14489576378344005, "agent_compute-ego3": 0.14760318178749282, "complete-iteration": 2.004817672483894, "set_robot_commands": 0.01492683612668997, "deviation-center-line": 4.685258885331869, "driven_lanedir_consec": 10.92528890466095, "sim_compute_sim_state": 0.08519932909299033, "sim_compute_performance-ego0": 0.011180515972624686, "sim_compute_performance-ego1": 0.006615780100520403, "sim_compute_performance-ego2": 0.006866799708096037, "sim_compute_performance-ego3": 0.0068686171855510585}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.882625929480804, "get_ui_image": 0.10957153464898638, "step_physics": 0.9630887746068176, "survival_time": 48.099999999999405, "driven_lanedir": 14.082195873383895, "get_state_dump": 0.06036328823766976, "get_robot_state": 0.06392154837199338, "sim_render-ego0": 0.01373268535451602, "sim_render-ego1": 0.01033455090111785, "sim_render-ego2": 0.011251350305781062, "sim_render-ego3": 0.011453701823423708, "get_duckie_state": 4.620566917728412e-06, "in-drivable-lane": 1.4500000000000108, "deviation-heading": 6.631339641284122, "agent_compute-ego0": 0.16530507004520975, "agent_compute-ego1": 0.13735119501749674, "agent_compute-ego2": 0.14489576378344005, "agent_compute-ego3": 0.14760318178749282, "complete-iteration": 2.004817672483894, "set_robot_commands": 0.01492683612668997, "deviation-center-line": 3.3761229140722087, "driven_lanedir_consec": 14.082195873383895, "sim_compute_sim_state": 0.08519932909299033, "sim_compute_performance-ego0": 0.011180515972624686, "sim_compute_performance-ego1": 0.006615780100520403, "sim_compute_performance-ego2": 0.006866799708096037, "sim_compute_performance-ego3": 0.0068686171855510585}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.288432337203725, "get_ui_image": 0.10957153464898638, "step_physics": 0.9630887746068176, "survival_time": 48.099999999999405, "driven_lanedir": 10.909233457179283, "get_state_dump": 0.06036328823766976, "get_robot_state": 0.06392154837199338, "sim_render-ego0": 0.01373268535451602, "sim_render-ego1": 0.01033455090111785, "sim_render-ego2": 0.011251350305781062, "sim_render-ego3": 0.011453701823423708, "get_duckie_state": 4.620566917728412e-06, "in-drivable-lane": 0.3500000000000032, "deviation-heading": 10.291517953394273, "agent_compute-ego0": 0.16530507004520975, "agent_compute-ego1": 0.13735119501749674, "agent_compute-ego2": 0.14489576378344005, "agent_compute-ego3": 0.14760318178749282, "complete-iteration": 2.004817672483894, "set_robot_commands": 0.01492683612668997, "deviation-center-line": 3.973005565851766, "driven_lanedir_consec": 10.909233457179283, "sim_compute_sim_state": 0.08519932909299033, "sim_compute_performance-ego0": 0.011180515972624686, "sim_compute_performance-ego1": 0.006615780100520403, "sim_compute_performance-ego2": 0.006866799708096037, "sim_compute_performance-ego3": 0.0068686171855510585}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.289474282206614, "get_ui_image": 0.08520067927888694, "step_physics": 0.8194532590369655, "survival_time": 25.500000000000227, "driven_lanedir": 8.76615241756709, "get_state_dump": 0.032382122457843936, "get_robot_state": 0.053337270266389195, "sim_render-ego0": 0.011745809342296624, "sim_render-ego1": 0.009738564257985692, "sim_render-ego2": 0.009280128721621638, "sim_render-ego3": 0.0093292326843202, "get_duckie_state": 4.818294846148407e-06, "in-drivable-lane": 7.0000000000000995, "deviation-heading": 3.355866733742272, "agent_compute-ego0": 0.12498468755509289, "agent_compute-ego1": 0.1077189464158508, "agent_compute-ego2": 0.10894612183542868, "agent_compute-ego3": 0.10911616513873731, "complete-iteration": 1.591944995924918, "set_robot_commands": 0.007333363105639552, "deviation-center-line": 1.1572362815813495, "driven_lanedir_consec": 8.76615241756709, "sim_compute_sim_state": 0.06129986152723577, "sim_compute_performance-ego0": 0.007586980285943137, "sim_compute_performance-ego1": 0.005160069512294464, "sim_compute_performance-ego2": 0.004905901776367904, "sim_compute_performance-ego3": 0.005195179097573118}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.634422435690906, "get_ui_image": 0.08520067927888694, "step_physics": 0.8194532590369655, "survival_time": 25.500000000000227, "driven_lanedir": 3.060634333986818, "get_state_dump": 0.032382122457843936, "get_robot_state": 0.053337270266389195, "sim_render-ego0": 0.011745809342296624, "sim_render-ego1": 0.009738564257985692, "sim_render-ego2": 0.009280128721621638, "sim_render-ego3": 0.0093292326843202, "get_duckie_state": 4.818294846148407e-06, "in-drivable-lane": 1.3000000000000007, "deviation-heading": 9.103409844428269, "agent_compute-ego0": 0.12498468755509289, "agent_compute-ego1": 0.1077189464158508, "agent_compute-ego2": 0.10894612183542868, "agent_compute-ego3": 0.10911616513873731, "complete-iteration": 1.591944995924918, "set_robot_commands": 0.007333363105639552, "deviation-center-line": 3.5437718854438516, "driven_lanedir_consec": 3.060634333986818, "sim_compute_sim_state": 0.06129986152723577, "sim_compute_performance-ego0": 0.007586980285943137, "sim_compute_performance-ego1": 0.005160069512294464, "sim_compute_performance-ego2": 0.004905901776367904, "sim_compute_performance-ego3": 0.005195179097573118}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 4.131995111470532, "get_ui_image": 0.08520067927888694, "step_physics": 0.8194532590369655, "survival_time": 25.500000000000227, "driven_lanedir": 4.082488962295669, "get_state_dump": 0.032382122457843936, "get_robot_state": 0.053337270266389195, "sim_render-ego0": 0.011745809342296624, "sim_render-ego1": 0.009738564257985692, "sim_render-ego2": 0.009280128721621638, "sim_render-ego3": 0.0093292326843202, "get_duckie_state": 4.818294846148407e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.200506294096474, "agent_compute-ego0": 0.12498468755509289, "agent_compute-ego1": 0.1077189464158508, "agent_compute-ego2": 0.10894612183542868, "agent_compute-ego3": 0.10911616513873731, "complete-iteration": 1.591944995924918, "set_robot_commands": 0.007333363105639552, "deviation-center-line": 2.793224769868812, "driven_lanedir_consec": 4.082488962295669, "sim_compute_sim_state": 0.06129986152723577, "sim_compute_performance-ego0": 0.007586980285943137, "sim_compute_performance-ego1": 0.005160069512294464, "sim_compute_performance-ego2": 0.004905901776367904, "sim_compute_performance-ego3": 0.005195179097573118}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.166247135608948, "get_ui_image": 0.08520067927888694, "step_physics": 0.8194532590369655, "survival_time": 25.500000000000227, "driven_lanedir": 11.573623696993607, "get_state_dump": 0.032382122457843936, "get_robot_state": 0.053337270266389195, "sim_render-ego0": 0.011745809342296624, "sim_render-ego1": 0.009738564257985692, "sim_render-ego2": 0.009280128721621638, "sim_render-ego3": 0.0093292326843202, "get_duckie_state": 4.818294846148407e-06, "in-drivable-lane": 1.050000000000015, "deviation-heading": 3.939493375876067, "agent_compute-ego0": 0.12498468755509289, "agent_compute-ego1": 0.1077189464158508, "agent_compute-ego2": 0.10894612183542868, "agent_compute-ego3": 0.10911616513873731, "complete-iteration": 1.591944995924918, "set_robot_commands": 0.007333363105639552, "deviation-center-line": 1.548662468903218, "driven_lanedir_consec": 11.573623696993607, "sim_compute_sim_state": 0.06129986152723577, "sim_compute_performance-ego0": 0.007586980285943137, "sim_compute_performance-ego1": 0.005160069512294464, "sim_compute_performance-ego2": 0.004905901776367904, "sim_compute_performance-ego3": 0.005195179097573118}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.542051695809606, "get_ui_image": 0.053927317909572434, "step_physics": 0.3281351053936881, "survival_time": 7.99999999999998, "driven_lanedir": 3.485589746288337, "get_state_dump": 0.025753663933795433, "get_robot_state": 0.0225176411385862, "sim_render-ego0": 0.010932110851595862, "sim_render-ego1": 0.008101438143238517, "get_duckie_state": 4.633613254712976e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1525089054371125, "agent_compute-ego0": 0.1188771546997639, "agent_compute-ego1": 0.099689211164202, "complete-iteration": 0.7147099320192515, "set_robot_commands": 0.005436190907259165, "deviation-center-line": 0.5244579909543857, "driven_lanedir_consec": 3.485589746288337, "sim_compute_sim_state": 0.02277100308341269, "sim_compute_performance-ego0": 0.007261101503549896, "sim_compute_performance-ego1": 0.005451057268225629}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.222519519891979, "get_ui_image": 0.053927317909572434, "step_physics": 0.3281351053936881, "survival_time": 7.99999999999998, "driven_lanedir": 3.1399072970072126, "get_state_dump": 0.025753663933795433, "get_robot_state": 0.0225176411385862, "sim_render-ego0": 0.010932110851595862, "sim_render-ego1": 0.008101438143238517, "get_duckie_state": 4.633613254712976e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.6314448400562316, "agent_compute-ego0": 0.1188771546997639, "agent_compute-ego1": 0.099689211164202, "complete-iteration": 0.7147099320192515, "set_robot_commands": 0.005436190907259165, "deviation-center-line": 0.46580390692958307, "driven_lanedir_consec": 3.1399072970072126, "sim_compute_sim_state": 0.02277100308341269, "sim_compute_performance-ego0": 0.007261101503549896, "sim_compute_performance-ego1": 0.005451057268225629}}
set_robot_commands_max0.01492683612668997
set_robot_commands_mean0.009873298685497372
set_robot_commands_median0.009578250713281698
set_robot_commands_min0.005436190907259165
sim_compute_performance-ego0_max0.011180515972624686
sim_compute_performance-ego0_mean0.008812833295824348
sim_compute_performance-ego0_median0.008446869525042448
sim_compute_performance-ego0_min0.007261101503549896
sim_compute_performance-ego1_max0.006615780100520403
sim_compute_performance-ego1_mean0.0057769355223653085
sim_compute_performance-ego1_median0.0057178960813509
sim_compute_performance-ego1_min0.005160069512294464
sim_compute_sim_state_max0.08519932909299033
sim_compute_sim_state_mean0.0617533802437946
sim_compute_sim_state_median0.06129986152723577
sim_compute_sim_state_min0.02277100308341269
sim_render-ego0_max0.01373268535451602
sim_render-ego0_mean0.012106563531015134
sim_render-ego0_median0.011745809342296624
sim_render-ego0_min0.010932110851595862
sim_render-ego1_max0.01033455090111785
sim_render-ego1_mean0.009809280930710524
sim_render-ego1_median0.010208649026764023
sim_render-ego1_min0.008101438143238517
simulation-passed1
step_physics_max0.9630887746068176
step_physics_mean0.7715230374155405
step_physics_median0.8194532590369655
step_physics_min0.3281351053936881
survival_time_max57.14999999999889
survival_time_mean38.49999999999958
survival_time_min7.99999999999998

Highlights

62080

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.