Duckietown Challenges Home Challenges Submissions

Job 62115

Job ID62115
submission13578
userMárton Tim 🇭🇺
user label3626
challengeaido-LFV_multi-sim-validation
step356
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg03
date started
date completed
duration1:26:37
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.200000000000195
in-drivable-lane_median0.32500000000000107
driven_lanedir_consec_median6.5549358915067355
deviation-center-line_median1.547413430912079


other stats
agent_compute-ego0_max0.08858402867183507
agent_compute-ego0_mean0.08688713452809385
agent_compute-ego0_median0.0874363650246622
agent_compute-ego0_min0.08487993080703042
agent_compute-ego1_max0.09383528586297596
agent_compute-ego1_mean0.08861902522449497
agent_compute-ego1_median0.08702395757039388
agent_compute-ego1_min0.08609690231697581
complete-iteration_max1.5580918772198329
complete-iteration_mean1.350909739012526
complete-iteration_median1.494114522529705
complete-iteration_min0.7036871538561364
deviation-center-line_max3.58910551321615
deviation-center-line_mean1.6966158482572102
deviation-center-line_min0.4128592429526293
deviation-heading_max9.806603228498922
deviation-heading_mean5.260995323034602
deviation-heading_median5.142833619367243
deviation-heading_min1.811610977491286
driven_any_max27.933765816752988
driven_any_mean9.560937169828566
driven_any_median7.261436438658971
driven_any_min1.8042128596372464
driven_lanedir_consec_max27.402190747727033
driven_lanedir_consec_mean8.939529884583347
driven_lanedir_consec_min1.5068466413925474
driven_lanedir_max27.402190747727033
driven_lanedir_mean8.939529884583347
driven_lanedir_median6.5549358915067355
driven_lanedir_min1.5068466413925474
get_duckie_state_max3.5500972070426585e-06
get_duckie_state_mean3.4669087849282917e-06
get_duckie_state_median3.5291076988302253e-06
get_duckie_state_min3.369918171041052e-06
get_robot_state_max0.05264371897673561
get_robot_state_mean0.04847789452375194
get_robot_state_median0.05205743184653661
get_robot_state_min0.02620622629792374
get_state_dump_max0.03348515264449581
get_state_dump_mean0.031219233551445826
get_state_dump_median0.03205640405137962
get_state_dump_min0.023475825308904196
get_ui_image_max0.08373394692055533
get_ui_image_mean0.07547303316260016
get_ui_image_median0.078712301217522
get_ui_image_min0.05392233537757174
in-drivable-lane_max19.900000000000244
in-drivable-lane_mean2.4857142857143137
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 5.356869240088156, "get_ui_image": 0.07474820024223738, "step_physics": 0.6494325776253977, "survival_time": 23.200000000000195, "driven_lanedir": 5.267686713886854, "get_state_dump": 0.03348515264449581, "get_robot_state": 0.05205743184653661, "sim_render-ego0": 0.011053607797109953, "sim_render-ego1": 0.012633507226103097, "sim_render-ego2": 0.009824366210609354, "sim_render-ego3": 0.011185542486047232, "get_duckie_state": 3.5291076988302253e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.9751905771321434, "agent_compute-ego0": 0.08564461174831596, "agent_compute-ego1": 0.08702395757039388, "agent_compute-ego2": 0.09194005432949272, "agent_compute-ego3": 0.09342963823708154, "complete-iteration": 1.3241341098662345, "set_robot_commands": 0.009028921332410587, "deviation-center-line": 1.8013741904723823, "driven_lanedir_consec": 5.267686713886854, "sim_compute_sim_state": 0.045773211345877696, "sim_compute_performance-ego0": 0.006701018220634871, "sim_compute_performance-ego1": 0.007349016845867198, "sim_compute_performance-ego2": 0.00744788569788779, "sim_compute_performance-ego3": 0.007026705177881384}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 7.789785527378343, "get_ui_image": 0.07474820024223738, "step_physics": 0.6494325776253977, "survival_time": 23.200000000000195, "driven_lanedir": 7.689586441709319, "get_state_dump": 0.03348515264449581, "get_robot_state": 0.05205743184653661, "sim_render-ego0": 0.011053607797109953, "sim_render-ego1": 0.012633507226103097, "sim_render-ego2": 0.009824366210609354, "sim_render-ego3": 0.011185542486047232, "get_duckie_state": 3.5291076988302253e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.792473583746492, "agent_compute-ego0": 0.08564461174831596, "agent_compute-ego1": 0.08702395757039388, "agent_compute-ego2": 0.09194005432949272, "agent_compute-ego3": 0.09342963823708154, "complete-iteration": 1.3241341098662345, "set_robot_commands": 0.009028921332410587, "deviation-center-line": 1.4171013372992145, "driven_lanedir_consec": 7.689586441709319, "sim_compute_sim_state": 0.045773211345877696, "sim_compute_performance-ego0": 0.006701018220634871, "sim_compute_performance-ego1": 0.007349016845867198, "sim_compute_performance-ego2": 0.00744788569788779, "sim_compute_performance-ego3": 0.007026705177881384}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 5.478167598103866, "get_ui_image": 0.07474820024223738, "step_physics": 0.6494325776253977, "survival_time": 23.200000000000195, "driven_lanedir": 5.420285341304153, "get_state_dump": 0.03348515264449581, "get_robot_state": 0.05205743184653661, "sim_render-ego0": 0.011053607797109953, "sim_render-ego1": 0.012633507226103097, "sim_render-ego2": 0.009824366210609354, "sim_render-ego3": 0.011185542486047232, "get_duckie_state": 3.5291076988302253e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.5119391759623872, "agent_compute-ego0": 0.08564461174831596, "agent_compute-ego1": 0.08702395757039388, "agent_compute-ego2": 0.09194005432949272, "agent_compute-ego3": 0.09342963823708154, "complete-iteration": 1.3241341098662345, "set_robot_commands": 0.009028921332410587, "deviation-center-line": 1.6645650791883535, "driven_lanedir_consec": 5.420285341304153, "sim_compute_sim_state": 0.045773211345877696, "sim_compute_performance-ego0": 0.006701018220634871, "sim_compute_performance-ego1": 0.007349016845867198, "sim_compute_performance-ego2": 0.00744788569788779, "sim_compute_performance-ego3": 0.007026705177881384}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 11.367728869283878, "get_ui_image": 0.07474820024223738, "step_physics": 0.6494325776253977, "survival_time": 23.200000000000195, "driven_lanedir": 11.220583289160649, "get_state_dump": 0.03348515264449581, "get_robot_state": 0.05205743184653661, "sim_render-ego0": 0.011053607797109953, "sim_render-ego1": 0.012633507226103097, "sim_render-ego2": 0.009824366210609354, "sim_render-ego3": 0.011185542486047232, "get_duckie_state": 3.5291076988302253e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.0794995839580688, "agent_compute-ego0": 0.08564461174831596, "agent_compute-ego1": 0.08702395757039388, "agent_compute-ego2": 0.09194005432949272, "agent_compute-ego3": 0.09342963823708154, "complete-iteration": 1.3241341098662345, "set_robot_commands": 0.009028921332410587, "deviation-center-line": 1.154380590728063, "driven_lanedir_consec": 11.220583289160649, "sim_compute_sim_state": 0.045773211345877696, "sim_compute_performance-ego0": 0.006701018220634871, "sim_compute_performance-ego1": 0.007349016845867198, "sim_compute_performance-ego2": 0.00744788569788779, "sim_compute_performance-ego3": 0.007026705177881384}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.8538521755902235, "get_ui_image": 0.08373394692055533, "step_physics": 0.8727625296494671, "survival_time": 21.35000000000017, "driven_lanedir": 1.6165912108540368, "get_state_dump": 0.03205640405137962, "get_robot_state": 0.05186836686089774, "sim_render-ego0": 0.0112823543147506, "sim_render-ego1": 0.011811811790288052, "sim_render-ego2": 0.01093822717666626, "sim_render-ego3": 0.01139416538666342, "get_duckie_state": 3.5500972070426585e-06, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 8.62412885814695, "agent_compute-ego0": 0.08858402867183507, "agent_compute-ego1": 0.08609690231697581, "agent_compute-ego2": 0.09426194150871206, "agent_compute-ego3": 0.08964606311833748, "complete-iteration": 1.5580918772198329, "set_robot_commands": 0.008911475956997025, "deviation-center-line": 1.8026618497075255, "driven_lanedir_consec": 1.6165912108540368, "sim_compute_sim_state": 0.04995649941613741, "sim_compute_performance-ego0": 0.007865750901052885, "sim_compute_performance-ego1": 0.007069832810731692, "sim_compute_performance-ego2": 0.007066402479866955, "sim_compute_performance-ego3": 0.00626131530119994}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 6.733087349939599, "get_ui_image": 0.08373394692055533, "step_physics": 0.8727625296494671, "survival_time": 21.35000000000017, "driven_lanedir": 5.271109878982928, "get_state_dump": 0.03205640405137962, "get_robot_state": 0.05186836686089774, "sim_render-ego0": 0.0112823543147506, "sim_render-ego1": 0.011811811790288052, "sim_render-ego2": 0.01093822717666626, "sim_render-ego3": 0.01139416538666342, "get_duckie_state": 3.5500972070426585e-06, "in-drivable-lane": 2.250000000000001, "deviation-heading": 7.027380481771888, "agent_compute-ego0": 0.08858402867183507, "agent_compute-ego1": 0.08609690231697581, "agent_compute-ego2": 0.09426194150871206, "agent_compute-ego3": 0.08964606311833748, "complete-iteration": 1.5580918772198329, "set_robot_commands": 0.008911475956997025, "deviation-center-line": 1.7003697830887987, "driven_lanedir_consec": 5.271109878982928, "sim_compute_sim_state": 0.04995649941613741, "sim_compute_performance-ego0": 0.007865750901052885, "sim_compute_performance-ego1": 0.007069832810731692, "sim_compute_performance-ego2": 0.007066402479866955, "sim_compute_performance-ego3": 0.00626131530119994}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 9.777235057351124, "get_ui_image": 0.08373394692055533, "step_physics": 0.8727625296494671, "survival_time": 21.35000000000017, "driven_lanedir": 8.577163290279838, "get_state_dump": 0.03205640405137962, "get_robot_state": 0.05186836686089774, "sim_render-ego0": 0.0112823543147506, "sim_render-ego1": 0.011811811790288052, "sim_render-ego2": 0.01093822717666626, "sim_render-ego3": 0.01139416538666342, "get_duckie_state": 3.5500972070426585e-06, "in-drivable-lane": 2.3000000000000247, "deviation-heading": 4.949321412002788, "agent_compute-ego0": 0.08858402867183507, "agent_compute-ego1": 0.08609690231697581, "agent_compute-ego2": 0.09426194150871206, "agent_compute-ego3": 0.08964606311833748, "complete-iteration": 1.5580918772198329, "set_robot_commands": 0.008911475956997025, "deviation-center-line": 1.3815495815938803, "driven_lanedir_consec": 8.577163290279838, "sim_compute_sim_state": 0.04995649941613741, "sim_compute_performance-ego0": 0.007865750901052885, "sim_compute_performance-ego1": 0.007069832810731692, "sim_compute_performance-ego2": 0.007066402479866955, "sim_compute_performance-ego3": 0.00626131530119994}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.8042128596372464, "get_ui_image": 0.08373394692055533, "step_physics": 0.8727625296494671, "survival_time": 21.35000000000017, "driven_lanedir": 1.5068466413925474, "get_state_dump": 0.03205640405137962, "get_robot_state": 0.05186836686089774, "sim_render-ego0": 0.0112823543147506, "sim_render-ego1": 0.011811811790288052, "sim_render-ego2": 0.01093822717666626, "sim_render-ego3": 0.01139416538666342, "get_duckie_state": 3.5500972070426585e-06, "in-drivable-lane": 0.4499999999999984, "deviation-heading": 6.218274183011506, "agent_compute-ego0": 0.08858402867183507, "agent_compute-ego1": 0.08609690231697581, "agent_compute-ego2": 0.09426194150871206, "agent_compute-ego3": 0.08964606311833748, "complete-iteration": 1.5580918772198329, "set_robot_commands": 0.008911475956997025, "deviation-center-line": 2.544616694404326, "driven_lanedir_consec": 1.5068466413925474, "sim_compute_sim_state": 0.04995649941613741, "sim_compute_performance-ego0": 0.007865750901052885, "sim_compute_performance-ego1": 0.007069832810731692, "sim_compute_performance-ego2": 0.007066402479866955, "sim_compute_performance-ego3": 0.00626131530119994}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.633481807808629, "get_ui_image": 0.078712301217522, "step_physics": 0.7882254762226906, "survival_time": 25.900000000000233, "driven_lanedir": 8.152189985058246, "get_state_dump": 0.031987848079732845, "get_robot_state": 0.05264371897673561, "sim_render-ego0": 0.011637930236110795, "sim_render-ego1": 0.011041161641909209, "sim_render-ego2": 0.011294341960164624, "sim_render-ego3": 0.010725982846092856, "get_duckie_state": 3.370016755855612e-06, "in-drivable-lane": 8.050000000000113, "deviation-heading": 5.3363458267317, "agent_compute-ego0": 0.0874363650246622, "agent_compute-ego1": 0.09383528586297596, "agent_compute-ego2": 0.09827162948417296, "agent_compute-ego3": 0.09559603830752804, "complete-iteration": 1.494114522529705, "set_robot_commands": 0.008918676762222555, "deviation-center-line": 1.3486890141596573, "driven_lanedir_consec": 8.152189985058246, "sim_compute_sim_state": 0.05644919647187397, "sim_compute_performance-ego0": 0.008900647907587834, "sim_compute_performance-ego1": 0.006929096688654611, "sim_compute_performance-ego2": 0.007241855466985978, "sim_compute_performance-ego3": 0.00677322881988937}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.757334327886377, "get_ui_image": 0.078712301217522, "step_physics": 0.7882254762226906, "survival_time": 25.900000000000233, "driven_lanedir": 2.2541811135836167, "get_state_dump": 0.031987848079732845, "get_robot_state": 0.05264371897673561, "sim_render-ego0": 0.011637930236110795, "sim_render-ego1": 0.011041161641909209, "sim_render-ego2": 0.011294341960164624, "sim_render-ego3": 0.010725982846092856, "get_duckie_state": 3.370016755855612e-06, "in-drivable-lane": 19.900000000000244, "deviation-heading": 2.756319450527469, "agent_compute-ego0": 0.0874363650246622, "agent_compute-ego1": 0.09383528586297596, "agent_compute-ego2": 0.09827162948417296, "agent_compute-ego3": 0.09559603830752804, "complete-iteration": 1.494114522529705, "set_robot_commands": 0.008918676762222555, "deviation-center-line": 0.4128592429526293, "driven_lanedir_consec": 2.2541811135836167, "sim_compute_sim_state": 0.05644919647187397, "sim_compute_performance-ego0": 0.008900647907587834, "sim_compute_performance-ego1": 0.006929096688654611, "sim_compute_performance-ego2": 0.007241855466985978, "sim_compute_performance-ego3": 0.00677322881988937}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 4.002773274968244, "get_ui_image": 0.078712301217522, "step_physics": 0.7882254762226906, "survival_time": 25.900000000000233, "driven_lanedir": 3.9432595193168463, "get_state_dump": 0.031987848079732845, "get_robot_state": 0.05264371897673561, "sim_render-ego0": 0.011637930236110795, "sim_render-ego1": 0.011041161641909209, "sim_render-ego2": 0.011294341960164624, "sim_render-ego3": 0.010725982846092856, "get_duckie_state": 3.370016755855612e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.811610977491286, "agent_compute-ego0": 0.0874363650246622, "agent_compute-ego1": 0.09383528586297596, "agent_compute-ego2": 0.09827162948417296, "agent_compute-ego3": 0.09559603830752804, "complete-iteration": 1.494114522529705, "set_robot_commands": 0.008918676762222555, "deviation-center-line": 0.8673884414191289, "driven_lanedir_consec": 3.9432595193168463, "sim_compute_sim_state": 0.05644919647187397, "sim_compute_performance-ego0": 0.008900647907587834, "sim_compute_performance-ego1": 0.006929096688654611, "sim_compute_performance-ego2": 0.007241855466985978, "sim_compute_performance-ego3": 0.00677322881988937}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.51837742665236, "get_ui_image": 0.078712301217522, "step_physics": 0.7882254762226906, "survival_time": 25.900000000000233, "driven_lanedir": 11.54198982453608, "get_state_dump": 0.031987848079732845, "get_robot_state": 0.05264371897673561, "sim_render-ego0": 0.011637930236110795, "sim_render-ego1": 0.011041161641909209, "sim_render-ego2": 0.011294341960164624, "sim_render-ego3": 0.010725982846092856, "get_duckie_state": 3.370016755855612e-06, "in-drivable-lane": 1.200000000000017, "deviation-heading": 5.34962922228917, "agent_compute-ego0": 0.0874363650246622, "agent_compute-ego1": 0.09383528586297596, "agent_compute-ego2": 0.09827162948417296, "agent_compute-ego3": 0.09559603830752804, "complete-iteration": 1.494114522529705, "set_robot_commands": 0.008918676762222555, "deviation-center-line": 1.4302617826358044, "driven_lanedir_consec": 11.54198982453608, "sim_compute_sim_state": 0.05644919647187397, "sim_compute_performance-ego0": 0.008900647907587834, "sim_compute_performance-ego1": 0.006929096688654611, "sim_compute_performance-ego2": 0.007241855466985978, "sim_compute_performance-ego3": 0.00677322881988937}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 27.933765816752988, "get_ui_image": 0.05392233537757174, "step_physics": 0.34940477173347506, "survival_time": 56.09999999999895, "driven_lanedir": 27.402190747727033, "get_state_dump": 0.023475825308904196, "get_robot_state": 0.02620622629792374, "sim_render-ego0": 0.01101289173374193, "sim_render-ego1": 0.011188477994285306, "get_duckie_state": 3.369918171041052e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.415217961213674, "agent_compute-ego0": 0.08487993080703042, "agent_compute-ego1": 0.08642088507077361, "complete-iteration": 0.7036871538561364, "set_robot_commands": 0.007969191959683425, "deviation-center-line": 3.58910551321615, "driven_lanedir_consec": 27.402190747727033, "sim_compute_sim_state": 0.02615609088330426, "sim_compute_performance-ego0": 0.007193984671140078, "sim_compute_performance-ego1": 0.007007038391602432}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 25.846449046158884, "get_ui_image": 0.05392233537757174, "step_physics": 0.34940477173347506, "survival_time": 56.09999999999895, "driven_lanedir": 25.2897543863747, "get_state_dump": 0.023475825308904196, "get_robot_state": 0.02620622629792374, "sim_render-ego0": 0.01101289173374193, "sim_render-ego1": 0.011188477994285306, "get_duckie_state": 3.369918171041052e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 9.806603228498922, "agent_compute-ego0": 0.08487993080703042, "agent_compute-ego1": 0.08642088507077361, "complete-iteration": 0.7036871538561364, "set_robot_commands": 0.007969191959683425, "deviation-center-line": 2.6376987747350307, "driven_lanedir_consec": 25.2897543863747, "sim_compute_sim_state": 0.02615609088330426, "sim_compute_performance-ego0": 0.007193984671140078, "sim_compute_performance-ego1": 0.007007038391602432}}
set_robot_commands_max0.009028921332410587
set_robot_commands_mean0.008812477151849107
set_robot_commands_median0.008918676762222555
set_robot_commands_min0.007969191959683425
sim_compute_performance-ego0_max0.008900647907587834
sim_compute_performance-ego0_mean0.007732688389955894
sim_compute_performance-ego0_median0.007865750901052885
sim_compute_performance-ego0_min0.006701018220634871
sim_compute_performance-ego1_max0.007349016845867198
sim_compute_performance-ego1_mean0.0071004187260156355
sim_compute_performance-ego1_median0.007069832810731692
sim_compute_performance-ego1_min0.006929096688654611
sim_compute_sim_state_max0.05644919647187397
sim_compute_sim_state_mean0.04721627219301178
sim_compute_sim_state_median0.04995649941613741
sim_compute_sim_state_min0.02615609088330426
sim_render-ego0_max0.011637930236110795
sim_render-ego0_mean0.011280096632812087
sim_render-ego0_median0.0112823543147506
sim_render-ego0_min0.01101289173374193
sim_render-ego1_max0.012633507226103097
sim_render-ego1_mean0.011737348472983716
sim_render-ego1_median0.011811811790288052
sim_render-ego1_min0.011041161641909209
simulation-passed1
step_physics_max0.8727625296494671
step_physics_mean0.7100351341040837
step_physics_median0.7882254762226906
step_physics_min0.34940477173347506
survival_time_max56.09999999999895
survival_time_mean28.142857142857164
survival_time_min21.35000000000017

Highlights

62115

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

challenge-solution-output

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.