Duckietown Challenges Home Challenges Submissions

Submission 13070

Submission13070
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserMikita Sazanovich 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60345
Next
User label2dil
Admin priority50
Blessingn/a
User priority50

60345

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
60345LFVmultibodyv-simsuccessyes1:23:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.585417682235404
survival_time_median49.699999999999314
deviation-center-line_median3.096242223533725
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012113241232205788
agent_compute-ego0_mean0.011827003593259042
agent_compute-ego0_median0.01203097863630815
agent_compute-ego0_min0.0114094723875706
agent_compute-ego1_max0.01183990276221073
agent_compute-ego1_mean0.011441383187445937
agent_compute-ego1_median0.0114292427463198
agent_compute-ego1_min0.01116225084467749
agent_compute-ego2_max0.012197536592380293
agent_compute-ego2_mean0.011842125966799266
agent_compute-ego2_median0.011934669090039802
agent_compute-ego2_min0.011394172217977706
agent_compute-ego3_max0.011831568226669774
agent_compute-ego3_mean0.011588967419893813
agent_compute-ego3_median0.01174830874237391
agent_compute-ego3_min0.011187025290637758
complete-iteration_max1.055359643067448
complete-iteration_mean0.8884067337571558
complete-iteration_median1.0024870961155723
complete-iteration_min0.2975479169533803
deviation-center-line_max5.77610653299878
deviation-center-line_mean2.9972589817547433
deviation-center-line_min0.5253138431377542
deviation-heading_max20.05807975125181
deviation-heading_mean10.324099531398486
deviation-heading_median9.895341567548565
deviation-heading_min2.963123848624243
driven_any_max16.43314218980252
driven_any_mean8.06588526202585
driven_any_median6.860537450972676
driven_any_min1.0171296098734297
driven_lanedir_consec_max15.512675521435742
driven_lanedir_consec_mean7.643562332399493
driven_lanedir_consec_min0.9718406425564514
driven_lanedir_max15.512675521435742
driven_lanedir_mean7.643562332399493
driven_lanedir_median6.585417682235404
driven_lanedir_min0.9718406425564514
get_duckie_state_max1.528768828420928e-06
get_duckie_state_mean1.484767223862401e-06
get_duckie_state_median1.501917240008637e-06
get_duckie_state_min1.4249530064871072e-06
get_robot_state_max0.014364210042086515
get_robot_state_mean0.013094760575504358
get_robot_state_median0.014115734163867149
get_robot_state_min0.007036333473829122
get_state_dump_max0.009678965626340925
get_state_dump_mean0.008969537555810496
get_state_dump_median0.00934286716595367
get_state_dump_min0.006137906358792231
get_ui_image_max0.04960433867055113
get_ui_image_mean0.0440879389026931
get_ui_image_median0.04674985205108796
get_ui_image_min0.030054524540901184
in-drivable-lane_max0.9499999999999816
in-drivable-lane_mean0.1999999999999951
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.0171296098734297, "get_ui_image": 0.04292633316733621, "step_physics": 0.7370922276467988, "survival_time": 16.4500000000001, "driven_lanedir": 0.9718406425564514, "get_state_dump": 0.009678965626340925, "get_robot_state": 0.014364210042086515, "sim_render-ego0": 0.003820269758051092, "sim_render-ego1": 0.003724546865983443, "sim_render-ego2": 0.00370745731122566, "sim_render-ego3": 0.00375024549888842, "get_duckie_state": 1.528768828420928e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.984617187572397, "agent_compute-ego0": 0.01203097863630815, "agent_compute-ego1": 0.01183990276221073, "agent_compute-ego2": 0.011934669090039802, "agent_compute-ego3": 0.011831568226669774, "complete-iteration": 0.9028028704903344, "set_robot_commands": 0.002242721210826527, "deviation-center-line": 1.5286972023654894, "driven_lanedir_consec": 0.9718406425564514, "sim_compute_sim_state": 0.01874809843121153, "sim_compute_performance-ego0": 0.0020270882230816467, "sim_compute_performance-ego1": 0.002023193330475778, "sim_compute_performance-ego2": 0.001966527014067679, "sim_compute_performance-ego3": 0.0019931468096646395}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.3178716605236573, "get_ui_image": 0.04292633316733621, "step_physics": 0.7370922276467988, "survival_time": 16.4500000000001, "driven_lanedir": 3.262980837715598, "get_state_dump": 0.009678965626340925, "get_robot_state": 0.014364210042086515, "sim_render-ego0": 0.003820269758051092, "sim_render-ego1": 0.003724546865983443, "sim_render-ego2": 0.00370745731122566, "sim_render-ego3": 0.00375024549888842, "get_duckie_state": 1.528768828420928e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.963123848624243, "agent_compute-ego0": 0.01203097863630815, "agent_compute-ego1": 0.01183990276221073, "agent_compute-ego2": 0.011934669090039802, "agent_compute-ego3": 0.011831568226669774, "complete-iteration": 0.9028028704903344, "set_robot_commands": 0.002242721210826527, "deviation-center-line": 0.5253138431377542, "driven_lanedir_consec": 3.262980837715598, "sim_compute_sim_state": 0.01874809843121153, "sim_compute_performance-ego0": 0.0020270882230816467, "sim_compute_performance-ego1": 0.002023193330475778, "sim_compute_performance-ego2": 0.001966527014067679, "sim_compute_performance-ego3": 0.0019931468096646395}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.0986029339938923, "get_ui_image": 0.04292633316733621, "step_physics": 0.7370922276467988, "survival_time": 16.4500000000001, "driven_lanedir": 1.08747985267994, "get_state_dump": 0.009678965626340925, "get_robot_state": 0.014364210042086515, "sim_render-ego0": 0.003820269758051092, "sim_render-ego1": 0.003724546865983443, "sim_render-ego2": 0.00370745731122566, "sim_render-ego3": 0.00375024549888842, "get_duckie_state": 1.528768828420928e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.399030917925666, "agent_compute-ego0": 0.01203097863630815, "agent_compute-ego1": 0.01183990276221073, "agent_compute-ego2": 0.011934669090039802, "agent_compute-ego3": 0.011831568226669774, "complete-iteration": 0.9028028704903344, "set_robot_commands": 0.002242721210826527, "deviation-center-line": 1.7936205752021344, "driven_lanedir_consec": 1.08747985267994, "sim_compute_sim_state": 0.01874809843121153, "sim_compute_performance-ego0": 0.0020270882230816467, "sim_compute_performance-ego1": 0.002023193330475778, "sim_compute_performance-ego2": 0.001966527014067679, "sim_compute_performance-ego3": 0.0019931468096646395}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 4.542894447887895, "get_ui_image": 0.04292633316733621, "step_physics": 0.7370922276467988, "survival_time": 16.4500000000001, "driven_lanedir": 4.327641114148619, "get_state_dump": 0.009678965626340925, "get_robot_state": 0.014364210042086515, "sim_render-ego0": 0.003820269758051092, "sim_render-ego1": 0.003724546865983443, "sim_render-ego2": 0.00370745731122566, "sim_render-ego3": 0.00375024549888842, "get_duckie_state": 1.528768828420928e-06, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 3.235380773674476, "agent_compute-ego0": 0.01203097863630815, "agent_compute-ego1": 0.01183990276221073, "agent_compute-ego2": 0.011934669090039802, "agent_compute-ego3": 0.011831568226669774, "complete-iteration": 0.9028028704903344, "set_robot_commands": 0.002242721210826527, "deviation-center-line": 1.5011172554020251, "driven_lanedir_consec": 4.327641114148619, "sim_compute_sim_state": 0.01874809843121153, "sim_compute_performance-ego0": 0.0020270882230816467, "sim_compute_performance-ego1": 0.002023193330475778, "sim_compute_performance-ego2": 0.001966527014067679, "sim_compute_performance-ego3": 0.0019931468096646395}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 16.43314218980252, "get_ui_image": 0.04960433867055113, "step_physics": 0.8633058865203349, "survival_time": 59.99999999999873, "driven_lanedir": 15.512675521435742, "get_state_dump": 0.009302595473646024, "get_robot_state": 0.014115734163867149, "sim_render-ego0": 0.003663374919081409, "sim_render-ego1": 0.0036032322939984706, "sim_render-ego2": 0.003584320003245891, "sim_render-ego3": 0.003592761132639711, "get_duckie_state": 1.4249530064871072e-06, "in-drivable-lane": 0.0, "deviation-heading": 17.00064720398813, "agent_compute-ego0": 0.012113241232205788, "agent_compute-ego1": 0.0114292427463198, "agent_compute-ego2": 0.012197536592380293, "agent_compute-ego3": 0.01174830874237391, "complete-iteration": 1.055359643067448, "set_robot_commands": 0.0021338317912385227, "deviation-center-line": 3.819928726655851, "driven_lanedir_consec": 15.512675521435742, "sim_compute_sim_state": 0.0408225524038399, "sim_compute_performance-ego0": 0.0019421265782364997, "sim_compute_performance-ego1": 0.001883375158317877, "sim_compute_performance-ego2": 0.0018878411889374008, "sim_compute_performance-ego3": 0.0018774166790075247}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.403427491706232, "get_ui_image": 0.04960433867055113, "step_physics": 0.8633058865203349, "survival_time": 59.99999999999873, "driven_lanedir": 10.538552793675125, "get_state_dump": 0.009302595473646024, "get_robot_state": 0.014115734163867149, "sim_render-ego0": 0.003663374919081409, "sim_render-ego1": 0.0036032322939984706, "sim_render-ego2": 0.003584320003245891, "sim_render-ego3": 0.003592761132639711, "get_duckie_state": 1.4249530064871072e-06, "in-drivable-lane": 0.9499999999999816, "deviation-heading": 20.05807975125181, "agent_compute-ego0": 0.012113241232205788, "agent_compute-ego1": 0.0114292427463198, "agent_compute-ego2": 0.012197536592380293, "agent_compute-ego3": 0.01174830874237391, "complete-iteration": 1.055359643067448, "set_robot_commands": 0.0021338317912385227, "deviation-center-line": 4.6990768329463135, "driven_lanedir_consec": 10.538552793675125, "sim_compute_sim_state": 0.0408225524038399, "sim_compute_performance-ego0": 0.0019421265782364997, "sim_compute_performance-ego1": 0.001883375158317877, "sim_compute_performance-ego2": 0.0018878411889374008, "sim_compute_performance-ego3": 0.0018774166790075247}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 15.021867426382263, "get_ui_image": 0.04960433867055113, "step_physics": 0.8633058865203349, "survival_time": 59.99999999999873, "driven_lanedir": 14.034102757398658, "get_state_dump": 0.009302595473646024, "get_robot_state": 0.014115734163867149, "sim_render-ego0": 0.003663374919081409, "sim_render-ego1": 0.0036032322939984706, "sim_render-ego2": 0.003584320003245891, "sim_render-ego3": 0.003592761132639711, "get_duckie_state": 1.4249530064871072e-06, "in-drivable-lane": 0.649999999999963, "deviation-heading": 18.049722701160903, "agent_compute-ego0": 0.012113241232205788, "agent_compute-ego1": 0.0114292427463198, "agent_compute-ego2": 0.012197536592380293, "agent_compute-ego3": 0.01174830874237391, "complete-iteration": 1.055359643067448, "set_robot_commands": 0.0021338317912385227, "deviation-center-line": 4.0743934928745, "driven_lanedir_consec": 14.034102757398658, "sim_compute_sim_state": 0.0408225524038399, "sim_compute_performance-ego0": 0.0019421265782364997, "sim_compute_performance-ego1": 0.001883375158317877, "sim_compute_performance-ego2": 0.0018878411889374008, "sim_compute_performance-ego3": 0.0018774166790075247}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.431585517538585, "get_ui_image": 0.04960433867055113, "step_physics": 0.8633058865203349, "survival_time": 59.99999999999873, "driven_lanedir": 10.640437573946242, "get_state_dump": 0.009302595473646024, "get_robot_state": 0.014115734163867149, "sim_render-ego0": 0.003663374919081409, "sim_render-ego1": 0.0036032322939984706, "sim_render-ego2": 0.003584320003245891, "sim_render-ego3": 0.003592761132639711, "get_duckie_state": 1.4249530064871072e-06, "in-drivable-lane": 0.20000000000000284, "deviation-heading": 14.168852350501492, "agent_compute-ego0": 0.012113241232205788, "agent_compute-ego1": 0.0114292427463198, "agent_compute-ego2": 0.012197536592380293, "agent_compute-ego3": 0.01174830874237391, "complete-iteration": 1.055359643067448, "set_robot_commands": 0.0021338317912385227, "deviation-center-line": 5.77610653299878, "driven_lanedir_consec": 10.640437573946242, "sim_compute_sim_state": 0.0408225524038399, "sim_compute_performance-ego0": 0.0019421265782364997, "sim_compute_performance-ego1": 0.001883375158317877, "sim_compute_performance-ego2": 0.0018878411889374008, "sim_compute_performance-ego3": 0.0018774166790075247}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 7.022630352362361, "get_ui_image": 0.04674985205108796, "step_physics": 0.8251868660126499, "survival_time": 49.699999999999314, "driven_lanedir": 6.776886031197286, "get_state_dump": 0.00934286716595367, "get_robot_state": 0.013833551071397023, "sim_render-ego0": 0.0036622620108139577, "sim_render-ego1": 0.003579318703119479, "sim_render-ego2": 0.003573417903190881, "sim_render-ego3": 0.0035530030427865645, "get_duckie_state": 1.501917240008637e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.9677188686408, "agent_compute-ego0": 0.011545556514107404, "agent_compute-ego1": 0.01116225084467749, "agent_compute-ego2": 0.011394172217977706, "agent_compute-ego3": 0.011187025290637758, "complete-iteration": 1.0024870961155723, "set_robot_commands": 0.002073021749755246, "deviation-center-line": 5.284879160252759, "driven_lanedir_consec": 6.776886031197286, "sim_compute_sim_state": 0.0317162635937408, "sim_compute_performance-ego0": 0.001917267085319787, "sim_compute_performance-ego1": 0.0018689982256098608, "sim_compute_performance-ego2": 0.0018432461436669431, "sim_compute_performance-ego3": 0.001862394869627066}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 13.589190833871644, "get_ui_image": 0.04674985205108796, "step_physics": 0.8251868660126499, "survival_time": 49.699999999999314, "driven_lanedir": 13.05032134145735, "get_state_dump": 0.00934286716595367, "get_robot_state": 0.013833551071397023, "sim_render-ego0": 0.0036622620108139577, "sim_render-ego1": 0.003579318703119479, "sim_render-ego2": 0.003573417903190881, "sim_render-ego3": 0.0035530030427865645, "get_duckie_state": 1.501917240008637e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.8322951719664, "agent_compute-ego0": 0.011545556514107404, "agent_compute-ego1": 0.01116225084467749, "agent_compute-ego2": 0.011394172217977706, "agent_compute-ego3": 0.011187025290637758, "complete-iteration": 1.0024870961155723, "set_robot_commands": 0.002073021749755246, "deviation-center-line": 3.2801665111568568, "driven_lanedir_consec": 13.05032134145735, "sim_compute_sim_state": 0.0317162635937408, "sim_compute_performance-ego0": 0.001917267085319787, "sim_compute_performance-ego1": 0.0018689982256098608, "sim_compute_performance-ego2": 0.0018432461436669431, "sim_compute_performance-ego3": 0.001862394869627066}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 6.698444549582991, "get_ui_image": 0.04674985205108796, "step_physics": 0.8251868660126499, "survival_time": 49.699999999999314, "driven_lanedir": 6.393949333273521, "get_state_dump": 0.00934286716595367, "get_robot_state": 0.013833551071397023, "sim_render-ego0": 0.0036622620108139577, "sim_render-ego1": 0.003579318703119479, "sim_render-ego2": 0.003573417903190881, "sim_render-ego3": 0.0035530030427865645, "get_duckie_state": 1.501917240008637e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.84041921231281, "agent_compute-ego0": 0.011545556514107404, "agent_compute-ego1": 0.01116225084467749, "agent_compute-ego2": 0.011394172217977706, "agent_compute-ego3": 0.011187025290637758, "complete-iteration": 1.0024870961155723, "set_robot_commands": 0.002073021749755246, "deviation-center-line": 3.842499095882515, "driven_lanedir_consec": 6.393949333273521, "sim_compute_sim_state": 0.0317162635937408, "sim_compute_performance-ego0": 0.001917267085319787, "sim_compute_performance-ego1": 0.0018689982256098608, "sim_compute_performance-ego2": 0.0018432461436669431, "sim_compute_performance-ego3": 0.001862394869627066}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 10.082821872207315, "get_ui_image": 0.04674985205108796, "step_physics": 0.8251868660126499, "survival_time": 49.699999999999314, "driven_lanedir": 9.636055488550213, "get_state_dump": 0.00934286716595367, "get_robot_state": 0.013833551071397023, "sim_render-ego0": 0.0036622620108139577, "sim_render-ego1": 0.003579318703119479, "sim_render-ego2": 0.003573417903190881, "sim_render-ego3": 0.0035530030427865645, "get_duckie_state": 1.501917240008637e-06, "in-drivable-lane": 0.4999999999999858, "deviation-heading": 7.95838796313073, "agent_compute-ego0": 0.011545556514107404, "agent_compute-ego1": 0.01116225084467749, "agent_compute-ego2": 0.011394172217977706, "agent_compute-ego3": 0.011187025290637758, "complete-iteration": 1.0024870961155723, "set_robot_commands": 0.002073021749755246, "deviation-center-line": 2.9123179359105933, "driven_lanedir_consec": 9.636055488550213, "sim_compute_sim_state": 0.0317162635937408, "sim_compute_performance-ego0": 0.001917267085319787, "sim_compute_performance-ego1": 0.0018689982256098608, "sim_compute_performance-ego2": 0.0018432461436669431, "sim_compute_performance-ego3": 0.001862394869627066}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 5.948993196889603, "get_ui_image": 0.030054524540901184, "step_physics": 0.2063572928309441, "survival_time": 20.75000000000016, "driven_lanedir": 5.742246545697299, "get_state_dump": 0.006137906358792231, "get_robot_state": 0.007036333473829122, "sim_render-ego0": 0.003676972137047694, "sim_render-ego1": 0.0035653504041525032, "get_duckie_state": 1.4820924172034631e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.353581791671478, "agent_compute-ego0": 0.0114094723875706, "agent_compute-ego1": 0.011226889605705555, "complete-iteration": 0.2975479169533803, "set_robot_commands": 0.0020689179117862997, "deviation-center-line": 1.3746970029263317, "driven_lanedir_consec": 5.742246545697299, "sim_compute_sim_state": 0.010092532405486474, "sim_compute_performance-ego0": 0.0018820086350807776, "sim_compute_performance-ego1": 0.0018614404476605929}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 5.313791585739535, "get_ui_image": 0.030054524540901184, "step_physics": 0.2063572928309441, "survival_time": 20.75000000000016, "driven_lanedir": 5.034702819860868, "get_state_dump": 0.006137906358792231, "get_robot_state": 0.007036333473829122, "sim_render-ego0": 0.003676972137047694, "sim_render-ego1": 0.0035653504041525032, "get_duckie_state": 1.4820924172034631e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.725535697157455, "agent_compute-ego0": 0.0114094723875706, "agent_compute-ego1": 0.011226889605705555, "complete-iteration": 0.2975479169533803, "set_robot_commands": 0.0020689179117862997, "deviation-center-line": 1.5488115768544994, "driven_lanedir_consec": 5.034702819860868, "sim_compute_sim_state": 0.010092532405486474, "sim_compute_performance-ego0": 0.0018820086350807776, "sim_compute_performance-ego1": 0.0018614404476605929}}
set_robot_commands_max0.002242721210826527
set_robot_commands_mean0.0021382953450609843
set_robot_commands_median0.0021338317912385227
set_robot_commands_min0.0020689179117862997
sim_compute_performance-ego0_max0.0020270882230816467
sim_compute_performance-ego0_mean0.0019507103440509488
sim_compute_performance-ego0_median0.0019421265782364997
sim_compute_performance-ego0_min0.0018820086350807776
sim_compute_performance-ego1_max0.002023193330475778
sim_compute_performance-ego1_mean0.0019160819823525175
sim_compute_performance-ego1_median0.001883375158317877
sim_compute_performance-ego1_min0.0018614404476605929
sim_compute_performance-ego2_max0.001966527014067679
sim_compute_performance-ego2_mean0.0018992047822240076
sim_compute_performance-ego2_median0.0018878411889374008
sim_compute_performance-ego2_min0.0018432461436669431
sim_compute_performance-ego3_max0.0019931468096646395
sim_compute_performance-ego3_mean0.001910986119433076
sim_compute_performance-ego3_median0.0018774166790075247
sim_compute_performance-ego3_min0.001862394869627066
sim_compute_sim_state_max0.0408225524038399
sim_compute_sim_state_mean0.027523765894724415
sim_compute_sim_state_median0.0317162635937408
sim_compute_sim_state_min0.010092532405486474
sim_render-ego0_max0.003820269758051092
sim_render-ego0_mean0.0037098265018486593
sim_render-ego0_median0.003663374919081409
sim_render-ego0_min0.0036622620108139577
sim_render-ego1_max0.003724546865983443
sim_render-ego1_mean0.003625649447193611
sim_render-ego1_median0.0036032322939984706
sim_render-ego1_min0.0035653504041525032
sim_render-ego2_max0.00370745731122566
sim_render-ego2_mean0.0036217317392208096
sim_render-ego2_median0.003584320003245891
sim_render-ego2_min0.003573417903190881
sim_render-ego3_max0.00375024549888842
sim_render-ego3_mean0.0036320032247715655
sim_render-ego3_median0.003592761132639711
sim_render-ego3_min0.0035530030427865645
simulation-passed1
step_physics_max0.8633058865203349
step_physics_mean0.7225038933129302
step_physics_median0.8251868660126499
step_physics_min0.2063572928309441
survival_time_max59.99999999999873
survival_time_mean39.00714285714235
survival_time_min16.4500000000001
No reset possible