Duckietown Challenges Home Challenges Submissions

Submission 13107

Submission13107
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserMikita Sazanovich 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 61709
Next
User label2dil
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
61709LFVmultibodyv-simsuccessyes1:29:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.361376876514083
survival_time_median49.04999999999935
deviation-center-line_median3.311568393983515
in-drivable-lane_median1.0499999999999794


other stats
agent_compute-ego0_max0.01201676254117076
agent_compute-ego0_mean0.01187343974554338
agent_compute-ego0_median0.01198727403651864
agent_compute-ego0_min0.011651984564176907
agent_compute-ego1_max0.0118911986942593
agent_compute-ego1_mean0.011600932001319826
agent_compute-ego1_median0.01178552724935629
agent_compute-ego1_min0.011215025064896564
agent_compute-ego2_max0.011931393168351732
agent_compute-ego2_mean0.011609672911265584
agent_compute-ego2_median0.011796914063416444
agent_compute-ego2_min0.01110071150202858
agent_compute-ego3_max0.011919473430496966
agent_compute-ego3_mean0.011643265155932735
agent_compute-ego3_median0.011800497859805912
agent_compute-ego3_min0.011209824177495333
complete-iteration_max1.1805350022986076
complete-iteration_mean0.8812487802549055
complete-iteration_median0.982712869739453
complete-iteration_min0.3277769948349518
deviation-center-line_max5.465294108107236
deviation-center-line_mean3.1159255350779644
deviation-center-line_min0.3714643849398333
deviation-heading_max26.079756179997872
deviation-heading_mean12.832411195595858
deviation-heading_median10.07346720246484
deviation-heading_min2.170902072056662
driven_any_max17.42232279724747
driven_any_mean9.722742360411075
driven_any_median8.983435056280735
driven_any_min1.75930942988996
driven_lanedir_consec_max15.515327057373296
driven_lanedir_consec_mean8.59586689217137
driven_lanedir_consec_min1.5475555886580803
driven_lanedir_max15.515327057373296
driven_lanedir_mean8.780647893634821
driven_lanedir_median8.361376876514083
driven_lanedir_min1.5475555886580803
get_duckie_state_max1.3139728616065746e-06
get_duckie_state_mean1.2892144619542414e-06
get_duckie_state_median1.3109441992040868e-06
get_duckie_state_min1.2466849931372294e-06
get_robot_state_max0.014003224625364095
get_robot_state_mean0.01296650363939148
get_robot_state_median0.013986163311176473
get_robot_state_min0.006888139815557571
get_state_dump_max0.009428882742071296
get_state_dump_mean0.008925383771292419
get_state_dump_median0.00939093045052839
get_state_dump_min0.006094741172531024
get_ui_image_max0.04956935367218958
get_ui_image_mean0.04414973981845841
get_ui_image_median0.0472057455668867
get_ui_image_min0.02949837113724274
in-drivable-lane_max3.6999999999999336
in-drivable-lane_mean1.128571428571418
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.878702502847364, "get_ui_image": 0.04299980455690676, "step_physics": 0.5862245867560217, "survival_time": 33.25000000000025, "driven_lanedir": 9.219870806590228, "get_state_dump": 0.009428882742071296, "get_robot_state": 0.013986163311176473, "sim_render-ego0": 0.0037079691528916, "sim_render-ego1": 0.003627297040578482, "sim_render-ego2": 0.003593052113736356, "sim_render-ego3": 0.003577370901365538, "get_duckie_state": 1.3109441992040868e-06, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 9.06510028654988, "agent_compute-ego0": 0.011651984564176907, "agent_compute-ego1": 0.01178552724935629, "agent_compute-ego2": 0.011796914063416444, "agent_compute-ego3": 0.011800497859805912, "complete-iteration": 0.7572343614366319, "set_robot_commands": 0.002153977975473032, "deviation-center-line": 2.6535950738223044, "driven_lanedir_consec": 9.219870806590228, "sim_compute_sim_state": 0.02675414264381111, "sim_compute_performance-ego0": 0.0019228981063888597, "sim_compute_performance-ego1": 0.0018766935881193696, "sim_compute_performance-ego2": 0.001873941392869921, "sim_compute_performance-ego3": 0.0018713527971559816}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 8.052711874502412, "get_ui_image": 0.04299980455690676, "step_physics": 0.5862245867560217, "survival_time": 33.25000000000025, "driven_lanedir": 7.192190526128912, "get_state_dump": 0.009428882742071296, "get_robot_state": 0.013986163311176473, "sim_render-ego0": 0.0037079691528916, "sim_render-ego1": 0.003627297040578482, "sim_render-ego2": 0.003593052113736356, "sim_render-ego3": 0.003577370901365538, "get_duckie_state": 1.3109441992040868e-06, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 8.353240965377598, "agent_compute-ego0": 0.011651984564176907, "agent_compute-ego1": 0.01178552724935629, "agent_compute-ego2": 0.011796914063416444, "agent_compute-ego3": 0.011800497859805912, "complete-iteration": 0.7572343614366319, "set_robot_commands": 0.002153977975473032, "deviation-center-line": 2.9987740875467432, "driven_lanedir_consec": 7.192190526128912, "sim_compute_sim_state": 0.02675414264381111, "sim_compute_performance-ego0": 0.0019228981063888597, "sim_compute_performance-ego1": 0.0018766935881193696, "sim_compute_performance-ego2": 0.001873941392869921, "sim_compute_performance-ego3": 0.0018713527971559816}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 8.088167609714105, "get_ui_image": 0.04299980455690676, "step_physics": 0.5862245867560217, "survival_time": 33.25000000000025, "driven_lanedir": 7.502882946437937, "get_state_dump": 0.009428882742071296, "get_robot_state": 0.013986163311176473, "sim_render-ego0": 0.0037079691528916, "sim_render-ego1": 0.003627297040578482, "sim_render-ego2": 0.003593052113736356, "sim_render-ego3": 0.003577370901365538, "get_duckie_state": 1.3109441992040868e-06, "in-drivable-lane": 0.6000000000000085, "deviation-heading": 11.0818341183798, "agent_compute-ego0": 0.011651984564176907, "agent_compute-ego1": 0.01178552724935629, "agent_compute-ego2": 0.011796914063416444, "agent_compute-ego3": 0.011800497859805912, "complete-iteration": 0.7572343614366319, "set_robot_commands": 0.002153977975473032, "deviation-center-line": 1.9812817134537055, "driven_lanedir_consec": 7.502882946437937, "sim_compute_sim_state": 0.02675414264381111, "sim_compute_performance-ego0": 0.0019228981063888597, "sim_compute_performance-ego1": 0.0018766935881193696, "sim_compute_performance-ego2": 0.001873941392869921, "sim_compute_performance-ego3": 0.0018713527971559816}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.25553403015589, "get_ui_image": 0.04299980455690676, "step_physics": 0.5862245867560217, "survival_time": 33.25000000000025, "driven_lanedir": 9.328373961099905, "get_state_dump": 0.009428882742071296, "get_robot_state": 0.013986163311176473, "sim_render-ego0": 0.0037079691528916, "sim_render-ego1": 0.003627297040578482, "sim_render-ego2": 0.003593052113736356, "sim_render-ego3": 0.003577370901365538, "get_duckie_state": 1.3109441992040868e-06, "in-drivable-lane": 2.2999999999999545, "deviation-heading": 8.65422781846906, "agent_compute-ego0": 0.011651984564176907, "agent_compute-ego1": 0.01178552724935629, "agent_compute-ego2": 0.011796914063416444, "agent_compute-ego3": 0.011800497859805912, "complete-iteration": 0.7572343614366319, "set_robot_commands": 0.002153977975473032, "deviation-center-line": 2.147987537323619, "driven_lanedir_consec": 9.328373961099905, "sim_compute_sim_state": 0.02675414264381111, "sim_compute_performance-ego0": 0.0019228981063888597, "sim_compute_performance-ego1": 0.0018766935881193696, "sim_compute_performance-ego2": 0.001873941392869921, "sim_compute_performance-ego3": 0.0018713527971559816}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 17.15207542476228, "get_ui_image": 0.04956935367218958, "step_physics": 0.7834692856949831, "survival_time": 59.99999999999873, "driven_lanedir": 15.515327057373296, "get_state_dump": 0.00939093045052839, "get_robot_state": 0.013949304893550825, "sim_render-ego0": 0.0037198539181216178, "sim_render-ego1": 0.0036360699370143615, "sim_render-ego2": 0.003605930731755113, "sim_render-ego3": 0.00359298366988132, "get_duckie_state": 1.2466849931372294e-06, "in-drivable-lane": 0.4499999999999984, "deviation-heading": 21.891923254573015, "agent_compute-ego0": 0.01198727403651864, "agent_compute-ego1": 0.0118911986942593, "agent_compute-ego2": 0.011931393168351732, "agent_compute-ego3": 0.011919473430496966, "complete-iteration": 0.982712869739453, "set_robot_commands": 0.0021349720712704624, "deviation-center-line": 4.589900313160045, "driven_lanedir_consec": 15.515327057373296, "sim_compute_sim_state": 0.04767189752450097, "sim_compute_performance-ego0": 0.001951177352473301, "sim_compute_performance-ego1": 0.0018993178374761349, "sim_compute_performance-ego2": 0.001888316239445136, "sim_compute_performance-ego3": 0.0018920640365765753}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 17.42232279724747, "get_ui_image": 0.04956935367218958, "step_physics": 0.7834692856949831, "survival_time": 59.99999999999873, "driven_lanedir": 14.968191379115847, "get_state_dump": 0.00939093045052839, "get_robot_state": 0.013949304893550825, "sim_render-ego0": 0.0037198539181216178, "sim_render-ego1": 0.0036360699370143615, "sim_render-ego2": 0.003605930731755113, "sim_render-ego3": 0.00359298366988132, "get_duckie_state": 1.2466849931372294e-06, "in-drivable-lane": 3.6999999999999336, "deviation-heading": 21.227127614917872, "agent_compute-ego0": 0.01198727403651864, "agent_compute-ego1": 0.0118911986942593, "agent_compute-ego2": 0.011931393168351732, "agent_compute-ego3": 0.011919473430496966, "complete-iteration": 0.982712869739453, "set_robot_commands": 0.0021349720712704624, "deviation-center-line": 4.32792983843713, "driven_lanedir_consec": 14.968191379115847, "sim_compute_sim_state": 0.04767189752450097, "sim_compute_performance-ego0": 0.001951177352473301, "sim_compute_performance-ego1": 0.0018993178374761349, "sim_compute_performance-ego2": 0.001888316239445136, "sim_compute_performance-ego3": 0.0018920640365765753}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 17.278695577925138, "get_ui_image": 0.04956935367218958, "step_physics": 0.7834692856949831, "survival_time": 59.99999999999873, "driven_lanedir": 15.400901894614956, "get_state_dump": 0.00939093045052839, "get_robot_state": 0.013949304893550825, "sim_render-ego0": 0.0037198539181216178, "sim_render-ego1": 0.0036360699370143615, "sim_render-ego2": 0.003605930731755113, "sim_render-ego3": 0.00359298366988132, "get_duckie_state": 1.2466849931372294e-06, "in-drivable-lane": 2.0499999999999616, "deviation-heading": 20.224876260230857, "agent_compute-ego0": 0.01198727403651864, "agent_compute-ego1": 0.0118911986942593, "agent_compute-ego2": 0.011931393168351732, "agent_compute-ego3": 0.011919473430496966, "complete-iteration": 0.982712869739453, "set_robot_commands": 0.0021349720712704624, "deviation-center-line": 4.528203147151742, "driven_lanedir_consec": 15.400901894614956, "sim_compute_sim_state": 0.04767189752450097, "sim_compute_performance-ego0": 0.001951177352473301, "sim_compute_performance-ego1": 0.0018993178374761349, "sim_compute_performance-ego2": 0.001888316239445136, "sim_compute_performance-ego3": 0.0018920640365765753}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 16.41565236078826, "get_ui_image": 0.04956935367218958, "step_physics": 0.7834692856949831, "survival_time": 59.99999999999873, "driven_lanedir": 15.015011073815192, "get_state_dump": 0.00939093045052839, "get_robot_state": 0.013949304893550825, "sim_render-ego0": 0.0037198539181216178, "sim_render-ego1": 0.0036360699370143615, "sim_render-ego2": 0.003605930731755113, "sim_render-ego3": 0.00359298366988132, "get_duckie_state": 1.2466849931372294e-06, "in-drivable-lane": 1.0999999999999508, "deviation-heading": 17.526510801292616, "agent_compute-ego0": 0.01198727403651864, "agent_compute-ego1": 0.0118911986942593, "agent_compute-ego2": 0.011931393168351732, "agent_compute-ego3": 0.011919473430496966, "complete-iteration": 0.982712869739453, "set_robot_commands": 0.0021349720712704624, "deviation-center-line": 3.7282271253431625, "driven_lanedir_consec": 12.70663055105151, "sim_compute_sim_state": 0.04767189752450097, "sim_compute_performance-ego0": 0.001951177352473301, "sim_compute_performance-ego1": 0.0018993178374761349, "sim_compute_performance-ego2": 0.001888316239445136, "sim_compute_performance-ego3": 0.0018920640365765753}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 3.292212325784174, "get_ui_image": 0.0472057455668867, "step_physics": 1.0113597338651203, "survival_time": 49.04999999999935, "driven_lanedir": 3.2220785043269884, "get_state_dump": 0.009371659420658277, "get_robot_state": 0.014003224625364095, "sim_render-ego0": 0.003714744282351492, "sim_render-ego1": 0.003626282491897614, "sim_render-ego2": 0.003583707294736035, "sim_render-ego3": 0.0035691016074839046, "get_duckie_state": 1.3139728616065746e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.940181471781795, "agent_compute-ego0": 0.01201676254117076, "agent_compute-ego1": 0.011319023528555502, "agent_compute-ego2": 0.01110071150202858, "agent_compute-ego3": 0.011209824177495333, "complete-iteration": 1.1805350022986076, "set_robot_commands": 0.0021173601966282987, "deviation-center-line": 2.720275651062766, "driven_lanedir_consec": 3.2220785043269884, "sim_compute_sim_state": 0.02208193183673618, "sim_compute_performance-ego0": 0.0019172172682348431, "sim_compute_performance-ego1": 0.0019011558194752863, "sim_compute_performance-ego2": 0.00188910378458058, "sim_compute_performance-ego3": 0.0018833336665042791}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.951703556953369, "get_ui_image": 0.0472057455668867, "step_physics": 1.0113597338651203, "survival_time": 49.04999999999935, "driven_lanedir": 2.348988974918693, "get_state_dump": 0.009371659420658277, "get_robot_state": 0.014003224625364095, "sim_render-ego0": 0.003714744282351492, "sim_render-ego1": 0.003626282491897614, "sim_render-ego2": 0.003583707294736035, "sim_render-ego3": 0.0035691016074839046, "get_duckie_state": 1.3139728616065746e-06, "in-drivable-lane": 1.150000000000012, "deviation-heading": 26.079756179997872, "agent_compute-ego0": 0.01201676254117076, "agent_compute-ego1": 0.011319023528555502, "agent_compute-ego2": 0.01110071150202858, "agent_compute-ego3": 0.011209824177495333, "complete-iteration": 1.1805350022986076, "set_robot_commands": 0.0021173601966282987, "deviation-center-line": 5.465294108107236, "driven_lanedir_consec": 2.070435477194068, "sim_compute_sim_state": 0.02208193183673618, "sim_compute_performance-ego0": 0.0019172172682348431, "sim_compute_performance-ego1": 0.0019011558194752863, "sim_compute_performance-ego2": 0.00188910378458058, "sim_compute_performance-ego3": 0.0018833336665042791}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 7.686472782496661, "get_ui_image": 0.0472057455668867, "step_physics": 1.0113597338651203, "survival_time": 49.04999999999935, "driven_lanedir": 6.9800222498361, "get_state_dump": 0.009371659420658277, "get_robot_state": 0.014003224625364095, "sim_render-ego0": 0.003714744282351492, "sim_render-ego1": 0.003626282491897614, "sim_render-ego2": 0.003583707294736035, "sim_render-ego3": 0.0035691016074839046, "get_duckie_state": 1.3139728616065746e-06, "in-drivable-lane": 1.000000000000008, "deviation-heading": 7.803835223893858, "agent_compute-ego0": 0.01201676254117076, "agent_compute-ego1": 0.011319023528555502, "agent_compute-ego2": 0.01110071150202858, "agent_compute-ego3": 0.011209824177495333, "complete-iteration": 1.1805350022986076, "set_robot_commands": 0.0021173601966282987, "deviation-center-line": 3.9316568258865745, "driven_lanedir_consec": 6.9800222498361, "sim_compute_sim_state": 0.02208193183673618, "sim_compute_performance-ego0": 0.0019172172682348431, "sim_compute_performance-ego1": 0.0019011558194752863, "sim_compute_performance-ego2": 0.00188910378458058, "sim_compute_performance-ego3": 0.0018833336665042791}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 13.99636849389195, "get_ui_image": 0.0472057455668867, "step_physics": 1.0113597338651203, "survival_time": 49.04999999999935, "driven_lanedir": 13.054024726466071, "get_state_dump": 0.009371659420658277, "get_robot_state": 0.014003224625364095, "sim_render-ego0": 0.003714744282351492, "sim_render-ego1": 0.003626282491897614, "sim_render-ego2": 0.003583707294736035, "sim_render-ego3": 0.0035691016074839046, "get_duckie_state": 1.3139728616065746e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.037256287401236, "agent_compute-ego0": 0.01201676254117076, "agent_compute-ego1": 0.011319023528555502, "agent_compute-ego2": 0.01110071150202858, "agent_compute-ego3": 0.011209824177495333, "complete-iteration": 1.1805350022986076, "set_robot_commands": 0.0021173601966282987, "deviation-center-line": 3.6243627004202863, "driven_lanedir_consec": 13.054024726466071, "sim_compute_sim_state": 0.02208193183673618, "sim_compute_performance-ego0": 0.0019172172682348431, "sim_compute_performance-ego1": 0.0019011558194752863, "sim_compute_performance-ego2": 0.00188910378458058, "sim_compute_performance-ego3": 0.0018833336665042791}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.88846427879602, "get_ui_image": 0.02949837113724274, "step_physics": 0.2381543594152749, "survival_time": 7.299999999999982, "driven_lanedir": 1.5475555886580803, "get_state_dump": 0.006094741172531024, "get_robot_state": 0.006888139815557571, "sim_render-ego0": 0.003608638737477413, "sim_render-ego1": 0.0035221463158017115, "get_duckie_state": 1.2812971257839074e-06, "in-drivable-lane": 1.4499999999999948, "deviation-heading": 2.170902072056662, "agent_compute-ego0": 0.01180203593507105, "agent_compute-ego1": 0.011215025064896564, "complete-iteration": 0.3277769948349518, "set_robot_commands": 0.0020477690664278407, "deviation-center-line": 0.3714643849398333, "driven_lanedir_consec": 1.5475555886580803, "sim_compute_sim_state": 0.009057466675635098, "sim_compute_performance-ego0": 0.001841519154658934, "sim_compute_performance-ego1": 0.0018297571714232569}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.75930942988996, "get_ui_image": 0.02949837113724274, "step_physics": 0.2381543594152749, "survival_time": 7.299999999999982, "driven_lanedir": 1.6336508215053018, "get_state_dump": 0.006094741172531024, "get_robot_state": 0.006888139815557571, "sim_render-ego0": 0.003608638737477413, "sim_render-ego1": 0.0035221463158017115, "get_duckie_state": 1.2812971257839074e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.596984383419892, "agent_compute-ego0": 0.01180203593507105, "agent_compute-ego1": 0.011215025064896564, "complete-iteration": 0.3277769948349518, "set_robot_commands": 0.0020477690664278407, "deviation-center-line": 0.5540049844363591, "driven_lanedir_consec": 1.6336508215053018, "sim_compute_sim_state": 0.009057466675635098, "sim_compute_performance-ego0": 0.001841519154658934, "sim_compute_performance-ego1": 0.0018297571714232569}}
set_robot_commands_max0.002153977975473032
set_robot_commands_mean0.002122912793310204
set_robot_commands_median0.0021349720712704624
set_robot_commands_min0.0020477690664278407
sim_compute_performance-ego0_max0.001951177352473301
sim_compute_performance-ego0_mean0.0019177292298361345
sim_compute_performance-ego0_median0.0019228981063888597
sim_compute_performance-ego0_min0.001841519154658934
sim_compute_performance-ego1_max0.0019011558194752863
sim_compute_performance-ego1_mean0.0018834416659378344
sim_compute_performance-ego1_median0.0018993178374761349
sim_compute_performance-ego1_min0.0018297571714232569
sim_compute_performance-ego2_max0.00188910378458058
sim_compute_performance-ego2_mean0.0018837871389652124
sim_compute_performance-ego2_median0.001888316239445136
sim_compute_performance-ego2_min0.001873941392869921
sim_compute_performance-ego3_max0.0018920640365765753
sim_compute_performance-ego3_mean0.001882250166745612
sim_compute_performance-ego3_median0.0018833336665042791
sim_compute_performance-ego3_min0.0018713527971559816
sim_compute_sim_state_max0.04767189752450097
sim_compute_sim_state_mean0.028867630097961654
sim_compute_sim_state_median0.02675414264381111
sim_compute_sim_state_min0.009057466675635098
sim_render-ego0_max0.0037198539181216178
sim_render-ego0_mean0.003699110492029549
sim_render-ego0_median0.003714744282351492
sim_render-ego0_min0.003608638737477413
sim_render-ego1_max0.0036360699370143615
sim_render-ego1_mean0.003614492179254661
sim_render-ego1_median0.003627297040578482
sim_render-ego1_min0.0035221463158017115
sim_render-ego2_max0.003605930731755113
sim_render-ego2_mean0.003594230046742501
sim_render-ego2_median0.003593052113736356
sim_render-ego2_min0.003583707294736035
sim_render-ego3_max0.00359298366988132
sim_render-ego3_mean0.0035798187262435868
sim_render-ego3_median0.003577370901365538
sim_render-ego3_min0.0035691016074839046
simulation-passed1
step_physics_max1.0113597338651203
step_physics_mean0.7143230817210752
step_physics_median0.7834692856949831
step_physics_min0.2381543594152749
survival_time_max59.99999999999873
survival_time_mean41.69999999999952
survival_time_min7.299999999999982
No reset possible