Duckietown Challenges Home Challenges Submissions

Submission 13052

Submission13052
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAndrás Kalapos 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60351
Next
User label3090
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60351LFVmultibodyv-simsuccessyes2:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median27.71009038182325
survival_time_median59.99999999999873
deviation-center-line_median2.2136329694156553
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013030617362156598
agent_compute-ego0_mean0.01282115448835674
agent_compute-ego0_median0.012808671700368812
agent_compute-ego0_min0.012681155081692584
agent_compute-ego1_max0.013657534946311424
agent_compute-ego1_mean0.012794366670701315
agent_compute-ego1_median0.012447319261041112
agent_compute-ego1_min0.01239958254125692
agent_compute-ego2_max0.013220332048020691
agent_compute-ego2_mean0.012699711895174296
agent_compute-ego2_median0.012471390405761312
agent_compute-ego2_min0.012407413231740884
agent_compute-ego3_max0.012492473675349074
agent_compute-ego3_mean0.012356241180140412
agent_compute-ego3_median0.012296420549175126
agent_compute-ego3_min0.012279829315897032
complete-iteration_max1.390506042032615
complete-iteration_mean0.9511596731131692
complete-iteration_median0.974935983837296
complete-iteration_min0.32758715607343764
deviation-center-line_max2.435977572042343
deviation-center-line_mean1.834437027554291
deviation-center-line_min0.03703574446293157
deviation-heading_max11.430987760239582
deviation-heading_mean7.726403384708933
deviation-heading_median8.594227769555548
deviation-heading_min0.5118171359865579
driven_any_max29.752264902498005
driven_any_mean22.593383763423713
driven_any_median28.14452153772165
driven_any_min0.4475267055420201
driven_lanedir_consec_max29.466532037142265
driven_lanedir_consec_mean22.156968679809207
driven_lanedir_consec_min0.1105335462318231
driven_lanedir_max29.466532037142265
driven_lanedir_mean22.156968679809207
driven_lanedir_median27.71009038182325
driven_lanedir_min0.1105335462318231
get_duckie_state_max1.3256946471608946e-06
get_duckie_state_mean1.272208571249684e-06
get_duckie_state_median1.2907557046780677e-06
get_duckie_state_min1.2157163850274512e-06
get_robot_state_max0.0139166520696
get_robot_state_mean0.012859973099791252
get_robot_state_median0.013847107097171529
get_robot_state_min0.006963656804245973
get_state_dump_max0.009316250644655253
get_state_dump_mean0.008841254331984188
get_state_dump_median0.00930964837562631
get_state_dump_min0.006023127669398731
get_ui_image_max0.05097744248491044
get_ui_image_mean0.04490954677145731
get_ui_image_median0.04764663805870291
get_ui_image_min0.03011573502463564
in-drivable-lane_max59.34999999999873
in-drivable-lane_mean8.457142857142676
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 29.752264902498005, "get_ui_image": 0.04350146564416941, "step_physics": 0.6236646217073032, "survival_time": 59.99999999999873, "driven_lanedir": 29.466532037142265, "get_state_dump": 0.009316250644655253, "get_robot_state": 0.013764318280374875, "sim_render-ego0": 0.0035614292389347987, "sim_render-ego1": 0.0035153396123652654, "sim_render-ego2": 0.003496278632590415, "sim_render-ego3": 0.003495219545896405, "get_duckie_state": 1.2907557046780677e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.955168893136934, "agent_compute-ego0": 0.012681155081692584, "agent_compute-ego1": 0.01239958254125692, "agent_compute-ego2": 0.012407413231740884, "agent_compute-ego3": 0.012279829315897032, "complete-iteration": 0.7998232519894615, "set_robot_commands": 0.0020725181160322534, "deviation-center-line": 1.8281006480174395, "driven_lanedir_consec": 29.466532037142265, "sim_compute_sim_state": 0.02998750394428898, "sim_compute_performance-ego0": 0.001847807711903797, "sim_compute_performance-ego1": 0.0018149984567786732, "sim_compute_performance-ego2": 0.001819837897345982, "sim_compute_performance-ego3": 0.0018245550516146009}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 28.877555694642055, "get_ui_image": 0.04350146564416941, "step_physics": 0.6236646217073032, "survival_time": 59.99999999999873, "driven_lanedir": 28.3325478239338, "get_state_dump": 0.009316250644655253, "get_robot_state": 0.013764318280374875, "sim_render-ego0": 0.0035614292389347987, "sim_render-ego1": 0.0035153396123652654, "sim_render-ego2": 0.003496278632590415, "sim_render-ego3": 0.003495219545896405, "get_duckie_state": 1.2907557046780677e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.13560039592075, "agent_compute-ego0": 0.012681155081692584, "agent_compute-ego1": 0.01239958254125692, "agent_compute-ego2": 0.012407413231740884, "agent_compute-ego3": 0.012279829315897032, "complete-iteration": 0.7998232519894615, "set_robot_commands": 0.0020725181160322534, "deviation-center-line": 2.305962241890517, "driven_lanedir_consec": 28.3325478239338, "sim_compute_sim_state": 0.02998750394428898, "sim_compute_performance-ego0": 0.001847807711903797, "sim_compute_performance-ego1": 0.0018149984567786732, "sim_compute_performance-ego2": 0.001819837897345982, "sim_compute_performance-ego3": 0.0018245550516146009}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 29.587234204076548, "get_ui_image": 0.04350146564416941, "step_physics": 0.6236646217073032, "survival_time": 59.99999999999873, "driven_lanedir": 29.285156630273327, "get_state_dump": 0.009316250644655253, "get_robot_state": 0.013764318280374875, "sim_render-ego0": 0.0035614292389347987, "sim_render-ego1": 0.0035153396123652654, "sim_render-ego2": 0.003496278632590415, "sim_render-ego3": 0.003495219545896405, "get_duckie_state": 1.2907557046780677e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.413317962075196, "agent_compute-ego0": 0.012681155081692584, "agent_compute-ego1": 0.01239958254125692, "agent_compute-ego2": 0.012407413231740884, "agent_compute-ego3": 0.012279829315897032, "complete-iteration": 0.7998232519894615, "set_robot_commands": 0.0020725181160322534, "deviation-center-line": 1.7707974074265025, "driven_lanedir_consec": 29.285156630273327, "sim_compute_sim_state": 0.02998750394428898, "sim_compute_performance-ego0": 0.001847807711903797, "sim_compute_performance-ego1": 0.0018149984567786732, "sim_compute_performance-ego2": 0.001819837897345982, "sim_compute_performance-ego3": 0.0018245550516146009}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 28.629075757160205, "get_ui_image": 0.04350146564416941, "step_physics": 0.6236646217073032, "survival_time": 59.99999999999873, "driven_lanedir": 28.057149301706733, "get_state_dump": 0.009316250644655253, "get_robot_state": 0.013764318280374875, "sim_render-ego0": 0.0035614292389347987, "sim_render-ego1": 0.0035153396123652654, "sim_render-ego2": 0.003496278632590415, "sim_render-ego3": 0.003495219545896405, "get_duckie_state": 1.2907557046780677e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.29632498875692, "agent_compute-ego0": 0.012681155081692584, "agent_compute-ego1": 0.01239958254125692, "agent_compute-ego2": 0.012407413231740884, "agent_compute-ego3": 0.012279829315897032, "complete-iteration": 0.7998232519894615, "set_robot_commands": 0.0020725181160322534, "deviation-center-line": 2.264884953498606, "driven_lanedir_consec": 28.057149301706733, "sim_compute_sim_state": 0.02998750394428898, "sim_compute_performance-ego0": 0.001847807711903797, "sim_compute_performance-ego1": 0.0018149984567786732, "sim_compute_performance-ego2": 0.001819837897345982, "sim_compute_performance-ego3": 0.0018245550516146009}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 27.969344871435307, "get_ui_image": 0.05097744248491044, "step_physics": 1.2179141425768798, "survival_time": 59.99999999999873, "driven_lanedir": 27.552919444000864, "get_state_dump": 0.00930964837562631, "get_robot_state": 0.013847107097171529, "sim_render-ego0": 0.0036239425506718846, "sim_render-ego1": 0.003767860422126459, "sim_render-ego2": 0.003628372848282051, "sim_render-ego3": 0.00355873616112956, "get_duckie_state": 1.2157163850274512e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.487263993245756, "agent_compute-ego0": 0.013030617362156598, "agent_compute-ego1": 0.013657534946311424, "agent_compute-ego2": 0.013220332048020691, "agent_compute-ego3": 0.012492473675349074, "complete-iteration": 1.390506042032615, "set_robot_commands": 0.0021108181450785845, "deviation-center-line": 2.3784541886862547, "driven_lanedir_consec": 27.552919444000864, "sim_compute_sim_state": 0.015307831823776206, "sim_compute_performance-ego0": 0.001866588584588628, "sim_compute_performance-ego1": 0.0018417068961061704, "sim_compute_performance-ego2": 0.0018939422032517455, "sim_compute_performance-ego3": 0.0018811337060475727}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.2462115609292443, "get_ui_image": 0.05097744248491044, "step_physics": 1.2179141425768798, "survival_time": 59.99999999999873, "driven_lanedir": 0.11407150722566683, "get_state_dump": 0.00930964837562631, "get_robot_state": 0.013847107097171529, "sim_render-ego0": 0.0036239425506718846, "sim_render-ego1": 0.003767860422126459, "sim_render-ego2": 0.003628372848282051, "sim_render-ego3": 0.00355873616112956, "get_duckie_state": 1.2157163850274512e-06, "in-drivable-lane": 59.04999999999873, "deviation-heading": 0.99567714707235, "agent_compute-ego0": 0.013030617362156598, "agent_compute-ego1": 0.013657534946311424, "agent_compute-ego2": 0.013220332048020691, "agent_compute-ego3": 0.012492473675349074, "complete-iteration": 1.390506042032615, "set_robot_commands": 0.0021108181450785845, "deviation-center-line": 0.06116264430160003, "driven_lanedir_consec": 0.11407150722566683, "sim_compute_sim_state": 0.015307831823776206, "sim_compute_performance-ego0": 0.001866588584588628, "sim_compute_performance-ego1": 0.0018417068961061704, "sim_compute_performance-ego2": 0.0018939422032517455, "sim_compute_performance-ego3": 0.0018811337060475727}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.4475267055420201, "get_ui_image": 0.05097744248491044, "step_physics": 1.2179141425768798, "survival_time": 59.99999999999873, "driven_lanedir": 0.1105335462318231, "get_state_dump": 0.00930964837562631, "get_robot_state": 0.013847107097171529, "sim_render-ego0": 0.0036239425506718846, "sim_render-ego1": 0.003767860422126459, "sim_render-ego2": 0.003628372848282051, "sim_render-ego3": 0.00355873616112956, "get_duckie_state": 1.2157163850274512e-06, "in-drivable-lane": 59.34999999999873, "deviation-heading": 0.5118171359865579, "agent_compute-ego0": 0.013030617362156598, "agent_compute-ego1": 0.013657534946311424, "agent_compute-ego2": 0.013220332048020691, "agent_compute-ego3": 0.012492473675349074, "complete-iteration": 1.390506042032615, "set_robot_commands": 0.0021108181450785845, "deviation-center-line": 0.03703574446293157, "driven_lanedir_consec": 0.1105335462318231, "sim_compute_sim_state": 0.015307831823776206, "sim_compute_performance-ego0": 0.001866588584588628, "sim_compute_performance-ego1": 0.0018417068961061704, "sim_compute_performance-ego2": 0.0018939422032517455, "sim_compute_performance-ego3": 0.0018811337060475727}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.4946441924540465, "get_ui_image": 0.05097744248491044, "step_physics": 1.2179141425768798, "survival_time": 59.99999999999873, "driven_lanedir": 0.4802279210716409, "get_state_dump": 0.00930964837562631, "get_robot_state": 0.013847107097171529, "sim_render-ego0": 0.0036239425506718846, "sim_render-ego1": 0.003767860422126459, "sim_render-ego2": 0.003628372848282051, "sim_render-ego3": 0.00355873616112956, "get_duckie_state": 1.2157163850274512e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.17878162802628, "agent_compute-ego0": 0.013030617362156598, "agent_compute-ego1": 0.013657534946311424, "agent_compute-ego2": 0.013220332048020691, "agent_compute-ego3": 0.012492473675349074, "complete-iteration": 1.390506042032615, "set_robot_commands": 0.0021108181450785845, "deviation-center-line": 1.6522958391825957, "driven_lanedir_consec": 0.4802279210716409, "sim_compute_sim_state": 0.015307831823776206, "sim_compute_performance-ego0": 0.001866588584588628, "sim_compute_performance-ego1": 0.0018417068961061704, "sim_compute_performance-ego2": 0.0018939422032517455, "sim_compute_performance-ego3": 0.0018811337060475727}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 28.101842246564782, "get_ui_image": 0.04764663805870291, "step_physics": 0.7804181998615757, "survival_time": 59.99999999999873, "driven_lanedir": 27.667650109222855, "get_state_dump": 0.00930692730696374, "get_robot_state": 0.0139166520696, "sim_render-ego0": 0.0035998082776351535, "sim_render-ego1": 0.0035530722806296875, "sim_render-ego2": 0.0035403753498213972, "sim_render-ego3": 0.0035255094253451103, "get_duckie_state": 1.3256946471608946e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.94267774383882, "agent_compute-ego0": 0.012808671700368812, "agent_compute-ego1": 0.012447319261041112, "agent_compute-ego2": 0.012471390405761312, "agent_compute-ego3": 0.012296420549175126, "complete-iteration": 0.974935983837296, "set_robot_commands": 0.0021139890526256197, "deviation-center-line": 2.324166182574332, "driven_lanedir_consec": 27.667650109222855, "sim_compute_sim_state": 0.04335483524027117, "sim_compute_performance-ego0": 0.001894451597151808, "sim_compute_performance-ego1": 0.001845448142185894, "sim_compute_performance-ego2": 0.001834568433420148, "sim_compute_performance-ego3": 0.0018343306103912023}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 28.064215798004327, "get_ui_image": 0.04764663805870291, "step_physics": 0.7804181998615757, "survival_time": 59.99999999999873, "driven_lanedir": 27.66261899297377, "get_state_dump": 0.00930692730696374, "get_robot_state": 0.0139166520696, "sim_render-ego0": 0.0035998082776351535, "sim_render-ego1": 0.0035530722806296875, "sim_render-ego2": 0.0035403753498213972, "sim_render-ego3": 0.0035255094253451103, "get_duckie_state": 1.3256946471608946e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.701191545865338, "agent_compute-ego0": 0.012808671700368812, "agent_compute-ego1": 0.012447319261041112, "agent_compute-ego2": 0.012471390405761312, "agent_compute-ego3": 0.012296420549175126, "complete-iteration": 0.974935983837296, "set_robot_commands": 0.0021139890526256197, "deviation-center-line": 2.3223389521071693, "driven_lanedir_consec": 27.66261899297377, "sim_compute_sim_state": 0.04335483524027117, "sim_compute_performance-ego0": 0.001894451597151808, "sim_compute_performance-ego1": 0.001845448142185894, "sim_compute_performance-ego2": 0.001834568433420148, "sim_compute_performance-ego3": 0.0018343306103912023}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 28.606215983820977, "get_ui_image": 0.04764663805870291, "step_physics": 0.7804181998615757, "survival_time": 59.99999999999873, "driven_lanedir": 28.251048085251643, "get_state_dump": 0.00930692730696374, "get_robot_state": 0.0139166520696, "sim_render-ego0": 0.0035998082776351535, "sim_render-ego1": 0.0035530722806296875, "sim_render-ego2": 0.0035403753498213972, "sim_render-ego3": 0.0035255094253451103, "get_duckie_state": 1.3256946471608946e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.201995602288429, "agent_compute-ego0": 0.012808671700368812, "agent_compute-ego1": 0.012447319261041112, "agent_compute-ego2": 0.012471390405761312, "agent_compute-ego3": 0.012296420549175126, "complete-iteration": 0.974935983837296, "set_robot_commands": 0.0021139890526256197, "deviation-center-line": 2.1623809853327045, "driven_lanedir_consec": 28.251048085251643, "sim_compute_sim_state": 0.04335483524027117, "sim_compute_performance-ego0": 0.001894451597151808, "sim_compute_performance-ego1": 0.001845448142185894, "sim_compute_performance-ego2": 0.001834568433420148, "sim_compute_performance-ego3": 0.0018343306103912023}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 28.187200828878517, "get_ui_image": 0.04764663805870291, "step_physics": 0.7804181998615757, "survival_time": 59.99999999999873, "driven_lanedir": 27.75253065442364, "get_state_dump": 0.00930692730696374, "get_robot_state": 0.0139166520696, "sim_render-ego0": 0.0035998082776351535, "sim_render-ego1": 0.0035530722806296875, "sim_render-ego2": 0.0035403753498213972, "sim_render-ego3": 0.0035255094253451103, "get_duckie_state": 1.3256946471608946e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.853356567999588, "agent_compute-ego0": 0.012808671700368812, "agent_compute-ego1": 0.012447319261041112, "agent_compute-ego2": 0.012471390405761312, "agent_compute-ego3": 0.012296420549175126, "complete-iteration": 0.974935983837296, "set_robot_commands": 0.0021139890526256197, "deviation-center-line": 2.435977572042343, "driven_lanedir_consec": 27.75253065442364, "sim_compute_sim_state": 0.04335483524027117, "sim_compute_performance-ego0": 0.001894451597151808, "sim_compute_performance-ego1": 0.001845448142185894, "sim_compute_performance-ego2": 0.001834568433420148, "sim_compute_performance-ego3": 0.0018343306103912023}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 27.956290039816547, "get_ui_image": 0.03011573502463564, "step_physics": 0.23388165875735828, "survival_time": 59.99999999999873, "driven_lanedir": 27.281911225172415, "get_state_dump": 0.006023127669398731, "get_robot_state": 0.006963656804245973, "sim_render-ego0": 0.0036460324985399337, "sim_render-ego1": 0.0035524165799079785, "get_duckie_state": 1.2411265250149614e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.430987760239582, "agent_compute-ego0": 0.012707193130061191, "agent_compute-ego1": 0.01255169319769028, "complete-iteration": 0.32758715607343764, "set_robot_commands": 0.0021135949969390945, "deviation-center-line": 2.275986308972785, "driven_lanedir_consec": 27.281911225172415, "sim_compute_sim_state": 0.01010177216859384, "sim_compute_performance-ego0": 0.0018683099230560633, "sim_compute_performance-ego1": 0.0018456170799134673}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 28.387749902109466, "get_ui_image": 0.03011573502463564, "step_physics": 0.23388165875735828, "survival_time": 59.99999999999873, "driven_lanedir": 28.182664238698468, "get_state_dump": 0.006023127669398731, "get_robot_state": 0.006963656804245973, "sim_render-ego0": 0.0036460324985399337, "sim_render-ego1": 0.0035524165799079785, "get_duckie_state": 1.2411265250149614e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.065486021472584, "agent_compute-ego0": 0.012707193130061191, "agent_compute-ego1": 0.01255169319769028, "complete-iteration": 0.32758715607343764, "set_robot_commands": 0.0021135949969390945, "deviation-center-line": 1.862574717264296, "driven_lanedir_consec": 28.182664238698468, "sim_compute_sim_state": 0.01010177216859384, "sim_compute_performance-ego0": 0.0018683099230560633, "sim_compute_performance-ego1": 0.0018456170799134673}}
set_robot_commands_max0.0021139890526256197
set_robot_commands_mean0.002101177946344572
set_robot_commands_median0.0021108181450785845
set_robot_commands_min0.0020725181160322534
sim_compute_performance-ego0_max0.001894451597151808
sim_compute_performance-ego0_mean0.001869429387192076
sim_compute_performance-ego0_median0.001866588584588628
sim_compute_performance-ego0_min0.001847807711903797
sim_compute_performance-ego1_max0.0018456170799134673
sim_compute_performance-ego1_mean0.0018357034385792777
sim_compute_performance-ego1_median0.0018417068961061704
sim_compute_performance-ego1_min0.0018149984567786732
sim_compute_performance-ego2_max0.0018939422032517455
sim_compute_performance-ego2_mean0.0018494495113392925
sim_compute_performance-ego2_median0.001834568433420148
sim_compute_performance-ego2_min0.001819837897345982
sim_compute_performance-ego3_max0.0018811337060475727
sim_compute_performance-ego3_mean0.0018466731226844584
sim_compute_performance-ego3_median0.0018343306103912023
sim_compute_performance-ego3_min0.0018245550516146009
sim_compute_sim_state_max0.04335483524027117
sim_compute_sim_state_mean0.026771730597895223
sim_compute_sim_state_median0.02998750394428898
sim_compute_sim_state_min0.01010177216859384
sim_render-ego0_max0.0036460324985399337
sim_render-ego0_mean0.003602341804717658
sim_render-ego0_median0.0035998082776351535
sim_render-ego0_min0.0035614292389347987
sim_render-ego1_max0.003767860422126459
sim_render-ego1_mean0.003603565887164401
sim_render-ego1_median0.0035530722806296875
sim_render-ego1_min0.0035153396123652654
sim_render-ego2_max0.003628372848282051
sim_render-ego2_mean0.003555008943564622
sim_render-ego2_median0.0035403753498213972
sim_render-ego2_min0.003496278632590415
sim_render-ego3_max0.00355873616112956
sim_render-ego3_mean0.0035264883774570248
sim_render-ego3_median0.0035255094253451103
sim_render-ego3_min0.003495219545896405
simulation-passed1
step_physics_max1.2179141425768798
step_physics_mean0.7825536552926965
step_physics_median0.7804181998615757
step_physics_min0.23388165875735828
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible