Duckietown Challenges Home Challenges Submissions

Submission 15518

Submission15518
Competingyes
Challengeaido-LFVI_multi_full-sim-validation
UserAlessandro Zanardi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 91485 sim-1of4: 91483 sim-2of4: 91481 sim-3of4: 91488
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

91485

Click the images to see detailed statistics about the episode.

LFVI_multi-full-4way-000

91483

Click the images to see detailed statistics about the episode.

LFVI_multi-full-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
91488sim-3of4successyes0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
91487sim-3of4successyes0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91486sim-3of4successyes0:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91485sim-0of4successyes0:21:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median44.399999999999615
in-drivable-lane_median0.0
driven_lanedir_consec_median1.9202212939230892
deviation-center-line_median0.13224235483042074


other stats
agent_compute-ego0_max0.041841696298296725
agent_compute-ego0_mean0.041841696298296725
agent_compute-ego0_median0.041841696298296725
agent_compute-ego0_min0.041841696298296725
agent_compute-ego1_max0.0376325965061767
agent_compute-ego1_mean0.0376325965061767
agent_compute-ego1_median0.0376325965061767
agent_compute-ego1_min0.0376325965061767
agent_compute-ego2_max0.04887843829306226
agent_compute-ego2_mean0.04887843829306226
agent_compute-ego2_median0.04887843829306226
agent_compute-ego2_min0.04887843829306226
agent_compute-ego3_max0.04951253355689205
agent_compute-ego3_mean0.04951253355689205
agent_compute-ego3_median0.04951253355689205
agent_compute-ego3_min0.04951253355689205
complete-iteration_max0.5598948498008222
complete-iteration_mean0.5598948498008222
complete-iteration_median0.5598948498008222
complete-iteration_min0.5598948498008222
deviation-center-line_max0.2190212687887183
deviation-center-line_mean0.12746091377604488
deviation-center-line_min0.026337676654619696
deviation-heading_max4.5234362970932365
deviation-heading_mean1.8710558562957245
deviation-heading_median1.353961116347964
deviation-heading_min0.2528648953937336
distance-from-start_max2.3706251132528147
distance-from-start_mean1.4881747935054808
distance-from-start_median1.4146788981804663
distance-from-start_min0.7527162644081755
driven_any_max5.402116049785622
driven_any_mean2.509959846238396
driven_any_median1.924681488709651
driven_any_min0.7883603577486602
driven_lanedir_consec_max5.10143264073436
driven_lanedir_consec_mean2.388210901967574
driven_lanedir_consec_min0.6109683792897571
driven_lanedir_max5.393628024205742
driven_lanedir_mean2.504397566787926
driven_lanedir_median1.9202228991862915
driven_lanedir_min0.7835164445733769
get_duckie_state_max1.5064085026023355e-06
get_duckie_state_mean1.5064085026023355e-06
get_duckie_state_median1.5064085026023355e-06
get_duckie_state_min1.5064085026023355e-06
get_robot_state_max0.013528409234852571
get_robot_state_mean0.013528409234852571
get_robot_state_median0.013528409234852571
get_robot_state_min0.013528409234852571
get_state_dump_max0.008915999340662404
get_state_dump_mean0.008915999340662404
get_state_dump_median0.008915999340662404
get_state_dump_min0.008915999340662404
get_ui_image_max0.06158303088090551
get_ui_image_mean0.06158303088090551
get_ui_image_median0.06158303088090551
get_ui_image_min0.06158303088090551
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-full-4way-000-ego0": {"driven_any": 3.0609956261264943, "get_ui_image": 0.06158303088090551, "step_physics": 0.2494503805420128, "survival_time": 44.399999999999615, "driven_lanedir": 3.0524104540512114, "get_state_dump": 0.008915999340662404, "get_robot_state": 0.013528409234852571, "sim_render-ego0": 0.003628902413847744, "sim_render-ego1": 0.003672320877607279, "sim_render-ego2": 0.003722860789004005, "sim_render-ego3": 0.003718313672008879, "get_duckie_state": 1.5064085026023355e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1133984736066704, "agent_compute-ego0": 0.041841696298296725, "agent_compute-ego1": 0.0376325965061767, "agent_compute-ego2": 0.04887843829306226, "agent_compute-ego3": 0.04951253355689205, "complete-iteration": 0.5598948498008222, "set_robot_commands": 0.0023951761097688105, "distance-from-start": 2.3706251132528147, "deviation-center-line": 0.09672093640322205, "driven_lanedir_consec": 3.052407243524806, "sim_compute_sim_state": 0.016867262708322808, "sim_compute_performance-ego0": 0.001918708245585284, "sim_compute_performance-ego1": 0.001852725032209948, "sim_compute_performance-ego2": 0.0018576403704751597, "sim_compute_performance-ego3": 0.0019112333269838003}, "LFVI_multi-full-4way-000-ego1": {"driven_any": 5.402116049785622, "get_ui_image": 0.06158303088090551, "step_physics": 0.2494503805420128, "survival_time": 44.399999999999615, "driven_lanedir": 5.393628024205742, "get_state_dump": 0.008915999340662404, "get_robot_state": 0.013528409234852571, "sim_render-ego0": 0.003628902413847744, "sim_render-ego1": 0.003672320877607279, "sim_render-ego2": 0.003722860789004005, "sim_render-ego3": 0.003718313672008879, "get_duckie_state": 1.5064085026023355e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.5945237590892574, "agent_compute-ego0": 0.041841696298296725, "agent_compute-ego1": 0.0376325965061767, "agent_compute-ego2": 0.04887843829306226, "agent_compute-ego3": 0.04951253355689205, "complete-iteration": 0.5598948498008222, "set_robot_commands": 0.0023951761097688105, "distance-from-start": 2.0412352803226614, "deviation-center-line": 0.16776377325761943, "driven_lanedir_consec": 5.10143264073436, "sim_compute_sim_state": 0.016867262708322808, "sim_compute_performance-ego0": 0.001918708245585284, "sim_compute_performance-ego1": 0.001852725032209948, "sim_compute_performance-ego2": 0.0018576403704751597, "sim_compute_performance-ego3": 0.0019112333269838003}, "LFVI_multi-full-4way-000-ego2": {"driven_any": 0.7883673512928077, "get_ui_image": 0.06158303088090551, "step_physics": 0.2494503805420128, "survival_time": 44.399999999999615, "driven_lanedir": 0.7880353443213717, "get_state_dump": 0.008915999340662404, "get_robot_state": 0.013528409234852571, "sim_render-ego0": 0.003628902413847744, "sim_render-ego1": 0.003672320877607279, "sim_render-ego2": 0.003722860789004005, "sim_render-ego3": 0.003718313672008879, "get_duckie_state": 1.5064085026023355e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.2528648953937336, "agent_compute-ego0": 0.041841696298296725, "agent_compute-ego1": 0.0376325965061767, "agent_compute-ego2": 0.04887843829306226, "agent_compute-ego3": 0.04951253355689205, "complete-iteration": 0.5598948498008222, "set_robot_commands": 0.0023951761097688105, "distance-from-start": 0.7881225160382711, "deviation-center-line": 0.026337676654619696, "driven_lanedir_consec": 0.7880353443213717, "sim_compute_sim_state": 0.016867262708322808, "sim_compute_performance-ego0": 0.001918708245585284, "sim_compute_performance-ego1": 0.001852725032209948, "sim_compute_performance-ego2": 0.0018576403704751597, "sim_compute_performance-ego3": 0.0019112333269838003}, "LFVI_multi-full-4way-000-ego3": {"driven_any": 0.7883603577486602, "get_ui_image": 0.06158303088090551, "step_physics": 0.2494503805420128, "survival_time": 44.399999999999615, "driven_lanedir": 0.7835164445733769, "get_state_dump": 0.008915999340662404, "get_robot_state": 0.013528409234852571, "sim_render-ego0": 0.003628902413847744, "sim_render-ego1": 0.003672320877607279, "sim_render-ego2": 0.003722860789004005, "sim_render-ego3": 0.003718313672008879, "get_duckie_state": 1.5064085026023355e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.5234362970932365, "agent_compute-ego0": 0.041841696298296725, "agent_compute-ego1": 0.0376325965061767, "agent_compute-ego2": 0.04887843829306226, "agent_compute-ego3": 0.04951253355689205, "complete-iteration": 0.5598948498008222, "set_robot_commands": 0.0023951761097688105, "distance-from-start": 0.7527162644081755, "deviation-center-line": 0.2190212687887183, "driven_lanedir_consec": 0.6109683792897571, "sim_compute_sim_state": 0.016867262708322808, "sim_compute_performance-ego0": 0.001918708245585284, "sim_compute_performance-ego1": 0.001852725032209948, "sim_compute_performance-ego2": 0.0018576403704751597, "sim_compute_performance-ego3": 0.0019112333269838003}}
set_robot_commands_max0.0023951761097688105
set_robot_commands_mean0.0023951761097688105
set_robot_commands_median0.0023951761097688105
set_robot_commands_min0.0023951761097688105
sim_compute_performance-ego0_max0.001918708245585284
sim_compute_performance-ego0_mean0.001918708245585284
sim_compute_performance-ego0_median0.001918708245585284
sim_compute_performance-ego0_min0.001918708245585284
sim_compute_performance-ego1_max0.001852725032209948
sim_compute_performance-ego1_mean0.001852725032209948
sim_compute_performance-ego1_median0.001852725032209948
sim_compute_performance-ego1_min0.001852725032209948
sim_compute_performance-ego2_max0.0018576403704751597
sim_compute_performance-ego2_mean0.0018576403704751597
sim_compute_performance-ego2_median0.0018576403704751597
sim_compute_performance-ego2_min0.0018576403704751597
sim_compute_performance-ego3_max0.0019112333269838003
sim_compute_performance-ego3_mean0.0019112333269838003
sim_compute_performance-ego3_median0.0019112333269838003
sim_compute_performance-ego3_min0.0019112333269838003
sim_compute_sim_state_max0.016867262708322808
sim_compute_sim_state_mean0.016867262708322808
sim_compute_sim_state_median0.016867262708322808
sim_compute_sim_state_min0.016867262708322808
sim_render-ego0_max0.003628902413847744
sim_render-ego0_mean0.003628902413847744
sim_render-ego0_median0.003628902413847744
sim_render-ego0_min0.003628902413847744
sim_render-ego1_max0.003672320877607279
sim_render-ego1_mean0.003672320877607279
sim_render-ego1_median0.003672320877607279
sim_render-ego1_min0.003672320877607279
sim_render-ego2_max0.003722860789004005
sim_render-ego2_mean0.003722860789004005
sim_render-ego2_median0.003722860789004005
sim_render-ego2_min0.003722860789004005
sim_render-ego3_max0.003718313672008879
sim_render-ego3_mean0.003718313672008879
sim_render-ego3_median0.003718313672008879
sim_render-ego3_min0.003718313672008879
simulation-passed1
step_physics_max0.2494503805420128
step_physics_mean0.2494503805420128
step_physics_median0.2494503805420128
step_physics_min0.2494503805420128
survival_time_max44.399999999999615
survival_time_mean44.399999999999615
survival_time_min44.399999999999615
No reset possible
91483sim-1of4successyes0:29:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median7.262510287063529
deviation-center-line_median0.26016399154497555


other stats
agent_compute-ego0_max0.03558028786505986
agent_compute-ego0_mean0.03558028786505986
agent_compute-ego0_median0.03558028786505986
agent_compute-ego0_min0.03558028786505986
agent_compute-ego1_max0.03544444505816991
agent_compute-ego1_mean0.03544444505816991
agent_compute-ego1_median0.03544444505816991
agent_compute-ego1_min0.03544444505816991
agent_compute-ego2_max0.037951650071600694
agent_compute-ego2_mean0.037951650071600694
agent_compute-ego2_median0.037951650071600694
agent_compute-ego2_min0.037951650071600694
agent_compute-ego3_max0.0362938008240915
agent_compute-ego3_mean0.0362938008240915
agent_compute-ego3_median0.0362938008240915
agent_compute-ego3_min0.0362938008240915
complete-iteration_max0.6059383188655831
complete-iteration_mean0.6059383188655831
complete-iteration_median0.6059383188655831
complete-iteration_min0.6059383188655831
deviation-center-line_max0.3863922266213418
deviation-center-line_mean0.2883210282182219
deviation-center-line_min0.24656390316159468
deviation-heading_max2.913596905289015
deviation-heading_mean2.512402118448656
deviation-heading_median2.399435977702611
deviation-heading_min2.337139613100387
distance-from-start_max3.515088509563693
distance-from-start_mean3.1568955817473703
distance-from-start_median3.1777509440561964
distance-from-start_min2.756991929313395
driven_any_max7.431900136286946
driven_any_mean7.431889723338576
driven_any_median7.431898572807542
driven_any_min7.431861611452274
driven_lanedir_consec_max7.4132071890160365
driven_lanedir_consec_mean7.262916181959527
driven_lanedir_consec_min7.113436964695012
driven_lanedir_max7.415533534731159
driven_lanedir_mean7.412226015248207
driven_lanedir_median7.412568955945987
driven_lanedir_min7.408232614369693
get_duckie_state_max1.272690683280697e-06
get_duckie_state_mean1.272690683280697e-06
get_duckie_state_median1.272690683280697e-06
get_duckie_state_min1.272690683280697e-06
get_robot_state_max0.012983582994522996
get_robot_state_mean0.012983582994522996
get_robot_state_median0.012983582994522996
get_robot_state_min0.012983582994522996
get_state_dump_max0.00882192674425619
get_state_dump_mean0.00882192674425619
get_state_dump_median0.00882192674425619
get_state_dump_min0.00882192674425619
get_ui_image_max0.06041215103333637
get_ui_image_mean0.06041215103333637
get_ui_image_median0.06041215103333637
get_ui_image_min0.06041215103333637
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-full-udem1-000-ego0": {"driven_any": 7.431861611452274, "get_ui_image": 0.06041215103333637, "step_physics": 0.3152238064066357, "survival_time": 59.99999999999873, "driven_lanedir": 7.408232614369693, "get_state_dump": 0.00882192674425619, "get_robot_state": 0.012983582994522996, "sim_render-ego0": 0.0034929630063554825, "sim_render-ego1": 0.0034970796475501777, "sim_render-ego2": 0.003602676248669525, "sim_render-ego3": 0.0035917322204869354, "get_duckie_state": 1.272690683280697e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.913596905289015, "agent_compute-ego0": 0.03558028786505986, "agent_compute-ego1": 0.03544444505816991, "agent_compute-ego2": 0.037951650071600694, "agent_compute-ego3": 0.0362938008240915, "complete-iteration": 0.6059383188655831, "set_robot_commands": 0.0020300111206842403, "distance-from-start": 2.756991929313395, "deviation-center-line": 0.3863922266213418, "driven_lanedir_consec": 7.408232614369693, "sim_compute_sim_state": 0.033438591039945044, "sim_compute_performance-ego0": 0.0018782022096632323, "sim_compute_performance-ego1": 0.0017312662885349856, "sim_compute_performance-ego2": 0.001802544907467451, "sim_compute_performance-ego3": 0.001791124637676814}, "LFVI_multi-full-udem1-000-ego1": {"driven_any": 7.431897753906775, "get_ui_image": 0.06041215103333637, "step_physics": 0.3152238064066357, "survival_time": 59.99999999999873, "driven_lanedir": 7.4132071890160365, "get_state_dump": 0.00882192674425619, "get_robot_state": 0.012983582994522996, "sim_render-ego0": 0.0034929630063554825, "sim_render-ego1": 0.0034970796475501777, "sim_render-ego2": 0.003602676248669525, "sim_render-ego3": 0.0035917322204869354, "get_duckie_state": 1.272690683280697e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.453209419877407, "agent_compute-ego0": 0.03558028786505986, "agent_compute-ego1": 0.03544444505816991, "agent_compute-ego2": 0.037951650071600694, "agent_compute-ego3": 0.0362938008240915, "complete-iteration": 0.6059383188655831, "set_robot_commands": 0.0020300111206842403, "distance-from-start": 2.9695336261103513, "deviation-center-line": 0.25149539514164776, "driven_lanedir_consec": 7.4132071890160365, "sim_compute_sim_state": 0.033438591039945044, "sim_compute_performance-ego0": 0.0018782022096632323, "sim_compute_performance-ego1": 0.0017312662885349856, "sim_compute_performance-ego2": 0.001802544907467451, "sim_compute_performance-ego3": 0.001791124637676814}, "LFVI_multi-full-udem1-000-ego2": {"driven_any": 7.431899391708308, "get_ui_image": 0.06041215103333637, "step_physics": 0.3152238064066357, "survival_time": 59.99999999999873, "driven_lanedir": 7.415533534731159, "get_state_dump": 0.00882192674425619, "get_robot_state": 0.012983582994522996, "sim_render-ego0": 0.0034929630063554825, "sim_render-ego1": 0.0034970796475501777, "sim_render-ego2": 0.003602676248669525, "sim_render-ego3": 0.0035917322204869354, "get_duckie_state": 1.272690683280697e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.337139613100387, "agent_compute-ego0": 0.03558028786505986, "agent_compute-ego1": 0.03544444505816991, "agent_compute-ego2": 0.037951650071600694, "agent_compute-ego3": 0.0362938008240915, "complete-iteration": 0.6059383188655831, "set_robot_commands": 0.0020300111206842403, "distance-from-start": 3.385968262002042, "deviation-center-line": 0.24656390316159468, "driven_lanedir_consec": 7.1167879597573656, "sim_compute_sim_state": 0.033438591039945044, "sim_compute_performance-ego0": 0.0018782022096632323, "sim_compute_performance-ego1": 0.0017312662885349856, "sim_compute_performance-ego2": 0.001802544907467451, "sim_compute_performance-ego3": 0.001791124637676814}, "LFVI_multi-full-udem1-000-ego3": {"driven_any": 7.431900136286946, "get_ui_image": 0.06041215103333637, "step_physics": 0.3152238064066357, "survival_time": 59.99999999999873, "driven_lanedir": 7.411930722875937, "get_state_dump": 0.00882192674425619, "get_robot_state": 0.012983582994522996, "sim_render-ego0": 0.0034929630063554825, "sim_render-ego1": 0.0034970796475501777, "sim_render-ego2": 0.003602676248669525, "sim_render-ego3": 0.0035917322204869354, "get_duckie_state": 1.272690683280697e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.3456625355278145, "agent_compute-ego0": 0.03558028786505986, "agent_compute-ego1": 0.03544444505816991, "agent_compute-ego2": 0.037951650071600694, "agent_compute-ego3": 0.0362938008240915, "complete-iteration": 0.6059383188655831, "set_robot_commands": 0.0020300111206842403, "distance-from-start": 3.515088509563693, "deviation-center-line": 0.26883258794830334, "driven_lanedir_consec": 7.113436964695012, "sim_compute_sim_state": 0.033438591039945044, "sim_compute_performance-ego0": 0.0018782022096632323, "sim_compute_performance-ego1": 0.0017312662885349856, "sim_compute_performance-ego2": 0.001802544907467451, "sim_compute_performance-ego3": 0.001791124637676814}}
set_robot_commands_max0.0020300111206842403
set_robot_commands_mean0.0020300111206842403
set_robot_commands_median0.0020300111206842403
set_robot_commands_min0.0020300111206842403
sim_compute_performance-ego0_max0.0018782022096632323
sim_compute_performance-ego0_mean0.0018782022096632323
sim_compute_performance-ego0_median0.0018782022096632323
sim_compute_performance-ego0_min0.0018782022096632323
sim_compute_performance-ego1_max0.0017312662885349856
sim_compute_performance-ego1_mean0.0017312662885349856
sim_compute_performance-ego1_median0.0017312662885349856
sim_compute_performance-ego1_min0.0017312662885349856
sim_compute_performance-ego2_max0.001802544907467451
sim_compute_performance-ego2_mean0.001802544907467451
sim_compute_performance-ego2_median0.001802544907467451
sim_compute_performance-ego2_min0.001802544907467451
sim_compute_performance-ego3_max0.001791124637676814
sim_compute_performance-ego3_mean0.001791124637676814
sim_compute_performance-ego3_median0.001791124637676814
sim_compute_performance-ego3_min0.001791124637676814
sim_compute_sim_state_max0.033438591039945044
sim_compute_sim_state_mean0.033438591039945044
sim_compute_sim_state_median0.033438591039945044
sim_compute_sim_state_min0.033438591039945044
sim_render-ego0_max0.0034929630063554825
sim_render-ego0_mean0.0034929630063554825
sim_render-ego0_median0.0034929630063554825
sim_render-ego0_min0.0034929630063554825
sim_render-ego1_max0.0034970796475501777
sim_render-ego1_mean0.0034970796475501777
sim_render-ego1_median0.0034970796475501777
sim_render-ego1_min0.0034970796475501777
sim_render-ego2_max0.003602676248669525
sim_render-ego2_mean0.003602676248669525
sim_render-ego2_median0.003602676248669525
sim_render-ego2_min0.003602676248669525
sim_render-ego3_max0.0035917322204869354
sim_render-ego3_mean0.0035917322204869354
sim_render-ego3_median0.0035917322204869354
sim_render-ego3_min0.0035917322204869354
simulation-passed1
step_physics_max0.3152238064066357
step_physics_mean0.3152238064066357
step_physics_median0.3152238064066357
step_physics_min0.3152238064066357
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
91481sim-2of4successyes0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
91479sim-2of4successyes0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77101sim-3of4successyes0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77100sim-2of4successyes0:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77099sim-3of4successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77098sim-0of4successyes0:20:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77097sim-1of4successyes0:27:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77096sim-2of4successyes0:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible