Duckietown Challenges Home Challenges Submissions

Submission 15516

Submission15516
Competingyes
Challengeaido-LFVI_multi_full-sim-validation
UserAlessandro Zanardi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 91493 sim-1of4: 91494 sim-2of4: 91499 sim-3of4: 91500
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

91494

Click the images to see detailed statistics about the episode.

LFVI_multi-full-udem1-000

91493

Click the images to see detailed statistics about the episode.

LFVI_multi-full-4way-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
91500sim-3of4successyes0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
91499sim-2of4successyes0:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
91498sim-3of4successyes0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91497sim-2of4successyes0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91496sim-3of4successyes0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91495sim-3of4successyes0:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91494sim-1of4successyes0:20:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.74999999999954
in-drivable-lane_median23.92499999999936
driven_lanedir_consec_median2.564614171752136
deviation-center-line_median1.4517894976468984


other stats
agent_compute-ego0_max0.028244162490794752
agent_compute-ego0_mean0.028244162490794752
agent_compute-ego0_median0.028244162490794752
agent_compute-ego0_min0.028244162490794752
agent_compute-ego1_max0.028664262273946705
agent_compute-ego1_mean0.028664262273946705
agent_compute-ego1_median0.028664262273946705
agent_compute-ego1_min0.028664262273946705
agent_compute-ego2_max0.029338859574763537
agent_compute-ego2_mean0.029338859574763537
agent_compute-ego2_median0.029338859574763537
agent_compute-ego2_min0.029338859574763537
agent_compute-ego3_max0.03182780404278285
agent_compute-ego3_mean0.03182780404278285
agent_compute-ego3_median0.03182780404278285
agent_compute-ego3_min0.03182780404278285
complete-iteration_max0.4784915954785576
complete-iteration_mean0.4784915954785576
complete-iteration_median0.4784915954785576
complete-iteration_min0.4784915954785576
deviation-center-line_max2.847404933920423
deviation-center-line_mean1.5600775792083794
deviation-center-line_min0.4893263876192985
deviation-heading_max11.077602389853723
deviation-heading_mean6.00657536271361
deviation-heading_median5.4761378871111495
deviation-heading_min1.9964232867784195
distance-from-start_max3.707002417703116
distance-from-start_mean3.138956180617824
distance-from-start_median3.262342252968276
distance-from-start_min2.324137798831628
driven_any_max5.570237359967187
driven_any_mean4.0167536038605665
driven_any_median4.0198678209896075
driven_any_min2.4570414134958645
driven_lanedir_consec_max3.5955877468517707
driven_lanedir_consec_mean2.689889032493257
driven_lanedir_consec_min2.0347400396169864
driven_lanedir_max3.5957424761413117
driven_lanedir_mean2.689927714815642
driven_lanedir_median2.564614171752136
driven_lanedir_min2.0347400396169864
get_duckie_state_max1.1421186955214589e-06
get_duckie_state_mean1.1421186955214589e-06
get_duckie_state_median1.1421186955214589e-06
get_duckie_state_min1.1421186955214589e-06
get_robot_state_max0.0129280964880531
get_robot_state_mean0.0129280964880531
get_robot_state_median0.0129280964880531
get_robot_state_min0.0129280964880531
get_state_dump_max0.008316084807616654
get_state_dump_mean0.008316084807616654
get_state_dump_median0.008316084807616654
get_state_dump_min0.008316084807616654
get_ui_image_max0.05777707865144488
get_ui_image_mean0.05777707865144488
get_ui_image_median0.05777707865144488
get_ui_image_min0.05777707865144488
in-drivable-lane_max28.59999999999943
in-drivable-lane_mean22.612499999999475
in-drivable-lane_min13.999999999999757
per-episodes
details{"LFVI_multi-full-udem1-000-ego0": {"driven_any": 3.5217584460469045, "get_ui_image": 0.05777707865144488, "step_physics": 0.2291559366159564, "survival_time": 45.74999999999954, "driven_lanedir": 2.445617025602283, "get_state_dump": 0.008316084807616654, "get_robot_state": 0.0129280964880531, "sim_render-ego0": 0.003338725025476847, "sim_render-ego1": 0.0034601022062343283, "sim_render-ego2": 0.0034411557376645015, "sim_render-ego3": 0.0034555032784241257, "get_duckie_state": 1.1421186955214589e-06, "in-drivable-lane": 25.499999999999385, "deviation-heading": 1.9964232867784195, "agent_compute-ego0": 0.028244162490794752, "agent_compute-ego1": 0.028664262273946705, "agent_compute-ego2": 0.029338859574763537, "agent_compute-ego3": 0.03182780404278285, "complete-iteration": 0.4784915954785576, "set_robot_commands": 0.001965327294112293, "distance-from-start": 3.400124225881637, "deviation-center-line": 0.4893263876192985, "driven_lanedir_consec": 2.445617025602283, "sim_compute_sim_state": 0.023309552513355772, "sim_compute_performance-ego0": 0.001849839260484454, "sim_compute_performance-ego1": 0.0017272715485252149, "sim_compute_performance-ego2": 0.001772832141692982, "sim_compute_performance-ego3": 0.0017631535446799998}, "LFVI_multi-full-udem1-000-ego1": {"driven_any": 4.5179771959323105, "get_ui_image": 0.05777707865144488, "step_physics": 0.2291559366159564, "survival_time": 45.74999999999954, "driven_lanedir": 2.683611317901989, "get_state_dump": 0.008316084807616654, "get_robot_state": 0.0129280964880531, "sim_render-ego0": 0.003338725025476847, "sim_render-ego1": 0.0034601022062343283, "sim_render-ego2": 0.0034411557376645015, "sim_render-ego3": 0.0034555032784241257, "get_duckie_state": 1.1421186955214589e-06, "in-drivable-lane": 22.349999999999326, "deviation-heading": 7.262346412012639, "agent_compute-ego0": 0.028244162490794752, "agent_compute-ego1": 0.028664262273946705, "agent_compute-ego2": 0.029338859574763537, "agent_compute-ego3": 0.03182780404278285, "complete-iteration": 0.4784915954785576, "set_robot_commands": 0.001965327294112293, "distance-from-start": 3.1245602800549155, "deviation-center-line": 1.7882282398432696, "driven_lanedir_consec": 2.683611317901989, "sim_compute_sim_state": 0.023309552513355772, "sim_compute_performance-ego0": 0.001849839260484454, "sim_compute_performance-ego1": 0.0017272715485252149, "sim_compute_performance-ego2": 0.001772832141692982, "sim_compute_performance-ego3": 0.0017631535446799998}, "LFVI_multi-full-udem1-000-ego2": {"driven_any": 2.4570414134958645, "get_ui_image": 0.05777707865144488, "step_physics": 0.2291559366159564, "survival_time": 45.74999999999954, "driven_lanedir": 2.0347400396169864, "get_state_dump": 0.008316084807616654, "get_robot_state": 0.0129280964880531, "sim_render-ego0": 0.003338725025476847, "sim_render-ego1": 0.0034601022062343283, "sim_render-ego2": 0.0034411557376645015, "sim_render-ego3": 0.0034555032784241257, "get_duckie_state": 1.1421186955214589e-06, "in-drivable-lane": 28.59999999999943, "deviation-heading": 3.68992936220966, "agent_compute-ego0": 0.028244162490794752, "agent_compute-ego1": 0.028664262273946705, "agent_compute-ego2": 0.029338859574763537, "agent_compute-ego3": 0.03182780404278285, "complete-iteration": 0.4784915954785576, "set_robot_commands": 0.001965327294112293, "distance-from-start": 2.324137798831628, "deviation-center-line": 1.115350755450527, "driven_lanedir_consec": 2.0347400396169864, "sim_compute_sim_state": 0.023309552513355772, "sim_compute_performance-ego0": 0.001849839260484454, "sim_compute_performance-ego1": 0.0017272715485252149, "sim_compute_performance-ego2": 0.001772832141692982, "sim_compute_performance-ego3": 0.0017631535446799998}, "LFVI_multi-full-udem1-000-ego3": {"driven_any": 5.570237359967187, "get_ui_image": 0.05777707865144488, "step_physics": 0.2291559366159564, "survival_time": 45.74999999999954, "driven_lanedir": 3.5957424761413117, "get_state_dump": 0.008316084807616654, "get_robot_state": 0.0129280964880531, "sim_render-ego0": 0.003338725025476847, "sim_render-ego1": 0.0034601022062343283, "sim_render-ego2": 0.0034411557376645015, "sim_render-ego3": 0.0034555032784241257, "get_duckie_state": 1.1421186955214589e-06, "in-drivable-lane": 13.999999999999757, "deviation-heading": 11.077602389853723, "agent_compute-ego0": 0.028244162490794752, "agent_compute-ego1": 0.028664262273946705, "agent_compute-ego2": 0.029338859574763537, "agent_compute-ego3": 0.03182780404278285, "complete-iteration": 0.4784915954785576, "set_robot_commands": 0.001965327294112293, "distance-from-start": 3.707002417703116, "deviation-center-line": 2.847404933920423, "driven_lanedir_consec": 3.5955877468517707, "sim_compute_sim_state": 0.023309552513355772, "sim_compute_performance-ego0": 0.001849839260484454, "sim_compute_performance-ego1": 0.0017272715485252149, "sim_compute_performance-ego2": 0.001772832141692982, "sim_compute_performance-ego3": 0.0017631535446799998}}
set_robot_commands_max0.001965327294112293
set_robot_commands_mean0.001965327294112293
set_robot_commands_median0.001965327294112293
set_robot_commands_min0.001965327294112293
sim_compute_performance-ego0_max0.001849839260484454
sim_compute_performance-ego0_mean0.001849839260484454
sim_compute_performance-ego0_median0.001849839260484454
sim_compute_performance-ego0_min0.001849839260484454
sim_compute_performance-ego1_max0.0017272715485252149
sim_compute_performance-ego1_mean0.0017272715485252149
sim_compute_performance-ego1_median0.0017272715485252149
sim_compute_performance-ego1_min0.0017272715485252149
sim_compute_performance-ego2_max0.001772832141692982
sim_compute_performance-ego2_mean0.001772832141692982
sim_compute_performance-ego2_median0.001772832141692982
sim_compute_performance-ego2_min0.001772832141692982
sim_compute_performance-ego3_max0.0017631535446799998
sim_compute_performance-ego3_mean0.0017631535446799998
sim_compute_performance-ego3_median0.0017631535446799998
sim_compute_performance-ego3_min0.0017631535446799998
sim_compute_sim_state_max0.023309552513355772
sim_compute_sim_state_mean0.023309552513355772
sim_compute_sim_state_median0.023309552513355772
sim_compute_sim_state_min0.023309552513355772
sim_render-ego0_max0.003338725025476847
sim_render-ego0_mean0.003338725025476847
sim_render-ego0_median0.003338725025476847
sim_render-ego0_min0.003338725025476847
sim_render-ego1_max0.0034601022062343283
sim_render-ego1_mean0.0034601022062343283
sim_render-ego1_median0.0034601022062343283
sim_render-ego1_min0.0034601022062343283
sim_render-ego2_max0.0034411557376645015
sim_render-ego2_mean0.0034411557376645015
sim_render-ego2_median0.0034411557376645015
sim_render-ego2_min0.0034411557376645015
sim_render-ego3_max0.0034555032784241257
sim_render-ego3_mean0.0034555032784241257
sim_render-ego3_median0.0034555032784241257
sim_render-ego3_min0.0034555032784241257
simulation-passed1
step_physics_max0.2291559366159564
step_physics_mean0.2291559366159564
step_physics_median0.2291559366159564
step_physics_min0.2291559366159564
survival_time_max45.74999999999954
survival_time_mean45.74999999999954
survival_time_min45.74999999999954
No reset possible
91493sim-0of4successyes0:12:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.800000000000217
in-drivable-lane_median11.675000000000166
driven_lanedir_consec_median0.8622310383416778
deviation-center-line_median0.7692327951262461


other stats
agent_compute-ego0_max0.03005674715253189
agent_compute-ego0_mean0.03005674715253189
agent_compute-ego0_median0.03005674715253189
agent_compute-ego0_min0.03005674715253189
agent_compute-ego1_max0.03036390271944779
agent_compute-ego1_mean0.03036390271944779
agent_compute-ego1_median0.03036390271944779
agent_compute-ego1_min0.03036390271944779
agent_compute-ego2_max0.03537190080408599
agent_compute-ego2_mean0.03537190080408599
agent_compute-ego2_median0.03537190080408599
agent_compute-ego2_min0.03537190080408599
agent_compute-ego3_max0.04611432240522603
agent_compute-ego3_mean0.04611432240522603
agent_compute-ego3_median0.04611432240522603
agent_compute-ego3_min0.04611432240522603
complete-iteration_max0.5163430256143182
complete-iteration_mean0.5163430256143182
complete-iteration_median0.5163430256143182
complete-iteration_min0.5163430256143182
deviation-center-line_max4.002568878256163
deviation-center-line_mean1.4761468437373757
deviation-center-line_min0.36355290644084737
deviation-heading_max1.7907525006471785
deviation-heading_mean1.4700647776891465
deviation-heading_median1.5206850072430915
deviation-heading_min1.0481365956232245
distance-from-start_max2.4545805011910167
distance-from-start_mean1.2218499259596405
distance-from-start_median1.0365786451917411
distance-from-start_min0.359661912264063
driven_any_max2.9613813759160648
driven_any_mean1.4016657860497062
driven_any_median1.140156001613871
driven_any_min0.3649697650550177
driven_lanedir_consec_max1.7508039680063183
driven_lanedir_consec_mean0.9549480606969722
driven_lanedir_consec_min0.34452619809821483
driven_lanedir_max2.0379794595961607
driven_lanedir_mean1.0608114221542373
driven_lanedir_median0.9303700154612868
driven_lanedir_min0.34452619809821483
get_duckie_state_max1.3834993604203346e-06
get_duckie_state_mean1.3834993604203346e-06
get_duckie_state_median1.3834993604203346e-06
get_duckie_state_min1.3834993604203346e-06
get_robot_state_max0.013119785838443749
get_robot_state_mean0.013119785838443749
get_robot_state_median0.013119785838443749
get_robot_state_min0.013119785838443749
get_state_dump_max0.008842511436109332
get_state_dump_mean0.008842511436109332
get_state_dump_median0.008842511436109332
get_state_dump_min0.008842511436109332
get_ui_image_max0.06333146728500275
get_ui_image_mean0.06333146728500275
get_ui_image_median0.06333146728500275
get_ui_image_min0.06333146728500275
in-drivable-lane_max18.150000000000233
in-drivable-lane_mean10.375000000000142
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-full-4way-000-ego0": {"driven_any": 0.3649697650550177, "get_ui_image": 0.06333146728500275, "step_physics": 0.241741882723342, "survival_time": 24.800000000000217, "driven_lanedir": 0.34452619809821483, "get_state_dump": 0.008842511436109332, "get_robot_state": 0.013119785838443749, "sim_render-ego0": 0.003535943251980142, "sim_render-ego1": 0.003726115409037477, "sim_render-ego2": 0.0036957311918078294, "sim_render-ego3": 0.003695570487131775, "get_duckie_state": 1.3834993604203346e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.4780549664337888, "agent_compute-ego0": 0.03005674715253189, "agent_compute-ego1": 0.03036390271944779, "agent_compute-ego2": 0.03537190080408599, "agent_compute-ego3": 0.04611432240522603, "complete-iteration": 0.5163430256143182, "set_robot_commands": 0.002230148200297979, "distance-from-start": 0.359661912264063, "deviation-center-line": 4.002568878256163, "driven_lanedir_consec": 0.34452619809821483, "sim_compute_sim_state": 0.016480884321738536, "sim_compute_performance-ego0": 0.00183779181129256, "sim_compute_performance-ego1": 0.0017977442060198104, "sim_compute_performance-ego2": 0.0018139086978536255, "sim_compute_performance-ego3": 0.001823792755004146}, "LFVI_multi-full-4way-000-ego1": {"driven_any": 1.0685523691098808, "get_ui_image": 0.06333146728500275, "step_physics": 0.241741882723342, "survival_time": 24.800000000000217, "driven_lanedir": 0.755199573825768, "get_state_dump": 0.008842511436109332, "get_robot_state": 0.013119785838443749, "sim_render-ego0": 0.003535943251980142, "sim_render-ego1": 0.003726115409037477, "sim_render-ego2": 0.0036957311918078294, "sim_render-ego3": 0.003695570487131775, "get_duckie_state": 1.3834993604203346e-06, "in-drivable-lane": 18.150000000000233, "deviation-heading": 1.5633150480523947, "agent_compute-ego0": 0.03005674715253189, "agent_compute-ego1": 0.03036390271944779, "agent_compute-ego2": 0.03537190080408599, "agent_compute-ego3": 0.04611432240522603, "complete-iteration": 0.5163430256143182, "set_robot_commands": 0.002230148200297979, "distance-from-start": 0.9921272332440058, "deviation-center-line": 0.6685592059925011, "driven_lanedir_consec": 0.7309634470253514, "sim_compute_sim_state": 0.016480884321738536, "sim_compute_performance-ego0": 0.00183779181129256, "sim_compute_performance-ego1": 0.0017977442060198104, "sim_compute_performance-ego2": 0.0018139086978536255, "sim_compute_performance-ego3": 0.001823792755004146}, "LFVI_multi-full-4way-000-ego2": {"driven_any": 2.9613813759160648, "get_ui_image": 0.06333146728500275, "step_physics": 0.241741882723342, "survival_time": 24.800000000000217, "driven_lanedir": 2.0379794595961607, "get_state_dump": 0.008842511436109332, "get_robot_state": 0.013119785838443749, "sim_render-ego0": 0.003535943251980142, "sim_render-ego1": 0.003726115409037477, "sim_render-ego2": 0.0036957311918078294, "sim_render-ego3": 0.003695570487131775, "get_duckie_state": 1.3834993604203346e-06, "in-drivable-lane": 8.000000000000114, "deviation-heading": 1.0481365956232245, "agent_compute-ego0": 0.03005674715253189, "agent_compute-ego1": 0.03036390271944779, "agent_compute-ego2": 0.03537190080408599, "agent_compute-ego3": 0.04611432240522603, "complete-iteration": 0.5163430256143182, "set_robot_commands": 0.002230148200297979, "distance-from-start": 2.4545805011910167, "deviation-center-line": 0.36355290644084737, "driven_lanedir_consec": 1.7508039680063183, "sim_compute_sim_state": 0.016480884321738536, "sim_compute_performance-ego0": 0.00183779181129256, "sim_compute_performance-ego1": 0.0017977442060198104, "sim_compute_performance-ego2": 0.0018139086978536255, "sim_compute_performance-ego3": 0.001823792755004146}, "LFVI_multi-full-4way-000-ego3": {"driven_any": 1.211759634117861, "get_ui_image": 0.06333146728500275, "step_physics": 0.241741882723342, "survival_time": 24.800000000000217, "driven_lanedir": 1.1055404570968057, "get_state_dump": 0.008842511436109332, "get_robot_state": 0.013119785838443749, "sim_render-ego0": 0.003535943251980142, "sim_render-ego1": 0.003726115409037477, "sim_render-ego2": 0.0036957311918078294, "sim_render-ego3": 0.003695570487131775, "get_duckie_state": 1.3834993604203346e-06, "in-drivable-lane": 15.350000000000218, "deviation-heading": 1.7907525006471785, "agent_compute-ego0": 0.03005674715253189, "agent_compute-ego1": 0.03036390271944779, "agent_compute-ego2": 0.03537190080408599, "agent_compute-ego3": 0.04611432240522603, "complete-iteration": 0.5163430256143182, "set_robot_commands": 0.002230148200297979, "distance-from-start": 1.0810300571394766, "deviation-center-line": 0.869906384259991, "driven_lanedir_consec": 0.9934986296580042, "sim_compute_sim_state": 0.016480884321738536, "sim_compute_performance-ego0": 0.00183779181129256, "sim_compute_performance-ego1": 0.0017977442060198104, "sim_compute_performance-ego2": 0.0018139086978536255, "sim_compute_performance-ego3": 0.001823792755004146}}
set_robot_commands_max0.002230148200297979
set_robot_commands_mean0.002230148200297979
set_robot_commands_median0.002230148200297979
set_robot_commands_min0.002230148200297979
sim_compute_performance-ego0_max0.00183779181129256
sim_compute_performance-ego0_mean0.00183779181129256
sim_compute_performance-ego0_median0.00183779181129256
sim_compute_performance-ego0_min0.00183779181129256
sim_compute_performance-ego1_max0.0017977442060198104
sim_compute_performance-ego1_mean0.0017977442060198104
sim_compute_performance-ego1_median0.0017977442060198104
sim_compute_performance-ego1_min0.0017977442060198104
sim_compute_performance-ego2_max0.0018139086978536255
sim_compute_performance-ego2_mean0.0018139086978536255
sim_compute_performance-ego2_median0.0018139086978536255
sim_compute_performance-ego2_min0.0018139086978536255
sim_compute_performance-ego3_max0.001823792755004146
sim_compute_performance-ego3_mean0.001823792755004146
sim_compute_performance-ego3_median0.001823792755004146
sim_compute_performance-ego3_min0.001823792755004146
sim_compute_sim_state_max0.016480884321738536
sim_compute_sim_state_mean0.016480884321738536
sim_compute_sim_state_median0.016480884321738536
sim_compute_sim_state_min0.016480884321738536
sim_render-ego0_max0.003535943251980142
sim_render-ego0_mean0.003535943251980142
sim_render-ego0_median0.003535943251980142
sim_render-ego0_min0.003535943251980142
sim_render-ego1_max0.003726115409037477
sim_render-ego1_mean0.003726115409037477
sim_render-ego1_median0.003726115409037477
sim_render-ego1_min0.003726115409037477
sim_render-ego2_max0.0036957311918078294
sim_render-ego2_mean0.0036957311918078294
sim_render-ego2_median0.0036957311918078294
sim_render-ego2_min0.0036957311918078294
sim_render-ego3_max0.003695570487131775
sim_render-ego3_mean0.003695570487131775
sim_render-ego3_median0.003695570487131775
sim_render-ego3_min0.003695570487131775
simulation-passed1
step_physics_max0.241741882723342
step_physics_mean0.241741882723342
step_physics_median0.241741882723342
step_physics_min0.241741882723342
survival_time_max24.800000000000217
survival_time_mean24.800000000000217
survival_time_min24.800000000000217
No reset possible
77091sim-2of4successyes0:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77090sim-3of4successyes0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77089sim-2of4successyes0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77088sim-3of4successyes0:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77087sim-3of4successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77083sim-1of4successyes0:21:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77081sim-2of4successyes0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77080sim-0of4successyes0:12:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible