Duckietown Challenges Home Challenges Submissions

Submission 15520

Submission15520
Competingyes
Challengeaido-LFVI_multi_full-sim-validation
UserAlessandro Zanardi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 91471 sim-1of4: 91477 sim-2of4: 91473 sim-3of4: 91476
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

91477

Click the images to see detailed statistics about the episode.

LFVI_multi-full-udem1-000

91471

Click the images to see detailed statistics about the episode.

LFVI_multi-full-4way-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
91477sim-1of4successyes0:29:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median7.201645883349939
deviation-center-line_median0.2638091718743593


other stats
agent_compute-ego0_max0.03623630264021773
agent_compute-ego0_mean0.03623630264021773
agent_compute-ego0_median0.03623630264021773
agent_compute-ego0_min0.03623630264021773
agent_compute-ego1_max0.035895346999664686
agent_compute-ego1_mean0.035895346999664686
agent_compute-ego1_median0.035895346999664686
agent_compute-ego1_min0.035895346999664686
agent_compute-ego2_max0.03705261708497008
agent_compute-ego2_mean0.03705261708497008
agent_compute-ego2_median0.03705261708497008
agent_compute-ego2_min0.03705261708497008
agent_compute-ego3_max0.03736065845505383
agent_compute-ego3_mean0.03736065845505383
agent_compute-ego3_median0.03736065845505383
agent_compute-ego3_min0.03736065845505383
complete-iteration_max0.5946222254874605
complete-iteration_mean0.5946222254874605
complete-iteration_median0.5946222254874605
complete-iteration_min0.5946222254874605
deviation-center-line_max0.39601032018869425
deviation-center-line_mean0.29378101476976515
deviation-center-line_min0.25149539514164776
deviation-heading_max2.9975522219323265
deviation-heading_mean2.6790813321026343
deviation-heading_median2.6875889068937235
deviation-heading_min2.3435952926907646
distance-from-start_max3.515097799741973
distance-from-start_mean3.1568770292336445
distance-from-start_median3.177709193939605
distance-from-start_min2.756991929313395
driven_any_max7.431897753906775
driven_any_mean7.221604291430889
driven_any_median7.372729995004255
driven_any_min6.709059421808274
driven_lanedir_consec_max7.4132071890160365
driven_lanedir_consec_mean7.053136317150535
driven_lanedir_consec_min6.3960463128862255
driven_lanedir_max7.4132071890160365
driven_lanedir_mean7.202415510279658
driven_lanedir_median7.350892762594582
driven_lanedir_min6.6946693269134325
get_duckie_state_max1.500984909730986e-06
get_duckie_state_mean1.500984909730986e-06
get_duckie_state_median1.500984909730986e-06
get_duckie_state_min1.500984909730986e-06
get_robot_state_max0.01357327789986362
get_robot_state_mean0.01357327789986362
get_robot_state_median0.01357327789986362
get_robot_state_min0.01357327789986362
get_state_dump_max0.008755642607448301
get_state_dump_mean0.008755642607448301
get_state_dump_median0.008755642607448301
get_state_dump_min0.008755642607448301
get_ui_image_max0.059326994329765376
get_ui_image_mean0.059326994329765376
get_ui_image_median0.059326994329765376
get_ui_image_min0.059326994329765376
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-full-udem1-000-ego0": {"driven_any": 7.338465513600921, "get_ui_image": 0.059326994329765376, "step_physics": 0.30156297270801047, "survival_time": 59.99999999999873, "driven_lanedir": 7.314757807087399, "get_state_dump": 0.008755642607448301, "get_robot_state": 0.01357327789986362, "sim_render-ego0": 0.003623925875267518, "sim_render-ego1": 0.003657678283322959, "sim_render-ego2": 0.003693673930299173, "sim_render-ego3": 0.0036471473684318856, "get_duckie_state": 1.500984909730986e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.9219683939100407, "agent_compute-ego0": 0.03623630264021773, "agent_compute-ego1": 0.035895346999664686, "agent_compute-ego2": 0.03705261708497008, "agent_compute-ego3": 0.03736065845505383, "complete-iteration": 0.5946222254874605, "set_robot_commands": 0.0022412495847347873, "distance-from-start": 2.756991929313395, "deviation-center-line": 0.39601032018869425, "driven_lanedir_consec": 7.314757807087399, "sim_compute_sim_state": 0.033658663895009065, "sim_compute_performance-ego0": 0.00202092044458699, "sim_compute_performance-ego1": 0.0018773801519312923, "sim_compute_performance-ego2": 0.001880309464631728, "sim_compute_performance-ego3": 0.001874789707269597}, "LFVI_multi-full-udem1-000-ego1": {"driven_any": 7.431897753906775, "get_ui_image": 0.059326994329765376, "step_physics": 0.30156297270801047, "survival_time": 59.99999999999873, "driven_lanedir": 7.4132071890160365, "get_state_dump": 0.008755642607448301, "get_robot_state": 0.01357327789986362, "sim_render-ego0": 0.003623925875267518, "sim_render-ego1": 0.003657678283322959, "sim_render-ego2": 0.003693673930299173, "sim_render-ego3": 0.0036471473684318856, "get_duckie_state": 1.500984909730986e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.453209419877407, "agent_compute-ego0": 0.03623630264021773, "agent_compute-ego1": 0.035895346999664686, "agent_compute-ego2": 0.03705261708497008, "agent_compute-ego3": 0.03736065845505383, "complete-iteration": 0.5946222254874605, "set_robot_commands": 0.0022412495847347873, "distance-from-start": 2.9695336261103513, "deviation-center-line": 0.25149539514164776, "driven_lanedir_consec": 7.4132071890160365, "sim_compute_sim_state": 0.033658663895009065, "sim_compute_performance-ego0": 0.00202092044458699, "sim_compute_performance-ego1": 0.0018773801519312923, "sim_compute_performance-ego2": 0.001880309464631728, "sim_compute_performance-ego3": 0.001874789707269597}, "LFVI_multi-full-udem1-000-ego2": {"driven_any": 6.709059421808274, "get_ui_image": 0.059326994329765376, "step_physics": 0.30156297270801047, "survival_time": 59.99999999999873, "driven_lanedir": 6.6946693269134325, "get_state_dump": 0.008755642607448301, "get_robot_state": 0.01357327789986362, "sim_render-ego0": 0.003623925875267518, "sim_render-ego1": 0.003657678283322959, "sim_render-ego2": 0.003693673930299173, "sim_render-ego3": 0.0036471473684318856, "get_duckie_state": 1.500984909730986e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.9975522219323265, "agent_compute-ego0": 0.03623630264021773, "agent_compute-ego1": 0.035895346999664686, "agent_compute-ego2": 0.03705261708497008, "agent_compute-ego3": 0.03736065845505383, "complete-iteration": 0.5946222254874605, "set_robot_commands": 0.0022412495847347873, "distance-from-start": 3.3858847617688586, "deviation-center-line": 0.2588366099083409, "driven_lanedir_consec": 6.3960463128862255, "sim_compute_sim_state": 0.033658663895009065, "sim_compute_performance-ego0": 0.00202092044458699, "sim_compute_performance-ego1": 0.0018773801519312923, "sim_compute_performance-ego2": 0.001880309464631728, "sim_compute_performance-ego3": 0.001874789707269597}, "LFVI_multi-full-udem1-000-ego3": {"driven_any": 7.406994476407587, "get_ui_image": 0.059326994329765376, "step_physics": 0.30156297270801047, "survival_time": 59.99999999999873, "driven_lanedir": 7.387027718101765, "get_state_dump": 0.008755642607448301, "get_robot_state": 0.01357327789986362, "sim_render-ego0": 0.003623925875267518, "sim_render-ego1": 0.003657678283322959, "sim_render-ego2": 0.003693673930299173, "sim_render-ego3": 0.0036471473684318856, "get_duckie_state": 1.500984909730986e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.3435952926907646, "agent_compute-ego0": 0.03623630264021773, "agent_compute-ego1": 0.035895346999664686, "agent_compute-ego2": 0.03705261708497008, "agent_compute-ego3": 0.03736065845505383, "complete-iteration": 0.5946222254874605, "set_robot_commands": 0.0022412495847347873, "distance-from-start": 3.515097799741973, "deviation-center-line": 0.26878173384037773, "driven_lanedir_consec": 7.088533959612479, "sim_compute_sim_state": 0.033658663895009065, "sim_compute_performance-ego0": 0.00202092044458699, "sim_compute_performance-ego1": 0.0018773801519312923, "sim_compute_performance-ego2": 0.001880309464631728, "sim_compute_performance-ego3": 0.001874789707269597}}
set_robot_commands_max0.0022412495847347873
set_robot_commands_mean0.0022412495847347873
set_robot_commands_median0.0022412495847347873
set_robot_commands_min0.0022412495847347873
sim_compute_performance-ego0_max0.00202092044458699
sim_compute_performance-ego0_mean0.00202092044458699
sim_compute_performance-ego0_median0.00202092044458699
sim_compute_performance-ego0_min0.00202092044458699
sim_compute_performance-ego1_max0.0018773801519312923
sim_compute_performance-ego1_mean0.0018773801519312923
sim_compute_performance-ego1_median0.0018773801519312923
sim_compute_performance-ego1_min0.0018773801519312923
sim_compute_performance-ego2_max0.001880309464631728
sim_compute_performance-ego2_mean0.001880309464631728
sim_compute_performance-ego2_median0.001880309464631728
sim_compute_performance-ego2_min0.001880309464631728
sim_compute_performance-ego3_max0.001874789707269597
sim_compute_performance-ego3_mean0.001874789707269597
sim_compute_performance-ego3_median0.001874789707269597
sim_compute_performance-ego3_min0.001874789707269597
sim_compute_sim_state_max0.033658663895009065
sim_compute_sim_state_mean0.033658663895009065
sim_compute_sim_state_median0.033658663895009065
sim_compute_sim_state_min0.033658663895009065
sim_render-ego0_max0.003623925875267518
sim_render-ego0_mean0.003623925875267518
sim_render-ego0_median0.003623925875267518
sim_render-ego0_min0.003623925875267518
sim_render-ego1_max0.003657678283322959
sim_render-ego1_mean0.003657678283322959
sim_render-ego1_median0.003657678283322959
sim_render-ego1_min0.003657678283322959
sim_render-ego2_max0.003693673930299173
sim_render-ego2_mean0.003693673930299173
sim_render-ego2_median0.003693673930299173
sim_render-ego2_min0.003693673930299173
sim_render-ego3_max0.0036471473684318856
sim_render-ego3_mean0.0036471473684318856
sim_render-ego3_median0.0036471473684318856
sim_render-ego3_min0.0036471473684318856
simulation-passed1
step_physics_max0.30156297270801047
step_physics_mean0.30156297270801047
step_physics_median0.30156297270801047
step_physics_min0.30156297270801047
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
91476sim-3of4successyes0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
91475sim-3of4successyes0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91474sim-3of4successyes0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91473sim-2of4successyes0:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
91471sim-0of4successyes0:28:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median7.275289647480216
deviation-center-line_median0.17565073909383375


other stats
agent_compute-ego0_max0.0347018218060318
agent_compute-ego0_mean0.0347018218060318
agent_compute-ego0_median0.0347018218060318
agent_compute-ego0_min0.0347018218060318
agent_compute-ego1_max0.03629122626076729
agent_compute-ego1_mean0.03629122626076729
agent_compute-ego1_median0.03629122626076729
agent_compute-ego1_min0.03629122626076729
agent_compute-ego2_max0.03518452791250516
agent_compute-ego2_mean0.03518452791250516
agent_compute-ego2_median0.03518452791250516
agent_compute-ego2_min0.03518452791250516
agent_compute-ego3_max0.03500682686290376
agent_compute-ego3_mean0.03500682686290376
agent_compute-ego3_median0.03500682686290376
agent_compute-ego3_min0.03500682686290376
complete-iteration_max0.5346016730992225
complete-iteration_mean0.5346016730992225
complete-iteration_median0.5346016730992225
complete-iteration_min0.5346016730992225
deviation-center-line_max0.2008234359843604
deviation-center-line_mean0.17058848220289555
deviation-center-line_min0.13022901463955433
deviation-heading_max1.9071471687906605
deviation-heading_mean1.6454701948618748
deviation-heading_median1.779786382085616
deviation-heading_min1.1151608464856066
distance-from-start_max3.1429889412015144
distance-from-start_mean2.588258650399684
distance-from-start_median2.5866746395852145
distance-from-start_min2.0366963812267924
driven_any_max7.431931846867728
driven_any_mean7.204808261252023
driven_any_median7.43192292705587
driven_any_min6.523455344028619
driven_lanedir_consec_max7.42774649781732
driven_lanedir_consec_mean6.920116271751833
driven_lanedir_consec_min5.702139294229578
driven_lanedir_max7.427746592776523
driven_lanedir_mean7.19646457357502
driven_lanedir_median7.421387339215907
driven_lanedir_min6.5153370230917425
get_duckie_state_max1.1367067310037858e-06
get_duckie_state_mean1.1367067310037858e-06
get_duckie_state_median1.1367067310037858e-06
get_duckie_state_min1.1367067310037858e-06
get_robot_state_max0.012781983708263335
get_robot_state_mean0.012781983708263335
get_robot_state_median0.012781983708263335
get_robot_state_min0.012781983708263335
get_state_dump_max0.008459009000601916
get_state_dump_mean0.008459009000601916
get_state_dump_median0.008459009000601916
get_state_dump_min0.008459009000601916
get_ui_image_max0.05610695230672997
get_ui_image_mean0.05610695230672997
get_ui_image_median0.05610695230672997
get_ui_image_min0.05610695230672997
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-full-4way-000-ego0": {"driven_any": 7.431925271277351, "get_ui_image": 0.05610695230672997, "step_physics": 0.2557728574436769, "survival_time": 59.99999999999873, "driven_lanedir": 7.420630174959173, "get_state_dump": 0.008459009000601916, "get_robot_state": 0.012781983708263335, "sim_render-ego0": 0.003420484750892201, "sim_render-ego1": 0.003423560370414283, "sim_render-ego2": 0.003496679239328656, "sim_render-ego3": 0.0035306827710331924, "get_duckie_state": 1.1367067310037858e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.744980922171008, "agent_compute-ego0": 0.0347018218060318, "agent_compute-ego1": 0.03629122626076729, "agent_compute-ego2": 0.03518452791250516, "agent_compute-ego3": 0.03500682686290376, "complete-iteration": 0.5346016730992225, "set_robot_commands": 0.0020162926228417645, "distance-from-start": 3.1321139988477675, "deviation-center-line": 0.1683766480089113, "driven_lanedir_consec": 7.420630174959173, "sim_compute_sim_state": 0.031202892578213934, "sim_compute_performance-ego0": 0.0018250910467549624, "sim_compute_performance-ego1": 0.001664582736089168, "sim_compute_performance-ego2": 0.0017230048167715462, "sim_compute_performance-ego3": 0.0017389772734376016}, "LFVI_multi-full-4way-000-ego1": {"driven_any": 7.43192058283439, "get_ui_image": 0.05610695230672997, "step_physics": 0.2557728574436769, "survival_time": 59.99999999999873, "driven_lanedir": 7.422144503472641, "get_state_dump": 0.008459009000601916, "get_robot_state": 0.012781983708263335, "sim_render-ego0": 0.003420484750892201, "sim_render-ego1": 0.003423560370414283, "sim_render-ego2": 0.003496679239328656, "sim_render-ego3": 0.0035306827710331924, "get_duckie_state": 1.1367067310037858e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9071471687906605, "agent_compute-ego0": 0.0347018218060318, "agent_compute-ego1": 0.03629122626076729, "agent_compute-ego2": 0.03518452791250516, "agent_compute-ego3": 0.03500682686290376, "complete-iteration": 0.5346016730992225, "set_robot_commands": 0.0020162926228417645, "distance-from-start": 2.0412352803226614, "deviation-center-line": 0.2008234359843604, "driven_lanedir_consec": 7.129949120001259, "sim_compute_sim_state": 0.031202892578213934, "sim_compute_performance-ego0": 0.0018250910467549624, "sim_compute_performance-ego1": 0.001664582736089168, "sim_compute_performance-ego2": 0.0017230048167715462, "sim_compute_performance-ego3": 0.0017389772734376016}, "LFVI_multi-full-4way-000-ego2": {"driven_any": 7.431931846867728, "get_ui_image": 0.05610695230672997, "step_physics": 0.2557728574436769, "survival_time": 59.99999999999873, "driven_lanedir": 7.427746592776523, "get_state_dump": 0.008459009000601916, "get_robot_state": 0.012781983708263335, "sim_render-ego0": 0.003420484750892201, "sim_render-ego1": 0.003423560370414283, "sim_render-ego2": 0.003496679239328656, "sim_render-ego3": 0.0035306827710331924, "get_duckie_state": 1.1367067310037858e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1151608464856066, "agent_compute-ego0": 0.0347018218060318, "agent_compute-ego1": 0.03629122626076729, "agent_compute-ego2": 0.03518452791250516, "agent_compute-ego3": 0.03500682686290376, "complete-iteration": 0.5346016730992225, "set_robot_commands": 0.0020162926228417645, "distance-from-start": 3.1429889412015144, "deviation-center-line": 0.13022901463955433, "driven_lanedir_consec": 7.42774649781732, "sim_compute_sim_state": 0.031202892578213934, "sim_compute_performance-ego0": 0.0018250910467549624, "sim_compute_performance-ego1": 0.001664582736089168, "sim_compute_performance-ego2": 0.0017230048167715462, "sim_compute_performance-ego3": 0.0017389772734376016}, "LFVI_multi-full-4way-000-ego3": {"driven_any": 6.523455344028619, "get_ui_image": 0.05610695230672997, "step_physics": 0.2557728574436769, "survival_time": 59.99999999999873, "driven_lanedir": 6.5153370230917425, "get_state_dump": 0.008459009000601916, "get_robot_state": 0.012781983708263335, "sim_render-ego0": 0.003420484750892201, "sim_render-ego1": 0.003423560370414283, "sim_render-ego2": 0.003496679239328656, "sim_render-ego3": 0.0035306827710331924, "get_duckie_state": 1.1367067310037858e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.8145918420002245, "agent_compute-ego0": 0.0347018218060318, "agent_compute-ego1": 0.03629122626076729, "agent_compute-ego2": 0.03518452791250516, "agent_compute-ego3": 0.03500682686290376, "complete-iteration": 0.5346016730992225, "set_robot_commands": 0.0020162926228417645, "distance-from-start": 2.0366963812267924, "deviation-center-line": 0.18292483017875627, "driven_lanedir_consec": 5.702139294229578, "sim_compute_sim_state": 0.031202892578213934, "sim_compute_performance-ego0": 0.0018250910467549624, "sim_compute_performance-ego1": 0.001664582736089168, "sim_compute_performance-ego2": 0.0017230048167715462, "sim_compute_performance-ego3": 0.0017389772734376016}}
set_robot_commands_max0.0020162926228417645
set_robot_commands_mean0.0020162926228417645
set_robot_commands_median0.0020162926228417645
set_robot_commands_min0.0020162926228417645
sim_compute_performance-ego0_max0.0018250910467549624
sim_compute_performance-ego0_mean0.0018250910467549624
sim_compute_performance-ego0_median0.0018250910467549624
sim_compute_performance-ego0_min0.0018250910467549624
sim_compute_performance-ego1_max0.001664582736089168
sim_compute_performance-ego1_mean0.001664582736089168
sim_compute_performance-ego1_median0.001664582736089168
sim_compute_performance-ego1_min0.001664582736089168
sim_compute_performance-ego2_max0.0017230048167715462
sim_compute_performance-ego2_mean0.0017230048167715462
sim_compute_performance-ego2_median0.0017230048167715462
sim_compute_performance-ego2_min0.0017230048167715462
sim_compute_performance-ego3_max0.0017389772734376016
sim_compute_performance-ego3_mean0.0017389772734376016
sim_compute_performance-ego3_median0.0017389772734376016
sim_compute_performance-ego3_min0.0017389772734376016
sim_compute_sim_state_max0.031202892578213934
sim_compute_sim_state_mean0.031202892578213934
sim_compute_sim_state_median0.031202892578213934
sim_compute_sim_state_min0.031202892578213934
sim_render-ego0_max0.003420484750892201
sim_render-ego0_mean0.003420484750892201
sim_render-ego0_median0.003420484750892201
sim_render-ego0_min0.003420484750892201
sim_render-ego1_max0.003423560370414283
sim_render-ego1_mean0.003423560370414283
sim_render-ego1_median0.003423560370414283
sim_render-ego1_min0.003423560370414283
sim_render-ego2_max0.003496679239328656
sim_render-ego2_mean0.003496679239328656
sim_render-ego2_median0.003496679239328656
sim_render-ego2_min0.003496679239328656
sim_render-ego3_max0.0035306827710331924
sim_render-ego3_mean0.0035306827710331924
sim_render-ego3_median0.0035306827710331924
sim_render-ego3_min0.0035306827710331924
simulation-passed1
step_physics_max0.2557728574436769
step_physics_mean0.2557728574436769
step_physics_median0.2557728574436769
step_physics_min0.2557728574436769
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
91470sim-2of4successyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77112sim-3of4successyes0:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77111sim-2of4successyes0:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77110sim-3of4successyes0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77109sim-2of4successyes0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77108sim-3of4successyes0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77107sim-2of4successyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77106sim-1of4successyes0:28:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
77105sim-0of4successyes0:27:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible