Duckietown Challenges Home Challenges Submissions

Submission 15280

Submission15280
Competingyes
Challengeaido-LFVI_multi_full-sim-validation
UserAlessandro Zanardi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 92187 sim-1of4: 92173 sim-2of4: 92189 sim-3of4: 92193
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

92187

Click the images to see detailed statistics about the episode.

LFVI_multi-full-4way-000

92173

Click the images to see detailed statistics about the episode.

LFVI_multi-full-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
92193sim-3of4successyes0:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
92192sim-3of4successyes0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
92190sim-3of4successyes0:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
92189sim-2of4successyes0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
92187sim-0of4successyes0:23:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median50.199999999999285
in-drivable-lane_median0.0
driven_lanedir_consec_median1.8180653910428963
deviation-center-line_median3.937987330081824


other stats
agent_compute-ego0_max0.03491896491738694
agent_compute-ego0_mean0.03491896491738694
agent_compute-ego0_median0.03491896491738694
agent_compute-ego0_min0.03491896491738694
agent_compute-ego1_max0.03491924817289286
agent_compute-ego1_mean0.03491924817289286
agent_compute-ego1_median0.03491924817289286
agent_compute-ego1_min0.03491924817289286
agent_compute-ego2_max0.04549129637912731
agent_compute-ego2_mean0.04549129637912731
agent_compute-ego2_median0.04549129637912731
agent_compute-ego2_min0.04549129637912731
agent_compute-ego3_max0.045370520881159386
agent_compute-ego3_mean0.045370520881159386
agent_compute-ego3_median0.045370520881159386
agent_compute-ego3_min0.045370520881159386
complete-iteration_max0.5043296348989307
complete-iteration_mean0.5043296348989307
complete-iteration_median0.5043296348989307
complete-iteration_min0.5043296348989307
deviation-center-line_max4.273899445995705
deviation-center-line_mean3.236595300259534
deviation-center-line_min0.7965070948787814
deviation-heading_max7.2246699806324255
deviation-heading_mean3.527609279678649
deviation-heading_median3.4330490894166563
deviation-heading_min0.01966895924885798
distance-from-start_max2.3258318359565293
distance-from-start_mean1.3752701583515268
distance-from-start_median1.1909318603943206
distance-from-start_min0.793385076660937
driven_any_max2.94959544160748
driven_any_mean1.8635977639445929
driven_any_median1.8485981510238445
driven_any_min0.8075993121232021
driven_lanedir_consec_max2.9210855674437126
driven_lanedir_consec_mean1.8398258621068757
driven_lanedir_consec_min0.802087098897997
driven_lanedir_max2.930257073791821
driven_lanedir_mean1.8421188683648195
driven_lanedir_median1.81806565038473
driven_lanedir_min0.802087098897997
get_duckie_state_max1.299559180416278e-06
get_duckie_state_mean1.299559180416278e-06
get_duckie_state_median1.299559180416278e-06
get_duckie_state_min1.299559180416278e-06
get_robot_state_max0.01301671308071459
get_robot_state_mean0.01301671308071459
get_robot_state_median0.01301671308071459
get_robot_state_min0.01301671308071459
get_state_dump_max0.008389505936731746
get_state_dump_mean0.008389505936731746
get_state_dump_median0.008389505936731746
get_state_dump_min0.008389505936731746
get_ui_image_max0.05804609042495045
get_ui_image_mean0.05804609042495045
get_ui_image_median0.05804609042495045
get_ui_image_min0.05804609042495045
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean0.27499999999998437
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-full-4way-000-ego0": {"driven_any": 2.8895963025922615, "get_ui_image": 0.05804609042495045, "step_physics": 0.212374876506293, "survival_time": 50.199999999999285, "driven_lanedir": 2.828598101937548, "get_state_dump": 0.008389505936731746, "get_robot_state": 0.01301671308071459, "sim_render-ego0": 0.0034165083472408467, "sim_render-ego1": 0.0034770844587639197, "sim_render-ego2": 0.0035482413733183447, "sim_render-ego3": 0.003503463042909233, "get_duckie_state": 1.299559180416278e-06, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.940681634660039, "agent_compute-ego0": 0.03491896491738694, "agent_compute-ego1": 0.03491924817289286, "agent_compute-ego2": 0.04549129637912731, "agent_compute-ego3": 0.045370520881159386, "complete-iteration": 0.5043296348989307, "set_robot_commands": 0.0022742878738327404, "distance-from-start": 2.3258318359565293, "deviation-center-line": 4.273899445995705, "driven_lanedir_consec": 2.828597583253881, "sim_compute_sim_state": 0.021514342910614773, "sim_compute_performance-ego0": 0.001873549418662911, "sim_compute_performance-ego1": 0.00180079711610405, "sim_compute_performance-ego2": 0.0018392268698013837, "sim_compute_performance-ego3": 0.00185688407859992}, "LFVI_multi-full-4way-000-ego1": {"driven_any": 2.94959544160748, "get_ui_image": 0.05804609042495045, "step_physics": 0.212374876506293, "survival_time": 50.199999999999285, "driven_lanedir": 2.930257073791821, "get_state_dump": 0.008389505936731746, "get_robot_state": 0.01301671308071459, "sim_render-ego0": 0.0034165083472408467, "sim_render-ego1": 0.0034770844587639197, "sim_render-ego2": 0.0035482413733183447, "sim_render-ego3": 0.003503463042909233, "get_duckie_state": 1.299559180416278e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.925416544173274, "agent_compute-ego0": 0.03491896491738694, "agent_compute-ego1": 0.03491924817289286, "agent_compute-ego2": 0.04549129637912731, "agent_compute-ego3": 0.045370520881159386, "complete-iteration": 0.5043296348989307, "set_robot_commands": 0.0022742878738327404, "distance-from-start": 1.5742668771628427, "deviation-center-line": 3.629188936421764, "driven_lanedir_consec": 2.9210855674437126, "sim_compute_sim_state": 0.021514342910614773, "sim_compute_performance-ego0": 0.001873549418662911, "sim_compute_performance-ego1": 0.00180079711610405, "sim_compute_performance-ego2": 0.0018392268698013837, "sim_compute_performance-ego3": 0.00185688407859992}, "LFVI_multi-full-4way-000-ego2": {"driven_any": 0.8075999994554276, "get_ui_image": 0.05804609042495045, "step_physics": 0.212374876506293, "survival_time": 50.199999999999285, "driven_lanedir": 0.8075331988319121, "get_state_dump": 0.008389505936731746, "get_robot_state": 0.01301671308071459, "sim_render-ego0": 0.0034165083472408467, "sim_render-ego1": 0.0034770844587639197, "sim_render-ego2": 0.0035482413733183447, "sim_render-ego3": 0.003503463042909233, "get_duckie_state": 1.299559180416278e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.01966895924885798, "agent_compute-ego0": 0.03491896491738694, "agent_compute-ego1": 0.03491924817289286, "agent_compute-ego2": 0.04549129637912731, "agent_compute-ego3": 0.045370520881159386, "complete-iteration": 0.5043296348989307, "set_robot_commands": 0.0022742878738327404, "distance-from-start": 0.8075968436257983, "deviation-center-line": 0.7965070948787814, "driven_lanedir_consec": 0.8075331988319121, "sim_compute_sim_state": 0.021514342910614773, "sim_compute_performance-ego0": 0.001873549418662911, "sim_compute_performance-ego1": 0.00180079711610405, "sim_compute_performance-ego2": 0.0018392268698013837, "sim_compute_performance-ego3": 0.00185688407859992}, "LFVI_multi-full-4way-000-ego3": {"driven_any": 0.8075993121232021, "get_ui_image": 0.05804609042495045, "step_physics": 0.212374876506293, "survival_time": 50.199999999999285, "driven_lanedir": 0.802087098897997, "get_state_dump": 0.008389505936731746, "get_robot_state": 0.01301671308071459, "sim_render-ego0": 0.0034165083472408467, "sim_render-ego1": 0.0034770844587639197, "sim_render-ego2": 0.0035482413733183447, "sim_render-ego3": 0.003503463042909233, "get_duckie_state": 1.299559180416278e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.2246699806324255, "agent_compute-ego0": 0.03491896491738694, "agent_compute-ego1": 0.03491924817289286, "agent_compute-ego2": 0.04549129637912731, "agent_compute-ego3": 0.045370520881159386, "complete-iteration": 0.5043296348989307, "set_robot_commands": 0.0022742878738327404, "distance-from-start": 0.793385076660937, "deviation-center-line": 4.246785723741884, "driven_lanedir_consec": 0.802087098897997, "sim_compute_sim_state": 0.021514342910614773, "sim_compute_performance-ego0": 0.001873549418662911, "sim_compute_performance-ego1": 0.00180079711610405, "sim_compute_performance-ego2": 0.0018392268698013837, "sim_compute_performance-ego3": 0.00185688407859992}}
set_robot_commands_max0.0022742878738327404
set_robot_commands_mean0.0022742878738327404
set_robot_commands_median0.0022742878738327404
set_robot_commands_min0.0022742878738327404
sim_compute_performance-ego0_max0.001873549418662911
sim_compute_performance-ego0_mean0.001873549418662911
sim_compute_performance-ego0_median0.001873549418662911
sim_compute_performance-ego0_min0.001873549418662911
sim_compute_performance-ego1_max0.00180079711610405
sim_compute_performance-ego1_mean0.00180079711610405
sim_compute_performance-ego1_median0.00180079711610405
sim_compute_performance-ego1_min0.00180079711610405
sim_compute_performance-ego2_max0.0018392268698013837
sim_compute_performance-ego2_mean0.0018392268698013837
sim_compute_performance-ego2_median0.0018392268698013837
sim_compute_performance-ego2_min0.0018392268698013837
sim_compute_performance-ego3_max0.00185688407859992
sim_compute_performance-ego3_mean0.00185688407859992
sim_compute_performance-ego3_median0.00185688407859992
sim_compute_performance-ego3_min0.00185688407859992
sim_compute_sim_state_max0.021514342910614773
sim_compute_sim_state_mean0.021514342910614773
sim_compute_sim_state_median0.021514342910614773
sim_compute_sim_state_min0.021514342910614773
sim_render-ego0_max0.0034165083472408467
sim_render-ego0_mean0.0034165083472408467
sim_render-ego0_median0.0034165083472408467
sim_render-ego0_min0.0034165083472408467
sim_render-ego1_max0.0034770844587639197
sim_render-ego1_mean0.0034770844587639197
sim_render-ego1_median0.0034770844587639197
sim_render-ego1_min0.0034770844587639197
sim_render-ego2_max0.0035482413733183447
sim_render-ego2_mean0.0035482413733183447
sim_render-ego2_median0.0035482413733183447
sim_render-ego2_min0.0035482413733183447
sim_render-ego3_max0.003503463042909233
sim_render-ego3_mean0.003503463042909233
sim_render-ego3_median0.003503463042909233
sim_render-ego3_min0.003503463042909233
simulation-passed1
step_physics_max0.212374876506293
step_physics_mean0.212374876506293
step_physics_median0.212374876506293
step_physics_min0.212374876506293
survival_time_max50.199999999999285
survival_time_mean50.199999999999285
survival_time_min50.199999999999285
No reset possible
92186sim-2of4successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
92173sim-1of4successyes0:26:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.2499999999999858
driven_lanedir_consec_median3.3862878592109658
deviation-center-line_median4.463696570838215


other stats
agent_compute-ego0_max0.03503425770457043
agent_compute-ego0_mean0.03503425770457043
agent_compute-ego0_median0.03503425770457043
agent_compute-ego0_min0.03503425770457043
agent_compute-ego1_max0.032423103778785115
agent_compute-ego1_mean0.032423103778785115
agent_compute-ego1_median0.032423103778785115
agent_compute-ego1_min0.032423103778785115
agent_compute-ego2_max0.033859949326336534
agent_compute-ego2_mean0.033859949326336534
agent_compute-ego2_median0.033859949326336534
agent_compute-ego2_min0.033859949326336534
agent_compute-ego3_max0.03554208530772238
agent_compute-ego3_mean0.03554208530772238
agent_compute-ego3_median0.03554208530772238
agent_compute-ego3_min0.03554208530772238
complete-iteration_max0.4989972334916546
complete-iteration_mean0.4989972334916546
complete-iteration_median0.4989972334916546
complete-iteration_min0.4989972334916546
deviation-center-line_max5.4260979168750865
deviation-center-line_mean4.162691995403243
deviation-center-line_min2.2972769230614594
deviation-heading_max7.603264034774759
deviation-heading_mean5.0921606274986555
deviation-heading_median4.799579059298922
deviation-heading_min3.1662203566220186
distance-from-start_max3.038741726285562
distance-from-start_mean2.5722325217015793
distance-from-start_median2.6101811995571196
distance-from-start_min2.0298259614065173
driven_any_max3.5795940302762306
driven_any_mean3.405591624918424
driven_any_median3.563087532853605
driven_any_min2.9165974036902553
driven_lanedir_consec_max3.5313612130937737
driven_lanedir_consec_mean3.295002854961351
driven_lanedir_consec_min2.8760744883296985
driven_lanedir_max3.562978051773894
driven_lanedir_mean3.3526291930194945
driven_lanedir_median3.485731912165976
driven_lanedir_min2.876074895972133
get_duckie_state_max1.4317025749212896e-06
get_duckie_state_mean1.4317025749212896e-06
get_duckie_state_median1.4317025749212896e-06
get_duckie_state_min1.4317025749212896e-06
get_robot_state_max0.012634758746792731
get_robot_state_mean0.012634758746792731
get_robot_state_median0.012634758746792731
get_robot_state_min0.012634758746792731
get_state_dump_max0.008270841355526278
get_state_dump_mean0.008270841355526278
get_state_dump_median0.008270841355526278
get_state_dump_min0.008270841355526278
get_ui_image_max0.05516750111766501
get_ui_image_mean0.05516750111766501
get_ui_image_median0.05516750111766501
get_ui_image_min0.05516750111766501
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean0.39999999999997726
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-full-udem1-000-ego0": {"driven_any": 3.579584165236704, "get_ui_image": 0.05516750111766501, "step_physics": 0.2257797648567244, "survival_time": 59.99999999999873, "driven_lanedir": 3.562978051773894, "get_state_dump": 0.008270841355526278, "get_robot_state": 0.012634758746792731, "sim_render-ego0": 0.003306445829278722, "sim_render-ego1": 0.003301342162958887, "sim_render-ego2": 0.003284446008000942, "sim_render-ego3": 0.0033407798913198147, "get_duckie_state": 1.4317025749212896e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.1662203566220186, "agent_compute-ego0": 0.03503425770457043, "agent_compute-ego1": 0.032423103778785115, "agent_compute-ego2": 0.033859949326336534, "agent_compute-ego3": 0.03554208530772238, "complete-iteration": 0.4989972334916546, "set_robot_commands": 0.002036657063391286, "distance-from-start": 2.0298259614065173, "deviation-center-line": 2.2972769230614594, "driven_lanedir_consec": 3.3324731071837532, "sim_compute_sim_state": 0.032128317965555944, "sim_compute_performance-ego0": 0.0017877022094472462, "sim_compute_performance-ego1": 0.001657634650936333, "sim_compute_performance-ego2": 0.0016521998587297857, "sim_compute_performance-ego3": 0.0016960893245064944}, "LFVI_multi-full-udem1-000-ego1": {"driven_any": 3.5465909004705063, "get_ui_image": 0.05516750111766501, "step_physics": 0.2257797648567244, "survival_time": 59.99999999999873, "driven_lanedir": 3.440102611238178, "get_state_dump": 0.008270841355526278, "get_robot_state": 0.012634758746792731, "sim_render-ego0": 0.003306445829278722, "sim_render-ego1": 0.003301342162958887, "sim_render-ego2": 0.003284446008000942, "sim_render-ego3": 0.0033407798913198147, "get_duckie_state": 1.4317025749212896e-06, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 7.603264034774759, "agent_compute-ego0": 0.03503425770457043, "agent_compute-ego1": 0.032423103778785115, "agent_compute-ego2": 0.033859949326336534, "agent_compute-ego3": 0.03554208530772238, "complete-iteration": 0.4989972334916546, "set_robot_commands": 0.002036657063391286, "distance-from-start": 2.8671986877453888, "deviation-center-line": 5.4260979168750865, "driven_lanedir_consec": 3.440102611238178, "sim_compute_sim_state": 0.032128317965555944, "sim_compute_performance-ego0": 0.0017877022094472462, "sim_compute_performance-ego1": 0.001657634650936333, "sim_compute_performance-ego2": 0.0016521998587297857, "sim_compute_performance-ego3": 0.0016960893245064944}, "LFVI_multi-full-udem1-000-ego2": {"driven_any": 2.9165974036902553, "get_ui_image": 0.05516750111766501, "step_physics": 0.2257797648567244, "survival_time": 59.99999999999873, "driven_lanedir": 2.876074895972133, "get_state_dump": 0.008270841355526278, "get_robot_state": 0.012634758746792731, "sim_render-ego0": 0.003306445829278722, "sim_render-ego1": 0.003301342162958887, "sim_render-ego2": 0.003284446008000942, "sim_render-ego3": 0.0033407798913198147, "get_duckie_state": 1.4317025749212896e-06, "in-drivable-lane": 0.4999999999999716, "deviation-heading": 3.2055863537729596, "agent_compute-ego0": 0.03503425770457043, "agent_compute-ego1": 0.032423103778785115, "agent_compute-ego2": 0.033859949326336534, "agent_compute-ego3": 0.03554208530772238, "complete-iteration": 0.4989972334916546, "set_robot_commands": 0.002036657063391286, "distance-from-start": 2.3531637113688504, "deviation-center-line": 4.562164342090965, "driven_lanedir_consec": 2.8760744883296985, "sim_compute_sim_state": 0.032128317965555944, "sim_compute_performance-ego0": 0.0017877022094472462, "sim_compute_performance-ego1": 0.001657634650936333, "sim_compute_performance-ego2": 0.0016521998587297857, "sim_compute_performance-ego3": 0.0016960893245064944}, "LFVI_multi-full-udem1-000-ego3": {"driven_any": 3.5795940302762306, "get_ui_image": 0.05516750111766501, "step_physics": 0.2257797648567244, "survival_time": 59.99999999999873, "driven_lanedir": 3.5313612130937737, "get_state_dump": 0.008270841355526278, "get_robot_state": 0.012634758746792731, "sim_render-ego0": 0.003306445829278722, "sim_render-ego1": 0.003301342162958887, "sim_render-ego2": 0.003284446008000942, "sim_render-ego3": 0.0033407798913198147, "get_duckie_state": 1.4317025749212896e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.393571764824884, "agent_compute-ego0": 0.03503425770457043, "agent_compute-ego1": 0.032423103778785115, "agent_compute-ego2": 0.033859949326336534, "agent_compute-ego3": 0.03554208530772238, "complete-iteration": 0.4989972334916546, "set_robot_commands": 0.002036657063391286, "distance-from-start": 3.038741726285562, "deviation-center-line": 4.365228799585463, "driven_lanedir_consec": 3.5313612130937737, "sim_compute_sim_state": 0.032128317965555944, "sim_compute_performance-ego0": 0.0017877022094472462, "sim_compute_performance-ego1": 0.001657634650936333, "sim_compute_performance-ego2": 0.0016521998587297857, "sim_compute_performance-ego3": 0.0016960893245064944}}
set_robot_commands_max0.002036657063391286
set_robot_commands_mean0.002036657063391286
set_robot_commands_median0.002036657063391286
set_robot_commands_min0.002036657063391286
sim_compute_performance-ego0_max0.0017877022094472462
sim_compute_performance-ego0_mean0.0017877022094472462
sim_compute_performance-ego0_median0.0017877022094472462
sim_compute_performance-ego0_min0.0017877022094472462
sim_compute_performance-ego1_max0.001657634650936333
sim_compute_performance-ego1_mean0.001657634650936333
sim_compute_performance-ego1_median0.001657634650936333
sim_compute_performance-ego1_min0.001657634650936333
sim_compute_performance-ego2_max0.0016521998587297857
sim_compute_performance-ego2_mean0.0016521998587297857
sim_compute_performance-ego2_median0.0016521998587297857
sim_compute_performance-ego2_min0.0016521998587297857
sim_compute_performance-ego3_max0.0016960893245064944
sim_compute_performance-ego3_mean0.0016960893245064944
sim_compute_performance-ego3_median0.0016960893245064944
sim_compute_performance-ego3_min0.0016960893245064944
sim_compute_sim_state_max0.032128317965555944
sim_compute_sim_state_mean0.032128317965555944
sim_compute_sim_state_median0.032128317965555944
sim_compute_sim_state_min0.032128317965555944
sim_render-ego0_max0.003306445829278722
sim_render-ego0_mean0.003306445829278722
sim_render-ego0_median0.003306445829278722
sim_render-ego0_min0.003306445829278722
sim_render-ego1_max0.003301342162958887
sim_render-ego1_mean0.003301342162958887
sim_render-ego1_median0.003301342162958887
sim_render-ego1_min0.003301342162958887
sim_render-ego2_max0.003284446008000942
sim_render-ego2_mean0.003284446008000942
sim_render-ego2_median0.003284446008000942
sim_render-ego2_min0.003284446008000942
sim_render-ego3_max0.0033407798913198147
sim_render-ego3_mean0.0033407798913198147
sim_render-ego3_median0.0033407798913198147
sim_render-ego3_min0.0033407798913198147
simulation-passed1
step_physics_max0.2257797648567244
step_physics_mean0.2257797648567244
step_physics_median0.2257797648567244
step_physics_min0.2257797648567244
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
76512sim-2of4successyes0:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76511sim-3of4successyes0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76510sim-2of4successyes0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76509sim-3of4successyes0:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76508sim-2of4successyes0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76507sim-0of4successyes0:22:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76506sim-3of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
76505sim-1of4successyes0:25:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible