AI Driving Olympics Home Challenges Submissions Jobs

Submission 3321

Submission3321
Competingyes
Challengeaido2-LF-sim-validation
Userjp18813100494
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22415
Next
User labelThird test - TH
Admin priority50
Blessing50
User priority

22415

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
224153321jp18813100494Third test - THaido2-LF-sim-validationstep1-simulationsuccessyes-0:16:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9549096814971124
survival_time_median14.950000000000076
deviation-center-line_median0.9357839616453356
in-drivable-lane_median0.849999999999997


other stats
agent_compute-ego_max0.18074224154154456
agent_compute-ego_mean0.17371583696440154
agent_compute-ego_median0.172976446946462
agent_compute-ego_min0.1688112511354334
deviation-center-line_max2.334655865862999
deviation-center-line_mean0.9879715075158756
deviation-center-line_min0.1999349376906932
deviation-heading_max12.904965982970015
deviation-heading_mean5.1200907887469835
deviation-heading_median3.596230592332538
deviation-heading_min2.174753382622343
driven_any_max2.748207692459921
driven_any_mean1.2052548943363444
driven_any_median1.0879291838247798
driven_any_min1.9152295794596823e-12
driven_lanedir_consec_max1.387048580759752
driven_lanedir_consec_mean0.6854081866510972
driven_lanedir_consec_min-5.89932152017525e-08
driven_lanedir_max1.387048580759752
driven_lanedir_mean0.720569905609605
driven_lanedir_median1.0850827295486316
driven_lanedir_min-5.89932152017525e-08
in-drivable-lane_max9.100000000000067
in-drivable-lane_mean3.3900000000000197
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.748207692459921, "sim_physics": 0.05899174769719442, "survival_time": 14.950000000000076, "driven_lanedir": 1.387048580759752, "sim_render-ego": 0.06287358442942302, "in-drivable-lane": 7.0000000000000355, "agent_compute-ego": 0.1760239553451538, "deviation-heading": 2.174753382622343, "set_robot_commands": 0.07759058157602947, "deviation-center-line": 1.0108148594987827, "driven_lanedir_consec": 1.387048580759752, "sim_compute_sim_state": 0.04043722152709961, "sim_compute_performance-ego": 0.06457882006963094, "sim_compute_robot_state-ego": 0.06379093408584595}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.112865745022347, "sim_physics": 0.059270910422007245, "survival_time": 14.950000000000076, "driven_lanedir": 1.1307182762896515, "sim_render-ego": 0.061204959551493326, "in-drivable-lane": 9.100000000000067, "agent_compute-ego": 0.1700252898534139, "deviation-heading": 3.596230592332538, "set_robot_commands": 0.07612169663111369, "deviation-center-line": 0.45866791288156766, "driven_lanedir_consec": 0.9549096814971124, "sim_compute_sim_state": 0.04020744721094767, "sim_compute_performance-ego": 0.06616552273432413, "sim_compute_robot_state-ego": 0.06436314105987549}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.07727185037275815, "sim_physics": 0.058198738098144534, "survival_time": 4.249999999999993, "driven_lanedir": -5.89932152017525e-08, "sim_render-ego": 0.05917840564952177, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1688112511354334, "deviation-heading": 2.8226336951116706, "set_robot_commands": 0.07861074279336368, "deviation-center-line": 0.1999349376906932, "driven_lanedir_consec": -5.89932152017525e-08, "sim_compute_sim_state": 0.04163806298199822, "sim_compute_performance-ego": 0.06447155615862678, "sim_compute_robot_state-ego": 0.0631738915162928}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9152295794596823e-12, "sim_physics": 0.0607490611076355, "survival_time": 14.950000000000076, "driven_lanedir": 4.4320458414404124e-10, "sim_render-ego": 0.06280940612157186, "in-drivable-lane": 0, "agent_compute-ego": 0.18074224154154456, "deviation-heading": 12.904965982970015, "set_robot_commands": 0.07841910759607951, "deviation-center-line": 0.9357839616453356, "driven_lanedir_consec": 4.4320458414404124e-10, "sim_compute_sim_state": 0.04019814411799113, "sim_compute_performance-ego": 0.06492121616999308, "sim_compute_robot_state-ego": 0.06385136047999064}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0879291838247798, "sim_physics": 0.05951239347457886, "survival_time": 14.950000000000076, "driven_lanedir": 1.0850827295486316, "sim_render-ego": 0.06288059234619141, "in-drivable-lane": 0, "agent_compute-ego": 0.172976446946462, "deviation-heading": 4.101870290698347, "set_robot_commands": 0.07712016503016154, "deviation-center-line": 2.334655865862999, "driven_lanedir_consec": 1.0850827295486316, "sim_compute_sim_state": 0.0409175173441569, "sim_compute_performance-ego": 0.06604103088378906, "sim_compute_robot_state-ego": 0.06484139760335286}}
set_robot_commands_max0.07861074279336368
set_robot_commands_mean0.07757245872534958
set_robot_commands_median0.07759058157602947
set_robot_commands_min0.07612169663111369
sim_compute_performance-ego_max0.06616552273432413
sim_compute_performance-ego_mean0.06523562920327279
sim_compute_performance-ego_median0.06492121616999308
sim_compute_performance-ego_min0.06447155615862678
sim_compute_robot_state-ego_max0.06484139760335286
sim_compute_robot_state-ego_mean0.06400414494907154
sim_compute_robot_state-ego_median0.06385136047999064
sim_compute_robot_state-ego_min0.0631738915162928
sim_compute_sim_state_max0.04163806298199822
sim_compute_sim_state_mean0.04067967863643871
sim_compute_sim_state_median0.04043722152709961
sim_compute_sim_state_min0.04019814411799113
sim_physics_max0.0607490611076355
sim_physics_mean0.05934457015991211
sim_physics_median0.059270910422007245
sim_physics_min0.058198738098144534
sim_render-ego_max0.06288059234619141
sim_render-ego_mean0.06178938961964028
sim_render-ego_median0.06280940612157186
sim_render-ego_min0.05917840564952177
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.81000000000006
survival_time_min4.249999999999993
218563321jp18813100494Third test - THaido2-LF-sim-validationstep1-simulationsuccessno-0:14:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0127786305511397
survival_time_median14.950000000000076
deviation-center-line_median0.9357839616453356
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10055964867273968
agent_compute-ego_mean0.0999662815729777
agent_compute-ego_median0.10029001315434774
agent_compute-ego_min0.09828621784845988
deviation-center-line_max2.334665900678586
deviation-center-line_mean1.118209065532312
deviation-center-line_min0.5045474979650298
deviation-heading_max12.913163049073791
deviation-heading_mean7.441248201979498
deviation-heading_median4.567135975858354
deviation-heading_min3.9539262467021183
driven_any_max2.577881299511474
driven_any_mean1.1586283556514594
driven_any_median1.0879291850030055
driven_any_min1.9162650682564156e-12
driven_lanedir_consec_max1.702598862503674
driven_lanedir_consec_mean0.7600864075516727
driven_lanedir_consec_min4.4320458414404124e-10
driven_lanedir_max1.702598862503674
driven_lanedir_mean0.8048700825987476
driven_lanedir_median1.085054543746666
driven_lanedir_min4.4320458414404124e-10
in-drivable-lane_max8.300000000000052
in-drivable-lane_mean2.6700000000000124
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.577881299511474, "sim_physics": 0.061494423548380535, "survival_time": 14.950000000000076, "driven_lanedir": 1.702598862503674, "sim_render-ego": 0.03699854214986165, "in-drivable-lane": 5.0500000000000105, "agent_compute-ego": 0.10029001315434774, "deviation-heading": 4.567135975858354, "set_robot_commands": 0.055824981530507405, "deviation-center-line": 0.9369229153819782, "driven_lanedir_consec": 1.702598862503674, "sim_compute_sim_state": 0.023427664438883465, "sim_compute_performance-ego": 0.03916760444641113, "sim_compute_robot_state-ego": 0.04170756101608277}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.127331293735395, "sim_physics": 0.05876453002293905, "survival_time": 14.950000000000076, "driven_lanedir": 1.2366970057865143, "sim_render-ego": 0.03619227091471354, "in-drivable-lane": 8.300000000000052, "agent_compute-ego": 0.10055964867273968, "deviation-heading": 3.9539262467021183, "set_robot_commands": 0.05535950740178426, "deviation-center-line": 0.5045474979650298, "driven_lanedir_consec": 1.0127786305511397, "sim_compute_sim_state": 0.02348709185918172, "sim_compute_performance-ego": 0.03964510281880697, "sim_compute_robot_state-ego": 0.041581602891286214}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.505248997361529e-12, "sim_physics": 0.052748184204101566, "survival_time": 14.950000000000076, "driven_lanedir": 5.13679321301197e-10, "sim_render-ego": 0.03487366040547689, "in-drivable-lane": 0, "agent_compute-ego": 0.09828621784845988, "deviation-heading": 11.646421158159336, "set_robot_commands": 0.05629777669906616, "deviation-center-line": 0.8791250519906306, "driven_lanedir_consec": 5.13679321301197e-10, "sim_compute_sim_state": 0.023452895482381185, "sim_compute_performance-ego": 0.03976903200149536, "sim_compute_robot_state-ego": 0.04096479733784993}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9162650682564156e-12, "sim_physics": 0.05817382176717122, "survival_time": 14.950000000000076, "driven_lanedir": 4.4320458414404124e-10, "sim_render-ego": 0.03657490809758504, "in-drivable-lane": 0, "agent_compute-ego": 0.10049254814783733, "deviation-heading": 12.913163049073791, "set_robot_commands": 0.05628652572631836, "deviation-center-line": 0.9357839616453356, "driven_lanedir_consec": 4.4320458414404124e-10, "sim_compute_sim_state": 0.023544747034708657, "sim_compute_performance-ego": 0.039920199712117514, "sim_compute_robot_state-ego": 0.04126426219940185}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0879291850030055, "sim_physics": 0.05736349662144979, "survival_time": 14.950000000000076, "driven_lanedir": 1.085054543746666, "sim_render-ego": 0.03583551406860352, "in-drivable-lane": 0, "agent_compute-ego": 0.10020298004150392, "deviation-heading": 4.125594580103889, "set_robot_commands": 0.05623649835586548, "deviation-center-line": 2.334665900678586, "driven_lanedir_consec": 1.085054543746666, "sim_compute_sim_state": 0.023514457543691, "sim_compute_performance-ego": 0.039817949930826824, "sim_compute_robot_state-ego": 0.04116599162419637}}
set_robot_commands_max0.05629777669906616
set_robot_commands_mean0.056001057942708335
set_robot_commands_median0.05623649835586548
set_robot_commands_min0.05535950740178426
sim_compute_performance-ego_max0.039920199712117514
sim_compute_performance-ego_mean0.03966397778193157
sim_compute_performance-ego_median0.03976903200149536
sim_compute_performance-ego_min0.03916760444641113
sim_compute_robot_state-ego_max0.04170756101608277
sim_compute_robot_state-ego_mean0.04133684301376343
sim_compute_robot_state-ego_median0.04126426219940185
sim_compute_robot_state-ego_min0.04096479733784993
sim_compute_sim_state_max0.023544747034708657
sim_compute_sim_state_mean0.02348537127176921
sim_compute_sim_state_median0.02348709185918172
sim_compute_sim_state_min0.023427664438883465
sim_physics_max0.061494423548380535
sim_physics_mean0.05770889123280844
sim_physics_median0.05817382176717122
sim_physics_min0.052748184204101566
sim_render-ego_max0.03699854214986165
sim_render-ego_mean0.03609497912724813
sim_render-ego_median0.03619227091471354
sim_render-ego_min0.03487366040547689
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
218553321jp18813100494Third test - THaido2-LF-sim-validationstep1-simulationhost-errorno-0:08:54
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3321/step1-simulation-ip-172-31-38-104-5376-job21855/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.