AI Driving Olympics Home Challenges Submissions Jobs

Submission 3315

Submission3315
Competingyes
Challengeaido2-LFV-sim-validation
Userjp18813100494
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22423
Next
User labelRL - TH -hhk
Admin priority50
Blessing50
User priority

22423

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
224233315jp18813100494RL - TH -hhkaido2-LFV-sim-validationstep1-simulationsuccessyes-0:36:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5517440458980518
survival_time_median14.200000000000069
deviation-center-line_median0.7272239486453499
in-drivable-lane_median5.750000000000046


other stats
agent_compute-ego_max0.2130505734798955
agent_compute-ego_mean0.20282127191560032
agent_compute-ego_median0.20635603745778405
agent_compute-ego_min0.18375860049691
deviation-center-line_max0.9279072479689552
deviation-center-line_mean0.6589507941348265
deviation-center-line_min0.31622589498973774
deviation-heading_max3.5700258663607576
deviation-heading_mean2.418449430899825
deviation-heading_median2.267214123131697
deviation-heading_min1.2784341577931226
driven_any_max3.328877265093844
driven_any_mean2.759198264229227
driven_any_median2.724544350470416
driven_any_min2.0766251404617697
driven_lanedir_consec_max2.0831169577925572
driven_lanedir_consec_mean1.7128994984836787
driven_lanedir_consec_min1.440631971837869
driven_lanedir_max2.0831169577925572
driven_lanedir_mean1.7128994984836787
driven_lanedir_median1.5517440458980518
driven_lanedir_min1.440631971837869
in-drivable-lane_max8.950000000000092
in-drivable-lane_mean5.390000000000032
in-drivable-lane_min0.7499999999999973
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.6926861899110346, "sim_physics": 0.2033137329419454, "survival_time": 14.950000000000076, "driven_lanedir": 1.5517440458980518, "sim_render-ego": 0.06917388200759887, "in-drivable-lane": 5.750000000000046, "agent_compute-ego": 0.19902162631352743, "deviation-heading": 3.4726568066413894, "set_robot_commands": 0.10540439367294312, "deviation-center-line": 0.9279072479689552, "driven_lanedir_consec": 1.5517440458980518, "sim_compute_sim_state": 0.04283759991327921, "sim_compute_performance-ego": 0.07818885326385498, "sim_compute_robot_state-ego": 0.08327256043752035, "sim_compute_robot_state-npc0": 0.07620591163635254, "sim_compute_robot_state-npc1": 0.07596495151519775, "sim_compute_robot_state-npc2": 0.07498029867808025, "sim_compute_robot_state-npc3": 0.07610459963480631}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.973258375209071, "sim_physics": 0.1875648070389116, "survival_time": 14.200000000000069, "driven_lanedir": 1.948011841574245, "sim_render-ego": 0.06308083383130356, "in-drivable-lane": 5.850000000000038, "agent_compute-ego": 0.18375860049691, "deviation-heading": 3.5700258663607576, "set_robot_commands": 0.09931425141616608, "deviation-center-line": 0.8848890986540239, "driven_lanedir_consec": 1.948011841574245, "sim_compute_sim_state": 0.04078804523172513, "sim_compute_performance-ego": 0.07057923498288007, "sim_compute_robot_state-ego": 0.07727744713635512, "sim_compute_robot_state-npc0": 0.07271789581003324, "sim_compute_robot_state-npc1": 0.07098793899509269, "sim_compute_robot_state-npc2": 0.07135663485862839, "sim_compute_robot_state-npc3": 0.07126523071611432}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.724544350470416, "sim_physics": 0.20781414765937656, "survival_time": 10.20000000000001, "driven_lanedir": 2.0831169577925572, "sim_render-ego": 0.07141176392050351, "in-drivable-lane": 5.64999999999999, "agent_compute-ego": 0.2130505734798955, "deviation-heading": 1.2784341577931226, "set_robot_commands": 0.114981868687798, "deviation-center-line": 0.31622589498973774, "driven_lanedir_consec": 2.0831169577925572, "sim_compute_sim_state": 0.04622797755634084, "sim_compute_performance-ego": 0.0805942462939842, "sim_compute_robot_state-ego": 0.08838611490586225, "sim_compute_robot_state-npc0": 0.07997561085457895, "sim_compute_robot_state-npc1": 0.08043069348615758, "sim_compute_robot_state-npc2": 0.08020630420423021, "sim_compute_robot_state-npc3": 0.07935584292692296}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.328877265093844, "sim_physics": 0.20390507062276209, "survival_time": 14.950000000000076, "driven_lanedir": 1.440631971837869, "sim_render-ego": 0.06979416211446127, "in-drivable-lane": 8.950000000000092, "agent_compute-ego": 0.20635603745778405, "deviation-heading": 1.5039162005721562, "set_robot_commands": 0.1116332960128784, "deviation-center-line": 0.7272239486453499, "driven_lanedir_consec": 1.440631971837869, "sim_compute_sim_state": 0.04567816813786824, "sim_compute_performance-ego": 0.0799093516667684, "sim_compute_robot_state-ego": 0.08768229881922404, "sim_compute_robot_state-npc0": 0.0797870930035909, "sim_compute_robot_state-npc1": 0.08011466900507609, "sim_compute_robot_state-npc2": 0.07988088369369507, "sim_compute_robot_state-npc3": 0.07952544291814169}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0766251404617697, "sim_physics": 0.2007360883579133, "survival_time": 7.84999999999998, "driven_lanedir": 1.5409926753156715, "sim_render-ego": 0.07230483498542932, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.21191952182988452, "deviation-heading": 2.267214123131697, "set_robot_commands": 0.1125273051535248, "deviation-center-line": 0.43850778041606575, "driven_lanedir_consec": 1.5409926753156715, "sim_compute_sim_state": 0.045921090302194, "sim_compute_performance-ego": 0.07937100586617828, "sim_compute_robot_state-ego": 0.08857788249945185, "sim_compute_robot_state-npc0": 0.07907046482061884, "sim_compute_robot_state-npc1": 0.07797935358278311, "sim_compute_robot_state-npc2": 0.07934770310760304, "sim_compute_robot_state-npc3": 0.07918583815264854}}
set_robot_commands_max0.114981868687798
set_robot_commands_mean0.1087722229886621
set_robot_commands_median0.1116332960128784
set_robot_commands_min0.09931425141616608
sim_compute_performance-ego_max0.0805942462939842
sim_compute_performance-ego_mean0.07772853841473318
sim_compute_performance-ego_median0.07937100586617828
sim_compute_performance-ego_min0.07057923498288007
sim_compute_robot_state-ego_max0.08857788249945185
sim_compute_robot_state-ego_mean0.08503926075968274
sim_compute_robot_state-ego_median0.08768229881922404
sim_compute_robot_state-ego_min0.07727744713635512
sim_compute_robot_state-npc0_max0.07997561085457895
sim_compute_robot_state-npc0_mean0.07755139522503489
sim_compute_robot_state-npc0_median0.07907046482061884
sim_compute_robot_state-npc0_min0.07271789581003324
sim_compute_robot_state-npc1_max0.08043069348615758
sim_compute_robot_state-npc1_mean0.07709552131686145
sim_compute_robot_state-npc1_median0.07797935358278311
sim_compute_robot_state-npc1_min0.07098793899509269
sim_compute_robot_state-npc2_max0.08020630420423021
sim_compute_robot_state-npc2_mean0.07715436490844738
sim_compute_robot_state-npc2_median0.07934770310760304
sim_compute_robot_state-npc2_min0.07135663485862839
sim_compute_robot_state-npc3_max0.07952544291814169
sim_compute_robot_state-npc3_mean0.07708739086972675
sim_compute_robot_state-npc3_median0.07918583815264854
sim_compute_robot_state-npc3_min0.07126523071611432
sim_compute_sim_state_max0.04622797755634084
sim_compute_sim_state_mean0.04429057622828148
sim_compute_sim_state_median0.04567816813786824
sim_compute_sim_state_min0.04078804523172513
sim_physics_max0.20781414765937656
sim_physics_mean0.2006667693241818
sim_physics_median0.2033137329419454
sim_physics_min0.1875648070389116
sim_render-ego_max0.07230483498542932
sim_render-ego_mean0.0691530953718593
sim_render-ego_median0.06979416211446127
sim_render-ego_min0.06308083383130356
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.43000000000004
survival_time_min7.84999999999998
218483315jp18813100494RL - TH -hhkaido2-LFV-sim-validationstep1-simulationsuccessno-0:15:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2538414623461482
survival_time_median14.950000000000076
deviation-center-line_median0.27954515900842103
in-drivable-lane_median3.650000000000052


other stats
agent_compute-ego_max0.10378916873488316
agent_compute-ego_mean0.10164615761576735
agent_compute-ego_median0.10127334398766089
agent_compute-ego_min0.10062241315841676
deviation-center-line_max0.880408678227055
deviation-center-line_mean0.4008310164380379
deviation-center-line_min0.04588492545812347
deviation-heading_max3.965863447138271
deviation-heading_mean1.5371052082645311
deviation-heading_median0.973819688666778
deviation-heading_min0.3131407185843258
driven_any_max3.06928230803212
driven_any_mean1.867754632823131
driven_any_median1.590389614926163
driven_any_min1.0181573162464244
driven_lanedir_consec_max2.448497564861985
driven_lanedir_consec_mean1.5877856956907153
driven_lanedir_consec_min0.67239844483524
driven_lanedir_max2.448497564861985
driven_lanedir_mean1.5877856956907153
driven_lanedir_median1.2538414623461482
driven_lanedir_min0.67239844483524
in-drivable-lane_max11.000000000000083
in-drivable-lane_mean4.29000000000003
in-drivable-lane_min0.549999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0181573162464244, "sim_physics": 0.09008214085601098, "survival_time": 2.1500000000000004, "driven_lanedir": 0.67239844483524, "sim_render-ego": 0.03766231758649959, "in-drivable-lane": 0.5999999999999996, "agent_compute-ego": 0.10378916873488316, "deviation-heading": 0.3131407185843258, "set_robot_commands": 0.05476692665454953, "deviation-center-line": 0.08766781204208815, "driven_lanedir_consec": 0.67239844483524, "sim_compute_sim_state": 0.02281788892524187, "sim_compute_performance-ego": 0.03930890282919241, "sim_compute_robot_state-ego": 0.04228693939918696, "sim_compute_robot_state-npc0": 0.04169733579768691, "sim_compute_robot_state-npc1": 0.039975937022719274, "sim_compute_robot_state-npc2": 0.04059940715168798, "sim_compute_robot_state-npc3": 0.040065610131552055}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.354957571562967, "sim_physics": 0.09001100619633992, "survival_time": 14.950000000000076, "driven_lanedir": 2.3405417101823236, "sim_render-ego": 0.03650694767634074, "in-drivable-lane": 3.650000000000052, "agent_compute-ego": 0.10104924996693929, "deviation-heading": 3.965863447138271, "set_robot_commands": 0.056219635804494225, "deviation-center-line": 0.710648507454502, "driven_lanedir_consec": 2.3405417101823236, "sim_compute_sim_state": 0.023187727928161626, "sim_compute_performance-ego": 0.03987587531407674, "sim_compute_robot_state-ego": 0.042031502723693846, "sim_compute_robot_state-npc0": 0.04182349999745687, "sim_compute_robot_state-npc1": 0.040622496604919435, "sim_compute_robot_state-npc2": 0.04060363213221232, "sim_compute_robot_state-npc3": 0.040614030361175536}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.06928230803212, "sim_physics": 0.09435378313064575, "survival_time": 14.950000000000076, "driven_lanedir": 2.448497564861985, "sim_render-ego": 0.036825546423594153, "in-drivable-lane": 5.65000000000002, "agent_compute-ego": 0.10149661223093669, "deviation-heading": 2.0224328807220036, "set_robot_commands": 0.05506343205769857, "deviation-center-line": 0.880408678227055, "driven_lanedir_consec": 2.448497564861985, "sim_compute_sim_state": 0.02295187791188558, "sim_compute_performance-ego": 0.04058294375737508, "sim_compute_robot_state-ego": 0.0416293199857076, "sim_compute_robot_state-npc0": 0.04140212774276733, "sim_compute_robot_state-npc1": 0.04011568387349446, "sim_compute_robot_state-npc2": 0.04024712721506755, "sim_compute_robot_state-npc3": 0.04008457183837891}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.30598635334798, "sim_physics": 0.08775739510854086, "survival_time": 14.950000000000076, "driven_lanedir": 1.2236492962278795, "sim_render-ego": 0.03606517235438029, "in-drivable-lane": 11.000000000000083, "agent_compute-ego": 0.10062241315841676, "deviation-heading": 0.973819688666778, "set_robot_commands": 0.05634642442067464, "deviation-center-line": 0.27954515900842103, "driven_lanedir_consec": 1.2236492962278795, "sim_compute_sim_state": 0.022966350714365643, "sim_compute_performance-ego": 0.03942085822423299, "sim_compute_robot_state-ego": 0.04191094398498535, "sim_compute_robot_state-npc0": 0.04116448640823364, "sim_compute_robot_state-npc1": 0.04023699363072713, "sim_compute_robot_state-npc2": 0.04004765669504801, "sim_compute_robot_state-npc3": 0.04028974612553914}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.590389614926163, "sim_physics": 0.08976609086337155, "survival_time": 3.649999999999995, "driven_lanedir": 1.2538414623461482, "sim_render-ego": 0.03719162940979004, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.10127334398766089, "deviation-heading": 0.4102693062112778, "set_robot_commands": 0.05546137078167641, "deviation-center-line": 0.04588492545812347, "driven_lanedir_consec": 1.2538414623461482, "sim_compute_sim_state": 0.022992418236928443, "sim_compute_performance-ego": 0.039600627063071894, "sim_compute_robot_state-ego": 0.041581862593350345, "sim_compute_robot_state-npc0": 0.044707353800943456, "sim_compute_robot_state-npc1": 0.040180826840335374, "sim_compute_robot_state-npc2": 0.03970070081214382, "sim_compute_robot_state-npc3": 0.04037616024278615}}
set_robot_commands_max0.05634642442067464
set_robot_commands_mean0.05557155794381867
set_robot_commands_median0.05546137078167641
set_robot_commands_min0.05476692665454953
sim_compute_performance-ego_max0.04058294375737508
sim_compute_performance-ego_mean0.03975784143758983
sim_compute_performance-ego_median0.039600627063071894
sim_compute_performance-ego_min0.03930890282919241
sim_compute_robot_state-ego_max0.04228693939918696
sim_compute_robot_state-ego_mean0.04188811373738482
sim_compute_robot_state-ego_median0.04191094398498535
sim_compute_robot_state-ego_min0.041581862593350345
sim_compute_robot_state-npc0_max0.044707353800943456
sim_compute_robot_state-npc0_mean0.04215896074941764
sim_compute_robot_state-npc0_median0.04169733579768691
sim_compute_robot_state-npc0_min0.04116448640823364
sim_compute_robot_state-npc1_max0.040622496604919435
sim_compute_robot_state-npc1_mean0.04022638759443914
sim_compute_robot_state-npc1_median0.040180826840335374
sim_compute_robot_state-npc1_min0.039975937022719274
sim_compute_robot_state-npc2_max0.04060363213221232
sim_compute_robot_state-npc2_mean0.040239704801231936
sim_compute_robot_state-npc2_median0.04024712721506755
sim_compute_robot_state-npc2_min0.03970070081214382
sim_compute_robot_state-npc3_max0.040614030361175536
sim_compute_robot_state-npc3_mean0.04028602373988636
sim_compute_robot_state-npc3_median0.04028974612553914
sim_compute_robot_state-npc3_min0.040065610131552055
sim_compute_sim_state_max0.023187727928161626
sim_compute_sim_state_mean0.022983252743316633
sim_compute_sim_state_median0.022966350714365643
sim_compute_sim_state_min0.02281788892524187
sim_physics_max0.09435378313064575
sim_physics_mean0.09039408323098182
sim_physics_median0.09001100619633992
sim_physics_min0.08775739510854086
sim_render-ego_max0.03766231758649959
sim_render-ego_mean0.036850322690120965
sim_render-ego_median0.036825546423594153
sim_render-ego_min0.03606517235438029
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.130000000000043
survival_time_min2.1500000000000004
218473315jp18813100494RL - TH -hhkaido2-LFV-sim-validationstep1-simulationhost-errorno-0:05:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission3315/step1-simulation-ip-172-31-25-98-2470-job21847/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.