AI Driving Olympics Home Challenges Submissions Jobs

Submission 3412

Submission3412
Competingyes
Challengeaido2-LFV-sim-validation
Userjp18813100494
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22325
Next
User labelRL-TH-shi
Admin priority50
Blessing50
User priority

22325

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223253412jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes-0:22:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0894705765189667
survival_time_median14.950000000000076
deviation-center-line_median0.7808489625201965
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2389633117652521
agent_compute-ego_mean0.20972906205130787
agent_compute-ego_median0.20016915639241536
agent_compute-ego_min0.1904742455482483
deviation-center-line_max1.080811140050729
deviation-center-line_mean0.6139556479593946
deviation-center-line_min0.12209242724108248
deviation-heading_max5.508535733391926
deviation-heading_mean2.6409089801477457
deviation-heading_median2.1983868834446385
deviation-heading_min0.6033898842908664
driven_any_max3.592375600042936
driven_any_mean2.3521698010301337
driven_any_median2.589184285321486
driven_any_min0.5232782289857002
driven_lanedir_consec_max3.5429274216986983
driven_lanedir_consec_mean2.191468669692593
driven_lanedir_consec_min0.4930898587697343
driven_lanedir_max3.5429274216986983
driven_lanedir_mean2.2589554727064196
driven_lanedir_median2.4269045915881
driven_lanedir_min0.4930898587697343
in-drivable-lane_max1.9500000000000275
in-drivable-lane_mean0.420000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5232782289857002, "sim_physics": 0.1057573139667511, "survival_time": 2.000000000000001, "driven_lanedir": 0.4930898587697343, "sim_render-ego": 0.055715179443359374, "in-drivable-lane": 0, "agent_compute-ego": 0.19146645665168763, "deviation-heading": 0.6033898842908664, "set_robot_commands": 0.07260074019432068, "deviation-center-line": 0.12209242724108248, "driven_lanedir_consec": 0.4930898587697343, "sim_compute_sim_state": 0.03343672156333923, "sim_compute_performance-ego": 0.05760161280632019, "sim_compute_robot_state-ego": 0.05914224982261658, "sim_compute_robot_state-npc0": 0.06373208165168762, "sim_compute_robot_state-npc1": 0.06136396527290344, "sim_compute_robot_state-npc2": 0.062213361263275146, "sim_compute_robot_state-npc3": 0.061494636535644534}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.592375600042936, "sim_physics": 0.10195271650950112, "survival_time": 14.950000000000076, "driven_lanedir": 3.5429274216986983, "sim_render-ego": 0.05473088264465332, "in-drivable-lane": 0, "agent_compute-ego": 0.1904742455482483, "deviation-heading": 2.1983868834446385, "set_robot_commands": 0.07498637755711873, "deviation-center-line": 0.7808489625201965, "driven_lanedir_consec": 3.5429274216986983, "sim_compute_sim_state": 0.03333227634429932, "sim_compute_performance-ego": 0.05933251857757568, "sim_compute_robot_state-ego": 0.05841846466064453, "sim_compute_robot_state-npc0": 0.06469401518503824, "sim_compute_robot_state-npc1": 0.06068751096725464, "sim_compute_robot_state-npc2": 0.059006129105885825, "sim_compute_robot_state-npc3": 0.05916419665018718}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.150276698824858, "sim_physics": 0.09994192441304524, "survival_time": 14.950000000000076, "driven_lanedir": 3.0719759070534836, "sim_render-ego": 0.05483065207799276, "in-drivable-lane": 0, "agent_compute-ego": 0.20016915639241536, "deviation-heading": 3.0928361580042747, "set_robot_commands": 0.07416905959447224, "deviation-center-line": 0.8159237810073902, "driven_lanedir_consec": 3.0719759070534836, "sim_compute_sim_state": 0.03312629143397013, "sim_compute_performance-ego": 0.058005059560139974, "sim_compute_robot_state-ego": 0.05813943386077881, "sim_compute_robot_state-npc0": 0.06353615204493204, "sim_compute_robot_state-npc1": 0.061459511915842695, "sim_compute_robot_state-npc2": 0.05905007441838583, "sim_compute_robot_state-npc3": 0.058705010414123536}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.589184285321486, "sim_physics": 0.09891724983851116, "survival_time": 14.950000000000076, "driven_lanedir": 2.4269045915881, "sim_render-ego": 0.0598866081237793, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.22757213989893596, "deviation-heading": 5.508535733391926, "set_robot_commands": 0.07676365931828817, "deviation-center-line": 1.080811140050729, "driven_lanedir_consec": 2.0894705765189667, "sim_compute_sim_state": 0.03558298428853353, "sim_compute_performance-ego": 0.0626944891611735, "sim_compute_robot_state-ego": 0.06145346323649088, "sim_compute_robot_state-npc0": 0.0692631983757019, "sim_compute_robot_state-npc1": 0.06331435521443685, "sim_compute_robot_state-npc2": 0.06295977751413981, "sim_compute_robot_state-npc3": 0.06219621499379476}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9057341919756896, "sim_physics": 0.09707124204170411, "survival_time": 8.199999999999982, "driven_lanedir": 1.7598795844220825, "sim_render-ego": 0.05811449085793844, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.2389633117652521, "deviation-heading": 1.801396241607022, "set_robot_commands": 0.07683733032970894, "deviation-center-line": 0.27010192897757457, "driven_lanedir_consec": 1.7598795844220825, "sim_compute_sim_state": 0.03567179528678336, "sim_compute_performance-ego": 0.062087679781564854, "sim_compute_robot_state-ego": 0.06221980874131366, "sim_compute_robot_state-npc0": 0.06810352278918755, "sim_compute_robot_state-npc1": 0.062881647086725, "sim_compute_robot_state-npc2": 0.062380802340623806, "sim_compute_robot_state-npc3": 0.06251661370440227}}
set_robot_commands_max0.07683733032970894
set_robot_commands_mean0.07507143339878175
set_robot_commands_median0.07498637755711873
set_robot_commands_min0.07260074019432068
sim_compute_performance-ego_max0.0626944891611735
sim_compute_performance-ego_mean0.05994427197735484
sim_compute_performance-ego_median0.05933251857757568
sim_compute_performance-ego_min0.05760161280632019
sim_compute_robot_state-ego_max0.06221980874131366
sim_compute_robot_state-ego_mean0.05987468406436889
sim_compute_robot_state-ego_median0.05914224982261658
sim_compute_robot_state-ego_min0.05813943386077881
sim_compute_robot_state-npc0_max0.0692631983757019
sim_compute_robot_state-npc0_mean0.06586579400930948
sim_compute_robot_state-npc0_median0.06469401518503824
sim_compute_robot_state-npc0_min0.06353615204493204
sim_compute_robot_state-npc1_max0.06331435521443685
sim_compute_robot_state-npc1_mean0.06194139809143253
sim_compute_robot_state-npc1_median0.061459511915842695
sim_compute_robot_state-npc1_min0.06068751096725464
sim_compute_robot_state-npc2_max0.06295977751413981
sim_compute_robot_state-npc2_mean0.06112202892846208
sim_compute_robot_state-npc2_median0.062213361263275146
sim_compute_robot_state-npc2_min0.059006129105885825
sim_compute_robot_state-npc3_max0.06251661370440227
sim_compute_robot_state-npc3_mean0.06081533445963046
sim_compute_robot_state-npc3_median0.061494636535644534
sim_compute_robot_state-npc3_min0.058705010414123536
sim_compute_sim_state_max0.03567179528678336
sim_compute_sim_state_mean0.03423001378338511
sim_compute_sim_state_median0.03343672156333923
sim_compute_sim_state_min0.03312629143397013
sim_physics_max0.1057573139667511
sim_physics_mean0.10072808935390257
sim_physics_median0.09994192441304524
sim_physics_min0.09707124204170411
sim_render-ego_max0.0598866081237793
sim_render-ego_mean0.056655562629544645
sim_render-ego_median0.055715179443359374
sim_render-ego_min0.05473088264465332
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.010000000000044
survival_time_min2.000000000000001
220593412jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessno-0:36:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1170319729193263
survival_time_median14.950000000000076
deviation-center-line_median0.669401506264004
in-drivable-lane_median0.20000000000000284


other stats
agent_compute-ego_max0.1925611753721495
agent_compute-ego_mean0.18973056577562217
agent_compute-ego_median0.18988429148991903
agent_compute-ego_min0.1841786257425944
deviation-center-line_max1.0363995200136338
deviation-center-line_mean0.7332854622662206
deviation-center-line_min0.4475046471710668
deviation-heading_max6.574658269182281
deviation-heading_mean4.135424324931191
deviation-heading_median3.8271145701854663
deviation-heading_min2.1644874191051224
driven_any_max3.6176088593258378
driven_any_mean2.6611473765465954
driven_any_median2.4599104038365303
driven_any_min1.9737633861025847
driven_lanedir_consec_max3.552621186311328
driven_lanedir_consec_mean2.3758932528742127
driven_lanedir_consec_min1.4559090470160427
driven_lanedir_max3.552621186311328
driven_lanedir_mean2.4765410653154616
driven_lanedir_median2.2420916456906643
driven_lanedir_min1.6386045434392444
in-drivable-lane_max2.1500000000000306
in-drivable-lane_mean0.6100000000000063
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.04062589561721, "sim_physics": 0.18643476009368895, "survival_time": 14.950000000000076, "driven_lanedir": 1.834088436450948, "sim_render-ego": 0.06774195750554403, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.1841786257425944, "deviation-heading": 6.574658269182281, "set_robot_commands": 0.10262927452723183, "deviation-center-line": 0.5729163122459467, "driven_lanedir_consec": 1.4559090470160427, "sim_compute_sim_state": 0.04246886094411214, "sim_compute_performance-ego": 0.07420280377070108, "sim_compute_robot_state-ego": 0.08105912208557128, "sim_compute_robot_state-npc0": 0.07397331714630127, "sim_compute_robot_state-npc1": 0.07402107954025268, "sim_compute_robot_state-npc2": 0.07439037164052327, "sim_compute_robot_state-npc3": 0.07406147241592408}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.6176088593258378, "sim_physics": 0.21080356518427532, "survival_time": 14.950000000000076, "driven_lanedir": 3.552621186311328, "sim_render-ego": 0.06801529963811238, "in-drivable-lane": 0, "agent_compute-ego": 0.1896040455500285, "deviation-heading": 2.411699302213478, "set_robot_commands": 0.10314570824305216, "deviation-center-line": 0.669401506264004, "driven_lanedir_consec": 3.552621186311328, "sim_compute_sim_state": 0.04207516113917033, "sim_compute_performance-ego": 0.07336221138636272, "sim_compute_robot_state-ego": 0.08105612119038899, "sim_compute_robot_state-npc0": 0.07372759819030762, "sim_compute_robot_state-npc1": 0.07485515038172404, "sim_compute_robot_state-npc2": 0.07465130964914958, "sim_compute_robot_state-npc3": 0.07542889436086019}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.4599104038365303, "sim_physics": 0.17632683436075847, "survival_time": 14.950000000000076, "driven_lanedir": 2.2420916456906643, "sim_render-ego": 0.06671892881393432, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.18988429148991903, "deviation-heading": 5.699162063969605, "set_robot_commands": 0.10085198481877646, "deviation-center-line": 0.940205325636452, "driven_lanedir_consec": 2.1170319729193263, "sim_compute_sim_state": 0.042087447643280027, "sim_compute_performance-ego": 0.07492113431294758, "sim_compute_robot_state-ego": 0.08027693033218383, "sim_compute_robot_state-npc0": 0.0731946094830831, "sim_compute_robot_state-npc1": 0.07380872329076131, "sim_compute_robot_state-npc2": 0.07337249199549357, "sim_compute_robot_state-npc3": 0.07366467634836833}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.213828337850817, "sim_physics": 0.1864305090904236, "survival_time": 14.950000000000076, "driven_lanedir": 3.1152995146851232, "sim_render-ego": 0.06703760464986165, "in-drivable-lane": 0, "agent_compute-ego": 0.1924246907234192, "deviation-heading": 3.8271145701854663, "set_robot_commands": 0.10495473146438598, "deviation-center-line": 1.0363995200136338, "driven_lanedir_consec": 3.1152995146851232, "sim_compute_sim_state": 0.042247575918833415, "sim_compute_performance-ego": 0.07421987851460775, "sim_compute_robot_state-ego": 0.0814269757270813, "sim_compute_robot_state-npc0": 0.07505246877670288, "sim_compute_robot_state-npc1": 0.07438211679458619, "sim_compute_robot_state-npc2": 0.07478137572606404, "sim_compute_robot_state-npc3": 0.07346221764882406}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9737633861025847, "sim_physics": 0.17596924884899243, "survival_time": 9.249999999999996, "driven_lanedir": 1.6386045434392444, "sim_render-ego": 0.06574377626986116, "in-drivable-lane": 0.6999999999999984, "agent_compute-ego": 0.1925611753721495, "deviation-heading": 2.1644874191051224, "set_robot_commands": 0.10551489108317608, "deviation-center-line": 0.4475046471710668, "driven_lanedir_consec": 1.6386045434392444, "sim_compute_sim_state": 0.04163567439929859, "sim_compute_performance-ego": 0.0740145799275991, "sim_compute_robot_state-ego": 0.08180068505776895, "sim_compute_robot_state-npc0": 0.0751545016830032, "sim_compute_robot_state-npc1": 0.0753734691722973, "sim_compute_robot_state-npc2": 0.07380648174801388, "sim_compute_robot_state-npc3": 0.07326707839965821}}
set_robot_commands_max0.10551489108317608
set_robot_commands_mean0.10341931802732449
set_robot_commands_median0.10314570824305216
set_robot_commands_min0.10085198481877646
sim_compute_performance-ego_max0.07492113431294758
sim_compute_performance-ego_mean0.07414412158244366
sim_compute_performance-ego_median0.07420280377070108
sim_compute_performance-ego_min0.07336221138636272
sim_compute_robot_state-ego_max0.08180068505776895
sim_compute_robot_state-ego_mean0.08112396687859887
sim_compute_robot_state-ego_median0.08105912208557128
sim_compute_robot_state-ego_min0.08027693033218383
sim_compute_robot_state-npc0_max0.0751545016830032
sim_compute_robot_state-npc0_mean0.07422049905587962
sim_compute_robot_state-npc0_median0.07397331714630127
sim_compute_robot_state-npc0_min0.0731946094830831
sim_compute_robot_state-npc1_max0.0753734691722973
sim_compute_robot_state-npc1_mean0.0744881078359243
sim_compute_robot_state-npc1_median0.07438211679458619
sim_compute_robot_state-npc1_min0.07380872329076131
sim_compute_robot_state-npc2_max0.07478137572606404
sim_compute_robot_state-npc2_mean0.07420040615184886
sim_compute_robot_state-npc2_median0.07439037164052327
sim_compute_robot_state-npc2_min0.07337249199549357
sim_compute_robot_state-npc3_max0.07542889436086019
sim_compute_robot_state-npc3_mean0.07397686783472697
sim_compute_robot_state-npc3_median0.07366467634836833
sim_compute_robot_state-npc3_min0.07326707839965821
sim_compute_sim_state_max0.04246886094411214
sim_compute_sim_state_mean0.042102944008938895
sim_compute_sim_state_median0.042087447643280027
sim_compute_sim_state_min0.04163567439929859
sim_physics_max0.21080356518427532
sim_physics_mean0.18719298351562777
sim_physics_median0.1864305090904236
sim_physics_min0.17596924884899243
sim_render-ego_max0.06801529963811238
sim_render-ego_mean0.06705151337546271
sim_render-ego_median0.06703760464986165
sim_render-ego_min0.06574377626986116
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.810000000000064
survival_time_min9.249999999999996
220553412jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationhost-errorno-0:15:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22055-736661', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22055-736661', 'down']:

   >  Command '['docker-compose', '-p', 'job22055-736661', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.