AI Driving Olympics Home Challenges Submissions Jobs

Submission 3401

Submission3401
Competingyes
Challengeaido2-LFV-sim-validation
Userjp18813100494
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 22341
Next
User labelRL-TH-shi
Admin priority50
User priority50

22341

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223413401jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes-0:34:44(hidden)
driven_lanedir_consec_median2.6122028022687203
survival_time_median14.950000000000076
deviation-center-line_median0.8622398031940482
in-drivable-lane_median0.8999999999999968


other stats
agent_compute-ego_max0.16729239543279012
agent_compute-ego_mean0.1659226689338684
agent_compute-ego_median0.16650668700536092
agent_compute-ego_min0.16424867630004883
deviation-center-line_max1.2294950023616256
deviation-center-line_mean0.7029994234629569
deviation-center-line_min0.19944560489846033
deviation-heading_max3.6015755153620983
deviation-heading_mean2.2719166628476004
deviation-heading_median2.5594891189389006
deviation-heading_min0.6034828847490026
driven_any_max3.5900950910523566
driven_any_mean2.424995416610534
driven_any_median3.095744811115921
driven_any_min0.975500459780526
driven_lanedir_consec_max3.5282029373516197
driven_lanedir_consec_mean2.238567661722691
driven_lanedir_consec_min0.7324591416350186
driven_lanedir_max3.5282029373516197
driven_lanedir_mean2.238567661722691
driven_lanedir_median2.6122028022687203
driven_lanedir_min0.7324591416350186
in-drivable-lane_max11.750000000000082
in-drivable-lane_mean4.730000000000032
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.975500459780526, "sim_physics": 0.15815587759017943, "survival_time": 14.950000000000076, "driven_lanedir": 0.7324591416350186, "sim_render-ego": 0.058783784707387286, "in-drivable-lane": 11.750000000000082, "agent_compute-ego": 0.16650668700536092, "deviation-heading": 1.2656895524573837, "set_robot_commands": 0.09079294045766197, "deviation-center-line": 0.19944560489846033, "driven_lanedir_consec": 0.7324591416350186, "sim_compute_sim_state": 0.036823956966400145, "sim_compute_performance-ego": 0.06440264225006104, "sim_compute_robot_state-ego": 0.07013684431711832, "sim_compute_robot_state-npc0": 0.06585266749064128, "sim_compute_robot_state-npc1": 0.06411370833714804, "sim_compute_robot_state-npc2": 0.06422042846679688, "sim_compute_robot_state-npc3": 0.06428931872049967}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.5900950910523566, "sim_physics": 0.18128358205159503, "survival_time": 14.950000000000076, "driven_lanedir": 3.5282029373516197, "sim_render-ego": 0.05883023262023926, "in-drivable-lane": 0, "agent_compute-ego": 0.16424867630004883, "deviation-heading": 2.5594891189389006, "set_robot_commands": 0.08909126043319703, "deviation-center-line": 1.003567419442511, "driven_lanedir_consec": 3.5282029373516197, "sim_compute_sim_state": 0.03841446081797282, "sim_compute_performance-ego": 0.06542700608571371, "sim_compute_robot_state-ego": 0.06940486510594686, "sim_compute_robot_state-npc0": 0.06404531081517538, "sim_compute_robot_state-npc1": 0.06457496563593547, "sim_compute_robot_state-npc2": 0.06443557182947794, "sim_compute_robot_state-npc3": 0.06674905220667521}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3198711486029897, "sim_physics": 0.14785994291305543, "survival_time": 14.950000000000076, "driven_lanedir": 1.2487676342568608, "sim_render-ego": 0.05690511306126912, "in-drivable-lane": 11.000000000000083, "agent_compute-ego": 0.16496785720189414, "deviation-heading": 0.6034828847490026, "set_robot_commands": 0.08907537937164306, "deviation-center-line": 0.22024928741813887, "driven_lanedir_consec": 1.2487676342568608, "sim_compute_sim_state": 0.0373182479540507, "sim_compute_performance-ego": 0.06430840253829956, "sim_compute_robot_state-ego": 0.0699708088239034, "sim_compute_robot_state-npc0": 0.06766618172327678, "sim_compute_robot_state-npc1": 0.0698047661781311, "sim_compute_robot_state-npc2": 0.06604162136713664, "sim_compute_robot_state-npc3": 0.06512808799743652}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.1437655725008766, "sim_physics": 0.1622022763888041, "survival_time": 14.950000000000076, "driven_lanedir": 3.071205793101236, "sim_render-ego": 0.0584545373916626, "in-drivable-lane": 0, "agent_compute-ego": 0.16729239543279012, "deviation-heading": 3.3293462427306157, "set_robot_commands": 0.08845183372497559, "deviation-center-line": 0.8622398031940482, "driven_lanedir_consec": 3.071205793101236, "sim_compute_sim_state": 0.036035913626352944, "sim_compute_performance-ego": 0.0659927256902059, "sim_compute_robot_state-ego": 0.06984869241714478, "sim_compute_robot_state-npc0": 0.06590573787689209, "sim_compute_robot_state-npc1": 0.06537930329640707, "sim_compute_robot_state-npc2": 0.06379809538523357, "sim_compute_robot_state-npc3": 0.06350290218989055}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.095744811115921, "sim_physics": 0.14900822559992472, "survival_time": 14.950000000000076, "driven_lanedir": 2.6122028022687203, "sim_render-ego": 0.057048963705698646, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.16659772872924805, "deviation-heading": 3.6015755153620983, "set_robot_commands": 0.09299068689346314, "deviation-center-line": 1.2294950023616256, "driven_lanedir_consec": 2.6122028022687203, "sim_compute_sim_state": 0.03577664295832316, "sim_compute_performance-ego": 0.06403486808141072, "sim_compute_robot_state-ego": 0.06846436738967895, "sim_compute_robot_state-npc0": 0.06458853085835775, "sim_compute_robot_state-npc1": 0.06380321184794108, "sim_compute_robot_state-npc2": 0.06317252000172933, "sim_compute_robot_state-npc3": 0.06217089494069417}}
set_robot_commands_max0.09299068689346314
set_robot_commands_mean0.09008042017618816
set_robot_commands_median0.08909126043319703
set_robot_commands_min0.08845183372497559
sim_compute_performance-ego_max0.0659927256902059
sim_compute_performance-ego_mean0.06483312892913819
sim_compute_performance-ego_median0.06440264225006104
sim_compute_performance-ego_min0.06403486808141072
sim_compute_robot_state-ego_max0.07013684431711832
sim_compute_robot_state-ego_mean0.06956511561075847
sim_compute_robot_state-ego_median0.06984869241714478
sim_compute_robot_state-ego_min0.06846436738967895
sim_compute_robot_state-npc0_max0.06766618172327678
sim_compute_robot_state-npc0_mean0.06561168575286866
sim_compute_robot_state-npc0_median0.06585266749064128
sim_compute_robot_state-npc0_min0.06404531081517538
sim_compute_robot_state-npc1_max0.0698047661781311
sim_compute_robot_state-npc1_mean0.06553519105911255
sim_compute_robot_state-npc1_median0.06457496563593547
sim_compute_robot_state-npc1_min0.06380321184794108
sim_compute_robot_state-npc2_max0.06604162136713664
sim_compute_robot_state-npc2_mean0.06433364741007488
sim_compute_robot_state-npc2_median0.06422042846679688
sim_compute_robot_state-npc2_min0.06317252000172933
sim_compute_robot_state-npc3_max0.06674905220667521
sim_compute_robot_state-npc3_mean0.06436805121103922
sim_compute_robot_state-npc3_median0.06428931872049967
sim_compute_robot_state-npc3_min0.06217089494069417
sim_compute_sim_state_max0.03841446081797282
sim_compute_sim_state_mean0.03687384446461995
sim_compute_sim_state_median0.036823956966400145
sim_compute_sim_state_min0.03577664295832316
sim_physics_max0.18128358205159503
sim_physics_mean0.15970198090871174
sim_physics_median0.15815587759017943
sim_physics_min0.14785994291305543
sim_render-ego_max0.05883023262023926
sim_render-ego_mean0.05800452629725138
sim_render-ego_median0.0584545373916626
sim_render-ego_min0.05690511306126912
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
220433401jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessno-0:19:26(hidden)
driven_lanedir_consec_median1.3838838571977454
survival_time_median14.950000000000076
deviation-center-line_median0.9140657090941292
in-drivable-lane_median0.25000000000000355


other stats
agent_compute-ego_max0.12849862893422445
agent_compute-ego_mean0.12489685624568214
agent_compute-ego_median0.12645866058684968
agent_compute-ego_min0.12148608446121216
deviation-center-line_max1.4608479754419017
deviation-center-line_mean0.8137743230981439
deviation-center-line_min0.13999744084704718
deviation-heading_max11.87887971883936
deviation-heading_mean4.858635852754812
deviation-heading_median1.9226629123400905
deviation-heading_min0.6554145563267308
driven_any_max3.5876801549396427
driven_any_mean2.0836289106366896
driven_any_median1.9004358473287517
driven_any_min1.3619625388308363
driven_lanedir_consec_max3.5526689999041188
driven_lanedir_consec_mean1.8387197835383056
driven_lanedir_consec_min1.2518690778871426
driven_lanedir_max3.5526689999041188
driven_lanedir_mean1.8851549330913528
driven_lanedir_median1.6160876437959728
driven_lanedir_min1.2518690778871426
in-drivable-lane_max2.3499999999999917
in-drivable-lane_mean0.7099999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9743852344416584, "sim_physics": 0.10953867038091024, "survival_time": 14.950000000000076, "driven_lanedir": 1.6160876437959728, "sim_render-ego": 0.044224960009257, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.12148608446121216, "deviation-heading": 8.488659934468131, "set_robot_commands": 0.06621468544006348, "deviation-center-line": 1.2979023595597494, "driven_lanedir_consec": 1.3838838571977454, "sim_compute_sim_state": 0.026710631052652995, "sim_compute_performance-ego": 0.046057337125142414, "sim_compute_robot_state-ego": 0.04908578475316366, "sim_compute_robot_state-npc0": 0.048489734331766766, "sim_compute_robot_state-npc1": 0.04938529332478841, "sim_compute_robot_state-npc2": 0.04712691307067871, "sim_compute_robot_state-npc3": 0.047067995071411135}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.5876801549396427, "sim_physics": 0.12462342262268068, "survival_time": 14.950000000000076, "driven_lanedir": 3.5526689999041188, "sim_render-ego": 0.04553714116414388, "in-drivable-lane": 0, "agent_compute-ego": 0.12647626002629597, "deviation-heading": 1.9226629123400905, "set_robot_commands": 0.07209776798884074, "deviation-center-line": 0.9140657090941292, "driven_lanedir_consec": 3.5526689999041188, "sim_compute_sim_state": 0.02874153931935628, "sim_compute_performance-ego": 0.04946261088053385, "sim_compute_robot_state-ego": 0.05165202935536702, "sim_compute_robot_state-npc0": 0.05238489230473836, "sim_compute_robot_state-npc1": 0.05134103695551554, "sim_compute_robot_state-npc2": 0.05124186913172404, "sim_compute_robot_state-npc3": 0.05099051713943482}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5936807776425606, "sim_physics": 0.11784437200525304, "survival_time": 4.549999999999992, "driven_lanedir": 1.2518690778871426, "sim_render-ego": 0.04289065088544573, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.12645866058684968, "deviation-heading": 0.6554145563267308, "set_robot_commands": 0.07156041166284582, "deviation-center-line": 0.13999744084704718, "driven_lanedir_consec": 1.2518690778871426, "sim_compute_sim_state": 0.02828212884756235, "sim_compute_performance-ego": 0.0477511044386979, "sim_compute_robot_state-ego": 0.05000434603009905, "sim_compute_robot_state-npc0": 0.05132688532818805, "sim_compute_robot_state-npc1": 0.04964224846808465, "sim_compute_robot_state-npc2": 0.05041313695383596, "sim_compute_robot_state-npc3": 0.05112988346225613}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3619625388308363, "sim_physics": 0.1153890585899353, "survival_time": 14.950000000000076, "driven_lanedir": 1.2586553672677412, "sim_render-ego": 0.04492382685343425, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.12849862893422445, "deviation-heading": 11.87887971883936, "set_robot_commands": 0.06959244807561239, "deviation-center-line": 1.4608479754419017, "driven_lanedir_consec": 1.2586834061007317, "sim_compute_sim_state": 0.029173658688863117, "sim_compute_performance-ego": 0.0490304708480835, "sim_compute_robot_state-ego": 0.05154491742451986, "sim_compute_robot_state-npc0": 0.050882310072580976, "sim_compute_robot_state-npc1": 0.048776466051737466, "sim_compute_robot_state-npc2": 0.048590925534566246, "sim_compute_robot_state-npc3": 0.04935102303822835}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9004358473287517, "sim_physics": 0.10952028533480816, "survival_time": 7.549999999999981, "driven_lanedir": 1.7464935766017904, "sim_render-ego": 0.0444777501339944, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.12156464721982842, "deviation-heading": 1.3475621417997494, "set_robot_commands": 0.07168345577669459, "deviation-center-line": 0.25605813054789217, "driven_lanedir_consec": 1.7464935766017904, "sim_compute_sim_state": 0.029119388946634253, "sim_compute_performance-ego": 0.04937799245316461, "sim_compute_robot_state-ego": 0.05218645436874288, "sim_compute_robot_state-npc0": 0.0515199007577454, "sim_compute_robot_state-npc1": 0.050709433902967845, "sim_compute_robot_state-npc2": 0.050703726067448295, "sim_compute_robot_state-npc3": 0.05117552485687054}}
set_robot_commands_max0.07209776798884074
set_robot_commands_mean0.07022975378881141
set_robot_commands_median0.07156041166284582
set_robot_commands_min0.06621468544006348
sim_compute_performance-ego_max0.04946261088053385
sim_compute_performance-ego_mean0.04833590314912445
sim_compute_performance-ego_median0.0490304708480835
sim_compute_performance-ego_min0.046057337125142414
sim_compute_robot_state-ego_max0.05218645436874288
sim_compute_robot_state-ego_mean0.0508947063863785
sim_compute_robot_state-ego_median0.05154491742451986
sim_compute_robot_state-ego_min0.04908578475316366
sim_compute_robot_state-npc0_max0.05238489230473836
sim_compute_robot_state-npc0_mean0.0509207445590039
sim_compute_robot_state-npc0_median0.05132688532818805
sim_compute_robot_state-npc0_min0.048489734331766766
sim_compute_robot_state-npc1_max0.05134103695551554
sim_compute_robot_state-npc1_mean0.04997089574061878
sim_compute_robot_state-npc1_median0.04964224846808465
sim_compute_robot_state-npc1_min0.048776466051737466
sim_compute_robot_state-npc2_max0.05124186913172404
sim_compute_robot_state-npc2_mean0.04961531415165065
sim_compute_robot_state-npc2_median0.05041313695383596
sim_compute_robot_state-npc2_min0.04712691307067871
sim_compute_robot_state-npc3_max0.05117552485687054
sim_compute_robot_state-npc3_mean0.04994298871364019
sim_compute_robot_state-npc3_median0.05099051713943482
sim_compute_robot_state-npc3_min0.047067995071411135
sim_compute_sim_state_max0.029173658688863117
sim_compute_sim_state_mean0.0284054693710138
sim_compute_sim_state_median0.02874153931935628
sim_compute_sim_state_min0.026710631052652995
sim_physics_max0.12462342262268068
sim_physics_mean0.11538316178671748
sim_physics_median0.1153890585899353
sim_physics_min0.10952028533480816
sim_render-ego_max0.04553714116414388
sim_render-ego_mean0.04441086580925506
sim_render-ego_median0.0444777501339944
sim_render-ego_min0.04289065088544573
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.39000000000004
survival_time_min4.549999999999992
220403401jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationhost-errorno-0:12:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22040-906552', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22040-906552', 'down']:

   >  Command '['docker-compose', '-p', 'job22040-906552', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
(hidden)