AI Driving Olympics Home Challenges Submissions Jobs

Submission 3424

Submission3424
Competingyes
Challengeaido2-LFV-sim-validation
Userjp18813100494
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 22310
Next
User labelRL-TH-shi
Admin priority50
User priority50

22310

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223103424jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes-0:31:06(hidden)
driven_lanedir_consec_median2.6853739513856465
survival_time_median14.950000000000076
deviation-center-line_median0.904356570989936
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16993042548497517
agent_compute-ego_mean0.1610130560874939
agent_compute-ego_median0.15860117355982462
agent_compute-ego_min0.15495229148864745
deviation-center-line_max1.2262029270835118
deviation-center-line_mean0.8070600915977242
deviation-center-line_min0.25243172547580756
deviation-heading_max4.70697477823008
deviation-heading_mean3.3700774614271567
deviation-heading_median3.596520086178101
deviation-heading_min1.9689577032995276
driven_any_max3.6679529495143193
driven_any_mean2.8002989199964845
driven_any_median2.798066880559286
driven_any_min2.0107297460871
driven_lanedir_consec_max3.612765573596355
driven_lanedir_consec_mean2.590162626986308
driven_lanedir_consec_min1.440758901329754
driven_lanedir_max3.612765573596355
driven_lanedir_mean2.6012680099921552
driven_lanedir_median2.6853739513856465
driven_lanedir_min1.440758901329754
in-drivable-lane_max2.3000000000000327
in-drivable-lane_mean0.5900000000000061
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.798066880559286, "sim_physics": 0.15062413771947225, "survival_time": 14.950000000000076, "driven_lanedir": 2.6853739513856465, "sim_render-ego": 0.057138010660807294, "in-drivable-lane": 0, "agent_compute-ego": 0.1633625356356303, "deviation-heading": 4.241814130061826, "set_robot_commands": 0.08751890261967978, "deviation-center-line": 0.904356570989936, "driven_lanedir_consec": 2.6853739513856465, "sim_compute_sim_state": 0.04147142648696899, "sim_compute_performance-ego": 0.0625065008799235, "sim_compute_robot_state-ego": 0.0651844596862793, "sim_compute_robot_state-npc0": 0.06423521041870117, "sim_compute_robot_state-npc1": 0.06215200185775757, "sim_compute_robot_state-npc2": 0.06553987661997478, "sim_compute_robot_state-npc3": 0.06267652273178101}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.6679529495143193, "sim_physics": 0.1711104933420817, "survival_time": 14.950000000000076, "driven_lanedir": 3.612765573596355, "sim_render-ego": 0.05780163923899333, "in-drivable-lane": 0, "agent_compute-ego": 0.15821885426839194, "deviation-heading": 2.336120609366247, "set_robot_commands": 0.08577289819717407, "deviation-center-line": 1.2262029270835118, "driven_lanedir_consec": 3.612765573596355, "sim_compute_sim_state": 0.038803377946217854, "sim_compute_performance-ego": 0.06558411200841267, "sim_compute_robot_state-ego": 0.06800716797510784, "sim_compute_robot_state-npc0": 0.0654430357615153, "sim_compute_robot_state-npc1": 0.06525684038798014, "sim_compute_robot_state-npc2": 0.06361711899439494, "sim_compute_robot_state-npc3": 0.06456395864486694}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3280983853584063, "sim_physics": 0.15441890875498454, "survival_time": 14.950000000000076, "driven_lanedir": 2.1624555334621935, "sim_render-ego": 0.05657849868138631, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.15860117355982462, "deviation-heading": 4.70697477823008, "set_robot_commands": 0.0906017557779948, "deviation-center-line": 0.6926233292200495, "driven_lanedir_consec": 2.106928618432955, "sim_compute_sim_state": 0.03690572738647461, "sim_compute_performance-ego": 0.06346465190251668, "sim_compute_robot_state-ego": 0.06723767280578613, "sim_compute_robot_state-npc0": 0.0637391193707784, "sim_compute_robot_state-npc1": 0.06457918564478557, "sim_compute_robot_state-npc2": 0.0648497215906779, "sim_compute_robot_state-npc3": 0.06489957014719645}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.196646638463311, "sim_physics": 0.1568604604403178, "survival_time": 14.950000000000076, "driven_lanedir": 3.104986090186827, "sim_render-ego": 0.060015067259470624, "in-drivable-lane": 0, "agent_compute-ego": 0.16993042548497517, "deviation-heading": 3.596520086178101, "set_robot_commands": 0.08948218584060669, "deviation-center-line": 0.9596859052193152, "driven_lanedir_consec": 3.104986090186827, "sim_compute_sim_state": 0.03680365800857544, "sim_compute_performance-ego": 0.06534903923670451, "sim_compute_robot_state-ego": 0.0710450530052185, "sim_compute_robot_state-npc0": 0.06627983967463176, "sim_compute_robot_state-npc1": 0.06588219165802002, "sim_compute_robot_state-npc2": 0.06427190065383911, "sim_compute_robot_state-npc3": 0.0661713202794393}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0107297460871, "sim_physics": 0.13624010848999024, "survival_time": 6.249999999999986, "driven_lanedir": 1.440758901329754, "sim_render-ego": 0.055894140243530274, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.15495229148864745, "deviation-heading": 1.9689577032995276, "set_robot_commands": 0.08353702926635742, "deviation-center-line": 0.25243172547580756, "driven_lanedir_consec": 1.440758901329754, "sim_compute_sim_state": 0.034356002807617185, "sim_compute_performance-ego": 0.06125058364868164, "sim_compute_robot_state-ego": 0.06394232368469238, "sim_compute_robot_state-npc0": 0.06324353218078613, "sim_compute_robot_state-npc1": 0.06079923439025879, "sim_compute_robot_state-npc2": 0.06020779991149902, "sim_compute_robot_state-npc3": 0.06356545639038086}}
set_robot_commands_max0.0906017557779948
set_robot_commands_mean0.08738255434036254
set_robot_commands_median0.08751890261967978
set_robot_commands_min0.08353702926635742
sim_compute_performance-ego_max0.06558411200841267
sim_compute_performance-ego_mean0.0636309775352478
sim_compute_performance-ego_median0.06346465190251668
sim_compute_performance-ego_min0.06125058364868164
sim_compute_robot_state-ego_max0.0710450530052185
sim_compute_robot_state-ego_mean0.06708333543141684
sim_compute_robot_state-ego_median0.06723767280578613
sim_compute_robot_state-ego_min0.06394232368469238
sim_compute_robot_state-npc0_max0.06627983967463176
sim_compute_robot_state-npc0_mean0.06458814748128254
sim_compute_robot_state-npc0_median0.06423521041870117
sim_compute_robot_state-npc0_min0.06324353218078613
sim_compute_robot_state-npc1_max0.06588219165802002
sim_compute_robot_state-npc1_mean0.06373389078776043
sim_compute_robot_state-npc1_median0.06457918564478557
sim_compute_robot_state-npc1_min0.06079923439025879
sim_compute_robot_state-npc2_max0.06553987661997478
sim_compute_robot_state-npc2_mean0.06369728355407715
sim_compute_robot_state-npc2_median0.06427190065383911
sim_compute_robot_state-npc2_min0.06020779991149902
sim_compute_robot_state-npc3_max0.0661713202794393
sim_compute_robot_state-npc3_mean0.0643753656387329
sim_compute_robot_state-npc3_median0.06456395864486694
sim_compute_robot_state-npc3_min0.06267652273178101
sim_compute_sim_state_max0.04147142648696899
sim_compute_sim_state_mean0.037668038527170815
sim_compute_sim_state_median0.03690572738647461
sim_compute_sim_state_min0.034356002807617185
sim_physics_max0.1711104933420817
sim_physics_mean0.15385082174936932
sim_physics_median0.15441890875498454
sim_physics_min0.13624010848999024
sim_render-ego_max0.060015067259470624
sim_render-ego_mean0.05748547121683757
sim_render-ego_median0.057138010660807294
sim_render-ego_min0.055894140243530274
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.21000000000006
survival_time_min6.249999999999986
220783424jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessno-0:23:04(hidden)
driven_lanedir_consec_median2.4952110873012714
survival_time_median14.950000000000076
deviation-center-line_median0.5803126056489702
in-drivable-lane_median0.5000000000000071


other stats
agent_compute-ego_max0.18051959787096297
agent_compute-ego_mean0.16258529690609003
agent_compute-ego_median0.17111502512536866
agent_compute-ego_min0.1286848306655884
deviation-center-line_max0.9668485352354208
deviation-center-line_mean0.5461230058956437
deviation-center-line_min0.11119446624569562
deviation-heading_max3.989114172006981
deviation-heading_mean2.2564474441586264
deviation-heading_median2.769084980175022
deviation-heading_min0.5812705502786776
driven_any_max3.658249591146466
driven_any_mean2.230884292262708
driven_any_median2.6038499008805376
driven_any_min0.3889091166706845
driven_lanedir_consec_max3.5447347156164666
driven_lanedir_consec_mean2.0750406245211623
driven_lanedir_consec_min0.35171950791948214
driven_lanedir_max3.5447347156164666
driven_lanedir_mean2.0750406245211623
driven_lanedir_median2.4952110873012714
driven_lanedir_min0.35171950791948214
in-drivable-lane_max1.099999999999996
in-drivable-lane_mean0.4400000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.6038499008805376, "sim_physics": 0.16552118142445882, "survival_time": 14.950000000000076, "driven_lanedir": 2.4952110873012714, "sim_render-ego": 0.059232340653737385, "in-drivable-lane": 0, "agent_compute-ego": 0.16125528891881308, "deviation-heading": 3.989114172006981, "set_robot_commands": 0.08826395591100057, "deviation-center-line": 0.9668485352354208, "driven_lanedir_consec": 2.4952110873012714, "sim_compute_sim_state": 0.03697359323501587, "sim_compute_performance-ego": 0.06395871798197428, "sim_compute_robot_state-ego": 0.06955485900243123, "sim_compute_robot_state-npc0": 0.06687022129694621, "sim_compute_robot_state-npc1": 0.06541790167490641, "sim_compute_robot_state-npc2": 0.06420137484868367, "sim_compute_robot_state-npc3": 0.06451876004536947}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3889091166706845, "sim_physics": 0.18337453263146536, "survival_time": 1.4000000000000006, "driven_lanedir": 0.35171950791948214, "sim_render-ego": 0.0562342745917184, "in-drivable-lane": 0, "agent_compute-ego": 0.18051959787096297, "deviation-heading": 0.5812705502786776, "set_robot_commands": 0.09700942039489746, "deviation-center-line": 0.11119446624569562, "driven_lanedir_consec": 0.35171950791948214, "sim_compute_sim_state": 0.04244384595326015, "sim_compute_performance-ego": 0.06959377867834908, "sim_compute_robot_state-ego": 0.07768245254244123, "sim_compute_robot_state-npc0": 0.07415783405303955, "sim_compute_robot_state-npc1": 0.06883378539766584, "sim_compute_robot_state-npc2": 0.06765441383634295, "sim_compute_robot_state-npc3": 0.07150801590510777}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.601593058816293, "sim_physics": 0.18022132401514537, "survival_time": 4.94999999999999, "driven_lanedir": 1.2491366879725887, "sim_render-ego": 0.0612693266435103, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.17111502512536866, "deviation-heading": 0.7162737435226221, "set_robot_commands": 0.09089377672985346, "deviation-center-line": 0.16463735975318983, "driven_lanedir_consec": 1.2491366879725887, "sim_compute_sim_state": 0.039252926604916354, "sim_compute_performance-ego": 0.06656872383271804, "sim_compute_robot_state-ego": 0.07317005504261363, "sim_compute_robot_state-npc0": 0.06792900538203692, "sim_compute_robot_state-npc1": 0.07396622378416735, "sim_compute_robot_state-npc2": 0.06810094611813323, "sim_compute_robot_state-npc3": 0.06815184968890566}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.658249591146466, "sim_physics": 0.16198265075683593, "survival_time": 14.950000000000076, "driven_lanedir": 3.5447347156164666, "sim_render-ego": 0.06369664192199707, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1713517419497172, "deviation-heading": 2.769084980175022, "set_robot_commands": 0.09067777872085572, "deviation-center-line": 0.9076220625949418, "driven_lanedir_consec": 3.5447347156164666, "sim_compute_sim_state": 0.03898268699645996, "sim_compute_performance-ego": 0.06874656041463216, "sim_compute_robot_state-ego": 0.07376555601755778, "sim_compute_robot_state-npc0": 0.06704269806543986, "sim_compute_robot_state-npc1": 0.06527680317560831, "sim_compute_robot_state-npc2": 0.0660417373975118, "sim_compute_robot_state-npc3": 0.06681055784225463}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.9018197937995573, "sim_physics": 0.1145862889289856, "survival_time": 14.950000000000076, "driven_lanedir": 2.734401123796004, "sim_render-ego": 0.046371747652689616, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.1286848306655884, "deviation-heading": 3.226493774809829, "set_robot_commands": 0.07108975172042847, "deviation-center-line": 0.5803126056489702, "driven_lanedir_consec": 2.734401123796004, "sim_compute_sim_state": 0.02924976428349813, "sim_compute_performance-ego": 0.050278987089792886, "sim_compute_robot_state-ego": 0.05307238578796387, "sim_compute_robot_state-npc0": 0.05248977184295654, "sim_compute_robot_state-npc1": 0.05120674053827921, "sim_compute_robot_state-npc2": 0.05165236075719198, "sim_compute_robot_state-npc3": 0.05190286159515381}}
set_robot_commands_max0.09700942039489746
set_robot_commands_mean0.08758693669540712
set_robot_commands_median0.09067777872085572
set_robot_commands_min0.07108975172042847
sim_compute_performance-ego_max0.06959377867834908
sim_compute_performance-ego_mean0.0638293535994933
sim_compute_performance-ego_median0.06656872383271804
sim_compute_performance-ego_min0.050278987089792886
sim_compute_robot_state-ego_max0.07768245254244123
sim_compute_robot_state-ego_mean0.06944906167860156
sim_compute_robot_state-ego_median0.07317005504261363
sim_compute_robot_state-ego_min0.05307238578796387
sim_compute_robot_state-npc0_max0.07415783405303955
sim_compute_robot_state-npc0_mean0.06569790612808382
sim_compute_robot_state-npc0_median0.06704269806543986
sim_compute_robot_state-npc0_min0.05248977184295654
sim_compute_robot_state-npc1_max0.07396622378416735
sim_compute_robot_state-npc1_mean0.06494029091412543
sim_compute_robot_state-npc1_median0.06541790167490641
sim_compute_robot_state-npc1_min0.05120674053827921
sim_compute_robot_state-npc2_max0.06810094611813323
sim_compute_robot_state-npc2_mean0.06353016659157272
sim_compute_robot_state-npc2_median0.0660417373975118
sim_compute_robot_state-npc2_min0.05165236075719198
sim_compute_robot_state-npc3_max0.07150801590510777
sim_compute_robot_state-npc3_mean0.06457840901535827
sim_compute_robot_state-npc3_median0.06681055784225463
sim_compute_robot_state-npc3_min0.05190286159515381
sim_compute_sim_state_max0.04244384595326015
sim_compute_sim_state_mean0.03738056341463009
sim_compute_sim_state_median0.03898268699645996
sim_compute_sim_state_min0.02924976428349813
sim_physics_max0.18337453263146536
sim_physics_mean0.1611371955513782
sim_physics_median0.16552118142445882
sim_physics_min0.1145862889289856
sim_render-ego_max0.06369664192199707
sim_render-ego_mean0.05736086629273056
sim_render-ego_median0.059232340653737385
sim_render-ego_min0.046371747652689616
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.240000000000045
survival_time_min1.4000000000000006
220733424jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationhost-errorno-0:16:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22073-93136', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22073-93136', 'down']:

   >  Command '['docker-compose', '-p', 'job22073-93136', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
(hidden)