AI Driving Olympics Home Challenges Submissions Jobs

Submission 3402

Submission3402
Competingyes
Challengeaido2-LFV-sim-validation
Userjp18813100494
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22338
Next
User labelRL-TH-shi
Admin priority50
Blessing50
User priority

22338

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223383402jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes-0:31:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0656256711545056
survival_time_median14.950000000000076
deviation-center-line_median1.067962415499822
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.17157697677612305
agent_compute-ego_mean0.1661475680247456
agent_compute-ego_median0.16582575379585734
agent_compute-ego_min0.1575186038017273
deviation-center-line_max1.3050316432676294
deviation-center-line_mean0.939056391191476
deviation-center-line_min0.2352082649629227
deviation-heading_max8.476768494662194
deviation-heading_mean4.140557172545289
deviation-heading_median3.0429296736689047
deviation-heading_min1.500030541342493
driven_any_max3.794125700053806
driven_any_mean2.4869055410177014
driven_any_median2.612878294174509
driven_any_min1.4086570521625874
driven_lanedir_consec_max3.742087276869941
driven_lanedir_consec_mean2.2992516928522773
driven_lanedir_consec_min1.254594619368286
driven_lanedir_max3.742087276869941
driven_lanedir_mean2.3843231188552685
driven_lanedir_median2.4306487193687563
driven_lanedir_min1.3149287011689903
in-drivable-lane_max4.099999999999985
in-drivable-lane_mean1.1700000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.7094953140588514, "sim_physics": 0.1594630495707194, "survival_time": 14.950000000000076, "driven_lanedir": 2.6525567712103726, "sim_render-ego": 0.05655939896901448, "in-drivable-lane": 0, "agent_compute-ego": 0.1575186038017273, "deviation-heading": 3.0429296736689047, "set_robot_commands": 0.08654730717341105, "deviation-center-line": 1.3050316432676294, "driven_lanedir_consec": 2.6525567712103726, "sim_compute_sim_state": 0.03513382434844971, "sim_compute_performance-ego": 0.06142990112304687, "sim_compute_robot_state-ego": 0.0656575067838033, "sim_compute_robot_state-npc0": 0.06254857540130615, "sim_compute_robot_state-npc1": 0.061590179602305097, "sim_compute_robot_state-npc2": 0.061166305541992184, "sim_compute_robot_state-npc3": 0.06215750296910604}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.794125700053806, "sim_physics": 0.17906782229741414, "survival_time": 14.950000000000076, "driven_lanedir": 3.742087276869941, "sim_render-ego": 0.05846297740936279, "in-drivable-lane": 0, "agent_compute-ego": 0.17134380181630451, "deviation-heading": 2.262240256023796, "set_robot_commands": 0.09059075196584064, "deviation-center-line": 1.067962415499822, "driven_lanedir_consec": 3.742087276869941, "sim_compute_sim_state": 0.03646530866622925, "sim_compute_performance-ego": 0.06677495479583741, "sim_compute_robot_state-ego": 0.0705595866839091, "sim_compute_robot_state-npc0": 0.06733516216278077, "sim_compute_robot_state-npc1": 0.06486596584320069, "sim_compute_robot_state-npc2": 0.06476866642634074, "sim_compute_robot_state-npc3": 0.0646024481455485}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.612878294174509, "sim_physics": 0.16263309790163624, "survival_time": 14.700000000000074, "driven_lanedir": 2.4306487193687563, "sim_render-ego": 0.05863287578634664, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.16582575379585734, "deviation-heading": 5.420816897029061, "set_robot_commands": 0.09164221676028504, "deviation-center-line": 1.197885946037198, "driven_lanedir_consec": 2.0656256711545056, "sim_compute_sim_state": 0.03645126998019056, "sim_compute_performance-ego": 0.06632480410491529, "sim_compute_robot_state-ego": 0.06964137278446535, "sim_compute_robot_state-npc0": 0.06554411138807024, "sim_compute_robot_state-npc1": 0.06411471577728686, "sim_compute_robot_state-npc2": 0.06464217876901432, "sim_compute_robot_state-npc3": 0.06445423194340297}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4086570521625874, "sim_physics": 0.15182961225509645, "survival_time": 14.950000000000076, "driven_lanedir": 1.3149287011689903, "sim_render-ego": 0.05691541751225789, "in-drivable-lane": 4.099999999999985, "agent_compute-ego": 0.16447270393371582, "deviation-heading": 8.476768494662194, "set_robot_commands": 0.09010095755259195, "deviation-center-line": 0.8891936861898081, "driven_lanedir_consec": 1.254594619368286, "sim_compute_sim_state": 0.03670051495234171, "sim_compute_performance-ego": 0.06298758029937744, "sim_compute_robot_state-ego": 0.06820156415303548, "sim_compute_robot_state-npc0": 0.06556615670522054, "sim_compute_robot_state-npc1": 0.06560276110967, "sim_compute_robot_state-npc2": 0.06421844482421875, "sim_compute_robot_state-npc3": 0.06594360669453939}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9093713446387544, "sim_physics": 0.15730951513562882, "survival_time": 6.999999999999983, "driven_lanedir": 1.7813941256582806, "sim_render-ego": 0.061457674843924386, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.17157697677612305, "deviation-heading": 1.500030541342493, "set_robot_commands": 0.09291960852486748, "deviation-center-line": 0.2352082649629227, "driven_lanedir_consec": 1.7813941256582806, "sim_compute_sim_state": 0.03777547223227365, "sim_compute_performance-ego": 0.06616788932255337, "sim_compute_robot_state-ego": 0.07253009080886841, "sim_compute_robot_state-npc0": 0.06814404726028442, "sim_compute_robot_state-npc1": 0.06711064577102661, "sim_compute_robot_state-npc2": 0.06574511698314121, "sim_compute_robot_state-npc3": 0.06774926696504865}}
set_robot_commands_max0.09291960852486748
set_robot_commands_mean0.09036016839539925
set_robot_commands_median0.09059075196584064
set_robot_commands_min0.08654730717341105
sim_compute_performance-ego_max0.06677495479583741
sim_compute_performance-ego_mean0.06473702592914607
sim_compute_performance-ego_median0.06616788932255337
sim_compute_performance-ego_min0.06142990112304687
sim_compute_robot_state-ego_max0.07253009080886841
sim_compute_robot_state-ego_mean0.06931802424281633
sim_compute_robot_state-ego_median0.06964137278446535
sim_compute_robot_state-ego_min0.0656575067838033
sim_compute_robot_state-npc0_max0.06814404726028442
sim_compute_robot_state-npc0_mean0.06582761058353241
sim_compute_robot_state-npc0_median0.06556615670522054
sim_compute_robot_state-npc0_min0.06254857540130615
sim_compute_robot_state-npc1_max0.06711064577102661
sim_compute_robot_state-npc1_mean0.06465685362069785
sim_compute_robot_state-npc1_median0.06486596584320069
sim_compute_robot_state-npc1_min0.061590179602305097
sim_compute_robot_state-npc2_max0.06574511698314121
sim_compute_robot_state-npc2_mean0.06410814250894145
sim_compute_robot_state-npc2_median0.06464217876901432
sim_compute_robot_state-npc2_min0.061166305541992184
sim_compute_robot_state-npc3_max0.06774926696504865
sim_compute_robot_state-npc3_mean0.06498141134352911
sim_compute_robot_state-npc3_median0.0646024481455485
sim_compute_robot_state-npc3_min0.06215750296910604
sim_compute_sim_state_max0.03777547223227365
sim_compute_sim_state_mean0.036505278035896975
sim_compute_sim_state_median0.03646530866622925
sim_compute_sim_state_min0.03513382434844971
sim_physics_max0.17906782229741414
sim_physics_mean0.162060619432099
sim_physics_median0.1594630495707194
sim_physics_min0.15182961225509645
sim_render-ego_max0.061457674843924386
sim_render-ego_mean0.05840566890418124
sim_render-ego_median0.05846297740936279
sim_render-ego_min0.05655939896901448
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.31000000000006
survival_time_min6.999999999999983
220423402jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessno-0:12:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7610774019643551
survival_time_median8.199999999999982
deviation-center-line_median1.0187737150462366
in-drivable-lane_median0.849999999999997


other stats
agent_compute-ego_max0.08944998105367025
agent_compute-ego_mean0.08839966342611019
agent_compute-ego_median0.08815578699111938
agent_compute-ego_min0.08785167554529702
deviation-center-line_max1.1184555303173498
deviation-center-line_mean0.7050251003576312
deviation-center-line_min0.1408798709275622
deviation-heading_max6.299607622113256
deviation-heading_mean2.8282579902479585
deviation-heading_median2.0843518005358224
deviation-heading_min0.9209486578787726
driven_any_max3.62018222938969
driven_any_mean2.2564317811874965
driven_any_median1.8856349011461329
driven_any_min1.0560199552283918
driven_lanedir_consec_max3.5465238019274827
driven_lanedir_consec_mean2.0589068335414815
driven_lanedir_consec_min0.6998388966401745
driven_lanedir_max3.5465238019274827
driven_lanedir_mean2.0589068335414815
driven_lanedir_median1.7610774019643551
driven_lanedir_min0.6998388966401745
in-drivable-lane_max1.9500000000000275
in-drivable-lane_mean0.7900000000000047
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0560199552283918, "sim_physics": 0.06580025829919954, "survival_time": 8.199999999999982, "driven_lanedir": 0.6998388966401745, "sim_render-ego": 0.031870532326582005, "in-drivable-lane": 1.049999999999999, "agent_compute-ego": 0.08785167554529702, "deviation-heading": 6.299607622113256, "set_robot_commands": 0.0490944298302255, "deviation-center-line": 1.0187737150462366, "driven_lanedir_consec": 0.6998388966401745, "sim_compute_sim_state": 0.02017761149057528, "sim_compute_performance-ego": 0.035004339567044886, "sim_compute_robot_state-ego": 0.03647569476104364, "sim_compute_robot_state-npc0": 0.03554137887024298, "sim_compute_robot_state-npc1": 0.03601265389744828, "sim_compute_robot_state-npc2": 0.035391025426911145, "sim_compute_robot_state-npc3": 0.035320271806019106}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.62018222938969, "sim_physics": 0.07130422512690227, "survival_time": 14.950000000000076, "driven_lanedir": 3.5465238019274827, "sim_render-ego": 0.03250849088033041, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.08944998105367025, "deviation-heading": 2.0843518005358224, "set_robot_commands": 0.0495378851890564, "deviation-center-line": 1.069770539204626, "driven_lanedir_consec": 3.5465238019274827, "sim_compute_sim_state": 0.020367151896158855, "sim_compute_performance-ego": 0.035053940614064534, "sim_compute_robot_state-ego": 0.036587920188903805, "sim_compute_robot_state-npc0": 0.03589537700017293, "sim_compute_robot_state-npc1": 0.03612893740336101, "sim_compute_robot_state-npc2": 0.03577528715133667, "sim_compute_robot_state-npc3": 0.03668009996414184}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.1286057242541547, "sim_physics": 0.06916890859603882, "survival_time": 14.950000000000076, "driven_lanedir": 3.032724435885751, "sim_render-ego": 0.032134814262390135, "in-drivable-lane": 0, "agent_compute-ego": 0.08815578699111938, "deviation-heading": 3.729323607187256, "set_robot_commands": 0.04908432165781657, "deviation-center-line": 1.1184555303173498, "driven_lanedir_consec": 3.032724435885751, "sim_compute_sim_state": 0.02039766788482666, "sim_compute_performance-ego": 0.034751409689585365, "sim_compute_robot_state-ego": 0.037388331095377605, "sim_compute_robot_state-npc0": 0.03567529837290446, "sim_compute_robot_state-npc1": 0.03571642557779948, "sim_compute_robot_state-npc2": 0.03545287847518921, "sim_compute_robot_state-npc3": 0.03558070182800293}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5917160959191126, "sim_physics": 0.07267962802540172, "survival_time": 4.399999999999992, "driven_lanedir": 1.2543696312896429, "sim_render-ego": 0.031786192547191276, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0880720317363739, "deviation-heading": 0.9209486578787726, "set_robot_commands": 0.0490682910789143, "deviation-center-line": 0.1772458462923813, "driven_lanedir_consec": 1.2543696312896429, "sim_compute_sim_state": 0.02022281830961054, "sim_compute_performance-ego": 0.03460563312877308, "sim_compute_robot_state-ego": 0.036621844226663765, "sim_compute_robot_state-npc0": 0.03554974902759899, "sim_compute_robot_state-npc1": 0.03556923432783647, "sim_compute_robot_state-npc2": 0.03567204692146995, "sim_compute_robot_state-npc3": 0.03562080047347329}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.8856349011461329, "sim_physics": 0.06194288970888123, "survival_time": 6.449999999999985, "driven_lanedir": 1.7610774019643551, "sim_render-ego": 0.032041658726773524, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0884688418040904, "deviation-heading": 1.1070582635246875, "set_robot_commands": 0.048893812090851536, "deviation-center-line": 0.1408798709275622, "driven_lanedir_consec": 1.7610774019643551, "sim_compute_sim_state": 0.020124692325444185, "sim_compute_performance-ego": 0.035940183225528215, "sim_compute_robot_state-ego": 0.03658996441567591, "sim_compute_robot_state-npc0": 0.03567235784013142, "sim_compute_robot_state-npc1": 0.035579768262168236, "sim_compute_robot_state-npc2": 0.03542185753814934, "sim_compute_robot_state-npc3": 0.03569458251775697}}
set_robot_commands_max0.0495378851890564
set_robot_commands_mean0.04913574796937286
set_robot_commands_median0.04908432165781657
set_robot_commands_min0.048893812090851536
sim_compute_performance-ego_max0.035940183225528215
sim_compute_performance-ego_mean0.035071101244999216
sim_compute_performance-ego_median0.035004339567044886
sim_compute_performance-ego_min0.03460563312877308
sim_compute_robot_state-ego_max0.037388331095377605
sim_compute_robot_state-ego_mean0.03673275093753295
sim_compute_robot_state-ego_median0.03658996441567591
sim_compute_robot_state-ego_min0.03647569476104364
sim_compute_robot_state-npc0_max0.03589537700017293
sim_compute_robot_state-npc0_mean0.03566683222221016
sim_compute_robot_state-npc0_median0.03567235784013142
sim_compute_robot_state-npc0_min0.03554137887024298
sim_compute_robot_state-npc1_max0.03612893740336101
sim_compute_robot_state-npc1_mean0.035801403893722696
sim_compute_robot_state-npc1_median0.03571642557779948
sim_compute_robot_state-npc1_min0.03556923432783647
sim_compute_robot_state-npc2_max0.03577528715133667
sim_compute_robot_state-npc2_mean0.035542619102611264
sim_compute_robot_state-npc2_median0.03545287847518921
sim_compute_robot_state-npc2_min0.035391025426911145
sim_compute_robot_state-npc3_max0.03668009996414184
sim_compute_robot_state-npc3_mean0.03577929131787883
sim_compute_robot_state-npc3_median0.03562080047347329
sim_compute_robot_state-npc3_min0.035320271806019106
sim_compute_sim_state_max0.02039766788482666
sim_compute_sim_state_mean0.020257988381323103
sim_compute_sim_state_median0.02022281830961054
sim_compute_sim_state_min0.020124692325444185
sim_physics_max0.07267962802540172
sim_physics_mean0.06817918195128472
sim_physics_median0.06916890859603882
sim_physics_min0.06194288970888123
sim_render-ego_max0.03250849088033041
sim_render-ego_mean0.03206833774865347
sim_render-ego_median0.032041658726773524
sim_render-ego_min0.031786192547191276
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.790000000000024
survival_time_min4.399999999999992
220413402jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationhost-errorno-0:06:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22041-812164', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22041-812164', 'down']:

   >  Command '['docker-compose', '-p', 'job22041-812164', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.