AI Driving Olympics Home Challenges Submissions Jobs

Submission 3064

Submission3064
Competingyes
Challengeaido2-LF-sim-testing
Userawoo424
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 22638
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
226383064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationerroryes-0:59:44
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
208603064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessno-0:55:40(hidden)
driven_lanedir_consec_median0.6523240082563025
survival_time_median12.650000000000045
deviation-center-line_median0.5953043214119251
in-drivable-lane_median0


other stats
agent_compute-ego_max0.26157378399465964
agent_compute-ego_mean0.20814646252113456
agent_compute-ego_median0.2106568916638692
agent_compute-ego_min0.16425865809122722
deviation-center-line_max1.2171177182330184
deviation-center-line_mean0.6907259034506872
deviation-center-line_min0.4045264267617618
deviation-heading_max3.5560693107984767
deviation-heading_mean1.7270421867244328
deviation-heading_median1.7980735870244908
deviation-heading_min0.16792099924859266
driven_any_max1.219699516636652
driven_any_mean0.8879355368571517
driven_any_median0.9956764758809086
driven_any_min0.271780030825251
driven_lanedir_consec_max1.2170036305209848
driven_lanedir_consec_mean0.7659108050549978
driven_lanedir_consec_min0.26504279849886814
driven_lanedir_max1.2170036305209848
driven_lanedir_mean0.7659108050549978
driven_lanedir_median0.6523240082563025
driven_lanedir_min0.26504279849886814
in-drivable-lane_max4.350000000000062
in-drivable-lane_mean1.113333333333349
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0182088072267623, "sim_physics": 0.1396547283713273, "survival_time": 12.700000000000044, "driven_lanedir": 0.6638163524254224, "sim_render-ego": 0.07195449157023993, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.26157378399465964, "deviation-heading": 3.5560693107984767, "set_robot_commands": 0.11570402299325296, "deviation-center-line": 0.5485266957093649, "driven_lanedir_consec": 0.6638163524254224, "sim_compute_sim_state": 0.04591660799942617, "sim_compute_performance-ego": 0.08132659262559545, "sim_compute_robot_state-ego": 0.08697716082174947}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9993417829299396, "sim_physics": 0.1170262834057212, "survival_time": 12.800000000000049, "driven_lanedir": 0.8368606887654501, "sim_render-ego": 0.06137991324067116, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.2233696011826396, "deviation-heading": 2.7869759774508465, "set_robot_commands": 0.09760731551796198, "deviation-center-line": 0.8146350958289812, "driven_lanedir_consec": 0.8368606887654501, "sim_compute_sim_state": 0.03939247038215399, "sim_compute_performance-ego": 0.06894868053495884, "sim_compute_robot_state-ego": 0.07409333623945713}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.271780030825251, "sim_physics": 0.10517922607628076, "survival_time": 3.699999999999995, "driven_lanedir": 0.26504279849886814, "sim_render-ego": 0.05754020729580441, "in-drivable-lane": 0, "agent_compute-ego": 0.19839380238507243, "deviation-heading": 0.8179445990514, "set_robot_commands": 0.08908518907186147, "deviation-center-line": 0.4045264267617618, "driven_lanedir_consec": 0.26504279849886814, "sim_compute_sim_state": 0.03735714345364957, "sim_compute_performance-ego": 0.06460251034917058, "sim_compute_robot_state-ego": 0.06899631023406982}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4684384601869749, "sim_physics": 0.10502446387424942, "survival_time": 6.0499999999999865, "driven_lanedir": 0.4477531320405155, "sim_render-ego": 0.05852276628667658, "in-drivable-lane": 0, "agent_compute-ego": 0.2008962434185438, "deviation-heading": 1.7980735870244908, "set_robot_commands": 0.08639988820414898, "deviation-center-line": 0.44966413762168134, "driven_lanedir_consec": 0.4477531320405155, "sim_compute_sim_state": 0.035696096656736266, "sim_compute_performance-ego": 0.06808819455548751, "sim_compute_robot_state-ego": 0.06851027622695796}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2027844297639856, "sim_physics": 0.10803059260050456, "survival_time": 14.950000000000076, "driven_lanedir": 1.177837187361293, "sim_render-ego": 0.06242657820383707, "in-drivable-lane": 0, "agent_compute-ego": 0.2172111988067627, "deviation-heading": 1.8112094121737237, "set_robot_commands": 0.09331000407536824, "deviation-center-line": 0.7353624172432771, "driven_lanedir_consec": 1.177837187361293, "sim_compute_sim_state": 0.0390433939297994, "sim_compute_performance-ego": 0.06800866921742757, "sim_compute_robot_state-ego": 0.07359510024388631}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4810419481852173, "sim_physics": 0.10395874295915876, "survival_time": 6.299999999999986, "driven_lanedir": 0.4578426505439186, "sim_render-ego": 0.05609900800008622, "in-drivable-lane": 0, "agent_compute-ego": 0.19800470367310535, "deviation-heading": 1.9402531210310952, "set_robot_commands": 0.08482909770238967, "deviation-center-line": 0.4934138003227537, "driven_lanedir_consec": 0.4578426505439186, "sim_compute_sim_state": 0.035686137184264166, "sim_compute_performance-ego": 0.06905620060269795, "sim_compute_robot_state-ego": 0.0680582220592196}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9956764758809086, "sim_physics": 0.1026452972954912, "survival_time": 12.650000000000045, "driven_lanedir": 0.6161863728044286, "sim_render-ego": 0.06071881625963294, "in-drivable-lane": 4.350000000000062, "agent_compute-ego": 0.2131653124164687, "deviation-heading": 1.8595594269002296, "set_robot_commands": 0.09066810909467252, "deviation-center-line": 0.5010265689470553, "driven_lanedir_consec": 0.6161863728044286, "sim_compute_sim_state": 0.03869987382247985, "sim_compute_performance-ego": 0.06749280733553317, "sim_compute_robot_state-ego": 0.07230110413472172}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.28025312636431154, "sim_physics": 0.10193746904783613, "survival_time": 3.949999999999994, "driven_lanedir": 0.27249823287446695, "sim_render-ego": 0.05624683899215505, "in-drivable-lane": 0, "agent_compute-ego": 0.1909859814221346, "deviation-heading": 0.9209015091609934, "set_robot_commands": 0.08535062210469306, "deviation-center-line": 0.4220809791841777, "driven_lanedir_consec": 0.27249823287446695, "sim_compute_sim_state": 0.03780096392088299, "sim_compute_performance-ego": 0.06433557558663283, "sim_compute_robot_state-ego": 0.06886532336850709}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.205281109718533, "sim_physics": 0.11394601901372274, "survival_time": 14.950000000000076, "driven_lanedir": 1.2028575181014998, "sim_render-ego": 0.0611337415377299, "in-drivable-lane": 0, "agent_compute-ego": 0.21416296084721884, "deviation-heading": 0.7095458329423281, "set_robot_commands": 0.0939766279856364, "deviation-center-line": 0.9600869493681972, "driven_lanedir_consec": 1.2028575181014998, "sim_compute_sim_state": 0.03886416912078858, "sim_compute_performance-ego": 0.06733304897944133, "sim_compute_robot_state-ego": 0.0733140206336975}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9932857153906, "sim_physics": 0.11293205618858336, "survival_time": 12.40000000000004, "driven_lanedir": 0.6467151093499586, "sim_render-ego": 0.05872334203412456, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.2015536379429602, "deviation-heading": 2.9544895475948003, "set_robot_commands": 0.08622871771935493, "deviation-center-line": 0.6708993268183443, "driven_lanedir_consec": 0.6467151093499586, "sim_compute_sim_state": 0.0385498462184783, "sim_compute_performance-ego": 0.0654356143166942, "sim_compute_robot_state-ego": 0.07039638296250374}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.2062955102460646, "sim_physics": 0.08524036248524984, "survival_time": 14.950000000000076, "driven_lanedir": 1.1813825200561072, "sim_render-ego": 0.04886703650156657, "in-drivable-lane": 0, "agent_compute-ego": 0.16425865809122722, "deviation-heading": 1.2738045958514146, "set_robot_commands": 0.07012849966684977, "deviation-center-line": 1.0526894092074612, "driven_lanedir_consec": 1.1813825200561072, "sim_compute_sim_state": 0.030510245164235433, "sim_compute_performance-ego": 0.05075741688410441, "sim_compute_robot_state-ego": 0.05895324230194092}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.9938254169584152, "sim_physics": 0.0945235759981217, "survival_time": 12.40000000000004, "driven_lanedir": 0.6523240082563025, "sim_render-ego": 0.05494209835606237, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.1850911234655688, "deviation-heading": 2.9060636747790514, "set_robot_commands": 0.08451469002231475, "deviation-center-line": 0.5953043214119251, "driven_lanedir_consec": 0.6523240082563025, "sim_compute_sim_state": 0.03527496514781829, "sim_compute_performance-ego": 0.06352757253954487, "sim_compute_robot_state-ego": 0.06416554027988065}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7835333983011468, "sim_physics": 0.1110816025853756, "survival_time": 9.950000000000006, "driven_lanedir": 0.6511025943751279, "sim_render-ego": 0.06248449200960859, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.23083465422817212, "deviation-heading": 1.7069568884599495, "set_robot_commands": 0.0959302995672178, "deviation-center-line": 0.49012224054366976, "driven_lanedir_consec": 0.6511025943751279, "sim_compute_sim_state": 0.039972573668513464, "sim_compute_performance-ego": 0.07093000651603967, "sim_compute_robot_state-ego": 0.07887132563183655}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.219699516636652, "sim_physics": 0.1056640068689982, "survival_time": 14.950000000000076, "driven_lanedir": 1.2170036305209848, "sim_render-ego": 0.060714329878489175, "in-drivable-lane": 0, "agent_compute-ego": 0.2106568916638692, "deviation-heading": 0.6958643183991009, "set_robot_commands": 0.09154264052708944, "deviation-center-line": 1.00543246455864, "driven_lanedir_consec": 1.2170036305209848, "sim_compute_sim_state": 0.038620492617289226, "sim_compute_performance-ego": 0.06643505732218424, "sim_compute_robot_state-ego": 0.07066634178161621}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.199587324242512, "sim_physics": 0.1038726274172465, "survival_time": 14.950000000000076, "driven_lanedir": 1.1994392798506217, "sim_render-ego": 0.05982819716135661, "in-drivable-lane": 0, "agent_compute-ego": 0.21203838427861532, "deviation-heading": 0.16792099924859266, "set_robot_commands": 0.08948752482732138, "deviation-center-line": 1.2171177182330184, "driven_lanedir_consec": 1.1994392798506217, "sim_compute_sim_state": 0.038060081799825035, "sim_compute_performance-ego": 0.06710414409637451, "sim_compute_robot_state-ego": 0.07232598622639974}}
set_robot_commands_max0.11570402299325296
set_robot_commands_mean0.09031754993867556
set_robot_commands_median0.08948752482732138
set_robot_commands_min0.07012849966684977
sim_compute_performance-ego_max0.08132659262559545
sim_compute_performance-ego_mean0.06689213943079247
sim_compute_performance-ego_median0.06733304897944133
sim_compute_performance-ego_min0.05075741688410441
sim_compute_robot_state-ego_max0.08697716082174947
sim_compute_robot_state-ego_mean0.07133931154309628
sim_compute_robot_state-ego_median0.07066634178161621
sim_compute_robot_state-ego_min0.05895324230194092
sim_compute_sim_state_max0.04591660799942617
sim_compute_sim_state_mean0.037963004072422715
sim_compute_sim_state_median0.0385498462184783
sim_compute_sim_state_min0.030510245164235433
sim_physics_max0.1396547283713273
sim_physics_mean0.1073811369458578
sim_physics_median0.10517922607628076
sim_physics_min0.08524036248524984
sim_render-ego_max0.07195449157023993
sim_render-ego_mean0.059438790488536064
sim_render-ego_median0.05982819716135661
sim_render-ego_min0.04886703650156657
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.176666666666703
survival_time_min3.699999999999995
208363064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errorno-0:21:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3064/step1-simulation-ip-172-31-42-167-7194-job20836/logs/challenges-runner/stdout.log'
(hidden)
207883064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errorno-0:55:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3064/step1-simulation-ip-172-31-40-253-31940-job20788/logs/challenges-runner/stdout.log'
(hidden)
207143064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationtimeoutno-1:05:04
I can see how the jo [...]
I can see how the job 20714 is timeout because passed 3904 seconds and the timeout is 3600.0.
(hidden)
206473064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessno-0:12:05(hidden)
driven_lanedir_consec_median0.6630877748979029
survival_time_median12.750000000000046
deviation-center-line_median0.5822332463739569
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1230407442365374
agent_compute-ego_mean0.1220982649306498
agent_compute-ego_median0.12233924786249796
agent_compute-ego_min0.12117325235158204
deviation-center-line_max0.9249435797594908
deviation-center-line_mean0.6236141363184236
deviation-center-line_min0.426424765465899
deviation-heading_max3.759461756120242
deviation-heading_mean2.303196999012237
deviation-heading_median1.8232139456992056
deviation-heading_min0.8502747617353257
driven_any_max1.2015746301294352
driven_any_mean0.7907164406678587
driven_any_median0.9959736033100296
driven_any_min0.27602310985282213
driven_lanedir_consec_max1.1767952520842249
driven_lanedir_consec_mean0.6772523759534536
driven_lanedir_consec_min0.2691295605287416
driven_lanedir_max1.1767952520842249
driven_lanedir_mean0.6772523759534536
driven_lanedir_median0.6630877748979029
driven_lanedir_min0.2691295605287416
in-drivable-lane_max3.2000000000000455
in-drivable-lane_mean0.8700000000000123
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.020882655831234, "sim_physics": 0.05992079898715019, "survival_time": 12.800000000000049, "driven_lanedir": 0.6630877748979029, "sim_render-ego": 0.0355042377486825, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.12117325235158204, "deviation-heading": 3.759461756120242, "set_robot_commands": 0.05475017894059419, "deviation-center-line": 0.5822332463739569, "driven_lanedir_consec": 0.6630877748979029, "sim_compute_sim_state": 0.02355692069977522, "sim_compute_performance-ego": 0.03971874713897705, "sim_compute_robot_state-ego": 0.0404807198792696}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9959736033100296, "sim_physics": 0.05655931678472781, "survival_time": 12.750000000000046, "driven_lanedir": 0.8395434223601778, "sim_render-ego": 0.03964063794005151, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.12153600524453556, "deviation-heading": 3.2659474942091373, "set_robot_commands": 0.05586552900426528, "deviation-center-line": 0.9249435797594908, "driven_lanedir_consec": 0.8395434223601778, "sim_compute_sim_state": 0.022666085935106463, "sim_compute_performance-ego": 0.03806858343236587, "sim_compute_robot_state-ego": 0.040146461187624466}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.27602310985282213, "sim_physics": 0.04592225458714869, "survival_time": 3.8499999999999943, "driven_lanedir": 0.2691295605287416, "sim_render-ego": 0.034525248911473655, "in-drivable-lane": 0, "agent_compute-ego": 0.1230407442365374, "deviation-heading": 0.8502747617353257, "set_robot_commands": 0.05448403915801606, "deviation-center-line": 0.426424765465899, "driven_lanedir_consec": 0.2691295605287416, "sim_compute_sim_state": 0.022663518979951933, "sim_compute_performance-ego": 0.038434409475945806, "sim_compute_robot_state-ego": 0.0409230814351664}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45912820421577255, "sim_physics": 0.05773019189594173, "survival_time": 5.949999999999987, "driven_lanedir": 0.4377058698962206, "sim_render-ego": 0.035083157675606866, "in-drivable-lane": 0, "agent_compute-ego": 0.12240207495809605, "deviation-heading": 1.817087037297275, "set_robot_commands": 0.05454229306773979, "deviation-center-line": 0.4414992567500641, "driven_lanedir_consec": 0.4377058698962206, "sim_compute_sim_state": 0.022549258560693564, "sim_compute_performance-ego": 0.03793499249370158, "sim_compute_robot_state-ego": 0.041380116919509505}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2015746301294352, "sim_physics": 0.06231565713882446, "survival_time": 14.950000000000076, "driven_lanedir": 1.1767952520842249, "sim_render-ego": 0.035215243498484296, "in-drivable-lane": 0, "agent_compute-ego": 0.12233924786249796, "deviation-heading": 1.8232139456992056, "set_robot_commands": 0.05537455161412557, "deviation-center-line": 0.7429698332427067, "driven_lanedir_consec": 1.1767952520842249, "sim_compute_sim_state": 0.022664729754130045, "sim_compute_performance-ego": 0.03868120670318603, "sim_compute_robot_state-ego": 0.04025922695795695}}
set_robot_commands_max0.05586552900426528
set_robot_commands_mean0.05500331835694818
set_robot_commands_median0.05475017894059419
set_robot_commands_min0.05448403915801606
sim_compute_performance-ego_max0.03971874713897705
sim_compute_performance-ego_mean0.038567587848835266
sim_compute_performance-ego_median0.038434409475945806
sim_compute_performance-ego_min0.03793499249370158
sim_compute_robot_state-ego_max0.041380116919509505
sim_compute_robot_state-ego_mean0.04063792127590538
sim_compute_robot_state-ego_median0.0404807198792696
sim_compute_robot_state-ego_min0.040146461187624466
sim_compute_sim_state_max0.02355692069977522
sim_compute_sim_state_mean0.022820102785931447
sim_compute_sim_state_median0.022664729754130045
sim_compute_sim_state_min0.022549258560693564
sim_physics_max0.06231565713882446
sim_physics_mean0.05648964387875858
sim_physics_median0.05773019189594173
sim_physics_min0.04592225458714869
sim_render-ego_max0.03964063794005151
sim_render-ego_mean0.035993705154859765
sim_render-ego_median0.035215243498484296
sim_render-ego_min0.034525248911473655
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.06000000000003
survival_time_min3.8499999999999943
206453064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errorno-0:06:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20645-948128', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20645-948128', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20645-948128', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)