AI Driving Olympics Home Challenges Submissions Jobs

Submission 3065

Submission3065
Competingyes
Challengeaido2-LF-sim-validation
Userawoo424
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 22639
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
User priority50

22639

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
226393065awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessyes-0:19:13(hidden)
driven_lanedir_consec_median0.6656866409578315
survival_time_median12.500000000000044
deviation-center-line_median0.5737017841765135
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2762987094166678
agent_compute-ego_mean0.2510839712351444
agent_compute-ego_median0.2506047407786051
agent_compute-ego_min0.2253457307815552
deviation-center-line_max0.767466606623434
deviation-center-line_mean0.5876338145110176
deviation-center-line_min0.41174842148952034
deviation-heading_max3.683891883563336
deviation-heading_mean2.1667806060200228
deviation-heading_median1.8155446801013535
deviation-heading_min0.8274931740634461
driven_any_max1.202912493143561
driven_any_mean0.7926719940279552
driven_any_median0.9924787975530256
driven_any_min0.27473659216578417
driven_lanedir_consec_max1.177922047403134
driven_lanedir_consec_mean0.6726702317379225
driven_lanedir_consec_min0.26795810676711973
driven_lanedir_max1.177922047403134
driven_lanedir_mean0.6726702317379225
driven_lanedir_median0.6656866409578315
driven_lanedir_min0.26795810676711973
in-drivable-lane_max3.250000000000046
in-drivable-lane_mean0.980000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0247936270904303, "sim_physics": 0.12431348529771144, "survival_time": 12.850000000000048, "driven_lanedir": 0.6656866409578315, "sim_render-ego": 0.07104914104892122, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.2762987094166678, "deviation-heading": 3.683891883563336, "set_robot_commands": 0.10718970168889264, "deviation-center-line": 0.5737017841765135, "driven_lanedir_consec": 0.6656866409578315, "sim_compute_sim_state": 0.0407493773137549, "sim_compute_performance-ego": 0.07409856569906154, "sim_compute_robot_state-ego": 0.0861862206737355}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9924787975530256, "sim_physics": 0.118212459564209, "survival_time": 12.500000000000044, "driven_lanedir": 0.8040312315210123, "sim_render-ego": 0.062088015556335446, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.25002087020874025, "deviation-heading": 2.7088997053474864, "set_robot_commands": 0.1010106725692749, "deviation-center-line": 0.767466606623434, "driven_lanedir_consec": 0.8040312315210123, "sim_compute_sim_state": 0.03941000461578369, "sim_compute_performance-ego": 0.07202931308746338, "sim_compute_robot_state-ego": 0.07624594211578369}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.27473659216578417, "sim_physics": 0.12546847025553384, "survival_time": 3.7499999999999942, "driven_lanedir": 0.26795810676711973, "sim_render-ego": 0.06914704004923503, "in-drivable-lane": 0, "agent_compute-ego": 0.2506047407786051, "deviation-heading": 0.8274931740634461, "set_robot_commands": 0.09625272750854492, "deviation-center-line": 0.41174842148952034, "driven_lanedir_consec": 0.26795810676711973, "sim_compute_sim_state": 0.03957120895385742, "sim_compute_performance-ego": 0.06820454279581706, "sim_compute_robot_state-ego": 0.07804643630981445}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4684384601869749, "sim_physics": 0.1307098471428737, "survival_time": 6.0499999999999865, "driven_lanedir": 0.4477531320405155, "sim_render-ego": 0.06634721480125239, "in-drivable-lane": 0, "agent_compute-ego": 0.25314980499015366, "deviation-heading": 1.7980735870244908, "set_robot_commands": 0.10120408002995264, "deviation-center-line": 0.44966413762168134, "driven_lanedir_consec": 0.4477531320405155, "sim_compute_sim_state": 0.04086342330806512, "sim_compute_performance-ego": 0.07578231874576286, "sim_compute_robot_state-ego": 0.08461610147775697}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.202912493143561, "sim_physics": 0.12177783727645874, "survival_time": 14.950000000000076, "driven_lanedir": 1.177922047403134, "sim_render-ego": 0.0652017052968343, "in-drivable-lane": 0, "agent_compute-ego": 0.2253457307815552, "deviation-heading": 1.8155446801013535, "set_robot_commands": 0.10375556230545044, "deviation-center-line": 0.7355881226439384, "driven_lanedir_consec": 1.177922047403134, "sim_compute_sim_state": 0.04120668570200602, "sim_compute_performance-ego": 0.07164891242980957, "sim_compute_robot_state-ego": 0.07811266501744588}}
set_robot_commands_max0.10718970168889264
set_robot_commands_mean0.10188254882042312
set_robot_commands_median0.10120408002995264
set_robot_commands_min0.09625272750854492
sim_compute_performance-ego_max0.07578231874576286
sim_compute_performance-ego_mean0.07235273055158288
sim_compute_performance-ego_median0.07202931308746338
sim_compute_performance-ego_min0.06820454279581706
sim_compute_robot_state-ego_max0.0861862206737355
sim_compute_robot_state-ego_mean0.0806414731189073
sim_compute_robot_state-ego_median0.07811266501744588
sim_compute_robot_state-ego_min0.07624594211578369
sim_compute_sim_state_max0.04120668570200602
sim_compute_sim_state_mean0.040360139978693435
sim_compute_sim_state_median0.0407493773137549
sim_compute_sim_state_min0.03941000461578369
sim_physics_max0.1307098471428737
sim_physics_mean0.12409641990735734
sim_physics_median0.12431348529771144
sim_physics_min0.118212459564209
sim_render-ego_max0.07104914104892122
sim_render-ego_mean0.06676662335051568
sim_render-ego_median0.06634721480125239
sim_render-ego_min0.062088015556335446
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.02000000000003
survival_time_min3.7499999999999942
208353065awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessno-0:12:57(hidden)
driven_lanedir_consec_median0.6629383268926756
survival_time_median12.700000000000044
deviation-center-line_median0.5473459644450284
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17407262423806938
agent_compute-ego_mean0.17113955839894235
agent_compute-ego_median0.17210254519004525
agent_compute-ego_min0.16534837180492926
deviation-center-line_max0.7868232837400035
deviation-center-line_mean0.5870388647309712
deviation-center-line_min0.4121024677102971
deviation-heading_max3.5535275354952507
deviation-heading_mean2.165103098367824
deviation-heading_median1.8109124871234037
deviation-heading_min0.8270854127767879
driven_any_max1.202479214346167
driven_any_mean0.7911628049473782
driven_any_median0.9941069699268384
driven_any_min0.2746828540026827
driven_lanedir_consec_max1.1775538539597532
driven_lanedir_consec_mean0.6726924534137455
driven_lanedir_consec_min0.2679034079797522
driven_lanedir_max1.1775538539597532
driven_lanedir_mean0.6726924534137455
driven_lanedir_median0.6629383268926756
driven_lanedir_min0.2679034079797522
in-drivable-lane_max3.250000000000046
in-drivable-lane_mean0.980000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0159721166208848, "sim_physics": 0.05344648922190947, "survival_time": 12.750000000000046, "driven_lanedir": 0.6629383268926756, "sim_render-ego": 0.05021414943769866, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.16534837180492926, "deviation-heading": 3.5535275354952507, "set_robot_commands": 0.07223544027291093, "deviation-center-line": 0.5473459644450284, "driven_lanedir_consec": 0.6629383268926756, "sim_compute_sim_state": 0.03355893995247635, "sim_compute_performance-ego": 0.0551303975722369, "sim_compute_robot_state-ego": 0.05735912229500565}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9941069699268384, "sim_physics": 0.05592316060554324, "survival_time": 12.700000000000044, "driven_lanedir": 0.8072673963529114, "sim_render-ego": 0.05097501296696701, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.17210254519004525, "deviation-heading": 2.8321339768451983, "set_robot_commands": 0.07342038567610613, "deviation-center-line": 0.7868232837400035, "driven_lanedir_consec": 0.8072673963529114, "sim_compute_sim_state": 0.035127305609034744, "sim_compute_performance-ego": 0.05662682675939845, "sim_compute_robot_state-ego": 0.05839671581748902}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2746828540026827, "sim_physics": 0.05663710912068685, "survival_time": 3.7499999999999942, "driven_lanedir": 0.2679034079797522, "sim_render-ego": 0.05329803466796875, "in-drivable-lane": 0, "agent_compute-ego": 0.17218555450439454, "deviation-heading": 0.8270854127767879, "set_robot_commands": 0.07337716102600098, "deviation-center-line": 0.4121024677102971, "driven_lanedir_consec": 0.2679034079797522, "sim_compute_sim_state": 0.03487082481384277, "sim_compute_performance-ego": 0.055774351755778, "sim_compute_robot_state-ego": 0.06012227058410644}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4685728698403183, "sim_physics": 0.05562081809871453, "survival_time": 6.0499999999999865, "driven_lanedir": 0.44779928188363494, "sim_render-ego": 0.050145375827127255, "in-drivable-lane": 0, "agent_compute-ego": 0.17407262423806938, "deviation-heading": 1.8018560795984804, "set_robot_commands": 0.0734699166510716, "deviation-center-line": 0.45016597316138546, "driven_lanedir_consec": 0.44779928188363494, "sim_compute_sim_state": 0.033077547372865286, "sim_compute_performance-ego": 0.05606572884173432, "sim_compute_robot_state-ego": 0.057525153987663835}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.202479214346167, "sim_physics": 0.05732285102208456, "survival_time": 14.950000000000076, "driven_lanedir": 1.1775538539597532, "sim_render-ego": 0.051534660657246906, "in-drivable-lane": 0, "agent_compute-ego": 0.17198869625727337, "deviation-heading": 1.8109124871234037, "set_robot_commands": 0.07474360863367717, "deviation-center-line": 0.7387566345981413, "driven_lanedir_consec": 1.1775538539597532, "sim_compute_sim_state": 0.0341858696937561, "sim_compute_performance-ego": 0.05584644714991251, "sim_compute_robot_state-ego": 0.060385445753733315}}
set_robot_commands_max0.07474360863367717
set_robot_commands_mean0.07344930245195336
set_robot_commands_median0.07342038567610613
set_robot_commands_min0.07223544027291093
sim_compute_performance-ego_max0.05662682675939845
sim_compute_performance-ego_mean0.05588875041581204
sim_compute_performance-ego_median0.05584644714991251
sim_compute_performance-ego_min0.0551303975722369
sim_compute_robot_state-ego_max0.060385445753733315
sim_compute_robot_state-ego_mean0.05875774168759965
sim_compute_robot_state-ego_median0.05839671581748902
sim_compute_robot_state-ego_min0.05735912229500565
sim_compute_sim_state_max0.035127305609034744
sim_compute_sim_state_mean0.03416409748839505
sim_compute_sim_state_median0.0341858696937561
sim_compute_sim_state_min0.033077547372865286
sim_physics_max0.05732285102208456
sim_physics_mean0.05579008561378772
sim_physics_median0.05592316060554324
sim_physics_min0.05344648922190947
sim_render-ego_max0.05329803466796875
sim_render-ego_mean0.05123344671140171
sim_render-ego_median0.05097501296696701
sim_render-ego_min0.050145375827127255
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.04000000000003
survival_time_min3.7499999999999942
206483065awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessno-0:15:16(hidden)
driven_lanedir_consec_median0.6623749762212874
survival_time_median12.750000000000046
deviation-center-line_median0.5788750360184303
in-drivable-lane_median0


other stats
agent_compute-ego_max0.20900447745072215
agent_compute-ego_mean0.20275907053338857
agent_compute-ego_median0.2054780391084046
agent_compute-ego_min0.19300666730850935
deviation-center-line_max0.9239127276613286
deviation-center-line_mean0.6213378988325248
deviation-center-line_min0.4193869889866216
deviation-heading_max3.765426729681934
deviation-heading_mean2.301179798304013
deviation-heading_median1.8225408827426393
deviation-heading_min0.8428756741421708
driven_any_max1.2015076002730527
driven_any_mean0.7899787868062503
driven_any_median0.9959595714153124
driven_any_min0.2778629397321094
driven_lanedir_consec_max1.176784079644766
driven_lanedir_consec_mean0.6775635573377883
driven_lanedir_consec_min0.2709337447301774
driven_lanedir_max1.176784079644766
driven_lanedir_mean0.6775635573377883
driven_lanedir_median0.6623749762212874
driven_lanedir_min0.2709337447301774
in-drivable-lane_max3.2000000000000455
in-drivable-lane_mean0.8700000000000123
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0154356183950053, "sim_physics": 0.059852433390915394, "survival_time": 12.800000000000049, "driven_lanedir": 0.6623749762212874, "sim_render-ego": 0.05849688407033682, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.19300666730850935, "deviation-heading": 3.765426729681934, "set_robot_commands": 0.0769646568223834, "deviation-center-line": 0.5788750360184303, "driven_lanedir_consec": 0.6623749762212874, "sim_compute_sim_state": 0.04050634428858757, "sim_compute_performance-ego": 0.06252545304596424, "sim_compute_robot_state-ego": 0.06214663106948137}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9959595714153124, "sim_physics": 0.060721539516074986, "survival_time": 12.750000000000046, "driven_lanedir": 0.8400191161964898, "sim_render-ego": 0.05794808537352319, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.19852222180834003, "deviation-heading": 3.2579686676560446, "set_robot_commands": 0.07798485849417892, "deviation-center-line": 0.9239127276613286, "driven_lanedir_consec": 0.8400191161964898, "sim_compute_sim_state": 0.04113006778791839, "sim_compute_performance-ego": 0.06270426488390156, "sim_compute_robot_state-ego": 0.06256399248160568}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2778629397321094, "sim_physics": 0.0519793661017167, "survival_time": 3.7999999999999945, "driven_lanedir": 0.2709337447301774, "sim_render-ego": 0.06151763702693738, "in-drivable-lane": 0, "agent_compute-ego": 0.20900447745072215, "deviation-heading": 0.8428756741421708, "set_robot_commands": 0.08383670292402569, "deviation-center-line": 0.4193869889866216, "driven_lanedir_consec": 0.2709337447301774, "sim_compute_sim_state": 0.04326695517489785, "sim_compute_performance-ego": 0.06388886037625764, "sim_compute_robot_state-ego": 0.06690643335643567}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45912820421577255, "sim_physics": 0.059263932604749665, "survival_time": 5.949999999999987, "driven_lanedir": 0.4377058698962206, "sim_render-ego": 0.06007902161413882, "in-drivable-lane": 0, "agent_compute-ego": 0.2054780391084046, "deviation-heading": 1.817087037297275, "set_robot_commands": 0.0788849722437498, "deviation-center-line": 0.4414992567500641, "driven_lanedir_consec": 0.4377058698962206, "sim_compute_sim_state": 0.04164769268837296, "sim_compute_performance-ego": 0.06332101541406968, "sim_compute_robot_state-ego": 0.06537546229963544}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2015076002730527, "sim_physics": 0.06574804147084554, "survival_time": 14.950000000000076, "driven_lanedir": 1.176784079644766, "sim_render-ego": 0.05953415314356486, "in-drivable-lane": 0, "agent_compute-ego": 0.2077839469909668, "deviation-heading": 1.8225408827426393, "set_robot_commands": 0.07810805797576904, "deviation-center-line": 0.7430154847461793, "driven_lanedir_consec": 1.176784079644766, "sim_compute_sim_state": 0.0419665265083313, "sim_compute_performance-ego": 0.06405635674794515, "sim_compute_robot_state-ego": 0.06396676143010457}}
set_robot_commands_max0.08383670292402569
set_robot_commands_mean0.07915584969202136
set_robot_commands_median0.07810805797576904
set_robot_commands_min0.0769646568223834
sim_compute_performance-ego_max0.06405635674794515
sim_compute_performance-ego_mean0.06329919009362764
sim_compute_performance-ego_median0.06332101541406968
sim_compute_performance-ego_min0.06252545304596424
sim_compute_robot_state-ego_max0.06690643335643567
sim_compute_robot_state-ego_mean0.06419185612745255
sim_compute_robot_state-ego_median0.06396676143010457
sim_compute_robot_state-ego_min0.06214663106948137
sim_compute_sim_state_max0.04326695517489785
sim_compute_sim_state_mean0.041703517289621614
sim_compute_sim_state_median0.04164769268837296
sim_compute_sim_state_min0.04050634428858757
sim_physics_max0.06574804147084554
sim_physics_mean0.05951306261686044
sim_physics_median0.059852433390915394
sim_physics_min0.0519793661017167
sim_render-ego_max0.06151763702693738
sim_render-ego_mean0.05951515624570022
sim_render-ego_median0.05953415314356486
sim_render-ego_min0.05794808537352319
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.050000000000033
survival_time_min3.7999999999999945
206463065awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationhost-errorno-0:04:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20646-81880', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20646-81880', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20646-81880', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)