AI Driving Olympics Home Challenges Submissions Jobs

Submission 3415

Submission3415
Competingyes
Challengeaido2-LFV-sim-testing
Userjp18813100494
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 22322
Next
User labelRL-TH-shi
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223223415jp18813100494RL-TH-shiaido2-LFV-sim-testingstep1-simulationerroryes-1:02:33
Waited 3603 seconds [...]
Waited 3603 seconds for container to finish. Giving up. 
(hidden)
220853415jp18813100494RL-TH-shiaido2-LFV-sim-testingstep1-simulationsuccessno-0:45:49(hidden)
driven_lanedir_consec_median2.740359892111466
survival_time_median14.950000000000076
deviation-center-line_median0.7800408895956616
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08993169148763021
agent_compute-ego_mean0.08812433000995405
agent_compute-ego_median0.08823757994491442
agent_compute-ego_min0.0872534655812961
deviation-center-line_max1.470050968708605
deviation-center-line_mean0.7866463985974816
deviation-center-line_min0.2823573494699889
deviation-heading_max6.526321405479559
deviation-heading_mean3.067962688472983
deviation-heading_median3.108903064158437
deviation-heading_min0.9460074975644724
driven_any_max4.236000131418521
driven_any_mean2.87584338785656
driven_any_median3.1183848194045822
driven_any_min1.808167426430077
driven_lanedir_consec_max4.179704731448592
driven_lanedir_consec_mean2.73323904718724
driven_lanedir_consec_min1.7612576685320924
driven_lanedir_max4.179704731448592
driven_lanedir_mean2.7350493493262653
driven_lanedir_median2.740359892111466
driven_lanedir_min1.7612576685320924
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean0.39666666666667194
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5200575418645945, "sim_physics": 0.06730771700541179, "survival_time": 14.950000000000076, "driven_lanedir": 2.4740367747784093, "sim_render-ego": 0.03221328894297282, "in-drivable-lane": 0, "agent_compute-ego": 0.08904070536295573, "deviation-heading": 3.1754540985580606, "set_robot_commands": 0.0489687983194987, "deviation-center-line": 0.6419355390102177, "driven_lanedir_consec": 2.4740367747784093, "sim_compute_sim_state": 0.019947276910146076, "sim_compute_performance-ego": 0.03459919214248657, "sim_compute_robot_state-ego": 0.036437185605367024, "sim_compute_robot_state-npc0": 0.03560082991917928, "sim_compute_robot_state-npc1": 0.03552725553512573, "sim_compute_robot_state-npc2": 0.03514618237813314, "sim_compute_robot_state-npc3": 0.03520544687906901}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.3999645692679796, "sim_physics": 0.06957779169082641, "survival_time": 14.950000000000076, "driven_lanedir": 3.3239042600067217, "sim_render-ego": 0.03186943213144938, "in-drivable-lane": 0, "agent_compute-ego": 0.08758206446965536, "deviation-heading": 2.613479733779206, "set_robot_commands": 0.048694523175557454, "deviation-center-line": 0.9034466273098086, "driven_lanedir_consec": 3.3239042600067217, "sim_compute_sim_state": 0.020070414543151855, "sim_compute_performance-ego": 0.035227065086364744, "sim_compute_robot_state-ego": 0.03634625752766927, "sim_compute_robot_state-npc0": 0.03527735074361165, "sim_compute_robot_state-npc1": 0.03537462949752808, "sim_compute_robot_state-npc2": 0.03503454685211182, "sim_compute_robot_state-npc3": 0.035245643456776936}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.1183848194045822, "sim_physics": 0.06684478759765625, "survival_time": 14.950000000000076, "driven_lanedir": 3.0428165378044176, "sim_render-ego": 0.03178830862045288, "in-drivable-lane": 0, "agent_compute-ego": 0.08993169148763021, "deviation-heading": 3.108903064158437, "set_robot_commands": 0.04877912998199463, "deviation-center-line": 0.8934877484328586, "driven_lanedir_consec": 3.0428165378044176, "sim_compute_sim_state": 0.019993420441945395, "sim_compute_performance-ego": 0.03450910806655884, "sim_compute_robot_state-ego": 0.03622483491897583, "sim_compute_robot_state-npc0": 0.03531205972035726, "sim_compute_robot_state-npc1": 0.035506441593170165, "sim_compute_robot_state-npc2": 0.03528985261917114, "sim_compute_robot_state-npc3": 0.03518466552098592}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.281800013616676, "sim_physics": 0.06278892119725545, "survival_time": 14.950000000000076, "driven_lanedir": 2.124738230188137, "sim_render-ego": 0.03166216293970744, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.08768882195154826, "deviation-heading": 6.526321405479559, "set_robot_commands": 0.048389949798583985, "deviation-center-line": 0.7308228798200448, "driven_lanedir_consec": 2.097583698102757, "sim_compute_sim_state": 0.020014103253682455, "sim_compute_performance-ego": 0.03451761245727539, "sim_compute_robot_state-ego": 0.03624631802241007, "sim_compute_robot_state-npc0": 0.035523369312286376, "sim_compute_robot_state-npc1": 0.03551125049591065, "sim_compute_robot_state-npc2": 0.03514280875523885, "sim_compute_robot_state-npc3": 0.03605429172515869}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.143713684486914, "sim_physics": 0.06139916817347209, "survival_time": 14.950000000000076, "driven_lanedir": 3.06253308392597, "sim_render-ego": 0.031501814524332684, "in-drivable-lane": 0, "agent_compute-ego": 0.08781365950902303, "deviation-heading": 3.1568601912893506, "set_robot_commands": 0.04923101743062337, "deviation-center-line": 0.9167030383258492, "driven_lanedir_consec": 3.06253308392597, "sim_compute_sim_state": 0.01991151968638102, "sim_compute_performance-ego": 0.0345574418703715, "sim_compute_robot_state-ego": 0.036292622884114584, "sim_compute_robot_state-npc0": 0.035351807276407875, "sim_compute_robot_state-npc1": 0.03552719036738078, "sim_compute_robot_state-npc2": 0.03518771251042684, "sim_compute_robot_state-npc3": 0.03526329835255941}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.217876555728277, "sim_physics": 0.0631647695719577, "survival_time": 14.45000000000007, "driven_lanedir": 2.9896904372777406, "sim_render-ego": 0.03156389827134287, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.08861513781300052, "deviation-heading": 3.3399258332266983, "set_robot_commands": 0.048428674057693216, "deviation-center-line": 0.979116022870647, "driven_lanedir_consec": 2.9896904372777406, "sim_compute_sim_state": 0.019972300446982203, "sim_compute_performance-ego": 0.034462140093212724, "sim_compute_robot_state-ego": 0.03619712199306818, "sim_compute_robot_state-npc0": 0.035208493368023404, "sim_compute_robot_state-npc1": 0.035646611018989326, "sim_compute_robot_state-npc2": 0.03513249063986808, "sim_compute_robot_state-npc3": 0.0351654575770289}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.317035851169691, "sim_physics": 0.06589252551396688, "survival_time": 14.950000000000076, "driven_lanedir": 2.242726902580886, "sim_render-ego": 0.032102896372477215, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.08841550032297771, "deviation-heading": 3.020065841684868, "set_robot_commands": 0.048499983151753745, "deviation-center-line": 0.8968690172173099, "driven_lanedir_consec": 2.242726902580886, "sim_compute_sim_state": 0.020150724252065023, "sim_compute_performance-ego": 0.03465440670649211, "sim_compute_robot_state-ego": 0.03710055828094482, "sim_compute_robot_state-npc0": 0.035381614367167157, "sim_compute_robot_state-npc1": 0.03545345624287923, "sim_compute_robot_state-npc2": 0.035214746793111165, "sim_compute_robot_state-npc3": 0.03523731708526611}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.54788254537679, "sim_physics": 0.06607006556952177, "survival_time": 6.699999999999984, "driven_lanedir": 2.407332992023061, "sim_render-ego": 0.03166876266251749, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.0872534655812961, "deviation-heading": 1.0046887812874328, "set_robot_commands": 0.0483396960728204, "deviation-center-line": 0.2823573494699889, "driven_lanedir_consec": 2.407332992023061, "sim_compute_sim_state": 0.02000959595637535, "sim_compute_performance-ego": 0.034569766984057074, "sim_compute_robot_state-ego": 0.036598314100237034, "sim_compute_robot_state-npc0": 0.03516929718985486, "sim_compute_robot_state-npc1": 0.03535588997513501, "sim_compute_robot_state-npc2": 0.03535686144188269, "sim_compute_robot_state-npc3": 0.0351564368205284}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 3.1576324194738437, "sim_physics": 0.06977768070929874, "survival_time": 11.300000000000026, "driven_lanedir": 2.740359892111466, "sim_render-ego": 0.031867214008770156, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.08823757994491442, "deviation-heading": 2.581209811322008, "set_robot_commands": 0.04832485608295002, "deviation-center-line": 0.4515073665777241, "driven_lanedir_consec": 2.740359892111466, "sim_compute_sim_state": 0.019885748888539, "sim_compute_performance-ego": 0.03442955228079737, "sim_compute_robot_state-ego": 0.03623316034806513, "sim_compute_robot_state-npc0": 0.03532860553370113, "sim_compute_robot_state-npc1": 0.03545050599933725, "sim_compute_robot_state-npc2": 0.03507699059174124, "sim_compute_robot_state-npc3": 0.0352642356821921}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.236000131418521, "sim_physics": 0.06669496536254883, "survival_time": 14.950000000000076, "driven_lanedir": 4.179704731448592, "sim_render-ego": 0.03179023822148641, "in-drivable-lane": 0, "agent_compute-ego": 0.08726011991500854, "deviation-heading": 2.188666640584591, "set_robot_commands": 0.04842511892318726, "deviation-center-line": 0.7800408895956616, "driven_lanedir_consec": 4.179704731448592, "sim_compute_sim_state": 0.0200472100575765, "sim_compute_performance-ego": 0.034479228655497234, "sim_compute_robot_state-ego": 0.036237067381540936, "sim_compute_robot_state-npc0": 0.0352249550819397, "sim_compute_robot_state-npc1": 0.035341637134552004, "sim_compute_robot_state-npc2": 0.03508593479792277, "sim_compute_robot_state-npc3": 0.035235424836476646}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.171414130999454, "sim_physics": 0.06220913489659627, "survival_time": 14.950000000000076, "driven_lanedir": 2.0531942336333007, "sim_render-ego": 0.03212971687316894, "in-drivable-lane": 0, "agent_compute-ego": 0.08825309197107951, "deviation-heading": 3.89932809492796, "set_robot_commands": 0.048530366420745846, "deviation-center-line": 1.279305837477684, "driven_lanedir_consec": 2.0531942336333007, "sim_compute_sim_state": 0.020024660428365072, "sim_compute_performance-ego": 0.03458314975102743, "sim_compute_robot_state-ego": 0.0364580766359965, "sim_compute_robot_state-npc0": 0.03537415107091268, "sim_compute_robot_state-npc1": 0.035516358216603594, "sim_compute_robot_state-npc2": 0.03515981753667196, "sim_compute_robot_state-npc3": 0.03534543673197428}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 3.183560974161546, "sim_physics": 0.06504631916681926, "survival_time": 14.950000000000076, "driven_lanedir": 2.7187349412054784, "sim_render-ego": 0.03253294308980306, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.08760321855545045, "deviation-heading": 4.108193331179519, "set_robot_commands": 0.048430043856302896, "deviation-center-line": 1.470050968708605, "driven_lanedir_consec": 2.7187349412054784, "sim_compute_sim_state": 0.01990239143371582, "sim_compute_performance-ego": 0.03453938802083333, "sim_compute_robot_state-ego": 0.036297132968902586, "sim_compute_robot_state-npc0": 0.03534536441167196, "sim_compute_robot_state-npc1": 0.03533813794453939, "sim_compute_robot_state-npc2": 0.03499270359675089, "sim_compute_robot_state-npc3": 0.035083601474761965}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.795272493640917, "sim_physics": 0.0634108559290568, "survival_time": 14.950000000000076, "driven_lanedir": 2.7597963155564194, "sim_render-ego": 0.032034698327382406, "in-drivable-lane": 0, "agent_compute-ego": 0.08829577445983887, "deviation-heading": 2.789271529278935, "set_robot_commands": 0.04830876111984253, "deviation-center-line": 0.6338399961207366, "driven_lanedir_consec": 2.7597963155564194, "sim_compute_sim_state": 0.020103603998819983, "sim_compute_performance-ego": 0.03460634311040243, "sim_compute_robot_state-ego": 0.036409948666890464, "sim_compute_robot_state-npc0": 0.035286468664805094, "sim_compute_robot_state-npc1": 0.035434043407440184, "sim_compute_robot_state-npc2": 0.03504975080490112, "sim_compute_robot_state-npc3": 0.0352947990099589}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.2388876608085457, "sim_physics": 0.06614022572835286, "survival_time": 14.950000000000076, "driven_lanedir": 3.1449132388212857, "sim_render-ego": 0.0327782408396403, "in-drivable-lane": 0, "agent_compute-ego": 0.08855470498402913, "deviation-heading": 3.5610644727736513, "set_robot_commands": 0.04867891550064087, "deviation-center-line": 0.635760596770057, "driven_lanedir_consec": 3.1449132388212857, "sim_compute_sim_state": 0.02022583961486817, "sim_compute_performance-ego": 0.03474368174870809, "sim_compute_robot_state-ego": 0.03637624661127726, "sim_compute_robot_state-npc0": 0.03547881523768107, "sim_compute_robot_state-npc1": 0.03569101730982462, "sim_compute_robot_state-npc2": 0.035276565551757816, "sim_compute_robot_state-npc3": 0.03538016557693482}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.808167426430077, "sim_physics": 0.06772529416614109, "survival_time": 5.399999999999989, "driven_lanedir": 1.7612576685320924, "sim_render-ego": 0.03192019021069562, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08731941382090251, "deviation-heading": 0.9460074975644724, "set_robot_commands": 0.048687758269133394, "deviation-center-line": 0.30445210125503297, "driven_lanedir_consec": 1.7612576685320924, "sim_compute_sim_state": 0.020012310257664433, "sim_compute_performance-ego": 0.034865346219804555, "sim_compute_robot_state-ego": 0.03639844832596956, "sim_compute_robot_state-npc0": 0.03554596503575643, "sim_compute_robot_state-npc1": 0.03553531567255656, "sim_compute_robot_state-npc2": 0.03527790307998657, "sim_compute_robot_state-npc3": 0.03532473025498567}}
set_robot_commands_max0.04923101743062337
set_robot_commands_mean0.04858117281075522
set_robot_commands_median0.048499983151753745
set_robot_commands_min0.04830876111984253
sim_compute_performance-ego_max0.035227065086364744
sim_compute_performance-ego_mean0.03462289487959262
sim_compute_performance-ego_median0.034569766984057074
sim_compute_performance-ego_min0.03442955228079737
sim_compute_robot_state-ego_max0.03710055828094482
sim_compute_robot_state-ego_mean0.03639021961809528
sim_compute_robot_state-ego_median0.03634625752766927
sim_compute_robot_state-ego_min0.03619712199306818
sim_compute_robot_state-npc0_max0.03560082991917928
sim_compute_robot_state-npc0_mean0.035360609795557066
sim_compute_robot_state-npc0_median0.03534536441167196
sim_compute_robot_state-npc0_min0.03516929718985486
sim_compute_robot_state-npc1_max0.03569101730982462
sim_compute_robot_state-npc1_mean0.0354806493607315
sim_compute_robot_state-npc1_median0.035506441593170165
sim_compute_robot_state-npc1_min0.03533813794453939
sim_compute_robot_state-npc2_max0.03535686144188269
sim_compute_robot_state-npc2_mean0.03516165786331174
sim_compute_robot_state-npc2_median0.03514618237813314
sim_compute_robot_state-npc2_min0.03499270359675089
sim_compute_robot_state-npc3_max0.03605429172515869
sim_compute_robot_state-npc3_mean0.03529606339897718
sim_compute_robot_state-npc3_median0.035245643456776936
sim_compute_robot_state-npc3_min0.035083601474761965
sim_compute_sim_state_max0.02022583961486817
sim_compute_sim_state_mean0.02001807467801856
sim_compute_sim_state_median0.020012310257664433
sim_compute_sim_state_min0.019885748888539
sim_physics_max0.06977768070929874
sim_physics_mean0.06560334815192549
sim_physics_median0.06607006556952177
sim_physics_min0.06139916817347209
sim_render-ego_max0.0327782408396403
sim_render-ego_mean0.031961587069079984
sim_render-ego_median0.03186943213144938
sim_render-ego_min0.031501814524332684
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.486666666666729
survival_time_min5.399999999999989
220823415jp18813100494RL-TH-shiaido2-LFV-sim-testingstep1-simulationhost-errorno-0:56:48
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22082-823047', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22082-823047', 'down']:

   >  Command '['docker-compose', '-p', 'job22082-823047', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
(hidden)
220653415jp18813100494RL-TH-shiaido2-LFV-sim-testingstep1-simulationhost-errorno-1:01:38
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22065-445612', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22065-445612', 'down']:

   >  Command '['docker-compose', '-p', 'job22065-445612', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
(hidden)
220603415jp18813100494RL-TH-shiaido2-LFV-sim-testingstep1-simulationhost-errorno-0:59:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22060-122958', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22060-122958', 'down']:

   >  Command '['docker-compose', '-p', 'job22060-122958', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
(hidden)