AI Driving Olympics Home Challenges Submissions Jobs

Submission 3385

Submission3385
Competingyes
Challengeaido2-LFVI-sim-testing
Userjp18813100494
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 22360
Next
User labelRL-TH-shi
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223603385jp18813100494RL-TH-shiaido2-LFVI-sim-testingstep1-simulationerroryes-0:56:40
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
220263385jp18813100494RL-TH-shiaido2-LFVI-sim-testingstep1-simulationsuccessno-0:52:41(hidden)
driven_lanedir_consec_median2.5568348240715713
survival_time_median14.950000000000076
deviation-center-line_median0.9842076831995794
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0921791172027588
agent_compute-ego_mean0.0881692254278395
agent_compute-ego_median0.08794744412104288
agent_compute-ego_min0.08727410157521566
deviation-center-line_max2.325996943054916
deviation-center-line_mean1.1126488601538993
deviation-center-line_min0.3940249189729459
deviation-heading_max8.668143308507965
deviation-heading_mean4.90742951196059
deviation-heading_median4.801098481850946
deviation-heading_min1.6982043007659424
driven_any_max4.152872756864505
driven_any_mean2.6168024352967456
driven_any_median3.0632217395746273
driven_any_min0.1934517109689615
driven_lanedir_consec_max3.819245546056329
driven_lanedir_consec_mean2.291222762315258
driven_lanedir_consec_min0.18591580645620764
driven_lanedir_max3.819245546056329
driven_lanedir_mean2.440681499448064
driven_lanedir_median2.5873279287600415
driven_lanedir_min0.18591580645620764
in-drivable-lane_max9.150000000000093
in-drivable-lane_mean1.2100000000000135
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 3.2105329471073287, "sim_physics": 0.07534271558125814, "survival_time": 14.950000000000076, "driven_lanedir": 2.6893769361306954, "sim_render-ego": 0.0321250859896342, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.08794744412104288, "deviation-heading": 6.1710229422177365, "set_robot_commands": 0.048592050075531, "deviation-center-line": 0.9842076831995794, "driven_lanedir_consec": 2.6893769361306954, "sim_compute_sim_state": 0.020194621086120607, "sim_compute_performance-ego": 0.03496453762054443, "sim_compute_robot_state-ego": 0.03690500179926554, "sim_compute_robot_state-npc0": 0.03548264980316162, "sim_compute_robot_state-npc1": 0.03581379016240438, "sim_compute_robot_state-npc2": 0.035377055803934736, "sim_compute_robot_state-npc3": 0.035445547103881835}, "udem1-1-0": {"driven_any": 3.39573336955306, "sim_physics": 0.07525456428527832, "survival_time": 14.950000000000076, "driven_lanedir": 3.324704525756386, "sim_render-ego": 0.03225386540095011, "in-drivable-lane": 0, "agent_compute-ego": 0.08843913714090983, "deviation-heading": 3.194009942502011, "set_robot_commands": 0.0481877334912618, "deviation-center-line": 0.90344741789003, "driven_lanedir_consec": 3.324704525756386, "sim_compute_sim_state": 0.02027866760889689, "sim_compute_performance-ego": 0.0349064842859904, "sim_compute_robot_state-ego": 0.037381766637166344, "sim_compute_robot_state-npc0": 0.03535987933476766, "sim_compute_robot_state-npc1": 0.035437228679656985, "sim_compute_robot_state-npc2": 0.03507317384084066, "sim_compute_robot_state-npc3": 0.03524631023406982}, "udem1-2-0": {"driven_any": 1.722229760609462, "sim_physics": 0.07110355297724406, "survival_time": 14.950000000000076, "driven_lanedir": 1.7161455188697228, "sim_render-ego": 0.03193552335103353, "in-drivable-lane": 0, "agent_compute-ego": 0.08810704549153646, "deviation-heading": 8.668143308507965, "set_robot_commands": 0.04824163277943929, "deviation-center-line": 2.325996943054916, "driven_lanedir_consec": 1.716088605007187, "sim_compute_sim_state": 0.020084033012390135, "sim_compute_performance-ego": 0.03492952267328898, "sim_compute_robot_state-ego": 0.03659605662027995, "sim_compute_robot_state-npc0": 0.035578258832295734, "sim_compute_robot_state-npc1": 0.035596375465393064, "sim_compute_robot_state-npc2": 0.035246575673421224, "sim_compute_robot_state-npc3": 0.035391879876454674}, "udem1-3-0": {"driven_any": 3.9208626027253186, "sim_physics": 0.0769841742515564, "survival_time": 14.950000000000076, "driven_lanedir": 3.819245546056329, "sim_render-ego": 0.03214469194412231, "in-drivable-lane": 3.3500000000000476, "agent_compute-ego": 0.0877872347831726, "deviation-heading": 1.831457358433834, "set_robot_commands": 0.04855181535085042, "deviation-center-line": 0.8105762260580995, "driven_lanedir_consec": 3.819245546056329, "sim_compute_sim_state": 0.02033511479695638, "sim_compute_performance-ego": 0.034818080266316734, "sim_compute_robot_state-ego": 0.03737170139948527, "sim_compute_robot_state-npc0": 0.03547821442286173, "sim_compute_robot_state-npc1": 0.03554600477218628, "sim_compute_robot_state-npc2": 0.035244034926096596, "sim_compute_robot_state-npc3": 0.03545828978220622}, "udem1-4-0": {"driven_any": 3.164995831700475, "sim_physics": 0.07428668816884358, "survival_time": 14.950000000000076, "driven_lanedir": 3.0944068513145733, "sim_render-ego": 0.031901888847351074, "in-drivable-lane": 0, "agent_compute-ego": 0.08796047846476238, "deviation-heading": 4.801098481850946, "set_robot_commands": 0.04838266372680664, "deviation-center-line": 1.4455799374407077, "driven_lanedir_consec": 3.094372774566399, "sim_compute_sim_state": 0.020260558128356938, "sim_compute_performance-ego": 0.034932367006937665, "sim_compute_robot_state-ego": 0.03652930100758871, "sim_compute_robot_state-npc0": 0.03540534973144531, "sim_compute_robot_state-npc1": 0.03562006632486979, "sim_compute_robot_state-npc2": 0.03521771589914958, "sim_compute_robot_state-npc3": 0.035403978824615476}, "udem1-5-0": {"driven_any": 3.44355029932036, "sim_physics": 0.07301665623982748, "survival_time": 14.950000000000076, "driven_lanedir": 2.9848361885140617, "sim_render-ego": 0.03207735220591227, "in-drivable-lane": 0.8500000000000068, "agent_compute-ego": 0.08814817190170288, "deviation-heading": 3.912273660822295, "set_robot_commands": 0.04837639411290487, "deviation-center-line": 1.0640748715483292, "driven_lanedir_consec": 2.9848361885140617, "sim_compute_sim_state": 0.020085361003875733, "sim_compute_performance-ego": 0.03479460080464681, "sim_compute_robot_state-ego": 0.03655546506245931, "sim_compute_robot_state-npc0": 0.03550032218297323, "sim_compute_robot_state-npc1": 0.03634010632832845, "sim_compute_robot_state-npc2": 0.03546990235646566, "sim_compute_robot_state-npc3": 0.03542908191680908}, "udem1-6-0": {"driven_any": 1.9394114772912765, "sim_physics": 0.07459924300511678, "survival_time": 14.950000000000076, "driven_lanedir": 1.8983577921167811, "sim_render-ego": 0.032191163698832195, "in-drivable-lane": 9.150000000000093, "agent_compute-ego": 0.08823638121287028, "deviation-heading": 1.6982043007659424, "set_robot_commands": 0.04845329682032267, "deviation-center-line": 0.3940249189729459, "driven_lanedir_consec": 1.607278390369137, "sim_compute_sim_state": 0.020088145732879637, "sim_compute_performance-ego": 0.03488292694091797, "sim_compute_robot_state-ego": 0.03698743104934693, "sim_compute_robot_state-npc0": 0.03564866224924723, "sim_compute_robot_state-npc1": 0.03572154362996419, "sim_compute_robot_state-npc2": 0.035176568031311035, "sim_compute_robot_state-npc3": 0.03553404410680135}, "udem1-7-0": {"driven_any": 2.647913711909802, "sim_physics": 0.07901992321014405, "survival_time": 14.950000000000076, "driven_lanedir": 2.5873279287600415, "sim_render-ego": 0.0321031912167867, "in-drivable-lane": 0, "agent_compute-ego": 0.08779647827148437, "deviation-heading": 3.1507467264645195, "set_robot_commands": 0.04803368091583251, "deviation-center-line": 0.9948243688209562, "driven_lanedir_consec": 2.5568348240715713, "sim_compute_sim_state": 0.02018006960550944, "sim_compute_performance-ego": 0.034576557477315265, "sim_compute_robot_state-ego": 0.03662861267725626, "sim_compute_robot_state-npc0": 0.03546248992284139, "sim_compute_robot_state-npc1": 0.03543647527694702, "sim_compute_robot_state-npc2": 0.03539063851038615, "sim_compute_robot_state-npc3": 0.03529791116714478}, "udem1-8-0": {"driven_any": 0.796326882447237, "sim_physics": 0.07147785902023315, "survival_time": 14.950000000000076, "driven_lanedir": 0.7643457679831825, "sim_render-ego": 0.03205012400945028, "in-drivable-lane": 0, "agent_compute-ego": 0.08727410157521566, "deviation-heading": 8.180152391360823, "set_robot_commands": 0.04840425411860149, "deviation-center-line": 0.4515979619358263, "driven_lanedir_consec": 0.7643457679831825, "sim_compute_sim_state": 0.02007406234741211, "sim_compute_performance-ego": 0.03473004659016927, "sim_compute_robot_state-ego": 0.03660079797108968, "sim_compute_robot_state-npc0": 0.035575772126515706, "sim_compute_robot_state-npc1": 0.035812747478485105, "sim_compute_robot_state-npc2": 0.03519963264465332, "sim_compute_robot_state-npc3": 0.035355019569396975}, "udem1-9-0": {"driven_any": 2.319450590807812, "sim_physics": 0.07692152341206869, "survival_time": 14.950000000000076, "driven_lanedir": 2.3068377726360363, "sim_render-ego": 0.03213379542032878, "in-drivable-lane": 0, "agent_compute-ego": 0.08785440762837728, "deviation-heading": 6.655350780291047, "set_robot_commands": 0.04812584002812703, "deviation-center-line": 2.01539488331347, "driven_lanedir_consec": 1.912411088151354, "sim_compute_sim_state": 0.02010342597961426, "sim_compute_performance-ego": 0.03478985150655111, "sim_compute_robot_state-ego": 0.036866538524627686, "sim_compute_robot_state-npc0": 0.03632333755493164, "sim_compute_robot_state-npc1": 0.035715146859486895, "sim_compute_robot_state-npc2": 0.035268741448720296, "sim_compute_robot_state-npc3": 0.03541739066441854}, "udem1-10-0": {"driven_any": 2.1403197471147504, "sim_physics": 0.07179238637288411, "survival_time": 14.950000000000076, "driven_lanedir": 2.0865119223739828, "sim_render-ego": 0.03168726364771525, "in-drivable-lane": 0, "agent_compute-ego": 0.0880950649579366, "deviation-heading": 8.39052144920566, "set_robot_commands": 0.04772012154261271, "deviation-center-line": 1.1281754271966231, "driven_lanedir_consec": 1.5548773457113534, "sim_compute_sim_state": 0.01999898433685303, "sim_compute_performance-ego": 0.03461027145385742, "sim_compute_robot_state-ego": 0.036745601495107014, "sim_compute_robot_state-npc0": 0.0354212212562561, "sim_compute_robot_state-npc1": 0.03545977512995402, "sim_compute_robot_state-npc2": 0.03510203917821248, "sim_compute_robot_state-npc3": 0.03522681474685669}, "udem1-11-0": {"driven_any": 3.0632217395746273, "sim_physics": 0.0723696502049764, "survival_time": 14.950000000000076, "driven_lanedir": 2.5826026540913127, "sim_render-ego": 0.03210858106613159, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.08739657084147136, "deviation-heading": 2.9718537427468568, "set_robot_commands": 0.047988093694051104, "deviation-center-line": 0.7545721242336999, "driven_lanedir_consec": 2.5825396690172977, "sim_compute_sim_state": 0.02085970322291056, "sim_compute_performance-ego": 0.034632526238759356, "sim_compute_robot_state-ego": 0.03661964257558187, "sim_compute_robot_state-npc0": 0.03537765979766846, "sim_compute_robot_state-npc1": 0.03546741724014282, "sim_compute_robot_state-npc2": 0.03530656655629476, "sim_compute_robot_state-npc3": 0.03548301378885905}, "udem1-12-0": {"driven_any": 3.141163101456208, "sim_physics": 0.07306855916976929, "survival_time": 14.950000000000076, "driven_lanedir": 2.98719099122665, "sim_render-ego": 0.03231151024500529, "in-drivable-lane": 0.7500000000000027, "agent_compute-ego": 0.08774325688680013, "deviation-heading": 5.0961698374565145, "set_robot_commands": 0.04882564147313436, "deviation-center-line": 0.8569580326418648, "driven_lanedir_consec": 1.9932222686659364, "sim_compute_sim_state": 0.02010755936304728, "sim_compute_performance-ego": 0.034709269205729164, "sim_compute_robot_state-ego": 0.03676820755004883, "sim_compute_robot_state-npc0": 0.03568349043528239, "sim_compute_robot_state-npc1": 0.03567619880040487, "sim_compute_robot_state-npc2": 0.03528644959131877, "sim_compute_robot_state-npc3": 0.03538199742635091}, "udem1-13-0": {"driven_any": 0.1934517109689615, "sim_physics": 0.07614664395650228, "survival_time": 14.950000000000076, "driven_lanedir": 0.18591580645620764, "sim_render-ego": 0.03510599613189697, "in-drivable-lane": 0, "agent_compute-ego": 0.0921791172027588, "deviation-heading": 5.072890302061363, "set_robot_commands": 0.05002868890762329, "deviation-center-line": 1.9227687061644148, "driven_lanedir_consec": 0.18591580645620764, "sim_compute_sim_state": 0.02093955914179484, "sim_compute_performance-ego": 0.03605013449986776, "sim_compute_robot_state-ego": 0.03800192912419637, "sim_compute_robot_state-npc0": 0.0370298973719279, "sim_compute_robot_state-npc1": 0.036947959264119465, "sim_compute_robot_state-npc2": 0.036686991850535075, "sim_compute_robot_state-npc3": 0.03700531244277954}, "udem1-14-0": {"driven_any": 4.152872756864505, "sim_physics": 0.07354777256647746, "survival_time": 14.950000000000076, "driven_lanedir": 3.5824162894349927, "sim_render-ego": 0.03217440684636434, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.08757349093755086, "deviation-heading": 3.8175474547213337, "set_robot_commands": 0.04883458852767944, "deviation-center-line": 0.6375333998370268, "driven_lanedir_consec": 3.5822916982717725, "sim_compute_sim_state": 0.020183193683624267, "sim_compute_performance-ego": 0.03480069637298584, "sim_compute_robot_state-ego": 0.036621081034342445, "sim_compute_robot_state-npc0": 0.035409904321034746, "sim_compute_robot_state-npc1": 0.035465978781382246, "sim_compute_robot_state-npc2": 0.03517374833424886, "sim_compute_robot_state-npc3": 0.03525893370310466}}
set_robot_commands_max0.05002868890762329
set_robot_commands_mean0.04844976637098524
set_robot_commands_median0.04838266372680664
set_robot_commands_min0.04772012154261271
sim_compute_performance-ego_max0.03605013449986776
sim_compute_performance-ego_mean0.03487519152959188
sim_compute_performance-ego_median0.03480069637298584
sim_compute_performance-ego_min0.034576557477315265
sim_compute_robot_state-ego_max0.03800192912419637
sim_compute_robot_state-ego_mean0.03687860896852282
sim_compute_robot_state-ego_median0.036745601495107014
sim_compute_robot_state-ego_min0.03652930100758871
sim_compute_robot_state-npc0_max0.0370298973719279
sim_compute_robot_state-npc0_mean0.03564914062288072
sim_compute_robot_state-npc0_median0.03548264980316162
sim_compute_robot_state-npc0_min0.03535987933476766
sim_compute_robot_state-npc1_max0.036947959264119465
sim_compute_robot_state-npc1_mean0.03573712094624837
sim_compute_robot_state-npc1_median0.03562006632486979
sim_compute_robot_state-npc1_min0.03543647527694702
sim_compute_robot_state-npc2_max0.036686991850535075
sim_compute_robot_state-npc2_mean0.03534798897637261
sim_compute_robot_state-npc2_median0.035246575673421224
sim_compute_robot_state-npc2_min0.03507317384084066
sim_compute_robot_state-npc3_max0.03700531244277954
sim_compute_robot_state-npc3_mean0.0354890350235833
sim_compute_robot_state-npc3_median0.035403978824615476
sim_compute_robot_state-npc3_min0.03522681474685669
sim_compute_sim_state_max0.02093955914179484
sim_compute_sim_state_mean0.02025153727001614
sim_compute_sim_state_median0.02018006960550944
sim_compute_sim_state_min0.01999898433685303
sim_physics_max0.07901992321014405
sim_physics_mean0.0743287941614787
sim_physics_median0.07428668816884358
sim_physics_min0.07110355297724406
sim_render-ego_max0.03510599613189697
sim_render-ego_mean0.032286962668100994
sim_render-ego_median0.0321250859896342
sim_render-ego_min0.03168726364771525
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
220103385jp18813100494RL-TH-shiaido2-LFVI-sim-testingstep1-simulationhost-errorno-1:00:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22010-623738', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22010-623738', 'down']:

   >  Command '['docker-compose', '-p', 'job22010-623738', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
(hidden)
220043385jp18813100494RL-TH-shiaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:14:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22004-630120', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22004-630120', 'down']:

   >  Command '['docker-compose', '-p', 'job22004-630120', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
(hidden)