AI Driving Olympics Home Challenges Submissions Jobs

Submission 3394

Submission3394
Competingyes
Challengeaido2-LF-sim-validation
Userjp18813100494
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22351
Next
User labelRL-TH-shi
Admin priority50
Blessing50
User priority

22351

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223513394jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessyes-0:20:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9580942832062203
survival_time_median14.950000000000076
deviation-center-line_median0.7458658791569256
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2076577623685201
agent_compute-ego_mean0.2030286332766215
agent_compute-ego_median0.2047239144643148
agent_compute-ego_min0.19764323393503824
deviation-center-line_max1.023673382471781
deviation-center-line_mean0.6848444354748396
deviation-center-line_min0.20332683544087596
deviation-heading_max8.023099931138008
deviation-heading_mean3.473497723059134
deviation-heading_median2.690758828971751
deviation-heading_min0.6766688715232884
driven_any_max3.8516419283770302
driven_any_mean2.6812363612084464
driven_any_median3.0311793853245015
driven_any_min1.4042621928079726
driven_lanedir_consec_max3.7855116979459695
driven_lanedir_consec_mean2.5700077582233662
driven_lanedir_consec_min1.3128463146855465
driven_lanedir_max3.7855116979459695
driven_lanedir_mean2.5761368221128977
driven_lanedir_median2.9580942832062203
driven_lanedir_min1.3128463146855465
in-drivable-lane_max10.700000000000085
in-drivable-lane_mean2.5200000000000222
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6409555350642595, "sim_physics": 0.05988128344217936, "survival_time": 14.950000000000076, "driven_lanedir": 1.4150523617779962, "sim_render-ego": 0.06360970417658487, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.20614188989003496, "deviation-heading": 8.023099931138008, "set_robot_commands": 0.07701700448989868, "deviation-center-line": 0.4899292791251429, "driven_lanedir_consec": 1.3844070423303392, "sim_compute_sim_state": 0.04089578708012899, "sim_compute_performance-ego": 0.06512320121129354, "sim_compute_robot_state-ego": 0.06413845539093017}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.8516419283770302, "sim_physics": 0.059052688280741374, "survival_time": 14.950000000000076, "driven_lanedir": 3.7855116979459695, "sim_render-ego": 0.06123266061147054, "in-drivable-lane": 0, "agent_compute-ego": 0.2076577623685201, "deviation-heading": 2.586852822531656, "set_robot_commands": 0.07706191062927246, "deviation-center-line": 1.023673382471781, "driven_lanedir_consec": 3.7855116979459695, "sim_compute_sim_state": 0.039406883716583255, "sim_compute_performance-ego": 0.06448968569437663, "sim_compute_robot_state-ego": 0.0627082872390747}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.478142764468469, "sim_physics": 0.059412612120310467, "survival_time": 14.950000000000076, "driven_lanedir": 3.409179452948755, "sim_render-ego": 0.06168588399887085, "in-drivable-lane": 0, "agent_compute-ego": 0.19764323393503824, "deviation-heading": 2.690758828971751, "set_robot_commands": 0.078029359181722, "deviation-center-line": 0.7458658791569256, "driven_lanedir_consec": 3.409179452948755, "sim_compute_sim_state": 0.04085077047348022, "sim_compute_performance-ego": 0.06451900800069173, "sim_compute_robot_state-ego": 0.06315929889678955}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0311793853245015, "sim_physics": 0.06110173304875692, "survival_time": 14.950000000000076, "driven_lanedir": 2.9580942832062203, "sim_render-ego": 0.0608803391456604, "in-drivable-lane": 0, "agent_compute-ego": 0.2047239144643148, "deviation-heading": 3.3901081611309674, "set_robot_commands": 0.07733355522155762, "deviation-center-line": 0.9614268011794728, "driven_lanedir_consec": 2.9580942832062203, "sim_compute_sim_state": 0.04094849983851115, "sim_compute_performance-ego": 0.06446659326553345, "sim_compute_robot_state-ego": 0.06303054730097453}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4042621928079726, "sim_physics": 0.058590034643809, "survival_time": 14.950000000000076, "driven_lanedir": 1.3128463146855465, "sim_render-ego": 0.06048910538355509, "in-drivable-lane": 10.700000000000085, "agent_compute-ego": 0.1989763657251994, "deviation-heading": 0.6766688715232884, "set_robot_commands": 0.07689695835113525, "deviation-center-line": 0.20332683544087596, "driven_lanedir_consec": 1.3128463146855465, "sim_compute_sim_state": 0.04017318169275919, "sim_compute_performance-ego": 0.06459432045618693, "sim_compute_robot_state-ego": 0.06171772082646688}}
set_robot_commands_max0.078029359181722
set_robot_commands_mean0.0772677575747172
set_robot_commands_median0.07706191062927246
set_robot_commands_min0.07689695835113525
sim_compute_performance-ego_max0.06512320121129354
sim_compute_performance-ego_mean0.06463856172561647
sim_compute_performance-ego_median0.06451900800069173
sim_compute_performance-ego_min0.06446659326553345
sim_compute_robot_state-ego_max0.06413845539093017
sim_compute_robot_state-ego_mean0.06295086193084717
sim_compute_robot_state-ego_median0.06303054730097453
sim_compute_robot_state-ego_min0.06171772082646688
sim_compute_sim_state_max0.04094849983851115
sim_compute_sim_state_mean0.04045502456029256
sim_compute_sim_state_median0.04085077047348022
sim_compute_sim_state_min0.039406883716583255
sim_physics_max0.06110173304875692
sim_physics_mean0.05960767030715943
sim_physics_median0.059412612120310467
sim_physics_min0.058590034643809
sim_render-ego_max0.06360970417658487
sim_render-ego_mean0.06157953866322835
sim_render-ego_median0.06123266061147054
sim_render-ego_min0.06048910538355509
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
223463394jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationerroryes-0:22:45
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
220223394jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessno-0:10:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0426352992075714
survival_time_median14.950000000000076
deviation-center-line_median0.34251233691000865
in-drivable-lane_median4.550000000000065


other stats
agent_compute-ego_max0.08801611264546712
agent_compute-ego_mean0.08741583395004272
agent_compute-ego_median0.08758956670761109
agent_compute-ego_min0.08659623463948568
deviation-center-line_max0.8079046112670283
deviation-center-line_mean0.4831480515974421
deviation-center-line_min0.262586299460362
deviation-heading_max4.989254393890268
deviation-heading_mean2.507025351952548
deviation-heading_median2.0496350593125
deviation-heading_min0.8641120298490688
driven_any_max3.097029558372008
driven_any_mean2.1484028529815333
driven_any_median2.2426418184423937
driven_any_min1.0992230104148897
driven_lanedir_consec_max3.0259573193892058
driven_lanedir_consec_mean1.9335170000181183
driven_lanedir_consec_min1.0702754332209712
driven_lanedir_max3.0259573193892058
driven_lanedir_mean1.934119707613712
driven_lanedir_median2.0426352992075714
driven_lanedir_min1.0702754332209712
in-drivable-lane_max7.300000000000029
in-drivable-lane_mean3.470000000000021
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.660319976721858, "sim_physics": 0.03750038305918375, "survival_time": 14.950000000000076, "driven_lanedir": 1.471216442756078, "sim_render-ego": 0.03172740379969279, "in-drivable-lane": 4.550000000000065, "agent_compute-ego": 0.08708515485127767, "deviation-heading": 4.989254393890268, "set_robot_commands": 0.04846590042114258, "deviation-center-line": 0.6687807061374607, "driven_lanedir_consec": 1.4682029047781138, "sim_compute_sim_state": 0.019718867937723795, "sim_compute_performance-ego": 0.03442210912704468, "sim_compute_robot_state-ego": 0.03624897003173829}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2426418184423937, "sim_physics": 0.03642845630645752, "survival_time": 14.950000000000076, "driven_lanedir": 2.0605140434947327, "sim_render-ego": 0.03143175363540649, "in-drivable-lane": 7.300000000000029, "agent_compute-ego": 0.08659623463948568, "deviation-heading": 1.679079731548807, "set_robot_commands": 0.04838608662287394, "deviation-center-line": 0.33395630421235073, "driven_lanedir_consec": 2.0605140434947327, "sim_compute_sim_state": 0.01996768871943156, "sim_compute_performance-ego": 0.03491541226704915, "sim_compute_robot_state-ego": 0.037163887023925785}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0992230104148897, "sim_physics": 0.03702168111447935, "survival_time": 4.049999999999994, "driven_lanedir": 1.0702754332209712, "sim_render-ego": 0.031501708207307036, "in-drivable-lane": 0, "agent_compute-ego": 0.08801611264546712, "deviation-heading": 0.8641120298490688, "set_robot_commands": 0.04853677749633789, "deviation-center-line": 0.262586299460362, "driven_lanedir_consec": 1.0702754332209712, "sim_compute_sim_state": 0.02023007251598217, "sim_compute_performance-ego": 0.034812123687179, "sim_compute_robot_state-ego": 0.03609490394592285}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.6427999009565175, "sim_physics": 0.03745193958282471, "survival_time": 14.950000000000076, "driven_lanedir": 2.0426352992075714, "sim_render-ego": 0.031566695372263594, "in-drivable-lane": 5.5000000000000115, "agent_compute-ego": 0.08758956670761109, "deviation-heading": 2.0496350593125, "set_robot_commands": 0.04797614336013794, "deviation-center-line": 0.34251233691000865, "driven_lanedir_consec": 2.0426352992075714, "sim_compute_sim_state": 0.019744215806325276, "sim_compute_performance-ego": 0.03500484943389893, "sim_compute_robot_state-ego": 0.03639957666397095}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.097029558372008, "sim_physics": 0.03744599103927612, "survival_time": 14.950000000000076, "driven_lanedir": 3.0259573193892058, "sim_render-ego": 0.0319326114654541, "in-drivable-lane": 0, "agent_compute-ego": 0.08779210090637207, "deviation-heading": 2.953045545162096, "set_robot_commands": 0.04874683380126953, "deviation-center-line": 0.8079046112670283, "driven_lanedir_consec": 3.0259573193892058, "sim_compute_sim_state": 0.0198406720161438, "sim_compute_performance-ego": 0.03453175624211629, "sim_compute_robot_state-ego": 0.03648512125015259}}
set_robot_commands_max0.04874683380126953
set_robot_commands_mean0.048422348340352375
set_robot_commands_median0.04846590042114258
set_robot_commands_min0.04797614336013794
sim_compute_performance-ego_max0.03500484943389893
sim_compute_performance-ego_mean0.03473725015145761
sim_compute_performance-ego_median0.034812123687179
sim_compute_performance-ego_min0.03442210912704468
sim_compute_robot_state-ego_max0.037163887023925785
sim_compute_robot_state-ego_mean0.03647849178314209
sim_compute_robot_state-ego_median0.03639957666397095
sim_compute_robot_state-ego_min0.03609490394592285
sim_compute_sim_state_max0.02023007251598217
sim_compute_sim_state_mean0.01990030339912132
sim_compute_sim_state_median0.0198406720161438
sim_compute_sim_state_min0.019718867937723795
sim_physics_max0.03750038305918375
sim_physics_mean0.03716969022044429
sim_physics_median0.03744599103927612
sim_physics_min0.03642845630645752
sim_render-ego_max0.0319326114654541
sim_render-ego_mean0.0316320344960248
sim_render-ego_median0.031566695372263594
sim_render-ego_min0.03143175363540649
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.770000000000058
survival_time_min4.049999999999994
220203394jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessno-0:13:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.228988796728535
survival_time_median4.99999999999999
deviation-center-line_median0.21014849265060903
in-drivable-lane_median0.5999999999999988


other stats
agent_compute-ego_max0.1925172472000122
agent_compute-ego_mean0.16585891961869295
agent_compute-ego_median0.158355446656545
agent_compute-ego_min0.15474387407302856
deviation-center-line_max0.620099703515918
deviation-center-line_mean0.3334512646369109
deviation-center-line_min0.08919073275793661
deviation-heading_max3.3584497613551667
deviation-heading_mean1.531663909948714
deviation-heading_median0.8419032070908664
deviation-heading_min0.4680423704955543
driven_any_max3.0627988911667217
driven_any_mean1.5801999567928404
driven_any_median1.2691439909454114
driven_any_min0.9378529815516244
driven_lanedir_consec_max2.97517237889076
driven_lanedir_consec_mean1.3711591624373338
driven_lanedir_consec_min0.684446548623556
driven_lanedir_max2.97517237889076
driven_lanedir_mean1.3711591624373338
driven_lanedir_median1.228988796728535
driven_lanedir_min0.684446548623556
in-drivable-lane_max8.450000000000092
in-drivable-lane_mean2.1300000000000168
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.042138169432424, "sim_physics": 0.10103408833767503, "survival_time": 2.3499999999999996, "driven_lanedir": 0.684446548623556, "sim_render-ego": 0.0616674727581917, "in-drivable-lane": 0.5999999999999988, "agent_compute-ego": 0.16881803248790986, "deviation-heading": 0.4680423704955543, "set_robot_commands": 0.08810022536744462, "deviation-center-line": 0.08919073275793661, "driven_lanedir_consec": 0.684446548623556, "sim_compute_sim_state": 0.036191128669901096, "sim_compute_performance-ego": 0.06653449890461374, "sim_compute_robot_state-ego": 0.07138204574584961}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9378529815516244, "sim_physics": 0.10463715333205004, "survival_time": 3.2499999999999964, "driven_lanedir": 0.7095885991999386, "sim_render-ego": 0.056240133138803335, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15485999767596906, "deviation-heading": 0.8419032070908664, "set_robot_commands": 0.08557619314927321, "deviation-center-line": 0.20249810937415183, "driven_lanedir_consec": 0.7095885991999386, "sim_compute_sim_state": 0.03749209550710825, "sim_compute_performance-ego": 0.061977793620182915, "sim_compute_robot_state-ego": 0.06833973664503831}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2691439909454114, "sim_physics": 0.09371900240580242, "survival_time": 14.950000000000076, "driven_lanedir": 1.228988796728535, "sim_render-ego": 0.05536940336227417, "in-drivable-lane": 8.450000000000092, "agent_compute-ego": 0.158355446656545, "deviation-heading": 2.313266003500952, "set_robot_commands": 0.0874607531229655, "deviation-center-line": 0.5453192848859388, "driven_lanedir_consec": 1.228988796728535, "sim_compute_sim_state": 0.03701972961425781, "sim_compute_performance-ego": 0.06296130975087484, "sim_compute_robot_state-ego": 0.06661859432856242}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.589065750868021, "sim_physics": 0.11059602975845335, "survival_time": 4.99999999999999, "driven_lanedir": 1.2575994887438786, "sim_render-ego": 0.06008260011672974, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1925172472000122, "deviation-heading": 0.6766582073010301, "set_robot_commands": 0.09462101459503174, "deviation-center-line": 0.21014849265060903, "driven_lanedir_consec": 1.2575994887438786, "sim_compute_sim_state": 0.03925408601760864, "sim_compute_performance-ego": 0.06818886041641235, "sim_compute_robot_state-ego": 0.07554686307907105}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0627988911667217, "sim_physics": 0.101566956837972, "survival_time": 14.950000000000076, "driven_lanedir": 2.97517237889076, "sim_render-ego": 0.05671442826588949, "in-drivable-lane": 0, "agent_compute-ego": 0.15474387407302856, "deviation-heading": 3.3584497613551667, "set_robot_commands": 0.08740116834640503, "deviation-center-line": 0.620099703515918, "driven_lanedir_consec": 2.97517237889076, "sim_compute_sim_state": 0.03569706281026205, "sim_compute_performance-ego": 0.06378857215245565, "sim_compute_robot_state-ego": 0.06482274532318115}}
set_robot_commands_max0.09462101459503174
set_robot_commands_mean0.08863187091622401
set_robot_commands_median0.0874607531229655
set_robot_commands_min0.08557619314927321
sim_compute_performance-ego_max0.06818886041641235
sim_compute_performance-ego_mean0.0646902069689079
sim_compute_performance-ego_median0.06378857215245565
sim_compute_performance-ego_min0.061977793620182915
sim_compute_robot_state-ego_max0.07554686307907105
sim_compute_robot_state-ego_mean0.0693419970243405
sim_compute_robot_state-ego_median0.06833973664503831
sim_compute_robot_state-ego_min0.06482274532318115
sim_compute_sim_state_max0.03925408601760864
sim_compute_sim_state_mean0.037130820523827573
sim_compute_sim_state_median0.03701972961425781
sim_compute_sim_state_min0.03569706281026205
sim_physics_max0.11059602975845335
sim_physics_mean0.1023106461343906
sim_physics_median0.101566956837972
sim_physics_min0.09371900240580242
sim_render-ego_max0.0616674727581917
sim_render-ego_mean0.05801480752837769
sim_render-ego_median0.05671442826588949
sim_render-ego_min0.05536940336227417
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.100000000000028
survival_time_min2.3499999999999996
220183394jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationhost-errorno-0:07:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1067, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job22018-976514', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 536, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1072, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job22018-976514', 'down']:

   >  Command '['docker-compose', '-p', 'job22018-976514', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.