AI Driving Olympics Home Challenges Submissions Jobs

Submission 2450

Submission2450
Competingyes
Challengeaido2-LFVI-sim-testing
Userenicky
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 22966
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
229662450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryes-0:49:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
217472450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerrorno-1:04:08
Waited 3604 seconds [...]
Waited 3604 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
214012450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerrorno-1:04:11
Waited 3600 seconds [...]
Waited 3600 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213972450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:59:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-38-104-5376-job21397/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213922450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:59:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-42-167-7357-job21392/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213862450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:59:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-38-104-5317-job21386/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213692450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:47:46
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-40-253-32125-job21369/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213362450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:59:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-25-98-2062-job21336/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213172450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:56:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-38-104-5197-job21317/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212882450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:56:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-25-98-2470-job21288/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212632450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:29:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-42-167-7194-job21263/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
205552450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessno-0:36:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3401138062222346
survival_time_median14.950000000000076
deviation-center-line_median1.0020906406379184
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.16174415508906043
agent_compute-ego_mean0.15938228130340576
agent_compute-ego_median0.1594925864537557
agent_compute-ego_min0.15699501355489096
deviation-center-line_max1.5200592903810726
deviation-center-line_mean0.9234183234449912
deviation-center-line_min0.28265732013386635
deviation-heading_max8.488415384770875
deviation-heading_mean7.083018992579007
deviation-heading_median7.089126128887597
deviation-heading_min5.694184625828925
driven_any_max4.378320939674843
driven_any_mean4.378320939674839
driven_any_median4.378320939674839
driven_any_min4.378320939674832
driven_lanedir_consec_max-1.2731239579032123
driven_lanedir_consec_mean-1.331671690718409
driven_lanedir_consec_min-1.3673592918445536
driven_lanedir_max-1.366645308459499
driven_lanedir_mean-2.07783178706321
driven_lanedir_median-2.2611460594308452
driven_lanedir_min-2.711272030505655
in-drivable-lane_max7.400000000000039
in-drivable-lane_mean4.630000000000026
in-drivable-lane_min2.150000000000011
per-episodes
details{"udem1-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.19731568336486816, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272030505655, "sim_render-ego": 0.05951244592666626, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16005189736684164, "deviation-heading": 8.371542541054898, "set_robot_commands": 0.09191433350245158, "deviation-center-line": 1.5194332899756515, "driven_lanedir_consec": -1.3111160891625455, "sim_compute_sim_state": 0.03795253117879232, "sim_compute_performance-ego": 0.06452972968419393, "sim_compute_robot_state-ego": 0.06895569006601969, "sim_compute_robot_state-npc0": 0.0674901779492696, "sim_compute_robot_state-npc1": 0.06580619653066, "sim_compute_robot_state-npc2": 0.06489685694376628, "sim_compute_robot_state-npc3": 0.06602426052093506}, "udem1-1-0": {"driven_any": 4.378320939674842, "sim_physics": 0.2091931406656901, "survival_time": 14.950000000000076, "driven_lanedir": -2.682736245075499, "sim_render-ego": 0.06061723391215006, "in-drivable-lane": 2.2000000000000113, "agent_compute-ego": 0.15862775405248006, "deviation-heading": 8.488415384770875, "set_robot_commands": 0.09201850255330404, "deviation-center-line": 1.5200592903810726, "driven_lanedir_consec": -1.2731239579032123, "sim_compute_sim_state": 0.03865094582239787, "sim_compute_performance-ego": 0.06677956660588583, "sim_compute_robot_state-ego": 0.0693455449740092, "sim_compute_robot_state-npc0": 0.06725589911142985, "sim_compute_robot_state-npc1": 0.06646379868189493, "sim_compute_robot_state-npc2": 0.06552303393681844, "sim_compute_robot_state-npc3": 0.066727614402771}, "udem1-2-0": {"driven_any": 4.378320939674832, "sim_physics": 0.19589363177617392, "survival_time": 14.950000000000076, "driven_lanedir": -1.366645308459499, "sim_render-ego": 0.05982870578765869, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.15699501355489096, "deviation-heading": 5.771826282352732, "set_robot_commands": 0.09169785261154174, "deviation-center-line": 0.2928510760964476, "driven_lanedir_consec": -1.366645308459499, "sim_compute_sim_state": 0.03711856444676717, "sim_compute_performance-ego": 0.06597498178482056, "sim_compute_robot_state-ego": 0.06988596439361572, "sim_compute_robot_state-npc0": 0.06580821673075359, "sim_compute_robot_state-npc1": 0.06703041156133016, "sim_compute_robot_state-npc2": 0.06641181071599324, "sim_compute_robot_state-npc3": 0.0656856377919515}, "udem1-3-0": {"driven_any": 4.378320939674839, "sim_physics": 0.20104711612065632, "survival_time": 14.950000000000076, "driven_lanedir": -1.3673592918445536, "sim_render-ego": 0.06074178298314412, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.16174415508906043, "deviation-heading": 5.694184625828925, "set_robot_commands": 0.09073220173517862, "deviation-center-line": 0.28265732013386635, "driven_lanedir_consec": -1.3673592918445536, "sim_compute_sim_state": 0.037414021492004394, "sim_compute_performance-ego": 0.06485916296641032, "sim_compute_robot_state-ego": 0.06981304963429769, "sim_compute_robot_state-npc0": 0.06554241180419922, "sim_compute_robot_state-npc1": 0.06683822472890218, "sim_compute_robot_state-npc2": 0.06652715126673381, "sim_compute_robot_state-npc3": 0.06650982936223349}, "udem1-4-0": {"driven_any": 4.378320939674835, "sim_physics": 0.19979225794474284, "survival_time": 14.950000000000076, "driven_lanedir": -2.2611460594308452, "sim_render-ego": 0.06055862744649251, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.1594925864537557, "deviation-heading": 7.089126128887597, "set_robot_commands": 0.0904445473353068, "deviation-center-line": 1.0020906406379184, "driven_lanedir_consec": -1.3401138062222346, "sim_compute_sim_state": 0.03771708806355794, "sim_compute_performance-ego": 0.06381249745686848, "sim_compute_robot_state-ego": 0.06672102292378744, "sim_compute_robot_state-npc0": 0.06511565287907918, "sim_compute_robot_state-npc1": 0.06627665837605794, "sim_compute_robot_state-npc2": 0.06589659929275513, "sim_compute_robot_state-npc3": 0.06699304342269898}}
set_robot_commands_max0.09201850255330404
set_robot_commands_mean0.09136148754755656
set_robot_commands_median0.09169785261154174
set_robot_commands_min0.0904445473353068
sim_compute_performance-ego_max0.06677956660588583
sim_compute_performance-ego_mean0.06519118769963583
sim_compute_performance-ego_median0.06485916296641032
sim_compute_performance-ego_min0.06381249745686848
sim_compute_robot_state-ego_max0.06988596439361572
sim_compute_robot_state-ego_mean0.06894425439834595
sim_compute_robot_state-ego_median0.0693455449740092
sim_compute_robot_state-ego_min0.06672102292378744
sim_compute_robot_state-npc0_max0.0674901779492696
sim_compute_robot_state-npc0_mean0.06624247169494629
sim_compute_robot_state-npc0_median0.06580821673075359
sim_compute_robot_state-npc0_min0.06511565287907918
sim_compute_robot_state-npc1_max0.06703041156133016
sim_compute_robot_state-npc1_mean0.06648305797576905
sim_compute_robot_state-npc1_median0.06646379868189493
sim_compute_robot_state-npc1_min0.06580619653066
sim_compute_robot_state-npc2_max0.06652715126673381
sim_compute_robot_state-npc2_mean0.06585109043121337
sim_compute_robot_state-npc2_median0.06589659929275513
sim_compute_robot_state-npc2_min0.06489685694376628
sim_compute_robot_state-npc3_max0.06699304342269898
sim_compute_robot_state-npc3_mean0.066388077100118
sim_compute_robot_state-npc3_median0.06650982936223349
sim_compute_robot_state-npc3_min0.0656856377919515
sim_compute_sim_state_max0.03865094582239787
sim_compute_sim_state_mean0.03777063020070394
sim_compute_sim_state_median0.03771708806355794
sim_compute_sim_state_min0.03711856444676717
sim_physics_max0.2091931406656901
sim_physics_mean0.2006483659744263
sim_physics_median0.19979225794474284
sim_physics_min0.19589363177617392
sim_render-ego_max0.06074178298314412
sim_render-ego_mean0.06025175921122232
sim_render-ego_median0.06055862744649251
sim_render-ego_min0.05951244592666626
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
199992450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessno-0:26:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3392996564499584
survival_time_median14.950000000000076
deviation-center-line_median0.9344958139419292
in-drivable-lane_median4.500000000000025


other stats
agent_compute-ego_max0.17846154769261677
agent_compute-ego_mean0.17059843031565347
agent_compute-ego_median0.16862079222997028
agent_compute-ego_min0.168127810160319
deviation-center-line_max1.52285369632223
deviation-center-line_mean0.9107937560811784
deviation-center-line_min0.2888337286318359
deviation-heading_max8.447870280266974
deviation-heading_mean7.028470170620348
deviation-heading_median6.6042810524033575
deviation-heading_min5.826897253480866
driven_any_max4.39082415278494
driven_any_mean4.390824152784926
driven_any_median4.390824152784926
driven_any_min4.390824152784916
driven_lanedir_consec_max-1.2821046138102197
driven_lanedir_consec_mean-1.3306279130927372
driven_lanedir_consec_min-1.369992228000605
driven_lanedir_max-1.3693900599336288
driven_lanedir_mean-2.0685654579561628
driven_lanedir_median-2.2132574606281774
driven_lanedir_min-2.705004190282363
in-drivable-lane_max7.35000000000004
in-drivable-lane_mean4.7200000000000255
in-drivable-lane_min2.1500000000000115
per-episodes
details{"udem1-0-0": {"driven_any": 4.390824152784916, "sim_physics": 0.029306702613830567, "survival_time": 14.950000000000076, "driven_lanedir": -2.705004190282363, "sim_render-ego": 0.06551725228627522, "in-drivable-lane": 2.1500000000000115, "agent_compute-ego": 0.17846154769261677, "deviation-heading": 8.435502739091172, "set_robot_commands": 0.07824103116989135, "deviation-center-line": 1.52285369632223, "driven_lanedir_consec": -1.2923530072692753, "sim_compute_sim_state": 0.03800439516703288, "sim_compute_performance-ego": 0.06633072932561239, "sim_compute_robot_state-ego": 0.06523234446843465, "sim_compute_robot_state-npc0": 0.07451892852783203, "sim_compute_robot_state-npc1": 0.06783440430959066, "sim_compute_robot_state-npc2": 0.0673433518409729, "sim_compute_robot_state-npc3": 0.06628722190856934}, "udem1-1-0": {"driven_any": 4.390824152784932, "sim_physics": 0.029661563237508137, "survival_time": 14.950000000000076, "driven_lanedir": -2.685183350936039, "sim_render-ego": 0.06555444002151489, "in-drivable-lane": 2.2500000000000115, "agent_compute-ego": 0.16943524916966757, "deviation-heading": 8.447870280266974, "set_robot_commands": 0.0777505628267924, "deviation-center-line": 1.514088673836754, "driven_lanedir_consec": -1.2821046138102197, "sim_compute_sim_state": 0.03765744209289551, "sim_compute_performance-ego": 0.06695671955744426, "sim_compute_robot_state-ego": 0.0652461568514506, "sim_compute_robot_state-npc0": 0.07571114142735799, "sim_compute_robot_state-npc1": 0.06903349081675211, "sim_compute_robot_state-npc2": 0.06755528529485066, "sim_compute_robot_state-npc3": 0.06701768557230632}, "udem1-2-0": {"driven_any": 4.390824152784919, "sim_physics": 0.028274525006612143, "survival_time": 14.950000000000076, "driven_lanedir": -1.369992228000605, "sim_render-ego": 0.06278244018554688, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16862079222997028, "deviation-heading": 5.826897253480866, "set_robot_commands": 0.07759477297465006, "deviation-center-line": 0.2936968676731421, "driven_lanedir_consec": -1.369992228000605, "sim_compute_sim_state": 0.03587281068166097, "sim_compute_performance-ego": 0.06459477663040161, "sim_compute_robot_state-ego": 0.0646851897239685, "sim_compute_robot_state-npc0": 0.07457156181335449, "sim_compute_robot_state-npc1": 0.0688131054242452, "sim_compute_robot_state-npc2": 0.06565423727035523, "sim_compute_robot_state-npc3": 0.06477109750111898}, "udem1-3-0": {"driven_any": 4.390824152784926, "sim_physics": 0.02734900156656901, "survival_time": 14.950000000000076, "driven_lanedir": -1.3693900599336288, "sim_render-ego": 0.05921582142512004, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16834675232569377, "deviation-heading": 5.827799527859374, "set_robot_commands": 0.0747737209002177, "deviation-center-line": 0.2888337286318359, "driven_lanedir_consec": -1.3693900599336288, "sim_compute_sim_state": 0.03342835744222005, "sim_compute_performance-ego": 0.06000104268391927, "sim_compute_robot_state-ego": 0.060700084368387856, "sim_compute_robot_state-npc0": 0.06798364321390787, "sim_compute_robot_state-npc1": 0.06141696850458781, "sim_compute_robot_state-npc2": 0.059776429335276285, "sim_compute_robot_state-npc3": 0.060068453152974446}, "udem1-4-0": {"driven_any": 4.39082415278494, "sim_physics": 0.026839214960734048, "survival_time": 14.950000000000076, "driven_lanedir": -2.2132574606281774, "sim_render-ego": 0.05672343095143636, "in-drivable-lane": 4.500000000000025, "agent_compute-ego": 0.168127810160319, "deviation-heading": 6.6042810524033575, "set_robot_commands": 0.07522224982579549, "deviation-center-line": 0.9344958139419292, "driven_lanedir_consec": -1.3392996564499584, "sim_compute_sim_state": 0.03302095095316569, "sim_compute_performance-ego": 0.059232280254364014, "sim_compute_robot_state-ego": 0.06167084534962972, "sim_compute_robot_state-npc0": 0.0649360990524292, "sim_compute_robot_state-npc1": 0.06044568538665771, "sim_compute_robot_state-npc2": 0.059548144340515134, "sim_compute_robot_state-npc3": 0.05977131525675456}}
set_robot_commands_max0.07824103116989135
set_robot_commands_mean0.0767164675394694
set_robot_commands_median0.07759477297465006
set_robot_commands_min0.0747737209002177
sim_compute_performance-ego_max0.06695671955744426
sim_compute_performance-ego_mean0.06342310969034831
sim_compute_performance-ego_median0.06459477663040161
sim_compute_performance-ego_min0.059232280254364014
sim_compute_robot_state-ego_max0.0652461568514506
sim_compute_robot_state-ego_mean0.06350692415237427
sim_compute_robot_state-ego_median0.0646851897239685
sim_compute_robot_state-ego_min0.060700084368387856
sim_compute_robot_state-npc0_max0.07571114142735799
sim_compute_robot_state-npc0_mean0.07154427480697631
sim_compute_robot_state-npc0_median0.07451892852783203
sim_compute_robot_state-npc0_min0.0649360990524292
sim_compute_robot_state-npc1_max0.06903349081675211
sim_compute_robot_state-npc1_mean0.0655087308883667
sim_compute_robot_state-npc1_median0.06783440430959066
sim_compute_robot_state-npc1_min0.06044568538665771
sim_compute_robot_state-npc2_max0.06755528529485066
sim_compute_robot_state-npc2_mean0.06397548961639404
sim_compute_robot_state-npc2_median0.06565423727035523
sim_compute_robot_state-npc2_min0.059548144340515134
sim_compute_robot_state-npc3_max0.06701768557230632
sim_compute_robot_state-npc3_mean0.06358315467834472
sim_compute_robot_state-npc3_median0.06477109750111898
sim_compute_robot_state-npc3_min0.05977131525675456
sim_compute_sim_state_max0.03800439516703288
sim_compute_sim_state_mean0.035596791267395025
sim_compute_sim_state_median0.03587281068166097
sim_compute_sim_state_min0.03302095095316569
sim_physics_max0.029661563237508137
sim_physics_mean0.028286201477050774
sim_physics_median0.028274525006612143
sim_physics_min0.026839214960734048
sim_render-ego_max0.06555444002151489
sim_render-ego_mean0.06195867697397868
sim_render-ego_median0.06278244018554688
sim_render-ego_min0.05672343095143636
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
197972450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessno-0:29:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3392996564499584
survival_time_median14.950000000000076
deviation-center-line_median0.9344958139419292
in-drivable-lane_median4.500000000000025


other stats
agent_compute-ego_max0.17003745794296266
agent_compute-ego_mean0.1537764121691386
agent_compute-ego_median0.15189086278279623
agent_compute-ego_min0.1450239888827006
deviation-center-line_max1.52285369632223
deviation-center-line_mean0.9107937560811784
deviation-center-line_min0.2888337286318359
deviation-heading_max8.447870280266974
deviation-heading_mean7.028470170620348
deviation-heading_median6.6042810524033575
deviation-heading_min5.826897253480866
driven_any_max4.39082415278494
driven_any_mean4.390824152784926
driven_any_median4.390824152784926
driven_any_min4.390824152784916
driven_lanedir_consec_max-1.2821046138102197
driven_lanedir_consec_mean-1.3306279130927372
driven_lanedir_consec_min-1.369992228000605
driven_lanedir_max-1.3693900599336288
driven_lanedir_mean-2.0685654579561628
driven_lanedir_median-2.2132574606281774
driven_lanedir_min-2.705004190282363
in-drivable-lane_max7.35000000000004
in-drivable-lane_mean4.7200000000000255
in-drivable-lane_min2.1500000000000115
per-episodes
details{"udem1-0-0": {"driven_any": 4.390824152784916, "sim_physics": 0.03942030429840088, "survival_time": 14.950000000000076, "driven_lanedir": -2.705004190282363, "sim_render-ego": 0.05718074242273966, "in-drivable-lane": 2.1500000000000115, "agent_compute-ego": 0.15267003138860066, "deviation-heading": 8.435502739091172, "set_robot_commands": 0.08730892817179361, "deviation-center-line": 1.52285369632223, "driven_lanedir_consec": -1.2923530072692753, "sim_compute_sim_state": 0.035625504652659096, "sim_compute_performance-ego": 0.0614979362487793, "sim_compute_robot_state-ego": 0.06697970787684122, "sim_compute_robot_state-npc0": 0.06187514861424764, "sim_compute_robot_state-npc1": 0.06207930564880371, "sim_compute_robot_state-npc2": 0.06206384499867757, "sim_compute_robot_state-npc3": 0.061279510656992595}, "udem1-1-0": {"driven_any": 4.390824152784932, "sim_physics": 0.03762932936350505, "survival_time": 14.950000000000076, "driven_lanedir": -2.685183350936039, "sim_render-ego": 0.05723930835723877, "in-drivable-lane": 2.2500000000000115, "agent_compute-ego": 0.14925971984863282, "deviation-heading": 8.447870280266974, "set_robot_commands": 0.08485250393549601, "deviation-center-line": 1.514088673836754, "driven_lanedir_consec": -1.2821046138102197, "sim_compute_sim_state": 0.03612425645192464, "sim_compute_performance-ego": 0.06122905731201172, "sim_compute_robot_state-ego": 0.06312606493631999, "sim_compute_robot_state-npc0": 0.06078939358393351, "sim_compute_robot_state-npc1": 0.06073633035024007, "sim_compute_robot_state-npc2": 0.0606175963083903, "sim_compute_robot_state-npc3": 0.06032084782918294}, "udem1-2-0": {"driven_any": 4.390824152784919, "sim_physics": 0.038946159680684406, "survival_time": 14.950000000000076, "driven_lanedir": -1.369992228000605, "sim_render-ego": 0.055572144985198975, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.15189086278279623, "deviation-heading": 5.826897253480866, "set_robot_commands": 0.08473602533340455, "deviation-center-line": 0.2936968676731421, "driven_lanedir_consec": -1.369992228000605, "sim_compute_sim_state": 0.03401650110880534, "sim_compute_performance-ego": 0.0594077730178833, "sim_compute_robot_state-ego": 0.06271220366160075, "sim_compute_robot_state-npc0": 0.06284408966700236, "sim_compute_robot_state-npc1": 0.06181308110555013, "sim_compute_robot_state-npc2": 0.06115705013275147, "sim_compute_robot_state-npc3": 0.060576598644256595}, "udem1-3-0": {"driven_any": 4.390824152784926, "sim_physics": 0.03570496241251628, "survival_time": 14.950000000000076, "driven_lanedir": -1.3693900599336288, "sim_render-ego": 0.05393695831298828, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.1450239888827006, "deviation-heading": 5.827799527859374, "set_robot_commands": 0.08003031730651855, "deviation-center-line": 0.2888337286318359, "driven_lanedir_consec": -1.3693900599336288, "sim_compute_sim_state": 0.03316582123438517, "sim_compute_performance-ego": 0.05671008904774984, "sim_compute_robot_state-ego": 0.06054834445317586, "sim_compute_robot_state-npc0": 0.05739636262257894, "sim_compute_robot_state-npc1": 0.05705735524495443, "sim_compute_robot_state-npc2": 0.05860085090001424, "sim_compute_robot_state-npc3": 0.06132194598515829}, "udem1-4-0": {"driven_any": 4.39082415278494, "sim_physics": 0.03402364412943522, "survival_time": 14.950000000000076, "driven_lanedir": -2.2132574606281774, "sim_render-ego": 0.05054777304331461, "in-drivable-lane": 4.500000000000025, "agent_compute-ego": 0.17003745794296266, "deviation-heading": 6.6042810524033575, "set_robot_commands": 0.07849796851476033, "deviation-center-line": 0.9344958139419292, "driven_lanedir_consec": -1.3392996564499584, "sim_compute_sim_state": 0.03175713300704956, "sim_compute_performance-ego": 0.05447705984115601, "sim_compute_robot_state-ego": 0.060229755242665606, "sim_compute_robot_state-npc0": 0.05831063508987427, "sim_compute_robot_state-npc1": 0.056415402094523115, "sim_compute_robot_state-npc2": 0.05597146034240723, "sim_compute_robot_state-npc3": 0.05581064144770304}}
set_robot_commands_max0.08730892817179361
set_robot_commands_mean0.08308514865239461
set_robot_commands_median0.08473602533340455
set_robot_commands_min0.07849796851476033
sim_compute_performance-ego_max0.0614979362487793
sim_compute_performance-ego_mean0.05866438309351603
sim_compute_performance-ego_median0.0594077730178833
sim_compute_performance-ego_min0.05447705984115601
sim_compute_robot_state-ego_max0.06697970787684122
sim_compute_robot_state-ego_mean0.06271921523412069
sim_compute_robot_state-ego_median0.06271220366160075
sim_compute_robot_state-ego_min0.060229755242665606
sim_compute_robot_state-npc0_max0.06284408966700236
sim_compute_robot_state-npc0_mean0.06024312591552734
sim_compute_robot_state-npc0_median0.06078939358393351
sim_compute_robot_state-npc0_min0.05739636262257894
sim_compute_robot_state-npc1_max0.06207930564880371
sim_compute_robot_state-npc1_mean0.05962029488881428
sim_compute_robot_state-npc1_median0.06073633035024007
sim_compute_robot_state-npc1_min0.056415402094523115
sim_compute_robot_state-npc2_max0.06206384499867757
sim_compute_robot_state-npc2_mean0.05968216053644816
sim_compute_robot_state-npc2_median0.0606175963083903
sim_compute_robot_state-npc2_min0.05597146034240723
sim_compute_robot_state-npc3_max0.06132194598515829
sim_compute_robot_state-npc3_mean0.05986190891265869
sim_compute_robot_state-npc3_median0.060576598644256595
sim_compute_robot_state-npc3_min0.05581064144770304
sim_compute_sim_state_max0.03612425645192464
sim_compute_sim_state_mean0.03413784329096477
sim_compute_sim_state_median0.03401650110880534
sim_compute_sim_state_min0.03175713300704956
sim_physics_max0.03942030429840088
sim_physics_mean0.037144879976908365
sim_physics_median0.03762932936350505
sim_physics_min0.03402364412943522
sim_render-ego_max0.05723930835723877
sim_render-ego_mean0.05489538542429606
sim_render-ego_median0.055572144985198975
sim_render-ego_min0.05054777304331461
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
196262450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessno-0:28:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3614573264245535
survival_time_median14.950000000000076
deviation-center-line_median1.0119696714086834
in-drivable-lane_median4.050000000000022


other stats
agent_compute-ego_max0.1584927654266357
agent_compute-ego_mean0.1528042116165161
agent_compute-ego_median0.15725028435389202
agent_compute-ego_min0.14363507350285848
deviation-center-line_max1.0119699909612991
deviation-center-line_mean1.0119697191394268
deviation-center-line_min1.0119693200897382
deviation-heading_max6.81542792438532
deviation-heading_mean6.815427924385318
deviation-heading_median6.815427924385318
deviation-heading_min6.815427924385317
driven_any_max4.390824152784938
driven_any_mean4.3908241527849325
driven_any_median4.3908241527849325
driven_any_min4.390824152784927
driven_lanedir_consec_max-1.361452200425545
driven_lanedir_consec_mean-1.3614579701548792
driven_lanedir_consec_min-1.3614641213545289
driven_lanedir_max-2.315814608416598
driven_lanedir_mean-2.3158170164441083
driven_lanedir_median-2.3158169926021728
driven_lanedir_min-2.315819376788188
in-drivable-lane_max4.050000000000022
in-drivable-lane_mean4.050000000000022
in-drivable-lane_min4.050000000000022
per-episodes
details{"udem1-0-0": {"driven_any": 4.390824152784927, "sim_physics": 0.03811277071634928, "survival_time": 14.950000000000076, "driven_lanedir": -2.315816992602138, "sim_render-ego": 0.056113093694051104, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.15725028435389202, "deviation-heading": 6.815427924385318, "set_robot_commands": 0.0867177144686381, "deviation-center-line": 1.0119693200897382, "driven_lanedir_consec": -1.361457326424502, "sim_compute_sim_state": 0.03489411354064941, "sim_compute_performance-ego": 0.06109131415685018, "sim_compute_robot_state-ego": 0.06473783890406291, "sim_compute_robot_state-npc0": 0.06252609968185424, "sim_compute_robot_state-npc1": 0.06310569683710734, "sim_compute_robot_state-npc2": 0.06271047910054525, "sim_compute_robot_state-npc3": 0.06215681791305542}, "udem1-1-0": {"driven_any": 4.390824152784938, "sim_physics": 0.03550353447596232, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.05220881859461467, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.14363507350285848, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08064581871032715, "deviation-center-line": 1.0119699909612991, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.032064960797627766, "sim_compute_performance-ego": 0.05672631820042928, "sim_compute_robot_state-ego": 0.059629807472229006, "sim_compute_robot_state-npc0": 0.0566832423210144, "sim_compute_robot_state-npc1": 0.05642531633377075, "sim_compute_robot_state-npc2": 0.05558094024658203, "sim_compute_robot_state-npc3": 0.056166400909423826}, "udem1-2-0": {"driven_any": 4.390824152784927, "sim_physics": 0.037299080689748125, "survival_time": 14.950000000000076, "driven_lanedir": -2.315819376788188, "sim_render-ego": 0.055145950317382814, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.14723472595214843, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.08108796675999959, "deviation-center-line": 1.0119699909612945, "driven_lanedir_consec": -1.3614641213545289, "sim_compute_sim_state": 0.03448127110799153, "sim_compute_performance-ego": 0.05927889108657837, "sim_compute_robot_state-ego": 0.06456041892369588, "sim_compute_robot_state-npc0": 0.05887037038803101, "sim_compute_robot_state-npc1": 0.059229212601979574, "sim_compute_robot_state-npc2": 0.060046664873758954, "sim_compute_robot_state-npc3": 0.060244556268056235}, "udem1-3-0": {"driven_any": 4.3908241527849325, "sim_physics": 0.03640127023061117, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158169926021728, "sim_render-ego": 0.054337058862050376, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1584927654266357, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.08625680367151896, "deviation-center-line": 1.0119696714086834, "driven_lanedir_consec": -1.3614573264245535, "sim_compute_sim_state": 0.03520679473876953, "sim_compute_performance-ego": 0.05877618789672852, "sim_compute_robot_state-ego": 0.07282241821289062, "sim_compute_robot_state-npc0": 0.059411657651265465, "sim_compute_robot_state-npc1": 0.0588210391998291, "sim_compute_robot_state-npc2": 0.06320595264434814, "sim_compute_robot_state-npc3": 0.05993734121322632}, "udem1-4-0": {"driven_any": 4.390824152784936, "sim_physics": 0.03926663637161255, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158171118114455, "sim_render-ego": 0.05626099189122518, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1574082088470459, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.08466642220815022, "deviation-center-line": 1.0119696222761183, "driven_lanedir_consec": -1.3614588761452664, "sim_compute_sim_state": 0.03578802188237508, "sim_compute_performance-ego": 0.06077367623647054, "sim_compute_robot_state-ego": 0.06455234289169312, "sim_compute_robot_state-npc0": 0.06082317352294922, "sim_compute_robot_state-npc1": 0.06262135108311971, "sim_compute_robot_state-npc2": 0.06185354709625244, "sim_compute_robot_state-npc3": 0.06286764462788899}}
set_robot_commands_max0.0867177144686381
set_robot_commands_mean0.0838749451637268
set_robot_commands_median0.08466642220815022
set_robot_commands_min0.08064581871032715
sim_compute_performance-ego_max0.06109131415685018
sim_compute_performance-ego_mean0.05932927751541138
sim_compute_performance-ego_median0.05927889108657837
sim_compute_performance-ego_min0.05672631820042928
sim_compute_robot_state-ego_max0.07282241821289062
sim_compute_robot_state-ego_mean0.06526056528091431
sim_compute_robot_state-ego_median0.06456041892369588
sim_compute_robot_state-ego_min0.059629807472229006
sim_compute_robot_state-npc0_max0.06252609968185424
sim_compute_robot_state-npc0_mean0.059662908713022864
sim_compute_robot_state-npc0_median0.059411657651265465
sim_compute_robot_state-npc0_min0.0566832423210144
sim_compute_robot_state-npc1_max0.06310569683710734
sim_compute_robot_state-npc1_mean0.0600405232111613
sim_compute_robot_state-npc1_median0.059229212601979574
sim_compute_robot_state-npc1_min0.05642531633377075
sim_compute_robot_state-npc2_max0.06320595264434814
sim_compute_robot_state-npc2_mean0.06067951679229736
sim_compute_robot_state-npc2_median0.06185354709625244
sim_compute_robot_state-npc2_min0.05558094024658203
sim_compute_robot_state-npc3_max0.06286764462788899
sim_compute_robot_state-npc3_mean0.060274552186330155
sim_compute_robot_state-npc3_median0.060244556268056235
sim_compute_robot_state-npc3_min0.056166400909423826
sim_compute_sim_state_max0.03578802188237508
sim_compute_sim_state_mean0.034487032413482666
sim_compute_sim_state_median0.03489411354064941
sim_compute_sim_state_min0.032064960797627766
sim_physics_max0.03926663637161255
sim_physics_mean0.03731665849685669
sim_physics_median0.037299080689748125
sim_physics_min0.03550353447596232
sim_render-ego_max0.05626099189122518
sim_render-ego_mean0.05481318267186482
sim_render-ego_median0.055145950317382814
sim_render-ego_min0.05220881859461467
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
195922450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:10:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19592-308101', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19592-308101', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19592-308101', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
188482450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerrorno-0:21:33
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
184882450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerrorno-0:21:42
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
178202450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerrorno-0:21:29
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
176322450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerrorno-0:20:57
Waited 1202 seconds [...]
Waited 1202 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
176252450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationtimeoutno-0:25:06Hidden. If you are the author, please login using the top-right link or use the dashboard.