AI Driving Olympics Home Challenges Submissions Jobs

Submission 2446

Submission2446
Competingyes
Challengeaido2-LF-sim-testing
Userenicky
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 22970
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
229702446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerroryes-0:41:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213952446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessno-0:54:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.349968485301373
survival_time_median14.950000000000076
deviation-center-line_median1.040807946070029
in-drivable-lane_median4.000000000000023


other stats
agent_compute-ego_max0.13602806011835733
agent_compute-ego_mean0.13264088143242733
agent_compute-ego_median0.13285026947657266
agent_compute-ego_min0.12937694708506267
deviation-center-line_max1.529644280889766
deviation-center-line_mean0.8701756872677942
deviation-center-line_min0.26477611315883814
deviation-heading_max8.558153948461722
deviation-heading_mean6.851383096454355
deviation-heading_median6.860620529247017
deviation-heading_min5.521409763793653
driven_any_max4.378506444052824
driven_any_mean4.378506444052813
driven_any_median4.378506444052814
driven_any_min4.3785064440528
driven_lanedir_consec_max-1.2728389207955129
driven_lanedir_consec_mean-1.3462902153896477
driven_lanedir_consec_min-1.3792285832163174
driven_lanedir_max-1.339366254383536
driven_lanedir_mean-2.03259639042992
driven_lanedir_median-2.3212713812257557
driven_lanedir_min-2.7107548643537447
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean4.880000000000026
in-drivable-lane_min2.100000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.08642577648162841, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.04851045767466227, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.13297950903574626, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.07536667029062907, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.031107096672058104, "sim_compute_performance-ego": 0.05479433139165243, "sim_compute_robot_state-ego": 0.058893465995788576}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052802, "sim_physics": 0.08691987117131551, "survival_time": 14.950000000000076, "driven_lanedir": -2.44752976847699, "sim_render-ego": 0.05048577864964803, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.13602806011835733, "deviation-heading": 7.300247877354016, "set_robot_commands": 0.0771160856882731, "deviation-center-line": 1.1660826179431367, "driven_lanedir_consec": -1.375791811242363, "sim_compute_sim_state": 0.03120510816574097, "sim_compute_performance-ego": 0.05668867349624634, "sim_compute_robot_state-ego": 0.061105138460795086}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.37850644405281, "sim_physics": 0.08317522366841634, "survival_time": 14.950000000000076, "driven_lanedir": -1.339366254383536, "sim_render-ego": 0.04890303532282511, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.13012502113978067, "deviation-heading": 5.592005976497815, "set_robot_commands": 0.07289218505223592, "deviation-center-line": 0.26894128230124625, "driven_lanedir_consec": -1.339366254383536, "sim_compute_sim_state": 0.031216882864634195, "sim_compute_performance-ego": 0.05457228740056356, "sim_compute_robot_state-ego": 0.057028980255126954}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052819, "sim_physics": 0.0864794127146403, "survival_time": 14.950000000000076, "driven_lanedir": -2.6766171477725837, "sim_render-ego": 0.04933712561925252, "in-drivable-lane": 2.2000000000000126, "agent_compute-ego": 0.13285026947657266, "deviation-heading": 8.502617994731201, "set_robot_commands": 0.07489354610443115, "deviation-center-line": 1.516600708411943, "driven_lanedir_consec": -1.3215500552073602, "sim_compute_sim_state": 0.031944018999735514, "sim_compute_performance-ego": 0.05636159976323445, "sim_compute_robot_state-ego": 0.05841718673706055}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378506444052814, "sim_physics": 0.0857601277033488, "survival_time": 14.950000000000076, "driven_lanedir": -2.5973993077066466, "sim_render-ego": 0.04888549009958903, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.13392890612284342, "deviation-heading": 8.166880118443489, "set_robot_commands": 0.07486514329910278, "deviation-center-line": 1.4012763877174623, "driven_lanedir_consec": -1.3674582749242976, "sim_compute_sim_state": 0.032506783008575436, "sim_compute_performance-ego": 0.0553258482615153, "sim_compute_robot_state-ego": 0.05898264726003011}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.378506444052818, "sim_physics": 0.08064375162124633, "survival_time": 14.950000000000076, "driven_lanedir": -2.6863506595444093, "sim_render-ego": 0.04808873732884725, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.1313062119483948, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.07205658356348674, "deviation-center-line": 1.529644280889766, "driven_lanedir_consec": -1.2728389207955129, "sim_compute_sim_state": 0.030136813322703043, "sim_compute_performance-ego": 0.052455137570699056, "sim_compute_robot_state-ego": 0.056194670995076496}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.3785064440528165, "sim_physics": 0.08243518908818563, "survival_time": 14.950000000000076, "driven_lanedir": -1.3792285832163174, "sim_render-ego": 0.04841504573822022, "in-drivable-lane": 7.450000000000041, "agent_compute-ego": 0.1325659322738647, "deviation-heading": 5.5809548780508695, "set_robot_commands": 0.07356699784596761, "deviation-center-line": 0.27326177365632137, "driven_lanedir_consec": -1.3792285832163174, "sim_compute_sim_state": 0.030697075525919597, "sim_compute_performance-ego": 0.05426031112670898, "sim_compute_robot_state-ego": 0.05707390069961548}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.378506444052812, "sim_physics": 0.08584404706954957, "survival_time": 14.950000000000076, "driven_lanedir": -1.3432315670097958, "sim_render-ego": 0.04903968731562296, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.13392133394877115, "deviation-heading": 5.577448138086962, "set_robot_commands": 0.07572504679361979, "deviation-center-line": 0.26477611315883814, "driven_lanedir_consec": -1.3432315670097958, "sim_compute_sim_state": 0.03151296536127726, "sim_compute_performance-ego": 0.05546119213104248, "sim_compute_robot_state-ego": 0.05814357280731201}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.378506444052817, "sim_physics": 0.08003878116607666, "survival_time": 14.950000000000076, "driven_lanedir": -2.326178382589746, "sim_render-ego": 0.04847033818562826, "in-drivable-lane": 4.000000000000023, "agent_compute-ego": 0.12937694708506267, "deviation-heading": 6.860620529247017, "set_robot_commands": 0.07248281637827556, "deviation-center-line": 1.040807946070029, "driven_lanedir_consec": -1.349968485301373, "sim_compute_sim_state": 0.03001556158065796, "sim_compute_performance-ego": 0.05345175584157308, "sim_compute_robot_state-ego": 0.05673758109410604}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.378506444052823, "sim_physics": 0.08730617046356201, "survival_time": 14.950000000000076, "driven_lanedir": -1.3566703884391194, "sim_render-ego": 0.04936212380727132, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.13505361080169678, "deviation-heading": 5.521409763793653, "set_robot_commands": 0.07622285763422648, "deviation-center-line": 0.2734733627444725, "driven_lanedir_consec": -1.3566703884391194, "sim_compute_sim_state": 0.03147024313608805, "sim_compute_performance-ego": 0.05776350259780884, "sim_compute_robot_state-ego": 0.05782592296600342}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.3785064440528, "sim_physics": 0.08320647637049357, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662528350192018, "sim_render-ego": 0.05061759789784749, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.13372203906377156, "deviation-heading": 5.773684892471284, "set_robot_commands": 0.07524203141530354, "deviation-center-line": 0.29292877009102625, "driven_lanedir_consec": -1.3662528350192018, "sim_compute_sim_state": 0.03161539951960246, "sim_compute_performance-ego": 0.054639304478963216, "sim_compute_robot_state-ego": 0.058443990548451744}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.378506444052815, "sim_physics": 0.08307898839314778, "survival_time": 14.950000000000076, "driven_lanedir": -1.9006947314702467, "sim_render-ego": 0.04819477796554565, "in-drivable-lane": 5.700000000000033, "agent_compute-ego": 0.13065277179082235, "deviation-heading": 5.897976469138944, "set_robot_commands": 0.07167072216669719, "deviation-center-line": 0.6401646582864557, "driven_lanedir_consec": -1.3481573540947158, "sim_compute_sim_state": 0.03088045597076416, "sim_compute_performance-ego": 0.05324330012003581, "sim_compute_robot_state-ego": 0.05680185238520304}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.3785064440528005, "sim_physics": 0.08270615895589192, "survival_time": 14.950000000000076, "driven_lanedir": -2.6697425839037123, "sim_render-ego": 0.049018498261769614, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.1337539529800415, "deviation-heading": 8.52845713238494, "set_robot_commands": 0.07527488152186076, "deviation-center-line": 1.5113151793151556, "driven_lanedir_consec": -1.3509792024801393, "sim_compute_sim_state": 0.031425457000732425, "sim_compute_performance-ego": 0.0549146588643392, "sim_compute_robot_state-ego": 0.05757980346679688}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.378506444052814, "sim_physics": 0.07818323055903117, "survival_time": 14.950000000000076, "driven_lanedir": -2.3212713812257557, "sim_render-ego": 0.04829586664835612, "in-drivable-lane": 3.9500000000000215, "agent_compute-ego": 0.13124968767166137, "deviation-heading": 6.99662450508493, "set_robot_commands": 0.0735815707842509, "deviation-center-line": 1.0417077412071511, "driven_lanedir_consec": -1.3443245306214604, "sim_compute_sim_state": 0.03103534698486328, "sim_compute_performance-ego": 0.05291268905003865, "sim_compute_robot_state-ego": 0.056521852811177574}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.378506444052824, "sim_physics": 0.08136114199956258, "survival_time": 14.950000000000076, "driven_lanedir": -1.3676574013369849, "sim_render-ego": 0.04820374329884847, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.1320989680290222, "deviation-heading": 5.540769848207861, "set_robot_commands": 0.07370618502298991, "deviation-center-line": 0.31212235976688296, "driven_lanedir_consec": -1.3676574013369849, "sim_compute_sim_state": 0.030656136671702063, "sim_compute_performance-ego": 0.053608717918396, "sim_compute_robot_state-ego": 0.05721550941467285}}
set_robot_commands_max0.0771160856882731
set_robot_commands_mean0.07431088823742336
set_robot_commands_median0.07486514329910278
set_robot_commands_min0.07167072216669719
sim_compute_performance-ego_max0.05776350259780884
sim_compute_performance-ego_mean0.05469688733418784
sim_compute_performance-ego_median0.054639304478963216
sim_compute_performance-ego_min0.052455137570699056
sim_compute_robot_state-ego_max0.061105138460795086
sim_compute_robot_state-ego_mean0.05779773839314779
sim_compute_robot_state-ego_median0.05757980346679688
sim_compute_robot_state-ego_min0.056194670995076496
sim_compute_sim_state_max0.032506783008575436
sim_compute_sim_state_mean0.031161689652336965
sim_compute_sim_state_median0.03120510816574097
sim_compute_sim_state_min0.03001556158065796
sim_physics_max0.08730617046356201
sim_physics_mean0.08357095649507311
sim_physics_median0.08317522366841634
sim_physics_min0.07818323055903117
sim_render-ego_max0.05061759789784749
sim_render-ego_mean0.04892188692092896
sim_render-ego_median0.04888549009958903
sim_render-ego_min0.04808873732884725
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
213782446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errorno-0:59:51
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-40-253-31940-job21378/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213612446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errorno-0:59:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-42-167-7227-job21361/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213402446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errorno-0:59:37
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-40-253-32059-job21340/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
213212446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errorno-0:50:51
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-42-167-7194-job21321/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212822446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errorno-0:59:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-38-104-5317-job21282/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212692446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errorno-0:09:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-40-253-32125-job21269/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
205592446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessno-0:23:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3397390356601346
survival_time_median14.950000000000076
deviation-center-line_median1.401141803909748
in-drivable-lane_median2.500000000000013


other stats
agent_compute-ego_max0.16138179381688436
agent_compute-ego_mean0.1544363842010498
agent_compute-ego_median0.15614225546518962
agent_compute-ego_min0.14178179423014323
deviation-center-line_max1.5194332589791988
deviation-center-line_mean1.1743762518416452
deviation-center-line_min0.26891847472491964
deviation-heading_max8.492476633385415
deviation-heading_mean7.583649780851511
deviation-heading_median8.165190079878816
deviation-heading_min5.589657549909816
driven_any_max4.378320939674851
driven_any_mean4.378320939674839
driven_any_median4.3783209396748415
driven_any_min4.378320939674831
driven_lanedir_consec_max-1.3111163275808764
driven_lanedir_consec_mean-1.342604284062788
driven_lanedir_consec_min-1.3761077892801137
driven_lanedir_max-1.3397390356601346
driven_lanedir_mean-2.354812195437246
driven_lanedir_median-2.597977359892488
driven_lanedir_min-2.711272268924253
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean3.570000000000019
in-drivable-lane_min2.150000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.11867382605870563, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272268924253, "sim_render-ego": 0.061295249462127686, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15907333294550577, "deviation-heading": 8.371542541054902, "set_robot_commands": 0.09471826314926148, "deviation-center-line": 1.5194332589791988, "driven_lanedir_consec": -1.3111163275808764, "sim_compute_sim_state": 0.039498422940572105, "sim_compute_performance-ego": 0.06658160924911499, "sim_compute_robot_state-ego": 0.07134103298187255}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378320939674851, "sim_physics": 0.09986755688985188, "survival_time": 14.950000000000076, "driven_lanedir": -2.448035866142366, "sim_render-ego": 0.05394635279973348, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.14178179423014323, "deviation-heading": 7.299382100028609, "set_robot_commands": 0.0860521109898885, "deviation-center-line": 1.1659435662933817, "driven_lanedir_consec": -1.3761077892801137, "sim_compute_sim_state": 0.03407214959462484, "sim_compute_performance-ego": 0.061092854340871174, "sim_compute_robot_state-ego": 0.06848312218983968}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.3783209396748415, "sim_physics": 0.11246212402979532, "survival_time": 14.950000000000076, "driven_lanedir": -1.3397390356601346, "sim_render-ego": 0.059262658754984536, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.16138179381688436, "deviation-heading": 5.589657549909816, "set_robot_commands": 0.08992591301600138, "deviation-center-line": 0.26891847472491964, "driven_lanedir_consec": -1.3397390356601346, "sim_compute_sim_state": 0.03743815183639526, "sim_compute_performance-ego": 0.06525811115900676, "sim_compute_robot_state-ego": 0.07070332606633505}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378320939674831, "sim_physics": 0.11153515418370565, "survival_time": 14.950000000000076, "driven_lanedir": -2.677036446566989, "sim_render-ego": 0.05833609660466512, "in-drivable-lane": 2.2000000000000117, "agent_compute-ego": 0.15614225546518962, "deviation-heading": 8.492476633385415, "set_robot_commands": 0.08980220397313436, "deviation-center-line": 1.5164441553009778, "driven_lanedir_consec": -1.3182655771745324, "sim_compute_sim_state": 0.03662278811136881, "sim_compute_performance-ego": 0.06377999464670817, "sim_compute_robot_state-ego": 0.06868614276250204}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378320939674831, "sim_physics": 0.1111218245824178, "survival_time": 14.950000000000076, "driven_lanedir": -2.597977359892488, "sim_render-ego": 0.05714348872502645, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.15380274454752604, "deviation-heading": 8.165190079878816, "set_robot_commands": 0.08649130423863728, "deviation-center-line": 1.401141803909748, "driven_lanedir_consec": -1.367792690618283, "sim_compute_sim_state": 0.035748157501220706, "sim_compute_performance-ego": 0.0633875584602356, "sim_compute_robot_state-ego": 0.06745607852935791}}
set_robot_commands_max0.09471826314926148
set_robot_commands_mean0.0893979590733846
set_robot_commands_median0.08980220397313436
set_robot_commands_min0.0860521109898885
sim_compute_performance-ego_max0.06658160924911499
sim_compute_performance-ego_mean0.06402002557118733
sim_compute_performance-ego_median0.06377999464670817
sim_compute_performance-ego_min0.061092854340871174
sim_compute_robot_state-ego_max0.07134103298187255
sim_compute_robot_state-ego_mean0.06933394050598143
sim_compute_robot_state-ego_median0.06868614276250204
sim_compute_robot_state-ego_min0.06745607852935791
sim_compute_sim_state_max0.039498422940572105
sim_compute_sim_state_mean0.036675933996836343
sim_compute_sim_state_median0.03662278811136881
sim_compute_sim_state_min0.03407214959462484
sim_physics_max0.11867382605870563
sim_physics_mean0.11073209714889524
sim_physics_median0.11153515418370565
sim_physics_min0.09986755688985188
sim_render-ego_max0.061295249462127686
sim_render-ego_mean0.057996769269307455
sim_render-ego_median0.05833609660466512
sim_render-ego_min0.05394635279973348
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
195992446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessno-0:23:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3614583993086016
survival_time_median14.950000000000076
deviation-center-line_median1.011969887428033
in-drivable-lane_median4.050000000000022


other stats
agent_compute-ego_max0.5483512719472249
agent_compute-ego_mean0.3755707926750183
agent_compute-ego_median0.33268925428390506
agent_compute-ego_min0.23373945395151777
deviation-center-line_max1.0119709059919424
deviation-center-line_mean1.0119700704341597
deviation-center-line_min1.0119697838947566
deviation-heading_max6.81542792438532
deviation-heading_mean6.815427924385318
deviation-heading_median6.815427924385319
deviation-heading_min6.815427924385317
driven_any_max4.390824152784936
driven_any_mean4.390824152784928
driven_any_median4.390824152784926
driven_any_min4.390824152784922
driven_lanedir_consec_max-1.361452200425545
driven_lanedir_consec_mean-1.3614594960339783
driven_lanedir_consec_min-1.3614696049818191
driven_lanedir_max-2.315814608416598
driven_lanedir_mean-2.3158178509092298
driven_lanedir_median-2.3158179462767055
driven_lanedir_min-2.315821760973971
in-drivable-lane_max4.050000000000022
in-drivable-lane_mean4.050000000000022
in-drivable-lane_min4.050000000000022
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.39082415278493, "sim_physics": 0.01723189910252889, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158179462767055, "sim_render-ego": 0.05273850202560425, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.33268925428390506, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.0725600028038025, "deviation-center-line": 1.0119698874280334, "driven_lanedir_consec": -1.3614583993086016, "sim_compute_sim_state": 0.03620200395584106, "sim_compute_performance-ego": 0.05842790047327678, "sim_compute_robot_state-ego": 0.05966818650563558}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.390824152784936, "sim_physics": 0.015198813279469809, "survival_time": 14.950000000000076, "driven_lanedir": -2.315820330462275, "sim_render-ego": 0.05377374728520711, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.23373945395151777, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.07293879588445028, "deviation-center-line": 1.0119709059919424, "driven_lanedir_consec": -1.3614650750283808, "sim_compute_sim_state": 0.03740429560343424, "sim_compute_performance-ego": 0.05857684055964152, "sim_compute_robot_state-ego": 0.060078837871551515}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.390824152784926, "sim_physics": 0.023700588544209797, "survival_time": 14.950000000000076, "driven_lanedir": -2.315821760973971, "sim_render-ego": 0.06304666837056477, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.4367273950576782, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.08859397808710734, "deviation-center-line": 1.0119697838947566, "driven_lanedir_consec": -1.3614696049818191, "sim_compute_sim_state": 0.041100916067759195, "sim_compute_performance-ego": 0.0684581168492635, "sim_compute_robot_state-ego": 0.07069117546081544}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.390824152784922, "sim_physics": 0.019686279296875, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.0551883594195048, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.5483512719472249, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.07695181051890056, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03571657419204712, "sim_compute_performance-ego": 0.060775073369344075, "sim_compute_robot_state-ego": 0.06318996508916219}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.390824152784922, "sim_physics": 0.016571615537007648, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.054642670154571533, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.32634658813476564, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.07661374727884929, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.037318952083587646, "sim_compute_performance-ego": 0.059749987125396725, "sim_compute_robot_state-ego": 0.0612310250600179}}
set_robot_commands_max0.08859397808710734
set_robot_commands_mean0.07753166691462199
set_robot_commands_median0.07661374727884929
set_robot_commands_min0.0725600028038025
sim_compute_performance-ego_max0.0684581168492635
sim_compute_performance-ego_mean0.061197583675384526
sim_compute_performance-ego_median0.059749987125396725
sim_compute_performance-ego_min0.05842790047327678
sim_compute_robot_state-ego_max0.07069117546081544
sim_compute_robot_state-ego_mean0.06297183799743652
sim_compute_robot_state-ego_median0.0612310250600179
sim_compute_robot_state-ego_min0.05966818650563558
sim_compute_sim_state_max0.041100916067759195
sim_compute_sim_state_mean0.037548548380533855
sim_compute_sim_state_median0.037318952083587646
sim_compute_sim_state_min0.03571657419204712
sim_physics_max0.023700588544209797
sim_physics_mean0.018477839152018227
sim_physics_median0.01723189910252889
sim_physics_min0.015198813279469809
sim_render-ego_max0.06304666837056477
sim_render-ego_mean0.055877989451090494
sim_render-ego_median0.054642670154571533
sim_render-ego_min0.05273850202560425
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
188522446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrorno-0:21:12
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
184932446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrorno-0:21:14
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
182372446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrorno-0:21:39
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
179492446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessno-0:14:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.6760228236109347
survival_time_median14.950000000000076
deviation-center-line_median0.2349287147361276
in-drivable-lane_median7.500000000000039


other stats
agent_compute-ego_max0.09521467606226604
agent_compute-ego_mean0.09410214932759604
agent_compute-ego_median0.093609934647878
agent_compute-ego_min0.09314604679743448
deviation-center-line_max0.2349306604543784
deviation-center-line_mean0.2349290643247573
deviation-center-line_min0.23492851696102396
deviation-heading_max5.833940015674341
deviation-heading_mean5.83394001567434
deviation-heading_median5.83394001567434
deviation-heading_min5.83394001567434
driven_any_max8.841232955081617
driven_any_mean8.841232955081612
driven_any_median8.84123295508161
driven_any_min8.841232955081608
driven_lanedir_consec_max-2.67601614789072
driven_lanedir_consec_mean-2.6760240395458146
driven_lanedir_consec_min-2.676035221377435
driven_lanedir_max-2.67601614789072
driven_lanedir_mean-2.6760240395458146
driven_lanedir_median-2.6760228236109347
driven_lanedir_min-2.676035221377435
in-drivable-lane_max7.500000000000039
in-drivable-lane_mean7.50000000000004
in-drivable-lane_min7.500000000000039
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 8.841232955081617, "sim_physics": 0.008290909926096598, "survival_time": 14.950000000000076, "driven_lanedir": -2.6760228236109347, "sim_render-ego": 0.03458826224009196, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.093609934647878, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.050415875116984046, "deviation-center-line": 0.2349287147361289, "driven_lanedir_consec": -2.6760228236109347, "sim_compute_sim_state": 0.02263307809829712, "sim_compute_performance-ego": 0.036064167022705075, "sim_compute_robot_state-ego": 0.0403826904296875}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 8.84123295508161, "sim_physics": 0.007871859073638916, "survival_time": 14.950000000000076, "driven_lanedir": -2.676029856959261, "sim_render-ego": 0.03554268439610799, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.09521467606226604, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.05017406066258749, "deviation-center-line": 0.2349306604543784, "driven_lanedir_consec": -2.676029856959261, "sim_compute_sim_state": 0.022954314549764, "sim_compute_performance-ego": 0.03637580315272013, "sim_compute_robot_state-ego": 0.04101231098175049}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 8.841232955081612, "sim_physics": 0.008268327713012695, "survival_time": 14.950000000000076, "driven_lanedir": -2.676035221377435, "sim_render-ego": 0.03524912118911743, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.09314604679743448, "deviation-heading": 5.833940015674341, "set_robot_commands": 0.050268466472625735, "deviation-center-line": 0.23492851696102396, "driven_lanedir_consec": -2.676035221377435, "sim_compute_sim_state": 0.022849852244059245, "sim_compute_performance-ego": 0.03623849868774414, "sim_compute_robot_state-ego": 0.041043508847554526}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 8.841232955081608, "sim_physics": 0.008317392667134603, "survival_time": 14.950000000000076, "driven_lanedir": -2.67601614789072, "sim_render-ego": 0.03463344971338908, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.093508669535319, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.05039882103602091, "deviation-center-line": 0.2349287147361276, "driven_lanedir_consec": -2.67601614789072, "sim_compute_sim_state": 0.022672865390777588, "sim_compute_performance-ego": 0.03704923709233602, "sim_compute_robot_state-ego": 0.04089852412541707}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 8.841232955081608, "sim_physics": 0.008064638773600261, "survival_time": 14.950000000000076, "driven_lanedir": -2.67601614789072, "sim_render-ego": 0.035048295656840006, "in-drivable-lane": 7.500000000000039, "agent_compute-ego": 0.0950314195950826, "deviation-heading": 5.83394001567434, "set_robot_commands": 0.050331406593322754, "deviation-center-line": 0.2349287147361276, "driven_lanedir_consec": -2.67601614789072, "sim_compute_sim_state": 0.02296727180480957, "sim_compute_performance-ego": 0.036427510579427086, "sim_compute_robot_state-ego": 0.040872730414072675}}
set_robot_commands_max0.050415875116984046
set_robot_commands_mean0.050317725976308195
set_robot_commands_median0.050331406593322754
set_robot_commands_min0.05017406066258749
sim_compute_performance-ego_max0.03704923709233602
sim_compute_performance-ego_mean0.03643104330698649
sim_compute_performance-ego_median0.03637580315272013
sim_compute_performance-ego_min0.036064167022705075
sim_compute_robot_state-ego_max0.041043508847554526
sim_compute_robot_state-ego_mean0.04084195295969646
sim_compute_robot_state-ego_median0.04089852412541707
sim_compute_robot_state-ego_min0.0403826904296875
sim_compute_sim_state_max0.02296727180480957
sim_compute_sim_state_mean0.022815476417541503
sim_compute_sim_state_median0.022849852244059245
sim_compute_sim_state_min0.02263307809829712
sim_physics_max0.008317392667134603
sim_physics_mean0.008162625630696614
sim_physics_median0.008268327713012695
sim_physics_min0.007871859073638916
sim_render-ego_max0.03554268439610799
sim_render-ego_mean0.0350123626391093
sim_render-ego_median0.035048295656840006
sim_render-ego_min0.03458826224009196
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
178532446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrorno-0:20:47
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
178232446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationtimeoutno-0:25:26
I can see how the jo [...]
I can see how the job 17823 is timeout because passed 1526 seconds and the timeout is 1200.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
176302446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrorno-0:21:09
Waited 1202 seconds [...]
Waited 1202 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
176272446enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errorno-0:21:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 471, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 980, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1131, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1177, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-idsc-rudolf-5891-job17627/tmp/tmprrni27cs/attempts/ETHZ_autolab_technical_track-4-0.attempt4/log.gs2.cbor.tmp']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.