AI Driving Olympics Home Challenges Submissions Jobs

Submission 3114

Submission3114
Competingyes
Challengeaido2-LF-sim-validation
Useralmasip
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 22605
Next
User labelBaseline solution using reinforcement learning
Admin priority50
User priority50

22605

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
226053114almasipBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes-0:27:03(hidden)
driven_lanedir_consec_median2.185353061495548
survival_time_median14.950000000000076
deviation-center-line_median0.9435008220616988
in-drivable-lane_median0


other stats
agent_compute-ego_max0.28572375535964967
agent_compute-ego_mean0.2666672357657017
agent_compute-ego_median0.256938803990682
agent_compute-ego_min0.25221720774968465
deviation-center-line_max0.9822461139602914
deviation-center-line_mean0.8606329948319832
deviation-center-line_min0.5558214411706502
deviation-heading_max3.2600620014175123
deviation-heading_mean2.7476538296717954
deviation-heading_median2.654186664499502
deviation-heading_min2.334890485276209
driven_any_max2.3249545528410955
driven_any_mean2.168326033245046
driven_any_median2.226723976325144
driven_any_min1.9668256472301673
driven_lanedir_consec_max2.27781394553347
driven_lanedir_consec_mean2.0950503876198985
driven_lanedir_consec_min1.8348894432223557
driven_lanedir_max2.27781394553347
driven_lanedir_mean2.0950503876198985
driven_lanedir_median2.185353061495548
driven_lanedir_min1.8348894432223557
in-drivable-lane_max1.0000000000000142
in-drivable-lane_mean0.20000000000000284
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9668256472301673, "sim_physics": 0.12550162919711716, "survival_time": 13.65000000000006, "driven_lanedir": 1.899485956723519, "sim_render-ego": 0.06567252075279152, "in-drivable-lane": 0, "agent_compute-ego": 0.28487812555753267, "deviation-heading": 2.93529075502866, "set_robot_commands": 0.09840394376398442, "deviation-center-line": 0.5558214411706502, "driven_lanedir_consec": 1.899485956723519, "sim_compute_sim_state": 0.04072246184715858, "sim_compute_performance-ego": 0.0730905864701603, "sim_compute_robot_state-ego": 0.07988009610018887}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.321044713767219, "sim_physics": 0.11436676184336345, "survival_time": 14.950000000000076, "driven_lanedir": 2.2777095311245996, "sim_render-ego": 0.0660379449526469, "in-drivable-lane": 0, "agent_compute-ego": 0.28572375535964967, "deviation-heading": 2.5538392421370943, "set_robot_commands": 0.1003089435895284, "deviation-center-line": 0.9709933754294416, "driven_lanedir_consec": 2.2777095311245996, "sim_compute_sim_state": 0.04115877389907837, "sim_compute_performance-ego": 0.07202286799748739, "sim_compute_robot_state-ego": 0.08049248774846395}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3249545528410955, "sim_physics": 0.10777249972025552, "survival_time": 14.950000000000076, "driven_lanedir": 2.27781394553347, "sim_render-ego": 0.057764697869618735, "in-drivable-lane": 0, "agent_compute-ego": 0.256938803990682, "deviation-heading": 2.654186664499502, "set_robot_commands": 0.09034234126408897, "deviation-center-line": 0.9435008220616988, "driven_lanedir_consec": 2.27781394553347, "sim_compute_sim_state": 0.03809483289718628, "sim_compute_performance-ego": 0.06409759998321533, "sim_compute_robot_state-ego": 0.06853599468866985}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0020812760616047, "sim_physics": 0.10309399843215944, "survival_time": 14.950000000000076, "driven_lanedir": 1.8348894432223557, "sim_render-ego": 0.05772845347722371, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.25221720774968465, "deviation-heading": 3.2600620014175123, "set_robot_commands": 0.08923460880915324, "deviation-center-line": 0.8506032215378343, "driven_lanedir_consec": 1.8348894432223557, "sim_compute_sim_state": 0.03678608973821004, "sim_compute_performance-ego": 0.0691389004389445, "sim_compute_robot_state-ego": 0.07210917949676514}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.226723976325144, "sim_physics": 0.10789947907129924, "survival_time": 14.950000000000076, "driven_lanedir": 2.185353061495548, "sim_render-ego": 0.06056863069534302, "in-drivable-lane": 0, "agent_compute-ego": 0.25357828617095945, "deviation-heading": 2.334890485276209, "set_robot_commands": 0.09022313435872396, "deviation-center-line": 0.9822461139602914, "driven_lanedir_consec": 2.185353061495548, "sim_compute_sim_state": 0.037215991020202635, "sim_compute_performance-ego": 0.0681192684173584, "sim_compute_robot_state-ego": 0.07108312129974365}}
set_robot_commands_max0.1003089435895284
set_robot_commands_mean0.0937025943570958
set_robot_commands_median0.09034234126408897
set_robot_commands_min0.08923460880915324
sim_compute_performance-ego_max0.0730905864701603
sim_compute_performance-ego_mean0.06929384466143318
sim_compute_performance-ego_median0.0691389004389445
sim_compute_performance-ego_min0.06409759998321533
sim_compute_robot_state-ego_max0.08049248774846395
sim_compute_robot_state-ego_mean0.07442017586676629
sim_compute_robot_state-ego_median0.07210917949676514
sim_compute_robot_state-ego_min0.06853599468866985
sim_compute_sim_state_max0.04115877389907837
sim_compute_sim_state_mean0.03879562988036718
sim_compute_sim_state_median0.03809483289718628
sim_compute_sim_state_min0.03678608973821004
sim_physics_max0.12550162919711716
sim_physics_mean0.11172687365283895
sim_physics_median0.10789947907129924
sim_physics_min0.10309399843215944
sim_render-ego_max0.0660379449526469
sim_render-ego_mean0.061554449549524784
sim_render-ego_median0.06056863069534302
sim_render-ego_min0.05772845347722371
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.690000000000072
survival_time_min13.65000000000006
214093114almasipBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessno-0:14:41(hidden)
driven_lanedir_consec_median2.149670626942928
survival_time_median14.950000000000076
deviation-center-line_median0.823680053773175
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16475215451470737
agent_compute-ego_mean0.16031398728798177
agent_compute-ego_median0.15965689738591513
agent_compute-ego_min0.15870187203089395
deviation-center-line_max0.9786332948326866
deviation-center-line_mean0.7526734266807116
deviation-center-line_min0.3563313142439007
deviation-heading_max2.952035441782488
deviation-heading_mean2.682269119758059
deviation-heading_median2.635209997552692
deviation-heading_min2.3909082838396634
driven_any_max2.291186016115682
driven_any_mean1.998510954139831
driven_any_median2.1862820973731782
driven_any_min1.0681563976707265
driven_lanedir_consec_max2.243002798181926
driven_lanedir_consec_mean1.8642695469029615
driven_lanedir_consec_min0.731366668470979
driven_lanedir_max2.243002798181926
driven_lanedir_mean1.8773039772487223
driven_lanedir_median2.149670626942928
driven_lanedir_min0.7965388201997836
in-drivable-lane_max1.3000000000000185
in-drivable-lane_mean0.4900000000000029
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0681563976707265, "sim_physics": 0.05497530575456291, "survival_time": 7.249999999999982, "driven_lanedir": 0.7965388201997836, "sim_render-ego": 0.03627967012339625, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.16475215451470737, "deviation-heading": 2.493330238693338, "set_robot_commands": 0.05580356367703142, "deviation-center-line": 0.3563313142439007, "driven_lanedir_consec": 0.731366668470979, "sim_compute_sim_state": 0.02377303222130085, "sim_compute_performance-ego": 0.03958172798156738, "sim_compute_robot_state-ego": 0.0413714129349281}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.291186016115682, "sim_physics": 0.057274293104807535, "survival_time": 14.950000000000076, "driven_lanedir": 2.243002798181926, "sim_render-ego": 0.03690431276957194, "in-drivable-lane": 0, "agent_compute-ego": 0.1596882661183675, "deviation-heading": 2.635209997552692, "set_robot_commands": 0.05545935153961182, "deviation-center-line": 0.823680053773175, "driven_lanedir_consec": 2.243002798181926, "sim_compute_sim_state": 0.0236332893371582, "sim_compute_performance-ego": 0.03928906520207723, "sim_compute_robot_state-ego": 0.041328402360280354}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.2667409811328776, "sim_physics": 0.0597157613436381, "survival_time": 14.950000000000076, "driven_lanedir": 2.2094587305294633, "sim_render-ego": 0.03636421680450439, "in-drivable-lane": 0, "agent_compute-ego": 0.1587707463900248, "deviation-heading": 2.952035441782488, "set_robot_commands": 0.05543043454488118, "deviation-center-line": 0.8594109469744858, "driven_lanedir_consec": 2.2094587305294633, "sim_compute_sim_state": 0.02371229330698649, "sim_compute_performance-ego": 0.040296967029571536, "sim_compute_robot_state-ego": 0.0409683362642924}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.180189278406689, "sim_physics": 0.057237568696339926, "survival_time": 14.950000000000076, "driven_lanedir": 1.9878489103895116, "sim_render-ego": 0.03616395950317383, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.15870187203089395, "deviation-heading": 2.9398616369221124, "set_robot_commands": 0.05569936672846476, "deviation-center-line": 0.7453115235793104, "driven_lanedir_consec": 1.9878489103895116, "sim_compute_sim_state": 0.023350710074106853, "sim_compute_performance-ego": 0.04060396750768026, "sim_compute_robot_state-ego": 0.04087452570597331}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1862820973731782, "sim_physics": 0.0577961540222168, "survival_time": 14.950000000000076, "driven_lanedir": 2.149670626942928, "sim_render-ego": 0.03631274302800496, "in-drivable-lane": 0, "agent_compute-ego": 0.15965689738591513, "deviation-heading": 2.3909082838396634, "set_robot_commands": 0.05663041830062866, "deviation-center-line": 0.9786332948326866, "driven_lanedir_consec": 2.149670626942928, "sim_compute_sim_state": 0.02342748721440633, "sim_compute_performance-ego": 0.03947339614232381, "sim_compute_robot_state-ego": 0.04090935548146566}}
set_robot_commands_max0.05663041830062866
set_robot_commands_mean0.05580462695812357
set_robot_commands_median0.05569936672846476
set_robot_commands_min0.05543043454488118
sim_compute_performance-ego_max0.04060396750768026
sim_compute_performance-ego_mean0.03984902477264404
sim_compute_performance-ego_median0.03958172798156738
sim_compute_performance-ego_min0.03928906520207723
sim_compute_robot_state-ego_max0.0413714129349281
sim_compute_robot_state-ego_mean0.04109040654938796
sim_compute_robot_state-ego_median0.0409683362642924
sim_compute_robot_state-ego_min0.04087452570597331
sim_compute_sim_state_max0.02377303222130085
sim_compute_sim_state_mean0.023579362430791746
sim_compute_sim_state_median0.0236332893371582
sim_compute_sim_state_min0.023350710074106853
sim_physics_max0.0597157613436381
sim_physics_mean0.057399816584313056
sim_physics_median0.057274293104807535
sim_physics_min0.05497530575456291
sim_render-ego_max0.03690431276957194
sim_render-ego_mean0.03640498044573027
sim_render-ego_median0.03631274302800496
sim_render-ego_min0.03616395950317383
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.410000000000055
survival_time_min7.249999999999982
214063114almasipBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationhost-errorno-0:05:40
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3114/step1-simulation-ip-172-31-40-253-32059-job21406/logs/challenges-runner/stdout.log'
(hidden)