Duckietown Challenges Home Challenges Submissions

Submission 2385

Submission2385
Competingyes
Challengeaido2-LFV-sim-testing
UserAndrea Censi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23014
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
23014step1-simulationsuccessyes0:44:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08510334771231687
survival_time_median1.7000000000000008
deviation-center-line_median0.1022089282560985
in-drivable-lane_median0.6500000000000006


other stats
agent_compute-ego_max0.18321098731114313
agent_compute-ego_mean0.14787584059083192
agent_compute-ego_median0.1694653188028643
agent_compute-ego_min0.09736391992279976
deviation-center-line_max0.513472697884007
deviation-center-line_mean0.19020199254672968
deviation-center-line_min0.027282485519790952
deviation-heading_max6.048475674802702
deviation-heading_mean2.641030814102052
deviation-heading_median0.7104917115254321
deviation-heading_min0.5341655512814498
driven_any_max1.602593678184747
driven_any_mean0.6579026318465446
driven_any_median0.15818326346729497
driven_any_min0.10299023933601764
driven_lanedir_consec_max0.578861969252721
driven_lanedir_consec_mean0.2289687251306853
driven_lanedir_consec_min0.03700417373868914
driven_lanedir_max0.578861969252721
driven_lanedir_mean0.2289687251306853
driven_lanedir_median0.08510334771231687
driven_lanedir_min0.03700417373868914
in-drivable-lane_max7.35000000000004
in-drivable-lane_mean3.0133333333333434
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.700897181079569, "sim_physics": 0.17242584712263467, "survival_time": 6.8999999999999835, "driven_lanedir": 0.21518492532445463, "sim_render-ego": 0.06404490920080655, "in-drivable-lane": 3.1499999999999932, "agent_compute-ego": 0.1770435917204705, "deviation-heading": 2.762872247408002, "set_robot_commands": 0.10015040204144908, "deviation-center-line": 0.14176458768376918, "driven_lanedir_consec": 0.21518492532445463, "sim_compute_sim_state": 0.040238532467164856, "sim_compute_performance-ego": 0.0695452862891598, "sim_compute_robot_state-ego": 0.07766435111778369, "sim_compute_robot_state-npc0": 0.0707142508548239, "sim_compute_robot_state-npc1": 0.07072856288025345, "sim_compute_robot_state-npc2": 0.0716051485227502, "sim_compute_robot_state-npc3": 0.07175904944323111}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4705121448738985, "sim_physics": 0.15926894982655845, "survival_time": 14.950000000000076, "driven_lanedir": 0.4913132136120972, "sim_render-ego": 0.06097488244374593, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.17119683742523192, "deviation-heading": 6.048475674802702, "set_robot_commands": 0.0966720978418986, "deviation-center-line": 0.48028821544328026, "driven_lanedir_consec": 0.4913132136120972, "sim_compute_sim_state": 0.03833464860916138, "sim_compute_performance-ego": 0.06718165079752604, "sim_compute_robot_state-ego": 0.0740491493542989, "sim_compute_robot_state-npc0": 0.06872492074966431, "sim_compute_robot_state-npc1": 0.06765748739242554, "sim_compute_robot_state-npc2": 0.06775407393773397, "sim_compute_robot_state-npc3": 0.06815799395243327}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12342779812560144, "sim_physics": 0.18746387041532075, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08510334771231687, "sim_render-ego": 0.06043379123394306, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18321098731114313, "deviation-heading": 0.6594187057635568, "set_robot_commands": 0.09800202112931472, "deviation-center-line": 0.1105180042874409, "driven_lanedir_consec": 0.08510334771231687, "sim_compute_sim_state": 0.03722010209010197, "sim_compute_performance-ego": 0.06870752114516038, "sim_compute_robot_state-ego": 0.07410848140716553, "sim_compute_robot_state-npc0": 0.06977247274838962, "sim_compute_robot_state-npc1": 0.06514666630671574, "sim_compute_robot_state-npc2": 0.06438927467052753, "sim_compute_robot_state-npc3": 0.06716190851651706}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1418542106144053, "sim_physics": 0.19347522335667763, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07484867868460032, "sim_render-ego": 0.0656819958840647, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1694653188028643, "deviation-heading": 0.5625883392197477, "set_robot_commands": 0.0959558948393791, "deviation-center-line": 0.08746265469157435, "driven_lanedir_consec": 0.07484867868460032, "sim_compute_sim_state": 0.041789062561527375, "sim_compute_performance-ego": 0.07379547242195375, "sim_compute_robot_state-ego": 0.07280676595626338, "sim_compute_robot_state-npc0": 0.07201392419876591, "sim_compute_robot_state-npc1": 0.07295213976214009, "sim_compute_robot_state-npc2": 0.07288726683585875, "sim_compute_robot_state-npc3": 0.0730674882088938}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6565742911863668, "sim_physics": 0.1665616982123431, "survival_time": 6.799999999999984, "driven_lanedir": 0.22369468807928392, "sim_render-ego": 0.06329913875635933, "in-drivable-lane": 3.0499999999999936, "agent_compute-ego": 0.17424308201845953, "deviation-heading": 2.872172155748011, "set_robot_commands": 0.0952127102543326, "deviation-center-line": 0.1022089282560985, "driven_lanedir_consec": 0.22369468807928392, "sim_compute_sim_state": 0.04000440765829647, "sim_compute_performance-ego": 0.07093148021137013, "sim_compute_robot_state-ego": 0.07476611172451693, "sim_compute_robot_state-npc0": 0.07003468625685748, "sim_compute_robot_state-npc1": 0.06945035212180194, "sim_compute_robot_state-npc2": 0.06976432484738967, "sim_compute_robot_state-npc3": 0.07049627514446483}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5534133603380018, "sim_physics": 0.16854915142059326, "survival_time": 14.950000000000076, "driven_lanedir": 0.47820139478128487, "sim_render-ego": 0.06431814432144164, "in-drivable-lane": 7.350000000000034, "agent_compute-ego": 0.17384034872055054, "deviation-heading": 5.650546769826332, "set_robot_commands": 0.09747639417648316, "deviation-center-line": 0.2902328148140882, "driven_lanedir_consec": 0.47820139478128487, "sim_compute_sim_state": 0.0396053155263265, "sim_compute_performance-ego": 0.07070090373357137, "sim_compute_robot_state-ego": 0.07669894059499105, "sim_compute_robot_state-npc0": 0.07053784847259521, "sim_compute_robot_state-npc1": 0.07007915576299031, "sim_compute_robot_state-npc2": 0.07008890151977538, "sim_compute_robot_state-npc3": 0.07003012975056966}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.11018966052696016, "sim_physics": 0.17281080114430394, "survival_time": 1.4500000000000006, "driven_lanedir": 0.03700417373868914, "sim_render-ego": 0.061558887876313306, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16474752590574068, "deviation-heading": 0.5935942134064083, "set_robot_commands": 0.09417450839075547, "deviation-center-line": 0.058094519106512664, "driven_lanedir_consec": 0.03700417373868914, "sim_compute_sim_state": 0.0381328401894405, "sim_compute_performance-ego": 0.06756800618664972, "sim_compute_robot_state-ego": 0.0696926528009875, "sim_compute_robot_state-npc0": 0.06949074514980974, "sim_compute_robot_state-npc1": 0.06752959613142342, "sim_compute_robot_state-npc2": 0.07015520950843548, "sim_compute_robot_state-npc3": 0.0677480779845139}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.11939190393472694, "sim_physics": 0.1731755661241936, "survival_time": 1.6500000000000008, "driven_lanedir": 0.046772363860278166, "sim_render-ego": 0.0577561566323945, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1722210320559415, "deviation-heading": 0.5341655512814498, "set_robot_commands": 0.09646473508892638, "deviation-center-line": 0.06663161104884709, "driven_lanedir_consec": 0.046772363860278166, "sim_compute_sim_state": 0.036692417029178505, "sim_compute_performance-ego": 0.06667328603339917, "sim_compute_robot_state-ego": 0.0723239364046039, "sim_compute_robot_state-npc0": 0.06689200979290587, "sim_compute_robot_state-npc1": 0.0698244571685791, "sim_compute_robot_state-npc2": 0.06921179366834236, "sim_compute_robot_state-npc3": 0.06903795762495561}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.602593678184747, "sim_physics": 0.16138318538665772, "survival_time": 14.950000000000076, "driven_lanedir": 0.578861969252721, "sim_render-ego": 0.06337691783905029, "in-drivable-lane": 6.950000000000033, "agent_compute-ego": 0.17444109360376994, "deviation-heading": 5.7249003617368865, "set_robot_commands": 0.09778342962265014, "deviation-center-line": 0.3860329098478613, "driven_lanedir_consec": 0.578861969252721, "sim_compute_sim_state": 0.03936089277267456, "sim_compute_performance-ego": 0.06907296816507975, "sim_compute_robot_state-ego": 0.07581380367279053, "sim_compute_robot_state-npc0": 0.07043318748474121, "sim_compute_robot_state-npc1": 0.06830210208892823, "sim_compute_robot_state-npc2": 0.06952282349268596, "sim_compute_robot_state-npc3": 0.07030684073766072}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4213902669948524, "sim_physics": 0.1588708734512329, "survival_time": 14.950000000000076, "driven_lanedir": 0.47044781515163425, "sim_render-ego": 0.05903428475062052, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16512853940327962, "deviation-heading": 5.752213327417323, "set_robot_commands": 0.09195372899373372, "deviation-center-line": 0.3589128525658105, "driven_lanedir_consec": 0.47044781515163425, "sim_compute_sim_state": 0.035989924271901445, "sim_compute_performance-ego": 0.0671133550008138, "sim_compute_robot_state-ego": 0.07164649804433187, "sim_compute_robot_state-npc0": 0.06542588551839193, "sim_compute_robot_state-npc1": 0.06538055102030436, "sim_compute_robot_state-npc2": 0.06449900309244792, "sim_compute_robot_state-npc3": 0.06507683992385864}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.15818326346729497, "sim_physics": 0.09725253509752678, "survival_time": 1.6500000000000008, "driven_lanedir": 0.05510013025102944, "sim_render-ego": 0.03545076196843928, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.09736391992279976, "deviation-heading": 0.7104917115254321, "set_robot_commands": 0.05554038105588971, "deviation-center-line": 0.027282485519790952, "driven_lanedir_consec": 0.05510013025102944, "sim_compute_sim_state": 0.02316796418392297, "sim_compute_performance-ego": 0.03979704596779563, "sim_compute_robot_state-ego": 0.04110186027758049, "sim_compute_robot_state-npc0": 0.03908587224555738, "sim_compute_robot_state-npc1": 0.03952956922126539, "sim_compute_robot_state-npc2": 0.03872830217534846, "sim_compute_robot_state-npc3": 0.03888133077910452}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.10299023933601764, "sim_physics": 0.08262198621576483, "survival_time": 1.1000000000000003, "driven_lanedir": 0.06418652184737894, "sim_render-ego": 0.035058086568659004, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09824534979733554, "deviation-heading": 0.6355363679687314, "set_robot_commands": 0.05644976009022106, "deviation-center-line": 0.092508268758589, "driven_lanedir_consec": 0.06418652184737894, "sim_compute_sim_state": 0.02280194109136408, "sim_compute_performance-ego": 0.03918931700966575, "sim_compute_robot_state-ego": 0.040906765244223854, "sim_compute_robot_state-npc0": 0.04038342562588779, "sim_compute_robot_state-npc1": 0.03991462967612527, "sim_compute_robot_state-npc2": 0.039489453489130195, "sim_compute_robot_state-npc3": 0.03990938446738503}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.4367811584302546, "sim_physics": 0.08848835468292236, "survival_time": 14.950000000000076, "driven_lanedir": 0.49657883746216536, "sim_render-ego": 0.03627137581507365, "in-drivable-lane": 7.100000000000033, "agent_compute-ego": 0.0993251117070516, "deviation-heading": 5.834450950732524, "set_robot_commands": 0.05522981564203898, "deviation-center-line": 0.513472697884007, "driven_lanedir_consec": 0.49657883746216536, "sim_compute_sim_state": 0.022628060976664224, "sim_compute_performance-ego": 0.03929254134496053, "sim_compute_robot_state-ego": 0.041265888214111326, "sim_compute_robot_state-npc0": 0.040891098181406654, "sim_compute_robot_state-npc1": 0.03970698356628418, "sim_compute_robot_state-npc2": 0.03937402725219727, "sim_compute_robot_state-npc3": 0.03940949281056722}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.12360991581163938, "sim_physics": 0.09416565100351967, "survival_time": 1.5000000000000009, "driven_lanedir": 0.049145823611127515, "sim_render-ego": 0.03669851620992025, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.0993758996327718, "deviation-heading": 0.6389956454260292, "set_robot_commands": 0.05538311799367269, "deviation-center-line": 0.0753920942093212, "driven_lanedir_consec": 0.049145823611127515, "sim_compute_sim_state": 0.022565523783365887, "sim_compute_performance-ego": 0.038694214820861814, "sim_compute_robot_state-ego": 0.041929284731547035, "sim_compute_robot_state-npc0": 0.04177592595418294, "sim_compute_robot_state-npc1": 0.040172235171000166, "sim_compute_robot_state-npc2": 0.04018445014953613, "sim_compute_robot_state-npc3": 0.039882532755533856}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1467304047938315, "sim_physics": 0.09179292706882251, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06808699359121784, "sim_render-ego": 0.03689179700963637, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09828897083506864, "deviation-heading": 0.6350401892676449, "set_robot_commands": 0.05516907748054056, "deviation-center-line": 0.06222724408395405, "driven_lanedir_consec": 0.06808699359121784, "sim_compute_sim_state": 0.02252022659077364, "sim_compute_performance-ego": 0.0391988333533792, "sim_compute_robot_state-ego": 0.0422595879610847, "sim_compute_robot_state-npc0": 0.04044861653271843, "sim_compute_robot_state-npc1": 0.039478238891152775, "sim_compute_robot_state-npc2": 0.03903207358191995, "sim_compute_robot_state-npc3": 0.0393447104622336}}
set_robot_commands_max0.10015040204144908
set_robot_commands_mean0.08277453830941907
set_robot_commands_median0.0952127102543326
set_robot_commands_min0.05516907748054056
sim_compute_performance-ego_max0.07379547242195375
sim_compute_performance-ego_mean0.05916412549875646
sim_compute_performance-ego_median0.06718165079752604
sim_compute_performance-ego_min0.038694214820861814
sim_compute_robot_state-ego_max0.07766435111778369
sim_compute_robot_state-ego_mean0.06313560516708537
sim_compute_robot_state-ego_median0.0723239364046039
sim_compute_robot_state-ego_min0.040906765244223854
sim_compute_robot_state-npc0_max0.07201392419876591
sim_compute_robot_state-npc0_mean0.05977499131777989
sim_compute_robot_state-npc0_median0.06872492074966431
sim_compute_robot_state-npc0_min0.03908587224555738
sim_compute_robot_state-npc1_max0.07295213976214009
sim_compute_robot_state-npc1_mean0.059056848477426
sim_compute_robot_state-npc1_median0.06752959613142342
sim_compute_robot_state-npc1_min0.039478238891152775
sim_compute_robot_state-npc2_max0.07288726683585875
sim_compute_robot_state-npc2_mean0.05911240844960529
sim_compute_robot_state-npc2_median0.06775407393773397
sim_compute_robot_state-npc2_min0.03872830217534846
sim_compute_robot_state-npc3_max0.0730674882088938
sim_compute_robot_state-npc3_mean0.059351334170794856
sim_compute_robot_state-npc3_median0.0677480779845139
sim_compute_robot_state-npc3_min0.03888133077910452
sim_compute_sim_state_max0.041789062561527375
sim_compute_sim_state_mean0.03340345732012429
sim_compute_sim_state_median0.03722010209010197
sim_compute_sim_state_min0.02252022659077364
sim_physics_max0.19347522335667763
sim_physics_mean0.14455377470193814
sim_physics_median0.16138318538665772
sim_physics_min0.08262198621576483
sim_render-ego_max0.0656819958840647
sim_render-ego_mean0.05338997643403123
sim_render-ego_median0.06043379123394306
sim_render-ego_min0.035058086568659004
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.6900000000000235
survival_time_min1.1000000000000003
No reset possible
21371step1-simulationsuccessno0:34:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21346step1-simulationhost-errorno0:29:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2385/step1-simulation-ip-172-31-40-253-32125-job21346/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20606step1-simulationsuccessno0:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19657step1-simulationsuccessno0:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18906step1-simulationsuccessno0:06:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18537step1-simulationsuccessno0:08:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17869step1-simulationsuccessno0:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17565step1-simulationsuccessno0:08:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible