Duckietown Challenges Home Challenges Submissions

Submission 3115

Submission3115
Competingyes
Challengeaido2-LF-sim-testing
UserPeter Almasi 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22604
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22604step1-simulationsuccessyes0:58:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.265086179650402
survival_time_median14.950000000000076
deviation-center-line_median0.8327780829746979
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1553969719040562
agent_compute-ego_mean0.15387822762498468
agent_compute-ego_median0.15397205750147502
agent_compute-ego_min0.1512725791360578
deviation-center-line_max1.4368841835528223
deviation-center-line_mean0.8096430174672471
deviation-center-line_min0.25020571747597103
deviation-heading_max3.370170204626468
deviation-heading_mean2.4583644056110883
deviation-heading_median2.5599750560778407
deviation-heading_min1.392732179016358
driven_any_max2.450687532331145
driven_any_mean2.165260000711855
driven_any_median2.3320268972133453
driven_any_min0.3852175431446918
driven_lanedir_consec_max2.406848342706212
driven_lanedir_consec_mean2.08585303738063
driven_lanedir_consec_min0.35197415653967745
driven_lanedir_max2.406848342706212
driven_lanedir_mean2.08585303738063
driven_lanedir_median2.265086179650402
driven_lanedir_min0.35197415653967745
in-drivable-lane_max2.1500000000000306
in-drivable-lane_mean0.2066666666666696
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3320268972133453, "sim_physics": 0.052921640872955325, "survival_time": 14.950000000000076, "driven_lanedir": 2.3106672714161083, "sim_render-ego": 0.05240263779958089, "in-drivable-lane": 0, "agent_compute-ego": 0.15502432584762574, "deviation-heading": 1.6369635921442525, "set_robot_commands": 0.05123791297276815, "deviation-center-line": 0.5082218339848436, "driven_lanedir_consec": 2.3106672714161083, "sim_compute_sim_state": 0.03883897066116333, "sim_compute_performance-ego": 0.0564526359240214, "sim_compute_robot_state-ego": 0.05558059295018514}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.4425542619345255, "sim_physics": 0.05091135263442993, "survival_time": 14.950000000000076, "driven_lanedir": 2.406848342706212, "sim_render-ego": 0.05213094393412272, "in-drivable-lane": 0, "agent_compute-ego": 0.1530291962623596, "deviation-heading": 1.9247602349665152, "set_robot_commands": 0.05111886898676554, "deviation-center-line": 0.8724494297340905, "driven_lanedir_consec": 2.406848342706212, "sim_compute_sim_state": 0.03907443602879842, "sim_compute_performance-ego": 0.05655974785486857, "sim_compute_robot_state-ego": 0.05546326239903768}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.336728611133094, "sim_physics": 0.04957874933878581, "survival_time": 14.950000000000076, "driven_lanedir": 2.2885765606212622, "sim_render-ego": 0.05238558451334636, "in-drivable-lane": 0, "agent_compute-ego": 0.15312089681625363, "deviation-heading": 2.6072092104997124, "set_robot_commands": 0.05102678219477336, "deviation-center-line": 0.7373792981535404, "driven_lanedir_consec": 2.2885765606212622, "sim_compute_sim_state": 0.03889608065287272, "sim_compute_performance-ego": 0.05627473513285319, "sim_compute_robot_state-ego": 0.05556745529174805}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3852175431446918, "sim_physics": 0.05382790028209418, "survival_time": 3.5499999999999954, "driven_lanedir": 0.35197415653967745, "sim_render-ego": 0.05060514597825601, "in-drivable-lane": 0, "agent_compute-ego": 0.1553969719040562, "deviation-heading": 1.392732179016358, "set_robot_commands": 0.05181411958076584, "deviation-center-line": 0.25020571747597103, "driven_lanedir_consec": 0.35197415653967745, "sim_compute_sim_state": 0.03835783542042047, "sim_compute_performance-ego": 0.056681280404749054, "sim_compute_robot_state-ego": 0.05596863719779001}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2209925401523796, "sim_physics": 0.05058119694391886, "survival_time": 14.950000000000076, "driven_lanedir": 2.1720610115339856, "sim_render-ego": 0.05116540988286336, "in-drivable-lane": 0, "agent_compute-ego": 0.15446340004603068, "deviation-heading": 2.372048849311206, "set_robot_commands": 0.050513160228729245, "deviation-center-line": 1.4368841835528223, "driven_lanedir_consec": 2.1720610115339856, "sim_compute_sim_state": 0.03830893119176229, "sim_compute_performance-ego": 0.05602630058924357, "sim_compute_robot_state-ego": 0.055292173226674395}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3482264395302015, "sim_physics": 0.05107503732045491, "survival_time": 14.950000000000076, "driven_lanedir": 2.2677970818536743, "sim_render-ego": 0.05064964691797892, "in-drivable-lane": 0, "agent_compute-ego": 0.15397205750147502, "deviation-heading": 3.370170204626468, "set_robot_commands": 0.05121188084284464, "deviation-center-line": 0.7488961887566032, "driven_lanedir_consec": 2.2677970818536743, "sim_compute_sim_state": 0.03807097593943278, "sim_compute_performance-ego": 0.05605132023493449, "sim_compute_robot_state-ego": 0.05471371412277222}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.241361628961206, "sim_physics": 0.04969164133071899, "survival_time": 14.950000000000076, "driven_lanedir": 2.207498529859232, "sim_render-ego": 0.050557422637939456, "in-drivable-lane": 0, "agent_compute-ego": 0.15528492212295533, "deviation-heading": 2.239791979416993, "set_robot_commands": 0.05115269422531128, "deviation-center-line": 0.8327780829746979, "driven_lanedir_consec": 2.207498529859232, "sim_compute_sim_state": 0.03831790049870809, "sim_compute_performance-ego": 0.05553229967753093, "sim_compute_robot_state-ego": 0.05512204726537069}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.738027916191508, "sim_physics": 0.05153964421687982, "survival_time": 11.700000000000031, "driven_lanedir": 1.3726874772321092, "sim_render-ego": 0.05137190553877089, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.1512725791360578, "deviation-heading": 2.3564858046261374, "set_robot_commands": 0.05080948324285002, "deviation-center-line": 0.6368359211960509, "driven_lanedir_consec": 1.3726874772321092, "sim_compute_sim_state": 0.03864245435111543, "sim_compute_performance-ego": 0.055636411039238304, "sim_compute_robot_state-ego": 0.05489324198828803}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3833630103515997, "sim_physics": 0.05107306877772013, "survival_time": 14.950000000000076, "driven_lanedir": 2.3434794495898728, "sim_render-ego": 0.05130502780278524, "in-drivable-lane": 0, "agent_compute-ego": 0.1553369156519572, "deviation-heading": 2.522948502785866, "set_robot_commands": 0.051132065455118815, "deviation-center-line": 0.7204716569082078, "driven_lanedir_consec": 2.3434794495898728, "sim_compute_sim_state": 0.03903297344843547, "sim_compute_performance-ego": 0.056519540150960286, "sim_compute_robot_state-ego": 0.05608772039413453}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.2650163360706586, "sim_physics": 0.05137864192326864, "survival_time": 14.950000000000076, "driven_lanedir": 2.1947386107865716, "sim_render-ego": 0.05124095916748047, "in-drivable-lane": 0, "agent_compute-ego": 0.15426623344421386, "deviation-heading": 2.8643503157133994, "set_robot_commands": 0.05123974482218425, "deviation-center-line": 0.9066567756170754, "driven_lanedir_consec": 2.1947386107865716, "sim_compute_sim_state": 0.038587108453114825, "sim_compute_performance-ego": 0.05516286214192708, "sim_compute_robot_state-ego": 0.054502744674682614}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.3250441444842935, "sim_physics": 0.04979526360829671, "survival_time": 14.950000000000076, "driven_lanedir": 2.2644608858820616, "sim_render-ego": 0.051837990283966066, "in-drivable-lane": 0, "agent_compute-ego": 0.15377970854441325, "deviation-heading": 2.6569594864213957, "set_robot_commands": 0.05059511184692383, "deviation-center-line": 1.0158229837127442, "driven_lanedir_consec": 2.2644608858820616, "sim_compute_sim_state": 0.03959852377573649, "sim_compute_performance-ego": 0.05666174809137981, "sim_compute_robot_state-ego": 0.05524249156316122}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.2371638750268037, "sim_physics": 0.0502588431040446, "survival_time": 14.950000000000076, "driven_lanedir": 2.1830362805477543, "sim_render-ego": 0.05123042583465576, "in-drivable-lane": 0, "agent_compute-ego": 0.15430175065994262, "deviation-heading": 2.878019764669697, "set_robot_commands": 0.05089955965677897, "deviation-center-line": 0.9831682329104716, "driven_lanedir_consec": 2.1830362805477543, "sim_compute_sim_state": 0.03784526030222575, "sim_compute_performance-ego": 0.056309749285380045, "sim_compute_robot_state-ego": 0.05508612314860026}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.3838160227542673, "sim_physics": 0.05045608441034953, "survival_time": 14.950000000000076, "driven_lanedir": 2.310430187037272, "sim_render-ego": 0.050858573118845625, "in-drivable-lane": 0, "agent_compute-ego": 0.15339535633722942, "deviation-heading": 2.8469047844412105, "set_robot_commands": 0.0503688104947408, "deviation-center-line": 1.064229477379346, "driven_lanedir_consec": 2.310430187037272, "sim_compute_sim_state": 0.03863373597462972, "sim_compute_performance-ego": 0.05605010032653809, "sim_compute_robot_state-ego": 0.05519638220469157}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.3886732513981044, "sim_physics": 0.048349409103393554, "survival_time": 14.950000000000076, "driven_lanedir": 2.348453535453254, "sim_render-ego": 0.05060897906621297, "in-drivable-lane": 0, "agent_compute-ego": 0.15242093086242675, "deviation-heading": 2.5599750560778407, "set_robot_commands": 0.05113851229349772, "deviation-center-line": 0.5938992894786003, "driven_lanedir_consec": 2.348453535453254, "sim_compute_sim_state": 0.03799171209335327, "sim_compute_performance-ego": 0.05537664333979289, "sim_compute_robot_state-ego": 0.05498829523722331}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.450687532331145, "sim_physics": 0.049576581319173176, "survival_time": 14.950000000000076, "driven_lanedir": 2.265086179650402, "sim_render-ego": 0.05225190321604411, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.15310816923777262, "deviation-heading": 2.6461461194492677, "set_robot_commands": 0.05025582154591878, "deviation-center-line": 0.8367461901736414, "driven_lanedir_consec": 2.265086179650402, "sim_compute_sim_state": 0.03827354669570923, "sim_compute_performance-ego": 0.05662265539169312, "sim_compute_robot_state-ego": 0.05563862800598145}}
set_robot_commands_max0.05181411958076584
set_robot_commands_mean0.05096763522599809
set_robot_commands_median0.05111886898676554
set_robot_commands_min0.05025582154591878
sim_compute_performance-ego_max0.056681280404749054
sim_compute_performance-ego_mean0.05612786863900739
sim_compute_performance-ego_median0.05627473513285319
sim_compute_performance-ego_min0.05516286214192708
sim_compute_robot_state-ego_max0.05608772039413453
sim_compute_robot_state-ego_mean0.055289567311356064
sim_compute_robot_state-ego_median0.05524249156316122
sim_compute_robot_state-ego_min0.054502744674682614
sim_compute_sim_state_max0.03959852377573649
sim_compute_sim_state_mean0.03856469636583189
sim_compute_sim_state_median0.038587108453114825
sim_compute_sim_state_min0.03784526030222575
sim_physics_max0.05382790028209418
sim_physics_mean0.05073433701243228
sim_physics_median0.05058119694391886
sim_physics_min0.048349409103393554
sim_render-ego_max0.05240263779958089
sim_render-ego_mean0.0513735037128566
sim_render-ego_median0.05124095916748047
sim_render-ego_min0.050557422637939456
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.973333333333402
survival_time_min3.5499999999999954
No reset possible
21410step1-simulationsuccessno0:37:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21408step1-simulationhost-errorno0:03:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3115/step1-simulation-ip-172-31-25-98-2062-job21408/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21407step1-simulationsuccessno0:53:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible