Duckietown Challenges Home Challenges Submissions

Submission 3301

Submission3301
Competingyes
Challengeaido2-LF-sim-validation
Userjiang peng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22439
Next
User labelSecond test - TH-jp
Admin priority50
Blessingn/a
User priority50

22439

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22439step1-simulationsuccessyes0:22:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.277675663625946
survival_time_median11.850000000000032
deviation-center-line_median0.8886969567993961
in-drivable-lane_median0.10000000000000142


other stats
agent_compute-ego_max0.1884143845788364
agent_compute-ego_mean0.17580563090527862
agent_compute-ego_median0.1779572068387446
agent_compute-ego_min0.1571871320406596
deviation-center-line_max1.0828531246789004
deviation-center-line_mean0.7780028352880441
deviation-center-line_min0.10113732086592696
deviation-heading_max4.75038184552419
deviation-heading_mean2.6149115092950295
deviation-heading_median2.4604686313196007
deviation-heading_min0.3621924595420643
driven_any_max3.629372669449184
driven_any_mean1.8764653258972304
driven_any_median1.8567245060698072
driven_any_min0.5134142970944952
driven_lanedir_consec_max2.865796262936026
driven_lanedir_consec_mean1.4309917409469897
driven_lanedir_consec_min0.4863604838511888
driven_lanedir_max2.865796262936026
driven_lanedir_mean1.56256603655931
driven_lanedir_median1.6678210529921635
driven_lanedir_min0.4863604838511888
in-drivable-lane_max1.400000000000012
in-drivable-lane_mean0.5200000000000019
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5134142970944952, "sim_physics": 0.13707632031934014, "survival_time": 1.4500000000000006, "driven_lanedir": 0.4863604838511888, "sim_render-ego": 0.0669920773341738, "in-drivable-lane": 0, "agent_compute-ego": 0.1884143845788364, "deviation-heading": 0.3621924595420643, "set_robot_commands": 0.10318590032643284, "deviation-center-line": 0.10113732086592696, "driven_lanedir_consec": 0.4863604838511888, "sim_compute_sim_state": 0.041925627609779095, "sim_compute_performance-ego": 0.07242200292389968, "sim_compute_robot_state-ego": 0.0771156015067265}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8567245060698072, "sim_physics": 0.11178285260743732, "survival_time": 11.850000000000032, "driven_lanedir": 1.6678210529921635, "sim_render-ego": 0.06457287148584294, "in-drivable-lane": 0, "agent_compute-ego": 0.1779572068387446, "deviation-heading": 2.2066824892397583, "set_robot_commands": 0.1011950758439076, "deviation-center-line": 0.8886969567993961, "driven_lanedir_consec": 1.6678210529921635, "sim_compute_sim_state": 0.04103765004797827, "sim_compute_performance-ego": 0.07351804886186174, "sim_compute_robot_state-ego": 0.07788434612097117}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.629372669449184, "sim_physics": 0.10547150055567424, "survival_time": 14.950000000000076, "driven_lanedir": 2.865796262936026, "sim_render-ego": 0.06270131826400757, "in-drivable-lane": 1.400000000000012, "agent_compute-ego": 0.17055782397588093, "deviation-heading": 3.2948321208495344, "set_robot_commands": 0.0901597269376119, "deviation-center-line": 0.9765259220890452, "driven_lanedir_consec": 2.865796262936026, "sim_compute_sim_state": 0.03658454497655233, "sim_compute_performance-ego": 0.06434880733489991, "sim_compute_robot_state-ego": 0.07472690343856811}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1205829569142365, "sim_physics": 0.1231828067334778, "survival_time": 11.150000000000023, "driven_lanedir": 0.8573052413296254, "sim_render-ego": 0.066736763368273, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.18491160709227147, "deviation-heading": 2.4604686313196007, "set_robot_commands": 0.1006142579921158, "deviation-center-line": 0.8408008520069524, "driven_lanedir_consec": 0.8573052413296254, "sim_compute_sim_state": 0.04137467696527729, "sim_compute_performance-ego": 0.07319483307979567, "sim_compute_robot_state-ego": 0.08251360179062917}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2622321999584303, "sim_physics": 0.10698526779810588, "survival_time": 14.950000000000076, "driven_lanedir": 1.935547141687548, "sim_render-ego": 0.05562561432520549, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.1571871320406596, "deviation-heading": 4.75038184552419, "set_robot_commands": 0.0871495787302653, "deviation-center-line": 1.0828531246789004, "driven_lanedir_consec": 1.277675663625946, "sim_compute_sim_state": 0.0361199418703715, "sim_compute_performance-ego": 0.06343640883763631, "sim_compute_robot_state-ego": 0.06941769282023112}}
set_robot_commands_max0.10318590032643284
set_robot_commands_mean0.09646090796606668
set_robot_commands_median0.1006142579921158
set_robot_commands_min0.0871495787302653
sim_compute_performance-ego_max0.07351804886186174
sim_compute_performance-ego_mean0.06938402020761866
sim_compute_performance-ego_median0.07242200292389968
sim_compute_performance-ego_min0.06343640883763631
sim_compute_robot_state-ego_max0.08251360179062917
sim_compute_robot_state-ego_mean0.07633162913542521
sim_compute_robot_state-ego_median0.0771156015067265
sim_compute_robot_state-ego_min0.06941769282023112
sim_compute_sim_state_max0.041925627609779095
sim_compute_sim_state_mean0.0394084882939917
sim_compute_sim_state_median0.04103765004797827
sim_compute_sim_state_min0.0361199418703715
sim_physics_max0.13707632031934014
sim_physics_mean0.11689974960280708
sim_physics_median0.11178285260743732
sim_physics_min0.10547150055567424
sim_render-ego_max0.0669920773341738
sim_render-ego_mean0.06332572895550057
sim_render-ego_median0.06457287148584294
sim_render-ego_min0.05562561432520549
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.870000000000042
survival_time_min1.4500000000000006
No reset possible
21835step1-simulationsuccessno0:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21825step1-simulationtimeoutno1:05:56
I can see how the jo [...]
I can see how the job 21825 is timeout because passed 3956 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21824step1-simulationhost-errorno0:10:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3301/step1-simulation-ip-172-31-38-104-5197-job21824/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible