Duckietown Challenges Home Challenges Submissions

Submission 3328

Submission3328
Competingyes
Challengeaido2-LFV-sim-validation
Userjiang peng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22407
Next
User labelRL - TH -xyz
Admin priority50
Blessingn/a
User priority50

22407

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22407step1-simulationsuccessyes0:11:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.227819515552722
survival_time_median5.799999999999987
deviation-center-line_median0.22386875522206823
in-drivable-lane_median1.4499999999999948


other stats
agent_compute-ego_max0.1874852180480957
agent_compute-ego_mean0.18004823055148172
agent_compute-ego_median0.18359124369737576
agent_compute-ego_min0.1695663542360873
deviation-center-line_max0.4305492360948032
deviation-center-line_mean0.2427194205077623
deviation-center-line_min0.12290248816951904
deviation-heading_max2.352856747169026
deviation-heading_mean1.0506874496921812
deviation-heading_median0.7176770483640806
deviation-heading_min0.6099402965886649
driven_any_max1.7192664304834346
driven_any_mean1.2511217070796443
driven_any_median1.5978390101871738
driven_any_min0.3080067169334595
driven_lanedir_consec_max1.2445934083383023
driven_lanedir_consec_mean0.9234546878934644
driven_lanedir_consec_min0.2587589692083694
driven_lanedir_max1.2445934083383023
driven_lanedir_mean0.9267754187677676
driven_lanedir_median1.2365591490514087
driven_lanedir_min0.2587589692083694
in-drivable-lane_max1.6999999999999966
in-drivable-lane_mean1.1899999999999964
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0310896536940737, "sim_physics": 0.09291348876533928, "survival_time": 4.549999999999992, "driven_lanedir": 0.6495423973165191, "sim_render-ego": 0.057694809777396064, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1726825263474014, "deviation-heading": 0.7176770483640806, "set_robot_commands": 0.07646369148086715, "deviation-center-line": 0.22386875522206823, "driven_lanedir_consec": 0.6495423973165191, "sim_compute_sim_state": 0.03389178527580513, "sim_compute_performance-ego": 0.06092306021805648, "sim_compute_robot_state-ego": 0.060767142327277215, "sim_compute_robot_state-npc0": 0.06636866894397107, "sim_compute_robot_state-npc1": 0.06290915248158215, "sim_compute_robot_state-npc2": 0.061598513152573135, "sim_compute_robot_state-npc3": 0.061416990154392115}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3080067169334595, "sim_physics": 0.10154511477496173, "survival_time": 1.850000000000001, "driven_lanedir": 0.2587589692083694, "sim_render-ego": 0.05773340044794856, "in-drivable-lane": 0, "agent_compute-ego": 0.1695663542360873, "deviation-heading": 0.9349624220681668, "set_robot_commands": 0.07586627393155485, "deviation-center-line": 0.12290248816951904, "driven_lanedir_consec": 0.2587589692083694, "sim_compute_sim_state": 0.035546998719911314, "sim_compute_performance-ego": 0.06304561769640124, "sim_compute_robot_state-ego": 0.06304141637441274, "sim_compute_robot_state-npc0": 0.07010271742537215, "sim_compute_robot_state-npc1": 0.06242302946142248, "sim_compute_robot_state-npc2": 0.06101175901052114, "sim_compute_robot_state-npc3": 0.063053002228608}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5978390101871738, "sim_physics": 0.10044576176281632, "survival_time": 5.799999999999987, "driven_lanedir": 1.2445934083383023, "sim_render-ego": 0.05622075343954152, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1874852180480957, "deviation-heading": 0.6099402965886649, "set_robot_commands": 0.07629847937616809, "deviation-center-line": 0.1768586536968656, "driven_lanedir_consec": 1.2445934083383023, "sim_compute_sim_state": 0.03474992719189874, "sim_compute_performance-ego": 0.0606634966258345, "sim_compute_robot_state-ego": 0.05991466497552806, "sim_compute_robot_state-npc0": 0.06742263251337512, "sim_compute_robot_state-npc1": 0.06316429376602173, "sim_compute_robot_state-npc2": 0.062200116700139536, "sim_compute_robot_state-npc3": 0.06083532037406132}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.599406724100081, "sim_physics": 0.10042242861505764, "survival_time": 6.699999999999984, "driven_lanedir": 1.2365591490514087, "sim_render-ego": 0.057240123179421495, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.18691581042844857, "deviation-heading": 0.6380007342709684, "set_robot_commands": 0.0775475751108198, "deviation-center-line": 0.4305492360948032, "driven_lanedir_consec": 1.2365591490514087, "sim_compute_sim_state": 0.03502555391681728, "sim_compute_performance-ego": 0.060114931704393075, "sim_compute_robot_state-ego": 0.06145497934142156, "sim_compute_robot_state-npc0": 0.06833919482444649, "sim_compute_robot_state-npc1": 0.06316670375083809, "sim_compute_robot_state-npc2": 0.06123581217296088, "sim_compute_robot_state-npc3": 0.06167893623238179}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7192664304834346, "sim_physics": 0.09126594153846182, "survival_time": 8.199999999999982, "driven_lanedir": 1.2444231699242378, "sim_render-ego": 0.057317038861716664, "in-drivable-lane": 1.6999999999999966, "agent_compute-ego": 0.18359124369737576, "deviation-heading": 2.352856747169026, "set_robot_commands": 0.07545680970680423, "deviation-center-line": 0.2594179693555554, "driven_lanedir_consec": 1.227819515552722, "sim_compute_sim_state": 0.03433303571328884, "sim_compute_performance-ego": 0.0601655273902707, "sim_compute_robot_state-ego": 0.06169008191038922, "sim_compute_robot_state-npc0": 0.0668684200542729, "sim_compute_robot_state-npc1": 0.0626609659776455, "sim_compute_robot_state-npc2": 0.06146310887685636, "sim_compute_robot_state-npc3": 0.06112768155772511}}
set_robot_commands_max0.0775475751108198
set_robot_commands_mean0.07632656592124283
set_robot_commands_median0.07629847937616809
set_robot_commands_min0.07545680970680423
sim_compute_performance-ego_max0.06304561769640124
sim_compute_performance-ego_mean0.060982526726991206
sim_compute_performance-ego_median0.0606634966258345
sim_compute_performance-ego_min0.060114931704393075
sim_compute_robot_state-ego_max0.06304141637441274
sim_compute_robot_state-ego_mean0.061373656985805755
sim_compute_robot_state-ego_median0.06145497934142156
sim_compute_robot_state-ego_min0.05991466497552806
sim_compute_robot_state-npc0_max0.07010271742537215
sim_compute_robot_state-npc0_mean0.06782032675228755
sim_compute_robot_state-npc0_median0.06742263251337512
sim_compute_robot_state-npc0_min0.06636866894397107
sim_compute_robot_state-npc1_max0.06316670375083809
sim_compute_robot_state-npc1_mean0.06286482908750199
sim_compute_robot_state-npc1_median0.06290915248158215
sim_compute_robot_state-npc1_min0.06242302946142248
sim_compute_robot_state-npc2_max0.062200116700139536
sim_compute_robot_state-npc2_mean0.061501861982610206
sim_compute_robot_state-npc2_median0.06146310887685636
sim_compute_robot_state-npc2_min0.06101175901052114
sim_compute_robot_state-npc3_max0.063053002228608
sim_compute_robot_state-npc3_mean0.06162238610943367
sim_compute_robot_state-npc3_median0.061416990154392115
sim_compute_robot_state-npc3_min0.06083532037406132
sim_compute_sim_state_max0.035546998719911314
sim_compute_sim_state_mean0.03470946016354426
sim_compute_sim_state_median0.03474992719189874
sim_compute_sim_state_min0.03389178527580513
sim_physics_max0.10154511477496173
sim_physics_mean0.09731854709132735
sim_physics_median0.10042242861505764
sim_physics_min0.09126594153846182
sim_render-ego_max0.05773340044794856
sim_render-ego_mean0.05724122514120487
sim_render-ego_median0.057317038861716664
sim_render-ego_min0.05622075343954152
simulation-passed1
survival_time_max8.199999999999982
survival_time_mean5.419999999999989
survival_time_min1.850000000000001
No reset possible
21871step1-simulationsuccessno0:10:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21870step1-simulationhost-errorno0:05:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission3328/step1-simulation-ip-172-31-40-253-32059-job21870/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21869step1-simulationhost-errorno0:05:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission3328/step1-simulation-ip-172-31-42-167-7194-job21869/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible