Duckietown Challenges Home Challenges Submissions

Submission 3269

Submission3269
Competingyes
Challengeaido2-LFVI-sim-validation
Userjiang peng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22478
Next
User labelFirst test - TH
Admin priority50
Blessingn/a
User priority50

22478

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-1-0

udem1-2-0

udem1-3-0

udem1-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22478step1-simulationsuccessyes0:43:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1928627733177803
survival_time_median14.950000000000076
deviation-center-line_median1.1297102345353156
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.2079839245478312
agent_compute-ego_mean0.19514523347218832
agent_compute-ego_median0.19732200304667155
agent_compute-ego_min0.1745238161087036
deviation-center-line_max1.2984984168083928
deviation-center-line_mean1.1400954475767242
deviation-center-line_min0.920973641706334
deviation-heading_max8.912481499087207
deviation-heading_mean3.9627203809520735
deviation-heading_median2.9925279061212793
deviation-heading_min2.149066894730949
driven_any_max4.747063545019325
driven_any_mean3.694730054188277
driven_any_median4.429396121543521
driven_any_min0.6029833071425168
driven_lanedir_consec_max4.166887183074564
driven_lanedir_consec_mean2.982007677042271
driven_lanedir_consec_min0.5956261393744722
driven_lanedir_max4.167033237939997
driven_lanedir_mean2.9821559319242583
driven_lanedir_median3.193318419631921
driven_lanedir_min0.5956261393744722
in-drivable-lane_max4.300000000000035
in-drivable-lane_mean1.8900000000000137
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 4.686055497549962, "sim_physics": 0.21097280899683635, "survival_time": 14.950000000000076, "driven_lanedir": 4.167033237939997, "sim_render-ego": 0.0679859749476115, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.19972487449645995, "deviation-heading": 2.9925279061212793, "set_robot_commands": 0.10377381086349488, "deviation-center-line": 1.1297102345353156, "driven_lanedir_consec": 4.166887183074564, "sim_compute_sim_state": 0.042455898920694984, "sim_compute_performance-ego": 0.07368861834208171, "sim_compute_robot_state-ego": 0.07952031453450521, "sim_compute_robot_state-npc0": 0.07603556474049886, "sim_compute_robot_state-npc1": 0.07492805163065593, "sim_compute_robot_state-npc2": 0.0741956361134847, "sim_compute_robot_state-npc3": 0.07471672455469767}, "udem1-1-0": {"driven_any": 0.6029833071425168, "sim_physics": 0.21542454719543455, "survival_time": 14.950000000000076, "driven_lanedir": 0.5956261393744722, "sim_render-ego": 0.06651774644851685, "in-drivable-lane": 0, "agent_compute-ego": 0.1961715491612752, "deviation-heading": 8.912481499087207, "set_robot_commands": 0.10470554987589518, "deviation-center-line": 1.2879434971893793, "driven_lanedir_consec": 0.5956261393744722, "sim_compute_sim_state": 0.043823493321736656, "sim_compute_performance-ego": 0.07483383178710938, "sim_compute_robot_state-ego": 0.08134915033976237, "sim_compute_robot_state-npc0": 0.0773846975962321, "sim_compute_robot_state-npc1": 0.07506900707880657, "sim_compute_robot_state-npc2": 0.07553852558135986, "sim_compute_robot_state-npc3": 0.07659899791081747}, "udem1-2-0": {"driven_any": 4.429396121543521, "sim_physics": 0.21626497189203897, "survival_time": 14.950000000000076, "driven_lanedir": 3.193318419631921, "sim_render-ego": 0.06271966536839803, "in-drivable-lane": 4.300000000000035, "agent_compute-ego": 0.1745238161087036, "deviation-heading": 3.1827753581112717, "set_robot_commands": 0.09222187121709188, "deviation-center-line": 0.920973641706334, "driven_lanedir_consec": 3.1928627733177803, "sim_compute_sim_state": 0.03859273036321005, "sim_compute_performance-ego": 0.07032028913497924, "sim_compute_robot_state-ego": 0.07235512097676595, "sim_compute_robot_state-npc0": 0.06822649319966634, "sim_compute_robot_state-npc1": 0.06763775825500488, "sim_compute_robot_state-npc2": 0.06794969956080119, "sim_compute_robot_state-npc3": 0.06927379767100016}, "udem1-3-0": {"driven_any": 4.747063545019325, "sim_physics": 0.23000691811243693, "survival_time": 14.950000000000076, "driven_lanedir": 3.141748953177258, "sim_render-ego": 0.07314892053604126, "in-drivable-lane": 4.250000000000031, "agent_compute-ego": 0.19732200304667155, "deviation-heading": 2.576750246709662, "set_robot_commands": 0.10507477045059203, "deviation-center-line": 1.0633514476441996, "driven_lanedir_consec": 3.1416093799468965, "sim_compute_sim_state": 0.04192545652389526, "sim_compute_performance-ego": 0.07542896270751953, "sim_compute_robot_state-ego": 0.08101131836573283, "sim_compute_robot_state-npc0": 0.07587045590082804, "sim_compute_robot_state-npc1": 0.07493554830551147, "sim_compute_robot_state-npc2": 0.07319547176361084, "sim_compute_robot_state-npc3": 0.07258665720621744}, "udem1-4-0": {"driven_any": 4.008151799686058, "sim_physics": 0.24317551374435423, "survival_time": 14.950000000000076, "driven_lanedir": 3.8130529094976415, "sim_render-ego": 0.07025822877883911, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.2079839245478312, "deviation-heading": 2.149066894730949, "set_robot_commands": 0.10837629238764444, "deviation-center-line": 1.2984984168083928, "driven_lanedir_consec": 3.8130529094976415, "sim_compute_sim_state": 0.043574086030324304, "sim_compute_performance-ego": 0.07784417470296225, "sim_compute_robot_state-ego": 0.08486685991287231, "sim_compute_robot_state-npc0": 0.07758621215820312, "sim_compute_robot_state-npc1": 0.07805768569310506, "sim_compute_robot_state-npc2": 0.07967583735783895, "sim_compute_robot_state-npc3": 0.077426704565684}}
set_robot_commands_max0.10837629238764444
set_robot_commands_mean0.10283045895894367
set_robot_commands_median0.10470554987589518
set_robot_commands_min0.09222187121709188
sim_compute_performance-ego_max0.07784417470296225
sim_compute_performance-ego_mean0.07442317533493041
sim_compute_performance-ego_median0.07483383178710938
sim_compute_performance-ego_min0.07032028913497924
sim_compute_robot_state-ego_max0.08486685991287231
sim_compute_robot_state-ego_mean0.07982055282592773
sim_compute_robot_state-ego_median0.08101131836573283
sim_compute_robot_state-ego_min0.07235512097676595
sim_compute_robot_state-npc0_max0.07758621215820312
sim_compute_robot_state-npc0_mean0.07502068471908568
sim_compute_robot_state-npc0_median0.07603556474049886
sim_compute_robot_state-npc0_min0.06822649319966634
sim_compute_robot_state-npc1_max0.07805768569310506
sim_compute_robot_state-npc1_mean0.07412561019261679
sim_compute_robot_state-npc1_median0.07493554830551147
sim_compute_robot_state-npc1_min0.06763775825500488
sim_compute_robot_state-npc2_max0.07967583735783895
sim_compute_robot_state-npc2_mean0.07411103407541911
sim_compute_robot_state-npc2_median0.0741956361134847
sim_compute_robot_state-npc2_min0.06794969956080119
sim_compute_robot_state-npc3_max0.077426704565684
sim_compute_robot_state-npc3_mean0.07412057638168335
sim_compute_robot_state-npc3_median0.07471672455469767
sim_compute_robot_state-npc3_min0.06927379767100016
sim_compute_sim_state_max0.043823493321736656
sim_compute_sim_state_mean0.04207433303197225
sim_compute_sim_state_median0.042455898920694984
sim_compute_sim_state_min0.03859273036321005
sim_physics_max0.24317551374435423
sim_physics_mean0.2231689519882202
sim_physics_median0.21626497189203897
sim_physics_min0.21097280899683635
sim_render-ego_max0.07314892053604126
sim_render-ego_mean0.06812610721588135
sim_render-ego_median0.0679859749476115
sim_render-ego_min0.06271966536839803
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
21789step1-simulationsuccessno0:22:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21787step1-simulationhost-errorno0:04:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission3269/step1-simulation-ip-172-31-40-253-32059-job21787/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible