Duckietown Challenges Home Challenges Submissions

Submission 2444

Submission2444
Competingyes
Challengeaido2-LFVI-sim-validation
UserJacopo Tani
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22971
Next
User labelrandom_agent
Admin priority50
Blessingn/a
User priority50

22971

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-1-0

udem1-2-0

udem1-3-0

udem1-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22971step1-simulationsuccessyes0:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.17048288243157522
agent_compute-ego_mean0.15960002402231888
agent_compute-ego_median0.15708462397257486
agent_compute-ego_min0.15541604161262512
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.2178357884853701, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06552296952356267, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15821532056301454, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10205837141109418, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04137729391267028, "sim_compute_performance-ego": 0.07199225848234153, "sim_compute_robot_state-ego": 0.08304874806464473, "sim_compute_robot_state-npc0": 0.0722465213341049, "sim_compute_robot_state-npc1": 0.07363585278957704, "sim_compute_robot_state-npc2": 0.07268159298957148, "sim_compute_robot_state-npc3": 0.07386917705777325}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2562669175011771, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06798212017331805, "in-drivable-lane": 0, "agent_compute-ego": 0.17048288243157522, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10050207376480104, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04157194920948574, "sim_compute_performance-ego": 0.07608881167003087, "sim_compute_robot_state-ego": 0.08950325420924596, "sim_compute_robot_state-npc0": 0.07084948675973075, "sim_compute_robot_state-npc1": 0.07331403664180211, "sim_compute_robot_state-npc2": 0.07479562078203474, "sim_compute_robot_state-npc3": 0.07380859340940203}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20428892709676505, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.062260051375453915, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15680125153180466, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10158487662528325, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04344079563918623, "sim_compute_performance-ego": 0.07111561414107535, "sim_compute_robot_state-ego": 0.07650315877303336, "sim_compute_robot_state-npc0": 0.07291740815616349, "sim_compute_robot_state-npc1": 0.07123122631924823, "sim_compute_robot_state-npc2": 0.06960797309875488, "sim_compute_robot_state-npc3": 0.07227968938142351}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.22287070751190183, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06381108860174815, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15541604161262512, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09541623791058858, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03916416565577189, "sim_compute_performance-ego": 0.0696339209874471, "sim_compute_robot_state-ego": 0.07935616374015808, "sim_compute_robot_state-npc0": 0.07095393538475037, "sim_compute_robot_state-npc1": 0.07111405332883199, "sim_compute_robot_state-npc2": 0.07226763168970744, "sim_compute_robot_state-npc3": 0.07107387979825337}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2139339901152111, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06631766046796526, "in-drivable-lane": 0, "agent_compute-ego": 0.15708462397257486, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10039934657868883, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04151311374845959, "sim_compute_performance-ego": 0.0750502518245152, "sim_compute_robot_state-ego": 0.07292606717064268, "sim_compute_robot_state-npc0": 0.07088905289059594, "sim_compute_robot_state-npc1": 0.07236727078755696, "sim_compute_robot_state-npc2": 0.06825242723737444, "sim_compute_robot_state-npc3": 0.07494154430571057}}
set_robot_commands_max0.10205837141109418
set_robot_commands_mean0.09999218125809116
set_robot_commands_median0.10050207376480104
set_robot_commands_min0.09541623791058858
sim_compute_performance-ego_max0.07608881167003087
sim_compute_performance-ego_mean0.072776171421082
sim_compute_performance-ego_median0.07199225848234153
sim_compute_performance-ego_min0.0696339209874471
sim_compute_robot_state-ego_max0.08950325420924596
sim_compute_robot_state-ego_mean0.08026747839154495
sim_compute_robot_state-ego_median0.07935616374015808
sim_compute_robot_state-ego_min0.07292606717064268
sim_compute_robot_state-npc0_max0.07291740815616349
sim_compute_robot_state-npc0_mean0.07157128090506909
sim_compute_robot_state-npc0_median0.07095393538475037
sim_compute_robot_state-npc0_min0.07084948675973075
sim_compute_robot_state-npc1_max0.07363585278957704
sim_compute_robot_state-npc1_mean0.07233248797340326
sim_compute_robot_state-npc1_median0.07236727078755696
sim_compute_robot_state-npc1_min0.07111405332883199
sim_compute_robot_state-npc2_max0.07479562078203474
sim_compute_robot_state-npc2_mean0.0715210491594886
sim_compute_robot_state-npc2_median0.07226763168970744
sim_compute_robot_state-npc2_min0.06825242723737444
sim_compute_robot_state-npc3_max0.07494154430571057
sim_compute_robot_state-npc3_mean0.07319457679051256
sim_compute_robot_state-npc3_median0.07380859340940203
sim_compute_robot_state-npc3_min0.07107387979825337
sim_compute_sim_state_max0.04344079563918623
sim_compute_sim_state_mean0.041413463633114746
sim_compute_sim_state_median0.04151311374845959
sim_compute_sim_state_min0.03916416565577189
sim_physics_max0.2562669175011771
sim_physics_mean0.22303926614208505
sim_physics_median0.2178357884853701
sim_physics_min0.20428892709676505
sim_render-ego_max0.06798212017331805
sim_render-ego_mean0.06517877802840961
sim_render-ego_median0.06552296952356267
sim_render-ego_min0.062260051375453915
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
21292step1-simulationsuccessno0:09:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21270step1-simulationhost-errorno0:07:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2444/step1-simulation-ip-172-31-38-104-5197-job21270/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20558step1-simulationsuccessno0:08:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19597step1-simulationsuccessno0:08:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18853step1-simulationsuccessno0:10:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18492step1-simulationsuccessno0:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17932step1-simulationsuccessno0:05:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17825step1-simulationsuccessno0:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17618step1-simulationsuccessno0:06:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible