Duckietown Challenges Home Challenges Submissions

Submission 3346

Submission3346
Competingyes
Challengeaido2-LFVI-sim-validation
UserAnastasiya Nikolskaya 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22384
Next
User labelJetBrains Research
Admin priority50
Blessingn/a
User priority50

22384

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-1-0

udem1-2-0

udem1-3-0

udem1-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22384step1-simulationsuccessyes0:31:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2212724092692753
survival_time_median8.04999999999998
deviation-center-line_median0.5751850080662609
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14516848531262627
agent_compute-ego_mean0.12100714652603715
agent_compute-ego_median0.12144958843355594
agent_compute-ego_min0.09273682369126214
deviation-center-line_max1.3080756021175788
deviation-center-line_mean0.5939588800297929
deviation-center-line_min0.208564180438624
deviation-heading_max2.921567128325301
deviation-heading_mean1.721839859503752
deviation-heading_median1.7119748285646246
deviation-heading_min0.549147402377039
driven_any_max2.901127713204258
driven_any_mean1.2901607397496293
driven_any_median1.265812593699502
driven_any_min0.4607767819960878
driven_lanedir_consec_max2.6545548101656244
driven_lanedir_consec_mean1.19127017173932
driven_lanedir_consec_min0.3769531596616167
driven_lanedir_max2.6545548101656244
driven_lanedir_mean1.1917305681457298
driven_lanedir_median1.2212724092692753
driven_lanedir_min0.3769531596616167
in-drivable-lane_max1.649999999999994
in-drivable-lane_mean0.3399999999999988
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.4607767819960878, "sim_physics": 0.19737310542000663, "survival_time": 3.599999999999995, "driven_lanedir": 0.3769531596616167, "sim_render-ego": 0.0628097587161594, "in-drivable-lane": 0, "agent_compute-ego": 0.09273682369126214, "deviation-heading": 1.6746913678877264, "set_robot_commands": 0.11173269152641296, "deviation-center-line": 0.21258867457836844, "driven_lanedir_consec": 0.3769531596616167, "sim_compute_sim_state": 0.03946675194634332, "sim_compute_performance-ego": 0.06972758968671162, "sim_compute_robot_state-ego": 0.07770977748764886, "sim_compute_robot_state-npc0": 0.07552058166927761, "sim_compute_robot_state-npc1": 0.07585479484664069, "sim_compute_robot_state-npc2": 0.07228695684009129, "sim_compute_robot_state-npc3": 0.06667009658283657}, "udem1-1-0": {"driven_any": 1.265812593699502, "sim_physics": 0.2580698691539883, "survival_time": 8.04999999999998, "driven_lanedir": 1.2212724092692753, "sim_render-ego": 0.07311879181713792, "in-drivable-lane": 0, "agent_compute-ego": 0.12012446000709295, "deviation-heading": 1.75181857036407, "set_robot_commands": 0.13765075191947984, "deviation-center-line": 0.5751850080662609, "driven_lanedir_consec": 1.2212724092692753, "sim_compute_sim_state": 0.04689747354258662, "sim_compute_performance-ego": 0.08131660733904157, "sim_compute_robot_state-ego": 0.09087430023998948, "sim_compute_robot_state-npc0": 0.08845030743142833, "sim_compute_robot_state-npc1": 0.08247834258938427, "sim_compute_robot_state-npc2": 0.0823426972264829, "sim_compute_robot_state-npc3": 0.08271729131663068}, "udem1-2-0": {"driven_any": 1.3334970009829048, "sim_physics": 0.33062495485596033, "survival_time": 9.199999999999996, "driven_lanedir": 1.24648963493867, "sim_render-ego": 0.0772629315438478, "in-drivable-lane": 0, "agent_compute-ego": 0.12144958843355594, "deviation-heading": 2.921567128325301, "set_robot_commands": 0.14860192848288495, "deviation-center-line": 0.6653809349481323, "driven_lanedir_consec": 1.2441876529066214, "sim_compute_sim_state": 0.04829497052275616, "sim_compute_performance-ego": 0.08992629595424818, "sim_compute_robot_state-ego": 0.1054839375226394, "sim_compute_robot_state-npc0": 0.09461571470550868, "sim_compute_robot_state-npc1": 0.09096078380294469, "sim_compute_robot_state-npc2": 0.08948867606080096, "sim_compute_robot_state-npc3": 0.08931718831476958}, "udem1-3-0": {"driven_any": 0.489589608865393, "sim_physics": 0.3748061040352131, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4593828266934623, "sim_render-ego": 0.09095288556197594, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.14516848531262627, "deviation-heading": 0.549147402377039, "set_robot_commands": 0.17351450180185252, "deviation-center-line": 0.208564180438624, "driven_lanedir_consec": 0.4593828266934623, "sim_compute_sim_state": 0.05583291629265095, "sim_compute_performance-ego": 0.10457800174581594, "sim_compute_robot_state-ego": 0.12686319186769682, "sim_compute_robot_state-npc0": 0.10876369887384876, "sim_compute_robot_state-npc1": 0.10226986737086854, "sim_compute_robot_state-npc2": 0.1050823474752492, "sim_compute_robot_state-npc3": 0.10281479769739613}, "udem1-4-0": {"driven_any": 2.901127713204258, "sim_physics": 0.3094626959164937, "survival_time": 14.950000000000076, "driven_lanedir": 2.6545548101656244, "sim_render-ego": 0.08154248555501302, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1255563751856486, "deviation-heading": 1.7119748285646246, "set_robot_commands": 0.15425367514292398, "deviation-center-line": 1.3080756021175788, "driven_lanedir_consec": 2.6545548101656244, "sim_compute_sim_state": 0.04970561901728312, "sim_compute_performance-ego": 0.09292558034261068, "sim_compute_robot_state-ego": 0.11241600592931111, "sim_compute_robot_state-npc0": 0.09564220348993938, "sim_compute_robot_state-npc1": 0.09219741980234782, "sim_compute_robot_state-npc2": 0.09229446967442832, "sim_compute_robot_state-npc3": 0.09163254499435423}}
set_robot_commands_max0.17351450180185252
set_robot_commands_mean0.14515070977471084
set_robot_commands_median0.14860192848288495
set_robot_commands_min0.11173269152641296
sim_compute_performance-ego_max0.10457800174581594
sim_compute_performance-ego_mean0.0876948150136856
sim_compute_performance-ego_median0.08992629595424818
sim_compute_performance-ego_min0.06972758968671162
sim_compute_robot_state-ego_max0.12686319186769682
sim_compute_robot_state-ego_mean0.10266944260945714
sim_compute_robot_state-ego_median0.1054839375226394
sim_compute_robot_state-ego_min0.07770977748764886
sim_compute_robot_state-npc0_max0.10876369887384876
sim_compute_robot_state-npc0_mean0.09259850123400055
sim_compute_robot_state-npc0_median0.09461571470550868
sim_compute_robot_state-npc0_min0.07552058166927761
sim_compute_robot_state-npc1_max0.10226986737086854
sim_compute_robot_state-npc1_mean0.0887522416824372
sim_compute_robot_state-npc1_median0.09096078380294469
sim_compute_robot_state-npc1_min0.07585479484664069
sim_compute_robot_state-npc2_max0.1050823474752492
sim_compute_robot_state-npc2_mean0.08829902945541053
sim_compute_robot_state-npc2_median0.08948867606080096
sim_compute_robot_state-npc2_min0.07228695684009129
sim_compute_robot_state-npc3_max0.10281479769739613
sim_compute_robot_state-npc3_mean0.08663038378119745
sim_compute_robot_state-npc3_median0.08931718831476958
sim_compute_robot_state-npc3_min0.06667009658283657
sim_compute_sim_state_max0.05583291629265095
sim_compute_sim_state_mean0.04803954626432404
sim_compute_sim_state_median0.04829497052275616
sim_compute_sim_state_min0.03946675194634332
sim_physics_max0.3748061040352131
sim_physics_mean0.29406734587633243
sim_physics_median0.3094626959164937
sim_physics_min0.19737310542000663
sim_render-ego_max0.09095288556197594
sim_render-ego_mean0.07713737063882682
sim_render-ego_median0.0772629315438478
sim_render-ego_min0.0628097587161594
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.740000000000009
survival_time_min2.8999999999999977
No reset possible
21907step1-simulationsuccessno0:26:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21902step1-simulationhost-errorno0:25:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission3346/step1-simulation-ip-172-31-38-104-5317-job21902/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21901step1-simulationsuccessno0:23:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible