Duckietown Challenges Home Challenges Submissions

Submission 3340

Submission3340
Competingyes
Challengeaido2-LF-sim-testing
UserAnastasiya Nikolskaya 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22393
Next
User labelJetBrains Research
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22393step1-simulationsuccessyes0:44:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5128553335511117
survival_time_median14.950000000000076
deviation-center-line_median1.122222814417881
in-drivable-lane_median1.3000000000000185


other stats
agent_compute-ego_max0.06621618747711182
agent_compute-ego_mean0.06251238073012201
agent_compute-ego_median0.06363719542821249
agent_compute-ego_min0.05772817611694336
deviation-center-line_max1.423166222967213
deviation-center-line_mean1.1397607322570826
deviation-center-line_min0.930888904400431
deviation-heading_max2.757124138140006
deviation-heading_mean2.159552088375371
deviation-heading_median2.2558815863398975
deviation-heading_min1.2744155520332374
driven_any_max2.9174128496256415
driven_any_mean2.656571944175289
driven_any_median2.6924474158840823
driven_any_min2.1375989662715007
driven_lanedir_consec_max2.7079598410647256
driven_lanedir_consec_mean2.4496928292268874
driven_lanedir_consec_min1.9443195833821627
driven_lanedir_max2.7079598410647256
driven_lanedir_mean2.4496928292268874
driven_lanedir_median2.5128553335511117
driven_lanedir_min1.9443195833821627
in-drivable-lane_max3.500000000000023
in-drivable-lane_mean1.3100000000000125
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5650719468729535, "sim_physics": 0.052139388720194496, "survival_time": 14.950000000000076, "driven_lanedir": 2.3610890153979867, "sim_render-ego": 0.05098668177922567, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.06094792048136393, "deviation-heading": 2.211828835586313, "set_robot_commands": 0.07296099980672201, "deviation-center-line": 1.1110331266624105, "driven_lanedir_consec": 2.3610890153979867, "sim_compute_sim_state": 0.03280349175135295, "sim_compute_performance-ego": 0.05535304625829061, "sim_compute_robot_state-ego": 0.05594752709070842}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1375989662715007, "sim_physics": 0.052633149989907674, "survival_time": 12.050000000000036, "driven_lanedir": 2.061463373166061, "sim_render-ego": 0.05040896977626436, "in-drivable-lane": 0, "agent_compute-ego": 0.05862632628793043, "deviation-heading": 2.696731610096, "set_robot_commands": 0.07185858413886233, "deviation-center-line": 1.0588295189543349, "driven_lanedir_consec": 2.061463373166061, "sim_compute_sim_state": 0.033660512742165215, "sim_compute_performance-ego": 0.05551565336488589, "sim_compute_robot_state-ego": 0.05690334446697314}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.8289588373958776, "sim_physics": 0.0499658219019572, "survival_time": 14.950000000000076, "driven_lanedir": 2.603662228924135, "sim_render-ego": 0.05018142620722453, "in-drivable-lane": 1.5499999999999965, "agent_compute-ego": 0.05772817611694336, "deviation-heading": 1.85235795396942, "set_robot_commands": 0.07229344526926676, "deviation-center-line": 1.122222814417881, "driven_lanedir_consec": 2.603662228924135, "sim_compute_sim_state": 0.03290922482808431, "sim_compute_performance-ego": 0.05493348519007365, "sim_compute_robot_state-ego": 0.05545948425928752}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.7039791072384376, "sim_physics": 0.049848230679829915, "survival_time": 14.950000000000076, "driven_lanedir": 2.6598268682005988, "sim_render-ego": 0.049284558296203616, "in-drivable-lane": 0, "agent_compute-ego": 0.05841889937718709, "deviation-heading": 2.483540424963821, "set_robot_commands": 0.07374011437098185, "deviation-center-line": 1.0879782895119572, "driven_lanedir_consec": 2.6598268682005988, "sim_compute_sim_state": 0.03186652342478434, "sim_compute_performance-ego": 0.0543382199605306, "sim_compute_robot_state-ego": 0.054917731285095216}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.6982809173057407, "sim_physics": 0.05156596581141154, "survival_time": 14.950000000000076, "driven_lanedir": 2.6624096582717196, "sim_render-ego": 0.0506597638130188, "in-drivable-lane": 0, "agent_compute-ego": 0.05846745491027832, "deviation-heading": 1.826705369949727, "set_robot_commands": 0.07404593467712402, "deviation-center-line": 1.0811784441934995, "driven_lanedir_consec": 2.6624096582717196, "sim_compute_sim_state": 0.03302253246307373, "sim_compute_performance-ego": 0.05537354628245036, "sim_compute_robot_state-ego": 0.05580255349477132}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.610985303686576, "sim_physics": 0.05199416399002075, "survival_time": 14.950000000000076, "driven_lanedir": 2.188154304326984, "sim_render-ego": 0.052084709803263345, "in-drivable-lane": 3.0500000000000176, "agent_compute-ego": 0.061385980447133386, "deviation-heading": 2.2558815863398975, "set_robot_commands": 0.0751107128461202, "deviation-center-line": 1.138392135251591, "driven_lanedir_consec": 2.188154304326984, "sim_compute_sim_state": 0.03448211590449015, "sim_compute_performance-ego": 0.05854841391245525, "sim_compute_robot_state-ego": 0.05999972263971965}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.546441123890681, "sim_physics": 0.05327050765355428, "survival_time": 14.950000000000076, "driven_lanedir": 2.3664027145965667, "sim_render-ego": 0.05319554646809896, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.06463689009348551, "deviation-heading": 2.3518537620337785, "set_robot_commands": 0.07524391412734985, "deviation-center-line": 0.930888904400431, "driven_lanedir_consec": 2.3664027145965667, "sim_compute_sim_state": 0.03384164571762085, "sim_compute_performance-ego": 0.0586351203918457, "sim_compute_robot_state-ego": 0.05856926282246907}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.4320546297431354, "sim_physics": 0.05465762853622436, "survival_time": 14.950000000000076, "driven_lanedir": 1.9443195833821627, "sim_render-ego": 0.05523086547851563, "in-drivable-lane": 3.500000000000023, "agent_compute-ego": 0.06287846724192302, "deviation-heading": 2.511415976653937, "set_robot_commands": 0.07501583019892374, "deviation-center-line": 1.0463661667575943, "driven_lanedir_consec": 1.9443195833821627, "sim_compute_sim_state": 0.035761492252349855, "sim_compute_performance-ego": 0.05993864138921102, "sim_compute_robot_state-ego": 0.05920047362645467}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.87800021710747, "sim_physics": 0.05546230395634969, "survival_time": 14.950000000000076, "driven_lanedir": 2.5882351209821626, "sim_render-ego": 0.05595622221628825, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.06489065408706665, "deviation-heading": 1.628062121807574, "set_robot_commands": 0.07605545043945312, "deviation-center-line": 1.1937557151161535, "driven_lanedir_consec": 2.5882351209821626, "sim_compute_sim_state": 0.03715811729431152, "sim_compute_performance-ego": 0.062409629027048746, "sim_compute_robot_state-ego": 0.06054123957951864}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.6422652165846685, "sim_physics": 0.05549829244613647, "survival_time": 14.950000000000076, "driven_lanedir": 2.4818567030041603, "sim_render-ego": 0.05771137555440267, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.065403946240743, "deviation-heading": 2.572920176519858, "set_robot_commands": 0.0754540212949117, "deviation-center-line": 1.1970066138776128, "driven_lanedir_consec": 2.4818567030041603, "sim_compute_sim_state": 0.037014304796854657, "sim_compute_performance-ego": 0.06192248741785685, "sim_compute_robot_state-ego": 0.06147120237350464}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.6924474158840823, "sim_physics": 0.05455441395441691, "survival_time": 14.950000000000076, "driven_lanedir": 2.5128553335511117, "sim_render-ego": 0.0548099684715271, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.06487957795461019, "deviation-heading": 2.0496726120819435, "set_robot_commands": 0.07499718268712362, "deviation-center-line": 1.014363782435872, "driven_lanedir_consec": 2.5128553335511117, "sim_compute_sim_state": 0.03663253704706828, "sim_compute_performance-ego": 0.06036423365275065, "sim_compute_robot_state-ego": 0.06085224469502767}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.5380128618458473, "sim_physics": 0.05716475407282511, "survival_time": 14.950000000000076, "driven_lanedir": 2.292032848166017, "sim_render-ego": 0.05752490838368734, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.06621618747711182, "deviation-heading": 2.757124138140006, "set_robot_commands": 0.0757921306292216, "deviation-center-line": 1.1637270865048868, "driven_lanedir_consec": 2.292032848166017, "sim_compute_sim_state": 0.03780451695124308, "sim_compute_performance-ego": 0.06087553103764852, "sim_compute_robot_state-ego": 0.06050684611002604}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.786077830933103, "sim_physics": 0.057932021617889407, "survival_time": 14.950000000000076, "driven_lanedir": 2.7079598410647256, "sim_render-ego": 0.05628654321034749, "in-drivable-lane": 0, "agent_compute-ego": 0.0636850873629252, "deviation-heading": 2.354775263669708, "set_robot_commands": 0.07686208804448445, "deviation-center-line": 1.423166222967213, "driven_lanedir_consec": 2.7079598410647256, "sim_compute_sim_state": 0.038810702164967854, "sim_compute_performance-ego": 0.061516276995340985, "sim_compute_robot_state-ego": 0.06190252224604289}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.9174128496256415, "sim_physics": 0.054588436285654705, "survival_time": 14.950000000000076, "driven_lanedir": 2.66711444045894, "sim_render-ego": 0.05744539419809977, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.06588294744491577, "deviation-heading": 1.5659959417853493, "set_robot_commands": 0.07646499713261923, "deviation-center-line": 1.2548475717867107, "driven_lanedir_consec": 2.66711444045894, "sim_compute_sim_state": 0.0381484858194987, "sim_compute_performance-ego": 0.06341485261917114, "sim_compute_robot_state-ego": 0.06136090358098348}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.8709919382436215, "sim_physics": 0.05631641308466594, "survival_time": 14.950000000000076, "driven_lanedir": 2.6480104049099777, "sim_render-ego": 0.05731159925460815, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.06363719542821249, "deviation-heading": 1.2744155520332374, "set_robot_commands": 0.07397979736328125, "deviation-center-line": 1.2726545910180889, "driven_lanedir_consec": 2.6480104049099777, "sim_compute_sim_state": 0.03918626546859741, "sim_compute_performance-ego": 0.060938995679219565, "sim_compute_robot_state-ego": 0.06113895336786906}}
set_robot_commands_max0.07686208804448445
set_robot_commands_mean0.07465834686842972
set_robot_commands_median0.07501583019892374
set_robot_commands_min0.07185858413886233
sim_compute_performance-ego_max0.06341485261917114
sim_compute_performance-ego_mean0.05893854221191864
sim_compute_performance-ego_median0.05993864138921102
sim_compute_performance-ego_min0.0543382199605306
sim_compute_robot_state-ego_max0.06190252224604289
sim_compute_robot_state-ego_mean0.05897160077589675
sim_compute_robot_state-ego_median0.05999972263971965
sim_compute_robot_state-ego_min0.054917731285095216
sim_compute_sim_state_max0.03918626546859741
sim_compute_sim_state_mean0.035540164575097524
sim_compute_sim_state_median0.035761492252349855
sim_compute_sim_state_min0.03186652342478434
sim_physics_max0.057932021617889407
sim_physics_mean0.0538394328467359
sim_physics_median0.05455441395441691
sim_physics_min0.049848230679829915
sim_render-ego_max0.05771137555440267
sim_render-ego_mean0.05393856886071838
sim_render-ego_median0.0548099684715271
sim_render-ego_min0.049284558296203616
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.75666666666674
survival_time_min12.050000000000036
No reset possible
21895step1-simulationsuccessno0:47:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21894step1-simulationhost-errorno0:26:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3340/step1-simulation-ip-172-31-40-253-31940-job21894/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21893step1-simulationhost-errorno0:26:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3340/step1-simulation-ip-172-31-42-167-7357-job21893/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible