Duckietown Challenges Home Challenges Submissions

Submission 3147

Submission3147
Competingyes
Challengeaido2-LF-sim-testing
UserArtem Ioselevskii
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22575
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22575step1-simulationsuccessyes0:24:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8229376007844924
survival_time_median5.549999999999988
deviation-center-line_median0.5837521601868435
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08652340730031331
agent_compute-ego_mean0.08129194879022128
agent_compute-ego_median0.08041197121745408
agent_compute-ego_min0.07656284173329671
deviation-center-line_max1.198284189012972
deviation-center-line_mean0.5914263666236229
deviation-center-line_min0.17537150253837816
deviation-heading_max5.731016104089707
deviation-heading_mean2.0857743865017655
deviation-heading_median1.5553473411801535
deviation-heading_min0.6137989653407925
driven_any_max2.349009164757122
driven_any_mean1.1340225691490364
driven_any_median0.8383321650230576
driven_any_min0.4445796757000227
driven_lanedir_consec_max2.1648699898094717
driven_lanedir_consec_mean0.9281087092698672
driven_lanedir_consec_min0.21960343861415063
driven_lanedir_max2.1648699898094717
driven_lanedir_mean0.9827398248525728
driven_lanedir_median0.8229376007844924
driven_lanedir_min0.4307361639726697
in-drivable-lane_max2.599999999999996
in-drivable-lane_mean0.4033333333333345
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.902967749707584, "sim_physics": 0.04997454484303792, "survival_time": 5.999999999999987, "driven_lanedir": 0.8456445938545052, "sim_render-ego": 0.048269548018773395, "in-drivable-lane": 0, "agent_compute-ego": 0.07656284173329671, "deviation-heading": 1.5553473411801535, "set_robot_commands": 0.06982674797375997, "deviation-center-line": 0.5272315311112448, "driven_lanedir_consec": 0.8456445938545052, "sim_compute_sim_state": 0.031979801257451375, "sim_compute_performance-ego": 0.05309838652610779, "sim_compute_robot_state-ego": 0.05413442850112915}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.70962900967167, "sim_physics": 0.05305892542788857, "survival_time": 4.749999999999991, "driven_lanedir": 0.436427678015778, "sim_render-ego": 0.04979219185678582, "in-drivable-lane": 0.49999999999999933, "agent_compute-ego": 0.07717300214265523, "deviation-heading": 2.6973665759394576, "set_robot_commands": 0.07373591222261128, "deviation-center-line": 0.4134564657385398, "driven_lanedir_consec": 0.21960343861415063, "sim_compute_sim_state": 0.03330350926047877, "sim_compute_performance-ego": 0.054447026001779655, "sim_compute_robot_state-ego": 0.05537593741165965}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.645484697179345, "sim_physics": 0.04910316138431944, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6385558466666215, "sim_render-ego": 0.04850471704855733, "in-drivable-lane": 0, "agent_compute-ego": 0.07726897316417475, "deviation-heading": 0.6137989653407925, "set_robot_commands": 0.07264589167189324, "deviation-center-line": 0.49268697648864446, "driven_lanedir_consec": 0.6385558466666215, "sim_compute_sim_state": 0.031297508327440285, "sim_compute_performance-ego": 0.05400363878272046, "sim_compute_robot_state-ego": 0.05482311632441378}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3445368604387746, "sim_physics": 0.05089926719665527, "survival_time": 8.699999999999989, "driven_lanedir": 1.2184687565410195, "sim_render-ego": 0.05059467238941412, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.07787255994204817, "deviation-heading": 2.299039464202053, "set_robot_commands": 0.07307248279966157, "deviation-center-line": 0.6621085021351769, "driven_lanedir_consec": 1.2184687565410195, "sim_compute_sim_state": 0.0339922206155185, "sim_compute_performance-ego": 0.05538158033085966, "sim_compute_robot_state-ego": 0.05424026785225704}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2641893902207335, "sim_physics": 0.05251115415154434, "survival_time": 8.199999999999982, "driven_lanedir": 1.1734734050831688, "sim_render-ego": 0.050884680050175365, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.07991937020929848, "deviation-heading": 1.9791152241885108, "set_robot_commands": 0.07209453786291727, "deviation-center-line": 0.6466080596850211, "driven_lanedir_consec": 1.1734734050831688, "sim_compute_sim_state": 0.03391551535304, "sim_compute_performance-ego": 0.05513851817061261, "sim_compute_robot_state-ego": 0.055813207858946265}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.8185654064766903, "sim_physics": 0.050443774129188115, "survival_time": 11.65000000000003, "driven_lanedir": 1.2538100481702823, "sim_render-ego": 0.05031168205032021, "in-drivable-lane": 2.599999999999996, "agent_compute-ego": 0.07752619280835589, "deviation-heading": 3.3562403553944855, "set_robot_commands": 0.07229165662511736, "deviation-center-line": 0.6202040709201165, "driven_lanedir_consec": 1.0419047968839394, "sim_compute_sim_state": 0.0330365399945959, "sim_compute_performance-ego": 0.05528365900588138, "sim_compute_robot_state-ego": 0.05577416890680534}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7418367930845936, "sim_physics": 0.04997477146110149, "survival_time": 4.94999999999999, "driven_lanedir": 0.6262907658358514, "sim_render-ego": 0.05101492429020429, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08041197121745408, "deviation-heading": 1.5147715075376245, "set_robot_commands": 0.07172880028233383, "deviation-center-line": 0.17537150253837816, "driven_lanedir_consec": 0.6262907658358514, "sim_compute_sim_state": 0.03421944801253502, "sim_compute_performance-ego": 0.05498739926501958, "sim_compute_robot_state-ego": 0.0551930581680452}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.4249461697079857, "sim_physics": 0.05083411024964374, "survival_time": 9.199999999999996, "driven_lanedir": 1.1088375627588172, "sim_render-ego": 0.05505736107411592, "in-drivable-lane": 1.2000000000000028, "agent_compute-ego": 0.08322712131168532, "deviation-heading": 2.7783925807777075, "set_robot_commands": 0.07537542348322661, "deviation-center-line": 0.7226782296473723, "driven_lanedir_consec": 1.1088375627588172, "sim_compute_sim_state": 0.03629872721174489, "sim_compute_performance-ego": 0.05857930235240771, "sim_compute_robot_state-ego": 0.05942848843076955}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.7901335882430541, "sim_physics": 0.052485965547107515, "survival_time": 5.249999999999989, "driven_lanedir": 0.7764173381056678, "sim_render-ego": 0.05494571867443267, "in-drivable-lane": 0, "agent_compute-ego": 0.08580378577822731, "deviation-heading": 0.8157162098832271, "set_robot_commands": 0.07574875695364816, "deviation-center-line": 0.4909869956719903, "driven_lanedir_consec": 0.7764173381056678, "sim_compute_sim_state": 0.037389519101097474, "sim_compute_performance-ego": 0.06011459032694499, "sim_compute_robot_state-ego": 0.06179216702779134}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5972447843117555, "sim_physics": 0.05340002789909457, "survival_time": 4.049999999999994, "driven_lanedir": 0.5814465514167686, "sim_render-ego": 0.05546543921953366, "in-drivable-lane": 0, "agent_compute-ego": 0.08486222632137345, "deviation-heading": 0.7492836965719113, "set_robot_commands": 0.07713337592136713, "deviation-center-line": 0.40337665529648176, "driven_lanedir_consec": 0.5814465514167686, "sim_compute_sim_state": 0.03803489826343678, "sim_compute_performance-ego": 0.05999533335367838, "sim_compute_robot_state-ego": 0.062280752040721754}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7901227401959195, "sim_physics": 0.05316971370152065, "survival_time": 5.249999999999989, "driven_lanedir": 0.7770767400314136, "sim_render-ego": 0.05570554733276367, "in-drivable-lane": 0, "agent_compute-ego": 0.08231558799743652, "deviation-heading": 0.8108839174804106, "set_robot_commands": 0.07657633054824102, "deviation-center-line": 0.5837521601868435, "driven_lanedir_consec": 0.7770767400314136, "sim_compute_sim_state": 0.03610827582223075, "sim_compute_performance-ego": 0.05930911699930827, "sim_compute_robot_state-ego": 0.05967854545229957}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4445796757000227, "sim_physics": 0.05457425117492676, "survival_time": 3.099999999999997, "driven_lanedir": 0.4307361639726697, "sim_render-ego": 0.05641293141149705, "in-drivable-lane": 0, "agent_compute-ego": 0.08501831946834441, "deviation-heading": 0.6671209917389188, "set_robot_commands": 0.07522202307178129, "deviation-center-line": 0.28782365096089446, "driven_lanedir_consec": 0.4307361639726697, "sim_compute_sim_state": 0.0377546279661117, "sim_compute_performance-ego": 0.06170643529584331, "sim_compute_robot_state-ego": 0.05846963005681192}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.349009164757122, "sim_physics": 0.05447297255198161, "survival_time": 14.950000000000076, "driven_lanedir": 2.1648699898094717, "sim_render-ego": 0.0605729603767395, "in-drivable-lane": 0, "agent_compute-ego": 0.08652340730031331, "deviation-heading": 4.80995181088137, "set_robot_commands": 0.07703729311625163, "deviation-center-line": 1.0122919602058542, "driven_lanedir_consec": 2.1648699898094717, "sim_compute_sim_state": 0.0401858385403951, "sim_compute_performance-ego": 0.0633698829015096, "sim_compute_robot_state-ego": 0.061325902144114174}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.3487603425172394, "sim_physics": 0.05285631815592448, "survival_time": 14.950000000000076, "driven_lanedir": 1.886104331742069, "sim_render-ego": 0.056018770535786945, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.08490209579467774, "deviation-heading": 5.731016104089707, "set_robot_commands": 0.07386449575424195, "deviation-center-line": 1.198284189012972, "driven_lanedir_consec": 1.495367088689452, "sim_compute_sim_state": 0.037347030639648435, "sim_compute_performance-ego": 0.05893639326095581, "sim_compute_robot_state-ego": 0.05953692754109701}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.8383321650230576, "sim_physics": 0.05273486257673384, "survival_time": 5.549999999999988, "driven_lanedir": 0.8229376007844924, "sim_render-ego": 0.05415744824452443, "in-drivable-lane": 0, "agent_compute-ego": 0.07999177666397782, "deviation-heading": 0.9085710523201538, "set_robot_commands": 0.07148658047925245, "deviation-center-line": 0.6345345497548124, "driven_lanedir_consec": 0.8229376007844924, "sim_compute_sim_state": 0.0359433363149832, "sim_compute_performance-ego": 0.05723255389445537, "sim_compute_robot_state-ego": 0.05723780339902586}}
set_robot_commands_max0.07713337592136713
set_robot_commands_mean0.07385602058442031
set_robot_commands_median0.07373591222261128
set_robot_commands_min0.06982674797375997
sim_compute_performance-ego_max0.0633698829015096
sim_compute_performance-ego_mean0.0574389210978723
sim_compute_performance-ego_median0.05723255389445537
sim_compute_performance-ego_min0.05309838652610779
sim_compute_robot_state-ego_max0.062280752040721754
sim_compute_robot_state-ego_mean0.05767362674105917
sim_compute_robot_state-ego_median0.05723780339902586
sim_compute_robot_state-ego_min0.05413442850112915
sim_compute_sim_state_max0.0401858385403951
sim_compute_sim_state_mean0.03538711977871388
sim_compute_sim_state_median0.0359433363149832
sim_compute_sim_state_min0.031297508327440285
sim_physics_max0.05457425117492676
sim_physics_mean0.05203292136337789
sim_physics_median0.05251115415154434
sim_physics_min0.04910316138431944
sim_render-ego_max0.0605729603767395
sim_render-ego_mean0.053180572838241624
sim_render-ego_median0.05415744824452443
sim_render-ego_min0.048269548018773395
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.393333333333337
survival_time_min3.099999999999997
No reset possible
22573step1-simulationerroryes0:07:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21444step1-simulationsuccessno0:31:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21443step1-simulationhost-errorno0:16:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3147/step1-simulation-ip-172-31-25-98-2062-job21443/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible