Duckietown Challenges Home Challenges Submissions

Submission 3848

Submission3848
Competingyes
Challengeaido2-LF-sim-testing-offseason
UserJunghyun Seo 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 24058
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
24058step1-simulationsuccessyes0:08:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1229443581134273
survival_time_median1.3500000000000003
deviation-center-line_median0.07666609549956557
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11029372612635296
agent_compute-ego_mean0.09718670064441325
agent_compute-ego_median0.09571255170381986
agent_compute-ego_min0.09446550499309192
deviation-center-line_max0.13280535346761538
deviation-center-line_mean0.08341721544931532
deviation-center-line_min0.044634091985992545
deviation-heading_max1.0509843201450328
deviation-heading_mean0.7268228368430759
deviation-heading_median0.7571356106125486
deviation-heading_min0.4407891421364369
driven_any_max0.24341132515354225
driven_any_mean0.1782360757850334
driven_any_median0.17394321290463016
driven_any_min0.1231734531965312
driven_lanedir_consec_max0.19202791779080508
driven_lanedir_consec_mean0.11795308596805625
driven_lanedir_consec_min0.058553136577239595
driven_lanedir_max0.19202791779080508
driven_lanedir_mean0.11795308596805625
driven_lanedir_median0.1229443581134273
driven_lanedir_min0.058553136577239595
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.08000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21784388970386043, "sim_physics": 0.059850431978702545, "survival_time": 1.6000000000000008, "driven_lanedir": 0.13562462050107582, "sim_render-ego": 0.03619995713233948, "in-drivable-lane": 0, "agent_compute-ego": 0.10377609729766846, "deviation-heading": 1.0509843201450328, "set_robot_commands": 0.055401675403118134, "deviation-center-line": 0.10424047374846002, "driven_lanedir_consec": 0.13562462050107582, "sim_compute_sim_state": 0.023091517388820648, "sim_compute_performance-ego": 0.03881244361400604, "sim_compute_robot_state-ego": 0.040485478937625885}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.24341132515354225, "sim_physics": 0.059744467054094585, "survival_time": 1.7500000000000009, "driven_lanedir": 0.17236304027848937, "sim_render-ego": 0.03575107710702079, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09633346966334752, "deviation-heading": 0.8881560403107783, "set_robot_commands": 0.05454801150730678, "deviation-center-line": 0.06549435431208495, "driven_lanedir_consec": 0.17236304027848937, "sim_compute_sim_state": 0.02344212532043457, "sim_compute_performance-ego": 0.039439208166939875, "sim_compute_robot_state-ego": 0.04088039398193359}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1231734531965312, "sim_physics": 0.05874059313819522, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09414985618509952, "sim_render-ego": 0.035969745545160206, "in-drivable-lane": 0, "agent_compute-ego": 0.0961693014417376, "deviation-heading": 0.5586926307322083, "set_robot_commands": 0.05385372752235049, "deviation-center-line": 0.09794670099385716, "driven_lanedir_consec": 0.09414985618509952, "sim_compute_sim_state": 0.02333891959417434, "sim_compute_performance-ego": 0.039209116072881786, "sim_compute_robot_state-ego": 0.040715172177269346}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17633006573155224, "sim_physics": 0.06504533208649733, "survival_time": 1.4500000000000006, "driven_lanedir": 0.07616191045725307, "sim_render-ego": 0.03674069766340585, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.09720968378001246, "deviation-heading": 0.9805094729677124, "set_robot_commands": 0.05557279751218598, "deviation-center-line": 0.06413429802505513, "driven_lanedir_consec": 0.07616191045725307, "sim_compute_sim_state": 0.023410164076706454, "sim_compute_performance-ego": 0.03890867068849761, "sim_compute_robot_state-ego": 0.04067992341929469}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22275054588977952, "sim_physics": 0.06380349217039166, "survival_time": 1.6500000000000008, "driven_lanedir": 0.14638465078058038, "sim_render-ego": 0.03652576966719194, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09683557712670528, "deviation-heading": 0.8492114904895192, "set_robot_commands": 0.0578853144790187, "deviation-center-line": 0.0712737219748357, "driven_lanedir_consec": 0.14638465078058038, "sim_compute_sim_state": 0.02341732834324692, "sim_compute_performance-ego": 0.039356202790231415, "sim_compute_robot_state-ego": 0.04107469500917377}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.18773213486094453, "sim_physics": 0.06225159764289856, "survival_time": 1.6000000000000008, "driven_lanedir": 0.058553136577239595, "sim_render-ego": 0.03682372719049454, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09568683058023451, "deviation-heading": 0.8976997876744849, "set_robot_commands": 0.05429675430059433, "deviation-center-line": 0.06037512768288391, "driven_lanedir_consec": 0.058553136577239595, "sim_compute_sim_state": 0.023168981075286865, "sim_compute_performance-ego": 0.03872343897819519, "sim_compute_robot_state-ego": 0.04045236110687256}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.2251873551058529, "sim_physics": 0.06152981122334798, "survival_time": 1.5000000000000009, "driven_lanedir": 0.19202791779080508, "sim_render-ego": 0.035486761728922525, "in-drivable-lane": 0, "agent_compute-ego": 0.09548126856486004, "deviation-heading": 0.5836644222385844, "set_robot_commands": 0.053549154599507647, "deviation-center-line": 0.10143054101209424, "driven_lanedir_consec": 0.19202791779080508, "sim_compute_sim_state": 0.023042448361714683, "sim_compute_performance-ego": 0.03862470785776774, "sim_compute_robot_state-ego": 0.04034092426300049}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.13775473224063794, "sim_physics": 0.05523665384812789, "survival_time": 1.1000000000000003, "driven_lanedir": 0.1051179778500404, "sim_render-ego": 0.035022063688798385, "in-drivable-lane": 0, "agent_compute-ego": 0.09446550499309192, "deviation-heading": 0.5783914395686329, "set_robot_commands": 0.0543942776593295, "deviation-center-line": 0.10137170634845805, "driven_lanedir_consec": 0.1051179778500404, "sim_compute_sim_state": 0.023315711454911667, "sim_compute_performance-ego": 0.03868713162162087, "sim_compute_robot_state-ego": 0.04071886972947554}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14382652503473223, "sim_physics": 0.05701860097738413, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07639718955321007, "sim_render-ego": 0.03588681037609394, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.0946797040792612, "deviation-heading": 0.7775430075810775, "set_robot_commands": 0.05432403087615967, "deviation-center-line": 0.044634091985992545, "driven_lanedir_consec": 0.07639718955321007, "sim_compute_sim_state": 0.023384992892925557, "sim_compute_performance-ego": 0.03883211429302509, "sim_compute_robot_state-ego": 0.04079767373891977}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.16575475257370412, "sim_physics": 0.0612483574793889, "survival_time": 1.3000000000000005, "driven_lanedir": 0.128276307911535, "sim_render-ego": 0.04227846402388353, "in-drivable-lane": 0, "agent_compute-ego": 0.09571255170381986, "deviation-heading": 0.5991811933956286, "set_robot_commands": 0.05450230378371019, "deviation-center-line": 0.09840410208342552, "driven_lanedir_consec": 0.128276307911535, "sim_compute_sim_state": 0.023311449931218073, "sim_compute_performance-ego": 0.039297085541945234, "sim_compute_robot_state-ego": 0.04104258463932918}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1586243662901447, "sim_physics": 0.06124300003051758, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1264633834032557, "sim_render-ego": 0.04200637817382812, "in-drivable-lane": 0, "agent_compute-ego": 0.09501618385314942, "deviation-heading": 0.5191351250629405, "set_robot_commands": 0.05459192276000977, "deviation-center-line": 0.11102855621744924, "driven_lanedir_consec": 0.1264633834032557, "sim_compute_sim_state": 0.023310766220092777, "sim_compute_performance-ego": 0.03858145713806152, "sim_compute_robot_state-ego": 0.0406609058380127}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14532602778681517, "sim_physics": 0.06638988852500916, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10552075516404393, "sim_render-ego": 0.036208927631378174, "in-drivable-lane": 0, "agent_compute-ego": 0.11029372612635296, "deviation-heading": 0.6433314660550675, "set_robot_commands": 0.05407660206158956, "deviation-center-line": 0.07666609549956557, "driven_lanedir_consec": 0.10552075516404393, "sim_compute_sim_state": 0.023110419511795044, "sim_compute_performance-ego": 0.03887237111727397, "sim_compute_robot_state-ego": 0.04650078217188517}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.18283249884991845, "sim_physics": 0.05930591374635696, "survival_time": 1.6000000000000008, "driven_lanedir": 0.08043569777929549, "sim_render-ego": 0.03660367429256439, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.09504076093435287, "deviation-heading": 0.7779174036754858, "set_robot_commands": 0.05382777750492096, "deviation-center-line": 0.053782878450133, "driven_lanedir_consec": 0.08043569777929549, "sim_compute_sim_state": 0.023179173469543457, "sim_compute_performance-ego": 0.03899698704481125, "sim_compute_robot_state-ego": 0.04077526181936264}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.16905025145285457, "sim_physics": 0.05866719209230863, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1229443581134273, "sim_render-ego": 0.03519900028522198, "in-drivable-lane": 0, "agent_compute-ego": 0.09491450969989484, "deviation-heading": 0.7571356106125486, "set_robot_commands": 0.05364535405085637, "deviation-center-line": 0.06767022993781907, "driven_lanedir_consec": 0.1229443581134273, "sim_compute_sim_state": 0.023006109090951778, "sim_compute_performance-ego": 0.03866552389585055, "sim_compute_robot_state-ego": 0.04037053768451397}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.17394321290463016, "sim_physics": 0.05840714772542318, "survival_time": 1.3500000000000003, "driven_lanedir": 0.14887548717549315, "sim_render-ego": 0.036333931816948786, "in-drivable-lane": 0, "agent_compute-ego": 0.09618533982170951, "deviation-heading": 0.4407891421364369, "set_robot_commands": 0.05514686195938675, "deviation-center-line": 0.13280535346761538, "driven_lanedir_consec": 0.14887548717549315, "sim_compute_sim_state": 0.023279825846354168, "sim_compute_performance-ego": 0.03884870917708785, "sim_compute_robot_state-ego": 0.040822894484908494}}
set_robot_commands_max0.0578853144790187
set_robot_commands_mean0.05464110439866966
set_robot_commands_median0.0543942776593295
set_robot_commands_min0.053549154599507647
sim_compute_performance-ego_max0.039439208166939875
sim_compute_performance-ego_mean0.0389236778665464
sim_compute_performance-ego_median0.03884870917708785
sim_compute_performance-ego_min0.03858145713806152
sim_compute_robot_state-ego_max0.04650078217188517
sim_compute_robot_state-ego_mean0.04108789726677186
sim_compute_robot_state-ego_median0.04071886972947554
sim_compute_robot_state-ego_min0.04034092426300049
sim_compute_sim_state_max0.02344212532043457
sim_compute_sim_state_mean0.0232539955052118
sim_compute_sim_state_median0.023310766220092777
sim_compute_sim_state_min0.023006109090951778
sim_physics_max0.06638988852500916
sim_physics_mean0.060565498647909624
sim_physics_median0.059850431978702545
sim_physics_min0.05523665384812789
sim_render-ego_max0.04227846402388353
sim_render-ego_mean0.036869132421550176
sim_render-ego_median0.036208927631378174
sim_render-ego_min0.035022063688798385
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.4000000000000008
survival_time_min1.0500000000000005
No reset possible
24057step1-simulationhost-erroryes0:08:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1361, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1408, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing-offseason/submission3848/step1-simulation-ip-172-31-42-167-7227-job24057/tmp/tmpl1qgv5wi/episodes/ETHZ_autolab_technical_track-6-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible