Duckietown Challenges Home Challenges Submissions

Submission 3158

Submission3158
Competingyes
Challengeaido2-LF-sim-validation
UserAngel Woo 🇭🇰
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22582
Next
User labelRoasted duck
Admin priority50
Blessingn/a
User priority50

22582

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22582step1-simulationsuccessyes0:18:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3486310751400876
survival_time_median5.299999999999989
deviation-center-line_median0.3019890466717774
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.26113168256623404
agent_compute-ego_mean0.23168587535811533
agent_compute-ego_median0.22866113391923315
agent_compute-ego_min0.2113718401710942
deviation-center-line_max0.8976199585319824
deviation-center-line_mean0.4274883731254226
deviation-center-line_min0.2809808935661084
deviation-heading_max2.0945753454878107
deviation-heading_mean1.7663837334133623
deviation-heading_median1.874120999686132
deviation-heading_min1.074888276942665
driven_any_max1.100825560094354
driven_any_mean0.5653555398500792
driven_any_median0.396994889596267
driven_any_min0.191852909632394
driven_lanedir_consec_max1.064791560704841
driven_lanedir_consec_mean0.5008859997369833
driven_lanedir_consec_min0.17539772240706508
driven_lanedir_max1.064791560704841
driven_lanedir_mean0.5008859997369833
driven_lanedir_median0.3486310751400876
driven_lanedir_min0.17539772240706508
in-drivable-lane_max1.500000000000021
in-drivable-lane_mean0.4200000000000047
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.100825560094354, "sim_physics": 0.10888699849446616, "survival_time": 14.950000000000076, "driven_lanedir": 1.064791560704841, "sim_render-ego": 0.06328174670537313, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.22328012943267825, "deviation-heading": 2.0945753454878107, "set_robot_commands": 0.09788309653600057, "deviation-center-line": 0.8976199585319824, "driven_lanedir_consec": 1.064791560704841, "sim_compute_sim_state": 0.03957921107610067, "sim_compute_performance-ego": 0.0701746145884196, "sim_compute_robot_state-ego": 0.0740521518389384}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8341419556379043, "sim_physics": 0.11021462476478432, "survival_time": 10.600000000000016, "driven_lanedir": 0.6708547623192422, "sim_render-ego": 0.06327917890728645, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.23398459070133712, "deviation-heading": 1.874120999686132, "set_robot_commands": 0.09842260828558004, "deviation-center-line": 0.3665015972841808, "driven_lanedir_consec": 0.6708547623192422, "sim_compute_sim_state": 0.04020917865465272, "sim_compute_performance-ego": 0.0725807030245943, "sim_compute_robot_state-ego": 0.07594954067806028}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.191852909632394, "sim_physics": 0.13320978624480112, "survival_time": 2.799999999999998, "driven_lanedir": 0.17539772240706508, "sim_render-ego": 0.0645957248551505, "in-drivable-lane": 0, "agent_compute-ego": 0.26113168256623404, "deviation-heading": 1.074888276942665, "set_robot_commands": 0.11117435353142877, "deviation-center-line": 0.3019890466717774, "driven_lanedir_consec": 0.17539772240706508, "sim_compute_sim_state": 0.041381197316305976, "sim_compute_performance-ego": 0.07448345422744751, "sim_compute_robot_state-ego": 0.09121689626148768}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3029623842894765, "sim_physics": 0.12124379770255383, "survival_time": 4.049999999999994, "driven_lanedir": 0.24475487811368035, "sim_render-ego": 0.06777323911219467, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.22866113391923315, "deviation-heading": 1.9973464709795616, "set_robot_commands": 0.10231589093620394, "deviation-center-line": 0.2809808935661084, "driven_lanedir_consec": 0.24475487811368035, "sim_compute_sim_state": 0.04114261379948369, "sim_compute_performance-ego": 0.07344117576693311, "sim_compute_robot_state-ego": 0.07708066481131094}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.396994889596267, "sim_physics": 0.11970317363739014, "survival_time": 5.299999999999989, "driven_lanedir": 0.3486310751400876, "sim_render-ego": 0.06483801580824942, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2113718401710942, "deviation-heading": 1.7909875739706425, "set_robot_commands": 0.0957952467900402, "deviation-center-line": 0.29035036957306415, "driven_lanedir_consec": 0.3486310751400876, "sim_compute_sim_state": 0.039266921439260805, "sim_compute_performance-ego": 0.06936619191799524, "sim_compute_robot_state-ego": 0.07377146549944608}}
set_robot_commands_max0.11117435353142877
set_robot_commands_mean0.1011182392158507
set_robot_commands_median0.09842260828558004
set_robot_commands_min0.0957952467900402
sim_compute_performance-ego_max0.07448345422744751
sim_compute_performance-ego_mean0.07200922790507795
sim_compute_performance-ego_median0.0725807030245943
sim_compute_performance-ego_min0.06936619191799524
sim_compute_robot_state-ego_max0.09121689626148768
sim_compute_robot_state-ego_mean0.07841414381784868
sim_compute_robot_state-ego_median0.07594954067806028
sim_compute_robot_state-ego_min0.07377146549944608
sim_compute_sim_state_max0.041381197316305976
sim_compute_sim_state_mean0.04031582445716077
sim_compute_sim_state_median0.04020917865465272
sim_compute_sim_state_min0.039266921439260805
sim_physics_max0.13320978624480112
sim_physics_mean0.1186516761687991
sim_physics_median0.11970317363739014
sim_physics_min0.10888699849446616
sim_render-ego_max0.06777323911219467
sim_render-ego_mean0.06475358107765083
sim_render-ego_median0.0645957248551505
sim_render-ego_min0.06327917890728645
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.540000000000015
survival_time_min2.799999999999998
No reset possible
22566step1-simulationhost-erroryes0:15:33
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1358, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1405, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3158/step1-simulation-ip-172-31-38-104-2553-job22566/tmp/tmpvjw9cucr/episodes/ETHZ_autolab_technical_track-0-0/drawing.html']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible