Duckietown Challenges Home Challenges Submissions

Submission 5579

Submission5579
Competingyes
Challengeaido3-LF-sim-validation
UserMoustafa Elarabi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 29025
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

29025

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
29025step1-simulationsuccessyes0:05:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.496429627020847
survival_time_median4.94999999999999
deviation-center-line_median0.3183791704146555
in-drivable-lane_median0.7499999999999973


other stats
agent_compute-ego_max0.04794405445908055
agent_compute-ego_mean0.04260071833349533
agent_compute-ego_median0.04200315087791381
agent_compute-ego_min0.040040118877704325
deviation-center-line_max0.5004463881948017
deviation-center-line_mean0.3186167737911033
deviation-center-line_min0.20123418416190345
deviation-heading_max2.6104524278118233
deviation-heading_mean1.7085894066673823
deviation-heading_median1.6934597746848523
deviation-heading_min0.7755271474518287
driven_any_max3.1957819939165284
driven_any_mean2.033268437436888
driven_any_median1.8164378938577803
driven_any_min1.1653229687703677
driven_lanedir_consec_max2.5355015395837452
driven_lanedir_consec_mean1.5914848675918047
driven_lanedir_consec_min1.0463035021418343
driven_lanedir_max2.5355015395837452
driven_lanedir_mean1.5914848675918047
driven_lanedir_median1.496429627020847
driven_lanedir_min1.0463035021418343
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.6799999999999976
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1653229687703677, "sim_physics": 0.08419959728534405, "survival_time": 3.2499999999999964, "driven_lanedir": 1.0998868211966244, "sim_render-ego": 0.013760045858529898, "in-drivable-lane": 0, "agent_compute-ego": 0.040040118877704325, "deviation-heading": 0.7755271474518287, "set_robot_commands": 0.00929570564856896, "deviation-center-line": 0.21057041391608272, "driven_lanedir_consec": 1.0998868211966244, "sim_compute_sim_state": 0.005834715182964618, "sim_compute_performance-ego": 0.008474995539738581, "sim_compute_robot_state-ego": 0.009877597368680512}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.27991784926961, "sim_physics": 0.08734166137571257, "survival_time": 6.149999999999986, "driven_lanedir": 1.7793028480159727, "sim_render-ego": 0.014913188732736478, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.04200315087791381, "deviation-heading": 1.9169500568497273, "set_robot_commands": 0.010285695393880207, "deviation-center-line": 0.3624537122680731, "driven_lanedir_consec": 1.7793028480159727, "sim_compute_sim_state": 0.0065990347203200425, "sim_compute_performance-ego": 0.009147186589434864, "sim_compute_robot_state-ego": 0.010820559369839304}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.1957819939165284, "sim_physics": 0.08475895537886509, "survival_time": 8.599999999999987, "driven_lanedir": 2.5355015395837452, "sim_render-ego": 0.014075408148211102, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.04227571154749671, "deviation-heading": 2.6104524278118233, "set_robot_commands": 0.009909979132718818, "deviation-center-line": 0.5004463881948017, "driven_lanedir_consec": 2.5355015395837452, "sim_compute_sim_state": 0.006279341010160224, "sim_compute_performance-ego": 0.008460408033326615, "sim_compute_robot_state-ego": 0.010591619236524717}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7088814813701554, "sim_physics": 0.08848961363447473, "survival_time": 4.699999999999991, "driven_lanedir": 1.0463035021418343, "sim_render-ego": 0.014574471940385534, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.04074055590528123, "deviation-heading": 1.54655762653868, "set_robot_commands": 0.009532598738974713, "deviation-center-line": 0.20123418416190345, "driven_lanedir_consec": 1.0463035021418343, "sim_compute_sim_state": 0.006558172246243091, "sim_compute_performance-ego": 0.008832974636808355, "sim_compute_robot_state-ego": 0.010574589384363052}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.8164378938577803, "sim_physics": 0.08376896501791598, "survival_time": 4.94999999999999, "driven_lanedir": 1.496429627020847, "sim_render-ego": 0.015170588637843275, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.04794405445908055, "deviation-heading": 1.6934597746848523, "set_robot_commands": 0.009718622824158332, "deviation-center-line": 0.3183791704146555, "driven_lanedir_consec": 1.496429627020847, "sim_compute_sim_state": 0.0060671339131364915, "sim_compute_performance-ego": 0.008557654390431414, "sim_compute_robot_state-ego": 0.010387996230462585}}
set_robot_commands_max0.010285695393880207
set_robot_commands_mean0.009748520347660206
set_robot_commands_median0.009718622824158332
set_robot_commands_min0.00929570564856896
sim_compute_performance-ego_max0.009147186589434864
sim_compute_performance-ego_mean0.008694643837947966
sim_compute_performance-ego_median0.008557654390431414
sim_compute_performance-ego_min0.008460408033326615
sim_compute_robot_state-ego_max0.010820559369839304
sim_compute_robot_state-ego_mean0.010450472317974031
sim_compute_robot_state-ego_median0.010574589384363052
sim_compute_robot_state-ego_min0.009877597368680512
sim_compute_sim_state_max0.0065990347203200425
sim_compute_sim_state_mean0.006267679414564893
sim_compute_sim_state_median0.006279341010160224
sim_compute_sim_state_min0.005834715182964618
sim_physics_max0.08848961363447473
sim_physics_mean0.08571175853846248
sim_physics_median0.08475895537886509
sim_physics_min0.08376896501791598
sim_render-ego_max0.015170588637843275
sim_render-ego_mean0.014498740663541256
sim_render-ego_median0.014574471940385534
sim_render-ego_min0.013760045858529898
simulation-passed1
survival_time_max8.599999999999987
survival_time_mean5.529999999999991
survival_time_min3.2499999999999964
No reset possible
29024step1-simulationsuccessyes0:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
29023step1-simulationhost-erroryes0:03:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1563, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1619, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission5579/step1-simulation-ip-172-31-35-218-10492-job29023/logs/scenario_maker/combined.log']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
29022step1-simulationhost-erroryes0:04:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1563, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1619, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission5579/step1-simulation-ip-172-31-46-148-10490-job29022/logs/simulator/stderr.html']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible