Duckietown Challenges Home Challenges Submissions

Submission 4716

Submission4716
Competingyes
Challengeaido3-LF-sim-validation
UserSoroush Saryazdi 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27154
Next
User labelupduck
Admin priority50
Blessingn/a
User priority50

27154

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
27154step1-simulationsuccessyes0:09:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9093084527115787
survival_time_median14.950000000000076
deviation-center-line_median0.5920295088433971
in-drivable-lane_median0.34999999999999876


other stats
agent_compute-ego_max0.027102142969767252
agent_compute-ego_mean0.02568464759405186
agent_compute-ego_median0.025480690966831164
agent_compute-ego_min0.0240636666615804
deviation-center-line_max0.84743537956784
deviation-center-line_mean0.56761581324314
deviation-center-line_min0.28926865530814344
deviation-heading_max3.113141356214026
deviation-heading_mean2.1702953724816165
deviation-heading_median2.001919734559453
deviation-heading_min1.0686210317352842
driven_any_max4.926154041168908
driven_any_mean3.3389367600768565
driven_any_median3.067601771952558
driven_any_min1.377229105923394
driven_lanedir_consec_max4.865580509238263
driven_lanedir_consec_mean3.171371887431765
driven_lanedir_consec_min1.3334576781834764
driven_lanedir_max4.865580509238263
driven_lanedir_mean3.171371887431765
driven_lanedir_median2.9093084527115787
driven_lanedir_min1.3334576781834764
in-drivable-lane_max0.9999999999999972
in-drivable-lane_mean0.4100000000000012
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.067601771952558, "sim_physics": 0.0774228819211324, "survival_time": 14.950000000000076, "driven_lanedir": 2.9093084527115787, "sim_render-ego": 0.012527544498443604, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.026479397614796955, "deviation-heading": 2.84547686452064, "set_robot_commands": 0.008883581956227621, "deviation-center-line": 0.5920295088433971, "driven_lanedir_consec": 2.9093084527115787, "sim_compute_sim_state": 0.005343801180521648, "sim_compute_performance-ego": 0.007575075626373291, "sim_compute_robot_state-ego": 0.009138044516245523}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.377229105923394, "sim_physics": 0.07549198289935509, "survival_time": 4.449999999999992, "driven_lanedir": 1.3334576781834764, "sim_render-ego": 0.012703740194942177, "in-drivable-lane": 0, "agent_compute-ego": 0.025480690966831164, "deviation-heading": 1.0686210317352842, "set_robot_commands": 0.009027633774146605, "deviation-center-line": 0.3255143184156362, "driven_lanedir_consec": 1.3334576781834764, "sim_compute_sim_state": 0.005513027812657731, "sim_compute_performance-ego": 0.007885322142183111, "sim_compute_robot_state-ego": 0.009342638294348556}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.926154041168908, "sim_physics": 0.0820712431271871, "survival_time": 14.950000000000076, "driven_lanedir": 4.865580509238263, "sim_render-ego": 0.013301300207773844, "in-drivable-lane": 0, "agent_compute-ego": 0.027102142969767252, "deviation-heading": 2.001919734559453, "set_robot_commands": 0.009255132675170898, "deviation-center-line": 0.7838312040806829, "driven_lanedir_consec": 4.865580509238263, "sim_compute_sim_state": 0.0058476885159810385, "sim_compute_performance-ego": 0.007983395258585612, "sim_compute_robot_state-ego": 0.009440688292185466}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.458766652829266, "sim_physics": 0.08473552465438842, "survival_time": 14.950000000000076, "driven_lanedir": 4.176869106529751, "sim_render-ego": 0.012923731803894042, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.02529733975728353, "deviation-heading": 3.113141356214026, "set_robot_commands": 0.008907117048899333, "deviation-center-line": 0.84743537956784, "driven_lanedir_consec": 4.176869106529751, "sim_compute_sim_state": 0.005544098218282064, "sim_compute_performance-ego": 0.007780277729034424, "sim_compute_robot_state-ego": 0.008720081647237142}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8649322285101575, "sim_physics": 0.0822630806973106, "survival_time": 8.549999999999986, "driven_lanedir": 2.5716436904957556, "sim_render-ego": 0.012456721032572072, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.0240636666615804, "deviation-heading": 1.82231787537868, "set_robot_commands": 0.00864172121237593, "deviation-center-line": 0.28926865530814344, "driven_lanedir_consec": 2.5716436904957556, "sim_compute_sim_state": 0.005517110489962394, "sim_compute_performance-ego": 0.007647900553474649, "sim_compute_robot_state-ego": 0.008655146548622534}}
set_robot_commands_max0.009255132675170898
set_robot_commands_mean0.008943037333364079
set_robot_commands_median0.008907117048899333
set_robot_commands_min0.00864172121237593
sim_compute_performance-ego_max0.007983395258585612
sim_compute_performance-ego_mean0.0077743942619302175
sim_compute_performance-ego_median0.007780277729034424
sim_compute_performance-ego_min0.007575075626373291
sim_compute_robot_state-ego_max0.009440688292185466
sim_compute_robot_state-ego_mean0.009059319859727844
sim_compute_robot_state-ego_median0.009138044516245523
sim_compute_robot_state-ego_min0.008655146548622534
sim_compute_sim_state_max0.0058476885159810385
sim_compute_sim_state_mean0.005553145243480976
sim_compute_sim_state_median0.005517110489962394
sim_compute_sim_state_min0.005343801180521648
sim_physics_max0.08473552465438842
sim_physics_mean0.08039694265987472
sim_physics_median0.0820712431271871
sim_physics_min0.07549198289935509
sim_render-ego_max0.013301300207773844
sim_render-ego_mean0.012782607547525146
sim_render-ego_median0.012703740194942177
sim_render-ego_min0.012456721032572072
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.57000000000004
survival_time_min4.449999999999992
No reset possible
27149step1-simulationsuccessyes0:12:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
27139step1-simulationhost-erroryes0:00:12
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 894, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1277, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 306, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 287, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4716/step1-simulation-ip-172-31-43-40-10498-job27139': '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4716/step1-simulation-ip-172-31-43-40-10498-job27139'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible