Duckietown Challenges Home Challenges Submissions

Submission 3656

Submission3656
Competingyes
Challengeaido2-LF-sim-validation
Userjiang peng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23475
Next
User labelRL-TH-xyz
Admin priority50
Blessingn/a
User priority50

23475

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23475step1-simulationsuccessyes0:11:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6601686524415251
survival_time_median13.300000000000054
deviation-center-line_median0.3934561963593459
in-drivable-lane_median0.9999999999999964


other stats
agent_compute-ego_max0.10631141627406722
agent_compute-ego_mean0.10467877879828838
agent_compute-ego_median0.10415000836054485
agent_compute-ego_min0.10398321273999336
deviation-center-line_max0.7159369900356997
deviation-center-line_mean0.3888198686152492
deviation-center-line_min0.1368864080648932
deviation-heading_max2.585660156294618
deviation-heading_mean1.4996111984810372
deviation-heading_median1.6624986916468236
deviation-heading_min0.5509723559289654
driven_any_max2.5776326431550514
driven_any_mean1.9463457670700948
driven_any_median2.0581802629742074
driven_any_min1.0837226204642323
driven_lanedir_consec_max2.5263006027656463
driven_lanedir_consec_mean1.699653387168611
driven_lanedir_consec_min0.9934225797598628
driven_lanedir_max2.5263006027656463
driven_lanedir_mean1.699653387168611
driven_lanedir_median1.6601686524415251
driven_lanedir_min0.9934225797598628
in-drivable-lane_max1.40000000000002
in-drivable-lane_mean0.7700000000000065
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0581802629742074, "sim_physics": 0.05886234656471168, "survival_time": 13.550000000000058, "driven_lanedir": 1.6601686524415251, "sim_render-ego": 0.039102821772388864, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.10631141627406722, "deviation-heading": 1.6624986916468236, "set_robot_commands": 0.05713763272190446, "deviation-center-line": 0.4058166881770972, "driven_lanedir_consec": 1.6601686524415251, "sim_compute_sim_state": 0.02479272047092114, "sim_compute_performance-ego": 0.04168398617818347, "sim_compute_robot_state-ego": 0.04350836602524198}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0837226204642323, "sim_physics": 0.06304141850147432, "survival_time": 5.14999999999999, "driven_lanedir": 0.9934225797598628, "sim_render-ego": 0.03816614104706107, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.1040204960165672, "deviation-heading": 0.7692391563639723, "set_robot_commands": 0.056564981497607185, "deviation-center-line": 0.29200306043920987, "driven_lanedir_consec": 0.9934225797598628, "sim_compute_sim_state": 0.025330707864853943, "sim_compute_performance-ego": 0.042102288273931705, "sim_compute_robot_state-ego": 0.04416420853253707}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5776326431550514, "sim_physics": 0.05835317532221476, "survival_time": 14.950000000000076, "driven_lanedir": 2.5263006027656463, "sim_render-ego": 0.038137925465901695, "in-drivable-lane": 0, "agent_compute-ego": 0.10415000836054485, "deviation-heading": 2.585660156294618, "set_robot_commands": 0.05756393273671468, "deviation-center-line": 0.7159369900356997, "driven_lanedir_consec": 2.5263006027656463, "sim_compute_sim_state": 0.024626015027364095, "sim_compute_performance-ego": 0.04175795555114746, "sim_compute_robot_state-ego": 0.043017958799997966}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.42936047926378, "sim_physics": 0.06283736945991229, "survival_time": 13.300000000000054, "driven_lanedir": 2.0907493794664003, "sim_render-ego": 0.04017104062818943, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.10492876060026927, "deviation-heading": 1.929685632170806, "set_robot_commands": 0.05686915906748377, "deviation-center-line": 0.3934561963593459, "driven_lanedir_consec": 2.0907493794664003, "sim_compute_sim_state": 0.024763374400318117, "sim_compute_performance-ego": 0.04199275307189253, "sim_compute_robot_state-ego": 0.04431597361887308}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5828328294932026, "sim_physics": 0.06366385761489216, "survival_time": 5.849999999999987, "driven_lanedir": 1.2276257214096211, "sim_render-ego": 0.0381571900131356, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.10398321273999336, "deviation-heading": 0.5509723559289654, "set_robot_commands": 0.05645166095505413, "deviation-center-line": 0.1368864080648932, "driven_lanedir_consec": 1.2276257214096211, "sim_compute_sim_state": 0.025312050794943784, "sim_compute_performance-ego": 0.04227428354768672, "sim_compute_robot_state-ego": 0.04385749906556219}}
set_robot_commands_max0.05756393273671468
set_robot_commands_mean0.05691747339575283
set_robot_commands_median0.05686915906748377
set_robot_commands_min0.05645166095505413
sim_compute_performance-ego_max0.04227428354768672
sim_compute_performance-ego_mean0.041962253324568384
sim_compute_performance-ego_median0.04199275307189253
sim_compute_performance-ego_min0.04168398617818347
sim_compute_robot_state-ego_max0.04431597361887308
sim_compute_robot_state-ego_mean0.04377280120844246
sim_compute_robot_state-ego_median0.04385749906556219
sim_compute_robot_state-ego_min0.043017958799997966
sim_compute_sim_state_max0.025330707864853943
sim_compute_sim_state_mean0.024964973711680216
sim_compute_sim_state_median0.02479272047092114
sim_compute_sim_state_min0.024626015027364095
sim_physics_max0.06366385761489216
sim_physics_mean0.061351633492641035
sim_physics_median0.06283736945991229
sim_physics_min0.05835317532221476
sim_render-ego_max0.04017104062818943
sim_render-ego_mean0.03874702378533533
sim_render-ego_median0.03816614104706107
sim_render-ego_min0.038137925465901695
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.560000000000032
survival_time_min5.14999999999999
No reset possible
23474step1-simulationhost-erroryes0:00:42
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 759, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1100, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 286, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 267, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 709, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1344, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3656/step1-simulation-ip-172-31-40-253-16443-job23474': '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3656/step1-simulation-ip-172-31-40-253-16443-job23474'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible