Duckietown Challenges Home Challenges Submissions

Submission 4750

Submission4750
Competingyes
Challengeaido3-LF-sim-validation
UserRey Wiyatno 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27095
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

27095

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27095step1-simulationsuccessyes0:09:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7180795373664046
survival_time_median14.950000000000076
deviation-center-line_median0.5004098106313846
in-drivable-lane_median1.6500000000000234


other stats
agent_compute-ego_max0.048745607874196045
agent_compute-ego_mean0.047071791607356625
agent_compute-ego_median0.04681860869097861
agent_compute-ego_min0.045708008607228595
deviation-center-line_max0.7725052998244433
deviation-center-line_mean0.553041296016645
deviation-center-line_min0.3853003607883889
deviation-heading_max3.0315345524577912
deviation-heading_mean2.1700846700162466
deviation-heading_median2.1855327878082824
deviation-heading_min1.264818652219495
driven_any_max5.2013692041866735
driven_any_mean3.71291361765863
driven_any_median3.596646944476264
driven_any_min2.41005349800833
driven_lanedir_consec_max4.813721939951934
driven_lanedir_consec_mean3.3001163032739966
driven_lanedir_consec_min1.9598232912004607
driven_lanedir_max4.813721939951934
driven_lanedir_mean3.3001163032739966
driven_lanedir_median2.7180795373664046
driven_lanedir_min1.9598232912004607
in-drivable-lane_max3.850000000000019
in-drivable-lane_mean1.590000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.596646944476264, "sim_physics": 0.09226579427719116, "survival_time": 14.950000000000076, "driven_lanedir": 2.7180795373664046, "sim_render-ego": 0.012630585829416912, "in-drivable-lane": 3.850000000000019, "agent_compute-ego": 0.04637569109598796, "deviation-heading": 2.7316102089124588, "set_robot_commands": 0.008950730959574382, "deviation-center-line": 0.4696787235853761, "driven_lanedir_consec": 2.7180795373664046, "sim_compute_sim_state": 0.005425933202107747, "sim_compute_performance-ego": 0.008139193058013916, "sim_compute_robot_state-ego": 0.00939530372619629}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.41005349800833, "sim_physics": 0.0675286092575948, "survival_time": 7.84999999999998, "driven_lanedir": 2.3180915311421035, "sim_render-ego": 0.01168213832150599, "in-drivable-lane": 0, "agent_compute-ego": 0.048745607874196045, "deviation-heading": 2.1855327878082824, "set_robot_commands": 0.008449732118351445, "deviation-center-line": 0.5004098106313846, "driven_lanedir_consec": 2.3180915311421035, "sim_compute_sim_state": 0.004962890770784609, "sim_compute_performance-ego": 0.007057054786925103, "sim_compute_robot_state-ego": 0.008360984219107657}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.542725308880879, "sim_physics": 0.06756913434168335, "survival_time": 7.84999999999998, "driven_lanedir": 1.9598232912004607, "sim_render-ego": 0.01260832616478015, "in-drivable-lane": 2.449999999999992, "agent_compute-ego": 0.04681860869097861, "deviation-heading": 1.264818652219495, "set_robot_commands": 0.00907451483854063, "deviation-center-line": 0.3853003607883889, "driven_lanedir_consec": 1.9598232912004607, "sim_compute_sim_state": 0.005499144268643325, "sim_compute_performance-ego": 0.00738548928764975, "sim_compute_robot_state-ego": 0.00923615504222311}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.813773132741005, "sim_physics": 0.06722952365875244, "survival_time": 14.950000000000076, "driven_lanedir": 4.6908652167090805, "sim_render-ego": 0.011213459968566895, "in-drivable-lane": 0, "agent_compute-ego": 0.045708008607228595, "deviation-heading": 3.0315345524577912, "set_robot_commands": 0.00820162852605184, "deviation-center-line": 0.7725052998244433, "driven_lanedir_consec": 4.6908652167090805, "sim_compute_sim_state": 0.004856962362925212, "sim_compute_performance-ego": 0.006827516555786133, "sim_compute_robot_state-ego": 0.008026670614878337}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.2013692041866735, "sim_physics": 0.07346212784449259, "survival_time": 14.950000000000076, "driven_lanedir": 4.813721939951934, "sim_render-ego": 0.012262891133626302, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.04771104176839193, "deviation-heading": 1.636927148683205, "set_robot_commands": 0.008732911745707193, "deviation-center-line": 0.637312285253632, "driven_lanedir_consec": 4.813721939951934, "sim_compute_sim_state": 0.005187579790751139, "sim_compute_performance-ego": 0.00719594399134318, "sim_compute_robot_state-ego": 0.008566444714864094}}
set_robot_commands_max0.00907451483854063
set_robot_commands_mean0.008681903637645098
set_robot_commands_median0.008732911745707193
set_robot_commands_min0.00820162852605184
sim_compute_performance-ego_max0.008139193058013916
sim_compute_performance-ego_mean0.007321039535943616
sim_compute_performance-ego_median0.00719594399134318
sim_compute_performance-ego_min0.006827516555786133
sim_compute_robot_state-ego_max0.00939530372619629
sim_compute_robot_state-ego_mean0.008717111663453897
sim_compute_robot_state-ego_median0.008566444714864094
sim_compute_robot_state-ego_min0.008026670614878337
sim_compute_sim_state_max0.005499144268643325
sim_compute_sim_state_mean0.005186502079042406
sim_compute_sim_state_median0.005187579790751139
sim_compute_sim_state_min0.004856962362925212
sim_physics_max0.09226579427719116
sim_physics_mean0.07361103787594286
sim_physics_median0.06756913434168335
sim_physics_min0.06722952365875244
sim_render-ego_max0.012630585829416912
sim_render-ego_mean0.01207948028357925
sim_render-ego_median0.012262891133626302
sim_render-ego_min0.011213459968566895
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.11000000000004
survival_time_min7.84999999999998
No reset possible
27092step1-simulationsuccessyes0:10:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26464step1-simulationsuccessno0:08:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26463step1-simulationsuccessno0:05:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
26462step1-simulationhost-errorno0:06:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 40, in copy_to_cache
    msg = "Copying %s to cache %s" % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4750/step1-simulation-ip-172-31-35-218-10491-job26462/challenge-evaluation-output/episodes/ETHZ_autolab_technical_track-2-0/drawing.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible