Duckietown Challenges Home Challenges Submissions

Submission 5295

Submission5295
Competingyes
Challengeaido3-LF-sim-validation
UserRey Wiyatno 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 28303
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

28303

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
28303step1-simulationsuccessyes0:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.940574936610112
survival_time_median14.950000000000076
deviation-center-line_median0.763207183695417
in-drivable-lane_median1.549999999999999


other stats
agent_compute-ego_max0.04406269629796346
agent_compute-ego_mean0.04102583649369324
agent_compute-ego_median0.04171788546503807
agent_compute-ego_min0.03769068320592244
deviation-center-line_max1.078068124797833
deviation-center-line_mean0.7958858593555487
deviation-center-line_min0.5728060911749496
deviation-heading_max3.7701212240573536
deviation-heading_mean2.8592236440320784
deviation-heading_median2.7367832606824014
deviation-heading_min1.7571969500472626
driven_any_max5.387735223061357
driven_any_mean4.3846123102627015
driven_any_median4.853378340280431
driven_any_min3.05091235502922
driven_lanedir_consec_max4.844005277240461
driven_lanedir_consec_mean3.5452023194848814
driven_lanedir_consec_min2.5803085944110955
driven_lanedir_max5.263185116867533
driven_lanedir_mean4.08230995041275
driven_lanedir_median4.69275465685636
driven_lanedir_min2.671029764489283
in-drivable-lane_max3.749999999999996
in-drivable-lane_mean1.800000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.256986515612494, "sim_physics": 0.08398547967274984, "survival_time": 14.950000000000076, "driven_lanedir": 2.940574936610112, "sim_render-ego": 0.009653094609578451, "in-drivable-lane": 1.549999999999999, "agent_compute-ego": 0.0384136962890625, "deviation-heading": 3.7701212240573536, "set_robot_commands": 0.008254919052124023, "deviation-center-line": 1.078068124797833, "driven_lanedir_consec": 2.940574936610112, "sim_compute_sim_state": 0.004348646799723307, "sim_compute_performance-ego": 0.005699833234151204, "sim_compute_robot_state-ego": 0.007312276363372803}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.05091235502922, "sim_physics": 0.0826327557466468, "survival_time": 12.25000000000004, "driven_lanedir": 2.671029764489283, "sim_render-ego": 0.010169191749728456, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.04171788546503807, "deviation-heading": 2.500266897703551, "set_robot_commands": 0.00793898056964485, "deviation-center-line": 0.5728060911749496, "driven_lanedir_consec": 2.6683681323063766, "sim_compute_sim_state": 0.004321438925606864, "sim_compute_performance-ego": 0.00584831140479263, "sim_compute_robot_state-ego": 0.007415319948780293}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.387735223061357, "sim_physics": 0.08904250462849934, "survival_time": 14.950000000000076, "driven_lanedir": 4.844005277240461, "sim_render-ego": 0.01069589614868164, "in-drivable-lane": 3.749999999999996, "agent_compute-ego": 0.04406269629796346, "deviation-heading": 1.7571969500472626, "set_robot_commands": 0.008309022585550944, "deviation-center-line": 0.6675793069268203, "driven_lanedir_consec": 4.844005277240461, "sim_compute_sim_state": 0.004530834356943766, "sim_compute_performance-ego": 0.006263272762298584, "sim_compute_robot_state-ego": 0.007753503322601318}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.853378340280431, "sim_physics": 0.08345931768417358, "survival_time": 14.950000000000076, "driven_lanedir": 4.69275465685636, "sim_render-ego": 0.010271482467651367, "in-drivable-lane": 0, "agent_compute-ego": 0.04324422121047974, "deviation-heading": 3.531749887669825, "set_robot_commands": 0.007422850926717122, "deviation-center-line": 0.8977685901827231, "driven_lanedir_consec": 4.69275465685636, "sim_compute_sim_state": 0.004314560890197754, "sim_compute_performance-ego": 0.005963437557220459, "sim_compute_robot_state-ego": 0.007559072971343994}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.37404911733001, "sim_physics": 0.06194394667943319, "survival_time": 14.950000000000076, "driven_lanedir": 5.263185116867533, "sim_render-ego": 0.008110620180765788, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.03769068320592244, "deviation-heading": 2.7367832606824014, "set_robot_commands": 0.0059948587417602535, "deviation-center-line": 0.763207183695417, "driven_lanedir_consec": 2.5803085944110955, "sim_compute_sim_state": 0.003335544268290202, "sim_compute_performance-ego": 0.004531311988830567, "sim_compute_robot_state-ego": 0.005800477663675944}}
set_robot_commands_max0.008309022585550944
set_robot_commands_mean0.007584126375159439
set_robot_commands_median0.00793898056964485
set_robot_commands_min0.0059948587417602535
sim_compute_performance-ego_max0.006263272762298584
sim_compute_performance-ego_mean0.005661233389458688
sim_compute_performance-ego_median0.00584831140479263
sim_compute_performance-ego_min0.004531311988830567
sim_compute_robot_state-ego_max0.007753503322601318
sim_compute_robot_state-ego_mean0.00716813005395487
sim_compute_robot_state-ego_median0.007415319948780293
sim_compute_robot_state-ego_min0.005800477663675944
sim_compute_sim_state_max0.004530834356943766
sim_compute_sim_state_mean0.004170205048152379
sim_compute_sim_state_median0.004321438925606864
sim_compute_sim_state_min0.003335544268290202
sim_physics_max0.08904250462849934
sim_physics_mean0.08021280088230055
sim_physics_median0.08345931768417358
sim_physics_min0.06194394667943319
sim_render-ego_max0.01069589614868164
sim_render-ego_mean0.00978005703128114
sim_render-ego_median0.010169191749728456
sim_render-ego_min0.008110620180765788
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.410000000000068
survival_time_min12.25000000000004
No reset possible
28302step1-simulationsuccessyes0:09:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28290step1-simulationhost-erroryes0:07:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 648, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1309, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1565, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 40, in copy_to_cache
    msg = "Copying %s to cache %s" % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission5295/step1-simulation-ip-172-31-35-218-10490-job28290/tmp/tmppeklj_pr/episodes/ETHZ_autolab_technical_track-4-0/drawing.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28289step1-simulationerroryes0:08:29
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
28288step1-simulationerroryes0:08:29
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible