Duckietown Challenges Home Challenges Submissions

Submission 5609

Submission5609
Competingyes
Challengeaido3-LF-sim-validation
UserMoustafa Elarabi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 29068
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

29068

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
29068step1-simulationsuccessyes0:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1524979505568915
survival_time_median3.4999999999999956
deviation-center-line_median0.17043720847940044
in-drivable-lane_median1.099999999999998


other stats
agent_compute-ego_max0.0387249265398298
agent_compute-ego_mean0.03750285443074812
agent_compute-ego_median0.03778367042541504
agent_compute-ego_min0.03619349002838135
deviation-center-line_max0.318406381418274
deviation-center-line_mean0.17659327981621237
deviation-center-line_min0.0935443119314702
deviation-heading_max0.9949387469101568
deviation-heading_mean0.7307852620922466
deviation-heading_median0.7810799889676147
deviation-heading_min0.4357858400356022
driven_any_max2.0072744878463933
driven_any_mean1.530316055076492
driven_any_median1.5338538368566288
driven_any_min1.2004803882239206
driven_lanedir_consec_max1.887397826898796
driven_lanedir_consec_mean1.1712090013546823
driven_lanedir_consec_min0.7414132187777441
driven_lanedir_max1.887397826898796
driven_lanedir_mean1.1712090013546823
driven_lanedir_median1.1524979505568915
driven_lanedir_min0.7414132187777441
in-drivable-lane_max1.2999999999999954
in-drivable-lane_mean0.7499999999999977
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2004803882239206, "sim_physics": 0.0734428814479283, "survival_time": 3.4999999999999956, "driven_lanedir": 0.7414132187777441, "sim_render-ego": 0.01344196455819266, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.0387249265398298, "deviation-heading": 0.5397880456886355, "set_robot_commands": 0.009688220705304828, "deviation-center-line": 0.0935443119314702, "driven_lanedir_consec": 0.7414132187777441, "sim_compute_sim_state": 0.005111030169895717, "sim_compute_performance-ego": 0.008544039726257325, "sim_compute_robot_state-ego": 0.009625812939235142}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5338538368566288, "sim_physics": 0.07289255026615027, "survival_time": 3.2999999999999963, "driven_lanedir": 0.8476138278727412, "sim_render-ego": 0.013098785371491404, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.03619349002838135, "deviation-heading": 0.902333688859224, "set_robot_commands": 0.009962533459518894, "deviation-center-line": 0.17043720847940044, "driven_lanedir_consec": 0.8476138278727412, "sim_compute_sim_state": 0.005055991086092862, "sim_compute_performance-ego": 0.007852753003438314, "sim_compute_robot_state-ego": 0.00961067821040298}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.0072744878463933, "sim_physics": 0.07606715438640223, "survival_time": 5.649999999999988, "driven_lanedir": 1.887397826898796, "sim_render-ego": 0.013404700608380072, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.03673400710114336, "deviation-heading": 0.9949387469101568, "set_robot_commands": 0.009158005756614483, "deviation-center-line": 0.318406381418274, "driven_lanedir_consec": 1.887397826898796, "sim_compute_sim_state": 0.005063373430640296, "sim_compute_performance-ego": 0.008116390852801568, "sim_compute_robot_state-ego": 0.009668008416099886}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.694429274324517, "sim_physics": 0.07356879711151124, "survival_time": 3.999999999999994, "driven_lanedir": 1.2271221826672385, "sim_render-ego": 0.013294464349746704, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.03778367042541504, "deviation-heading": 0.4357858400356022, "set_robot_commands": 0.009108424186706545, "deviation-center-line": 0.11646624349222968, "driven_lanedir_consec": 1.2271221826672385, "sim_compute_sim_state": 0.005020514130592346, "sim_compute_performance-ego": 0.00807654857635498, "sim_compute_robot_state-ego": 0.009430888295173644}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2155422881310003, "sim_physics": 0.07191940654407848, "survival_time": 2.7499999999999982, "driven_lanedir": 1.1524979505568915, "sim_render-ego": 0.012643328579989349, "in-drivable-lane": 0, "agent_compute-ego": 0.03807817805897106, "deviation-heading": 0.7810799889676147, "set_robot_commands": 0.00936847600069913, "deviation-center-line": 0.1841122537596875, "driven_lanedir_consec": 1.1524979505568915, "sim_compute_sim_state": 0.005113692717118696, "sim_compute_performance-ego": 0.007629871368408203, "sim_compute_robot_state-ego": 0.009200720353560014}}
set_robot_commands_max0.009962533459518894
set_robot_commands_mean0.009457132021768776
set_robot_commands_median0.00936847600069913
set_robot_commands_min0.009108424186706545
sim_compute_performance-ego_max0.008544039726257325
sim_compute_performance-ego_mean0.008043920705452078
sim_compute_performance-ego_median0.00807654857635498
sim_compute_performance-ego_min0.007629871368408203
sim_compute_robot_state-ego_max0.009668008416099886
sim_compute_robot_state-ego_mean0.009507221642894336
sim_compute_robot_state-ego_median0.00961067821040298
sim_compute_robot_state-ego_min0.009200720353560014
sim_compute_sim_state_max0.005113692717118696
sim_compute_sim_state_mean0.005072920306867984
sim_compute_sim_state_median0.005063373430640296
sim_compute_sim_state_min0.005020514130592346
sim_physics_max0.07606715438640223
sim_physics_mean0.0735781579512141
sim_physics_median0.0734428814479283
sim_physics_min0.07191940654407848
sim_render-ego_max0.01344196455819266
sim_render-ego_mean0.013176648693560037
sim_render-ego_median0.013294464349746704
sim_render-ego_min0.012643328579989349
simulation-passed1
survival_time_max5.649999999999988
survival_time_mean3.839999999999995
survival_time_min2.7499999999999982
No reset possible
29067step1-simulationsuccessyes0:03:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
29066step1-simulationhost-erroryes0:00:58
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 894, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1277, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 306, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 287, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission5609/step1-simulation-ip-172-31-45-34-10499-job29066': '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission5609/step1-simulation-ip-172-31-45-34-10499-job29066'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
29065step1-simulationhost-erroryes0:01:56
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job29065-413943', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job29065-413943', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible