Duckietown Challenges Home Challenges Submissions

Submission 3063

Submission3063
Competingyes
Challengeaido2-LFVI-sim-validation
UserAndrea Censi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22634
Next
User labelrotation
Admin priority50
Blessingn/a
User priority50

22634

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-1-0

udem1-2-0

udem1-3-0

udem1-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22634step1-simulationsuccessyes0:37:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.000305044676884636
survival_time_median14.950000000000076
deviation-center-line_median0.4891046565937845
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.15654685099919638
agent_compute-ego_mean0.15515980195999146
agent_compute-ego_median0.15556374073028564
agent_compute-ego_min0.1525131313006083
deviation-center-line_max0.6113246250082045
deviation-center-line_mean0.4225460275157091
deviation-center-line_min0.020737627062439232
deviation-heading_max5.830135897709594
deviation-heading_mean5.684570550707688
deviation-heading_median5.657649106857694
deviation-heading_min5.536662996854866
driven_any_max0.02647867283405392
driven_any_mean0.024864239592253624
driven_any_median0.02593019554120814
driven_any_min0.02216545266138003
driven_lanedir_consec_max0.002162616049345756
driven_lanedir_consec_mean-0.0004886462276792348
driven_lanedir_consec_min-0.0036402347654349576
driven_lanedir_max0.002162616049345756
driven_lanedir_mean-0.0004886462276792348
driven_lanedir_median0.000305044676884636
driven_lanedir_min-0.0036402347654349576
in-drivable-lane_max7.650000000000043
in-drivable-lane_mean7.600000000000042
in-drivable-lane_min7.550000000000044
per-episodes
details{"udem1-0-0": {"driven_any": 0.02647867283405392, "sim_physics": 0.19089327017466223, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.06302229086558024, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.15556374073028564, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.09884076515833536, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.039439262549082435, "sim_compute_performance-ego": 0.06963777860005696, "sim_compute_robot_state-ego": 0.074398725827535, "sim_compute_robot_state-npc0": 0.06983048597971599, "sim_compute_robot_state-npc1": 0.06944490591684978, "sim_compute_robot_state-npc2": 0.06962353150049845, "sim_compute_robot_state-npc3": 0.06919933398564657}, "udem1-1-0": {"driven_any": 0.02593019554120814, "sim_physics": 0.20286035776138303, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.06266499201456706, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15478568871815998, "deviation-heading": 5.795316370396738, "set_robot_commands": 0.09711106459299725, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.038844245274861654, "sim_compute_performance-ego": 0.06830163399378458, "sim_compute_robot_state-ego": 0.07329256534576416, "sim_compute_robot_state-npc0": 0.06876020113627115, "sim_compute_robot_state-npc1": 0.06832564353942872, "sim_compute_robot_state-npc2": 0.06931315739949544, "sim_compute_robot_state-npc3": 0.06895219405492146}, "udem1-2-0": {"driven_any": 0.02380440467243486, "sim_physics": 0.18972459316253665, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.06299083471298218, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.1525131313006083, "deviation-heading": 5.6030883817195525, "set_robot_commands": 0.0960243574778239, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.039229941368103025, "sim_compute_performance-ego": 0.06829575777053833, "sim_compute_robot_state-ego": 0.07406152486801147, "sim_compute_robot_state-npc0": 0.06943959792455037, "sim_compute_robot_state-npc1": 0.06908557812372844, "sim_compute_robot_state-npc2": 0.06909600734710693, "sim_compute_robot_state-npc3": 0.07063842535018922}, "udem1-3-0": {"driven_any": 0.02216545266138003, "sim_physics": 0.19260472615559895, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202353105, "sim_render-ego": 0.0632344675064087, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.15654685099919638, "deviation-heading": 5.536662996854866, "set_robot_commands": 0.1002322467168172, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202353105, "sim_compute_sim_state": 0.03851029396057129, "sim_compute_performance-ego": 0.06892403920491537, "sim_compute_robot_state-ego": 0.07397625048955282, "sim_compute_robot_state-npc0": 0.06884946743647258, "sim_compute_robot_state-npc1": 0.06806499083836873, "sim_compute_robot_state-npc2": 0.0688560422261556, "sim_compute_robot_state-npc3": 0.06886681715647379}, "udem1-4-0": {"driven_any": 0.02594247225219117, "sim_physics": 0.1980738425254822, "survival_time": 14.950000000000076, "driven_lanedir": 0.000305044676884636, "sim_render-ego": 0.0619713028271993, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.15638959805170696, "deviation-heading": 5.830135897709594, "set_robot_commands": 0.0978343677520752, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.000305044676884636, "sim_compute_sim_state": 0.03804886817932129, "sim_compute_performance-ego": 0.06796612977981567, "sim_compute_robot_state-ego": 0.0746860162417094, "sim_compute_robot_state-npc0": 0.0698667558034261, "sim_compute_robot_state-npc1": 0.06989970842997233, "sim_compute_robot_state-npc2": 0.06904610951741537, "sim_compute_robot_state-npc3": 0.06942482550938923}}
set_robot_commands_max0.1002322467168172
set_robot_commands_mean0.09800856033960978
set_robot_commands_median0.0978343677520752
set_robot_commands_min0.0960243574778239
sim_compute_performance-ego_max0.06963777860005696
sim_compute_performance-ego_mean0.06862506786982218
sim_compute_performance-ego_median0.06830163399378458
sim_compute_performance-ego_min0.06796612977981567
sim_compute_robot_state-ego_max0.0746860162417094
sim_compute_robot_state-ego_mean0.07408301655451457
sim_compute_robot_state-ego_median0.07406152486801147
sim_compute_robot_state-ego_min0.07329256534576416
sim_compute_robot_state-npc0_max0.0698667558034261
sim_compute_robot_state-npc0_mean0.06934930165608724
sim_compute_robot_state-npc0_median0.06943959792455037
sim_compute_robot_state-npc0_min0.06876020113627115
sim_compute_robot_state-npc1_max0.06989970842997233
sim_compute_robot_state-npc1_mean0.0689641653696696
sim_compute_robot_state-npc1_median0.06908557812372844
sim_compute_robot_state-npc1_min0.06806499083836873
sim_compute_robot_state-npc2_max0.06962353150049845
sim_compute_robot_state-npc2_mean0.06918696959813435
sim_compute_robot_state-npc2_median0.06909600734710693
sim_compute_robot_state-npc2_min0.0688560422261556
sim_compute_robot_state-npc3_max0.07063842535018922
sim_compute_robot_state-npc3_mean0.06941631921132405
sim_compute_robot_state-npc3_median0.06919933398564657
sim_compute_robot_state-npc3_min0.06886681715647379
sim_compute_sim_state_max0.039439262549082435
sim_compute_sim_state_mean0.038814522266387944
sim_compute_sim_state_median0.038844245274861654
sim_compute_sim_state_min0.03804886817932129
sim_physics_max0.20286035776138303
sim_physics_mean0.19483135795593265
sim_physics_median0.19260472615559895
sim_physics_min0.18972459316253665
sim_render-ego_max0.0632344675064087
sim_render-ego_mean0.0627767775853475
sim_render-ego_median0.06299083471298218
sim_render-ego_min0.0619713028271993
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
20864step1-simulationsuccessno0:35:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20837step1-simulationhost-errorno0:18:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission3063/step1-simulation-ip-172-31-40-253-32059-job20837/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20171step1-simulationsuccessno0:37:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20166step1-simulationhost-errorno0:00:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20166-731160', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20166-731160', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20166-731160', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20102step1-simulationsuccessno0:31:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20085step1-simulationsuccessno0:25:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible