Duckietown Challenges Home Challenges Submissions

Submission 2569

Submission2569
Competingyes
Challengeaido2-LFVI-sim-validation
UserAlexander Karavaev
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22889
Next
User labelchallenge-aido_LF-template-ros - Template solution using ROS
Admin priority50
Blessingn/a
User priority50

22889

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-1-0

udem1-2-0

udem1-3-0

udem1-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22889step1-simulationsuccessyes0:06:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4702323960536803
survival_time_median2.849999999999998
deviation-center-line_median0.13623952041905
in-drivable-lane_median0.7999999999999976


other stats
agent_compute-ego_max0.03779195877442877
agent_compute-ego_mean0.03681586798109114
agent_compute-ego_median0.037035801471808016
agent_compute-ego_min0.035714680688423026
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.16546426353561405
deviation-center-line_min0.07144385614371519
deviation-heading_max1.2111022380750738
deviation-heading_mean0.8262001110734373
deviation-heading_median0.7978002362162198
deviation-heading_min0.39989969254594865
driven_any_max1.093753441791869
driven_any_mean0.7182169120135662
driven_any_median0.8072381933001392
driven_any_min0.29795781475632777
driven_lanedir_consec_max0.6735785385729686
driven_lanedir_consec_mean0.4271077107010905
driven_lanedir_consec_min0.2312609677194346
driven_lanedir_max0.6758329617605024
driven_lanedir_mean0.4275585953385973
driven_lanedir_median0.4702323960536803
driven_lanedir_min0.2312609677194346
in-drivable-lane_max1.6499999999999957
in-drivable-lane_mean0.7199999999999979
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.08055917038974991, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.0334306136671319, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.03779195877442877, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.05053520777139319, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.0206080545862037, "sim_compute_performance-ego": 0.03636457259396473, "sim_compute_robot_state-ego": 0.03748877938971462, "sim_compute_robot_state-npc0": 0.036684073597551825, "sim_compute_robot_state-npc1": 0.03617731347141496, "sim_compute_robot_state-npc2": 0.03640941252191383, "sim_compute_robot_state-npc3": 0.03649904354509101}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.08085169615568938, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.03390152366073043, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03748759516963252, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.04984658735769766, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.01988202554208261, "sim_compute_performance-ego": 0.03515081935458713, "sim_compute_robot_state-ego": 0.03711208590754756, "sim_compute_robot_state-npc0": 0.03536667647185149, "sim_compute_robot_state-npc1": 0.03545565958376284, "sim_compute_robot_state-npc2": 0.03602329889933268, "sim_compute_robot_state-npc3": 0.035760720570882164}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.08364306046412541, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.03340426775125357, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.037035801471808016, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.049314236029600486, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.02023207224332369, "sim_compute_performance-ego": 0.03491252813583765, "sim_compute_robot_state-ego": 0.03708287080128988, "sim_compute_robot_state-npc0": 0.03640468303973858, "sim_compute_robot_state-npc1": 0.03626149128644894, "sim_compute_robot_state-npc2": 0.03598411877950033, "sim_compute_robot_state-npc3": 0.03566101575509096}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.08188403698436, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.032592827813667166, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.035714680688423026, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.04929082017195852, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.020541027972572727, "sim_compute_performance-ego": 0.034901255055477746, "sim_compute_robot_state-ego": 0.03681282411541855, "sim_compute_robot_state-npc0": 0.03608720344409608, "sim_compute_robot_state-npc1": 0.03574798818220172, "sim_compute_robot_state-npc2": 0.035442076231303965, "sim_compute_robot_state-npc3": 0.03543125955682052}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.08179230275361435, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.032389412755551544, "in-drivable-lane": 0, "agent_compute-ego": 0.03604930380116338, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.048672416935796325, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.019954505174056343, "sim_compute_performance-ego": 0.034504330676534904, "sim_compute_robot_state-ego": 0.03714302311772886, "sim_compute_robot_state-npc0": 0.03553101290827212, "sim_compute_robot_state-npc1": 0.036603077598240066, "sim_compute_robot_state-npc2": 0.036380135494729744, "sim_compute_robot_state-npc3": 0.03550966926242994}}
set_robot_commands_max0.05053520777139319
set_robot_commands_mean0.04953185365328923
set_robot_commands_median0.049314236029600486
set_robot_commands_min0.048672416935796325
sim_compute_performance-ego_max0.03636457259396473
sim_compute_performance-ego_mean0.03516670116328043
sim_compute_performance-ego_median0.03491252813583765
sim_compute_performance-ego_min0.034504330676534904
sim_compute_robot_state-ego_max0.03748877938971462
sim_compute_robot_state-ego_mean0.0371279166663399
sim_compute_robot_state-ego_median0.03711208590754756
sim_compute_robot_state-ego_min0.03681282411541855
sim_compute_robot_state-npc0_max0.036684073597551825
sim_compute_robot_state-npc0_mean0.03601472989230202
sim_compute_robot_state-npc0_median0.03608720344409608
sim_compute_robot_state-npc0_min0.03536667647185149
sim_compute_robot_state-npc1_max0.036603077598240066
sim_compute_robot_state-npc1_mean0.036049106024413705
sim_compute_robot_state-npc1_median0.03617731347141496
sim_compute_robot_state-npc1_min0.03545565958376284
sim_compute_robot_state-npc2_max0.03640941252191383
sim_compute_robot_state-npc2_mean0.03604780838535611
sim_compute_robot_state-npc2_median0.03602329889933268
sim_compute_robot_state-npc2_min0.035442076231303965
sim_compute_robot_state-npc3_max0.03649904354509101
sim_compute_robot_state-npc3_mean0.035772341738062916
sim_compute_robot_state-npc3_median0.03566101575509096
sim_compute_robot_state-npc3_min0.03543125955682052
sim_compute_sim_state_max0.0206080545862037
sim_compute_sim_state_mean0.02024353710364781
sim_compute_sim_state_median0.02023207224332369
sim_compute_sim_state_min0.01988202554208261
sim_physics_max0.08364306046412541
sim_physics_mean0.08174605334950782
sim_physics_median0.08179230275361435
sim_physics_min0.08055917038974991
sim_render-ego_max0.03390152366073043
sim_render-ego_mean0.03314372912966693
sim_render-ego_median0.03340426775125357
sim_render-ego_min0.032389412755551544
simulation-passed1
survival_time_max4.149999999999993
survival_time_mean2.679999999999997
survival_time_min1.1500000000000004
No reset possible
21180step1-simulationsuccessno0:10:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20474step1-simulationsuccessno0:12:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20473step1-simulationsuccessno0:12:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19513step1-simulationsuccessno0:06:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18769step1-simulationsuccessno0:16:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18763step1-simulationhost-errorno0:06:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18763-236838', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18763-236838', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18763-236838', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18411step1-simulationsuccessno0:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17997step1-simulationsuccessno0:05:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17991step1-simulationsuccessno0:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible