Evaluator 805

step1-simulation

success

2019-04-26 22:00:27+00:00

2019-04-26 22:21:43+00:00

0:21:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4434704365929587
survival_time_median	13.300000000000054
deviation-center-line_median	0.658003595311064
in-drivable-lane_median	5.250000000000065

other stats

agent_compute-ego_max	0.1226197067896525
agent_compute-ego_mean	0.1210524699927407
agent_compute-ego_median	0.1209040127548517
agent_compute-ego_min	0.12016444890074028
deviation-center-line_max	0.8132426664665893
deviation-center-line_mean	0.635026285791169
deviation-center-line_min	0.4844235659756217
deviation-heading_max	3.352973803126495
deviation-heading_mean	2.5068386765895565
deviation-heading_median	2.4185519043469443
deviation-heading_min	1.1753094982328518
driven_any_max	0.93824410752437
driven_any_mean	0.8619384153958155
driven_any_median	0.8300281175540088
driven_any_min	0.788410205146125
driven_lanedir_consec_max	0.9001127983452686
driven_lanedir_consec_mean	0.5999638228146578
driven_lanedir_consec_min	0.37462671691741933
driven_lanedir_max	0.9001127983452686
driven_lanedir_mean	0.5999638228146578
driven_lanedir_median	0.4434704365929587
driven_lanedir_min	0.37462671691741933
in-drivable-lane_max	6.700000000000062
in-drivable-lane_mean	3.700000000000043
in-drivable-lane_min	0.10000000000000142
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8150878195483384, "sim_physics": 0.08998079262962637, "survival_time": 12.900000000000048, "driven_lanedir": 0.37462671691741933, "sim_render-ego": 0.03499367255573125, "in-drivable-lane": 6.700000000000062, "agent_compute-ego": 0.12016444890074028, "deviation-heading": 1.1753094982328518, "set_robot_commands": 0.05520692352176637, "deviation-center-line": 0.658003595311064, "driven_lanedir_consec": 0.37462671691741933, "sim_compute_sim_state": 0.02223327825235766, "sim_compute_performance-ego": 0.039237959440364394, "sim_compute_robot_state-ego": 0.04017306021017621, "sim_compute_robot_state-npc0": 0.0400051941243253, "sim_compute_robot_state-npc1": 0.039133101470710696, "sim_compute_robot_state-npc2": 0.038922836614209554, "sim_compute_robot_state-npc3": 0.03903908415358196}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9379218272062352, "sim_physics": 0.09864480177561442, "survival_time": 14.950000000000076, "driven_lanedir": 0.9001127983452686, "sim_render-ego": 0.034993871847788495, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.1226197067896525, "deviation-heading": 3.352973803126495, "set_robot_commands": 0.05408549706141154, "deviation-center-line": 0.7204204432371522, "driven_lanedir_consec": 0.9001127983452686, "sim_compute_sim_state": 0.02196122407913208, "sim_compute_performance-ego": 0.03868539651234944, "sim_compute_robot_state-ego": 0.03991535822550456, "sim_compute_robot_state-npc0": 0.039609045187632246, "sim_compute_robot_state-npc1": 0.038498940467834475, "sim_compute_robot_state-npc2": 0.03836216688156128, "sim_compute_robot_state-npc3": 0.03850587606430054}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8300281175540088, "sim_physics": 0.09088143549467388, "survival_time": 13.300000000000054, "driven_lanedir": 0.4434704365929587, "sim_render-ego": 0.03432492385233255, "in-drivable-lane": 5.600000000000073, "agent_compute-ego": 0.12065617303202925, "deviation-heading": 2.4185519043469443, "set_robot_commands": 0.05443933763002094, "deviation-center-line": 0.4990411579654187, "driven_lanedir_consec": 0.4434704365929587, "sim_compute_sim_state": 0.022063791303706348, "sim_compute_performance-ego": 0.037407209102372475, "sim_compute_robot_state-ego": 0.04007728028118162, "sim_compute_robot_state-npc0": 0.0392975179772628, "sim_compute_robot_state-npc1": 0.040530811575122346, "sim_compute_robot_state-npc2": 0.03820562990088212, "sim_compute_robot_state-npc3": 0.03937955279099314}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.788410205146125, "sim_physics": 0.09023685361824783, "survival_time": 12.750000000000046, "driven_lanedir": 0.43144417737982144, "sim_render-ego": 0.0363799113853305, "in-drivable-lane": 5.250000000000065, "agent_compute-ego": 0.1209040127548517, "deviation-heading": 2.3783435247397895, "set_robot_commands": 0.054087104049383425, "deviation-center-line": 0.4844235659756217, "driven_lanedir_consec": 0.43144417737982144, "sim_compute_sim_state": 0.02211622256858676, "sim_compute_performance-ego": 0.037662111544141584, "sim_compute_robot_state-ego": 0.03955399382348154, "sim_compute_robot_state-npc0": 0.03921079542122635, "sim_compute_robot_state-npc1": 0.038388302746941064, "sim_compute_robot_state-npc2": 0.03835636494206447, "sim_compute_robot_state-npc3": 0.03850990183213178}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.93824410752437, "sim_physics": 0.09453424453735353, "survival_time": 14.950000000000076, "driven_lanedir": 0.8501649848378204, "sim_render-ego": 0.03479205369949341, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.12091800848642983, "deviation-heading": 3.209014652501702, "set_robot_commands": 0.054774345556894935, "deviation-center-line": 0.8132426664665893, "driven_lanedir_consec": 0.8501649848378204, "sim_compute_sim_state": 0.02203951597213745, "sim_compute_performance-ego": 0.03732408364613851, "sim_compute_robot_state-ego": 0.03967433293660482, "sim_compute_robot_state-npc0": 0.03949718157450358, "sim_compute_robot_state-npc1": 0.03840140581130982, "sim_compute_robot_state-npc2": 0.038635469277699785, "sim_compute_robot_state-npc3": 0.03860084692637126}}
set_robot_commands_max	0.05520692352176637
set_robot_commands_mean	0.05451864156389544
set_robot_commands_median	0.05443933763002094
set_robot_commands_min	0.05408549706141154
sim_compute_performance-ego_max	0.039237959440364394
sim_compute_performance-ego_mean	0.03806335204907328
sim_compute_performance-ego_median	0.037662111544141584
sim_compute_performance-ego_min	0.03732408364613851
sim_compute_robot_state-ego_max	0.04017306021017621
sim_compute_robot_state-ego_mean	0.039878805095389755
sim_compute_robot_state-ego_median	0.03991535822550456
sim_compute_robot_state-ego_min	0.03955399382348154
sim_compute_robot_state-npc0_max	0.0400051941243253
sim_compute_robot_state-npc0_mean	0.03952394685699005
sim_compute_robot_state-npc0_median	0.03949718157450358
sim_compute_robot_state-npc0_min	0.03921079542122635
sim_compute_robot_state-npc1_max	0.040530811575122346
sim_compute_robot_state-npc1_mean	0.03899051241438368
sim_compute_robot_state-npc1_median	0.038498940467834475
sim_compute_robot_state-npc1_min	0.038388302746941064
sim_compute_robot_state-npc2_max	0.038922836614209554
sim_compute_robot_state-npc2_mean	0.03849649352328344
sim_compute_robot_state-npc2_median	0.03836216688156128
sim_compute_robot_state-npc2_min	0.03820562990088212
sim_compute_robot_state-npc3_max	0.03937955279099314
sim_compute_robot_state-npc3_mean	0.03880705235347573
sim_compute_robot_state-npc3_median	0.03860084692637126
sim_compute_robot_state-npc3_min	0.03850587606430054
sim_compute_sim_state_max	0.02223327825235766
sim_compute_sim_state_mean	0.02208280643518406
sim_compute_sim_state_median	0.022063791303706348
sim_compute_sim_state_min	0.02196122407913208
sim_physics_max	0.09864480177561442
sim_physics_mean	0.0928556256111032
sim_physics_median	0.09088143549467388
sim_physics_min	0.08998079262962637
sim_render-ego_max	0.0363799113853305
sim_render-ego_mean	0.03509688666813524
sim_render-ego_median	0.03499367255573125
sim_render-ego_min	0.03432492385233255
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.770000000000058
survival_time_min	12.750000000000046

No reset possible

20698

3096

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-26 16:55:07+00:00

2019-04-26 17:00:05+00:00

0:04:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20698-427445', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20698-427445', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20698-427445', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20695

3095

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-26 14:56:50+00:00

2019-04-26 15:00:05+00:00

0:03:15

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20695-248229', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20695-248229', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20695-248229', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20682

3086

Claudio Ruch

Python template

aido2-AMOD-efficiency

step1-simulation

failed

yes

aido2-AMOD-service_quality

2019-04-26 13:06:06+00:00

2019-04-26 13:26:15+00:00

0:20:09

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 288, in wait_for_solution
    return wait_for_file(fn, timeout=TIMEOUT_SOLUTION, wait=1)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 245, in wait_for_file
    raise Timeout(msg)
duckietown_challenges.cie_concrete.Timeout: Timeout of 600 while waiting for /challenges/challenge-solution-output/output-solution.yaml.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 505, in wrap_evaluator
    cie.wait_for_solution()
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 291, in wait_for_solution
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Time out: Timeout of 600 while waiting for /challenges/challenge-solution-output/output-solution.yaml.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20679

3087

Claudio Ruch

Python template

step1-simulation

success

yes

2019-04-26 12:40:06+00:00

2019-04-26 12:43:16+00:00

0:03:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20656

3070

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 10:02:25+00:00

2019-04-26 10:21:25+00:00

0:19:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6284831367985957
survival_time_median	10.90000000000002
deviation-center-line_median	0.5451688280658136
in-drivable-lane_median	1.4499999999999984

other stats

agent_compute-ego_max	0.228579949488682
agent_compute-ego_mean	0.2104526009855742
agent_compute-ego_median	0.2096293773807463
agent_compute-ego_min	0.19410014152526855
deviation-center-line_max	0.9469109282266313
deviation-center-line_mean	0.6187594786192575
deviation-center-line_min	0.3745003648529284
deviation-heading_max	3.705148473738756
deviation-heading_mean	1.5927143900859622
deviation-heading_median	1.0353684535419978
deviation-heading_min	0.7229427430952275
driven_any_max	1.3743268594252878
driven_any_mean	0.8475196795891968
driven_any_median	0.9932053120643004
driven_any_min	0.29728133305141663
driven_lanedir_consec_max	0.8048205685102011
driven_lanedir_consec_mean	0.5986925846439184
driven_lanedir_consec_min	0.2911392357483962
driven_lanedir_max	0.8048205685102011
driven_lanedir_mean	0.5986925846439184
driven_lanedir_median	0.6284831367985957
driven_lanedir_min	0.2911392357483962
in-drivable-lane_max	6.6500000000000945
in-drivable-lane_mean	2.3500000000000263
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9932053120643004, "sim_physics": 0.10457293812288056, "survival_time": 10.90000000000002, "driven_lanedir": 0.6284831367985957, "sim_render-ego": 0.05964568229990268, "in-drivable-lane": 3.6500000000000377, "agent_compute-ego": 0.19410014152526855, "deviation-heading": 1.0353684535419978, "set_robot_commands": 0.0863485336303711, "deviation-center-line": 0.5451688280658136, "driven_lanedir_consec": 0.6284831367985957, "sim_compute_sim_state": 0.03786477036432389, "sim_compute_performance-ego": 0.06570135015960134, "sim_compute_robot_state-ego": 0.06780083901291593}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0305445824774817, "sim_physics": 0.12280064346516029, "survival_time": 11.300000000000026, "driven_lanedir": 0.8048205685102011, "sim_render-ego": 0.06568854256013854, "in-drivable-lane": 1.4499999999999984, "agent_compute-ego": 0.228579949488682, "deviation-heading": 3.705148473738756, "set_robot_commands": 0.09607953729882704, "deviation-center-line": 0.9469109282266313, "driven_lanedir_consec": 0.8048205685102011, "sim_compute_sim_state": 0.03993213598707081, "sim_compute_performance-ego": 0.06923825761913198, "sim_compute_robot_state-ego": 0.07887685404414624}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.29728133305141663, "sim_physics": 0.09858641965048652, "survival_time": 3.4999999999999956, "driven_lanedir": 0.2911392357483962, "sim_render-ego": 0.060904833248683385, "in-drivable-lane": 0, "agent_compute-ego": 0.21943182264055525, "deviation-heading": 0.7229427430952275, "set_robot_commands": 0.09204041617257254, "deviation-center-line": 0.3745003648529284, "driven_lanedir_consec": 0.2911392357483962, "sim_compute_sim_state": 0.04129582473209926, "sim_compute_performance-ego": 0.06902308804648263, "sim_compute_robot_state-ego": 0.07396691526685442}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5422403109274971, "sim_physics": 0.1038068024838557, "survival_time": 6.099999999999986, "driven_lanedir": 0.525663595621864, "sim_render-ego": 0.06014494426914903, "in-drivable-lane": 0, "agent_compute-ego": 0.2096293773807463, "deviation-heading": 1.5211104268059048, "set_robot_commands": 0.0901577609484313, "deviation-center-line": 0.440938382172192, "driven_lanedir_consec": 0.525663595621864, "sim_compute_sim_state": 0.037897192063878794, "sim_compute_performance-ego": 0.06582081708751741, "sim_compute_robot_state-ego": 0.0703409128501767}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3743268594252878, "sim_physics": 0.11520155350367228, "survival_time": 14.950000000000076, "driven_lanedir": 0.743356386540535, "sim_render-ego": 0.06060741504033407, "in-drivable-lane": 6.6500000000000945, "agent_compute-ego": 0.2005217138926188, "deviation-heading": 0.9790018532479252, "set_robot_commands": 0.08955635865529378, "deviation-center-line": 0.7862788897787225, "driven_lanedir_consec": 0.743356386540535, "sim_compute_sim_state": 0.03706476132074992, "sim_compute_performance-ego": 0.06651402791341146, "sim_compute_robot_state-ego": 0.06871552467346191}}
set_robot_commands_max	0.09607953729882704
set_robot_commands_mean	0.09083652134109917
set_robot_commands_median	0.0901577609484313
set_robot_commands_min	0.0863485336303711
sim_compute_performance-ego_max	0.06923825761913198
sim_compute_performance-ego_mean	0.06725950816522897
sim_compute_performance-ego_median	0.06651402791341146
sim_compute_performance-ego_min	0.06570135015960134
sim_compute_robot_state-ego_max	0.07887685404414624
sim_compute_robot_state-ego_mean	0.07194020916951105
sim_compute_robot_state-ego_median	0.0703409128501767
sim_compute_robot_state-ego_min	0.06780083901291593
sim_compute_sim_state_max	0.04129582473209926
sim_compute_sim_state_mean	0.03881093689362453
sim_compute_sim_state_median	0.037897192063878794
sim_compute_sim_state_min	0.03706476132074992
sim_physics_max	0.12280064346516029
sim_physics_mean	0.10899367144521106
sim_physics_median	0.10457293812288056
sim_physics_min	0.09858641965048652
sim_render-ego_max	0.06568854256013854
sim_render-ego_mean	0.061398283483641534
sim_render-ego_median	0.06060741504033407
sim_render-ego_min	0.05964568229990268
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.35000000000002
survival_time_min	3.4999999999999956

No reset possible

20638

2376

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-25 15:10:48+00:00

2019-04-25 15:17:25+00:00

0:06:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6706320447655254
survival_time_median	3.649999999999995
deviation-center-line_median	0.1443022347216951
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.07549579079086716
agent_compute-ego_mean	0.06367339022826522
agent_compute-ego_median	0.06104970829827445
agent_compute-ego_min	0.05861500147226695
deviation-center-line_max	0.4004784761211184
deviation-center-line_mean	0.2180329391973995
deviation-center-line_min	0.1241222516023625
deviation-heading_max	1.0472953726467125
deviation-heading_mean	0.5587116998597059
deviation-heading_median	0.5584700619682197
deviation-heading_min	0.3001803644882976
driven_any_max	1.5796421483387642
driven_any_mean	0.8626819028624159
driven_any_median	0.9946421491379502
driven_any_min	0.2748323161055837
driven_lanedir_consec_max	1.1255773482598914
driven_lanedir_consec_mean	0.6744516539239503
driven_lanedir_consec_min	0.26694401727266204
driven_lanedir_max	1.1255773482598914
driven_lanedir_mean	0.6744516539239503
driven_lanedir_median	0.6706320447655254
driven_lanedir_min	0.26694401727266204
in-drivable-lane_max	1.499999999999995
in-drivable-lane_mean	0.5299999999999981
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9946421491379502, "sim_physics": 0.09049447921857444, "survival_time": 3.649999999999995, "driven_lanedir": 0.6706320447655254, "sim_render-ego": 0.06119108200073242, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05999185287789123, "deviation-heading": 0.5584700619682197, "set_robot_commands": 0.08812979802693406, "deviation-center-line": 0.1443022347216951, "driven_lanedir_consec": 0.6706320447655254, "sim_compute_sim_state": 0.03570589300704329, "sim_compute_performance-ego": 0.06431542357353315, "sim_compute_robot_state-ego": 0.06870291984244568}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009642148956158, "sim_physics": 0.09016458086065345, "survival_time": 3.699999999999995, "driven_lanedir": 0.8759181599115546, "sim_render-ego": 0.060026275145040976, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.05861500147226695, "deviation-heading": 1.0472953726467125, "set_robot_commands": 0.08650711420420054, "deviation-center-line": 0.29628367710760867, "driven_lanedir_consec": 0.8759181599115546, "sim_compute_sim_state": 0.03655393381376524, "sim_compute_performance-ego": 0.06529305110106597, "sim_compute_robot_state-ego": 0.06676001484329636}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2748323161055837, "sim_physics": 0.08629653930664062, "survival_time": 1.2500000000000004, "driven_lanedir": 0.26694401727266204, "sim_render-ego": 0.060167303085327146, "in-drivable-lane": 0, "agent_compute-ego": 0.06321459770202636, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.08676060676574707, "deviation-center-line": 0.1241222516023625, "driven_lanedir_consec": 0.26694401727266204, "sim_compute_sim_state": 0.0340289306640625, "sim_compute_performance-ego": 0.06777711868286133, "sim_compute_robot_state-ego": 0.07135933876037598}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4546507517736229, "sim_physics": 0.118217726011534, "survival_time": 1.850000000000001, "driven_lanedir": 0.43318669941011834, "sim_render-ego": 0.06812966836465371, "in-drivable-lane": 0, "agent_compute-ego": 0.07549579079086716, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.10166976258561418, "deviation-center-line": 0.1249780564342128, "driven_lanedir_consec": 0.43318669941011834, "sim_compute_sim_state": 0.045286275245047906, "sim_compute_performance-ego": 0.07597649419629895, "sim_compute_robot_state-ego": 0.08602289251379065}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5796421483387642, "sim_physics": 0.1016698841537748, "survival_time": 5.599999999999988, "driven_lanedir": 1.1255773482598914, "sim_render-ego": 0.05978231983525412, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.06104970829827445, "deviation-heading": 0.31685839721760034, "set_robot_commands": 0.0917236294065203, "deviation-center-line": 0.4004784761211184, "driven_lanedir_consec": 1.1255773482598914, "sim_compute_sim_state": 0.038460774081093926, "sim_compute_performance-ego": 0.06736056932381221, "sim_compute_robot_state-ego": 0.06887858893190112}}
set_robot_commands_max	0.10166976258561418
set_robot_commands_mean	0.09095818219780324
set_robot_commands_median	0.08812979802693406
set_robot_commands_min	0.08650711420420054
sim_compute_performance-ego_max	0.07597649419629895
sim_compute_performance-ego_mean	0.06814453137551432
sim_compute_performance-ego_median	0.06736056932381221
sim_compute_performance-ego_min	0.06431542357353315
sim_compute_robot_state-ego_max	0.08602289251379065
sim_compute_robot_state-ego_mean	0.07234475097836196
sim_compute_robot_state-ego_median	0.06887858893190112
sim_compute_robot_state-ego_min	0.06676001484329636
sim_compute_sim_state_max	0.045286275245047906
sim_compute_sim_state_mean	0.03800716136220257
sim_compute_sim_state_median	0.03655393381376524
sim_compute_sim_state_min	0.0340289306640625
sim_physics_max	0.118217726011534
sim_physics_mean	0.09736864191023543
sim_physics_median	0.09049447921857444
sim_physics_min	0.08629653930664062
sim_render-ego_max	0.06812966836465371
sim_render-ego_mean	0.06185932968620167
sim_render-ego_median	0.060167303085327146
sim_render-ego_min	0.05978231983525412
simulation-passed	1
survival_time_max	5.599999999999988
survival_time_mean	3.209999999999996
survival_time_min	1.2500000000000004

No reset possible

20623

2364

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 15:00:23+00:00

2019-04-25 15:10:40+00:00

0:10:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.19341742075406587
agent_compute-ego_mean	0.16431668514541165
agent_compute-ego_median	0.1727840680825083
agent_compute-ego_min	0.13108646428143536
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.2332679955464489, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.08713978641438035, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.19019148934562252, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.1327615683933474, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.051660398267350104, "sim_compute_performance-ego": 0.10133003288844848, "sim_compute_robot_state-ego": 0.11438601421860028, "sim_compute_robot_state-npc0": 0.09883099232079848, "sim_compute_robot_state-npc1": 0.09810844457374428, "sim_compute_robot_state-npc2": 0.09412438914460956, "sim_compute_robot_state-npc3": 0.09369692262613548}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.25241613388061523, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.09047597188215988, "in-drivable-lane": 0, "agent_compute-ego": 0.19341742075406587, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.1400446708385761, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.059445830491872936, "sim_compute_performance-ego": 0.09887869541461652, "sim_compute_robot_state-ego": 0.12159506174234244, "sim_compute_robot_state-npc0": 0.10125349118159369, "sim_compute_robot_state-npc1": 0.1030749357663668, "sim_compute_robot_state-npc2": 0.10571969472444974, "sim_compute_robot_state-npc3": 0.10447412270766038}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.1970158219337463, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.07931842302021228, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.1727840680825083, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.11581685668543766, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.04794588841890034, "sim_compute_performance-ego": 0.08465197525526348, "sim_compute_robot_state-ego": 0.09664854250456158, "sim_compute_robot_state-npc0": 0.0852677539775246, "sim_compute_robot_state-npc1": 0.08281960612849186, "sim_compute_robot_state-npc2": 0.08472964951866552, "sim_compute_robot_state-npc3": 0.08499018769515188}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.15025103544887108, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.06157522865488559, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.13410398326342618, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.09010815922218034, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.036775703671612314, "sim_compute_performance-ego": 0.0705603587476513, "sim_compute_robot_state-ego": 0.0717357744144488, "sim_compute_robot_state-npc0": 0.06581698791890205, "sim_compute_robot_state-npc1": 0.06667243679867516, "sim_compute_robot_state-npc2": 0.06829957418803927, "sim_compute_robot_state-npc3": 0.0656315224080146}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.13566980538544832, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.05820451842414008, "in-drivable-lane": 0, "agent_compute-ego": 0.13108646428143536, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.09740748228850188, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.039626616018789786, "sim_compute_performance-ego": 0.06163571499012135, "sim_compute_robot_state-ego": 0.06856135085777, "sim_compute_robot_state-npc0": 0.06574063830905491, "sim_compute_robot_state-npc1": 0.06618162437721535, "sim_compute_robot_state-npc2": 0.06841905911763509, "sim_compute_robot_state-npc3": 0.06694601200245044}}
set_robot_commands_max	0.1400446708385761
set_robot_commands_mean	0.11522774748560868
set_robot_commands_median	0.11581685668543766
set_robot_commands_min	0.09010815922218034
sim_compute_performance-ego_max	0.10133003288844848
sim_compute_performance-ego_mean	0.08341135545922021
sim_compute_performance-ego_median	0.08465197525526348
sim_compute_performance-ego_min	0.06163571499012135
sim_compute_robot_state-ego_max	0.12159506174234244
sim_compute_robot_state-ego_mean	0.09458534874754462
sim_compute_robot_state-ego_median	0.09664854250456158
sim_compute_robot_state-ego_min	0.06856135085777
sim_compute_robot_state-npc0_max	0.10125349118159369
sim_compute_robot_state-npc0_mean	0.08338197274157474
sim_compute_robot_state-npc0_median	0.0852677539775246
sim_compute_robot_state-npc0_min	0.06574063830905491
sim_compute_robot_state-npc1_max	0.1030749357663668
sim_compute_robot_state-npc1_mean	0.08337140952889868
sim_compute_robot_state-npc1_median	0.08281960612849186
sim_compute_robot_state-npc1_min	0.06618162437721535
sim_compute_robot_state-npc2_max	0.10571969472444974
sim_compute_robot_state-npc2_mean	0.08425847333867983
sim_compute_robot_state-npc2_median	0.08472964951866552
sim_compute_robot_state-npc2_min	0.06829957418803927
sim_compute_robot_state-npc3_max	0.10447412270766038
sim_compute_robot_state-npc3_mean	0.08314775348788256
sim_compute_robot_state-npc3_median	0.08499018769515188
sim_compute_robot_state-npc3_min	0.0656315224080146
sim_compute_sim_state_max	0.059445830491872936
sim_compute_sim_state_mean	0.0470908873737051
sim_compute_sim_state_median	0.04794588841890034
sim_compute_sim_state_min	0.036775703671612314
sim_physics_max	0.25241613388061523
sim_physics_mean	0.193724158439026
sim_physics_median	0.1970158219337463
sim_physics_min	0.13566980538544832
sim_render-ego_max	0.09047597188215988
sim_render-ego_mean	0.07534278567915563
sim_render-ego_median	0.07931842302021228
sim_render-ego_min	0.05820451842414008
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20581

2410

jiang peng

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 14:31:46+00:00

2019-04-25 15:00:04+00:00

0:28:18

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20581-295025', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20581-295025', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20581-295025', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20574

2425

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 14:22:56+00:00

2019-04-25 14:31:32+00:00

0:08:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1334137472055726
agent_compute-ego_mean	0.12834789940853666
agent_compute-ego_median	0.13032296552496442
agent_compute-ego_min	0.11681137084960938
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1593993992175696, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.05997297224008812, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.13149339522955553, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.0907786634733092, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.0372272032611775, "sim_compute_performance-ego": 0.06449570295945653, "sim_compute_robot_state-ego": 0.06612230246921755, "sim_compute_robot_state-npc0": 0.06538884594755352, "sim_compute_robot_state-npc1": 0.06360070210582805, "sim_compute_robot_state-npc2": 0.06373261955549132, "sim_compute_robot_state-npc3": 0.06440620377378643}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.16509785254796347, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.059057265520095825, "in-drivable-lane": 0, "agent_compute-ego": 0.12969801823298135, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.0919179618358612, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03974717855453491, "sim_compute_performance-ego": 0.06899237632751465, "sim_compute_robot_state-ego": 0.07536083459854126, "sim_compute_robot_state-npc0": 0.06734279791514079, "sim_compute_robot_state-npc1": 0.06701656182607015, "sim_compute_robot_state-npc2": 0.06337368488311768, "sim_compute_robot_state-npc3": 0.06574511528015137}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.1580728959229033, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.05792201979685638, "in-drivable-lane": 0, "agent_compute-ego": 0.13032296552496442, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09323901241108525, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03669444989349883, "sim_compute_performance-ego": 0.062123973490828176, "sim_compute_robot_state-ego": 0.0664493067789886, "sim_compute_robot_state-npc0": 0.06672413874480684, "sim_compute_robot_state-npc1": 0.06479368371478582, "sim_compute_robot_state-npc2": 0.06326646723989714, "sim_compute_robot_state-npc3": 0.06205458560232389}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.18348821138931537, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.06303341509932178, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1334137472055726, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.09236045611106744, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.039216069851891466, "sim_compute_performance-ego": 0.06586370225680077, "sim_compute_robot_state-ego": 0.07095185780929307, "sim_compute_robot_state-npc0": 0.0677762960983535, "sim_compute_robot_state-npc1": 0.06563117140430515, "sim_compute_robot_state-npc2": 0.06428901623871366, "sim_compute_robot_state-npc3": 0.06444156776040287}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.12593615055084229, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.051944637298583986, "in-drivable-lane": 0, "agent_compute-ego": 0.11681137084960938, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.07832598686218262, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.037493669986724855, "sim_compute_performance-ego": 0.06510562896728515, "sim_compute_robot_state-ego": 0.07161102294921876, "sim_compute_robot_state-npc0": 0.08731734752655029, "sim_compute_robot_state-npc1": 0.05941041707992554, "sim_compute_robot_state-npc2": 0.06840131282806397, "sim_compute_robot_state-npc3": 0.0683164119720459}}
set_robot_commands_max	0.09323901241108525
set_robot_commands_mean	0.08932441613870114
set_robot_commands_median	0.0919179618358612
set_robot_commands_min	0.07832598686218262
sim_compute_performance-ego_max	0.06899237632751465
sim_compute_performance-ego_mean	0.06531627680037706
sim_compute_performance-ego_median	0.06510562896728515
sim_compute_performance-ego_min	0.062123973490828176
sim_compute_robot_state-ego_max	0.07536083459854126
sim_compute_robot_state-ego_mean	0.07009906492105185
sim_compute_robot_state-ego_median	0.07095185780929307
sim_compute_robot_state-ego_min	0.06612230246921755
sim_compute_robot_state-npc0_max	0.08731734752655029
sim_compute_robot_state-npc0_mean	0.07090988524648098
sim_compute_robot_state-npc0_median	0.06734279791514079
sim_compute_robot_state-npc0_min	0.06538884594755352
sim_compute_robot_state-npc1_max	0.06701656182607015
sim_compute_robot_state-npc1_mean	0.06409050722618295
sim_compute_robot_state-npc1_median	0.06479368371478582
sim_compute_robot_state-npc1_min	0.05941041707992554
sim_compute_robot_state-npc2_max	0.06840131282806397
sim_compute_robot_state-npc2_mean	0.06461262014905675
sim_compute_robot_state-npc2_median	0.06373261955549132
sim_compute_robot_state-npc2_min	0.06326646723989714
sim_compute_robot_state-npc3_max	0.0683164119720459
sim_compute_robot_state-npc3_mean	0.06499277687774209
sim_compute_robot_state-npc3_median	0.06444156776040287
sim_compute_robot_state-npc3_min	0.06205458560232389
sim_compute_sim_state_max	0.03974717855453491
sim_compute_sim_state_mean	0.03807571430956551
sim_compute_sim_state_median	0.037493669986724855
sim_compute_sim_state_min	0.03669444989349883
sim_physics_max	0.18348821138931537
sim_physics_mean	0.1583989019257188
sim_physics_median	0.1593993992175696
sim_physics_min	0.12593615055084229
sim_render-ego_max	0.06303341509932178
sim_render-ego_mean	0.058386061990989224
sim_render-ego_median	0.059057265520095825
sim_render-ego_min	0.051944637298583986
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20568

2429

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 14:21:38+00:00

2019-04-25 14:22:14+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20565

2437

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 14:20:05+00:00

2019-04-25 14:21:03+00:00

0:00:58

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20563

2440

Jacopo Tani

random_agent

step1-simulation

success

2019-04-25 14:14:01+00:00

2019-04-25 14:19:31+00:00

0:05:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.15471976208236982
agent_compute-ego_mean	0.14260173975984966
agent_compute-ego_median	0.1420769500732422
agent_compute-ego_min	0.13306662771436903
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.099575290140116, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06231195071958146, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.15471976208236982, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09283879567992012, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03639010213456064, "sim_compute_performance-ego": 0.06574000952378758, "sim_compute_robot_state-ego": 0.07287289511482671}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.10022707627369808, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.059063306221595176, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14421202127750105, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.08966931471457848, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03679394263487596, "sim_compute_performance-ego": 0.06673457530828622, "sim_compute_robot_state-ego": 0.06933491505109347}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.07400015989939372, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.05214222272237142, "in-drivable-lane": 0, "agent_compute-ego": 0.13306662771436903, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.07896125316619873, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.03312647342681885, "sim_compute_performance-ego": 0.05555807219611274, "sim_compute_robot_state-ego": 0.11352566878000896}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.09703360557556152, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.06120388984680176, "in-drivable-lane": 0, "agent_compute-ego": 0.1420769500732422, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.09674405097961426, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.037995433807373045, "sim_compute_performance-ego": 0.0654225254058838, "sim_compute_robot_state-ego": 0.07219913482666016}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.08744959036509196, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.05788214695759309, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.13893333765176627, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.08818524311750363, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.035424366975441955, "sim_compute_performance-ego": 0.06336574982374142, "sim_compute_robot_state-ego": 0.06851687492468418}}
set_robot_commands_max	0.09674405097961426
set_robot_commands_mean	0.08927973153156304
set_robot_commands_median	0.08966931471457848
set_robot_commands_min	0.07896125316619873
sim_compute_performance-ego_max	0.06673457530828622
sim_compute_performance-ego_mean	0.06336418645156236
sim_compute_performance-ego_median	0.0654225254058838
sim_compute_performance-ego_min	0.05555807219611274
sim_compute_robot_state-ego_max	0.11352566878000896
sim_compute_robot_state-ego_mean	0.07928989773945469
sim_compute_robot_state-ego_median	0.07219913482666016
sim_compute_robot_state-ego_min	0.06851687492468418
sim_compute_sim_state_max	0.037995433807373045
sim_compute_sim_state_mean	0.035946063795814095
sim_compute_sim_state_median	0.03639010213456064
sim_compute_sim_state_min	0.03312647342681885
sim_physics_max	0.10022707627369808
sim_physics_mean	0.09165714445077223
sim_physics_median	0.09703360557556152
sim_physics_min	0.07400015989939372
sim_render-ego_max	0.06231195071958146
sim_render-ego_mean	0.058520703293588584
sim_render-ego_median	0.059063306221595176
sim_render-ego_min	0.05214222272237142
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20554

2452

Liam Paull 🇨🇦

Baseline solution using ROS

step1-simulation

error

2019-04-25 14:10:21+00:00

2019-04-25 14:13:54+00:00

0:03:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20551

2455

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:09:31+00:00

2019-04-25 14:10:08+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20546

2464

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:08:07+00:00

2019-04-25 14:08:41+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20530

2496

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 14:01:50+00:00

2019-04-25 14:07:34+00:00

0:05:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.11800836052752794
survival_time_median	1.4000000000000006
deviation-center-line_median	0.07789844200501482
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.1801716461777687
agent_compute-ego_mean	0.1514714655531195
agent_compute-ego_median	0.1564155320326487
agent_compute-ego_min	0.12063966478620256
deviation-center-line_max	0.12110798720781216
deviation-center-line_mean	0.08345551712637263
deviation-center-line_min	0.053426170794070575
deviation-heading_max	0.8463883074997451
deviation-heading_mean	0.6997981724429791
deviation-heading_median	0.7745545607362658
deviation-heading_min	0.5284062336799495
driven_any_max	0.22367677987782228
driven_any_mean	0.18622912232701125
driven_any_median	0.18462682387474424
driven_any_min	0.1440527763389095
driven_lanedir_consec_max	0.1566331619586605
driven_lanedir_consec_mean	0.11244332279718396
driven_lanedir_consec_min	0.059034806146766705
driven_lanedir_max	0.1566331619586605
driven_lanedir_mean	0.11244332279718396
driven_lanedir_median	0.11800836052752794
driven_lanedir_min	0.059034806146766705
in-drivable-lane_max	0.5500000000000005
in-drivable-lane_mean	0.17000000000000015
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22367677987782228, "sim_physics": 0.18852587044239044, "survival_time": 1.6000000000000008, "driven_lanedir": 0.11800836052752794, "sim_render-ego": 0.0607600212097168, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1801716461777687, "deviation-heading": 0.8463883074997451, "set_robot_commands": 0.0897296816110611, "deviation-center-line": 0.07789844200501482, "driven_lanedir_consec": 0.11800836052752794, "sim_compute_sim_state": 0.03624996542930603, "sim_compute_performance-ego": 0.06377319991588593, "sim_compute_robot_state-ego": 0.07668884843587875, "sim_compute_robot_state-npc0": 0.06673088669776917, "sim_compute_robot_state-npc1": 0.0665772408246994, "sim_compute_robot_state-npc2": 0.06331266462802887, "sim_compute_robot_state-npc3": 0.06316987425088882}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20256450814096563, "sim_physics": 0.10451219975948334, "survival_time": 1.6000000000000008, "driven_lanedir": 0.059034806146766705, "sim_render-ego": 0.04636959731578827, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1263141706585884, "deviation-heading": 0.8073389885552706, "set_robot_commands": 0.07142593711614609, "deviation-center-line": 0.05479906358874325, "driven_lanedir_consec": 0.059034806146766705, "sim_compute_sim_state": 0.029787130653858185, "sim_compute_performance-ego": 0.047122709453105927, "sim_compute_robot_state-ego": 0.049809761345386505, "sim_compute_robot_state-npc0": 0.052304066717624664, "sim_compute_robot_state-npc1": 0.05853155255317688, "sim_compute_robot_state-npc2": 0.051881954073905945, "sim_compute_robot_state-npc3": 0.051917992532253265}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.18462682387474424, "sim_physics": 0.11614870173590525, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1566331619586605, "sim_render-ego": 0.043359730924878805, "in-drivable-lane": 0, "agent_compute-ego": 0.12063966478620256, "deviation-heading": 0.5423027717436649, "set_robot_commands": 0.0680243798664638, "deviation-center-line": 0.12110798720781216, "driven_lanedir_consec": 0.1566331619586605, "sim_compute_sim_state": 0.02757821764264788, "sim_compute_performance-ego": 0.049077161720820835, "sim_compute_robot_state-ego": 0.05516387735094343, "sim_compute_robot_state-npc0": 0.05006336314337594, "sim_compute_robot_state-npc1": 0.04675249542508807, "sim_compute_robot_state-npc2": 0.047578513622283936, "sim_compute_robot_state-npc3": 0.04799736397606986}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17622472340261464, "sim_physics": 0.12589884721315825, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14311801323642248, "sim_render-ego": 0.05150708785423866, "in-drivable-lane": 0, "agent_compute-ego": 0.17381631411038911, "deviation-heading": 0.5284062336799495, "set_robot_commands": 0.08300176033606896, "deviation-center-line": 0.11004592203622234, "driven_lanedir_consec": 0.14311801323642248, "sim_compute_sim_state": 0.032797740055964544, "sim_compute_performance-ego": 0.056623376332796536, "sim_compute_robot_state-ego": 0.06089681845444899, "sim_compute_robot_state-npc0": 0.06565570831298828, "sim_compute_robot_state-npc1": 0.056496693537785456, "sim_compute_robot_state-npc2": 0.05355806534106915, "sim_compute_robot_state-npc3": 0.057606321114760176}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1440527763389095, "sim_physics": 0.11734431982040404, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08542227211654219, "sim_render-ego": 0.05476627747217814, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1564155320326487, "deviation-heading": 0.7745545607362658, "set_robot_commands": 0.08760602275530498, "deviation-center-line": 0.053426170794070575, "driven_lanedir_consec": 0.08542227211654219, "sim_compute_sim_state": 0.03748077154159546, "sim_compute_performance-ego": 0.06012908617655436, "sim_compute_robot_state-ego": 0.06940598289171855, "sim_compute_robot_state-npc0": 0.0637307067712148, "sim_compute_robot_state-npc1": 0.06481278936068217, "sim_compute_robot_state-npc2": 0.06605265537897746, "sim_compute_robot_state-npc3": 0.06811492641766866}}
set_robot_commands_max	0.0897296816110611
set_robot_commands_mean	0.07995755633700899
set_robot_commands_median	0.08300176033606896
set_robot_commands_min	0.0680243798664638
sim_compute_performance-ego_max	0.06377319991588593
sim_compute_performance-ego_mean	0.05534510671983271
sim_compute_performance-ego_median	0.056623376332796536
sim_compute_performance-ego_min	0.047122709453105927
sim_compute_robot_state-ego_max	0.07668884843587875
sim_compute_robot_state-ego_mean	0.06239305769567525
sim_compute_robot_state-ego_median	0.06089681845444899
sim_compute_robot_state-ego_min	0.049809761345386505
sim_compute_robot_state-npc0_max	0.06673088669776917
sim_compute_robot_state-npc0_mean	0.05969694632859457
sim_compute_robot_state-npc0_median	0.0637307067712148
sim_compute_robot_state-npc0_min	0.05006336314337594
sim_compute_robot_state-npc1_max	0.0665772408246994
sim_compute_robot_state-npc1_mean	0.0586341543402864
sim_compute_robot_state-npc1_median	0.05853155255317688
sim_compute_robot_state-npc1_min	0.04675249542508807
sim_compute_robot_state-npc2_max	0.06605265537897746
sim_compute_robot_state-npc2_mean	0.056476770608853075
sim_compute_robot_state-npc2_median	0.05355806534106915
sim_compute_robot_state-npc2_min	0.047578513622283936
sim_compute_robot_state-npc3_max	0.06811492641766866
sim_compute_robot_state-npc3_mean	0.057761295658328146
sim_compute_robot_state-npc3_median	0.057606321114760176
sim_compute_robot_state-npc3_min	0.04799736397606986
sim_compute_sim_state_max	0.03748077154159546
sim_compute_sim_state_mean	0.03277876506467442
sim_compute_sim_state_median	0.032797740055964544
sim_compute_sim_state_min	0.02757821764264788
sim_physics_max	0.18852587044239044
sim_physics_mean	0.13048598779426826
sim_physics_median	0.11734431982040404
sim_physics_min	0.10451219975948334
sim_render-ego_max	0.0607600212097168
sim_render-ego_mean	0.05135254295536014
sim_render-ego_median	0.05150708785423866
sim_render-ego_min	0.043359730924878805
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.4200000000000006
survival_time_min	1.2000000000000004

No reset possible

20521

2521

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 14:00:55+00:00

2019-04-25 14:01:42+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20512

2507

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

host-error

2019-04-25 13:59:49+00:00

2019-04-25 14:00:26+00:00

0:00:37

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20512-216750', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20512-216750', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20512-216750', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20506

2512

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 13:58:50+00:00

2019-04-25 13:59:35+00:00

0:00:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20496

2529

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-25 13:56:17+00:00

2019-04-25 13:58:43+00:00

0:02:26

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20492

2538

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 13:53:38+00:00

2019-04-25 13:55:48+00:00

0:02:10

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20472

2570

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 13:38:27+00:00

2019-04-25 13:53:30+00:00

0:15:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0
survival_time_median	14.950000000000076
deviation-center-line_median	0.8791250519425075
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.052968169848124184
agent_compute-ego_mean	0.05169769493738811
agent_compute-ego_median	0.052219667434692384
agent_compute-ego_min	0.049369930426279705
deviation-center-line_max	1.1518259299248657
deviation-center-line_mean	0.7501216125180884
deviation-center-line_min	0.25213161298160436
deviation-heading_max	4.612311799738734
deviation-heading_mean	2.597716698919712
deviation-heading_median	2.4213367613149206
deviation-heading_min	1.055344347110816
driven_any_max	1.328474932138796e-13
driven_any_mean	2.6569498642775922e-14
driven_any_median	0
driven_any_min	0
driven_lanedir_consec_max	0
driven_lanedir_consec_mean	0
driven_lanedir_consec_min	0
driven_lanedir_max	0
driven_lanedir_mean	0
driven_lanedir_median	0
driven_lanedir_min	0
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.328474932138796e-13, "sim_physics": 0.08379596471786499, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.04685768286387126, "in-drivable-lane": 0, "agent_compute-ego": 0.05236672560373942, "deviation-heading": 1.3094334271540409, "set_robot_commands": 0.06898518641789754, "deviation-center-line": 1.1518259299248657, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.029794673919677737, "sim_compute_performance-ego": 0.05058369398117066, "sim_compute_robot_state-ego": 0.051842041015625}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0, "sim_physics": 0.08006564696629842, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.04630346695582072, "in-drivable-lane": 0, "agent_compute-ego": 0.052219667434692384, "deviation-heading": 2.4213367613149206, "set_robot_commands": 0.06995450496673584, "deviation-center-line": 0.25213161298160436, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02999040444691976, "sim_compute_performance-ego": 0.050141209761301674, "sim_compute_robot_state-ego": 0.05189075867335002}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0, "sim_physics": 0.08109282970428466, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.046689300537109374, "in-drivable-lane": 0, "agent_compute-ego": 0.05156398137410482, "deviation-heading": 3.590157159280048, "set_robot_commands": 0.06963569005330404, "deviation-center-line": 0.8791250519425075, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.03109522263209025, "sim_compute_performance-ego": 0.05052332639694214, "sim_compute_robot_state-ego": 0.05309583822886149}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0, "sim_physics": 0.07833951870600382, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.043566154638926186, "in-drivable-lane": 0, "agent_compute-ego": 0.049369930426279705, "deviation-heading": 4.612311799738734, "set_robot_commands": 0.0674868933359782, "deviation-center-line": 0.9357839616685772, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02835396687189738, "sim_compute_performance-ego": 0.04747258504231771, "sim_compute_robot_state-ego": 0.04955911000569661}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0, "sim_physics": 0.08466063181559245, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.04566914637883504, "in-drivable-lane": 0, "agent_compute-ego": 0.052968169848124184, "deviation-heading": 1.055344347110816, "set_robot_commands": 0.07095043420791626, "deviation-center-line": 0.5317415060728867, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.029253615538279217, "sim_compute_performance-ego": 0.0488421090443929, "sim_compute_robot_state-ego": 0.050637352466583255}}
set_robot_commands_max	0.07095043420791626
set_robot_commands_mean	0.06940254179636637
set_robot_commands_median	0.06963569005330404
set_robot_commands_min	0.0674868933359782
sim_compute_performance-ego_max	0.05058369398117066
sim_compute_performance-ego_mean	0.04951258484522501
sim_compute_performance-ego_median	0.050141209761301674
sim_compute_performance-ego_min	0.04747258504231771
sim_compute_robot_state-ego_max	0.05309583822886149
sim_compute_robot_state-ego_mean	0.05140502007802328
sim_compute_robot_state-ego_median	0.051842041015625
sim_compute_robot_state-ego_min	0.04955911000569661
sim_compute_sim_state_max	0.03109522263209025
sim_compute_sim_state_mean	0.02969757668177287
sim_compute_sim_state_median	0.029794673919677737
sim_compute_sim_state_min	0.02835396687189738
sim_physics_max	0.08466063181559245
sim_physics_mean	0.08159091838200887
sim_physics_median	0.08109282970428466
sim_physics_min	0.07833951870600382
sim_render-ego_max	0.04685768286387126
sim_render-ego_mean	0.04581715027491252
sim_render-ego_median	0.04630346695582072
sim_render-ego_min	0.043566154638926186
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20471

2573

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 13:37:52+00:00

2019-04-25 13:38:20+00:00

0:00:28

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20469

2574

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 13:37:07+00:00

2019-04-25 13:37:38+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20467

2581

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 13:34:27+00:00

2019-04-25 13:36:45+00:00

0:02:18

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20455

2598

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 13:23:31+00:00

2019-04-25 13:34:12+00:00

0:10:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4562629591334715
survival_time_median	8.349999999999984
deviation-center-line_median	0.3482319483052215
in-drivable-lane_median	4.199999999999995

other stats

agent_compute-ego_max	0.06450506528218587
agent_compute-ego_mean	0.06069491336802345
agent_compute-ego_median	0.06007293239235878
agent_compute-ego_min	0.058695916334788
deviation-center-line_max	0.7137289931513128
deviation-center-line_mean	0.446172404981034
deviation-center-line_min	0.31330748535748865
deviation-heading_max	5.6019910117778196
deviation-heading_mean	3.225457911812221
deviation-heading_median	3.058441352931268
deviation-heading_min	0.4258169633377884
driven_any_max	2.348143016533108
driven_any_mean	1.4373528996533305
driven_any_median	1.2878126431008812
driven_any_min	0.46055575767077384
driven_lanedir_consec_max	0.8482961047158355
driven_lanedir_consec_mean	0.4989960391532248
driven_lanedir_consec_min	0.2622146519781854
driven_lanedir_max	1.2409106030301893
driven_lanedir_mean	0.7076393036054673
driven_lanedir_median	0.6456638962437875
driven_lanedir_min	0.39201500107392784
in-drivable-lane_max	7.250000000000043
in-drivable-lane_mean	3.2400000000000175
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7427234593278016, "sim_physics": 0.07994694756989432, "survival_time": 5.04999999999999, "driven_lanedir": 0.6456638962437875, "sim_render-ego": 0.04710555076599121, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.05999210093281056, "deviation-heading": 1.8063701739902644, "set_robot_commands": 0.06876230948042161, "deviation-center-line": 0.3482319483052215, "driven_lanedir_consec": 0.6456638962437875, "sim_compute_sim_state": 0.029348002802027335, "sim_compute_performance-ego": 0.05044747579215777, "sim_compute_robot_state-ego": 0.05439806928729067}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2878126431008812, "sim_physics": 0.08694411037924761, "survival_time": 8.349999999999984, "driven_lanedir": 0.39201500107392784, "sim_render-ego": 0.04776945513879468, "in-drivable-lane": 4.199999999999995, "agent_compute-ego": 0.06020855189797407, "deviation-heading": 3.058441352931268, "set_robot_commands": 0.07278336879022107, "deviation-center-line": 0.31330748535748865, "driven_lanedir_consec": 0.2622146519781854, "sim_compute_sim_state": 0.03070013109081519, "sim_compute_performance-ego": 0.05218525989326888, "sim_compute_robot_state-ego": 0.053813801554148784}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.46055575767077384, "sim_physics": 0.0634208619594574, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4562629591334715, "sim_render-ego": 0.06192838028073311, "in-drivable-lane": 0, "agent_compute-ego": 0.06007293239235878, "deviation-heading": 0.4258169633377884, "set_robot_commands": 0.07148580253124237, "deviation-center-line": 0.3362487341527758, "driven_lanedir_consec": 0.4562629591334715, "sim_compute_sim_state": 0.031121041625738144, "sim_compute_performance-ego": 0.05747748538851738, "sim_compute_robot_state-ego": 0.05436886847019195}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348143016533108, "sim_physics": 0.08626725355784098, "survival_time": 14.950000000000076, "driven_lanedir": 1.2409106030301893, "sim_render-ego": 0.04372002124786377, "in-drivable-lane": 4.700000000000051, "agent_compute-ego": 0.06450506528218587, "deviation-heading": 5.6019910117778196, "set_robot_commands": 0.06987876892089843, "deviation-center-line": 0.7137289931513128, "driven_lanedir_consec": 0.8482961047158355, "sim_compute_sim_state": 0.028920493125915527, "sim_compute_performance-ego": 0.05001047452290853, "sim_compute_robot_state-ego": 0.05363982597986857}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.347529621634087, "sim_physics": 0.09356731414794922, "survival_time": 14.950000000000076, "driven_lanedir": 0.8033440585459606, "sim_render-ego": 0.04653447945912679, "in-drivable-lane": 7.250000000000043, "agent_compute-ego": 0.058695916334788, "deviation-heading": 5.234670057023964, "set_robot_commands": 0.07039210319519043, "deviation-center-line": 0.5193448639383714, "driven_lanedir_consec": 0.28254258369484386, "sim_compute_sim_state": 0.030360409418741865, "sim_compute_performance-ego": 0.05131896495819092, "sim_compute_robot_state-ego": 0.05611933946609497}}
set_robot_commands_max	0.07278336879022107
set_robot_commands_mean	0.07066047058359479
set_robot_commands_median	0.07039210319519043
set_robot_commands_min	0.06876230948042161
sim_compute_performance-ego_max	0.05747748538851738
sim_compute_performance-ego_mean	0.0522879321110087
sim_compute_performance-ego_median	0.05131896495819092
sim_compute_performance-ego_min	0.05001047452290853
sim_compute_robot_state-ego_max	0.05611933946609497
sim_compute_robot_state-ego_mean	0.05446798095151899
sim_compute_robot_state-ego_median	0.05436886847019195
sim_compute_robot_state-ego_min	0.05363982597986857
sim_compute_sim_state_max	0.031121041625738144
sim_compute_sim_state_mean	0.030090015612647607
sim_compute_sim_state_median	0.030360409418741865
sim_compute_sim_state_min	0.028920493125915527
sim_physics_max	0.09356731414794922
sim_physics_mean	0.08202929752287791
sim_physics_median	0.08626725355784098
sim_physics_min	0.0634208619594574
sim_render-ego_max	0.06192838028073311
sim_render-ego_mean	0.04941157737850191
sim_render-ego_median	0.04710555076599121
sim_render-ego_min	0.04372002124786377
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.300000000000026
survival_time_min	3.1999999999999966

No reset possible

20439

2698

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 13:08:06+00:00

2019-04-25 13:23:03+00:00

0:14:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6256422646922535
survival_time_median	5.1999999999999895
deviation-center-line_median	0.4152439116427565
in-drivable-lane_median	0.6999999999999988

other stats

agent_compute-ego_max	0.06486199182622573
agent_compute-ego_mean	0.060857331719104936
agent_compute-ego_median	0.06337015674664424
agent_compute-ego_min	0.054447571436564125
deviation-center-line_max	1.2117226619873809
deviation-center-line_mean	0.5951944462890751
deviation-center-line_min	0.14695551452821648
deviation-heading_max	5.904587513264206
deviation-heading_mean	3.186427371703546
deviation-heading_median	1.9544271535980131
deviation-heading_min	0.5392687809284806
driven_any_max	2.3486701522086784
driven_any_mean	1.2111405333805343
driven_any_median	0.7818617197277746
driven_any_min	0.21946224571431225
driven_lanedir_consec_max	1.1267193226658485
driven_lanedir_consec_mean	0.619020683109756
driven_lanedir_consec_min	0.16518033977971425
driven_lanedir_max	1.7695840990632146
driven_lanedir_mean	0.880308696360623
driven_lanedir_median	0.6256422646922535
driven_lanedir_min	0.1946734360384572
in-drivable-lane_max	1.8000000000000052
in-drivable-lane_mean	0.9200000000000014
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.6382205496671358, "sim_physics": 0.13159520788626236, "survival_time": 4.399999999999992, "driven_lanedir": 0.3800788961212376, "sim_render-ego": 0.05080122568390586, "in-drivable-lane": 0.6999999999999988, "agent_compute-ego": 0.06354548985307867, "deviation-heading": 1.9544271535980131, "set_robot_commands": 0.07384869456291199, "deviation-center-line": 0.4152439116427565, "driven_lanedir_consec": 0.16518033977971425, "sim_compute_sim_state": 0.030291695486415516, "sim_compute_performance-ego": 0.054790713570334694, "sim_compute_robot_state-ego": 0.056232433427463875, "sim_compute_robot_state-npc0": 0.05299366604198109, "sim_compute_robot_state-npc1": 0.05240990627895702, "sim_compute_robot_state-npc2": 0.05209215662696145, "sim_compute_robot_state-npc3": 0.05121555111624978}, "udem1-1-0": {"driven_any": 0.7818617197277746, "sim_physics": 0.13786576573665327, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6256422646922535, "sim_render-ego": 0.05037064506457402, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.06337015674664424, "deviation-heading": 1.6860490515633453, "set_robot_commands": 0.07491108545890221, "deviation-center-line": 0.197605428330531, "driven_lanedir_consec": 0.6256422646922535, "sim_compute_sim_state": 0.029599774342316847, "sim_compute_performance-ego": 0.05389525110904987, "sim_compute_robot_state-ego": 0.06239044666290283, "sim_compute_robot_state-npc0": 0.05605516754663908, "sim_compute_robot_state-npc1": 0.05526105715678288, "sim_compute_robot_state-npc2": 0.05304055947523851, "sim_compute_robot_state-npc3": 0.05459099549513597}, "udem1-2-0": {"driven_any": 2.3486701522086784, "sim_physics": 0.15331519842147828, "survival_time": 14.950000000000076, "driven_lanedir": 1.7695840990632146, "sim_render-ego": 0.04691533088684082, "in-drivable-lane": 1.6500000000000048, "agent_compute-ego": 0.05806144873301188, "deviation-heading": 5.904587513264206, "set_robot_commands": 0.06921576261520386, "deviation-center-line": 1.2117226619873809, "driven_lanedir_consec": 1.1267193226658485, "sim_compute_sim_state": 0.028273920218149826, "sim_compute_performance-ego": 0.0504502542813619, "sim_compute_robot_state-ego": 0.052591152985890705, "sim_compute_robot_state-npc0": 0.052167157332102455, "sim_compute_robot_state-npc1": 0.050245398680369056, "sim_compute_robot_state-npc2": 0.051393611431121825, "sim_compute_robot_state-npc3": 0.05088935136795044}, "udem1-3-0": {"driven_any": 0.21946224571431225, "sim_physics": 0.15162517743952134, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1946734360384572, "sim_render-ego": 0.053107661359450394, "in-drivable-lane": 0, "agent_compute-ego": 0.06486199182622573, "deviation-heading": 0.5392687809284806, "set_robot_commands": 0.07662615355323343, "deviation-center-line": 0.14695551452821648, "driven_lanedir_consec": 0.1946734360384572, "sim_compute_sim_state": 0.03053840468911564, "sim_compute_performance-ego": 0.05073894472683177, "sim_compute_robot_state-ego": 0.05531410609974581, "sim_compute_robot_state-npc0": 0.05701364489162669, "sim_compute_robot_state-npc1": 0.0545953161576215, "sim_compute_robot_state-npc2": 0.05548620925230138, "sim_compute_robot_state-npc3": 0.05295409875757554}, "udem1-4-0": {"driven_any": 2.0674879995847717, "sim_physics": 0.13699563976490137, "survival_time": 13.200000000000053, "driven_lanedir": 1.4315647858879526, "sim_render-ego": 0.044105737498312286, "in-drivable-lane": 1.8000000000000052, "agent_compute-ego": 0.054447571436564125, "deviation-heading": 5.847804359163685, "set_robot_commands": 0.06477762984507011, "deviation-center-line": 1.0044447149564912, "driven_lanedir_consec": 0.9828880523725072, "sim_compute_sim_state": 0.02690172285744638, "sim_compute_performance-ego": 0.047829325451995384, "sim_compute_robot_state-ego": 0.04988799673138243, "sim_compute_robot_state-npc0": 0.04935017769986933, "sim_compute_robot_state-npc1": 0.04795406352389942, "sim_compute_robot_state-npc2": 0.04834866523742676, "sim_compute_robot_state-npc3": 0.04857939752665433}}
set_robot_commands_max	0.07662615355323343
set_robot_commands_mean	0.07187586520706432
set_robot_commands_median	0.07384869456291199
set_robot_commands_min	0.06477762984507011
sim_compute_performance-ego_max	0.054790713570334694
sim_compute_performance-ego_mean	0.051540897827914725
sim_compute_performance-ego_median	0.05073894472683177
sim_compute_performance-ego_min	0.047829325451995384
sim_compute_robot_state-ego_max	0.06239044666290283
sim_compute_robot_state-ego_mean	0.05528322718147712
sim_compute_robot_state-ego_median	0.05531410609974581
sim_compute_robot_state-ego_min	0.04988799673138243
sim_compute_robot_state-npc0_max	0.05701364489162669
sim_compute_robot_state-npc0_mean	0.05351596270244373
sim_compute_robot_state-npc0_median	0.05299366604198109
sim_compute_robot_state-npc0_min	0.04935017769986933
sim_compute_robot_state-npc1_max	0.05526105715678288
sim_compute_robot_state-npc1_mean	0.05209314835952598
sim_compute_robot_state-npc1_median	0.05240990627895702
sim_compute_robot_state-npc1_min	0.04795406352389942
sim_compute_robot_state-npc2_max	0.05548620925230138
sim_compute_robot_state-npc2_mean	0.05207224040460998
sim_compute_robot_state-npc2_median	0.05209215662696145
sim_compute_robot_state-npc2_min	0.04834866523742676
sim_compute_robot_state-npc3_max	0.05459099549513597
sim_compute_robot_state-npc3_mean	0.05164587885271321
sim_compute_robot_state-npc3_median	0.05121555111624978
sim_compute_robot_state-npc3_min	0.04857939752665433
sim_compute_sim_state_max	0.03053840468911564
sim_compute_sim_state_mean	0.02912110351868884
sim_compute_sim_state_median	0.029599774342316847
sim_compute_sim_state_min	0.02690172285744638
sim_physics_max	0.15331519842147828
sim_physics_mean	0.14227939784976334
sim_physics_median	0.13786576573665327
sim_physics_min	0.13159520788626236
sim_render-ego_max	0.053107661359450394
sim_render-ego_mean	0.04906012009861667
sim_render-ego_median	0.05037064506457402
sim_render-ego_min	0.044105737498312286
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.890000000000024
survival_time_min	1.7000000000000008

No reset possible

20428

2637

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:00:19+00:00

2019-04-25 13:07:58+00:00

0:07:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14687568736526202
agent_compute-ego_mean	0.12703873588387968
agent_compute-ego_median	0.1253858865317652
agent_compute-ego_min	0.10668820142745972
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1657133214878586, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.057314933470959936, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.14687568736526202, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.09065581492657931, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.0369006485309241, "sim_compute_performance-ego": 0.06751351986291274, "sim_compute_robot_state-ego": 0.06755309284857984, "sim_compute_robot_state-npc0": 0.0660288153954272, "sim_compute_robot_state-npc1": 0.06519693023753616, "sim_compute_robot_state-npc2": 0.06653921559171856, "sim_compute_robot_state-npc3": 0.06331854496362074}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.1513177454471588, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.06065355738004049, "in-drivable-lane": 0, "agent_compute-ego": 0.1440326968828837, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.08800900975863139, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.035060346126556396, "sim_compute_performance-ego": 0.06524017453193665, "sim_compute_robot_state-ego": 0.06925809383392334, "sim_compute_robot_state-npc0": 0.061226457357406616, "sim_compute_robot_state-npc1": 0.06179717183113098, "sim_compute_robot_state-npc2": 0.061724970738093056, "sim_compute_robot_state-npc3": 0.059553325176239014}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.12067192287768348, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.0459459070431984, "in-drivable-lane": 0, "agent_compute-ego": 0.1253858865317652, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.06871237997281349, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.0325922481084274, "sim_compute_performance-ego": 0.0478418035022283, "sim_compute_robot_state-ego": 0.051462347224607304, "sim_compute_robot_state-npc0": 0.05443806567434537, "sim_compute_robot_state-npc1": 0.0532549276190289, "sim_compute_robot_state-npc2": 0.052193524473804535, "sim_compute_robot_state-npc3": 0.05122928296105336}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.12586828813714496, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.04537493495617883, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.11221120721202786, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.07125374422235004, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.028513884140273272, "sim_compute_performance-ego": 0.04892956604391842, "sim_compute_robot_state-ego": 0.05100973177764375, "sim_compute_robot_state-npc0": 0.05454054929442325, "sim_compute_robot_state-npc1": 0.0522631305759236, "sim_compute_robot_state-npc2": 0.04956592139551195, "sim_compute_robot_state-npc3": 0.04904214406417588}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.1041527509689331, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.04253432750701904, "in-drivable-lane": 0, "agent_compute-ego": 0.10668820142745972, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.06937403678894043, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.029688966274261475, "sim_compute_performance-ego": 0.048529648780822755, "sim_compute_robot_state-ego": 0.0510648250579834, "sim_compute_robot_state-npc0": 0.04938428401947022, "sim_compute_robot_state-npc1": 0.05124250650405884, "sim_compute_robot_state-npc2": 0.05322940349578857, "sim_compute_robot_state-npc3": 0.05143586397171021}}
set_robot_commands_max	0.09065581492657931
set_robot_commands_mean	0.07760099713386294
set_robot_commands_median	0.07125374422235004
set_robot_commands_min	0.06871237997281349
sim_compute_performance-ego_max	0.06751351986291274
sim_compute_performance-ego_mean	0.05561094254436377
sim_compute_performance-ego_median	0.04892956604391842
sim_compute_performance-ego_min	0.0478418035022283
sim_compute_robot_state-ego_max	0.06925809383392334
sim_compute_robot_state-ego_mean	0.05806961814854753
sim_compute_robot_state-ego_median	0.051462347224607304
sim_compute_robot_state-ego_min	0.05100973177764375
sim_compute_robot_state-npc0_max	0.0660288153954272
sim_compute_robot_state-npc0_mean	0.05712363434821453
sim_compute_robot_state-npc0_median	0.05454054929442325
sim_compute_robot_state-npc0_min	0.04938428401947022
sim_compute_robot_state-npc1_max	0.06519693023753616
sim_compute_robot_state-npc1_mean	0.05675093335353569
sim_compute_robot_state-npc1_median	0.0532549276190289
sim_compute_robot_state-npc1_min	0.05124250650405884
sim_compute_robot_state-npc2_max	0.06653921559171856
sim_compute_robot_state-npc2_mean	0.05665060713898333
sim_compute_robot_state-npc2_median	0.05322940349578857
sim_compute_robot_state-npc2_min	0.04956592139551195
sim_compute_robot_state-npc3_max	0.06331854496362074
sim_compute_robot_state-npc3_mean	0.05491583222735984
sim_compute_robot_state-npc3_median	0.05143586397171021
sim_compute_robot_state-npc3_min	0.04904214406417588
sim_compute_sim_state_max	0.0369006485309241
sim_compute_sim_state_mean	0.03255121863608853
sim_compute_sim_state_median	0.0325922481084274
sim_compute_sim_state_min	0.028513884140273272
sim_physics_max	0.1657133214878586
sim_physics_mean	0.13354480578375577
sim_physics_median	0.12586828813714496
sim_physics_min	0.1041527509689331
sim_render-ego_max	0.06065355738004049
sim_render-ego_mean	0.05036473207147933
sim_render-ego_median	0.0459459070431984
sim_render-ego_min	0.04253432750701904
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20422

2699

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 12:56:55+00:00

2019-04-25 13:00:04+00:00

0:03:09

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20422-244896', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20422-244896', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20422-244896', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20405

2656

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:32:12+00:00

2019-04-25 12:56:11+00:00

0:23:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6649857994880275
survival_time_median	9.45
deviation-center-line_median	0.4935844510615752
in-drivable-lane_median	3.700000000000003

other stats

agent_compute-ego_max	0.08435681978861491
agent_compute-ego_mean	0.07579784476407009
agent_compute-ego_median	0.0795653149233026
agent_compute-ego_min	0.0596067221959432
deviation-center-line_max	0.7919019723582558
deviation-center-line_mean	0.5365762562673267
deviation-center-line_min	0.2659381733756474
deviation-heading_max	6.091142928954325
deviation-heading_mean	3.8991783751996167
deviation-heading_median	3.0116934463540055
deviation-heading_min	2.194685169437252
driven_any_max	2.347987474350093
driven_any_mean	1.5530487164892122
driven_any_median	1.4497065061775791
driven_any_min	0.7255645300510777
driven_lanedir_consec_max	0.947649580277924
driven_lanedir_consec_mean	0.6908824852486254
driven_lanedir_consec_min	0.4135196500984386
driven_lanedir_max	1.034517439610272
driven_lanedir_mean	0.7174779082308206
driven_lanedir_median	0.6649857994880275
driven_lanedir_min	0.4135196500984386
in-drivable-lane_max	6.2500000000000355
in-drivable-lane_mean	3.570000000000013
in-drivable-lane_min	0.1999999999999993
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4497065061775791, "sim_physics": 0.1768044391006389, "survival_time": 9.45, "driven_lanedir": 0.6649857994880275, "sim_render-ego": 0.061996075211378635, "in-drivable-lane": 3.700000000000003, "agent_compute-ego": 0.07433865183875674, "deviation-heading": 3.0116934463540055, "set_robot_commands": 0.09157434090104684, "deviation-center-line": 0.4935844510615752, "driven_lanedir_consec": 0.6649857994880275, "sim_compute_sim_state": 0.038006269111835134, "sim_compute_performance-ego": 0.06750037052013257, "sim_compute_robot_state-ego": 0.07056422839089045, "sim_compute_robot_state-npc0": 0.06883966481244122, "sim_compute_robot_state-npc1": 0.06583553773385507, "sim_compute_robot_state-npc2": 0.0682434430198064, "sim_compute_robot_state-npc3": 0.06700206812096651}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8942596524753756, "sim_physics": 0.18435068049673303, "survival_time": 5.899999999999987, "driven_lanedir": 0.4135196500984386, "sim_render-ego": 0.06587253990819898, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.0795653149233026, "deviation-heading": 2.194685169437252, "set_robot_commands": 0.09899704133049916, "deviation-center-line": 0.2659381733756474, "driven_lanedir_consec": 0.4135196500984386, "sim_compute_sim_state": 0.04139813730272196, "sim_compute_performance-ego": 0.07459554833880926, "sim_compute_robot_state-ego": 0.08334936327853446, "sim_compute_robot_state-npc0": 0.07201336602033195, "sim_compute_robot_state-npc1": 0.07277664895785058, "sim_compute_robot_state-npc2": 0.07469594478607178, "sim_compute_robot_state-npc3": 0.07615655963703738}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7255645300510777, "sim_physics": 0.173510091820943, "survival_time": 4.849999999999991, "driven_lanedir": 0.5267170716794407, "sim_render-ego": 0.06705730477559198, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.08112171507373299, "deviation-heading": 2.5504926319610703, "set_robot_commands": 0.10472221964413356, "deviation-center-line": 0.40717864371072543, "driven_lanedir_consec": 0.5267170716794407, "sim_compute_sim_state": 0.04086385068205214, "sim_compute_performance-ego": 0.07766606635654096, "sim_compute_robot_state-ego": 0.07881794024988548, "sim_compute_robot_state-npc0": 0.07516598701477051, "sim_compute_robot_state-npc1": 0.07619717932239022, "sim_compute_robot_state-npc2": 0.07370577645056027, "sim_compute_robot_state-npc3": 0.07162378497959412}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.347987474350093, "sim_physics": 0.21311976432800292, "survival_time": 14.950000000000076, "driven_lanedir": 0.947649580277924, "sim_render-ego": 0.06790876865386963, "in-drivable-lane": 6.2500000000000355, "agent_compute-ego": 0.08435681978861491, "deviation-heading": 5.647877699291434, "set_robot_commands": 0.1045838737487793, "deviation-center-line": 0.7919019723582558, "driven_lanedir_consec": 0.947649580277924, "sim_compute_sim_state": 0.04228639284769694, "sim_compute_performance-ego": 0.0757823141415914, "sim_compute_robot_state-ego": 0.08162090222040812, "sim_compute_robot_state-npc0": 0.07624160369237264, "sim_compute_robot_state-npc1": 0.07554129362106324, "sim_compute_robot_state-npc2": 0.07409327109654744, "sim_compute_robot_state-npc3": 0.07458641449610393}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3477254193919364, "sim_physics": 0.13445935090382893, "survival_time": 14.950000000000076, "driven_lanedir": 1.034517439610272, "sim_render-ego": 0.046081995169321696, "in-drivable-lane": 5.500000000000036, "agent_compute-ego": 0.0596067221959432, "deviation-heading": 6.091142928954325, "set_robot_commands": 0.07084551095962524, "deviation-center-line": 0.7242780408304296, "driven_lanedir_consec": 0.9015403246992962, "sim_compute_sim_state": 0.028413333892822263, "sim_compute_performance-ego": 0.05081551710764567, "sim_compute_robot_state-ego": 0.05477463404337565, "sim_compute_robot_state-npc0": 0.052389604250590006, "sim_compute_robot_state-npc1": 0.05191153208414714, "sim_compute_robot_state-npc2": 0.05194183111190795, "sim_compute_robot_state-npc3": 0.05224702755610148}}
set_robot_commands_max	0.10472221964413356
set_robot_commands_mean	0.09414459731681683
set_robot_commands_median	0.09899704133049916
set_robot_commands_min	0.07084551095962524
sim_compute_performance-ego_max	0.07766606635654096
sim_compute_performance-ego_mean	0.06927196329294397
sim_compute_performance-ego_median	0.07459554833880926
sim_compute_performance-ego_min	0.05081551710764567
sim_compute_robot_state-ego_max	0.08334936327853446
sim_compute_robot_state-ego_mean	0.07382541363661883
sim_compute_robot_state-ego_median	0.07881794024988548
sim_compute_robot_state-ego_min	0.05477463404337565
sim_compute_robot_state-npc0_max	0.07624160369237264
sim_compute_robot_state-npc0_mean	0.06893004515810128
sim_compute_robot_state-npc0_median	0.07201336602033195
sim_compute_robot_state-npc0_min	0.052389604250590006
sim_compute_robot_state-npc1_max	0.07619717932239022
sim_compute_robot_state-npc1_mean	0.06845243834386125
sim_compute_robot_state-npc1_median	0.07277664895785058
sim_compute_robot_state-npc1_min	0.05191153208414714
sim_compute_robot_state-npc2_max	0.07469594478607178
sim_compute_robot_state-npc2_mean	0.06853605329297877
sim_compute_robot_state-npc2_median	0.07370577645056027
sim_compute_robot_state-npc2_min	0.05194183111190795
sim_compute_robot_state-npc3_max	0.07615655963703738
sim_compute_robot_state-npc3_mean	0.06832317095796069
sim_compute_robot_state-npc3_median	0.07162378497959412
sim_compute_robot_state-npc3_min	0.05224702755610148
sim_compute_sim_state_max	0.04228639284769694
sim_compute_sim_state_mean	0.03819359676742569
sim_compute_sim_state_median	0.04086385068205214
sim_compute_sim_state_min	0.028413333892822263
sim_physics_max	0.21311976432800292
sim_physics_mean	0.17644886533002935
sim_physics_median	0.1768044391006389
sim_physics_min	0.13445935090382893
sim_render-ego_max	0.06790876865386963
sim_render-ego_mean	0.06178333674367219
sim_render-ego_median	0.06587253990819898
sim_render-ego_min	0.046081995169321696
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.020000000000028
survival_time_min	4.849999999999991

No reset possible

20388

2685

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:00:39+00:00

2019-04-25 12:31:24+00:00

0:30:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4832326171643837
survival_time_median	12.25000000000004
deviation-center-line_median	0.8711567458749804
in-drivable-lane_median	2.249999999999994

other stats

agent_compute-ego_max	0.09786149239053532
agent_compute-ego_mean	0.08996906815261624
agent_compute-ego_median	0.0902758893512544
agent_compute-ego_min	0.0831577475865682
deviation-center-line_max	1.0438596207507431
deviation-center-line_mean	0.6376777918261621
deviation-center-line_min	0.1688017723199568
deviation-heading_max	7.682240421596391
deviation-heading_mean	4.7850323807496355
deviation-heading_median	6.710930823140187
deviation-heading_min	0.5470845971641398
driven_any_max	2.34821893425207
driven_any_mean	1.514597379857264
driven_any_median	1.8996701001084535
driven_any_min	0.28375083805126494
driven_lanedir_consec_max	1.1625087132576148
driven_lanedir_consec_mean	0.5699850719887168
driven_lanedir_consec_min	0.2407448944747017
driven_lanedir_max	1.2407429654838813
driven_lanedir_mean	0.8390114568707364
driven_lanedir_median	1.0678280939731006
driven_lanedir_min	0.2407448944747017
in-drivable-lane_max	4.60000000000004
in-drivable-lane_mean	2.2400000000000113
in-drivable-lane_min	0.14999999999999947
per-episodes	details {"udem1-0-0": {"driven_any": 1.8996701001084535, "sim_physics": 0.2866692766851308, "survival_time": 12.25000000000004, "driven_lanedir": 1.0678280939731006, "sim_render-ego": 0.07449029027199258, "in-drivable-lane": 2.249999999999994, "agent_compute-ego": 0.09786149239053532, "deviation-heading": 6.975599944404767, "set_robot_commands": 0.12283453746717804, "deviation-center-line": 0.8711567458749804, "driven_lanedir_consec": 0.3446483336304808, "sim_compute_sim_state": 0.04671843295194665, "sim_compute_performance-ego": 0.08225569725036622, "sim_compute_robot_state-ego": 0.0938536060099699, "sim_compute_robot_state-npc0": 0.08416231116470026, "sim_compute_robot_state-npc1": 0.08403288101663395, "sim_compute_robot_state-npc2": 0.08469159457148338, "sim_compute_robot_state-npc3": 0.08386723751924476}, "udem1-1-0": {"driven_any": 0.6934740052105646, "sim_physics": 0.2091753277727353, "survival_time": 4.6499999999999915, "driven_lanedir": 0.4832326171643837, "sim_render-ego": 0.07217640005132203, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.09148965343352287, "deviation-heading": 2.0093061174426925, "set_robot_commands": 0.11147099925625709, "deviation-center-line": 0.20054046330974576, "driven_lanedir_consec": 0.4832326171643837, "sim_compute_sim_state": 0.04405722566830215, "sim_compute_performance-ego": 0.07971259599090905, "sim_compute_robot_state-ego": 0.08793849073430543, "sim_compute_robot_state-npc0": 0.07994568988841066, "sim_compute_robot_state-npc1": 0.07840957436510311, "sim_compute_robot_state-npc2": 0.07962005369124873, "sim_compute_robot_state-npc3": 0.07639203020321425}, "udem1-2-0": {"driven_any": 2.34821893425207, "sim_physics": 0.25254963636398314, "survival_time": 14.950000000000076, "driven_lanedir": 1.2407429654838813, "sim_render-ego": 0.07068241834640503, "in-drivable-lane": 3.5500000000000256, "agent_compute-ego": 0.08706055800120036, "deviation-heading": 7.682240421596391, "set_robot_commands": 0.11192595561345418, "deviation-center-line": 1.0438596207507431, "driven_lanedir_consec": 0.6187908014164027, "sim_compute_sim_state": 0.04410116116205851, "sim_compute_performance-ego": 0.07996155977249146, "sim_compute_robot_state-ego": 0.08530312379201253, "sim_compute_robot_state-npc0": 0.07848300377527873, "sim_compute_robot_state-npc1": 0.07750471591949464, "sim_compute_robot_state-npc2": 0.0790208911895752, "sim_compute_robot_state-npc3": 0.08277160326639811}, "udem1-3-0": {"driven_any": 0.28375083805126494, "sim_physics": 0.2450629472732544, "survival_time": 2.1000000000000005, "driven_lanedir": 0.2407448944747017, "sim_render-ego": 0.07258012181236631, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.0902758893512544, "deviation-heading": 0.5470845971641398, "set_robot_commands": 0.11135734262920562, "deviation-center-line": 0.1688017723199568, "driven_lanedir_consec": 0.2407448944747017, "sim_compute_sim_state": 0.04416061015356155, "sim_compute_performance-ego": 0.07712389173961821, "sim_compute_robot_state-ego": 0.08814797514960879, "sim_compute_robot_state-npc0": 0.07829424880799793, "sim_compute_robot_state-npc1": 0.0755307504108974, "sim_compute_robot_state-npc2": 0.07744893573579334, "sim_compute_robot_state-npc3": 0.07618055457160586}, "udem1-4-0": {"driven_any": 2.347873021663966, "sim_physics": 0.242007687886556, "survival_time": 14.950000000000076, "driven_lanedir": 1.1625087132576148, "sim_render-ego": 0.0667520030339559, "in-drivable-lane": 4.60000000000004, "agent_compute-ego": 0.0831577475865682, "deviation-heading": 6.710930823140187, "set_robot_commands": 0.10506664514541626, "deviation-center-line": 0.9040303568753844, "driven_lanedir_consec": 1.1625087132576148, "sim_compute_sim_state": 0.04167490243911743, "sim_compute_performance-ego": 0.07526143709818522, "sim_compute_robot_state-ego": 0.0825229016939799, "sim_compute_robot_state-npc0": 0.07463919480641683, "sim_compute_robot_state-npc1": 0.07317543347676594, "sim_compute_robot_state-npc2": 0.07593470811843872, "sim_compute_robot_state-npc3": 0.07461875836054484}}
set_robot_commands_max	0.12283453746717804
set_robot_commands_mean	0.11253109602230224
set_robot_commands_median	0.11147099925625709
set_robot_commands_min	0.10506664514541626
sim_compute_performance-ego_max	0.08225569725036622
sim_compute_performance-ego_mean	0.07886303637031403
sim_compute_performance-ego_median	0.07971259599090905
sim_compute_performance-ego_min	0.07526143709818522
sim_compute_robot_state-ego_max	0.0938536060099699
sim_compute_robot_state-ego_mean	0.08755321947597532
sim_compute_robot_state-ego_median	0.08793849073430543
sim_compute_robot_state-ego_min	0.0825229016939799
sim_compute_robot_state-npc0_max	0.08416231116470026
sim_compute_robot_state-npc0_mean	0.07910488968856087
sim_compute_robot_state-npc0_median	0.07848300377527873
sim_compute_robot_state-npc0_min	0.07463919480641683
sim_compute_robot_state-npc1_max	0.08403288101663395
sim_compute_robot_state-npc1_mean	0.07773067103777902
sim_compute_robot_state-npc1_median	0.07750471591949464
sim_compute_robot_state-npc1_min	0.07317543347676594
sim_compute_robot_state-npc2_max	0.08469159457148338
sim_compute_robot_state-npc2_mean	0.07934323666130787
sim_compute_robot_state-npc2_median	0.0790208911895752
sim_compute_robot_state-npc2_min	0.07593470811843872
sim_compute_robot_state-npc3_max	0.08386723751924476
sim_compute_robot_state-npc3_mean	0.07876603678420156
sim_compute_robot_state-npc3_median	0.07639203020321425
sim_compute_robot_state-npc3_min	0.07461875836054484
sim_compute_sim_state_max	0.04671843295194665
sim_compute_sim_state_mean	0.044142466474997255
sim_compute_sim_state_median	0.04410116116205851
sim_compute_sim_state_min	0.04167490243911743
sim_physics_max	0.2866692766851308
sim_physics_mean	0.24709297519633192
sim_physics_median	0.2450629472732544
sim_physics_min	0.2091753277727353
sim_render-ego_max	0.07449029027199258
sim_render-ego_mean	0.07133624670320837
sim_render-ego_median	0.07217640005132203
sim_render-ego_min	0.0667520030339559
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.780000000000038
survival_time_min	2.1000000000000005

No reset possible

20335

2774

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:37:06+00:00

2019-04-25 12:00:08+00:00

0:23:02

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20335-883341', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20335-883341', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20335-883341', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20330

2783

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 11:36:14+00:00

2019-04-25 11:36:50+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20326

2792

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 11:34:12+00:00

2019-04-25 11:35:56+00:00

0:01:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20309

2826

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:25:04+00:00

2019-04-25 11:34:06+00:00

0:09:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15256241957346597
agent_compute-ego_mean	0.14675885579998008
agent_compute-ego_median	0.14846214601549051
agent_compute-ego_min	0.13554079532623292
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1733347110028537, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.05977135784221145, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.14769188413080178, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.09048785128683416, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03906474473341456, "sim_compute_performance-ego": 0.06635027561547621, "sim_compute_robot_state-ego": 0.07097750789714309, "sim_compute_robot_state-npc0": 0.0682094636953102, "sim_compute_robot_state-npc1": 0.0649381696053271, "sim_compute_robot_state-npc2": 0.06568134280870545, "sim_compute_robot_state-npc3": 0.06624225850375194}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.1408704419930776, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.05723303556442261, "in-drivable-lane": 0, "agent_compute-ego": 0.15256241957346597, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.0871876875559489, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03689512610435486, "sim_compute_performance-ego": 0.06059946616490682, "sim_compute_robot_state-ego": 0.06338389714558919, "sim_compute_robot_state-npc0": 0.06103119254112244, "sim_compute_robot_state-npc1": 0.0628410776456197, "sim_compute_robot_state-npc2": 0.06302539507548015, "sim_compute_robot_state-npc3": 0.0606057345867157}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.17300767413640428, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06431189634032168, "in-drivable-lane": 0, "agent_compute-ego": 0.14846214601549051, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.0919553546582238, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03699537050926079, "sim_compute_performance-ego": 0.06865359160859706, "sim_compute_robot_state-ego": 0.07169619253126241, "sim_compute_robot_state-npc0": 0.06356923458939892, "sim_compute_robot_state-npc1": 0.06123023113961947, "sim_compute_robot_state-npc2": 0.06397347126976918, "sim_compute_robot_state-npc3": 0.06330398785865914}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.19230049747531697, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05990328223018323, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14953703395390916, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.09225975456884351, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.03762697365324376, "sim_compute_performance-ego": 0.07062201580758821, "sim_compute_robot_state-ego": 0.0743138588080972, "sim_compute_robot_state-npc0": 0.06833510075585317, "sim_compute_robot_state-npc1": 0.06640385773222325, "sim_compute_robot_state-npc2": 0.06593741804866468, "sim_compute_robot_state-npc3": 0.06554970498812401}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.14146844148635865, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.057464075088500974, "in-drivable-lane": 0, "agent_compute-ego": 0.13554079532623292, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.08355097770690918, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.04227826595306396, "sim_compute_performance-ego": 0.06267616748809815, "sim_compute_robot_state-ego": 0.06831614971160889, "sim_compute_robot_state-npc0": 0.06870993375778198, "sim_compute_robot_state-npc1": 0.07150436639785766, "sim_compute_robot_state-npc2": 0.06436164379119873, "sim_compute_robot_state-npc3": 0.07005274295806885}}
set_robot_commands_max	0.09225975456884351
set_robot_commands_mean	0.0890883251553519
set_robot_commands_median	0.09048785128683416
set_robot_commands_min	0.08355097770690918
sim_compute_performance-ego_max	0.07062201580758821
sim_compute_performance-ego_mean	0.0657803033369333
sim_compute_performance-ego_median	0.06635027561547621
sim_compute_performance-ego_min	0.06059946616490682
sim_compute_robot_state-ego_max	0.0743138588080972
sim_compute_robot_state-ego_mean	0.06973752121874015
sim_compute_robot_state-ego_median	0.07097750789714309
sim_compute_robot_state-ego_min	0.06338389714558919
sim_compute_robot_state-npc0_max	0.06870993375778198
sim_compute_robot_state-npc0_mean	0.06597098506789334
sim_compute_robot_state-npc0_median	0.0682094636953102
sim_compute_robot_state-npc0_min	0.06103119254112244
sim_compute_robot_state-npc1_max	0.07150436639785766
sim_compute_robot_state-npc1_mean	0.06538354050412945
sim_compute_robot_state-npc1_median	0.0649381696053271
sim_compute_robot_state-npc1_min	0.06123023113961947
sim_compute_robot_state-npc2_max	0.06593741804866468
sim_compute_robot_state-npc2_mean	0.06459585419876365
sim_compute_robot_state-npc2_median	0.06436164379119873
sim_compute_robot_state-npc2_min	0.06302539507548015
sim_compute_robot_state-npc3_max	0.07005274295806885
sim_compute_robot_state-npc3_mean	0.06515088577906393
sim_compute_robot_state-npc3_median	0.06554970498812401
sim_compute_robot_state-npc3_min	0.0606057345867157
sim_compute_sim_state_max	0.04227826595306396
sim_compute_sim_state_mean	0.038572096190667586
sim_compute_sim_state_median	0.03762697365324376
sim_compute_sim_state_min	0.03689512610435486
sim_physics_max	0.19230049747531697
sim_physics_mean	0.16419635321880224
sim_physics_median	0.17300767413640428
sim_physics_min	0.1408704419930776
sim_render-ego_max	0.06431189634032168
sim_render-ego_mean	0.059736729413127986
sim_render-ego_median	0.05977135784221145
sim_render-ego_min	0.05723303556442261
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20303

2831

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:23:52+00:00

2019-04-25 11:24:28+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20295

2836

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:23:04+00:00

2019-04-25 11:23:37+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20293

2843

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:22:07+00:00

2019-04-25 11:22:38+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20291

2847

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:21:16+00:00

2019-04-25 11:21:51+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20283

2877

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 11:08:54+00:00

2019-04-25 11:20:44+00:00

0:11:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.658141340093886
survival_time_median	6.999999999999983
deviation-center-line_median	0.3805179887067449
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.16652868623318878
agent_compute-ego_mean	0.15535644066550172
agent_compute-ego_median	0.15353846299020868
agent_compute-ego_min	0.14762030219152775
deviation-center-line_max	0.8219069617270801
deviation-center-line_mean	0.4622890220224802
deviation-center-line_min	0.240946508088056
deviation-heading_max	1.819384597985526
deviation-heading_mean	0.9470500519861752
deviation-heading_median	0.8064348941516836
deviation-heading_min	0.5022393903257442
driven_any_max	1.5790906665051212
driven_any_mean	0.90897363561738
driven_any_median	0.9970530395825568
driven_any_min	0.2870933095253068
driven_lanedir_consec_max	1.1522212258289768
driven_lanedir_consec_mean	0.7286312661816596
driven_lanedir_consec_min	0.2804952221609298
driven_lanedir_max	1.1522212258289768
driven_lanedir_mean	0.7286312661816596
driven_lanedir_median	0.658141340093886
driven_lanedir_min	0.2804952221609298
in-drivable-lane_max	2.80000000000004
in-drivable-lane_mean	1.0400000000000065
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.11064906460898263, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.06507060527801514, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15826598576136996, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.10192005804606846, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.041616853645869666, "sim_compute_performance-ego": 0.07183943135397775, "sim_compute_robot_state-ego": 0.07850197553634644}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.018001036910281, "sim_physics": 0.10712795022507789, "survival_time": 7.099999999999983, "driven_lanedir": 0.9032065052271656, "sim_render-ego": 0.0631777350331696, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.15082876615121332, "deviation-heading": 1.819384597985526, "set_robot_commands": 0.09355122606519242, "deviation-center-line": 0.5370569656769042, "driven_lanedir_consec": 0.9032065052271656, "sim_compute_sim_state": 0.03937126045495692, "sim_compute_performance-ego": 0.07073752645035865, "sim_compute_robot_state-ego": 0.07419919463950143}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2870933095253068, "sim_physics": 0.10804363437320876, "survival_time": 2.3, "driven_lanedir": 0.2804952221609298, "sim_render-ego": 0.06640624481698741, "in-drivable-lane": 0, "agent_compute-ego": 0.16652868623318878, "deviation-heading": 0.5022393903257442, "set_robot_commands": 0.1014826245929884, "deviation-center-line": 0.240946508088056, "driven_lanedir_consec": 0.2804952221609298, "sim_compute_sim_state": 0.04138086671414583, "sim_compute_performance-ego": 0.07757278628971266, "sim_compute_robot_state-ego": 0.08192364547563635}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6636301255636338, "sim_physics": 0.10368402129725406, "survival_time": 4.749999999999991, "driven_lanedir": 0.6490920375973404, "sim_render-ego": 0.06961121559143066, "in-drivable-lane": 0, "agent_compute-ego": 0.15353846299020868, "deviation-heading": 0.9802944231598162, "set_robot_commands": 0.09226325938576146, "deviation-center-line": 0.3805179887067449, "driven_lanedir_consec": 0.6490920375973404, "sim_compute_sim_state": 0.03893092306036698, "sim_compute_performance-ego": 0.06719263729296232, "sim_compute_robot_state-ego": 0.07271374150326378}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5790906665051212, "sim_physics": 0.12243959321404382, "survival_time": 10.85000000000002, "driven_lanedir": 1.1522212258289768, "sim_render-ego": 0.06340581590678834, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.14762030219152775, "deviation-heading": 0.626896954308107, "set_robot_commands": 0.09110269788223478, "deviation-center-line": 0.8219069617270801, "driven_lanedir_consec": 1.1522212258289768, "sim_compute_sim_state": 0.03933129881933538, "sim_compute_performance-ego": 0.06976977800993327, "sim_compute_robot_state-ego": 0.07537641283553866}}
set_robot_commands_max	0.10192005804606846
set_robot_commands_mean	0.0960639731944491
set_robot_commands_median	0.09355122606519242
set_robot_commands_min	0.09110269788223478
sim_compute_performance-ego_max	0.07757278628971266
sim_compute_performance-ego_mean	0.07142243187938893
sim_compute_performance-ego_median	0.07073752645035865
sim_compute_performance-ego_min	0.06719263729296232
sim_compute_robot_state-ego_max	0.08192364547563635
sim_compute_robot_state-ego_mean	0.07654299399805733
sim_compute_robot_state-ego_median	0.07537641283553866
sim_compute_robot_state-ego_min	0.07271374150326378
sim_compute_sim_state_max	0.041616853645869666
sim_compute_sim_state_mean	0.04012624053893495
sim_compute_sim_state_median	0.03937126045495692
sim_compute_sim_state_min	0.03893092306036698
sim_physics_max	0.12243959321404382
sim_physics_mean	0.11038885274371343
sim_physics_median	0.10804363437320876
sim_physics_min	0.10368402129725406
sim_render-ego_max	0.06961121559143066
sim_render-ego_mean	0.06553432332527823
sim_render-ego_median	0.06507060527801514
sim_render-ego_min	0.0631777350331696
simulation-passed	1
survival_time_max	10.85000000000002
survival_time_mean	6.399999999999995
survival_time_min	2.3

No reset possible

20269

2867

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 11:00:21+00:00

2019-04-25 11:08:19+00:00

0:07:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.44297048542714457
survival_time_median	2.0500000000000007
deviation-center-line_median	0.08953577537338529
in-drivable-lane_median	0.49999999999999967

other stats

agent_compute-ego_max	0.213336508448531
agent_compute-ego_mean	0.1926198403995116
agent_compute-ego_median	0.1910839768556448
agent_compute-ego_min	0.16978357684227727
deviation-center-line_max	0.24789569373841508
deviation-center-line_mean	0.13160590632948438
deviation-center-line_min	0.06458578907942444
deviation-heading_max	1.2702004944853955
deviation-heading_mean	0.6103558567583608
deviation-heading_median	0.33274407178231713
deviation-heading_min	0.20978750590343137
driven_any_max	1.3772174106612145
driven_any_mean	0.902297287365388
driven_any_median	0.8452391122983286
driven_any_min	0.46176764788650015
driven_lanedir_consec_max	1.036739111167846
driven_lanedir_consec_mean	0.5366746899313497
driven_lanedir_consec_min	0.26685108973745963
driven_lanedir_max	1.036739111167846
driven_lanedir_mean	0.5741193818017196
driven_lanedir_median	0.45485966513861387
driven_lanedir_min	0.26685108973745963
in-drivable-lane_max	1.0000000000000009
in-drivable-lane_mean	0.4799999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9999136595959284, "sim_physics": 0.10848534397962616, "survival_time": 2.0500000000000007, "driven_lanedir": 0.6691765575375341, "sim_render-ego": 0.0676127643119998, "in-drivable-lane": 0.5, "agent_compute-ego": 0.213336508448531, "deviation-heading": 0.32381814220034477, "set_robot_commands": 0.0981590631531506, "deviation-center-line": 0.08953577537338529, "driven_lanedir_consec": 0.6691765575375341, "sim_compute_sim_state": 0.04245465557749679, "sim_compute_performance-ego": 0.0739956367306593, "sim_compute_robot_state-ego": 0.08141279220581055}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3772174106612145, "sim_physics": 0.09370642323647776, "survival_time": 3.099999999999997, "driven_lanedir": 1.036739111167846, "sim_render-ego": 0.07331765467120756, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.16978357684227727, "deviation-heading": 0.9152290694203156, "set_robot_commands": 0.09231062089243244, "deviation-center-line": 0.24789569373841508, "driven_lanedir_consec": 1.036739111167846, "sim_compute_sim_state": 0.03748007359043244, "sim_compute_performance-ego": 0.06903535704458913, "sim_compute_robot_state-ego": 0.06702508464936287}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8452391122983286, "sim_physics": 0.12551954159369835, "survival_time": 2.5999999999999988, "driven_lanedir": 0.45485966513861387, "sim_render-ego": 0.05742545311267559, "in-drivable-lane": 0.49999999999999967, "agent_compute-ego": 0.1910839768556448, "deviation-heading": 1.2702004944853955, "set_robot_commands": 0.11400809654822716, "deviation-center-line": 0.17839329168878798, "driven_lanedir_consec": 0.2676362057867645, "sim_compute_sim_state": 0.04677780316426204, "sim_compute_performance-ego": 0.07720627234532283, "sim_compute_robot_state-ego": 0.09670512492840108}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.46176764788650015, "sim_physics": 0.0961758053821066, "survival_time": 1.1500000000000004, "driven_lanedir": 0.44297048542714457, "sim_render-ego": 0.06410426678864853, "in-drivable-lane": 0, "agent_compute-ego": 0.20454657596090567, "deviation-heading": 0.33274407178231713, "set_robot_commands": 0.10103412296461024, "deviation-center-line": 0.077618981767409, "driven_lanedir_consec": 0.44297048542714457, "sim_compute_sim_state": 0.040834395781807274, "sim_compute_performance-ego": 0.06803756174833878, "sim_compute_robot_state-ego": 0.07723411269809889}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8273486063849694, "sim_physics": 0.10106016494132378, "survival_time": 1.850000000000001, "driven_lanedir": 0.26685108973745963, "sim_render-ego": 0.067210358542365, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.1843485638901994, "deviation-heading": 0.20978750590343137, "set_robot_commands": 0.0965404832685316, "deviation-center-line": 0.06458578907942444, "driven_lanedir_consec": 0.26685108973745963, "sim_compute_sim_state": 0.03831277666865168, "sim_compute_performance-ego": 0.0633232915723646, "sim_compute_robot_state-ego": 0.07156871460579536}}
set_robot_commands_max	0.11400809654822716
set_robot_commands_mean	0.1004104773653904
set_robot_commands_median	0.0981590631531506
set_robot_commands_min	0.09231062089243244
sim_compute_performance-ego_max	0.07720627234532283
sim_compute_performance-ego_mean	0.07031962388825493
sim_compute_performance-ego_median	0.06903535704458913
sim_compute_performance-ego_min	0.0633232915723646
sim_compute_robot_state-ego_max	0.09670512492840108
sim_compute_robot_state-ego_mean	0.07878916581749373
sim_compute_robot_state-ego_median	0.07723411269809889
sim_compute_robot_state-ego_min	0.06702508464936287
sim_compute_sim_state_max	0.04677780316426204
sim_compute_sim_state_mean	0.04117194095653005
sim_compute_sim_state_median	0.040834395781807274
sim_compute_sim_state_min	0.03748007359043244
sim_physics_max	0.12551954159369835
sim_physics_mean	0.10498945582664654
sim_physics_median	0.10106016494132378
sim_physics_min	0.09370642323647776
sim_render-ego_max	0.07331765467120756
sim_render-ego_mean	0.06593409948537929
sim_render-ego_median	0.067210358542365
sim_render-ego_min	0.05742545311267559
simulation-passed	1
survival_time_max	3.099999999999997
survival_time_mean	2.1499999999999995
survival_time_min	1.1500000000000004

No reset possible

20256

2908

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 10:45:09+00:00

2019-04-25 11:00:07+00:00

0:14:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20256-842142', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20256-842142', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20256-842142', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20244

2929

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 10:38:14+00:00

2019-04-25 10:44:33+00:00

0:06:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.13458294567708615
survival_time_median	1.3500000000000003
deviation-center-line_median	0.10330955034985607
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.20391734953849547
agent_compute-ego_mean	0.17705485422769077
agent_compute-ego_median	0.16927535717303938
agent_compute-ego_min	0.16649853481965907
deviation-center-line_max	0.1142080195269814
deviation-center-line_mean	0.08832025923166535
deviation-center-line_min	0.055651310997276576
deviation-heading_max	0.9342344737663074
deviation-heading_mean	0.7072499510436078
deviation-heading_median	0.8070894064577018
deviation-heading_min	0.4445608035126383
driven_any_max	0.2407616572856947
driven_any_mean	0.18474845093727996
driven_any_median	0.17908153988027395
driven_any_min	0.14057777563705937
driven_lanedir_consec_max	0.16202137762414015
driven_lanedir_consec_mean	0.1153426232905082
driven_lanedir_consec_min	0.045504207391451335
driven_lanedir_max	0.16202137762414015
driven_lanedir_mean	0.1153426232905082
driven_lanedir_median	0.13458294567708615
driven_lanedir_min	0.045504207391451335
in-drivable-lane_max	0.6500000000000006
in-drivable-lane_mean	0.13000000000000012
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2407616572856947, "sim_physics": 0.1846861377839119, "survival_time": 1.5500000000000007, "driven_lanedir": 0.16202137762414015, "sim_render-ego": 0.06158757209777832, "in-drivable-lane": 0, "agent_compute-ego": 0.20391734953849547, "deviation-heading": 0.9342344737663074, "set_robot_commands": 0.10302395205343924, "deviation-center-line": 0.10330955034985607, "driven_lanedir_consec": 0.16202137762414015, "sim_compute_sim_state": 0.03803279322962607, "sim_compute_performance-ego": 0.07111062542084724, "sim_compute_robot_state-ego": 0.07310777325784007, "sim_compute_robot_state-npc0": 0.07113330594954952, "sim_compute_robot_state-npc1": 0.06720802860875283, "sim_compute_robot_state-npc2": 0.06790416471419795, "sim_compute_robot_state-npc3": 0.06923428658516176}, "udem1-1-0": {"driven_any": 0.19976118981478388, "sim_physics": 0.19568006431355195, "survival_time": 1.7000000000000008, "driven_lanedir": 0.045504207391451335, "sim_render-ego": 0.0641953524421243, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.16649853481965907, "deviation-heading": 0.809770862008544, "set_robot_commands": 0.0909203571431777, "deviation-center-line": 0.055651310997276576, "driven_lanedir_consec": 0.045504207391451335, "sim_compute_sim_state": 0.03891623721403234, "sim_compute_performance-ego": 0.07098901973051183, "sim_compute_robot_state-ego": 0.07190838982077206, "sim_compute_robot_state-npc0": 0.0688544511795044, "sim_compute_robot_state-npc1": 0.06862433517680448, "sim_compute_robot_state-npc2": 0.06680031383738798, "sim_compute_robot_state-npc3": 0.06756377921384923}, "udem1-2-0": {"driven_any": 0.17908153988027395, "sim_physics": 0.19181317549485427, "survival_time": 1.3000000000000005, "driven_lanedir": 0.15383538969633292, "sim_render-ego": 0.06237642581646259, "in-drivable-lane": 0, "agent_compute-ego": 0.16927535717303938, "deviation-heading": 0.4445608035126383, "set_robot_commands": 0.09006243485670823, "deviation-center-line": 0.1142080195269814, "driven_lanedir_consec": 0.15383538969633292, "sim_compute_sim_state": 0.03832538311298077, "sim_compute_performance-ego": 0.07696691843179557, "sim_compute_robot_state-ego": 0.07413431314321664, "sim_compute_robot_state-npc0": 0.06871375670799842, "sim_compute_robot_state-npc1": 0.06840456449068509, "sim_compute_robot_state-npc2": 0.06584345377408542, "sim_compute_robot_state-npc3": 0.06414263065044697}, "udem1-3-0": {"driven_any": 0.16356009206858788, "sim_physics": 0.18114522651389792, "survival_time": 1.3500000000000003, "driven_lanedir": 0.13458294567708615, "sim_render-ego": 0.06384049521552192, "in-drivable-lane": 0, "agent_compute-ego": 0.17745861300715693, "deviation-heading": 0.5405942094728473, "set_robot_commands": 0.09255260008352774, "deviation-center-line": 0.11212380571320987, "driven_lanedir_consec": 0.13458294567708615, "sim_compute_sim_state": 0.04065756444577818, "sim_compute_performance-ego": 0.06759903166029188, "sim_compute_robot_state-ego": 0.08243903407344112, "sim_compute_robot_state-npc0": 0.0645107075020119, "sim_compute_robot_state-npc1": 0.0659799575805664, "sim_compute_robot_state-npc2": 0.06653858114171911, "sim_compute_robot_state-npc3": 0.06564406112388328}, "udem1-4-0": {"driven_any": 0.14057777563705937, "sim_physics": 0.15466531463291333, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08076919606353039, "sim_render-ego": 0.06091615428095278, "in-drivable-lane": 0, "agent_compute-ego": 0.16812441660010297, "deviation-heading": 0.8070894064577018, "set_robot_commands": 0.08695933093195377, "deviation-center-line": 0.056308609571002824, "driven_lanedir_consec": 0.08076919606353039, "sim_compute_sim_state": 0.04030569739963697, "sim_compute_performance-ego": 0.07024600194848102, "sim_compute_robot_state-ego": 0.06900472226350204, "sim_compute_robot_state-npc0": 0.06305767142254373, "sim_compute_robot_state-npc1": 0.06629770735035771, "sim_compute_robot_state-npc2": 0.06527668496836787, "sim_compute_robot_state-npc3": 0.06942005779432214}}
set_robot_commands_max	0.10302395205343924
set_robot_commands_mean	0.09270373501376132
set_robot_commands_median	0.0909203571431777
set_robot_commands_min	0.08695933093195377
sim_compute_performance-ego_max	0.07696691843179557
sim_compute_performance-ego_mean	0.07138231943838551
sim_compute_performance-ego_median	0.07098901973051183
sim_compute_performance-ego_min	0.06759903166029188
sim_compute_robot_state-ego_max	0.08243903407344112
sim_compute_robot_state-ego_mean	0.0741188465117544
sim_compute_robot_state-ego_median	0.07310777325784007
sim_compute_robot_state-ego_min	0.06900472226350204
sim_compute_robot_state-npc0_max	0.07113330594954952
sim_compute_robot_state-npc0_mean	0.0672539785523216
sim_compute_robot_state-npc0_median	0.06871375670799842
sim_compute_robot_state-npc0_min	0.06305767142254373
sim_compute_robot_state-npc1_max	0.06862433517680448
sim_compute_robot_state-npc1_mean	0.06730291864143331
sim_compute_robot_state-npc1_median	0.06720802860875283
sim_compute_robot_state-npc1_min	0.0659799575805664
sim_compute_robot_state-npc2_max	0.06790416471419795
sim_compute_robot_state-npc2_mean	0.06647263968715167
sim_compute_robot_state-npc2_median	0.06653858114171911
sim_compute_robot_state-npc2_min	0.06527668496836787
sim_compute_robot_state-npc3_max	0.06942005779432214
sim_compute_robot_state-npc3_mean	0.06720096307353267
sim_compute_robot_state-npc3_median	0.06756377921384923
sim_compute_robot_state-npc3_min	0.06414263065044697
sim_compute_sim_state_max	0.04065756444577818
sim_compute_sim_state_mean	0.039247535080410866
sim_compute_sim_state_median	0.03891623721403234
sim_compute_sim_state_min	0.03803279322962607
sim_physics_max	0.19568006431355195
sim_physics_mean	0.18159798374782588
sim_physics_median	0.1846861377839119
sim_physics_min	0.15466531463291333
sim_render-ego_max	0.0641953524421243
sim_render-ego_mean	0.06258319997056798
sim_render-ego_median	0.06237642581646259
sim_render-ego_min	0.06091615428095278
simulation-passed	1
survival_time_max	1.7000000000000008
survival_time_mean	1.4100000000000006
survival_time_min	1.1500000000000004

No reset possible

20171

3063

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-25 10:00:17+00:00

2019-04-25 10:38:07+00:00

0:37:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0004615556694189671
survival_time_median	14.950000000000076
deviation-center-line_median	0.4893543511348479
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.15843391100565593
agent_compute-ego_mean	0.1508959690729777
agent_compute-ego_median	0.14948288043340047
agent_compute-ego_min	0.14476900100708007
deviation-center-line_max	0.6110634223668668
deviation-center-line_mean	0.420093337748217
deviation-center-line_min	0.01675128614096042
deviation-heading_max	5.828528410212022
deviation-heading_mean	5.666366635305937
deviation-heading_median	5.656741799274124
deviation-heading_min	5.45365698365684
driven_any_max	0.02699486662998817
driven_any_mean	0.025026630137878515
driven_any_median	0.025845567204838143
driven_any_min	0.022110630442247207
driven_lanedir_consec_max	0.0024811319357622708
driven_lanedir_consec_mean	-0.0002839237876270495
driven_lanedir_consec_min	-0.003723902623983477
driven_lanedir_max	0.0024811319357622708
driven_lanedir_mean	-0.0002839237876270495
driven_lanedir_median	0.0004615556694189671
driven_lanedir_min	-0.003723902623983477
in-drivable-lane_max	7.650000000000045
in-drivable-lane_mean	7.610000000000044
in-drivable-lane_min	7.550000000000044
per-episodes	details {"udem1-0-0": {"driven_any": 0.02699486662998817, "sim_physics": 0.2162631464004517, "survival_time": 14.950000000000076, "driven_lanedir": 0.0024811319357622708, "sim_render-ego": 0.06240809520085653, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.15460896889368694, "deviation-heading": 5.656741799274124, "set_robot_commands": 0.0955582841237386, "deviation-center-line": 0.5615811912624447, "driven_lanedir_consec": 0.0024811319357622708, "sim_compute_sim_state": 0.03991979678471883, "sim_compute_performance-ego": 0.07105065902074179, "sim_compute_robot_state-ego": 0.07538472811381022, "sim_compute_robot_state-npc0": 0.0701625927289327, "sim_compute_robot_state-npc1": 0.07051294724146526, "sim_compute_robot_state-npc2": 0.07033451318740845, "sim_compute_robot_state-npc3": 0.0700149655342102}, "udem1-1-0": {"driven_any": 0.025845567204838143, "sim_physics": 0.2226694107055664, "survival_time": 14.950000000000076, "driven_lanedir": -0.003723902623983477, "sim_render-ego": 0.06476889371871948, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15843391100565593, "deviation-heading": 5.792980334963804, "set_robot_commands": 0.0967424488067627, "deviation-center-line": 0.6110634223668668, "driven_lanedir_consec": -0.003723902623983477, "sim_compute_sim_state": 0.04164273341496785, "sim_compute_performance-ego": 0.06967804590861003, "sim_compute_robot_state-ego": 0.07540271917978923, "sim_compute_robot_state-npc0": 0.07332563797632853, "sim_compute_robot_state-npc1": 0.07212393124898275, "sim_compute_robot_state-npc2": 0.07071705341339111, "sim_compute_robot_state-npc3": 0.07439839283625285}, "udem1-2-0": {"driven_any": 0.024318396942412283, "sim_physics": 0.19908061504364016, "survival_time": 14.950000000000076, "driven_lanedir": 0.0019934477256953187, "sim_render-ego": 0.059106652736663816, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.14476900100708007, "deviation-heading": 5.599925648422895, "set_robot_commands": 0.08778472503026326, "deviation-center-line": 0.4893543511348479, "driven_lanedir_consec": 0.0019934477256953187, "sim_compute_sim_state": 0.03736320336659749, "sim_compute_performance-ego": 0.06543137073516846, "sim_compute_robot_state-ego": 0.06724108537038168, "sim_compute_robot_state-npc0": 0.06604350487391154, "sim_compute_robot_state-npc1": 0.06678632974624633, "sim_compute_robot_state-npc2": 0.06456363677978516, "sim_compute_robot_state-npc3": 0.06683667421340943}, "udem1-3-0": {"driven_any": 0.022110630442247207, "sim_physics": 0.20795449654261272, "survival_time": 14.950000000000076, "driven_lanedir": -0.002631851645028327, "sim_render-ego": 0.06009384075800578, "in-drivable-lane": 7.650000000000045, "agent_compute-ego": 0.14948288043340047, "deviation-heading": 5.45365698365684, "set_robot_commands": 0.0915669584274292, "deviation-center-line": 0.4217164378359653, "driven_lanedir_consec": -0.002631851645028327, "sim_compute_sim_state": 0.03711789687474569, "sim_compute_performance-ego": 0.0662767235438029, "sim_compute_robot_state-ego": 0.07053916374842326, "sim_compute_robot_state-npc0": 0.06734729051589966, "sim_compute_robot_state-npc1": 0.06596714973449708, "sim_compute_robot_state-npc2": 0.06544398466746013, "sim_compute_robot_state-npc3": 0.0656069270769755}, "udem1-4-0": {"driven_any": 0.025863689469906782, "sim_physics": 0.20208343664805095, "survival_time": 14.950000000000076, "driven_lanedir": 0.0004615556694189671, "sim_render-ego": 0.059625860850016275, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.1471850840250651, "deviation-heading": 5.828528410212022, "set_robot_commands": 0.09090924183527628, "deviation-center-line": 0.01675128614096042, "driven_lanedir_consec": 0.0004615556694189671, "sim_compute_sim_state": 0.03646199862162272, "sim_compute_performance-ego": 0.06525272846221924, "sim_compute_robot_state-ego": 0.07123732566833496, "sim_compute_robot_state-npc0": 0.06589326937993367, "sim_compute_robot_state-npc1": 0.06600006421407063, "sim_compute_robot_state-npc2": 0.06536927302678426, "sim_compute_robot_state-npc3": 0.06530107021331787}}
set_robot_commands_max	0.0967424488067627
set_robot_commands_mean	0.092512331644694
set_robot_commands_median	0.0915669584274292
set_robot_commands_min	0.08778472503026326
sim_compute_performance-ego_max	0.07105065902074179
sim_compute_performance-ego_mean	0.06753790553410849
sim_compute_performance-ego_median	0.0662767235438029
sim_compute_performance-ego_min	0.06525272846221924
sim_compute_robot_state-ego_max	0.07540271917978923
sim_compute_robot_state-ego_mean	0.07196100441614786
sim_compute_robot_state-ego_median	0.07123732566833496
sim_compute_robot_state-ego_min	0.06724108537038168
sim_compute_robot_state-npc0_max	0.07332563797632853
sim_compute_robot_state-npc0_mean	0.06855445909500121
sim_compute_robot_state-npc0_median	0.06734729051589966
sim_compute_robot_state-npc0_min	0.06589326937993367
sim_compute_robot_state-npc1_max	0.07212393124898275
sim_compute_robot_state-npc1_mean	0.06827808443705241
sim_compute_robot_state-npc1_median	0.06678632974624633
sim_compute_robot_state-npc1_min	0.06596714973449708
sim_compute_robot_state-npc2_max	0.07071705341339111
sim_compute_robot_state-npc2_mean	0.06728569221496582
sim_compute_robot_state-npc2_median	0.06544398466746013
sim_compute_robot_state-npc2_min	0.06456363677978516
sim_compute_robot_state-npc3_max	0.07439839283625285
sim_compute_robot_state-npc3_mean	0.06843160597483318
sim_compute_robot_state-npc3_median	0.06683667421340943
sim_compute_robot_state-npc3_min	0.06530107021331787
sim_compute_sim_state_max	0.04164273341496785
sim_compute_sim_state_mean	0.03850112581253052
sim_compute_sim_state_median	0.03736320336659749
sim_compute_sim_state_min	0.03646199862162272
sim_physics_max	0.2226694107055664
sim_physics_mean	0.20961022106806437
sim_physics_median	0.20795449654261272
sim_physics_min	0.19908061504364016
sim_render-ego_max	0.06476889371871948
sim_render-ego_mean	0.061200668652852376
sim_render-ego_median	0.06009384075800578
sim_render-ego_min	0.059106652736663816
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20154

2894

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 09:48:27+00:00

2019-04-25 10:00:10+00:00

0:11:43

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20154-138905', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20154-138905', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20154-138905', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20144

2985

Artem Ioselevskii

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:42:38+00:00

2019-04-25 09:48:21+00:00

0:05:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20136

2995

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:41:08+00:00

2019-04-25 09:41:47+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20129

3003

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:40:01+00:00

2019-04-25 09:40:40+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20122

3015

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:39:10+00:00

2019-04-25 09:39:48+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20118

3019

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:38:20+00:00

2019-04-25 09:39:03+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20088

2894

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 09:19:19+00:00

2019-04-25 09:38:08+00:00

0:18:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.45942891170089206
survival_time_median	14.950000000000076
deviation-center-line_median	0.6293868858822561
in-drivable-lane_median	2.8999999999999897

other stats

agent_compute-ego_max	0.16299884014717808
agent_compute-ego_mean	0.15673543839034962
agent_compute-ego_median	0.15879082838694256
agent_compute-ego_min	0.14336578369140626
deviation-center-line_max	0.786637014034343
deviation-center-line_mean	0.6637702713595773
deviation-center-line_min	0.5496735769251236
deviation-heading_max	6.6297722994551656
deviation-heading_mean	4.870282813937431
deviation-heading_median	4.361857533321278
deviation-heading_min	2.888387773667082
driven_any_max	0.7896396473381312
driven_any_mean	0.6475542913446196
driven_any_median	0.6554444304338494
driven_any_min	0.5014516748718221
driven_lanedir_consec_max	0.5877267354450155
driven_lanedir_consec_mean	0.39186864989296577
driven_lanedir_consec_min	0.14657078615800367
driven_lanedir_max	0.5880037183648525
driven_lanedir_mean	0.4136276022718972
driven_lanedir_median	0.4748645683079431
driven_lanedir_min	0.17256634009411442
in-drivable-lane_max	5.300000000000006
in-drivable-lane_mean	3.330000000000023
in-drivable-lane_min	2.450000000000035
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7896396473381312, "sim_physics": 0.03534423430760702, "survival_time": 14.950000000000076, "driven_lanedir": 0.5880037183648525, "sim_render-ego": 0.04853662490844726, "in-drivable-lane": 3.300000000000047, "agent_compute-ego": 0.14336578369140626, "deviation-heading": 2.888387773667082, "set_robot_commands": 0.07594281991322835, "deviation-center-line": 0.7738732771876182, "driven_lanedir_consec": 0.5862714366309136, "sim_compute_sim_state": 0.03196640968322754, "sim_compute_performance-ego": 0.055497957865397136, "sim_compute_robot_state-ego": 0.05569811662038167}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.501705341243672, "sim_physics": 0.039855960182156334, "survival_time": 11.350000000000026, "driven_lanedir": 0.24497664914756023, "sim_render-ego": 0.05610377147859414, "in-drivable-lane": 2.8999999999999897, "agent_compute-ego": 0.16299884014717808, "deviation-heading": 6.6297722994551656, "set_robot_commands": 0.0873767310827314, "deviation-center-line": 0.6293868858822561, "driven_lanedir_consec": 0.17934537953000407, "sim_compute_sim_state": 0.03543905119538832, "sim_compute_performance-ego": 0.06150467595339872, "sim_compute_robot_state-ego": 0.06608748751064754}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6554444304338494, "sim_physics": 0.03996873219807943, "survival_time": 14.950000000000076, "driven_lanedir": 0.4748645683079431, "sim_render-ego": 0.05513658761978149, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.15879082838694256, "deviation-heading": 6.170569434517507, "set_robot_commands": 0.08631372054417928, "deviation-center-line": 0.786637014034343, "driven_lanedir_consec": 0.45942891170089206, "sim_compute_sim_state": 0.03687215725580851, "sim_compute_performance-ego": 0.06083742380142212, "sim_compute_robot_state-ego": 0.0620699675877889}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7895303628356238, "sim_physics": 0.03834319035212199, "survival_time": 14.950000000000076, "driven_lanedir": 0.5877267354450155, "sim_render-ego": 0.05445718924204508, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.16229023615519206, "deviation-heading": 4.361857533321278, "set_robot_commands": 0.08519110202789307, "deviation-center-line": 0.5792806027685456, "driven_lanedir_consec": 0.5877267354450155, "sim_compute_sim_state": 0.03430046319961548, "sim_compute_performance-ego": 0.05737371524175008, "sim_compute_robot_state-ego": 0.061405874888102216}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5014516748718221, "sim_physics": 0.037069685691225845, "survival_time": 11.300000000000026, "driven_lanedir": 0.17256634009411442, "sim_render-ego": 0.051908273612503456, "in-drivable-lane": 5.300000000000006, "agent_compute-ego": 0.15623150357102925, "deviation-heading": 4.300827028726121, "set_robot_commands": 0.0839431539046026, "deviation-center-line": 0.5496735769251236, "driven_lanedir_consec": 0.14657078615800367, "sim_compute_sim_state": 0.03475148065955238, "sim_compute_performance-ego": 0.05959097896002035, "sim_compute_robot_state-ego": 0.06157205801094528}}
set_robot_commands_max	0.0873767310827314
set_robot_commands_mean	0.08375350549452694
set_robot_commands_median	0.08519110202789307
set_robot_commands_min	0.07594281991322835
sim_compute_performance-ego_max	0.06150467595339872
sim_compute_performance-ego_mean	0.05896095036439768
sim_compute_performance-ego_median	0.05959097896002035
sim_compute_performance-ego_min	0.055497957865397136
sim_compute_robot_state-ego_max	0.06608748751064754
sim_compute_robot_state-ego_mean	0.06136670092357312
sim_compute_robot_state-ego_median	0.06157205801094528
sim_compute_robot_state-ego_min	0.05569811662038167
sim_compute_sim_state_max	0.03687215725580851
sim_compute_sim_state_mean	0.034665912398718454
sim_compute_sim_state_median	0.03475148065955238
sim_compute_sim_state_min	0.03196640968322754
sim_physics_max	0.03996873219807943
sim_physics_mean	0.038116360546238126
sim_physics_median	0.03834319035212199
sim_physics_min	0.03534423430760702
sim_render-ego_max	0.05610377147859414
sim_render-ego_mean	0.05322848937227428
sim_render-ego_median	0.05445718924204508
sim_render-ego_min	0.04853662490844726
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.500000000000057
survival_time_min	11.300000000000026

No reset possible

20077

2624

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 09:10:24+00:00

2019-04-25 09:19:02+00:00

0:08:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15418248375256857
agent_compute-ego_mean	0.14637864456046124
agent_compute-ego_median	0.1441748667571504
agent_compute-ego_min	0.14049980640411378
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.17193224070207128, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.06164366569159166, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.15231258689232594, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.09516133227438298, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03910474282390666, "sim_compute_performance-ego": 0.06833044313034921, "sim_compute_robot_state-ego": 0.07523275321384645, "sim_compute_robot_state-npc0": 0.06911053747501013, "sim_compute_robot_state-npc1": 0.06749041350382678, "sim_compute_robot_state-npc2": 0.0703125944677389, "sim_compute_robot_state-npc3": 0.06939115839184455}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.1458969215552012, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.05648603041966757, "in-drivable-lane": 0, "agent_compute-ego": 0.15418248375256857, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.09244545300801596, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03583081563313802, "sim_compute_performance-ego": 0.06171483794848124, "sim_compute_robot_state-ego": 0.06678595145543416, "sim_compute_robot_state-npc0": 0.06384400526682536, "sim_compute_robot_state-npc1": 0.060123284657796226, "sim_compute_robot_state-npc2": 0.05824922521909078, "sim_compute_robot_state-npc3": 0.05928892890612284}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.16615147913916636, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.059286683292712195, "in-drivable-lane": 0, "agent_compute-ego": 0.14072347899614754, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.08464429338099592, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03679210856809455, "sim_compute_performance-ego": 0.06188844826261876, "sim_compute_robot_state-ego": 0.0684253724954896, "sim_compute_robot_state-npc0": 0.06354638277474096, "sim_compute_robot_state-npc1": 0.059145058615733, "sim_compute_robot_state-npc2": 0.06161893424341234, "sim_compute_robot_state-npc3": 0.06180946705705029}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.1641565096580376, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05981097787113513, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1441748667571504, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.08768212189108639, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.03528151269686424, "sim_compute_performance-ego": 0.06630293797638456, "sim_compute_robot_state-ego": 0.06610425852112851, "sim_compute_robot_state-npc0": 0.06246971275846837, "sim_compute_robot_state-npc1": 0.06242214219044831, "sim_compute_robot_state-npc2": 0.06543726436162399, "sim_compute_robot_state-npc3": 0.0634502435134629}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.14582440853118897, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.05636156797409057, "in-drivable-lane": 0, "agent_compute-ego": 0.14049980640411378, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.08853141069412232, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.038758599758148195, "sim_compute_performance-ego": 0.06126002073287964, "sim_compute_robot_state-ego": 0.06996057033538819, "sim_compute_robot_state-npc0": 0.06933979988098145, "sim_compute_robot_state-npc1": 0.06861263513565063, "sim_compute_robot_state-npc2": 0.06849373579025268, "sim_compute_robot_state-npc3": 0.06620062589645385}}
set_robot_commands_max	0.09516133227438298
set_robot_commands_mean	0.08969292224972072
set_robot_commands_median	0.08853141069412232
set_robot_commands_min	0.08464429338099592
sim_compute_performance-ego_max	0.06833044313034921
sim_compute_performance-ego_mean	0.06389933761014269
sim_compute_performance-ego_median	0.06188844826261876
sim_compute_performance-ego_min	0.06126002073287964
sim_compute_robot_state-ego_max	0.07523275321384645
sim_compute_robot_state-ego_mean	0.06930178120425738
sim_compute_robot_state-ego_median	0.0684253724954896
sim_compute_robot_state-ego_min	0.06610425852112851
sim_compute_robot_state-npc0_max	0.06933979988098145
sim_compute_robot_state-npc0_mean	0.06566208763120525
sim_compute_robot_state-npc0_median	0.06384400526682536
sim_compute_robot_state-npc0_min	0.06246971275846837
sim_compute_robot_state-npc1_max	0.06861263513565063
sim_compute_robot_state-npc1_mean	0.063558706820691
sim_compute_robot_state-npc1_median	0.06242214219044831
sim_compute_robot_state-npc1_min	0.059145058615733
sim_compute_robot_state-npc2_max	0.0703125944677389
sim_compute_robot_state-npc2_mean	0.06482235081642373
sim_compute_robot_state-npc2_median	0.06543726436162399
sim_compute_robot_state-npc2_min	0.05824922521909078
sim_compute_robot_state-npc3_max	0.06939115839184455
sim_compute_robot_state-npc3_mean	0.0640280847529869
sim_compute_robot_state-npc3_median	0.0634502435134629
sim_compute_robot_state-npc3_min	0.05928892890612284
sim_compute_sim_state_max	0.03910474282390666
sim_compute_sim_state_mean	0.03715355589603033
sim_compute_sim_state_median	0.03679210856809455
sim_compute_sim_state_min	0.03528151269686424
sim_physics_max	0.17193224070207128
sim_physics_mean	0.15879231191713308
sim_physics_median	0.1641565096580376
sim_physics_min	0.14582440853118897
sim_render-ego_max	0.06164366569159166
sim_render-ego_mean	0.05871778504983942
sim_render-ego_median	0.059286683292712195
sim_render-ego_min	0.05636156797409057
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20055

2826

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 09:00:40+00:00

2019-04-25 09:10:10+00:00

0:09:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15872457471944518
agent_compute-ego_mean	0.14980956501041237
agent_compute-ego_median	0.15098310708999635
agent_compute-ego_min	0.14069433535559703
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.16319382190704346, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.05613348843916407, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.14554907240957585, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.09005992367582501, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03502706761630076, "sim_compute_performance-ego": 0.06206119285439545, "sim_compute_robot_state-ego": 0.06620694781249424, "sim_compute_robot_state-npc0": 0.06631484796416084, "sim_compute_robot_state-npc1": 0.06160853044042047, "sim_compute_robot_state-npc2": 0.062211637227040414, "sim_compute_robot_state-npc3": 0.062452125099470034}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.14452087879180908, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.05986914038658142, "in-drivable-lane": 0, "agent_compute-ego": 0.1530967354774475, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.09041074911753336, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03599324822425842, "sim_compute_performance-ego": 0.07785846789677937, "sim_compute_robot_state-ego": 0.07248618205388387, "sim_compute_robot_state-npc0": 0.06393876671791077, "sim_compute_robot_state-npc1": 0.06280068556467693, "sim_compute_robot_state-npc2": 0.06376380721728007, "sim_compute_robot_state-npc3": 0.06259288390477498}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.17153282488806773, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.062338182481668766, "in-drivable-lane": 0, "agent_compute-ego": 0.15872457471944518, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.0989357940221237, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03851081557193045, "sim_compute_performance-ego": 0.06830503172793631, "sim_compute_robot_state-ego": 0.0751638048786228, "sim_compute_robot_state-npc0": 0.0689037048210532, "sim_compute_robot_state-npc1": 0.06940102981308759, "sim_compute_robot_state-npc2": 0.0693681603771145, "sim_compute_robot_state-npc3": 0.06878766771090233}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.17488711567248327, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.06097140554654396, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14069433535559703, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.08892295320155257, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.03717214778318244, "sim_compute_performance-ego": 0.06466603683213056, "sim_compute_robot_state-ego": 0.07065924547486387, "sim_compute_robot_state-npc0": 0.0662606530270334, "sim_compute_robot_state-npc1": 0.06300742343320685, "sim_compute_robot_state-npc2": 0.06608970286482471, "sim_compute_robot_state-npc3": 0.06498616428698524}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.13333016633987427, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.05306353569030762, "in-drivable-lane": 0, "agent_compute-ego": 0.15098310708999635, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.09364494085311888, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03616448640823365, "sim_compute_performance-ego": 0.05598193407058716, "sim_compute_robot_state-ego": 0.0573960542678833, "sim_compute_robot_state-npc0": 0.06472283601760864, "sim_compute_robot_state-npc1": 0.06627107858657837, "sim_compute_robot_state-npc2": 0.0691953182220459, "sim_compute_robot_state-npc3": 0.06390717029571533}}
set_robot_commands_max	0.0989357940221237
set_robot_commands_mean	0.09239487217403072
set_robot_commands_median	0.09041074911753336
set_robot_commands_min	0.08892295320155257
sim_compute_performance-ego_max	0.07785846789677937
sim_compute_performance-ego_mean	0.06577453267636577
sim_compute_performance-ego_median	0.06466603683213056
sim_compute_performance-ego_min	0.05598193407058716
sim_compute_robot_state-ego_max	0.0751638048786228
sim_compute_robot_state-ego_mean	0.0683824468975496
sim_compute_robot_state-ego_median	0.07065924547486387
sim_compute_robot_state-ego_min	0.0573960542678833
sim_compute_robot_state-npc0_max	0.0689037048210532
sim_compute_robot_state-npc0_mean	0.06602816170955336
sim_compute_robot_state-npc0_median	0.0662606530270334
sim_compute_robot_state-npc0_min	0.06393876671791077
sim_compute_robot_state-npc1_max	0.06940102981308759
sim_compute_robot_state-npc1_mean	0.06461774956759404
sim_compute_robot_state-npc1_median	0.06300742343320685
sim_compute_robot_state-npc1_min	0.06160853044042047
sim_compute_robot_state-npc2_max	0.0693681603771145
sim_compute_robot_state-npc2_mean	0.06612572518166113
sim_compute_robot_state-npc2_median	0.06608970286482471
sim_compute_robot_state-npc2_min	0.062211637227040414
sim_compute_robot_state-npc3_max	0.06878766771090233
sim_compute_robot_state-npc3_mean	0.06454520225956958
sim_compute_robot_state-npc3_median	0.06390717029571533
sim_compute_robot_state-npc3_min	0.062452125099470034
sim_compute_sim_state_max	0.03851081557193045
sim_compute_sim_state_mean	0.03657355312078114
sim_compute_sim_state_median	0.03616448640823365
sim_compute_sim_state_min	0.03502706761630076
sim_physics_max	0.17488711567248327
sim_physics_mean	0.15749296151985556
sim_physics_median	0.16319382190704346
sim_physics_min	0.13333016633987427
sim_render-ego_max	0.062338182481668766
sim_render-ego_mean	0.05847515050885317
sim_render-ego_median	0.05986914038658142
sim_render-ego_min	0.05306353569030762
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20045

3050

challenge-aido_LF-template-tensorflow

step1-simulation

host-error

2019-04-25 08:59:26+00:00

2019-04-25 09:00:18+00:00

0:00:52

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    shutil.rmtree(wd)
  File "/usr/lib/python3.6/shutil.py", line 471, in rmtree
    onerror(os.lstat, path, sys.exc_info())
  File "/usr/lib/python3.6/shutil.py", line 469, in rmtree
    orig_st = os.lstat(path)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3050/step1-simulation-ip-172-31-42-167-7357-job20045'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20018

2399

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-25 08:46:41+00:00

2019-04-25 08:52:52+00:00

0:06:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.630782078032722
survival_time_median	2.6499999999999986
deviation-center-line_median	0.10342694179960472
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.11331115828620064
agent_compute-ego_mean	0.09755483626877652
agent_compute-ego_median	0.0957867848245721
agent_compute-ego_min	0.07571285742300528
deviation-center-line_max	0.24274593434117447
deviation-center-line_mean	0.1423794188959262
deviation-center-line_min	0.05838775199208855
deviation-heading_max	0.9510803390140998
deviation-heading_mean	0.5404741772455786
deviation-heading_median	0.4662935751765816
deviation-heading_min	0.3138996563005005
driven_any_max	2.1937495917222662
driven_any_mean	1.101203967779493
driven_any_median	1.072953759306336
driven_any_min	0.3121624499492532
driven_lanedir_consec_max	1.8128454170816104
driven_lanedir_consec_mean	0.8194262040404128
driven_lanedir_consec_min	0.29255031695938905
driven_lanedir_max	1.8128454170816104
driven_lanedir_mean	0.8194262040404128
driven_lanedir_median	0.630782078032722
driven_lanedir_min	0.29255031695938905
in-drivable-lane_max	1.0499999999999965
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.03303757309913635, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.044541011253992714, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.11331115828620064, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.06406292650434706, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.026473846700456407, "sim_compute_performance-ego": 0.04802227020263672, "sim_compute_robot_state-ego": 0.05008825659751892, "sim_compute_robot_state-npc0": 0.04807137449582418, "sim_compute_robot_state-npc1": 0.04769842823346456, "sim_compute_robot_state-npc2": 0.04629919264051649, "sim_compute_robot_state-npc3": 0.04623020357555813}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.02209621888619882, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.03618168830871582, "in-drivable-lane": 0, "agent_compute-ego": 0.07571285742300528, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.053892285735518845, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.022207781120582862, "sim_compute_performance-ego": 0.03798906008402506, "sim_compute_robot_state-ego": 0.03945717988190828, "sim_compute_robot_state-npc0": 0.0395758416917589, "sim_compute_robot_state-npc1": 0.03867653564170555, "sim_compute_robot_state-npc2": 0.03852126333448622, "sim_compute_robot_state-npc3": 0.04044138060675727}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.03245186574250749, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.049660351669904096, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.10870279617679927, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.07584120231924706, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.030015880621752693, "sim_compute_performance-ego": 0.0519523574310599, "sim_compute_robot_state-ego": 0.05299379987624085, "sim_compute_robot_state-npc0": 0.05501576766227056, "sim_compute_robot_state-npc1": 0.05284486233609394, "sim_compute_robot_state-npc2": 0.05500942295037427, "sim_compute_robot_state-npc3": 0.053260881923934786}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.029825102608158904, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.04411093244012797, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.0942605846333054, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.0661456674899695, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.026013194390063017, "sim_compute_performance-ego": 0.049731515488534606, "sim_compute_robot_state-ego": 0.04758299521680148, "sim_compute_robot_state-npc0": 0.04770020268998056, "sim_compute_robot_state-npc1": 0.047203459829654335, "sim_compute_robot_state-npc2": 0.04678285346840912, "sim_compute_robot_state-npc3": 0.04746283675139805}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.03143828793575889, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.04754370137264854, "in-drivable-lane": 0, "agent_compute-ego": 0.0957867848245721, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.07314129879600123, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.031663631138048674, "sim_compute_performance-ego": 0.05104835409867136, "sim_compute_robot_state-ego": 0.05044012320669074, "sim_compute_robot_state-npc0": 0.052906889664499385, "sim_compute_robot_state-npc1": 0.051458885795191714, "sim_compute_robot_state-npc2": 0.054073082773309, "sim_compute_robot_state-npc3": 0.05516481399536133}}
set_robot_commands_max	0.07584120231924706
set_robot_commands_mean	0.06661667616901673
set_robot_commands_median	0.0661456674899695
set_robot_commands_min	0.053892285735518845
sim_compute_performance-ego_max	0.0519523574310599
sim_compute_performance-ego_mean	0.04774871146098553
sim_compute_performance-ego_median	0.049731515488534606
sim_compute_performance-ego_min	0.03798906008402506
sim_compute_robot_state-ego_max	0.05299379987624085
sim_compute_robot_state-ego_mean	0.04811247095583206
sim_compute_robot_state-ego_median	0.05008825659751892
sim_compute_robot_state-ego_min	0.03945717988190828
sim_compute_robot_state-npc0_max	0.05501576766227056
sim_compute_robot_state-npc0_mean	0.04865401524086672
sim_compute_robot_state-npc0_median	0.04807137449582418
sim_compute_robot_state-npc0_min	0.0395758416917589
sim_compute_robot_state-npc1_max	0.05284486233609394
sim_compute_robot_state-npc1_mean	0.04757643436722202
sim_compute_robot_state-npc1_median	0.04769842823346456
sim_compute_robot_state-npc1_min	0.03867653564170555
sim_compute_robot_state-npc2_max	0.05500942295037427
sim_compute_robot_state-npc2_mean	0.048137163033419014
sim_compute_robot_state-npc2_median	0.04678285346840912
sim_compute_robot_state-npc2_min	0.03852126333448622
sim_compute_robot_state-npc3_max	0.05516481399536133
sim_compute_robot_state-npc3_mean	0.04851202337060192
sim_compute_robot_state-npc3_median	0.04746283675139805
sim_compute_robot_state-npc3_min	0.04044138060675727
sim_compute_sim_state_max	0.031663631138048674
sim_compute_sim_state_mean	0.02727486679418073
sim_compute_sim_state_median	0.026473846700456407
sim_compute_sim_state_min	0.022207781120582862
sim_physics_max	0.03303757309913635
sim_physics_mean	0.02976980965435209
sim_physics_median	0.03143828793575889
sim_physics_min	0.02209621888619882
sim_render-ego_max	0.049660351669904096
sim_render-ego_mean	0.04440753700907783
sim_render-ego_median	0.044541011253992714
sim_render-ego_min	0.03618168830871582
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.739999999999997
survival_time_min	0.9500000000000004

No reset possible

20010

2433

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 08:45:07+00:00

2019-04-25 08:46:21+00:00

0:01:14

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19984

2512

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:42:46+00:00

2019-04-25 08:44:52+00:00

0:02:06

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19962

2605

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:41:00+00:00

2019-04-25 08:42:38+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19920

3007

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 08:38:08+00:00

2019-04-25 08:40:43+00:00

0:02:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19908

2704

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:36:56+00:00

2019-04-25 08:38:01+00:00

0:01:05

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19887

2819

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

error

2019-04-25 08:35:22+00:00

2019-04-25 08:36:35+00:00

0:01:13

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19829

2684

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 08:20:22+00:00

2019-04-25 08:34:56+00:00

0:14:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4688644800340942
survival_time_median	3.599999999999995
deviation-center-line_median	0.33521320352539286
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08867019064286176
agent_compute-ego_mean	0.08039611325123894
agent_compute-ego_median	0.07939471737031013
agent_compute-ego_min	0.07297428448994954
deviation-center-line_max	1.0574643016365763
deviation-center-line_mean	0.4958669183111393
deviation-center-line_min	0.13166198301109117
deviation-heading_max	2.2120101001651142
deviation-heading_mean	1.2661905467067456
deviation-heading_median	1.1400269156025429
deviation-heading_min	0.5485536448500099
driven_any_max	1.8253040926521744
driven_any_mean	0.9151049866664368
driven_any_median	0.5315348651589137
driven_any_min	0.2261668545579117
driven_lanedir_consec_max	1.6535684153794692
driven_lanedir_consec_mean	0.7488089123310491
driven_lanedir_consec_min	0.20204312988533069
driven_lanedir_max	1.6536562691037238
driven_lanedir_mean	0.7488264830759
driven_lanedir_median	0.4688644800340942
driven_lanedir_min	0.20204312988533069
in-drivable-lane_max	3.6000000000000334
in-drivable-lane_mean	0.7700000000000065
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.6860174492892, "sim_physics": 0.04466418956281952, "survival_time": 10.85000000000002, "driven_lanedir": 1.6536562691037238, "sim_render-ego": 0.06512132987448696, "in-drivable-lane": 0, "agent_compute-ego": 0.07939471737031013, "deviation-heading": 1.6827145120487592, "set_robot_commands": 0.10090227061153008, "deviation-center-line": 1.0574643016365763, "driven_lanedir_consec": 1.6535684153794692, "sim_compute_sim_state": 0.040653851724440054, "sim_compute_performance-ego": 0.07038370035760413, "sim_compute_robot_state-ego": 0.07613708786151376, "sim_compute_robot_state-npc0": 0.07357732711299773, "sim_compute_robot_state-npc1": 0.07139021460361744, "sim_compute_robot_state-npc2": 0.07156065751879995, "sim_compute_robot_state-npc3": 0.07128314927975703}, "udem1-1-0": {"driven_any": 0.3065016716739841, "sim_physics": 0.03982922705737027, "survival_time": 2.2, "driven_lanedir": 0.2482687980387213, "sim_render-ego": 0.06180736151608554, "in-drivable-lane": 0, "agent_compute-ego": 0.08169315619902177, "deviation-heading": 1.1400269156025429, "set_robot_commands": 0.09256749261509288, "deviation-center-line": 0.13166198301109117, "driven_lanedir_consec": 0.2482687980387213, "sim_compute_sim_state": 0.03633805296637795, "sim_compute_performance-ego": 0.07422126423228871, "sim_compute_robot_state-ego": 0.06515085155313666, "sim_compute_robot_state-npc0": 0.06859939748590643, "sim_compute_robot_state-npc1": 0.06145307150754062, "sim_compute_robot_state-npc2": 0.06244034658778797, "sim_compute_robot_state-npc3": 0.0654855804009871}, "udem1-2-0": {"driven_any": 0.5315348651589137, "sim_physics": 0.048806213670306735, "survival_time": 3.599999999999995, "driven_lanedir": 0.4688644800340942, "sim_render-ego": 0.05817197759946187, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.07297428448994954, "deviation-heading": 0.7476475608673021, "set_robot_commands": 0.08984614743126763, "deviation-center-line": 0.33521320352539286, "driven_lanedir_consec": 0.4688644800340942, "sim_compute_sim_state": 0.03789235154787699, "sim_compute_performance-ego": 0.0669403506649865, "sim_compute_robot_state-ego": 0.06751429372363621, "sim_compute_robot_state-npc0": 0.07120587759547764, "sim_compute_robot_state-npc1": 0.06698619657092625, "sim_compute_robot_state-npc2": 0.06752741667959425, "sim_compute_robot_state-npc3": 0.06777078575558132}, "udem1-3-0": {"driven_any": 0.2261668545579117, "sim_physics": 0.05653904466068044, "survival_time": 1.7000000000000008, "driven_lanedir": 0.20204312988533069, "sim_render-ego": 0.07058180079740636, "in-drivable-lane": 0, "agent_compute-ego": 0.08867019064286176, "deviation-heading": 0.5485536448500099, "set_robot_commands": 0.11013489611008588, "deviation-center-line": 0.15266506294887486, "driven_lanedir_consec": 0.20204312988533069, "sim_compute_sim_state": 0.042232821969424975, "sim_compute_performance-ego": 0.07580343414755429, "sim_compute_robot_state-ego": 0.08477870857014376, "sim_compute_robot_state-npc0": 0.07278215885162354, "sim_compute_robot_state-npc1": 0.07162096921135397, "sim_compute_robot_state-npc2": 0.07073638719670913, "sim_compute_robot_state-npc3": 0.0739496665842393}, "udem1-4-0": {"driven_any": 1.8253040926521744, "sim_physics": 0.041253425532656166, "survival_time": 11.65000000000003, "driven_lanedir": 1.1712997383176302, "sim_render-ego": 0.062150422083973374, "in-drivable-lane": 3.6000000000000334, "agent_compute-ego": 0.07924821755405148, "deviation-heading": 2.2120101001651142, "set_robot_commands": 0.0927527278278007, "deviation-center-line": 0.8023300404337614, "driven_lanedir_consec": 1.1712997383176302, "sim_compute_sim_state": 0.03696693678270594, "sim_compute_performance-ego": 0.07098322876533214, "sim_compute_robot_state-ego": 0.06904280441513388, "sim_compute_robot_state-npc0": 0.06832879909629985, "sim_compute_robot_state-npc1": 0.06595459311816826, "sim_compute_robot_state-npc2": 0.0656325745480255, "sim_compute_robot_state-npc3": 0.06522458305686328}}
set_robot_commands_max	0.11013489611008588
set_robot_commands_mean	0.09724070691915544
set_robot_commands_median	0.0927527278278007
set_robot_commands_min	0.08984614743126763
sim_compute_performance-ego_max	0.07580343414755429
sim_compute_performance-ego_mean	0.07166639563355316
sim_compute_performance-ego_median	0.07098322876533214
sim_compute_performance-ego_min	0.0669403506649865
sim_compute_robot_state-ego_max	0.08477870857014376
sim_compute_robot_state-ego_mean	0.07252474922471285
sim_compute_robot_state-ego_median	0.06904280441513388
sim_compute_robot_state-ego_min	0.06515085155313666
sim_compute_robot_state-npc0_max	0.07357732711299773
sim_compute_robot_state-npc0_mean	0.07089871202846104
sim_compute_robot_state-npc0_median	0.07120587759547764
sim_compute_robot_state-npc0_min	0.06832879909629985
sim_compute_robot_state-npc1_max	0.07162096921135397
sim_compute_robot_state-npc1_mean	0.06748100900232132
sim_compute_robot_state-npc1_median	0.06698619657092625
sim_compute_robot_state-npc1_min	0.06145307150754062
sim_compute_robot_state-npc2_max	0.07156065751879995
sim_compute_robot_state-npc2_mean	0.06757947650618337
sim_compute_robot_state-npc2_median	0.06752741667959425
sim_compute_robot_state-npc2_min	0.06244034658778797
sim_compute_robot_state-npc3_max	0.0739496665842393
sim_compute_robot_state-npc3_mean	0.0687427530154856
sim_compute_robot_state-npc3_median	0.06777078575558132
sim_compute_robot_state-npc3_min	0.06522458305686328
sim_compute_sim_state_max	0.042232821969424975
sim_compute_sim_state_mean	0.03881680299816519
sim_compute_sim_state_median	0.03789235154787699
sim_compute_sim_state_min	0.03633805296637795
sim_physics_max	0.05653904466068044
sim_physics_mean	0.04621842009676662
sim_physics_median	0.04466418956281952
sim_physics_min	0.03982922705737027
sim_render-ego_max	0.07058180079740636
sim_render-ego_mean	0.06356657837428283
sim_render-ego_median	0.062150422083973374
sim_render-ego_min	0.05817197759946187
simulation-passed	1
survival_time_max	11.65000000000003
survival_time_mean	6.000000000000009
survival_time_min	1.7000000000000008

No reset possible

19825

2750

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 08:18:18+00:00

2019-04-25 08:20:10+00:00

0:01:52

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19775

2698

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 08:00:18+00:00

2019-04-25 08:18:03+00:00

0:17:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.502985479731668
survival_time_median	3.699999999999995
deviation-center-line_median	0.380356223432903
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.07923016945521037
agent_compute-ego_mean	0.07595346827666537
agent_compute-ego_median	0.07572676983964084
agent_compute-ego_min	0.07224778226903968
deviation-center-line_max	1.4995651005145367
deviation-center-line_mean	0.6596874891601018
deviation-center-line_min	0.08469223849141466
deviation-heading_max	4.476753375315642
deviation-heading_mean	1.891266901002552
deviation-heading_median	0.9632364497437982
deviation-heading_min	0.48270453305988537
driven_any_max	2.3555900293468506
driven_any_mean	1.1401604425744445
driven_any_median	0.5476055759773761
driven_any_min	0.20205401655657387
driven_lanedir_consec_max	2.2844840179440737
driven_lanedir_consec_mean	0.9305112401928404
driven_lanedir_consec_min	0.15447964879458542
driven_lanedir_max	2.290542122911593
driven_lanedir_mean	1.0050004773605692
driven_lanedir_median	0.502985479731668
driven_lanedir_min	0.15447964879458542
in-drivable-lane_max	1.6500000000000234
in-drivable-lane_mean	0.4100000000000046
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.353347319925085, "sim_physics": 0.03929014603296916, "survival_time": 14.950000000000076, "driven_lanedir": 2.290542122911593, "sim_render-ego": 0.0604302438100179, "in-drivable-lane": 0, "agent_compute-ego": 0.0749340303738912, "deviation-heading": 2.9144101493377543, "set_robot_commands": 0.09080188512802125, "deviation-center-line": 1.4995651005145367, "driven_lanedir_consec": 2.2844840179440737, "sim_compute_sim_state": 0.039151933193206784, "sim_compute_performance-ego": 0.06698151429494222, "sim_compute_robot_state-ego": 0.06900471607844035, "sim_compute_robot_state-npc0": 0.06751068512598674, "sim_compute_robot_state-npc1": 0.06730270783106486, "sim_compute_robot_state-npc2": 0.0685167400042216, "sim_compute_robot_state-npc3": 0.06821264346440634}, "udem1-1-0": {"driven_any": 0.24220527106633655, "sim_physics": 0.0430962774488661, "survival_time": 1.800000000000001, "driven_lanedir": 0.15447964879458542, "sim_render-ego": 0.06735496388541327, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.07923016945521037, "deviation-heading": 0.9632364497437982, "set_robot_commands": 0.09915592273076376, "deviation-center-line": 0.08469223849141466, "driven_lanedir_consec": 0.15447964879458542, "sim_compute_sim_state": 0.03932902548048231, "sim_compute_performance-ego": 0.06975126928753322, "sim_compute_robot_state-ego": 0.07459205389022827, "sim_compute_robot_state-npc0": 0.0683899654282464, "sim_compute_robot_state-npc1": 0.07073797782262166, "sim_compute_robot_state-npc2": 0.07096195883221096, "sim_compute_robot_state-npc3": 0.07084947162204319}, "udem1-2-0": {"driven_any": 0.5476055759773761, "sim_physics": 0.04711711406707764, "survival_time": 3.699999999999995, "driven_lanedir": 0.502985479731668, "sim_render-ego": 0.06232912798185606, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07224778226903968, "deviation-heading": 0.6192299975556795, "set_robot_commands": 0.0971530514794427, "deviation-center-line": 0.380356223432903, "driven_lanedir_consec": 0.502985479731668, "sim_compute_sim_state": 0.036323856663059546, "sim_compute_performance-ego": 0.06657183492505872, "sim_compute_robot_state-ego": 0.06679373496287577, "sim_compute_robot_state-npc0": 0.06275341639647612, "sim_compute_robot_state-npc1": 0.06496837654629269, "sim_compute_robot_state-npc2": 0.0650042488768294, "sim_compute_robot_state-npc3": 0.06653968063560692}, "udem1-3-0": {"driven_any": 0.20205401655657387, "sim_physics": 0.0463739518196352, "survival_time": 1.5500000000000007, "driven_lanedir": 0.17949643978172936, "sim_render-ego": 0.062302489434519125, "in-drivable-lane": 0, "agent_compute-ego": 0.07762858944554482, "deviation-heading": 0.48270453305988537, "set_robot_commands": 0.0926628343520626, "deviation-center-line": 0.1291530253786712, "driven_lanedir_consec": 0.17949643978172936, "sim_compute_sim_state": 0.03895981081070438, "sim_compute_performance-ego": 0.06235791790869928, "sim_compute_robot_state-ego": 0.07552542994099279, "sim_compute_robot_state-npc0": 0.06971606900615077, "sim_compute_robot_state-npc1": 0.06460663580125378, "sim_compute_robot_state-npc2": 0.06660278381839875, "sim_compute_robot_state-npc3": 0.07079016008684712}, "udem1-4-0": {"driven_any": 2.3555900293468506, "sim_physics": 0.04255266971014016, "survival_time": 14.950000000000076, "driven_lanedir": 1.8974986955832704, "sim_render-ego": 0.06175933394543702, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.07572676983964084, "deviation-heading": 4.476753375315642, "set_robot_commands": 0.0936104517716628, "deviation-center-line": 1.2046708579829837, "driven_lanedir_consec": 1.5311106147121465, "sim_compute_sim_state": 0.037292889528051265, "sim_compute_performance-ego": 0.06796233550361964, "sim_compute_robot_state-ego": 0.0700046314443633, "sim_compute_robot_state-npc0": 0.06717784269198925, "sim_compute_robot_state-npc1": 0.06500670503214451, "sim_compute_robot_state-npc2": 0.06635659036030339, "sim_compute_robot_state-npc3": 0.06700965393347086}}
set_robot_commands_max	0.09915592273076376
set_robot_commands_mean	0.0946768290923906
set_robot_commands_median	0.0936104517716628
set_robot_commands_min	0.09080188512802125
sim_compute_performance-ego_max	0.06975126928753322
sim_compute_performance-ego_mean	0.06672497438397061
sim_compute_performance-ego_median	0.06698151429494222
sim_compute_performance-ego_min	0.06235791790869928
sim_compute_robot_state-ego_max	0.07552542994099279
sim_compute_robot_state-ego_mean	0.0711841132633801
sim_compute_robot_state-ego_median	0.0700046314443633
sim_compute_robot_state-ego_min	0.06679373496287577
sim_compute_robot_state-npc0_max	0.06971606900615077
sim_compute_robot_state-npc0_mean	0.06710959572976985
sim_compute_robot_state-npc0_median	0.06751068512598674
sim_compute_robot_state-npc0_min	0.06275341639647612
sim_compute_robot_state-npc1_max	0.07073797782262166
sim_compute_robot_state-npc1_mean	0.0665244806066755
sim_compute_robot_state-npc1_median	0.06500670503214451
sim_compute_robot_state-npc1_min	0.06460663580125378
sim_compute_robot_state-npc2_max	0.07096195883221096
sim_compute_robot_state-npc2_mean	0.06748846437839282
sim_compute_robot_state-npc2_median	0.06660278381839875
sim_compute_robot_state-npc2_min	0.0650042488768294
sim_compute_robot_state-npc3_max	0.07084947162204319
sim_compute_robot_state-npc3_mean	0.06868032194847488
sim_compute_robot_state-npc3_median	0.06821264346440634
sim_compute_robot_state-npc3_min	0.06653968063560692
sim_compute_sim_state_max	0.03932902548048231
sim_compute_sim_state_mean	0.038211503135100855
sim_compute_sim_state_median	0.03895981081070438
sim_compute_sim_state_min	0.036323856663059546
sim_physics_max	0.04711711406707764
sim_physics_mean	0.04368603181573765
sim_physics_median	0.0430962774488661
sim_physics_min	0.03929014603296916
sim_render-ego_max	0.06735496388541327
sim_render-ego_mean	0.06283523181144868
sim_render-ego_median	0.062302489434519125
sim_render-ego_min	0.0604302438100179
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.390000000000031
survival_time_min	1.5500000000000007

No reset possible

19768

2636

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-25 07:54:07+00:00

2019-04-25 08:00:04+00:00

0:05:57

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19768-848159', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19768-848159', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19768-848159', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19752

3002

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 07:46:02+00:00

2019-04-25 07:53:35+00:00

0:07:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19724

3034

challenge-aido_LF-template-pytorch

step1-simulation

error