Evaluator 804

step1-simulation

host-error

2019-04-26 14:51:52+00:00

2019-04-26 15:00:05+00:00

0:08:13

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20694-761615', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20694-761615', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20694-761615', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20687

3091

Claudio Ruch

Java template from Webinar

aido2-AMOD-fleet_size

step2-scoring

success

yes

2019-04-26 13:41:05+00:00

2019-04-26 13:41:23+00:00

0:00:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

fleet_size

-1000000000

other stats

efficiency	-62.80661129604817
service_quality	-32.28352282401266

No reset possible

20676

3088

Claudio Ruch

Python template

aido2-AMOD-fleet_size

step1-simulation

host-error

yes

2019-04-26 12:39:48+00:00

2019-04-26 13:00:56+00:00

0:21:08

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20676-479794', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20676-479794', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20676-479794', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20665

3080

Andrea Censi 🇨🇭

Java template

aido2-AMOD-efficiency

step2-scoring

success

yes

2019-04-26 10:29:19+00:00

2019-04-26 10:32:05+00:00

0:02:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-62.46769702985202

other stats

fleet_size	-1000000000
service_quality	-32.124694257463595

No reset possible

20651

3075

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 10:02:08+00:00

2019-04-26 10:28:17+00:00

0:26:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6318268123582742
survival_time_median	10.90000000000002
deviation-center-line_median	0.535334259045396
in-drivable-lane_median	3.600000000000038

other stats

agent_compute-ego_max	0.24273980988396535
agent_compute-ego_mean	0.1950949434801888
agent_compute-ego_median	0.1994059451421102
agent_compute-ego_min	0.15998566309611004
deviation-center-line_max	0.6106327753200513
deviation-center-line_mean	0.5300621007894607
deviation-center-line_min	0.4265911055808853
deviation-heading_max	1.6572896225144285
deviation-heading_mean	1.390569726412972
deviation-heading_median	1.553845556243627
deviation-heading_min	1.0769455137308863
driven_any_max	1.3765220637299098
driven_any_mean	0.9543628621998004
driven_any_median	0.9932725692613242
driven_any_min	0.5078301169618679
driven_lanedir_consec_max	0.8157436063955408
driven_lanedir_consec_mean	0.6497790282054957
driven_lanedir_consec_min	0.4987776919144906
driven_lanedir_max	0.8157436063955408
driven_lanedir_mean	0.6497790282054957
driven_lanedir_median	0.6318268123582742
driven_lanedir_min	0.4987776919144906
in-drivable-lane_max	5.9500000000000846
in-drivable-lane_mean	3.0700000000000407
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9932725692613242, "sim_physics": 0.16045405777222518, "survival_time": 10.90000000000002, "driven_lanedir": 0.6318268123582742, "sim_render-ego": 0.058579791576490486, "in-drivable-lane": 3.600000000000038, "agent_compute-ego": 0.20592114356679653, "deviation-heading": 1.077334605351075, "set_robot_commands": 0.09280945948504526, "deviation-center-line": 0.535334259045396, "driven_lanedir_consec": 0.6318268123582742, "sim_compute_sim_state": 0.037238772855986146, "sim_compute_performance-ego": 0.06447904591166645, "sim_compute_robot_state-ego": 0.06994878698926453, "sim_compute_robot_state-npc0": 0.06675257267208275, "sim_compute_robot_state-npc1": 0.06758760640380579, "sim_compute_robot_state-npc2": 0.06621697298977353, "sim_compute_robot_state-npc3": 0.06709420571633436}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5192316224192188, "sim_physics": 0.17603006729712853, "survival_time": 5.849999999999987, "driven_lanedir": 0.4987776919144906, "sim_render-ego": 0.06653071264935355, "in-drivable-lane": 0, "agent_compute-ego": 0.24273980988396535, "deviation-heading": 1.6572896225144285, "set_robot_commands": 0.09917701207674466, "deviation-center-line": 0.4265911055808853, "driven_lanedir_consec": 0.4987776919144906, "sim_compute_sim_state": 0.04067270368592352, "sim_compute_performance-ego": 0.07262431862007858, "sim_compute_robot_state-ego": 0.07782857234661396, "sim_compute_robot_state-npc0": 0.07368399342920026, "sim_compute_robot_state-npc1": 0.07328521492134811, "sim_compute_robot_state-npc2": 0.0720992638514592, "sim_compute_robot_state-npc3": 0.07317217802390075}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3749579386266808, "sim_physics": 0.16296316862106322, "survival_time": 14.950000000000076, "driven_lanedir": 0.8157436063955408, "sim_render-ego": 0.05946813344955444, "in-drivable-lane": 5.800000000000082, "agent_compute-ego": 0.1994059451421102, "deviation-heading": 1.5874333342248423, "set_robot_commands": 0.09005646626154581, "deviation-center-line": 0.6106327753200513, "driven_lanedir_consec": 0.8157436063955408, "sim_compute_sim_state": 0.03673596938451131, "sim_compute_performance-ego": 0.06540968577067058, "sim_compute_robot_state-ego": 0.07071545044581096, "sim_compute_robot_state-npc0": 0.06724504470825195, "sim_compute_robot_state-npc1": 0.06549872001012166, "sim_compute_robot_state-npc2": 0.06461160182952881, "sim_compute_robot_state-npc3": 0.064853146870931}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3765220637299098, "sim_physics": 0.1307965071996053, "survival_time": 14.950000000000076, "driven_lanedir": 0.8035095596068245, "sim_render-ego": 0.04709683895111084, "in-drivable-lane": 5.9500000000000846, "agent_compute-ego": 0.15998566309611004, "deviation-heading": 1.553845556243627, "set_robot_commands": 0.06948979218800863, "deviation-center-line": 0.5979815004734461, "driven_lanedir_consec": 0.8035095596068245, "sim_compute_sim_state": 0.03011812607447306, "sim_compute_performance-ego": 0.05265493790308635, "sim_compute_robot_state-ego": 0.05498869975407918, "sim_compute_robot_state-npc0": 0.05452410300572713, "sim_compute_robot_state-npc1": 0.05556613206863403, "sim_compute_robot_state-npc2": 0.052727119127909346, "sim_compute_robot_state-npc3": 0.05276155471801758}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5078301169618679, "sim_physics": 0.11040582656860352, "survival_time": 5.749999999999988, "driven_lanedir": 0.4990374707523488, "sim_render-ego": 0.04771076285320779, "in-drivable-lane": 0, "agent_compute-ego": 0.16742215571196184, "deviation-heading": 1.0769455137308863, "set_robot_commands": 0.07457169242527174, "deviation-center-line": 0.479770863527525, "driven_lanedir_consec": 0.4990374707523488, "sim_compute_sim_state": 0.029407750005307404, "sim_compute_performance-ego": 0.052267476786737856, "sim_compute_robot_state-ego": 0.05508848273235819, "sim_compute_robot_state-npc0": 0.05562403305717137, "sim_compute_robot_state-npc1": 0.053915579422660495, "sim_compute_robot_state-npc2": 0.05358148657757303, "sim_compute_robot_state-npc3": 0.05181066264276919}}
set_robot_commands_max	0.09917701207674466
set_robot_commands_mean	0.08522088448732323
set_robot_commands_median	0.09005646626154581
set_robot_commands_min	0.06948979218800863
sim_compute_performance-ego_max	0.07262431862007858
sim_compute_performance-ego_mean	0.06148709299844797
sim_compute_performance-ego_median	0.06447904591166645
sim_compute_performance-ego_min	0.052267476786737856
sim_compute_robot_state-ego_max	0.07782857234661396
sim_compute_robot_state-ego_mean	0.06571399845362536
sim_compute_robot_state-ego_median	0.06994878698926453
sim_compute_robot_state-ego_min	0.05498869975407918
sim_compute_robot_state-npc0_max	0.07368399342920026
sim_compute_robot_state-npc0_mean	0.0635659493744867
sim_compute_robot_state-npc0_median	0.06675257267208275
sim_compute_robot_state-npc0_min	0.05452410300572713
sim_compute_robot_state-npc1_max	0.07328521492134811
sim_compute_robot_state-npc1_mean	0.06317065056531403
sim_compute_robot_state-npc1_median	0.06549872001012166
sim_compute_robot_state-npc1_min	0.053915579422660495
sim_compute_robot_state-npc2_max	0.0720992638514592
sim_compute_robot_state-npc2_mean	0.061847288875248776
sim_compute_robot_state-npc2_median	0.06461160182952881
sim_compute_robot_state-npc2_min	0.052727119127909346
sim_compute_robot_state-npc3_max	0.07317217802390075
sim_compute_robot_state-npc3_mean	0.06193834959439056
sim_compute_robot_state-npc3_median	0.064853146870931
sim_compute_robot_state-npc3_min	0.05181066264276919
sim_compute_sim_state_max	0.04067270368592352
sim_compute_sim_state_mean	0.03483466440124029
sim_compute_sim_state_median	0.03673596938451131
sim_compute_sim_state_min	0.029407750005307404
sim_physics_max	0.17603006729712853
sim_physics_mean	0.14812992549172516
sim_physics_median	0.16045405777222518
sim_physics_min	0.11040582656860352
sim_render-ego_max	0.06653071264935355
sim_render-ego_mean	0.055877247895943415
sim_render-ego_median	0.058579791576490486
sim_render-ego_min	0.04709683895111084
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.480000000000029
survival_time_min	5.749999999999988

No reset possible

20647

3064

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 17:00:26+00:00

2019-04-25 17:12:31+00:00

0:12:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6630877748979029
survival_time_median	12.750000000000046
deviation-center-line_median	0.5822332463739569
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1230407442365374
agent_compute-ego_mean	0.1220982649306498
agent_compute-ego_median	0.12233924786249796
agent_compute-ego_min	0.12117325235158204
deviation-center-line_max	0.9249435797594908
deviation-center-line_mean	0.6236141363184236
deviation-center-line_min	0.426424765465899
deviation-heading_max	3.759461756120242
deviation-heading_mean	2.303196999012237
deviation-heading_median	1.8232139456992056
deviation-heading_min	0.8502747617353257
driven_any_max	1.2015746301294352
driven_any_mean	0.7907164406678587
driven_any_median	0.9959736033100296
driven_any_min	0.27602310985282213
driven_lanedir_consec_max	1.1767952520842249
driven_lanedir_consec_mean	0.6772523759534536
driven_lanedir_consec_min	0.2691295605287416
driven_lanedir_max	1.1767952520842249
driven_lanedir_mean	0.6772523759534536
driven_lanedir_median	0.6630877748979029
driven_lanedir_min	0.2691295605287416
in-drivable-lane_max	3.2000000000000455
in-drivable-lane_mean	0.8700000000000123
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.020882655831234, "sim_physics": 0.05992079898715019, "survival_time": 12.800000000000049, "driven_lanedir": 0.6630877748979029, "sim_render-ego": 0.0355042377486825, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.12117325235158204, "deviation-heading": 3.759461756120242, "set_robot_commands": 0.05475017894059419, "deviation-center-line": 0.5822332463739569, "driven_lanedir_consec": 0.6630877748979029, "sim_compute_sim_state": 0.02355692069977522, "sim_compute_performance-ego": 0.03971874713897705, "sim_compute_robot_state-ego": 0.0404807198792696}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9959736033100296, "sim_physics": 0.05655931678472781, "survival_time": 12.750000000000046, "driven_lanedir": 0.8395434223601778, "sim_render-ego": 0.03964063794005151, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.12153600524453556, "deviation-heading": 3.2659474942091373, "set_robot_commands": 0.05586552900426528, "deviation-center-line": 0.9249435797594908, "driven_lanedir_consec": 0.8395434223601778, "sim_compute_sim_state": 0.022666085935106463, "sim_compute_performance-ego": 0.03806858343236587, "sim_compute_robot_state-ego": 0.040146461187624466}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.27602310985282213, "sim_physics": 0.04592225458714869, "survival_time": 3.8499999999999943, "driven_lanedir": 0.2691295605287416, "sim_render-ego": 0.034525248911473655, "in-drivable-lane": 0, "agent_compute-ego": 0.1230407442365374, "deviation-heading": 0.8502747617353257, "set_robot_commands": 0.05448403915801606, "deviation-center-line": 0.426424765465899, "driven_lanedir_consec": 0.2691295605287416, "sim_compute_sim_state": 0.022663518979951933, "sim_compute_performance-ego": 0.038434409475945806, "sim_compute_robot_state-ego": 0.0409230814351664}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45912820421577255, "sim_physics": 0.05773019189594173, "survival_time": 5.949999999999987, "driven_lanedir": 0.4377058698962206, "sim_render-ego": 0.035083157675606866, "in-drivable-lane": 0, "agent_compute-ego": 0.12240207495809605, "deviation-heading": 1.817087037297275, "set_robot_commands": 0.05454229306773979, "deviation-center-line": 0.4414992567500641, "driven_lanedir_consec": 0.4377058698962206, "sim_compute_sim_state": 0.022549258560693564, "sim_compute_performance-ego": 0.03793499249370158, "sim_compute_robot_state-ego": 0.041380116919509505}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2015746301294352, "sim_physics": 0.06231565713882446, "survival_time": 14.950000000000076, "driven_lanedir": 1.1767952520842249, "sim_render-ego": 0.035215243498484296, "in-drivable-lane": 0, "agent_compute-ego": 0.12233924786249796, "deviation-heading": 1.8232139456992056, "set_robot_commands": 0.05537455161412557, "deviation-center-line": 0.7429698332427067, "driven_lanedir_consec": 1.1767952520842249, "sim_compute_sim_state": 0.022664729754130045, "sim_compute_performance-ego": 0.03868120670318603, "sim_compute_robot_state-ego": 0.04025922695795695}}
set_robot_commands_max	0.05586552900426528
set_robot_commands_mean	0.05500331835694818
set_robot_commands_median	0.05475017894059419
set_robot_commands_min	0.05448403915801606
sim_compute_performance-ego_max	0.03971874713897705
sim_compute_performance-ego_mean	0.038567587848835266
sim_compute_performance-ego_median	0.038434409475945806
sim_compute_performance-ego_min	0.03793499249370158
sim_compute_robot_state-ego_max	0.041380116919509505
sim_compute_robot_state-ego_mean	0.04063792127590538
sim_compute_robot_state-ego_median	0.0404807198792696
sim_compute_robot_state-ego_min	0.040146461187624466
sim_compute_sim_state_max	0.02355692069977522
sim_compute_sim_state_mean	0.022820102785931447
sim_compute_sim_state_median	0.022664729754130045
sim_compute_sim_state_min	0.022549258560693564
sim_physics_max	0.06231565713882446
sim_physics_mean	0.05648964387875858
sim_physics_median	0.05773019189594173
sim_physics_min	0.04592225458714869
sim_render-ego_max	0.03964063794005151
sim_render-ego_mean	0.035993705154859765
sim_render-ego_median	0.035215243498484296
sim_render-ego_min	0.034525248911473655
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.06000000000003
survival_time_min	3.8499999999999943

No reset possible

20637

2383

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 15:10:48+00:00

2019-04-25 15:24:35+00:00

0:13:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.356145745538226
survival_time_median	10.300000000000011
deviation-center-line_median	0.21419568099885403
in-drivable-lane_median	5

other stats

agent_compute-ego_max	0.1582430068651835
agent_compute-ego_mean	0.13777303576097305
agent_compute-ego_median	0.12913069054109966
agent_compute-ego_min	0.12718040387607316
deviation-center-line_max	0.6801573361705155
deviation-center-line_mean	0.28282891439466284
deviation-center-line_min	0.08414373469983
deviation-heading_max	6.147484372355675
deviation-heading_mean	4.091504806194462
deviation-heading_median	4.096094649942027
deviation-heading_min	0.6780067606824705
driven_any_max	1.6444703797487137
driven_any_mean	1.1093519604093982
driven_any_median	1.1788966984603886
driven_any_min	0.09062975148709022
driven_lanedir_consec_max	0.5948662262316131
driven_lanedir_consec_mean	0.36203685025627375
driven_lanedir_consec_min	0.04485057050284435
driven_lanedir_max	0.5948662262316131
driven_lanedir_mean	0.36203685025627375
driven_lanedir_median	0.356145745538226
driven_lanedir_min	0.04485057050284435
in-drivable-lane_max	7.750000000000044
in-drivable-lane_mean	4.850000000000014
in-drivable-lane_min	0.10000000000000007
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.545035999138774, "sim_physics": 0.11643417437871297, "survival_time": 14.950000000000076, "driven_lanedir": 0.4621148849304922, "sim_render-ego": 0.05758346160252889, "in-drivable-lane": 7.750000000000044, "agent_compute-ego": 0.1582430068651835, "deviation-heading": 5.7341130656743795, "set_robot_commands": 0.08534011999766032, "deviation-center-line": 0.6801573361705155, "driven_lanedir_consec": 0.4621148849304922, "sim_compute_sim_state": 0.03703762213389079, "sim_compute_performance-ego": 0.06324795484542847, "sim_compute_robot_state-ego": 0.06869017918904623}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6444703797487137, "sim_physics": 0.09595385392506918, "survival_time": 14.950000000000076, "driven_lanedir": 0.5948662262316131, "sim_render-ego": 0.053608839511871335, "in-drivable-lane": 6.700000000000029, "agent_compute-ego": 0.14693174680074056, "deviation-heading": 6.147484372355675, "set_robot_commands": 0.080162193775177, "deviation-center-line": 0.29268229455344974, "driven_lanedir_consec": 0.5948662262316131, "sim_compute_sim_state": 0.034391980171203616, "sim_compute_performance-ego": 0.058969895839691165, "sim_compute_robot_state-ego": 0.06126821517944336}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09062975148709022, "sim_physics": 0.06584092703732577, "survival_time": 1.1000000000000003, "driven_lanedir": 0.04485057050284435, "sim_render-ego": 0.04696252129294656, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12737933072176846, "deviation-heading": 0.6780067606824705, "set_robot_commands": 0.07683312892913818, "deviation-center-line": 0.08414373469983, "driven_lanedir_consec": 0.04485057050284435, "sim_compute_sim_state": 0.030607624487443405, "sim_compute_performance-ego": 0.05006032640283758, "sim_compute_robot_state-ego": 0.04844952713359486}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1788966984603886, "sim_physics": 0.08330730790073432, "survival_time": 10.300000000000011, "driven_lanedir": 0.35220682407819304, "sim_render-ego": 0.04569875268102849, "in-drivable-lane": 5, "agent_compute-ego": 0.12718040387607316, "deviation-heading": 4.096094649942027, "set_robot_commands": 0.06897085615732138, "deviation-center-line": 0.21419568099885403, "driven_lanedir_consec": 0.35220682407819304, "sim_compute_sim_state": 0.02994876116224863, "sim_compute_performance-ego": 0.04887107738013406, "sim_compute_robot_state-ego": 0.050927496650843944}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0877269732120247, "sim_physics": 0.08462271858100316, "survival_time": 9.950000000000006, "driven_lanedir": 0.356145745538226, "sim_render-ego": 0.047682926283409845, "in-drivable-lane": 4.699999999999997, "agent_compute-ego": 0.12913069054109966, "deviation-heading": 3.8018251823177542, "set_robot_commands": 0.07270150687826339, "deviation-center-line": 0.14296552555066488, "driven_lanedir_consec": 0.356145745538226, "sim_compute_sim_state": 0.030226587650164886, "sim_compute_performance-ego": 0.05324387670162335, "sim_compute_robot_state-ego": 0.05196188322862788}}
set_robot_commands_max	0.08534011999766032
set_robot_commands_mean	0.07680156114751205
set_robot_commands_median	0.07683312892913818
set_robot_commands_min	0.06897085615732138
sim_compute_performance-ego_max	0.06324795484542847
sim_compute_performance-ego_mean	0.05487862623394293
sim_compute_performance-ego_median	0.05324387670162335
sim_compute_performance-ego_min	0.04887107738013406
sim_compute_robot_state-ego_max	0.06869017918904623
sim_compute_robot_state-ego_mean	0.056259460276311256
sim_compute_robot_state-ego_median	0.05196188322862788
sim_compute_robot_state-ego_min	0.04844952713359486
sim_compute_sim_state_max	0.03703762213389079
sim_compute_sim_state_mean	0.032442515120990265
sim_compute_sim_state_median	0.030607624487443405
sim_compute_sim_state_min	0.02994876116224863
sim_physics_max	0.11643417437871297
sim_physics_mean	0.08923179636456909
sim_physics_median	0.08462271858100316
sim_physics_min	0.06584092703732577
sim_render-ego_max	0.05758346160252889
sim_render-ego_mean	0.05030730027435702
sim_render-ego_median	0.047682926283409845
sim_render-ego_min	0.04569875268102849
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.250000000000034
survival_time_min	1.1000000000000003

No reset possible

20622

2365

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 15:00:23+00:00

2019-04-25 15:10:42+00:00

0:10:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.19938252522395208
agent_compute-ego_mean	0.16489804897973892
agent_compute-ego_median	0.16793913276571976
agent_compute-ego_min	0.12837216220324552
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.25600457191467285, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.08690797607853727, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1973847398218119, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.14297505594649404, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.0527672677669885, "sim_compute_performance-ego": 0.10241327195797328, "sim_compute_robot_state-ego": 0.11004178928879071, "sim_compute_robot_state-npc0": 0.10139923725488052, "sim_compute_robot_state-npc1": 0.09735178497602356, "sim_compute_robot_state-npc2": 0.0970027986562477, "sim_compute_robot_state-npc3": 0.09565560772733868}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.2594736172602727, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.09088716140160194, "in-drivable-lane": 0, "agent_compute-ego": 0.19938252522395208, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.13890341612008902, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.05495979235722469, "sim_compute_performance-ego": 0.0915384292602539, "sim_compute_robot_state-ego": 0.13163249309246355, "sim_compute_robot_state-npc0": 0.09932869214278, "sim_compute_robot_state-npc1": 0.1020118364920983, "sim_compute_robot_state-npc2": 0.09545197853675257, "sim_compute_robot_state-npc3": 0.095512894483713}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.2222981892134014, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.07857647067622135, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.16793913276571976, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.1182624289863988, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.051117975460855586, "sim_compute_performance-ego": 0.08804286781110261, "sim_compute_robot_state-ego": 0.09836925958332264, "sim_compute_robot_state-npc0": 0.08241532350841321, "sim_compute_robot_state-npc1": 0.08323968084234941, "sim_compute_robot_state-npc2": 0.08448918869620875, "sim_compute_robot_state-npc3": 0.0863938896279586}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.14493274085129362, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.060243181035488466, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.12837216220324552, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.09221385702302184, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03755540485623517, "sim_compute_performance-ego": 0.0672934326944472, "sim_compute_robot_state-ego": 0.07265966451620753, "sim_compute_robot_state-npc0": 0.06799475754363628, "sim_compute_robot_state-npc1": 0.06774695311920552, "sim_compute_robot_state-npc2": 0.06562155107908611, "sim_compute_robot_state-npc3": 0.06698842591877226}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.1425379823755335, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06454727384779188, "in-drivable-lane": 0, "agent_compute-ego": 0.13141168488396535, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.08802406876175492, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.03650057757342303, "sim_compute_performance-ego": 0.06920683825457538, "sim_compute_robot_state-ego": 0.07769105169508192, "sim_compute_robot_state-npc0": 0.06524669682538067, "sim_compute_robot_state-npc1": 0.06573363586708351, "sim_compute_robot_state-npc2": 0.06483911584924769, "sim_compute_robot_state-npc3": 0.06321475240919325}}
set_robot_commands_max	0.14297505594649404
set_robot_commands_mean	0.11607576536755174
set_robot_commands_median	0.1182624289863988
set_robot_commands_min	0.08802406876175492
sim_compute_performance-ego_max	0.10241327195797328
sim_compute_performance-ego_mean	0.08369896799567048
sim_compute_performance-ego_median	0.08804286781110261
sim_compute_performance-ego_min	0.0672934326944472
sim_compute_robot_state-ego_max	0.13163249309246355
sim_compute_robot_state-ego_mean	0.09807885163517328
sim_compute_robot_state-ego_median	0.09836925958332264
sim_compute_robot_state-ego_min	0.07265966451620753
sim_compute_robot_state-npc0_max	0.10139923725488052
sim_compute_robot_state-npc0_mean	0.08327694145501814
sim_compute_robot_state-npc0_median	0.08241532350841321
sim_compute_robot_state-npc0_min	0.06524669682538067
sim_compute_robot_state-npc1_max	0.1020118364920983
sim_compute_robot_state-npc1_mean	0.08321677825935206
sim_compute_robot_state-npc1_median	0.08323968084234941
sim_compute_robot_state-npc1_min	0.06573363586708351
sim_compute_robot_state-npc2_max	0.0970027986562477
sim_compute_robot_state-npc2_mean	0.08148092656350855
sim_compute_robot_state-npc2_median	0.08448918869620875
sim_compute_robot_state-npc2_min	0.06483911584924769
sim_compute_robot_state-npc3_max	0.09565560772733868
sim_compute_robot_state-npc3_mean	0.08155311403339516
sim_compute_robot_state-npc3_median	0.0863938896279586
sim_compute_robot_state-npc3_min	0.06321475240919325
sim_compute_sim_state_max	0.05495979235722469
sim_compute_sim_state_mean	0.04658020360294539
sim_compute_sim_state_median	0.051117975460855586
sim_compute_sim_state_min	0.03650057757342303
sim_physics_max	0.2594736172602727
sim_physics_mean	0.2050494203230348
sim_physics_median	0.2222981892134014
sim_physics_min	0.1425379823755335
sim_render-ego_max	0.09088716140160194
sim_render-ego_mean	0.0762324126079282
sim_render-ego_median	0.07857647067622135
sim_render-ego_min	0.060243181035488466
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20583

2411

jiang peng

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 14:31:47+00:00

2019-04-25 15:00:04+00:00

0:28:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20583-812531', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20583-812531', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20583-812531', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20572

2421

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 14:22:53+00:00

2019-04-25 14:31:00+00:00

0:08:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.14302824161670827
agent_compute-ego_mean	0.1338320353059013
agent_compute-ego_median	0.13234757471688186
agent_compute-ego_min	0.12671272691927457
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.1354845109975563, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.05904618299232339, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.12970346774695057, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.0878914347234762, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03591881158216944, "sim_compute_performance-ego": 0.06725082307491663, "sim_compute_robot_state-ego": 0.07268767086964734, "sim_compute_robot_state-npc0": 0.06358555127989571, "sim_compute_robot_state-npc1": 0.06260845796117243, "sim_compute_robot_state-npc2": 0.06320036582227023, "sim_compute_robot_state-npc3": 0.06047153922746766}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.14388834513150728, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.06202385058769813, "in-drivable-lane": 0, "agent_compute-ego": 0.13736816552969125, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.09847843647003174, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.03808899109180157, "sim_compute_performance-ego": 0.07001201006082389, "sim_compute_robot_state-ego": 0.06994893917670617, "sim_compute_robot_state-npc0": 0.06757639004633977, "sim_compute_robot_state-npc1": 0.06409351642315204, "sim_compute_robot_state-npc2": 0.07130737488086407, "sim_compute_robot_state-npc3": 0.06910947652963492}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.1432247099123503, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.06035443042453967, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.12671272691927457, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.08866712294126812, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.03753999659889623, "sim_compute_performance-ego": 0.0676612006990533, "sim_compute_robot_state-ego": 0.07145057540190847, "sim_compute_robot_state-npc0": 0.0651078412407323, "sim_compute_robot_state-npc1": 0.06601286248156898, "sim_compute_robot_state-npc2": 0.0646223457236039, "sim_compute_robot_state-npc3": 0.0651088702051263}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.15343010576465463, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.060327698912801625, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.13234757471688186, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.09214142002636871, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03822789312917975, "sim_compute_performance-ego": 0.06742713421205931, "sim_compute_robot_state-ego": 0.07167830950097193, "sim_compute_robot_state-npc0": 0.06872225713126268, "sim_compute_robot_state-npc1": 0.06676302982282036, "sim_compute_robot_state-npc2": 0.06567447396773327, "sim_compute_robot_state-npc3": 0.06744447539124308}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.15985566598397713, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06192225880093045, "in-drivable-lane": 0, "agent_compute-ego": 0.14302824161670827, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.11034035682678224, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.0404025360389992, "sim_compute_performance-ego": 0.07716313114872685, "sim_compute_robot_state-ego": 0.08298948076036242, "sim_compute_robot_state-npc0": 0.07494542333814833, "sim_compute_robot_state-npc1": 0.06938768316198278, "sim_compute_robot_state-npc2": 0.07372592996667933, "sim_compute_robot_state-npc3": 0.07142449308324743}}
set_robot_commands_max	0.11034035682678224
set_robot_commands_mean	0.0955037541975854
set_robot_commands_median	0.09214142002636871
set_robot_commands_min	0.0878914347234762
sim_compute_performance-ego_max	0.07716313114872685
sim_compute_performance-ego_mean	0.069902859839116
sim_compute_performance-ego_median	0.0676612006990533
sim_compute_performance-ego_min	0.06725082307491663
sim_compute_robot_state-ego_max	0.08298948076036242
sim_compute_robot_state-ego_mean	0.07375099514191925
sim_compute_robot_state-ego_median	0.07167830950097193
sim_compute_robot_state-ego_min	0.06994893917670617
sim_compute_robot_state-npc0_max	0.07494542333814833
sim_compute_robot_state-npc0_mean	0.06798749260727577
sim_compute_robot_state-npc0_median	0.06757639004633977
sim_compute_robot_state-npc0_min	0.06358555127989571
sim_compute_robot_state-npc1_max	0.06938768316198278
sim_compute_robot_state-npc1_mean	0.06577310997013933
sim_compute_robot_state-npc1_median	0.06601286248156898
sim_compute_robot_state-npc1_min	0.06260845796117243
sim_compute_robot_state-npc2_max	0.07372592996667933
sim_compute_robot_state-npc2_mean	0.06770609807223016
sim_compute_robot_state-npc2_median	0.06567447396773327
sim_compute_robot_state-npc2_min	0.06320036582227023
sim_compute_robot_state-npc3_max	0.07142449308324743
sim_compute_robot_state-npc3_mean	0.06671177088734388
sim_compute_robot_state-npc3_median	0.06744447539124308
sim_compute_robot_state-npc3_min	0.06047153922746766
sim_compute_sim_state_max	0.0404025360389992
sim_compute_sim_state_mean	0.03803564568820923
sim_compute_sim_state_median	0.03808899109180157
sim_compute_sim_state_min	0.03591881158216944
sim_physics_max	0.15985566598397713
sim_physics_mean	0.14717666755800912
sim_physics_median	0.14388834513150728
sim_physics_min	0.1354845109975563
sim_render-ego_max	0.06202385058769813
sim_render-ego_mean	0.06073488434365866
sim_render-ego_median	0.06035443042453967
sim_render-ego_min	0.05904618299232339
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20570

2432

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 14:21:58+00:00

2019-04-25 14:22:26+00:00

0:00:28

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20562

2443

Jacopo Tani

random_agent

step1-simulation

success

2019-04-25 14:13:39+00:00

2019-04-25 14:21:50+00:00

0:08:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1462684122182555
agent_compute-ego_mean	0.12917684769772755
agent_compute-ego_median	0.1377172966798147
agent_compute-ego_min	0.10152252912521362
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1624996099831923, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.06082158943392195, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.14202600380159774, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.08985512436560865, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03922179510008614, "sim_compute_performance-ego": 0.06561198774373757, "sim_compute_robot_state-ego": 0.06995096071711127, "sim_compute_robot_state-npc0": 0.06671329939140463, "sim_compute_robot_state-npc1": 0.06766282162576351, "sim_compute_robot_state-npc2": 0.06894109159145716, "sim_compute_robot_state-npc3": 0.06876582694503497}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.13959763447443643, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.0590600868066152, "in-drivable-lane": 0, "agent_compute-ego": 0.1377172966798147, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.07852577169736226, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.030717790126800537, "sim_compute_performance-ego": 0.06335130333900452, "sim_compute_robot_state-ego": 0.0656325916449229, "sim_compute_robot_state-npc0": 0.06293989221254985, "sim_compute_robot_state-npc1": 0.061905354261398315, "sim_compute_robot_state-npc2": 0.063374529282252, "sim_compute_robot_state-npc3": 0.06552269061406453}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.1711480657933122, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06107653601694915, "in-drivable-lane": 0, "agent_compute-ego": 0.1462684122182555, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.0851170208494542, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.04059050850949045, "sim_compute_performance-ego": 0.06727906404915503, "sim_compute_robot_state-ego": 0.07259160785351769, "sim_compute_robot_state-npc0": 0.06929006414898371, "sim_compute_robot_state-npc1": 0.06749824750221382, "sim_compute_robot_state-npc2": 0.06690394272238522, "sim_compute_robot_state-npc3": 0.06579949088015799}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.1311725438651392, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.04630431886446678, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.11834999666375629, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.07471200975321107, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.030077590780743096, "sim_compute_performance-ego": 0.049466795840505826, "sim_compute_robot_state-ego": 0.052333548917608746, "sim_compute_robot_state-npc0": 0.05637187068745241, "sim_compute_robot_state-npc1": 0.05903749950861527, "sim_compute_robot_state-npc2": 0.05127982365883003, "sim_compute_robot_state-npc3": 0.05247210648100255}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.08454179763793945, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.03652609586715698, "in-drivable-lane": 0, "agent_compute-ego": 0.10152252912521362, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.06203633546829224, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03332476615905762, "sim_compute_performance-ego": 0.04018446207046509, "sim_compute_robot_state-ego": 0.042392075061798096, "sim_compute_robot_state-npc0": 0.045405912399291995, "sim_compute_robot_state-npc1": 0.044413840770721434, "sim_compute_robot_state-npc2": 0.04243474006652832, "sim_compute_robot_state-npc3": 0.041447579860687256}}
set_robot_commands_max	0.08985512436560865
set_robot_commands_mean	0.07804925242678569
set_robot_commands_median	0.07852577169736226
set_robot_commands_min	0.06203633546829224
sim_compute_performance-ego_max	0.06727906404915503
sim_compute_performance-ego_mean	0.05717872260857361
sim_compute_performance-ego_median	0.06335130333900452
sim_compute_performance-ego_min	0.04018446207046509
sim_compute_robot_state-ego_max	0.07259160785351769
sim_compute_robot_state-ego_mean	0.06058015683899174
sim_compute_robot_state-ego_median	0.0656325916449229
sim_compute_robot_state-ego_min	0.042392075061798096
sim_compute_robot_state-npc0_max	0.06929006414898371
sim_compute_robot_state-npc0_mean	0.06014420776793652
sim_compute_robot_state-npc0_median	0.06293989221254985
sim_compute_robot_state-npc0_min	0.045405912399291995
sim_compute_robot_state-npc1_max	0.06766282162576351
sim_compute_robot_state-npc1_mean	0.06010355273374246
sim_compute_robot_state-npc1_median	0.061905354261398315
sim_compute_robot_state-npc1_min	0.044413840770721434
sim_compute_robot_state-npc2_max	0.06894109159145716
sim_compute_robot_state-npc2_mean	0.058586825464290546
sim_compute_robot_state-npc2_median	0.063374529282252
sim_compute_robot_state-npc2_min	0.04243474006652832
sim_compute_robot_state-npc3_max	0.06876582694503497
sim_compute_robot_state-npc3_mean	0.05880153895618946
sim_compute_robot_state-npc3_median	0.06552269061406453
sim_compute_robot_state-npc3_min	0.041447579860687256
sim_compute_sim_state_max	0.04059050850949045
sim_compute_sim_state_mean	0.03478649013523557
sim_compute_sim_state_median	0.03332476615905762
sim_compute_sim_state_min	0.030077590780743096
sim_physics_max	0.1711480657933122
sim_physics_mean	0.13779193035080392
sim_physics_median	0.13959763447443643
sim_physics_min	0.08454179763793945
sim_render-ego_max	0.06107653601694915
sim_render-ego_mean	0.05275772539782202
sim_render-ego_median	0.0590600868066152
sim_render-ego_min	0.03652609586715698
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20541

2475

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 14:04:50+00:00

2019-04-25 14:12:56+00:00

0:08:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15589571403244795
agent_compute-ego_mean	0.12956958217898382
agent_compute-ego_median	0.12315608263015748
agent_compute-ego_min	0.10365736484527588
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.16411905918481215, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.06230130060663763, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.1421722376121665, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.08378416187358352, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03648236337697731, "sim_compute_performance-ego": 0.0610271062491075, "sim_compute_robot_state-ego": 0.06652922000525133, "sim_compute_robot_state-npc0": 0.06428490944628446, "sim_compute_robot_state-npc1": 0.06395917343643476, "sim_compute_robot_state-npc2": 0.06295212484755607, "sim_compute_robot_state-npc3": 0.06174371377477106}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.11953511834144592, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.04332973559697469, "in-drivable-lane": 0, "agent_compute-ego": 0.10365736484527588, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.06623209516207378, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.0282209316889445, "sim_compute_performance-ego": 0.047989328702290855, "sim_compute_robot_state-ego": 0.047757754723230995, "sim_compute_robot_state-npc0": 0.04779883225758871, "sim_compute_robot_state-npc1": 0.04632830619812012, "sim_compute_robot_state-npc2": 0.06493674715360005, "sim_compute_robot_state-npc3": 0.05508465568224589}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.12233372866097145, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.05004934537208686, "in-drivable-lane": 0, "agent_compute-ego": 0.1229665117748713, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.07590846288002144, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.032415123309119276, "sim_compute_performance-ego": 0.05228576417696678, "sim_compute_robot_state-ego": 0.05286102375741732, "sim_compute_robot_state-npc0": 0.05533334764383607, "sim_compute_robot_state-npc1": 0.06619541523820263, "sim_compute_robot_state-npc2": 0.05459828295950162, "sim_compute_robot_state-npc3": 0.054877345844850704}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.192821377414768, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05735026779821364, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15589571403244795, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.08963768765077752, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.03665245185464115, "sim_compute_performance-ego": 0.06487845970412433, "sim_compute_robot_state-ego": 0.06731800305641304, "sim_compute_robot_state-npc0": 0.0662436646930242, "sim_compute_robot_state-npc1": 0.06592032464884096, "sim_compute_robot_state-npc2": 0.07653716055013365, "sim_compute_robot_state-npc3": 0.06507628246889276}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.11115007400512696, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.0506820559501648, "in-drivable-lane": 0, "agent_compute-ego": 0.12315608263015748, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.0787355899810791, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03122859001159668, "sim_compute_performance-ego": 0.06866601705551148, "sim_compute_robot_state-ego": 0.08988897800445557, "sim_compute_robot_state-npc0": 0.05893861055374146, "sim_compute_robot_state-npc1": 0.05421634912490845, "sim_compute_robot_state-npc2": 0.0557442307472229, "sim_compute_robot_state-npc3": 0.056236648559570314}}
set_robot_commands_max	0.08963768765077752
set_robot_commands_mean	0.07885959950950708
set_robot_commands_median	0.0787355899810791
set_robot_commands_min	0.06623209516207378
sim_compute_performance-ego_max	0.06866601705551148
sim_compute_performance-ego_mean	0.05896933517760019
sim_compute_performance-ego_median	0.0610271062491075
sim_compute_performance-ego_min	0.047989328702290855
sim_compute_robot_state-ego_max	0.08988897800445557
sim_compute_robot_state-ego_mean	0.06487099590935365
sim_compute_robot_state-ego_median	0.06652922000525133
sim_compute_robot_state-ego_min	0.047757754723230995
sim_compute_robot_state-npc0_max	0.0662436646930242
sim_compute_robot_state-npc0_mean	0.058519872918894975
sim_compute_robot_state-npc0_median	0.05893861055374146
sim_compute_robot_state-npc0_min	0.04779883225758871
sim_compute_robot_state-npc1_max	0.06619541523820263
sim_compute_robot_state-npc1_mean	0.05932391372930138
sim_compute_robot_state-npc1_median	0.06395917343643476
sim_compute_robot_state-npc1_min	0.04632830619812012
sim_compute_robot_state-npc2_max	0.07653716055013365
sim_compute_robot_state-npc2_mean	0.06295370925160286
sim_compute_robot_state-npc2_median	0.06295212484755607
sim_compute_robot_state-npc2_min	0.05459828295950162
sim_compute_robot_state-npc3_max	0.06507628246889276
sim_compute_robot_state-npc3_mean	0.05860372926606615
sim_compute_robot_state-npc3_median	0.056236648559570314
sim_compute_robot_state-npc3_min	0.054877345844850704
sim_compute_sim_state_max	0.03665245185464115
sim_compute_sim_state_mean	0.03299989204825578
sim_compute_sim_state_median	0.032415123309119276
sim_compute_sim_state_min	0.0282209316889445
sim_physics_max	0.192821377414768
sim_physics_mean	0.14199187152142492
sim_physics_median	0.12233372866097145
sim_physics_min	0.11115007400512696
sim_render-ego_max	0.06230130060663763
sim_render-ego_mean	0.05274254106481553
sim_render-ego_median	0.0506820559501648
sim_render-ego_min	0.04332973559697469
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20538

2480

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 14:04:13+00:00

2019-04-25 14:04:42+00:00

0:00:29

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20537

2484

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 14:03:19+00:00

2019-04-25 14:03:59+00:00

0:00:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20532

2487

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 14:02:00+00:00

2019-04-25 14:02:44+00:00

0:00:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20524

2509

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:01:11+00:00

2019-04-25 14:01:52+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20513

2504

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:00:11+00:00

2019-04-25 14:00:57+00:00

0:00:46

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20511

2508

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

host-error

2019-04-25 13:59:48+00:00

2019-04-25 14:00:04+00:00

0:00:16

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2508/step1-simulation-ip-172-31-42-167-7227-job20511/logs/challenges-runner/stderr.html']' returned non-zero exit status 1.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20505

2513

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 13:58:50+00:00

2019-04-25 13:59:35+00:00

0:00:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20497

2532

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-25 13:56:18+00:00

2019-04-25 13:58:43+00:00

0:02:25

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20484

2551

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:49:34+00:00

2019-04-25 13:55:37+00:00

0:06:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.051579379118405856
agent_compute-ego_mean	0.049956281465968554
agent_compute-ego_median	0.05085471272468567
agent_compute-ego_min	0.04546061234596448
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.09002477871744256, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.04908508062362671, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.05155660290467112, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.07255027796092786, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.029902847189652297, "sim_compute_performance-ego": 0.05016399057287919, "sim_compute_robot_state-ego": 0.05089631833528217, "sim_compute_robot_state-npc0": 0.05529371060823139, "sim_compute_robot_state-npc1": 0.05175785328212537, "sim_compute_robot_state-npc2": 0.051559159630223325, "sim_compute_robot_state-npc3": 0.052844257731186714}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.1017882153391838, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.04446045309305191, "in-drivable-lane": 0, "agent_compute-ego": 0.05085471272468567, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.06582113355398178, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.02771424502134323, "sim_compute_performance-ego": 0.05086110532283783, "sim_compute_robot_state-ego": 0.0511288046836853, "sim_compute_robot_state-npc0": 0.05075656622648239, "sim_compute_robot_state-npc1": 0.04868654906749725, "sim_compute_robot_state-npc2": 0.05142570286989212, "sim_compute_robot_state-npc3": 0.049918316304683685}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.11049474202669585, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.04347642568441538, "in-drivable-lane": 0, "agent_compute-ego": 0.051579379118405856, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.06843233108520508, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.026730230221381553, "sim_compute_performance-ego": 0.047856385891254134, "sim_compute_robot_state-ego": 0.05058497648972731, "sim_compute_robot_state-npc0": 0.04852150495235737, "sim_compute_robot_state-npc1": 0.04979102886640109, "sim_compute_robot_state-npc2": 0.04902962996409489, "sim_compute_robot_state-npc3": 0.047706892857184775}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.08283472061157227, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.04030080942007211, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.04546061234596448, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.062259603769351274, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.025478622852227628, "sim_compute_performance-ego": 0.04418727984795204, "sim_compute_robot_state-ego": 0.047409650606986806, "sim_compute_robot_state-npc0": 0.046508422264686, "sim_compute_robot_state-npc1": 0.04480178539569561, "sim_compute_robot_state-npc2": 0.04635072060120411, "sim_compute_robot_state-npc3": 0.04528331450926952}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.08482986026340061, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.06555274680808738, "in-drivable-lane": 0, "agent_compute-ego": 0.05033010023611563, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.061165438758002386, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.0295341103165238, "sim_compute_performance-ego": 0.04248328562136049, "sim_compute_robot_state-ego": 0.04753657623573586, "sim_compute_robot_state-npc0": 0.05725683106316461, "sim_compute_robot_state-npc1": 0.042936351564195424, "sim_compute_robot_state-npc2": 0.042433350174515334, "sim_compute_robot_state-npc3": 0.13120234454119648}}
set_robot_commands_max	0.07255027796092786
set_robot_commands_mean	0.06604575702549367
set_robot_commands_median	0.06582113355398178
set_robot_commands_min	0.061165438758002386
sim_compute_performance-ego_max	0.05086110532283783
sim_compute_performance-ego_mean	0.04711040945125673
sim_compute_performance-ego_median	0.047856385891254134
sim_compute_performance-ego_min	0.04248328562136049
sim_compute_robot_state-ego_max	0.0511288046836853
sim_compute_robot_state-ego_mean	0.04951126527028349
sim_compute_robot_state-ego_median	0.05058497648972731
sim_compute_robot_state-ego_min	0.047409650606986806
sim_compute_robot_state-npc0_max	0.05725683106316461
sim_compute_robot_state-npc0_mean	0.05166740702298435
sim_compute_robot_state-npc0_median	0.05075656622648239
sim_compute_robot_state-npc0_min	0.046508422264686
sim_compute_robot_state-npc1_max	0.05175785328212537
sim_compute_robot_state-npc1_mean	0.047594713635182945
sim_compute_robot_state-npc1_median	0.04868654906749725
sim_compute_robot_state-npc1_min	0.042936351564195424
sim_compute_robot_state-npc2_max	0.051559159630223325
sim_compute_robot_state-npc2_mean	0.04815971264798595
sim_compute_robot_state-npc2_median	0.04902962996409489
sim_compute_robot_state-npc2_min	0.042433350174515334
sim_compute_robot_state-npc3_max	0.13120234454119648
sim_compute_robot_state-npc3_mean	0.06539102518870424
sim_compute_robot_state-npc3_median	0.049918316304683685
sim_compute_robot_state-npc3_min	0.04528331450926952
sim_compute_sim_state_max	0.029902847189652297
sim_compute_sim_state_mean	0.027872011120225703
sim_compute_sim_state_median	0.02771424502134323
sim_compute_sim_state_min	0.025478622852227628
sim_physics_max	0.11049474202669585
sim_physics_mean	0.09399446339165902
sim_physics_median	0.09002477871744256
sim_physics_min	0.08283472061157227
sim_render-ego_max	0.06555274680808738
sim_render-ego_mean	0.04857510312585069
sim_render-ego_median	0.04446045309305191
sim_render-ego_min	0.04030080942007211
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20475

2568

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:39:15+00:00

2019-04-25 13:49:02+00:00

0:09:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.05413963425327355
agent_compute-ego_mean	0.05174990852729198
agent_compute-ego_median	0.05307203488992461
agent_compute-ego_min	0.04509361328617219
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.1177326576276259, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.04799872636795044, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.05393943461504849, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.07256825403733687, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.030935027382590553, "sim_compute_performance-ego": 0.0514671341939406, "sim_compute_robot_state-ego": 0.05239608883857727, "sim_compute_robot_state-npc0": 0.052584257992831146, "sim_compute_robot_state-npc1": 0.0523131787776947, "sim_compute_robot_state-npc2": 0.05415918610312722, "sim_compute_robot_state-npc3": 0.05480536005713723}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.10477408286063902, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.03801841889658282, "in-drivable-lane": 0, "agent_compute-ego": 0.04509361328617219, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.05749859348420174, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.023136208134312785, "sim_compute_performance-ego": 0.0400557441096152, "sim_compute_robot_state-ego": 0.04247876136533676, "sim_compute_robot_state-npc0": 0.04242462496603689, "sim_compute_robot_state-npc1": 0.0413577018245574, "sim_compute_robot_state-npc2": 0.04132315420335339, "sim_compute_robot_state-npc3": 0.041160375841202274}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.12556330193864537, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.04685669418767834, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.05307203488992461, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.07134206582468453, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.029348420758619376, "sim_compute_performance-ego": 0.05206078840485701, "sim_compute_robot_state-ego": 0.052402075300825406, "sim_compute_robot_state-npc0": 0.05624607606982508, "sim_compute_robot_state-npc1": 0.053691691540657206, "sim_compute_robot_state-npc2": 0.053321990560978014, "sim_compute_robot_state-npc3": 0.05185707917450168}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.12732169000725996, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.04676233592786287, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.05250482559204102, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.0715308942292866, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.029383676930477744, "sim_compute_performance-ego": 0.050781071813482986, "sim_compute_robot_state-ego": 0.053116519827591746, "sim_compute_robot_state-npc0": 0.054293471888491984, "sim_compute_robot_state-npc1": 0.05349811001827842, "sim_compute_robot_state-npc2": 0.052902116273578846, "sim_compute_robot_state-npc3": 0.05140067401685213}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.13504397869110107, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.04655354123719981, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.05413963425327355, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.07438510572406608, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.02950340089663653, "sim_compute_performance-ego": 0.04952564877523503, "sim_compute_robot_state-ego": 0.05243794682999732, "sim_compute_robot_state-npc0": 0.052107627962676574, "sim_compute_robot_state-npc1": 0.05172969253969864, "sim_compute_robot_state-npc2": 0.051612662597441336, "sim_compute_robot_state-npc3": 0.051888459165331344}}
set_robot_commands_max	0.07438510572406608
set_robot_commands_mean	0.06946498265991516
set_robot_commands_median	0.0715308942292866
set_robot_commands_min	0.05749859348420174
sim_compute_performance-ego_max	0.05206078840485701
sim_compute_performance-ego_mean	0.04877807745942616
sim_compute_performance-ego_median	0.050781071813482986
sim_compute_performance-ego_min	0.0400557441096152
sim_compute_robot_state-ego_max	0.053116519827591746
sim_compute_robot_state-ego_mean	0.05056627843246571
sim_compute_robot_state-ego_median	0.052402075300825406
sim_compute_robot_state-ego_min	0.04247876136533676
sim_compute_robot_state-npc0_max	0.05624607606982508
sim_compute_robot_state-npc0_mean	0.05153121177597234
sim_compute_robot_state-npc0_median	0.052584257992831146
sim_compute_robot_state-npc0_min	0.04242462496603689
sim_compute_robot_state-npc1_max	0.053691691540657206
sim_compute_robot_state-npc1_mean	0.05051807494017727
sim_compute_robot_state-npc1_median	0.0523131787776947
sim_compute_robot_state-npc1_min	0.0413577018245574
sim_compute_robot_state-npc2_max	0.05415918610312722
sim_compute_robot_state-npc2_mean	0.05066382194769577
sim_compute_robot_state-npc2_median	0.052902116273578846
sim_compute_robot_state-npc2_min	0.04132315420335339
sim_compute_robot_state-npc3_max	0.05480536005713723
sim_compute_robot_state-npc3_mean	0.05022238965100493
sim_compute_robot_state-npc3_median	0.05185707917450168
sim_compute_robot_state-npc3_min	0.041160375841202274
sim_compute_sim_state_max	0.030935027382590553
sim_compute_sim_state_mean	0.0284613468205274
sim_compute_sim_state_median	0.029383676930477744
sim_compute_sim_state_min	0.023136208134312785
sim_physics_max	0.13504397869110107
sim_physics_mean	0.12208714222505428
sim_physics_median	0.12556330193864537
sim_physics_min	0.10477408286063902
sim_render-ego_max	0.04799872636795044
sim_render-ego_mean	0.04523794332345486
sim_render-ego_median	0.04676233592786287
sim_render-ego_min	0.03801841889658282
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20458

2595

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 13:26:05+00:00

2019-04-25 13:39:08+00:00

0:13:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.236032599182076
survival_time_median	5.249999999999989
deviation-center-line_median	0.3790435479017953
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1885001761938936
agent_compute-ego_mean	0.17660535233030455
agent_compute-ego_median	0.18412877902511723
agent_compute-ego_min	0.15878156158659193
deviation-center-line_max	0.480621028039565
deviation-center-line_mean	0.3775582840198933
deviation-center-line_min	0.2545339315500566
deviation-heading_max	2.8637487534437063
deviation-heading_mean	2.219342229880892
deviation-heading_median	1.9906440544134296
deviation-heading_min	1.698709013968735
driven_any_max	0.3375974119618976
driven_any_mean	0.26546026267005846
driven_any_median	0.2609284426260094
driven_any_min	0.2061002252035742
driven_lanedir_consec_max	0.2858961527131785
driven_lanedir_consec_mean	0.2259096091152859
driven_lanedir_consec_min	0.16798649840199165
driven_lanedir_max	0.2858961527131785
driven_lanedir_mean	0.2259096091152859
driven_lanedir_median	0.236032599182076
driven_lanedir_min	0.16798649840199165
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.3375974119618976, "sim_physics": 0.13248088537168898, "survival_time": 6.0499999999999865, "driven_lanedir": 0.2858961527131785, "sim_render-ego": 0.04969655186676782, "in-drivable-lane": 0, "agent_compute-ego": 0.18412877902511723, "deviation-heading": 2.7760914265884686, "set_robot_commands": 0.07359020966143648, "deviation-center-line": 0.3790435479017953, "driven_lanedir_consec": 0.2858961527131785, "sim_compute_sim_state": 0.03203341586530701, "sim_compute_performance-ego": 0.05322190158623309, "sim_compute_robot_state-ego": 0.05809756744006449, "sim_compute_robot_state-npc0": 0.0566607841775437, "sim_compute_robot_state-npc1": 0.05364564233574985, "sim_compute_robot_state-npc2": 0.05336062967284652, "sim_compute_robot_state-npc3": 0.05348692846692298}, "udem1-1-0": {"driven_any": 0.26306292936188086, "sim_physics": 0.134511258012505, "survival_time": 4.6499999999999915, "driven_lanedir": 0.2018802210163733, "sim_render-ego": 0.0499791919544179, "in-drivable-lane": 0, "agent_compute-ego": 0.1885001761938936, "deviation-heading": 2.8637487534437063, "set_robot_commands": 0.07216868092936854, "deviation-center-line": 0.3034706459131665, "driven_lanedir_consec": 0.2018802210163733, "sim_compute_sim_state": 0.030539692089121828, "sim_compute_performance-ego": 0.05182433641085061, "sim_compute_robot_state-ego": 0.05439100983322308, "sim_compute_robot_state-npc0": 0.05442945931547431, "sim_compute_robot_state-npc1": 0.052673065534202, "sim_compute_robot_state-npc2": 0.05216026818880471, "sim_compute_robot_state-npc3": 0.05314527532105805}, "udem1-2-0": {"driven_any": 0.2609284426260094, "sim_physics": 0.13221341768900555, "survival_time": 5.249999999999989, "driven_lanedir": 0.23775257426281016, "sim_render-ego": 0.04561193557012649, "in-drivable-lane": 0, "agent_compute-ego": 0.16376476287841796, "deviation-heading": 1.698709013968735, "set_robot_commands": 0.06817296573093959, "deviation-center-line": 0.480621028039565, "driven_lanedir_consec": 0.23775257426281016, "sim_compute_sim_state": 0.028469685145786832, "sim_compute_performance-ego": 0.05044529324486142, "sim_compute_robot_state-ego": 0.05096415110996792, "sim_compute_robot_state-npc0": 0.05170782180059524, "sim_compute_robot_state-npc1": 0.04934877668108259, "sim_compute_robot_state-npc2": 0.04854902312869117, "sim_compute_robot_state-npc3": 0.05025769869486491}, "udem1-3-0": {"driven_any": 0.2596123041969303, "sim_physics": 0.11020993303369592, "survival_time": 5.399999999999989, "driven_lanedir": 0.236032599182076, "sim_render-ego": 0.04515168843445955, "in-drivable-lane": 0, "agent_compute-ego": 0.18785148196750215, "deviation-heading": 1.7675179009901218, "set_robot_commands": 0.06845998101764256, "deviation-center-line": 0.47012226669488294, "driven_lanedir_consec": 0.236032599182076, "sim_compute_sim_state": 0.038831993385597514, "sim_compute_performance-ego": 0.07523968043150725, "sim_compute_robot_state-ego": 0.0545834015916895, "sim_compute_robot_state-npc0": 0.051753991179996066, "sim_compute_robot_state-npc1": 0.05049448984640616, "sim_compute_robot_state-npc2": 0.04790793745606034, "sim_compute_robot_state-npc3": 0.04739667309655084}, "udem1-4-0": {"driven_any": 0.2061002252035742, "sim_physics": 0.10575958755281235, "survival_time": 3.599999999999995, "driven_lanedir": 0.16798649840199165, "sim_render-ego": 0.042502144972483315, "in-drivable-lane": 0, "agent_compute-ego": 0.15878156158659193, "deviation-heading": 1.9906440544134296, "set_robot_commands": 0.06405887007713318, "deviation-center-line": 0.2545339315500566, "driven_lanedir_consec": 0.16798649840199165, "sim_compute_sim_state": 0.02697858214378357, "sim_compute_performance-ego": 0.048245247867372304, "sim_compute_robot_state-ego": 0.04993477463722229, "sim_compute_robot_state-npc0": 0.04663669400744968, "sim_compute_robot_state-npc1": 0.04468293322457208, "sim_compute_robot_state-npc2": 0.044380135006374784, "sim_compute_robot_state-npc3": 0.04512706730100843}}
set_robot_commands_max	0.07359020966143648
set_robot_commands_mean	0.06929014148330406
set_robot_commands_median	0.06845998101764256
set_robot_commands_min	0.06405887007713318
sim_compute_performance-ego_max	0.07523968043150725
sim_compute_performance-ego_mean	0.055795291908164936
sim_compute_performance-ego_median	0.05182433641085061
sim_compute_performance-ego_min	0.048245247867372304
sim_compute_robot_state-ego_max	0.05809756744006449
sim_compute_robot_state-ego_mean	0.053594180922433454
sim_compute_robot_state-ego_median	0.05439100983322308
sim_compute_robot_state-ego_min	0.04993477463722229
sim_compute_robot_state-npc0_max	0.0566607841775437
sim_compute_robot_state-npc0_mean	0.0522377500962118
sim_compute_robot_state-npc0_median	0.051753991179996066
sim_compute_robot_state-npc0_min	0.04663669400744968
sim_compute_robot_state-npc1_max	0.05364564233574985
sim_compute_robot_state-npc1_mean	0.05016898152440254
sim_compute_robot_state-npc1_median	0.05049448984640616
sim_compute_robot_state-npc1_min	0.04468293322457208
sim_compute_robot_state-npc2_max	0.05336062967284652
sim_compute_robot_state-npc2_mean	0.0492715986905555
sim_compute_robot_state-npc2_median	0.04854902312869117
sim_compute_robot_state-npc2_min	0.044380135006374784
sim_compute_robot_state-npc3_max	0.05348692846692298
sim_compute_robot_state-npc3_mean	0.049882728576081045
sim_compute_robot_state-npc3_median	0.05025769869486491
sim_compute_robot_state-npc3_min	0.04512706730100843
sim_compute_sim_state_max	0.038831993385597514
sim_compute_sim_state_mean	0.031370673725919354
sim_compute_sim_state_median	0.030539692089121828
sim_compute_sim_state_min	0.02697858214378357
sim_physics_max	0.134511258012505
sim_physics_mean	0.12303501633194155
sim_physics_median	0.13221341768900555
sim_physics_min	0.10575958755281235
sim_render-ego_max	0.0499791919544179
sim_render-ego_mean	0.04658830255965101
sim_render-ego_median	0.04561193557012649
sim_render-ego_min	0.042502144972483315
simulation-passed	1
survival_time_max	6.0499999999999865
survival_time_mean	4.9899999999999896
survival_time_min	3.599999999999995

No reset possible

20449

2608

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:19:57+00:00

2019-04-25 13:25:57+00:00

0:06:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.058753764187848126
agent_compute-ego_mean	0.05299535062488614
agent_compute-ego_median	0.05370488533606896
agent_compute-ego_min	0.04410222860483023
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.10450130701065063, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.04720301377145868, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.05489635781237954, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.0756175486665023, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.03047096101861251, "sim_compute_performance-ego": 0.053390182946857656, "sim_compute_robot_state-ego": 0.05751869553013852, "sim_compute_robot_state-npc0": 0.05637302524165103, "sim_compute_robot_state-npc1": 0.05282668063515111, "sim_compute_robot_state-npc2": 0.05446139134858784, "sim_compute_robot_state-npc3": 0.05239246079796239}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.109483502805233, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.04605032503604889, "in-drivable-lane": 0, "agent_compute-ego": 0.05351951718330383, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.0668221265077591, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.028327576816082, "sim_compute_performance-ego": 0.05162426084280014, "sim_compute_robot_state-ego": 0.05323523283004761, "sim_compute_robot_state-npc0": 0.05248658359050751, "sim_compute_robot_state-npc1": 0.04788154363632202, "sim_compute_robot_state-npc2": 0.0504697784781456, "sim_compute_robot_state-npc3": 0.05194150656461716}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.09279207999889667, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.03926932353239793, "in-drivable-lane": 0, "agent_compute-ego": 0.04410222860483023, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.060319098142477184, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.025171146943018988, "sim_compute_performance-ego": 0.04353189468383789, "sim_compute_robot_state-ego": 0.04525634875664344, "sim_compute_robot_state-npc0": 0.044150315798245944, "sim_compute_robot_state-npc1": 0.044586002826690674, "sim_compute_robot_state-npc2": 0.04480506823613094, "sim_compute_robot_state-npc3": 0.04374330318891085}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.1167135238647461, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.04707831602830153, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.05370488533606896, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.06872373666518773, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.028912923274896085, "sim_compute_performance-ego": 0.050527694897773937, "sim_compute_robot_state-ego": 0.05707757900922726, "sim_compute_robot_state-npc0": 0.05393730677091158, "sim_compute_robot_state-npc1": 0.051701912513146035, "sim_compute_robot_state-npc2": 0.05219302421961075, "sim_compute_robot_state-npc3": 0.05105252449329083}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.10815694597032335, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.04791425775598596, "in-drivable-lane": 0, "agent_compute-ego": 0.058753764187848126, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.07254106027108652, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.028317619253087928, "sim_compute_performance-ego": 0.049731537147804546, "sim_compute_robot_state-ego": 0.05437423564769603, "sim_compute_robot_state-npc0": 0.05431720945570204, "sim_compute_robot_state-npc1": 0.05445089163603606, "sim_compute_robot_state-npc2": 0.052811110461199726, "sim_compute_robot_state-npc3": 0.0511584723437274}}
set_robot_commands_max	0.0756175486665023
set_robot_commands_mean	0.06880471405060257
set_robot_commands_median	0.06872373666518773
set_robot_commands_min	0.060319098142477184
sim_compute_performance-ego_max	0.053390182946857656
sim_compute_performance-ego_mean	0.04976111410381483
sim_compute_performance-ego_median	0.050527694897773937
sim_compute_performance-ego_min	0.04353189468383789
sim_compute_robot_state-ego_max	0.05751869553013852
sim_compute_robot_state-ego_mean	0.05349241835475058
sim_compute_robot_state-ego_median	0.05437423564769603
sim_compute_robot_state-ego_min	0.04525634875664344
sim_compute_robot_state-npc0_max	0.05637302524165103
sim_compute_robot_state-npc0_mean	0.05225288817140361
sim_compute_robot_state-npc0_median	0.05393730677091158
sim_compute_robot_state-npc0_min	0.044150315798245944
sim_compute_robot_state-npc1_max	0.05445089163603606
sim_compute_robot_state-npc1_mean	0.05028940624946918
sim_compute_robot_state-npc1_median	0.051701912513146035
sim_compute_robot_state-npc1_min	0.044586002826690674
sim_compute_robot_state-npc2_max	0.05446139134858784
sim_compute_robot_state-npc2_mean	0.05094807454873497
sim_compute_robot_state-npc2_median	0.05219302421961075
sim_compute_robot_state-npc2_min	0.04480506823613094
sim_compute_robot_state-npc3_max	0.05239246079796239
sim_compute_robot_state-npc3_mean	0.050057653477701726
sim_compute_robot_state-npc3_median	0.0511584723437274
sim_compute_robot_state-npc3_min	0.04374330318891085
sim_compute_sim_state_max	0.03047096101861251
sim_compute_sim_state_mean	0.0282400454611395
sim_compute_sim_state_median	0.028327576816082
sim_compute_sim_state_min	0.025171146943018988
sim_physics_max	0.1167135238647461
sim_physics_mean	0.10632947192996996
sim_physics_median	0.10815694597032335
sim_physics_min	0.09279207999889667
sim_render-ego_max	0.04791425775598596
sim_render-ego_mean	0.0455030472248386
sim_render-ego_median	0.04707831602830153
sim_render-ego_min	0.03926932353239793
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20443

2620

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:12:49+00:00

2019-04-25 13:19:44+00:00

0:06:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.1226137899002939
agent_compute-ego_mean	0.12021599003132132
agent_compute-ego_median	0.12031026986929086
agent_compute-ego_min	0.11794919437832302
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.11035580904978626, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.04945852621546332, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1226137899002939, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.07306295970700821, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03250353291349591, "sim_compute_performance-ego": 0.05304852971490824, "sim_compute_robot_state-ego": 0.05932317139967432, "sim_compute_robot_state-npc0": 0.053124175881439785, "sim_compute_robot_state-npc1": 0.05796143693744012, "sim_compute_robot_state-npc2": 0.05357386031240787, "sim_compute_robot_state-npc3": 0.05616557373190826}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.1099631694646982, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.05057173508864183, "in-drivable-lane": 0, "agent_compute-ego": 0.12031026986929086, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.07149066374852107, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.029780076100276068, "sim_compute_performance-ego": 0.05472503258631779, "sim_compute_robot_state-ego": 0.05633814518268292, "sim_compute_robot_state-npc0": 0.05668731836172251, "sim_compute_robot_state-npc1": 0.05528692098764273, "sim_compute_robot_state-npc2": 0.05351558098426232, "sim_compute_robot_state-npc3": 0.05320874544290396}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.11454799614454572, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.04989191105491236, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.11876031285838078, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.07341283246090538, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.031780860925975596, "sim_compute_performance-ego": 0.052670576070484365, "sim_compute_robot_state-ego": 0.05633801221847534, "sim_compute_robot_state-npc0": 0.05459907494093243, "sim_compute_robot_state-npc1": 0.05579380298915662, "sim_compute_robot_state-npc2": 0.05537447176481548, "sim_compute_robot_state-npc3": 0.05401448827040823}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.11711262449433532, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.04889618897739845, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.121446383150318, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.07062738756590252, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.029612194133710256, "sim_compute_performance-ego": 0.05276590359361866, "sim_compute_robot_state-ego": 0.05492805227448669, "sim_compute_robot_state-npc0": 0.05275469188448749, "sim_compute_robot_state-npc1": 0.05337933950786349, "sim_compute_robot_state-npc2": 0.05294129818300657, "sim_compute_robot_state-npc3": 0.052548145946068096}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.1010244952307807, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.04683063648365162, "in-drivable-lane": 0, "agent_compute-ego": 0.11794919437832302, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.07447175626401548, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.02787697756731952, "sim_compute_performance-ego": 0.05025603153087475, "sim_compute_robot_state-ego": 0.05221806632147895, "sim_compute_robot_state-npc0": 0.05231022834777832, "sim_compute_robot_state-npc1": 0.051430216541996705, "sim_compute_robot_state-npc2": 0.04961133886266638, "sim_compute_robot_state-npc3": 0.04752499085885507}}
set_robot_commands_max	0.07447175626401548
set_robot_commands_mean	0.07261311994927053
set_robot_commands_median	0.07306295970700821
set_robot_commands_min	0.07062738756590252
sim_compute_performance-ego_max	0.05472503258631779
sim_compute_performance-ego_mean	0.052693214699240765
sim_compute_performance-ego_median	0.05276590359361866
sim_compute_performance-ego_min	0.05025603153087475
sim_compute_robot_state-ego_max	0.05932317139967432
sim_compute_robot_state-ego_mean	0.05582908947935964
sim_compute_robot_state-ego_median	0.05633801221847534
sim_compute_robot_state-ego_min	0.05221806632147895
sim_compute_robot_state-npc0_max	0.05668731836172251
sim_compute_robot_state-npc0_mean	0.053895097883272104
sim_compute_robot_state-npc0_median	0.053124175881439785
sim_compute_robot_state-npc0_min	0.05231022834777832
sim_compute_robot_state-npc1_max	0.05796143693744012
sim_compute_robot_state-npc1_mean	0.05477034339281993
sim_compute_robot_state-npc1_median	0.05528692098764273
sim_compute_robot_state-npc1_min	0.051430216541996705
sim_compute_robot_state-npc2_max	0.05537447176481548
sim_compute_robot_state-npc2_mean	0.05300331002143173
sim_compute_robot_state-npc2_median	0.05351558098426232
sim_compute_robot_state-npc2_min	0.04961133886266638
sim_compute_robot_state-npc3_max	0.05616557373190826
sim_compute_robot_state-npc3_mean	0.05269238885002873
sim_compute_robot_state-npc3_median	0.05320874544290396
sim_compute_robot_state-npc3_min	0.04752499085885507
sim_compute_sim_state_max	0.03250353291349591
sim_compute_sim_state_mean	0.030310728328155467
sim_compute_sim_state_median	0.029780076100276068
sim_compute_sim_state_min	0.02787697756731952
sim_physics_max	0.11711262449433532
sim_physics_mean	0.11060081887682924
sim_physics_median	0.11035580904978626
sim_physics_min	0.1010244952307807
sim_render-ego_max	0.05057173508864183
sim_render-ego_mean	0.04912979956401352
sim_render-ego_median	0.04945852621546332
sim_render-ego_min	0.04683063648365162
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20437

2648

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:02:09+00:00

2019-04-25 13:12:27+00:00

0:10:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.06920282949100841
agent_compute-ego_mean	0.05671568321182626
agent_compute-ego_median	0.05496586880213778
agent_compute-ego_min	0.04972660917984812
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.17339426279067993, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.058547372167760674, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.06920282949100841, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.09310246326706628, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.038766427473588425, "sim_compute_performance-ego": 0.07214441624554721, "sim_compute_robot_state-ego": 0.07201414487578651, "sim_compute_robot_state-npc0": 0.06966677849942987, "sim_compute_robot_state-npc1": 0.06869254870848222, "sim_compute_robot_state-npc2": 0.06847386197610335, "sim_compute_robot_state-npc3": 0.06680626489899376}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.11783319134866038, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.04807626047442036, "in-drivable-lane": 0, "agent_compute-ego": 0.056068412719234344, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.06958223158313383, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.031638868393436555, "sim_compute_performance-ego": 0.051604647790232015, "sim_compute_robot_state-ego": 0.0537847395866148, "sim_compute_robot_state-npc0": 0.052544778393160914, "sim_compute_robot_state-npc1": 0.055800476381855625, "sim_compute_robot_state-npc2": 0.05606728984463599, "sim_compute_robot_state-npc3": 0.05556781830326203}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.12354506668469584, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.04451998413031828, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.05361469586690267, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.06828241821721936, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.027807384518021387, "sim_compute_performance-ego": 0.04765535077304705, "sim_compute_robot_state-ego": 0.04970714048290929, "sim_compute_robot_state-npc0": 0.05120344364896734, "sim_compute_robot_state-npc1": 0.051124552462963345, "sim_compute_robot_state-npc2": 0.04985985519192743, "sim_compute_robot_state-npc3": 0.04986101684840859}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.11779064379240337, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.04436732091401753, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.04972660917984812, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.0660227800670423, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.025761526509335168, "sim_compute_performance-ego": 0.04619795397708291, "sim_compute_robot_state-ego": 0.049209142986096834, "sim_compute_robot_state-npc0": 0.05017105403699373, "sim_compute_robot_state-npc1": 0.047367690738878754, "sim_compute_robot_state-npc2": 0.04633225390785619, "sim_compute_robot_state-npc3": 0.04612296505978233}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.14824809826595683, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.04785952433733873, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.05496586880213778, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.0711215465841159, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.029786187158504004, "sim_compute_performance-ego": 0.05196327726605912, "sim_compute_robot_state-ego": 0.05443163153151391, "sim_compute_robot_state-npc0": 0.05530911600086051, "sim_compute_robot_state-npc1": 0.05326876170198682, "sim_compute_robot_state-npc2": 0.05670336770339751, "sim_compute_robot_state-npc3": 0.05310309772760096}}
set_robot_commands_max	0.09310246326706628
set_robot_commands_mean	0.07362228794371553
set_robot_commands_median	0.06958223158313383
set_robot_commands_min	0.0660227800670423
sim_compute_performance-ego_max	0.07214441624554721
sim_compute_performance-ego_mean	0.053913129210393665
sim_compute_performance-ego_median	0.051604647790232015
sim_compute_performance-ego_min	0.04619795397708291
sim_compute_robot_state-ego_max	0.07201414487578651
sim_compute_robot_state-ego_mean	0.055829359892584265
sim_compute_robot_state-ego_median	0.0537847395866148
sim_compute_robot_state-ego_min	0.049209142986096834
sim_compute_robot_state-npc0_max	0.06966677849942987
sim_compute_robot_state-npc0_mean	0.055779034115882475
sim_compute_robot_state-npc0_median	0.052544778393160914
sim_compute_robot_state-npc0_min	0.05017105403699373
sim_compute_robot_state-npc1_max	0.06869254870848222
sim_compute_robot_state-npc1_mean	0.05525080599883335
sim_compute_robot_state-npc1_median	0.05326876170198682
sim_compute_robot_state-npc1_min	0.047367690738878754
sim_compute_robot_state-npc2_max	0.06847386197610335
sim_compute_robot_state-npc2_mean	0.0554873257247841
sim_compute_robot_state-npc2_median	0.05606728984463599
sim_compute_robot_state-npc2_min	0.04633225390785619
sim_compute_robot_state-npc3_max	0.06680626489899376
sim_compute_robot_state-npc3_mean	0.05429223256760953
sim_compute_robot_state-npc3_median	0.05310309772760096
sim_compute_robot_state-npc3_min	0.04612296505978233
sim_compute_sim_state_max	0.038766427473588425
sim_compute_sim_state_mean	0.03075207881057711
sim_compute_sim_state_median	0.029786187158504004
sim_compute_sim_state_min	0.025761526509335168
sim_physics_max	0.17339426279067993
sim_physics_mean	0.13616225257647926
sim_physics_median	0.12354506668469584
sim_physics_min	0.11779064379240337
sim_render-ego_max	0.058547372167760674
sim_render-ego_mean	0.048674092404771115
sim_render-ego_median	0.04785952433733873
sim_render-ego_min	0.04436732091401753
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20423

2694

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 12:59:02+00:00

2019-04-25 13:00:07+00:00

0:01:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20423-308355', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20423-308355', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20423-308355', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20415

2641

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 12:51:17+00:00

2019-04-25 12:58:04+00:00

0:06:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.07601282784813329
agent_compute-ego_mean	0.0662964654252084
agent_compute-ego_median	0.07354165207255971
agent_compute-ego_min	0.051725217274257114
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.0940248025091071, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.06212162344079269, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.07601282784813329, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.09615293615742732, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.038479428542287725, "sim_compute_performance-ego": 0.06920651699367322, "sim_compute_robot_state-ego": 0.07178764594228644}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.1057329143303028, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.06326992269875346, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07575151540231014, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.10176326572031216, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.043305708014446755, "sim_compute_performance-ego": 0.07376823217972465, "sim_compute_robot_state-ego": 0.08182716024094734}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.1157912557775324, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.06551650437441739, "in-drivable-lane": 0, "agent_compute-ego": 0.07354165207255971, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.09862742640755394, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.044917485930702904, "sim_compute_performance-ego": 0.0768403790213845, "sim_compute_robot_state-ego": 0.08093175021084872}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.0734239541567289, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.04920036976154034, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.05445111452878176, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.07504447999891344, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.031014560343145012, "sim_compute_performance-ego": 0.05511094711639069, "sim_compute_robot_state-ego": 0.05696031287476257}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.06812653736192353, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.04439710597602688, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.051725217274257114, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.07249223699375075, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.028817833686361507, "sim_compute_performance-ego": 0.04948599484502053, "sim_compute_robot_state-ego": 0.05134820208257558}}
set_robot_commands_max	0.10176326572031216
set_robot_commands_mean	0.08881606905559151
set_robot_commands_median	0.09615293615742732
set_robot_commands_min	0.07249223699375075
sim_compute_performance-ego_max	0.0768403790213845
sim_compute_performance-ego_mean	0.06488241403123872
sim_compute_performance-ego_median	0.06920651699367322
sim_compute_performance-ego_min	0.04948599484502053
sim_compute_robot_state-ego_max	0.08182716024094734
sim_compute_robot_state-ego_mean	0.06857101427028413
sim_compute_robot_state-ego_median	0.07178764594228644
sim_compute_robot_state-ego_min	0.05134820208257558
sim_compute_sim_state_max	0.044917485930702904
sim_compute_sim_state_mean	0.03730700330338878
sim_compute_sim_state_median	0.038479428542287725
sim_compute_sim_state_min	0.028817833686361507
sim_physics_max	0.1157912557775324
sim_physics_mean	0.09141989282711896
sim_physics_median	0.0940248025091071
sim_physics_min	0.06812653736192353
sim_render-ego_max	0.06551650437441739
sim_render-ego_mean	0.05690110525030615
sim_render-ego_median	0.06212162344079269
sim_render-ego_min	0.04439710597602688
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20403

2694

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

timeout

2019-04-25 12:25:41+00:00

2019-04-25 12:50:50+00:00

0:25:09

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20390

2712

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:01:51+00:00

2019-04-25 12:25:07+00:00

0:23:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.21668244161030015
survival_time_median	2.000000000000001
deviation-center-line_median	0.15329499324354323
in-drivable-lane_median	0.09999999999999988

other stats

agent_compute-ego_max	0.10037170350551604
agent_compute-ego_mean	0.095641769221883
agent_compute-ego_median	0.0949102222919464
agent_compute-ego_min	0.09352606910092014
deviation-center-line_max	0.9508810093584446
deviation-center-line_mean	0.4400398097958279
deviation-center-line_min	0.10523478672655724
deviation-heading_max	6.40018476891609
deviation-heading_mean	2.775505840547739
deviation-heading_median	1.0124319304458822
deviation-heading_min	0.37714158664946934
driven_any_max	2.3333319751377406
driven_any_mean	1.0584489380253228
driven_any_median	0.2676519828320544
driven_any_min	0.2034002133996885
driven_lanedir_consec_max	1.1533399730689216
driven_lanedir_consec_mean	0.4898124179293305
driven_lanedir_consec_min	0.19361253083413832
driven_lanedir_max	1.659035911005531
driven_lanedir_mean	0.690872299317767
driven_lanedir_median	0.21668244161030015
driven_lanedir_min	0.19361253083413832
in-drivable-lane_max	4.900000000000031
in-drivable-lane_mean	1.3000000000000071
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.3333319751377406, "sim_physics": 0.2491467547416687, "survival_time": 14.950000000000076, "driven_lanedir": 1.19071009665939, "sim_render-ego": 0.07162997325261435, "in-drivable-lane": 4.900000000000031, "agent_compute-ego": 0.09446046590805052, "deviation-heading": 5.510655031679696, "set_robot_commands": 0.116877547899882, "deviation-center-line": 0.8448434961578992, "driven_lanedir_consec": 0.6911066276538176, "sim_compute_sim_state": 0.046259871323903405, "sim_compute_performance-ego": 0.08057262579600016, "sim_compute_robot_state-ego": 0.08696039915084838, "sim_compute_robot_state-npc0": 0.07845830996831259, "sim_compute_robot_state-npc1": 0.07973695278167725, "sim_compute_robot_state-npc2": 0.0799336314201355, "sim_compute_robot_state-npc3": 0.0802009916305542}, "udem1-1-0": {"driven_any": 0.2676519828320544, "sim_physics": 0.23851679563522335, "survival_time": 2.000000000000001, "driven_lanedir": 0.194320516479475, "sim_render-ego": 0.08258777856826782, "in-drivable-lane": 0.09999999999999988, "agent_compute-ego": 0.0949102222919464, "deviation-heading": 1.0124319304458822, "set_robot_commands": 0.11696571111679076, "deviation-center-line": 0.10523478672655724, "driven_lanedir_consec": 0.194320516479475, "sim_compute_sim_state": 0.043569183349609374, "sim_compute_performance-ego": 0.0792168378829956, "sim_compute_robot_state-ego": 0.10195934772491456, "sim_compute_robot_state-npc0": 0.07814663052558898, "sim_compute_robot_state-npc1": 0.07628477215766907, "sim_compute_robot_state-npc2": 0.07699785828590393, "sim_compute_robot_state-npc3": 0.0790522575378418}, "udem1-2-0": {"driven_any": 0.2034002133996885, "sim_physics": 0.26498764008283615, "survival_time": 1.6000000000000008, "driven_lanedir": 0.19361253083413832, "sim_render-ego": 0.07269797474145889, "in-drivable-lane": 0, "agent_compute-ego": 0.10037170350551604, "deviation-heading": 0.37714158664946934, "set_robot_commands": 0.12187737226486206, "deviation-center-line": 0.14594476349269528, "driven_lanedir_consec": 0.19361253083413832, "sim_compute_sim_state": 0.04614393413066864, "sim_compute_performance-ego": 0.08343761414289474, "sim_compute_robot_state-ego": 0.08836415410041809, "sim_compute_robot_state-npc0": 0.08260148763656616, "sim_compute_robot_state-npc1": 0.0790909007191658, "sim_compute_robot_state-npc2": 0.07841329276561737, "sim_compute_robot_state-npc3": 0.08549445122480392}, "udem1-3-0": {"driven_any": 0.24356644685146184, "sim_physics": 0.2215401997437348, "survival_time": 1.850000000000001, "driven_lanedir": 0.21668244161030015, "sim_render-ego": 0.07176683400128339, "in-drivable-lane": 0, "agent_compute-ego": 0.0949403853029818, "deviation-heading": 0.5771158850475561, "set_robot_commands": 0.11907978315611144, "deviation-center-line": 0.15329499324354323, "driven_lanedir_consec": 0.21668244161030015, "sim_compute_sim_state": 0.044652281580744566, "sim_compute_performance-ego": 0.08140321680017419, "sim_compute_robot_state-ego": 0.08466634234866581, "sim_compute_robot_state-npc0": 0.07946327570322398, "sim_compute_robot_state-npc1": 0.07665275238655708, "sim_compute_robot_state-npc2": 0.08015115841014965, "sim_compute_robot_state-npc3": 0.08099476711170094}, "udem1-4-0": {"driven_any": 2.244294071905668, "sim_physics": 0.2686977286438842, "survival_time": 14.300000000000068, "driven_lanedir": 1.659035911005531, "sim_render-ego": 0.07427524103151335, "in-drivable-lane": 1.5000000000000044, "agent_compute-ego": 0.09352606910092014, "deviation-heading": 6.40018476891609, "set_robot_commands": 0.11606649252084586, "deviation-center-line": 0.9508810093584446, "driven_lanedir_consec": 1.1533399730689216, "sim_compute_sim_state": 0.04412325695678071, "sim_compute_performance-ego": 0.08386431207190027, "sim_compute_robot_state-ego": 0.09018395413885584, "sim_compute_robot_state-npc0": 0.0798533571349991, "sim_compute_robot_state-npc1": 0.07951510702813422, "sim_compute_robot_state-npc2": 0.07990818840640408, "sim_compute_robot_state-npc3": 0.08005407973602935}}
set_robot_commands_max	0.12187737226486206
set_robot_commands_mean	0.11817338139169845
set_robot_commands_median	0.11696571111679076
set_robot_commands_min	0.11606649252084586
sim_compute_performance-ego_max	0.08386431207190027
sim_compute_performance-ego_mean	0.081698921338793
sim_compute_performance-ego_median	0.08140321680017419
sim_compute_performance-ego_min	0.0792168378829956
sim_compute_robot_state-ego_max	0.10195934772491456
sim_compute_robot_state-ego_mean	0.09042683949274054
sim_compute_robot_state-ego_median	0.08836415410041809
sim_compute_robot_state-ego_min	0.08466634234866581
sim_compute_robot_state-npc0_max	0.08260148763656616
sim_compute_robot_state-npc0_mean	0.07970461219373816
sim_compute_robot_state-npc0_median	0.07946327570322398
sim_compute_robot_state-npc0_min	0.07814663052558898
sim_compute_robot_state-npc1_max	0.07973695278167725
sim_compute_robot_state-npc1_mean	0.07825609701464069
sim_compute_robot_state-npc1_median	0.0790909007191658
sim_compute_robot_state-npc1_min	0.07628477215766907
sim_compute_robot_state-npc2_max	0.08015115841014965
sim_compute_robot_state-npc2_mean	0.0790808258576421
sim_compute_robot_state-npc2_median	0.07990818840640408
sim_compute_robot_state-npc2_min	0.07699785828590393
sim_compute_robot_state-npc3_max	0.08549445122480392
sim_compute_robot_state-npc3_mean	0.08115930944818604
sim_compute_robot_state-npc3_median	0.0802009916305542
sim_compute_robot_state-npc3_min	0.0790522575378418
sim_compute_sim_state_max	0.046259871323903405
sim_compute_sim_state_mean	0.04494970546834134
sim_compute_sim_state_median	0.044652281580744566
sim_compute_sim_state_min	0.043569183349609374
sim_physics_max	0.2686977286438842
sim_physics_mean	0.24857782376946944
sim_physics_median	0.2491467547416687
sim_physics_min	0.2215401997437348
sim_render-ego_max	0.08258777856826782
sim_render-ego_mean	0.07459156031902756
sim_render-ego_median	0.07269797474145889
sim_render-ego_min	0.07162997325261435
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.940000000000029
survival_time_min	1.6000000000000008

No reset possible

20387

2669

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-25 12:00:38+00:00

2019-04-25 12:01:29+00:00

0:00:51

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20371

2707

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:55:24+00:00

2019-04-25 12:00:07+00:00

0:04:43

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20371-329436', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20371-329436', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20371-329436', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20357

2731

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-25 11:52:55+00:00

2019-04-25 11:54:47+00:00

0:01:52

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20343

2762

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 11:39:08+00:00

2019-04-25 11:52:36+00:00

0:13:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.07951381898695423
agent_compute-ego_mean	0.07363298540711183
agent_compute-ego_median	0.07187737302577242
agent_compute-ego_min	0.07052122203397079
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.1658602221445604, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.07574798573147166, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.07119296355680986, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.09396578236059708, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.03768149560148066, "sim_compute_performance-ego": 0.06963619589805603, "sim_compute_robot_state-ego": 0.07199791073799133, "sim_compute_robot_state-npc0": 0.06611781770532782, "sim_compute_robot_state-npc1": 0.06951219927180897, "sim_compute_robot_state-npc2": 0.06807959350672635, "sim_compute_robot_state-npc3": 0.06790466200221669}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.1798260288853799, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.06693121694749402, "in-drivable-lane": 0, "agent_compute-ego": 0.07951381898695423, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.10258891505579797, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.04088767113224152, "sim_compute_performance-ego": 0.06932451648096885, "sim_compute_robot_state-ego": 0.07159921430772351, "sim_compute_robot_state-npc0": 0.07253426890219411, "sim_compute_robot_state-npc1": 0.0721577598202613, "sim_compute_robot_state-npc2": 0.07103739246245354, "sim_compute_robot_state-npc3": 0.07467039169803742}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.19660829821376935, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.06269883433132308, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07187737302577242, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.09784470044129284, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.03985151838749013, "sim_compute_performance-ego": 0.06874660397252293, "sim_compute_robot_state-ego": 0.07327096512977113, "sim_compute_robot_state-npc0": 0.07111246196936208, "sim_compute_robot_state-npc1": 0.06957146969247371, "sim_compute_robot_state-npc2": 0.06876440758400774, "sim_compute_robot_state-npc3": 0.07020397220097535}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.2058187108290823, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.06360943693863719, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.07505954943205181, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.10055865739521228, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.0414416187687924, "sim_compute_performance-ego": 0.07406349935029682, "sim_compute_robot_state-ego": 0.07887518280430844, "sim_compute_robot_state-npc0": 0.07557179802342465, "sim_compute_robot_state-npc1": 0.07304410432514391, "sim_compute_robot_state-npc2": 0.07293071244892321, "sim_compute_robot_state-npc3": 0.07458291304738898}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.19978223887967392, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.0583306802830226, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.07052122203397079, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.08734331164561526, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.035655014951464156, "sim_compute_performance-ego": 0.06341293328244921, "sim_compute_robot_state-ego": 0.0725048562170754, "sim_compute_robot_state-npc0": 0.06538211459844885, "sim_compute_robot_state-npc1": 0.06617061856766822, "sim_compute_robot_state-npc2": 0.06536830478990582, "sim_compute_robot_state-npc3": 0.0644519547341575}}
set_robot_commands_max	0.10258891505579797
set_robot_commands_mean	0.09646027337970307
set_robot_commands_median	0.09784470044129284
set_robot_commands_min	0.08734331164561526
sim_compute_performance-ego_max	0.07406349935029682
sim_compute_performance-ego_mean	0.06903674979685877
sim_compute_performance-ego_median	0.06932451648096885
sim_compute_performance-ego_min	0.06341293328244921
sim_compute_robot_state-ego_max	0.07887518280430844
sim_compute_robot_state-ego_mean	0.07364962583937397
sim_compute_robot_state-ego_median	0.0725048562170754
sim_compute_robot_state-ego_min	0.07159921430772351
sim_compute_robot_state-npc0_max	0.07557179802342465
sim_compute_robot_state-npc0_mean	0.0701436922397515
sim_compute_robot_state-npc0_median	0.07111246196936208
sim_compute_robot_state-npc0_min	0.06538211459844885
sim_compute_robot_state-npc1_max	0.07304410432514391
sim_compute_robot_state-npc1_mean	0.07009123033547122
sim_compute_robot_state-npc1_median	0.06957146969247371
sim_compute_robot_state-npc1_min	0.06617061856766822
sim_compute_robot_state-npc2_max	0.07293071244892321
sim_compute_robot_state-npc2_mean	0.06923608215840334
sim_compute_robot_state-npc2_median	0.06876440758400774
sim_compute_robot_state-npc2_min	0.06536830478990582
sim_compute_robot_state-npc3_max	0.07467039169803742
sim_compute_robot_state-npc3_mean	0.07036277873655519
sim_compute_robot_state-npc3_median	0.07020397220097535
sim_compute_robot_state-npc3_min	0.0644519547341575
sim_compute_sim_state_max	0.0414416187687924
sim_compute_sim_state_mean	0.03910346376829378
sim_compute_sim_state_median	0.03985151838749013
sim_compute_sim_state_min	0.035655014951464156
sim_physics_max	0.2058187108290823
sim_physics_mean	0.1895790997904932
sim_physics_median	0.19660829821376935
sim_physics_min	0.1658602221445604
sim_render-ego_max	0.07574798573147166
sim_render-ego_mean	0.0654636308463897
sim_render-ego_median	0.06360943693863719
sim_render-ego_min	0.0583306802830226
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20321

2804

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-25 11:33:43+00:00

2019-04-25 11:39:01+00:00

0:05:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.16194694470136595
agent_compute-ego_mean	0.13955473661999457
agent_compute-ego_median	0.1259912344125601
agent_compute-ego_min	0.12318115234375
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.11936065385926443, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06325018630837495, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1613353873198887, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.0936573496404684, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.04224470876297861, "sim_compute_performance-ego": 0.07073415000483675, "sim_compute_robot_state-ego": 0.0813274068652459}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.09108624091515174, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.05339035162558922, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1259912344125601, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.07723181981306809, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03261956801781288, "sim_compute_performance-ego": 0.0583418791110699, "sim_compute_robot_state-ego": 0.06010126150571383}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.07239523198869494, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.051448080274793834, "in-drivable-lane": 0, "agent_compute-ego": 0.12531896432240805, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.0817031462987264, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.03634244865841336, "sim_compute_performance-ego": 0.055073685116238065, "sim_compute_robot_state-ego": 0.09069306320614284}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.0692007827758789, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.048184690475463865, "in-drivable-lane": 0, "agent_compute-ego": 0.12318115234375, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.08065730094909668, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.02923335075378418, "sim_compute_performance-ego": 0.04993414878845215, "sim_compute_robot_state-ego": 0.05301673889160157}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.11058206741626446, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06544151367285313, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.16194694470136595, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.09950117881481464, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.04022578092721792, "sim_compute_performance-ego": 0.07188688791715182, "sim_compute_robot_state-ego": 0.08058235278496376}}
set_robot_commands_max	0.09950117881481464
set_robot_commands_mean	0.08655015910323484
set_robot_commands_median	0.0817031462987264
set_robot_commands_min	0.07723181981306809
sim_compute_performance-ego_max	0.07188688791715182
sim_compute_performance-ego_mean	0.061194150187549735
sim_compute_performance-ego_median	0.0583418791110699
sim_compute_performance-ego_min	0.04993414878845215
sim_compute_robot_state-ego_max	0.09069306320614284
sim_compute_robot_state-ego_mean	0.07314416465073356
sim_compute_robot_state-ego_median	0.08058235278496376
sim_compute_robot_state-ego_min	0.05301673889160157
sim_compute_sim_state_max	0.04224470876297861
sim_compute_sim_state_mean	0.03613317142404139
sim_compute_sim_state_median	0.03634244865841336
sim_compute_sim_state_min	0.02923335075378418
sim_physics_max	0.11936065385926443
sim_physics_mean	0.09252499539105093
sim_physics_median	0.09108624091515174
sim_physics_min	0.0692007827758789
sim_render-ego_max	0.06544151367285313
sim_render-ego_mean	0.056342964471415
sim_render-ego_median	0.05339035162558922
sim_render-ego_min	0.048184690475463865
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20308

2827

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:24:31+00:00

2019-04-25 11:33:35+00:00

0:09:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15224234263102213
agent_compute-ego_mean	0.14436768069855377
agent_compute-ego_median	0.1455604221861241
agent_compute-ego_min	0.1335274835802474
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1570344960914468, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.05729858155520457, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.1335274835802474, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.08437290506542854, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03710099436202139, "sim_compute_performance-ego": 0.06289351436327088, "sim_compute_robot_state-ego": 0.06433700615505003, "sim_compute_robot_state-npc0": 0.06052439842583998, "sim_compute_robot_state-npc1": 0.06275359864504833, "sim_compute_robot_state-npc2": 0.06398206162002851, "sim_compute_robot_state-npc3": 0.06480228900909424}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.1529918611049652, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.0609095295270284, "in-drivable-lane": 0, "agent_compute-ego": 0.15224234263102213, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.09278656045595804, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03495221336682638, "sim_compute_performance-ego": 0.06467218200365703, "sim_compute_robot_state-ego": 0.07158410549163818, "sim_compute_robot_state-npc0": 0.06982678174972534, "sim_compute_robot_state-npc1": 0.06843923528989156, "sim_compute_robot_state-npc2": 0.06780540943145752, "sim_compute_robot_state-npc3": 0.06417659918467204}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.1728787503000033, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06360483977754237, "in-drivable-lane": 0, "agent_compute-ego": 0.1455604221861241, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09104714555255436, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03965763318336616, "sim_compute_performance-ego": 0.06856647992538194, "sim_compute_robot_state-ego": 0.07669872348591433, "sim_compute_robot_state-npc0": 0.07098495758185952, "sim_compute_robot_state-npc1": 0.06641131336406125, "sim_compute_robot_state-npc2": 0.06701542563357596, "sim_compute_robot_state-npc3": 0.06561884637606347}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.1803929724935758, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05949402259568037, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1445496122715837, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.0897412461749578, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.037544565685724805, "sim_compute_performance-ego": 0.06547580735158112, "sim_compute_robot_state-ego": 0.06881002248343775, "sim_compute_robot_state-npc0": 0.06761550095121739, "sim_compute_robot_state-npc1": 0.06702095371181682, "sim_compute_robot_state-npc2": 0.062470355276334086, "sim_compute_robot_state-npc3": 0.06294789152630305}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.13614035844802858, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.06021784543991089, "in-drivable-lane": 0, "agent_compute-ego": 0.1459585428237915, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.0988113522529602, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03781718015670776, "sim_compute_performance-ego": 0.0572166919708252, "sim_compute_robot_state-ego": 0.06806801557540894, "sim_compute_robot_state-npc0": 0.061979079246521, "sim_compute_robot_state-npc1": 0.06435412168502808, "sim_compute_robot_state-npc2": 0.06643743515014648, "sim_compute_robot_state-npc3": 0.06437513828277588}}
set_robot_commands_max	0.0988113522529602
set_robot_commands_mean	0.0913518419003718
set_robot_commands_median	0.09104714555255436
set_robot_commands_min	0.08437290506542854
sim_compute_performance-ego_max	0.06856647992538194
sim_compute_performance-ego_mean	0.06376493512294322
sim_compute_performance-ego_median	0.06467218200365703
sim_compute_performance-ego_min	0.0572166919708252
sim_compute_robot_state-ego_max	0.07669872348591433
sim_compute_robot_state-ego_mean	0.06989957463828984
sim_compute_robot_state-ego_median	0.06881002248343775
sim_compute_robot_state-ego_min	0.06433700615505003
sim_compute_robot_state-npc0_max	0.07098495758185952
sim_compute_robot_state-npc0_mean	0.06618614359103266
sim_compute_robot_state-npc0_median	0.06761550095121739
sim_compute_robot_state-npc0_min	0.06052439842583998
sim_compute_robot_state-npc1_max	0.06843923528989156
sim_compute_robot_state-npc1_mean	0.0657958445391692
sim_compute_robot_state-npc1_median	0.06641131336406125
sim_compute_robot_state-npc1_min	0.06275359864504833
sim_compute_robot_state-npc2_max	0.06780540943145752
sim_compute_robot_state-npc2_mean	0.06554213742230851
sim_compute_robot_state-npc2_median	0.06643743515014648
sim_compute_robot_state-npc2_min	0.062470355276334086
sim_compute_robot_state-npc3_max	0.06561884637606347
sim_compute_robot_state-npc3_mean	0.06438415287578174
sim_compute_robot_state-npc3_median	0.06437513828277588
sim_compute_robot_state-npc3_min	0.06294789152630305
sim_compute_sim_state_max	0.03965763318336616
sim_compute_sim_state_mean	0.0374145173509293
sim_compute_sim_state_median	0.037544565685724805
sim_compute_sim_state_min	0.03495221336682638
sim_physics_max	0.1803929724935758
sim_physics_mean	0.15988768768760395
sim_physics_median	0.1570344960914468
sim_physics_min	0.13614035844802858
sim_render-ego_max	0.06360483977754237
sim_render-ego_mean	0.06030496377907331
sim_render-ego_median	0.06021784543991089
sim_render-ego_min	0.05729858155520457
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20301

2836

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:23:39+00:00

2019-04-25 11:24:05+00:00

0:00:26

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20294

2840

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:22:39+00:00

2019-04-25 11:23:09+00:00

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20292

2844

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:21:38+00:00

2019-04-25 11:22:10+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20290

2848

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:20:47+00:00

2019-04-25 11:21:23+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20289

2851

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:19:52+00:00

2019-04-25 11:20:26+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20288

2852

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:18:53+00:00

2019-04-25 11:19:37+00:00

0:00:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20274

2881

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 11:00:22+00:00

2019-04-25 11:18:38+00:00

0:18:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.658141340093886
survival_time_median	6.999999999999983
deviation-center-line_median	0.3310166859136158
in-drivable-lane_median	2.0499999999999927

other stats

agent_compute-ego_max	0.16351714501014122
agent_compute-ego_mean	0.15480194963059066
agent_compute-ego_median	0.15552979802328443
agent_compute-ego_min	0.14532944985798427
deviation-center-line_max	0.4794323637301212
deviation-center-line_mean	0.3427896670341769
deviation-center-line_min	0.2298545284155696
deviation-heading_max	1.1504193675314938
deviation-heading_mean	0.9407336626620916
deviation-heading_median	0.9938354337214896
deviation-heading_min	0.7450586214352332
driven_any_max	1.6290075912696764
driven_any_mean	1.0117836241191598
driven_any_median	0.9970530395825568
driven_any_min	0.4251549262204664
driven_lanedir_consec_max	1.214560148863141
driven_lanedir_consec_mean	0.7110836872382787
driven_lanedir_consec_min	0.4039437775266599
driven_lanedir_max	1.214560148863141
driven_lanedir_mean	0.7110836872382787
driven_lanedir_median	0.658141340093886
driven_lanedir_min	0.4039437775266599
in-drivable-lane_max	5.000000000000038
in-drivable-lane_mean	1.8700000000000128
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.1582673396383013, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.06022349425724575, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.14894089528492518, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.09482555389404296, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.03788609334400722, "sim_compute_performance-ego": 0.06741126264844621, "sim_compute_robot_state-ego": 0.06959289312362671, "sim_compute_robot_state-npc0": 0.06733169385365077, "sim_compute_robot_state-npc1": 0.06809349060058593, "sim_compute_robot_state-npc2": 0.06822801828384399, "sim_compute_robot_state-npc3": 0.07011373213359288}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.43097149972321946, "sim_physics": 0.1501384368309608, "survival_time": 3.2499999999999964, "driven_lanedir": 0.4039437775266599, "sim_render-ego": 0.07165783368624173, "in-drivable-lane": 0, "agent_compute-ego": 0.16351714501014122, "deviation-heading": 1.1504193675314938, "set_robot_commands": 0.0960755678323599, "deviation-center-line": 0.23438865875177528, "driven_lanedir_consec": 0.4039437775266599, "sim_compute_sim_state": 0.034801882963914135, "sim_compute_performance-ego": 0.0750163041628324, "sim_compute_robot_state-ego": 0.07237019538879394, "sim_compute_robot_state-npc0": 0.06967263221740723, "sim_compute_robot_state-npc1": 0.06483931174645056, "sim_compute_robot_state-npc2": 0.07601368610675519, "sim_compute_robot_state-npc3": 0.07716637391310471}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6290075912696764, "sim_physics": 0.1623124395098005, "survival_time": 11.200000000000024, "driven_lanedir": 0.8652843360363267, "sim_render-ego": 0.056019701063632965, "in-drivable-lane": 5.000000000000038, "agent_compute-ego": 0.14532944985798427, "deviation-heading": 1.007919996470557, "set_robot_commands": 0.08861027019364494, "deviation-center-line": 0.4794323637301212, "driven_lanedir_consec": 0.8652843360363267, "sim_compute_sim_state": 0.03507778687136514, "sim_compute_performance-ego": 0.06379861384630203, "sim_compute_robot_state-ego": 0.06912547243492943, "sim_compute_robot_state-npc0": 0.06472612810986382, "sim_compute_robot_state-npc1": 0.06338338341031756, "sim_compute_robot_state-npc2": 0.06377556813614708, "sim_compute_robot_state-npc3": 0.06309928212847028}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.57673106379988, "sim_physics": 0.1770119381390409, "survival_time": 10.85000000000002, "driven_lanedir": 1.214560148863141, "sim_render-ego": 0.06542807570250903, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.16069245997661818, "deviation-heading": 0.9938354337214896, "set_robot_commands": 0.09711140861159644, "deviation-center-line": 0.4392560983598026, "driven_lanedir_consec": 1.214560148863141, "sim_compute_sim_state": 0.04169465210031254, "sim_compute_performance-ego": 0.07298275732224987, "sim_compute_robot_state-ego": 0.0798253287917458, "sim_compute_robot_state-npc0": 0.07011845694159582, "sim_compute_robot_state-npc1": 0.06933117242452735, "sim_compute_robot_state-npc2": 0.07008563648171139, "sim_compute_robot_state-npc3": 0.07095561818593109}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4251549262204664, "sim_physics": 0.14778086495777917, "survival_time": 3.149999999999997, "driven_lanedir": 0.4134888336713798, "sim_render-ego": 0.06379522217644586, "in-drivable-lane": 0, "agent_compute-ego": 0.15552979802328443, "deviation-heading": 0.7450586214352332, "set_robot_commands": 0.0990247991349962, "deviation-center-line": 0.2298545284155696, "driven_lanedir_consec": 0.4134888336713798, "sim_compute_sim_state": 0.037493823066590326, "sim_compute_performance-ego": 0.07218438103085473, "sim_compute_robot_state-ego": 0.08186373634943886, "sim_compute_robot_state-npc0": 0.07252165627857995, "sim_compute_robot_state-npc1": 0.07479504933432927, "sim_compute_robot_state-npc2": 0.07160805142115033, "sim_compute_robot_state-npc3": 0.07145501696874225}}
set_robot_commands_max	0.0990247991349962
set_robot_commands_mean	0.0951295199333281
set_robot_commands_median	0.0960755678323599
set_robot_commands_min	0.08861027019364494
sim_compute_performance-ego_max	0.0750163041628324
sim_compute_performance-ego_mean	0.07027866380213704
sim_compute_performance-ego_median	0.07218438103085473
sim_compute_performance-ego_min	0.06379861384630203
sim_compute_robot_state-ego_max	0.08186373634943886
sim_compute_robot_state-ego_mean	0.07455552521770695
sim_compute_robot_state-ego_median	0.07237019538879394
sim_compute_robot_state-ego_min	0.06912547243492943
sim_compute_robot_state-npc0_max	0.07252165627857995
sim_compute_robot_state-npc0_mean	0.06887411348021952
sim_compute_robot_state-npc0_median	0.06967263221740723
sim_compute_robot_state-npc0_min	0.06472612810986382
sim_compute_robot_state-npc1_max	0.07479504933432927
sim_compute_robot_state-npc1_mean	0.06808848150324213
sim_compute_robot_state-npc1_median	0.06809349060058593
sim_compute_robot_state-npc1_min	0.06338338341031756
sim_compute_robot_state-npc2_max	0.07601368610675519
sim_compute_robot_state-npc2_mean	0.0699421920859216
sim_compute_robot_state-npc2_median	0.07008563648171139
sim_compute_robot_state-npc2_min	0.06377556813614708
sim_compute_robot_state-npc3_max	0.07716637391310471
sim_compute_robot_state-npc3_mean	0.07055800466596825
sim_compute_robot_state-npc3_median	0.07095561818593109
sim_compute_robot_state-npc3_min	0.06309928212847028
sim_compute_sim_state_max	0.04169465210031254
sim_compute_sim_state_mean	0.03739084766923787
sim_compute_sim_state_median	0.037493823066590326
sim_compute_sim_state_min	0.034801882963914135
sim_physics_max	0.1770119381390409
sim_physics_mean	0.1591022038151765
sim_physics_median	0.1582673396383013
sim_physics_min	0.14778086495777917
sim_render-ego_max	0.07165783368624173
sim_render-ego_mean	0.06342486537721506
sim_render-ego_median	0.06379522217644586
sim_render-ego_min	0.056019701063632965
simulation-passed	1
survival_time_max	11.200000000000024
survival_time_mean	7.090000000000005
survival_time_min	3.149999999999997

No reset possible

20260

2885

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-25 10:45:35+00:00

2019-04-25 11:00:08+00:00

0:14:33

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20260-264958', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20260-264958', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20260-264958', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20248

2925

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 10:39:15+00:00

2019-04-25 10:45:03+00:00

0:05:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.10375686155535302
survival_time_median	1.2500000000000004
deviation-center-line_median	0.0678679005013871
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17407454615053924
agent_compute-ego_mean	0.16066017323625054
agent_compute-ego_median	0.16223076979319254
agent_compute-ego_min	0.1509349677297804
deviation-center-line_max	0.10517786486323812
deviation-center-line_mean	0.0775500828634605
deviation-center-line_min	0.058230982487878856
deviation-heading_max	0.8741738112541908
deviation-heading_mean	0.6753700460576425
deviation-heading_median	0.7390811416959229
deviation-heading_min	0.4392080637405558
driven_any_max	0.2510632449163531
driven_any_mean	0.17693728132131864
driven_any_median	0.15879665973745313
driven_any_min	0.13212948158418283
driven_lanedir_consec_max	0.1253055261043543
driven_lanedir_consec_mean	0.1033525609390068
driven_lanedir_consec_min	0.0829381217239149
driven_lanedir_max	0.1253055261043543
driven_lanedir_mean	0.1033525609390068
driven_lanedir_median	0.10375686155535302
driven_lanedir_min	0.0829381217239149
in-drivable-lane_max	0.5000000000000004
in-drivable-lane_mean	0.17000000000000015
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2510632449163531, "sim_physics": 0.14597550365659925, "survival_time": 1.800000000000001, "driven_lanedir": 0.11628802486126856, "sim_render-ego": 0.05776756339603, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1509349677297804, "deviation-heading": 0.7390811416959229, "set_robot_commands": 0.08226190010706584, "deviation-center-line": 0.0678679005013871, "driven_lanedir_consec": 0.11628802486126856, "sim_compute_sim_state": 0.03466965092553033, "sim_compute_performance-ego": 0.061333166228400335, "sim_compute_robot_state-ego": 0.06621535619099934, "sim_compute_robot_state-npc0": 0.05903172492980957, "sim_compute_robot_state-npc1": 0.06268947654300266, "sim_compute_robot_state-npc2": 0.06102987130482992, "sim_compute_robot_state-npc3": 0.06314841906229655}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2032793558459924, "sim_physics": 0.1257792870203654, "survival_time": 1.5000000000000009, "driven_lanedir": 0.0829381217239149, "sim_render-ego": 0.05680254300435384, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.16223076979319254, "deviation-heading": 0.8741738112541908, "set_robot_commands": 0.08591585159301758, "deviation-center-line": 0.06170166408352894, "driven_lanedir_consec": 0.0829381217239149, "sim_compute_sim_state": 0.036263291041056314, "sim_compute_performance-ego": 0.06615480581919352, "sim_compute_robot_state-ego": 0.07363377412160238, "sim_compute_robot_state-npc0": 0.06847634315490722, "sim_compute_robot_state-npc1": 0.06370658079783122, "sim_compute_robot_state-npc2": 0.06525332927703857, "sim_compute_robot_state-npc3": 0.06571823755900065}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13212948158418283, "sim_physics": 0.11726890910755504, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10375686155535302, "sim_render-ego": 0.05483987114646218, "in-drivable-lane": 0, "agent_compute-ego": 0.16266442428935657, "deviation-heading": 0.4392080637405558, "set_robot_commands": 0.10406643694097344, "deviation-center-line": 0.09477200238126952, "driven_lanedir_consec": 0.10375686155535302, "sim_compute_sim_state": 0.03439467603510076, "sim_compute_performance-ego": 0.06565750728953969, "sim_compute_robot_state-ego": 0.06824230064045299, "sim_compute_robot_state-npc0": 0.06618525765158913, "sim_compute_robot_state-npc1": 0.06205798279155384, "sim_compute_robot_state-npc2": 0.06629642573269931, "sim_compute_robot_state-npc3": 0.06230633909052068}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15879665973745313, "sim_physics": 0.1379395008087158, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1253055261043543, "sim_render-ego": 0.05743395805358887, "in-drivable-lane": 0, "agent_compute-ego": 0.1533961582183838, "deviation-heading": 0.5445503605792751, "set_robot_commands": 0.08657193183898926, "deviation-center-line": 0.10517786486323812, "driven_lanedir_consec": 0.1253055261043543, "sim_compute_sim_state": 0.03768058776855469, "sim_compute_performance-ego": 0.05885733604431152, "sim_compute_robot_state-ego": 0.0666181755065918, "sim_compute_robot_state-npc0": 0.06749172210693359, "sim_compute_robot_state-npc1": 0.06918915748596191, "sim_compute_robot_state-npc2": 0.06841175079345703, "sim_compute_robot_state-npc3": 0.06328412055969239}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13941766452261162, "sim_physics": 0.1180233437082042, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08847427045014322, "sim_render-ego": 0.05588565702023714, "in-drivable-lane": 0, "agent_compute-ego": 0.17407454615053924, "deviation-heading": 0.7798368530182679, "set_robot_commands": 0.09726005015165907, "deviation-center-line": 0.058230982487878856, "driven_lanedir_consec": 0.08847427045014322, "sim_compute_sim_state": 0.03404880606609842, "sim_compute_performance-ego": 0.0610453460527503, "sim_compute_robot_state-ego": 0.06010754212089207, "sim_compute_robot_state-npc0": 0.06628032352613367, "sim_compute_robot_state-npc1": 0.06045028437738833, "sim_compute_robot_state-npc2": 0.05818355601766835, "sim_compute_robot_state-npc3": 0.05929559210072393}}
set_robot_commands_max	0.10406643694097344
set_robot_commands_mean	0.09121523412634104
set_robot_commands_median	0.08657193183898926
set_robot_commands_min	0.08226190010706584
sim_compute_performance-ego_max	0.06615480581919352
sim_compute_performance-ego_mean	0.06260963228683908
sim_compute_performance-ego_median	0.061333166228400335
sim_compute_performance-ego_min	0.05885733604431152
sim_compute_robot_state-ego_max	0.07363377412160238
sim_compute_robot_state-ego_mean	0.06696342971610772
sim_compute_robot_state-ego_median	0.0666181755065918
sim_compute_robot_state-ego_min	0.06010754212089207
sim_compute_robot_state-npc0_max	0.06847634315490722
sim_compute_robot_state-npc0_mean	0.06549307427387464
sim_compute_robot_state-npc0_median	0.06628032352613367
sim_compute_robot_state-npc0_min	0.05903172492980957
sim_compute_robot_state-npc1_max	0.06918915748596191
sim_compute_robot_state-npc1_mean	0.06361869639914759
sim_compute_robot_state-npc1_median	0.06268947654300266
sim_compute_robot_state-npc1_min	0.06045028437738833
sim_compute_robot_state-npc2_max	0.06841175079345703
sim_compute_robot_state-npc2_mean	0.06383498662513863
sim_compute_robot_state-npc2_median	0.06525332927703857
sim_compute_robot_state-npc2_min	0.05818355601766835
sim_compute_robot_state-npc3_max	0.06571823755900065
sim_compute_robot_state-npc3_mean	0.06275054167444685
sim_compute_robot_state-npc3_median	0.06314841906229655
sim_compute_robot_state-npc3_min	0.05929559210072393
sim_compute_sim_state_max	0.03768058776855469
sim_compute_sim_state_mean	0.0354114023672681
sim_compute_sim_state_median	0.03466965092553033
sim_compute_sim_state_min	0.03404880606609842
sim_physics_max	0.14597550365659925
sim_physics_mean	0.12899730886028793
sim_physics_median	0.1257792870203654
sim_physics_min	0.11726890910755504
sim_render-ego_max	0.05776756339603
sim_render-ego_mean	0.05654591852413441
sim_render-ego_median	0.05680254300435384
sim_render-ego_min	0.05483987114646218
simulation-passed	1
survival_time_max	1.800000000000001
survival_time_mean	1.3600000000000003
survival_time_min	1.1000000000000003

No reset possible

20246

2937

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 10:38:17+00:00

2019-04-25 10:39:07+00:00

0:00:50

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20240

2941

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 10:37:05+00:00

2019-04-25 10:38:02+00:00

0:00:57

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20174

3059

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-25 10:00:37+00:00

2019-04-25 10:36:45+00:00

0:36:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.00047115201695890896
survival_time_median	14.950000000000076
deviation-center-line_median	0.48935454758261704
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.15488391717274982
agent_compute-ego_mean	0.1487863960266113
agent_compute-ego_median	0.14687824090321858
agent_compute-ego_min	0.14354461908340457
deviation-center-line_max	0.6110630347807673
deviation-center-line_mean	0.420093343660332
deviation-center-line_min	0.016750786693997155
deviation-heading_max	5.828528410212024
deviation-heading_mean	5.666366635305937
deviation-heading_median	5.656741799274124
deviation-heading_min	5.45365698365684
driven_any_max	0.026994866629984765
driven_any_mean	0.025026630137880906
driven_any_median	0.02584556720483493
driven_any_min	0.022110630442246686
driven_lanedir_consec_max	0.0024792245869211804
driven_lanedir_consec_mean	-0.0002801686950645088
driven_lanedir_consec_min	-0.003729386251302813
driven_lanedir_max	0.0024792245869211804
driven_lanedir_mean	-0.0002801686950645088
driven_lanedir_median	0.00047115201695890896
driven_lanedir_min	-0.003729386251302813
in-drivable-lane_max	7.650000000000045
in-drivable-lane_mean	7.610000000000044
in-drivable-lane_min	7.550000000000044
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026994866629984765, "sim_physics": 0.19728731314341227, "survival_time": 14.950000000000076, "driven_lanedir": 0.0024792245869211804, "sim_render-ego": 0.061812849044799806, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.15404427766799927, "deviation-heading": 5.656741799274124, "set_robot_commands": 0.0967242709795634, "deviation-center-line": 0.56158233038212, "driven_lanedir_consec": 0.0024792245869211804, "sim_compute_sim_state": 0.03944986502329508, "sim_compute_performance-ego": 0.07055665095647176, "sim_compute_robot_state-ego": 0.0754297685623169, "sim_compute_robot_state-npc0": 0.07087954918543497, "sim_compute_robot_state-npc1": 0.0702728549639384, "sim_compute_robot_state-npc2": 0.06946376085281372, "sim_compute_robot_state-npc3": 0.06954418182373047}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.02584556720483493, "sim_physics": 0.18205570936203003, "survival_time": 14.950000000000076, "driven_lanedir": -0.003729386251302813, "sim_render-ego": 0.06221700112024943, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15488391717274982, "deviation-heading": 5.792980334963805, "set_robot_commands": 0.09916705052057902, "deviation-center-line": 0.6110630347807673, "driven_lanedir_consec": -0.003729386251302813, "sim_compute_sim_state": 0.040773595174153646, "sim_compute_performance-ego": 0.07042086044947306, "sim_compute_robot_state-ego": 0.07440931558609008, "sim_compute_robot_state-npc0": 0.06967182874679566, "sim_compute_robot_state-npc1": 0.0712161922454834, "sim_compute_robot_state-npc2": 0.07112247228622437, "sim_compute_robot_state-npc3": 0.07032714049021403}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.024318396942426792, "sim_physics": 0.16931703726450603, "survival_time": 14.950000000000076, "driven_lanedir": 0.002004176561754889, "sim_render-ego": 0.05778519550959269, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.14687824090321858, "deviation-heading": 5.599925648422894, "set_robot_commands": 0.08907920996348064, "deviation-center-line": 0.48935454758261704, "driven_lanedir_consec": 0.002004176561754889, "sim_compute_sim_state": 0.037281320095062256, "sim_compute_performance-ego": 0.06382555564244588, "sim_compute_robot_state-ego": 0.06931720972061158, "sim_compute_robot_state-npc0": 0.0662599277496338, "sim_compute_robot_state-npc1": 0.06543546597162883, "sim_compute_robot_state-npc2": 0.06383167584737141, "sim_compute_robot_state-npc3": 0.06615036249160766}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022110630442246686, "sim_physics": 0.17754008213678996, "survival_time": 14.950000000000076, "driven_lanedir": -0.0026260103896547093, "sim_render-ego": 0.060679638385772706, "in-drivable-lane": 7.650000000000045, "agent_compute-ego": 0.14458092530568442, "deviation-heading": 5.45365698365684, "set_robot_commands": 0.08972249269485473, "deviation-center-line": 0.42171601886215854, "driven_lanedir_consec": -0.0026260103896547093, "sim_compute_sim_state": 0.03707813898722331, "sim_compute_performance-ego": 0.06896248817443848, "sim_compute_robot_state-ego": 0.07033044020334879, "sim_compute_robot_state-npc0": 0.06844461997350057, "sim_compute_robot_state-npc1": 0.06823386907577515, "sim_compute_robot_state-npc2": 0.06761085430781047, "sim_compute_robot_state-npc3": 0.06573898235956828}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.02586368946991136, "sim_physics": 0.16797231753667197, "survival_time": 14.950000000000076, "driven_lanedir": 0.00047115201695890896, "sim_render-ego": 0.05922606865564982, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.14354461908340457, "deviation-heading": 5.828528410212024, "set_robot_commands": 0.08854663848876954, "deviation-center-line": 0.016750786693997155, "driven_lanedir_consec": 0.00047115201695890896, "sim_compute_sim_state": 0.03637204567591349, "sim_compute_performance-ego": 0.06510189692179362, "sim_compute_robot_state-ego": 0.0677297329902649, "sim_compute_robot_state-npc0": 0.06519328912099202, "sim_compute_robot_state-npc1": 0.06378753900527954, "sim_compute_robot_state-npc2": 0.0635193641980489, "sim_compute_robot_state-npc3": 0.0632089376449585}}
set_robot_commands_max	0.09916705052057902
set_robot_commands_mean	0.09264793252944946
set_robot_commands_median	0.08972249269485473
set_robot_commands_min	0.08854663848876954
sim_compute_performance-ego_max	0.07055665095647176
sim_compute_performance-ego_mean	0.06777349042892457
sim_compute_performance-ego_median	0.06896248817443848
sim_compute_performance-ego_min	0.06382555564244588
sim_compute_robot_state-ego_max	0.0754297685623169
sim_compute_robot_state-ego_mean	0.07144329341252645
sim_compute_robot_state-ego_median	0.07033044020334879
sim_compute_robot_state-ego_min	0.0677297329902649
sim_compute_robot_state-npc0_max	0.07087954918543497
sim_compute_robot_state-npc0_mean	0.0680898429552714
sim_compute_robot_state-npc0_median	0.06844461997350057
sim_compute_robot_state-npc0_min	0.06519328912099202
sim_compute_robot_state-npc1_max	0.0712161922454834
sim_compute_robot_state-npc1_mean	0.06778918425242106
sim_compute_robot_state-npc1_median	0.06823386907577515
sim_compute_robot_state-npc1_min	0.06378753900527954
sim_compute_robot_state-npc2_max	0.07112247228622437
sim_compute_robot_state-npc2_mean	0.06710962549845378
sim_compute_robot_state-npc2_median	0.06761085430781047
sim_compute_robot_state-npc2_min	0.0635193641980489
sim_compute_robot_state-npc3_max	0.07032714049021403
sim_compute_robot_state-npc3_mean	0.06699392096201578
sim_compute_robot_state-npc3_median	0.06615036249160766
sim_compute_robot_state-npc3_min	0.0632089376449585
sim_compute_sim_state_max	0.040773595174153646
sim_compute_sim_state_mean	0.03819099299112955
sim_compute_sim_state_median	0.037281320095062256
sim_compute_sim_state_min	0.03637204567591349
sim_physics_max	0.19728731314341227
sim_physics_mean	0.17883449188868203
sim_physics_median	0.17754008213678996
sim_physics_min	0.16797231753667197
sim_render-ego_max	0.06221700112024943
sim_render-ego_mean	0.06034415054321289
sim_render-ego_median	0.060679638385772706
sim_render-ego_min	0.05778519550959269
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20152

2973

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 09:47:28+00:00

2019-04-25 10:00:07+00:00

0:12:39

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20152-465179', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20152-465179', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20152-465179', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20140

2988

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:42:23+00:00

2019-04-25 09:46:57+00:00

0:04:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20135

2994

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:41:06+00:00

2019-04-25 09:41:47+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20128

3006

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:40:01+00:00

2019-04-25 09:40:40+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20123

3018

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:39:12+00:00

2019-04-25 09:39:49+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20120

3026

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:38:21+00:00

2019-04-25 09:39:04+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20116

3027

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:37:22+00:00

2019-04-25 09:37:53+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20111

3035

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:35:08+00:00

2019-04-25 09:36:50+00:00

0:01:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20110

3043

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:33:56+00:00

2019-04-25 09:34:27+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20107

3046

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:32:46+00:00

2019-04-25 09:33:17+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20104

3051

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:28:41+00:00

2019-04-25 09:32:14+00:00

0:03:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20090

2873

Peter Almasi 🇭🇺

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 09:22:54+00:00

2019-04-25 09:28:26+00:00

0:05:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.10563158933839034
survival_time_median	1.3500000000000003
deviation-center-line_median	0.08219095297775313
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18011160578046526
agent_compute-ego_mean	0.15800786445996265
agent_compute-ego_median	0.15023147618329083
agent_compute-ego_min	0.14608143505297208
deviation-center-line_max	0.09860305266375256
deviation-center-line_mean	0.0776887942692367
deviation-center-line_min	0.05071581267234654
deviation-heading_max	0.944939478532231
deviation-heading_mean	0.7786647384330656
deviation-heading_median	0.7649476961349609
deviation-heading_min	0.5742714403633584
driven_any_max	0.30894716807732786
driven_any_mean	0.20622907670199347
driven_any_median	0.1838838108609466
driven_any_min	0.09948730623034575
driven_lanedir_consec_max	0.24433863555738888
driven_lanedir_consec_mean	0.14291692873673828
driven_lanedir_consec_min	0.0663556819737896
driven_lanedir_max	0.24433863555738888
driven_lanedir_mean	0.14291692873673828
driven_lanedir_median	0.10563158933839034
driven_lanedir_min	0.0663556819737896
in-drivable-lane_max	0.10000000000000007
in-drivable-lane_mean	0.020000000000000014
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2685735962550714, "sim_physics": 0.04466169111190304, "survival_time": 1.5500000000000007, "driven_lanedir": 0.2000460334909313, "sim_render-ego": 0.05867785792196951, "in-drivable-lane": 0, "agent_compute-ego": 0.1654350834508096, "deviation-heading": 0.867398720103499, "set_robot_commands": 0.09096466341326312, "deviation-center-line": 0.09860305266375256, "driven_lanedir_consec": 0.2000460334909313, "sim_compute_sim_state": 0.038622402375744234, "sim_compute_performance-ego": 0.06528541349595593, "sim_compute_robot_state-ego": 0.07229033593208559}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1702535020862758, "sim_physics": 0.037452141443888344, "survival_time": 1.3500000000000003, "driven_lanedir": 0.09821270332319132, "sim_render-ego": 0.054888107158519606, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15023147618329083, "deviation-heading": 0.7417663570312791, "set_robot_commands": 0.08206858458342375, "deviation-center-line": 0.05071581267234654, "driven_lanedir_consec": 0.09821270332319132, "sim_compute_sim_state": 0.03312465879652235, "sim_compute_performance-ego": 0.060719039705064565, "sim_compute_robot_state-ego": 0.06630042747214988}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09948730623034575, "sim_physics": 0.03784577470076712, "survival_time": 0.9500000000000004, "driven_lanedir": 0.0663556819737896, "sim_render-ego": 0.05418244161103901, "in-drivable-lane": 0, "agent_compute-ego": 0.14608143505297208, "deviation-heading": 0.5742714403633584, "set_robot_commands": 0.09010700175636692, "deviation-center-line": 0.08383950467600651, "driven_lanedir_consec": 0.0663556819737896, "sim_compute_sim_state": 0.03875771321748432, "sim_compute_performance-ego": 0.06349203461094906, "sim_compute_robot_state-ego": 0.07030833394903886}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1838838108609466, "sim_physics": 0.04113855361938477, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10563158933839034, "sim_render-ego": 0.05875682830810547, "in-drivable-lane": 0, "agent_compute-ego": 0.1481797218322754, "deviation-heading": 0.944939478532231, "set_robot_commands": 0.09063430786132812, "deviation-center-line": 0.07309464835632472, "driven_lanedir_consec": 0.10563158933839034, "sim_compute_sim_state": 0.035854949951171874, "sim_compute_performance-ego": 0.06074633598327637, "sim_compute_robot_state-ego": 0.06628728866577148}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.30894716807732786, "sim_physics": 0.05706296648297991, "survival_time": 1.7500000000000009, "driven_lanedir": 0.24433863555738888, "sim_render-ego": 0.06559361049107143, "in-drivable-lane": 0, "agent_compute-ego": 0.18011160578046526, "deviation-heading": 0.7649476961349609, "set_robot_commands": 0.10275002888270789, "deviation-center-line": 0.08219095297775313, "driven_lanedir_consec": 0.24433863555738888, "sim_compute_sim_state": 0.039894696644374304, "sim_compute_performance-ego": 0.07302002906799317, "sim_compute_robot_state-ego": 0.08560257639203753}}
set_robot_commands_max	0.10275002888270789
set_robot_commands_mean	0.09130491729941796
set_robot_commands_median	0.09063430786132812
set_robot_commands_min	0.08206858458342375
sim_compute_performance-ego_max	0.07302002906799317
sim_compute_performance-ego_mean	0.06465257057264781
sim_compute_performance-ego_median	0.06349203461094906
sim_compute_performance-ego_min	0.060719039705064565
sim_compute_robot_state-ego_max	0.08560257639203753
sim_compute_robot_state-ego_mean	0.07215779248221668
sim_compute_robot_state-ego_median	0.07030833394903886
sim_compute_robot_state-ego_min	0.06628728866577148
sim_compute_sim_state_max	0.039894696644374304
sim_compute_sim_state_mean	0.03725088419705942
sim_compute_sim_state_median	0.038622402375744234
sim_compute_sim_state_min	0.03312465879652235
sim_physics_max	0.05706296648297991
sim_physics_mean	0.04363222547178464
sim_physics_median	0.04113855361938477
sim_physics_min	0.037452141443888344
sim_render-ego_max	0.06559361049107143
sim_render-ego_mean	0.058419769098141006
sim_render-ego_median	0.05867785792196951
sim_render-ego_min	0.05418244161103901
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.3700000000000006
survival_time_min	0.9500000000000004

No reset possible

20050

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 09:00:22+00:00

2019-04-25 09:22:26+00:00

0:22:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7406162049123841
survival_time_median	9.950000000000006
deviation-center-line_median	0.3302177143601141
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16425176337361336
agent_compute-ego_mean	0.15149367309054926
agent_compute-ego_median	0.15023934024654023
agent_compute-ego_min	0.1447388172149658
deviation-center-line_max	0.6904628736300545
deviation-center-line_mean	0.3874259749000404
deviation-center-line_min	0.2530034862371619
deviation-heading_max	1.0778162767766089
deviation-heading_mean	0.8215479365254513
deviation-heading_median	0.9150868055674838
deviation-heading_min	0.3781055846447399
driven_any_max	2.20273818289615
driven_any_mean	1.2469484705963905
driven_any_median	1.4279632190835694
driven_any_min	0.4328289963250949
driven_lanedir_consec_max	2.201596053570166
driven_lanedir_consec_mean	1.1015078923939634
driven_lanedir_consec_min	0.4219705604336601
driven_lanedir_max	2.201596053570166
driven_lanedir_mean	1.1015543630441058
driven_lanedir_median	0.7406162049123841
driven_lanedir_min	0.4219705604336601
in-drivable-lane_max	4.550000000000018
in-drivable-lane_mean	0.9100000000000036
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.6645051945479123, "sim_physics": 0.18263817458173592, "survival_time": 11.450000000000028, "driven_lanedir": 1.6584103880801533, "sim_render-ego": 0.05840702452513849, "in-drivable-lane": 0, "agent_compute-ego": 0.14737046129318304, "deviation-heading": 0.9150868055674838, "set_robot_commands": 0.08860089893424354, "deviation-center-line": 0.6904628736300545, "driven_lanedir_consec": 1.6581780348294406, "sim_compute_sim_state": 0.03721077265177231, "sim_compute_performance-ego": 0.06380482948503119, "sim_compute_robot_state-ego": 0.06777628228133423, "sim_compute_robot_state-npc0": 0.06489437948668368, "sim_compute_robot_state-npc1": 0.06282027319529171, "sim_compute_robot_state-npc2": 0.06225940025529487, "sim_compute_robot_state-npc3": 0.06296346385406094}, "udem1-1-0": {"driven_any": 0.5067067601292259, "sim_physics": 0.15370917320251465, "survival_time": 3.649999999999995, "driven_lanedir": 0.4851786082241656, "sim_render-ego": 0.059183316688015034, "in-drivable-lane": 0, "agent_compute-ego": 0.15023934024654023, "deviation-heading": 1.0778162767766089, "set_robot_commands": 0.08751670628377836, "deviation-center-line": 0.25585703994298503, "driven_lanedir_consec": 0.4851786082241656, "sim_compute_sim_state": 0.03674356904748368, "sim_compute_performance-ego": 0.06434022237176765, "sim_compute_robot_state-ego": 0.07004274080877435, "sim_compute_robot_state-npc0": 0.06497549030878773, "sim_compute_robot_state-npc1": 0.06495656705882451, "sim_compute_robot_state-npc2": 0.06365240763311517, "sim_compute_robot_state-npc3": 0.06935747682231747}, "udem1-2-0": {"driven_any": 1.4279632190835694, "sim_physics": 0.17443693942161062, "survival_time": 9.950000000000006, "driven_lanedir": 0.7406162049123841, "sim_render-ego": 0.05564133485957007, "in-drivable-lane": 4.550000000000018, "agent_compute-ego": 0.15086798332444387, "deviation-heading": 1.0112025852481552, "set_robot_commands": 0.08690090155481693, "deviation-center-line": 0.3302177143601141, "driven_lanedir_consec": 0.7406162049123841, "sim_compute_sim_state": 0.03726805993660011, "sim_compute_performance-ego": 0.06294391622495411, "sim_compute_robot_state-ego": 0.06600315007732142, "sim_compute_robot_state-npc0": 0.06124833960029947, "sim_compute_robot_state-npc1": 0.06224395162496135, "sim_compute_robot_state-npc2": 0.06284874647705999, "sim_compute_robot_state-npc3": 0.06481235949837383}, "udem1-3-0": {"driven_any": 2.20273818289615, "sim_physics": 0.19433486541112263, "survival_time": 14.950000000000076, "driven_lanedir": 2.201596053570166, "sim_render-ego": 0.05919396956761678, "in-drivable-lane": 0, "agent_compute-ego": 0.1447388172149658, "deviation-heading": 0.3781055846447399, "set_robot_commands": 0.08699873050053915, "deviation-center-line": 0.4075887603298862, "driven_lanedir_consec": 2.201596053570166, "sim_compute_sim_state": 0.03721928199132283, "sim_compute_performance-ego": 0.06514434417088827, "sim_compute_robot_state-ego": 0.06976767698923747, "sim_compute_robot_state-npc0": 0.0655835469563802, "sim_compute_robot_state-npc1": 0.06433459917704264, "sim_compute_robot_state-npc2": 0.0637879713376363, "sim_compute_robot_state-npc3": 0.06396921157836914}, "udem1-4-0": {"driven_any": 0.4328289963250949, "sim_physics": 0.11501739919185638, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4219705604336601, "sim_render-ego": 0.04655298590660095, "in-drivable-lane": 0, "agent_compute-ego": 0.16425176337361336, "deviation-heading": 0.7255284303902685, "set_robot_commands": 0.1414029709994793, "deviation-center-line": 0.2530034862371619, "driven_lanedir_consec": 0.4219705604336601, "sim_compute_sim_state": 0.02929968759417534, "sim_compute_performance-ego": 0.05177886411547661, "sim_compute_robot_state-ego": 0.05438586696982384, "sim_compute_robot_state-npc0": 0.054374419152736664, "sim_compute_robot_state-npc1": 0.05921652913093567, "sim_compute_robot_state-npc2": 0.05336464196443558, "sim_compute_robot_state-npc3": 0.05341874435544014}}
set_robot_commands_max	0.1414029709994793
set_robot_commands_mean	0.09828404165457146
set_robot_commands_median	0.08751670628377836
set_robot_commands_min	0.08690090155481693
sim_compute_performance-ego_max	0.06514434417088827
sim_compute_performance-ego_mean	0.061602435273623565
sim_compute_performance-ego_median	0.06380482948503119
sim_compute_performance-ego_min	0.05177886411547661
sim_compute_robot_state-ego_max	0.07004274080877435
sim_compute_robot_state-ego_mean	0.06559514342529826
sim_compute_robot_state-ego_median	0.06777628228133423
sim_compute_robot_state-ego_min	0.05438586696982384
sim_compute_robot_state-npc0_max	0.0655835469563802
sim_compute_robot_state-npc0_mean	0.06221523510097755
sim_compute_robot_state-npc0_median	0.06489437948668368
sim_compute_robot_state-npc0_min	0.054374419152736664
sim_compute_robot_state-npc1_max	0.06495656705882451
sim_compute_robot_state-npc1_mean	0.06271438403741117
sim_compute_robot_state-npc1_median	0.06282027319529171
sim_compute_robot_state-npc1_min	0.05921652913093567
sim_compute_robot_state-npc2_max	0.0637879713376363
sim_compute_robot_state-npc2_mean	0.061182633533508377
sim_compute_robot_state-npc2_median	0.06284874647705999
sim_compute_robot_state-npc2_min	0.05336464196443558
sim_compute_robot_state-npc3_max	0.06935747682231747
sim_compute_robot_state-npc3_mean	0.06290425122171231
sim_compute_robot_state-npc3_median	0.06396921157836914
sim_compute_robot_state-npc3_min	0.05341874435544014
sim_compute_sim_state_max	0.03726805993660011
sim_compute_sim_state_mean	0.03554827424427086
sim_compute_sim_state_median	0.03721077265177231
sim_compute_sim_state_min	0.02929968759417534
sim_physics_max	0.19433486541112263
sim_physics_mean	0.16402731036176804
sim_physics_median	0.17443693942161062
sim_physics_min	0.11501739919185638
sim_render-ego_max	0.05919396956761678
sim_render-ego_mean	0.05579572630938827
sim_render-ego_median	0.05840702452513849
sim_render-ego_min	0.04655298590660095
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.64000000000002
survival_time_min	3.1999999999999966

No reset possible

20030

2373

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-25 08:48:57+00:00

2019-04-25 09:00:03+00:00

0:11:06

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20030-636334', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20030-636334', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20030-636334', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20017

2392

Liam Paull 🇨🇦

random_agent

step1-simulation

error

2019-04-25 08:46:40+00:00

2019-04-25 08:48:16+00:00

0:01:36

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20009

2436

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 08:45:07+00:00

2019-04-25 08:46:21+00:00

0:01:14

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19979

2505

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:42:43+00:00

2019-04-25 08:44:51+00:00

0:02:08

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19807

2981

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 08:11:20+00:00

2019-04-25 08:42:25+00:00

0:31:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.804593618005029
survival_time_median	14.950000000000076
deviation-center-line_median	0.5600699640934734
in-drivable-lane_median	0.5000000000000071

other stats

agent_compute-ego_max	0.2230733021100362
agent_compute-ego_mean	0.19851434737519943
agent_compute-ego_median	0.20392118374506632
agent_compute-ego_min	0.15415279196185086
deviation-center-line_max	1.4686466928086512
deviation-center-line_mean	0.7942598303087106
deviation-center-line_min	0.3811933235854591
deviation-heading_max	5.170581522468236
deviation-heading_mean	2.9021484339935517
deviation-heading_median	3.509484754434039
deviation-heading_min	0.8901923058765788
driven_any_max	1.3569390568547697
driven_any_mean	1.2550533258050385
driven_any_median	1.3175961573986663
driven_any_min	1.0890356634718037
driven_lanedir_consec_max	1.312697316901062
driven_lanedir_consec_mean	0.8788105362329592
driven_lanedir_consec_min	0.645968898299055
driven_lanedir_max	1.3127126312138755
driven_lanedir_mean	0.9571042224195286
driven_lanedir_median	0.811707762081578
driven_lanedir_min	0.6914383612518578
in-drivable-lane_max	6.700000000000095
in-drivable-lane_mean	2.430000000000034
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3175961573986663, "sim_physics": 0.043598369757334395, "survival_time": 14.950000000000076, "driven_lanedir": 1.3127126312138755, "sim_render-ego": 0.06359947125116984, "in-drivable-lane": 0, "agent_compute-ego": 0.2230733021100362, "deviation-heading": 0.8901923058765788, "set_robot_commands": 0.09725172519683838, "deviation-center-line": 0.3811933235854591, "driven_lanedir_consec": 1.312697316901062, "sim_compute_sim_state": 0.03954624017079671, "sim_compute_performance-ego": 0.06944871425628663, "sim_compute_robot_state-ego": 0.07281028509140014, "sim_compute_robot_state-npc0": 0.06949718077977499, "sim_compute_robot_state-npc1": 0.06967604875564576, "sim_compute_robot_state-npc2": 0.06836436986923218, "sim_compute_robot_state-npc3": 0.06848519802093506}, "udem1-1-0": {"driven_any": 1.333010696316094, "sim_physics": 0.0383921217918396, "survival_time": 14.950000000000076, "driven_lanedir": 0.6914383612518578, "sim_render-ego": 0.05721102237701416, "in-drivable-lane": 6.700000000000095, "agent_compute-ego": 0.20392118374506632, "deviation-heading": 3.509484754434039, "set_robot_commands": 0.08794769287109375, "deviation-center-line": 0.5600699640934734, "driven_lanedir_consec": 0.6914383612518578, "sim_compute_sim_state": 0.03494171460469564, "sim_compute_performance-ego": 0.06267313480377197, "sim_compute_robot_state-ego": 0.06542450030644735, "sim_compute_robot_state-npc0": 0.06479631265004476, "sim_compute_robot_state-npc1": 0.06243656476338704, "sim_compute_robot_state-npc2": 0.06265307664871216, "sim_compute_robot_state-npc3": 0.06431538422902425}, "udem1-2-0": {"driven_any": 1.0890356634718037, "sim_physics": 0.04167094171294533, "survival_time": 12.050000000000036, "driven_lanedir": 0.811707762081578, "sim_render-ego": 0.06282697376868537, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.21699151062866465, "deviation-heading": 5.170581522468236, "set_robot_commands": 0.09672169467720251, "deviation-center-line": 1.0720993316335423, "driven_lanedir_consec": 0.645968898299055, "sim_compute_sim_state": 0.040019385547558795, "sim_compute_performance-ego": 0.06756515225928848, "sim_compute_robot_state-ego": 0.07099126582323763, "sim_compute_robot_state-npc0": 0.07012123586725892, "sim_compute_robot_state-npc1": 0.06831678216388117, "sim_compute_robot_state-npc2": 0.06886121445177007, "sim_compute_robot_state-npc3": 0.0680861463190609}, "udem1-3-0": {"driven_any": 1.3569390568547697, "sim_physics": 0.03809954086939494, "survival_time": 14.950000000000076, "driven_lanedir": 1.165068739545303, "sim_render-ego": 0.06011674960454305, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.19443294843037923, "deviation-heading": 3.9308659073208303, "set_robot_commands": 0.08418012460072835, "deviation-center-line": 1.4686466928086512, "driven_lanedir_consec": 0.939354486707792, "sim_compute_sim_state": 0.03276417255401611, "sim_compute_performance-ego": 0.0609942897160848, "sim_compute_robot_state-ego": 0.06351221879323324, "sim_compute_robot_state-npc0": 0.060502510070800784, "sim_compute_robot_state-npc1": 0.06066583077112834, "sim_compute_robot_state-npc2": 0.06051251729329427, "sim_compute_robot_state-npc3": 0.05891794522603353}, "udem1-4-0": {"driven_any": 1.1786850549838572, "sim_physics": 0.029304029442104897, "survival_time": 12.650000000000045, "driven_lanedir": 0.804593618005029, "sim_render-ego": 0.05133667482217781, "in-drivable-lane": 4.500000000000061, "agent_compute-ego": 0.15415279196185086, "deviation-heading": 1.0096176798680756, "set_robot_commands": 0.06840020111898189, "deviation-center-line": 0.4892898394224271, "driven_lanedir_consec": 0.804593618005029, "sim_compute_sim_state": 0.028655235004048103, "sim_compute_performance-ego": 0.048624600346380546, "sim_compute_robot_state-ego": 0.055066342410362755, "sim_compute_robot_state-npc0": 0.05186477385961962, "sim_compute_robot_state-npc1": 0.05345120637313179, "sim_compute_robot_state-npc2": 0.04909566551329119, "sim_compute_robot_state-npc3": 0.049183105762768166}}
set_robot_commands_max	0.09725172519683838
set_robot_commands_mean	0.08690028769296897
set_robot_commands_median	0.08794769287109375
set_robot_commands_min	0.06840020111898189
sim_compute_performance-ego_max	0.06944871425628663
sim_compute_performance-ego_mean	0.06186117827636248
sim_compute_performance-ego_median	0.06267313480377197
sim_compute_performance-ego_min	0.048624600346380546
sim_compute_robot_state-ego_max	0.07281028509140014
sim_compute_robot_state-ego_mean	0.06556092248493622
sim_compute_robot_state-ego_median	0.06542450030644735
sim_compute_robot_state-ego_min	0.055066342410362755
sim_compute_robot_state-npc0_max	0.07012123586725892
sim_compute_robot_state-npc0_mean	0.06335640264549981
sim_compute_robot_state-npc0_median	0.06479631265004476
sim_compute_robot_state-npc0_min	0.05186477385961962
sim_compute_robot_state-npc1_max	0.06967604875564576
sim_compute_robot_state-npc1_mean	0.06290928656543482
sim_compute_robot_state-npc1_median	0.06243656476338704
sim_compute_robot_state-npc1_min	0.05345120637313179
sim_compute_robot_state-npc2_max	0.06886121445177007
sim_compute_robot_state-npc2_mean	0.061897368755259974
sim_compute_robot_state-npc2_median	0.06265307664871216
sim_compute_robot_state-npc2_min	0.04909566551329119
sim_compute_robot_state-npc3_max	0.06848519802093506
sim_compute_robot_state-npc3_mean	0.061797555911564384
sim_compute_robot_state-npc3_median	0.06431538422902425
sim_compute_robot_state-npc3_min	0.049183105762768166
sim_compute_sim_state_max	0.040019385547558795
sim_compute_sim_state_mean	0.035185349576223074
sim_compute_sim_state_median	0.03494171460469564
sim_compute_sim_state_min	0.028655235004048103
sim_physics_max	0.043598369757334395
sim_physics_mean	0.03821300071472383
sim_physics_median	0.0383921217918396
sim_physics_min	0.029304029442104897
sim_render-ego_max	0.06359947125116984
sim_render-ego_mean	0.059018178364718045
sim_render-ego_median	0.06011674960454305
sim_render-ego_min	0.05133667482217781
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.910000000000062
survival_time_min	12.050000000000036

No reset possible

19779

2762

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 08:00:19+00:00

2019-04-25 08:11:12+00:00

0:10:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4677520238097679
survival_time_median	2.849999999999998
deviation-center-line_median	0.13993923038273243
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.08302836250840571
agent_compute-ego_mean	0.07402585270282655
agent_compute-ego_median	0.06953474722410503
agent_compute-ego_min	0.06867600854035395
deviation-center-line_max	0.441991081977021
deviation-center-line_mean	0.24301419493149473
deviation-center-line_min	0.11233303566656118
deviation-heading_max	1.965590298952019
deviation-heading_mean	0.904977224642509
deviation-heading_median	0.6817498444220604
deviation-heading_min	0.23880859753921196
driven_any_max	2.234618045439434
driven_any_mean	1.1136680430892796
driven_any_median	0.7854280860806753
driven_any_min	0.3734823939695258
driven_lanedir_consec_max	1.4162453958283412
driven_lanedir_consec_mean	0.7217431069832176
driven_lanedir_consec_min	0.3618460409658957
driven_lanedir_max	1.4162453958283412
driven_lanedir_mean	0.7217431069832176
driven_lanedir_median	0.4677520238097679
driven_lanedir_min	0.3618460409658957
in-drivable-lane_max	3.2999999999999883
in-drivable-lane_mean	0.9999999999999964
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.04394580148587561, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.06070373468338304, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.06867600854035395, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.08907294880812335, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.036941589063899535, "sim_compute_performance-ego": 0.06668823539831076, "sim_compute_robot_state-ego": 0.06868417095986142, "sim_compute_robot_state-npc0": 0.06418581525231623, "sim_compute_robot_state-npc1": 0.06512318447137334, "sim_compute_robot_state-npc2": 0.06618324662469754, "sim_compute_robot_state-npc3": 0.06360664489162955}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.03871578291842812, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.05924986538134123, "in-drivable-lane": 0, "agent_compute-ego": 0.06953474722410503, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.09370692780143336, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.033872522805866445, "sim_compute_performance-ego": 0.06243668104472913, "sim_compute_robot_state-ego": 0.06749773025512695, "sim_compute_robot_state-npc0": 0.07011829551897551, "sim_compute_robot_state-npc1": 0.06549571062389173, "sim_compute_robot_state-npc2": 0.06351900100708008, "sim_compute_robot_state-npc3": 0.061281668512444744}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.052639668447929513, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.0673653201053017, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.08302836250840571, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.1145414804157458, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.04202361692462051, "sim_compute_performance-ego": 0.07371186791804799, "sim_compute_robot_state-ego": 0.08494306447213157, "sim_compute_robot_state-npc0": 0.07604583104451497, "sim_compute_robot_state-npc1": 0.07409911824945818, "sim_compute_robot_state-npc2": 0.07461079798246685, "sim_compute_robot_state-npc3": 0.07384359209161055}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.050445556640625, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.07357888751559788, "in-drivable-lane": 0, "agent_compute-ego": 0.08016734653049046, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.10809226389284488, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.042838847195660626, "sim_compute_performance-ego": 0.074295061605948, "sim_compute_robot_state-ego": 0.08050006407278555, "sim_compute_robot_state-npc0": 0.07635037987320512, "sim_compute_robot_state-npc1": 0.0746474442658601, "sim_compute_robot_state-npc2": 0.07635705559341996, "sim_compute_robot_state-npc3": 0.0781478175410518}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.04416789138127887, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.06264895295339917, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06872279871077765, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.09352152877383764, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.03771913430047414, "sim_compute_performance-ego": 0.06699701717921666, "sim_compute_robot_state-ego": 0.06925261777544779, "sim_compute_robot_state-npc0": 0.06874346543872167, "sim_compute_robot_state-npc1": 0.07277894020080566, "sim_compute_robot_state-npc2": 0.06658168822999984, "sim_compute_robot_state-npc3": 0.06611907671368311}}
set_robot_commands_max	0.1145414804157458
set_robot_commands_mean	0.099787029938397
set_robot_commands_median	0.09370692780143336
set_robot_commands_min	0.08907294880812335
sim_compute_performance-ego_max	0.074295061605948
sim_compute_performance-ego_mean	0.06882577262925052
sim_compute_performance-ego_median	0.06699701717921666
sim_compute_performance-ego_min	0.06243668104472913
sim_compute_robot_state-ego_max	0.08494306447213157
sim_compute_robot_state-ego_mean	0.07417552950707065
sim_compute_robot_state-ego_median	0.06925261777544779
sim_compute_robot_state-ego_min	0.06749773025512695
sim_compute_robot_state-npc0_max	0.07635037987320512
sim_compute_robot_state-npc0_mean	0.0710887574255467
sim_compute_robot_state-npc0_median	0.07011829551897551
sim_compute_robot_state-npc0_min	0.06418581525231623
sim_compute_robot_state-npc1_max	0.0746474442658601
sim_compute_robot_state-npc1_mean	0.07042887956227781
sim_compute_robot_state-npc1_median	0.07277894020080566
sim_compute_robot_state-npc1_min	0.06512318447137334
sim_compute_robot_state-npc2_max	0.07635705559341996
sim_compute_robot_state-npc2_mean	0.06945035788753286
sim_compute_robot_state-npc2_median	0.06658168822999984
sim_compute_robot_state-npc2_min	0.06351900100708008
sim_compute_robot_state-npc3_max	0.0781478175410518
sim_compute_robot_state-npc3_mean	0.06859975995008397
sim_compute_robot_state-npc3_median	0.06611907671368311
sim_compute_robot_state-npc3_min	0.061281668512444744
sim_compute_sim_state_max	0.042838847195660626
sim_compute_sim_state_mean	0.03867914205810426
sim_compute_sim_state_median	0.03771913430047414
sim_compute_sim_state_min	0.033872522805866445
sim_physics_max	0.052639668447929513
sim_physics_mean	0.04598294017482742
sim_physics_median	0.04416789138127887
sim_physics_min	0.03871578291842812
sim_render-ego_max	0.07357888751559788
sim_render-ego_mean	0.06470935212780461
sim_render-ego_median	0.06264895295339917
sim_render-ego_min	0.05924986538134123
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	4.049999999999993
survival_time_min	1.3500000000000003

No reset possible

19739

2964

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 07:45:26+00:00

2019-04-25 08:00:04+00:00

0:14:38

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19739-331507', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19739-331507', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19739-331507', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19719

3039

challenge-aido_LF-template-pytorch

step1-simulation

error