Evaluator 802

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 10:02:21+00:00

2019-04-26 10:20:22+00:00

0:18:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6250264656781446
survival_time_median	10.90000000000002
deviation-center-line_median	0.5422997712653593
in-drivable-lane_median	1.4499999999999984

other stats

agent_compute-ego_max	0.23937743954953897
agent_compute-ego_mean	0.2258828667652952
agent_compute-ego_median	0.22227419078896896
agent_compute-ego_min	0.21644935369491575
deviation-center-line_max	0.9470264608408818
deviation-center-line_mean	0.6182094447664657
deviation-center-line_min	0.3745020402384821
deviation-heading_max	3.705553267616144
deviation-heading_mean	1.5847864741031266
deviation-heading_median	0.9951355441879848
deviation-heading_min	0.7229619238029581
driven_any_max	1.3742193923990669
driven_any_mean	0.8474478263628755
driven_any_median	0.9930915156874642
driven_any_min	0.2972501539274738
driven_lanedir_consec_max	0.8047275709139564
driven_lanedir_consec_mean	0.5979667912917446
driven_lanedir_consec_min	0.2911080611451089
driven_lanedir_max	0.8047275709139564
driven_lanedir_mean	0.5979667912917446
driven_lanedir_median	0.6250264656781446
driven_lanedir_min	0.2911080611451089
in-drivable-lane_max	6.6500000000000945
in-drivable-lane_mean	2.360000000000026
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9930915156874642, "sim_physics": 0.11887399756580318, "survival_time": 10.90000000000002, "driven_lanedir": 0.6250264656781446, "sim_render-ego": 0.06293849004518001, "in-drivable-lane": 3.7000000000000375, "agent_compute-ego": 0.22227419078896896, "deviation-heading": 0.9951355441879848, "set_robot_commands": 0.10042692980635055, "deviation-center-line": 0.5422997712653593, "driven_lanedir_consec": 0.6250264656781446, "sim_compute_sim_state": 0.04043598021935979, "sim_compute_performance-ego": 0.07018871591725481, "sim_compute_robot_state-ego": 0.0751487891608422}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0304377588728757, "sim_physics": 0.133458318963515, "survival_time": 11.300000000000026, "driven_lanedir": 0.8047275709139564, "sim_render-ego": 0.06655768483085969, "in-drivable-lane": 1.4499999999999984, "agent_compute-ego": 0.23937743954953897, "deviation-heading": 3.705553267616144, "set_robot_commands": 0.1066938997369952, "deviation-center-line": 0.9470264608408818, "driven_lanedir_consec": 0.8047275709139564, "sim_compute_sim_state": 0.04193880494716948, "sim_compute_performance-ego": 0.07315447056187993, "sim_compute_robot_state-ego": 0.08175035388068816}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2972501539274738, "sim_physics": 0.10465679509299142, "survival_time": 3.4999999999999956, "driven_lanedir": 0.2911080611451089, "sim_render-ego": 0.06643908705030169, "in-drivable-lane": 0, "agent_compute-ego": 0.22945302895137243, "deviation-heading": 0.7229619238029581, "set_robot_commands": 0.09951883724757604, "deviation-center-line": 0.3745020402384821, "driven_lanedir_consec": 0.2911080611451089, "sim_compute_sim_state": 0.04171336718967983, "sim_compute_performance-ego": 0.07409087930406844, "sim_compute_robot_state-ego": 0.07926464421408518}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5422403109274971, "sim_physics": 0.1108180968487849, "survival_time": 6.099999999999986, "driven_lanedir": 0.525663595621864, "sim_render-ego": 0.06329477028768571, "in-drivable-lane": 0, "agent_compute-ego": 0.2218603208416798, "deviation-heading": 1.5211104268059048, "set_robot_commands": 0.10074434905755716, "deviation-center-line": 0.440938382172192, "driven_lanedir_consec": 0.525663595621864, "sim_compute_sim_state": 0.03987364299961778, "sim_compute_performance-ego": 0.06955563044938885, "sim_compute_robot_state-ego": 0.07443230269385166}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3742193923990669, "sim_physics": 0.1329625646273295, "survival_time": 14.950000000000076, "driven_lanedir": 0.743308263099649, "sim_render-ego": 0.06287271340688069, "in-drivable-lane": 6.6500000000000945, "agent_compute-ego": 0.21644935369491575, "deviation-heading": 0.979171208102641, "set_robot_commands": 0.09871049642562868, "deviation-center-line": 0.7862805693154133, "driven_lanedir_consec": 0.743308263099649, "sim_compute_sim_state": 0.03931148131688436, "sim_compute_performance-ego": 0.06968971888224283, "sim_compute_robot_state-ego": 0.07529893636703491}}
set_robot_commands_max	0.1066938997369952
set_robot_commands_mean	0.10121890245482151
set_robot_commands_median	0.10042692980635055
set_robot_commands_min	0.09871049642562868
sim_compute_performance-ego_max	0.07409087930406844
sim_compute_performance-ego_mean	0.07133588302296698
sim_compute_performance-ego_median	0.07018871591725481
sim_compute_performance-ego_min	0.06955563044938885
sim_compute_robot_state-ego_max	0.08175035388068816
sim_compute_robot_state-ego_mean	0.07717900526330042
sim_compute_robot_state-ego_median	0.07529893636703491
sim_compute_robot_state-ego_min	0.07443230269385166
sim_compute_sim_state_max	0.04193880494716948
sim_compute_sim_state_mean	0.04065465533454225
sim_compute_sim_state_median	0.04043598021935979
sim_compute_sim_state_min	0.03931148131688436
sim_physics_max	0.133458318963515
sim_physics_mean	0.1201539546196848
sim_physics_median	0.11887399756580318
sim_physics_min	0.10465679509299142
sim_render-ego_max	0.06655768483085969
sim_render-ego_mean	0.06442054912418156
sim_render-ego_median	0.06329477028768571
sim_render-ego_min	0.06287271340688069
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.35000000000002
survival_time_min	3.4999999999999956

No reset possible

20650

3067

Lei Chen

PredictorLast

aido2-PRED

step1-simulation

success

2019-04-26 06:02:04+00:00

2019-04-26 06:02:36+00:00

0:00:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11033180743452196
error_L2	0.02059824649323177

No reset possible

20627

2412

jiang peng

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 15:00:33+00:00

2019-04-25 15:33:29+00:00

0:32:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3401138062222346
survival_time_median	14.950000000000076
deviation-center-line_median	1.0020906406379184
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.17927666107813517
agent_compute-ego_mean	0.14797736247380577
agent_compute-ego_median	0.13323888937632242
agent_compute-ego_min	0.13281814416249593
deviation-center-line_max	1.5200592903810726
deviation-center-line_mean	0.9234183234449912
deviation-center-line_min	0.28265732013386635
deviation-heading_max	8.488415384770875
deviation-heading_mean	7.083018992579007
deviation-heading_median	7.089126128887597
deviation-heading_min	5.694184625828925
driven_any_max	4.378320939674843
driven_any_mean	4.378320939674839
driven_any_median	4.378320939674839
driven_any_min	4.378320939674832
driven_lanedir_consec_max	-1.2731239579032123
driven_lanedir_consec_mean	-1.331671690718409
driven_lanedir_consec_min	-1.3673592918445536
driven_lanedir_max	-1.366645308459499
driven_lanedir_mean	-2.07783178706321
driven_lanedir_median	-2.2611460594308452
driven_lanedir_min	-2.711272030505655
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.630000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"udem1-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.23120371580123905, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272030505655, "sim_render-ego": 0.06772223393122355, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17927666107813517, "deviation-heading": 8.371542541054898, "set_robot_commands": 0.1018516206741333, "deviation-center-line": 1.5194332899756515, "driven_lanedir_consec": -1.3111160891625455, "sim_compute_sim_state": 0.04221213499704997, "sim_compute_performance-ego": 0.0735639222462972, "sim_compute_robot_state-ego": 0.0800350046157837, "sim_compute_robot_state-npc0": 0.07348361810048422, "sim_compute_robot_state-npc1": 0.07417685667673747, "sim_compute_robot_state-npc2": 0.07526093324025472, "sim_compute_robot_state-npc3": 0.07496471405029297}, "udem1-1-0": {"driven_any": 4.378320939674842, "sim_physics": 0.19995825370152792, "survival_time": 14.950000000000076, "driven_lanedir": -2.682736245075499, "sim_render-ego": 0.06095462958017985, "in-drivable-lane": 2.2000000000000113, "agent_compute-ego": 0.16140578031539918, "deviation-heading": 8.488415384770875, "set_robot_commands": 0.09125607967376707, "deviation-center-line": 1.5200592903810726, "driven_lanedir_consec": -1.2731239579032123, "sim_compute_sim_state": 0.03741492430369059, "sim_compute_performance-ego": 0.06578234275182088, "sim_compute_robot_state-ego": 0.0710533046722412, "sim_compute_robot_state-npc0": 0.06796914418538412, "sim_compute_robot_state-npc1": 0.06789377371470133, "sim_compute_robot_state-npc2": 0.06662328561147055, "sim_compute_robot_state-npc3": 0.06705765724182129}, "udem1-2-0": {"driven_any": 4.378320939674832, "sim_physics": 0.15742351293563842, "survival_time": 14.950000000000076, "driven_lanedir": -1.366645308459499, "sim_render-ego": 0.049484143257141115, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.13314733743667603, "deviation-heading": 5.771826282352732, "set_robot_commands": 0.07276107549667359, "deviation-center-line": 0.2928510760964476, "driven_lanedir_consec": -1.366645308459499, "sim_compute_sim_state": 0.030698671340942386, "sim_compute_performance-ego": 0.05419464031855265, "sim_compute_robot_state-ego": 0.05755295832951864, "sim_compute_robot_state-npc0": 0.05630592584609986, "sim_compute_robot_state-npc1": 0.05488625526428223, "sim_compute_robot_state-npc2": 0.053824347654978434, "sim_compute_robot_state-npc3": 0.053472120761871335}, "udem1-3-0": {"driven_any": 4.378320939674839, "sim_physics": 0.1608731245994568, "survival_time": 14.950000000000076, "driven_lanedir": -1.3673592918445536, "sim_render-ego": 0.05189536492029826, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.13323888937632242, "deviation-heading": 5.694184625828925, "set_robot_commands": 0.07228706995646159, "deviation-center-line": 0.28265732013386635, "driven_lanedir_consec": -1.3673592918445536, "sim_compute_sim_state": 0.031433512369791666, "sim_compute_performance-ego": 0.05466536204020182, "sim_compute_robot_state-ego": 0.05860004107157389, "sim_compute_robot_state-npc0": 0.0550093666712443, "sim_compute_robot_state-npc1": 0.05435237328211467, "sim_compute_robot_state-npc2": 0.054208648204803464, "sim_compute_robot_state-npc3": 0.05382182121276855}, "udem1-4-0": {"driven_any": 4.378320939674835, "sim_physics": 0.16723283926645915, "survival_time": 14.950000000000076, "driven_lanedir": -2.2611460594308452, "sim_render-ego": 0.05042739947636922, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.13281814416249593, "deviation-heading": 7.089126128887597, "set_robot_commands": 0.07224876324335734, "deviation-center-line": 1.0020906406379184, "driven_lanedir_consec": -1.3401138062222346, "sim_compute_sim_state": 0.03152693192164103, "sim_compute_performance-ego": 0.05386229912439982, "sim_compute_robot_state-ego": 0.05771925131479899, "sim_compute_robot_state-npc0": 0.055528733730316165, "sim_compute_robot_state-npc1": 0.05500344753265381, "sim_compute_robot_state-npc2": 0.05384750207265218, "sim_compute_robot_state-npc3": 0.05530192772547404}}
set_robot_commands_max	0.1018516206741333
set_robot_commands_mean	0.08208092180887858
set_robot_commands_median	0.07276107549667359
set_robot_commands_min	0.07224876324335734
sim_compute_performance-ego_max	0.0735639222462972
sim_compute_performance-ego_mean	0.06041371329625448
sim_compute_performance-ego_median	0.05466536204020182
sim_compute_performance-ego_min	0.05386229912439982
sim_compute_robot_state-ego_max	0.0800350046157837
sim_compute_robot_state-ego_mean	0.06499211200078328
sim_compute_robot_state-ego_median	0.05860004107157389
sim_compute_robot_state-ego_min	0.05755295832951864
sim_compute_robot_state-npc0_max	0.07348361810048422
sim_compute_robot_state-npc0_mean	0.06165935770670574
sim_compute_robot_state-npc0_median	0.05630592584609986
sim_compute_robot_state-npc0_min	0.0550093666712443
sim_compute_robot_state-npc1_max	0.07417685667673747
sim_compute_robot_state-npc1_mean	0.061262541294097896
sim_compute_robot_state-npc1_median	0.05500344753265381
sim_compute_robot_state-npc1_min	0.05435237328211467
sim_compute_robot_state-npc2_max	0.07526093324025472
sim_compute_robot_state-npc2_mean	0.06075294335683186
sim_compute_robot_state-npc2_median	0.054208648204803464
sim_compute_robot_state-npc2_min	0.053824347654978434
sim_compute_robot_state-npc3_max	0.07496471405029297
sim_compute_robot_state-npc3_mean	0.06092364819844563
sim_compute_robot_state-npc3_median	0.05530192772547404
sim_compute_robot_state-npc3_min	0.053472120761871335
sim_compute_sim_state_max	0.04221213499704997
sim_compute_sim_state_mean	0.03465723498662313
sim_compute_sim_state_median	0.03152693192164103
sim_compute_sim_state_min	0.030698671340942386
sim_physics_max	0.23120371580123905
sim_physics_mean	0.18333828926086423
sim_physics_median	0.16723283926645915
sim_physics_min	0.15742351293563842
sim_render-ego_max	0.06772223393122355
sim_render-ego_mean	0.0560967542330424
sim_render-ego_median	0.05189536492029826
sim_render-ego_min	0.049484143257141115
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20613

2375

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

host-error

2019-04-25 14:59:11+00:00

2019-04-25 15:00:25+00:00

0:01:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20613-86732', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20613-86732', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20613-86732', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20600

2395

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-25 14:50:03+00:00

2019-04-25 14:58:56+00:00

0:08:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.1516543168288011
agent_compute-ego_mean	0.1416439618153309
agent_compute-ego_median	0.13931232578349564
agent_compute-ego_min	0.13302529299700702
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.1478794385802071, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.0648696557530817, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.13931232578349564, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09665611105145148, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.040442984059171856, "sim_compute_performance-ego": 0.07012257036173118, "sim_compute_robot_state-ego": 0.07367327078333441, "sim_compute_robot_state-npc0": 0.07095887526026312, "sim_compute_robot_state-npc1": 0.07414214566068829, "sim_compute_robot_state-npc2": 0.07258103928476009, "sim_compute_robot_state-npc3": 0.071733258805185}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.1736433872809777, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.07137065667372483, "in-drivable-lane": 0, "agent_compute-ego": 0.1516543168288011, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.10750080071962796, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.04290324908036452, "sim_compute_performance-ego": 0.08014176442072941, "sim_compute_robot_state-ego": 0.09247145285973182, "sim_compute_robot_state-npc0": 0.07586325131929837, "sim_compute_robot_state-npc1": 0.07670900454887977, "sim_compute_robot_state-npc2": 0.07594358004056491, "sim_compute_robot_state-npc3": 0.07429666702563946}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.17971039445776688, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.06724561829315989, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.1473640140734221, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.10728514194488524, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.04181136896735743, "sim_compute_performance-ego": 0.07583106818952058, "sim_compute_robot_state-ego": 0.08818992815519634, "sim_compute_robot_state-npc0": 0.07403175768099333, "sim_compute_robot_state-npc1": 0.07463952114707545, "sim_compute_robot_state-npc2": 0.0733886674830788, "sim_compute_robot_state-npc3": 0.07479799421210039}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.1654754348948032, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.06233955033217804, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.13686385939392862, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.10257924055751366, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.039389196830459786, "sim_compute_performance-ego": 0.07017249397084682, "sim_compute_robot_state-ego": 0.07496933997431889, "sim_compute_robot_state-npc0": 0.07217703288114524, "sim_compute_robot_state-npc1": 0.07426694676845888, "sim_compute_robot_state-npc2": 0.07113017613374734, "sim_compute_robot_state-npc3": 0.0720012942446938}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.1551817081592701, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06464268543102124, "in-drivable-lane": 0, "agent_compute-ego": 0.13302529299700702, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.09803777270846896, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.03894858007077818, "sim_compute_performance-ego": 0.07056634514420121, "sim_compute_robot_state-ego": 0.07429619188661929, "sim_compute_robot_state-npc0": 0.07331601778666179, "sim_compute_robot_state-npc1": 0.07040184515493887, "sim_compute_robot_state-npc2": 0.0716324735570837, "sim_compute_robot_state-npc3": 0.06923313494081851}}
set_robot_commands_max	0.10750080071962796
set_robot_commands_mean	0.10241181339638948
set_robot_commands_median	0.10257924055751366
set_robot_commands_min	0.09665611105145148
sim_compute_performance-ego_max	0.08014176442072941
sim_compute_performance-ego_mean	0.07336684841740584
sim_compute_performance-ego_median	0.07056634514420121
sim_compute_performance-ego_min	0.07012257036173118
sim_compute_robot_state-ego_max	0.09247145285973182
sim_compute_robot_state-ego_mean	0.08072003673184015
sim_compute_robot_state-ego_median	0.07496933997431889
sim_compute_robot_state-ego_min	0.07367327078333441
sim_compute_robot_state-npc0_max	0.07586325131929837
sim_compute_robot_state-npc0_mean	0.07326938698567238
sim_compute_robot_state-npc0_median	0.07331601778666179
sim_compute_robot_state-npc0_min	0.07095887526026312
sim_compute_robot_state-npc1_max	0.07670900454887977
sim_compute_robot_state-npc1_mean	0.07403189265600825
sim_compute_robot_state-npc1_median	0.07426694676845888
sim_compute_robot_state-npc1_min	0.07040184515493887
sim_compute_robot_state-npc2_max	0.07594358004056491
sim_compute_robot_state-npc2_mean	0.07293518729984697
sim_compute_robot_state-npc2_median	0.07258103928476009
sim_compute_robot_state-npc2_min	0.07113017613374734
sim_compute_robot_state-npc3_max	0.07479799421210039
sim_compute_robot_state-npc3_mean	0.07241246984568743
sim_compute_robot_state-npc3_median	0.0720012942446938
sim_compute_robot_state-npc3_min	0.06923313494081851
sim_compute_sim_state_max	0.04290324908036452
sim_compute_sim_state_mean	0.04069907580162635
sim_compute_sim_state_median	0.040442984059171856
sim_compute_sim_state_min	0.03894858007077818
sim_physics_max	0.17971039445776688
sim_physics_mean	0.164378072674605
sim_physics_median	0.1654754348948032
sim_physics_min	0.1478794385802071
sim_render-ego_max	0.07137065667372483
sim_render-ego_mean	0.06609363329663315
sim_render-ego_median	0.0648696557530817
sim_render-ego_min	0.06233955033217804
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20552

2449

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:10:19+00:00

2019-04-25 14:49:27+00:00

0:39:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3401047463162574
survival_time_median	14.950000000000076
deviation-center-line_median	1.0020903216633783
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.18214135646820068
agent_compute-ego_mean	0.1749527571996053
agent_compute-ego_median	0.1734783411026001
agent_compute-ego_min	0.16745083491007487
deviation-center-line_max	1.5200593248921646
deviation-center-line_mean	0.9234182563504314
deviation-center-line_min	0.2826572656098777
deviation-heading_max	8.488415384770876
deviation-heading_mean	7.083018992579007
deviation-heading_median	7.0891261288876
deviation-heading_min	5.694184625828924
driven_any_max	4.378320939674847
driven_any_mean	4.378320939674838
driven_any_median	4.378320939674838
driven_any_min	4.378320939674826
driven_lanedir_consec_max	-1.273127772600478
driven_lanedir_consec_mean	-1.3316670653980158
driven_lanedir_consec_min	-1.367352616124776
driven_lanedir_max	-1.3666338643676914
driven_lanedir_mean	-2.0778269948498607
driven_lanedir_median	-2.2611414102685594
driven_lanedir_min	-2.711272268924253
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.630000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.1987788160641988, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272268924253, "sim_render-ego": 0.06329557577768961, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17848833560943603, "deviation-heading": 8.371542541054902, "set_robot_commands": 0.10021490335464478, "deviation-center-line": 1.5194332589791988, "driven_lanedir_consec": -1.3111163275808764, "sim_compute_sim_state": 0.04035000960032145, "sim_compute_performance-ego": 0.07045668601989746, "sim_compute_robot_state-ego": 0.07707824468612672, "sim_compute_robot_state-npc0": 0.07101962566375733, "sim_compute_robot_state-npc1": 0.07085400501887004, "sim_compute_robot_state-npc2": 0.07169504642486572, "sim_compute_robot_state-npc3": 0.07251668373743693}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378320939674847, "sim_physics": 0.17587638775507608, "survival_time": 14.950000000000076, "driven_lanedir": -2.682734814564024, "sim_render-ego": 0.060597727298736574, "in-drivable-lane": 2.2000000000000113, "agent_compute-ego": 0.16745083491007487, "deviation-heading": 8.488415384770876, "set_robot_commands": 0.09607977231343588, "deviation-center-line": 1.5200593248921646, "driven_lanedir_consec": -1.273127772600478, "sim_compute_sim_state": 0.037952491442362464, "sim_compute_performance-ego": 0.06675541639328003, "sim_compute_robot_state-ego": 0.07188489596048991, "sim_compute_robot_state-npc0": 0.06891391913096111, "sim_compute_robot_state-npc1": 0.0666999610265096, "sim_compute_robot_state-npc2": 0.06680732568105062, "sim_compute_robot_state-npc3": 0.06835401932398479}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378320939674833, "sim_physics": 0.1905565897623698, "survival_time": 14.950000000000076, "driven_lanedir": -1.3666338643676914, "sim_render-ego": 0.06253867387771607, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.17320491790771483, "deviation-heading": 5.77182628235273, "set_robot_commands": 0.1109407941500346, "deviation-center-line": 0.2928511106075376, "driven_lanedir_consec": -1.3666338643676914, "sim_compute_sim_state": 0.03958119551340739, "sim_compute_performance-ego": 0.06862994273503621, "sim_compute_robot_state-ego": 0.07608049631118774, "sim_compute_robot_state-npc0": 0.07293841282526652, "sim_compute_robot_state-npc1": 0.06970292091369629, "sim_compute_robot_state-npc2": 0.07176542441050211, "sim_compute_robot_state-npc3": 0.0696921984354655}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378320939674826, "sim_physics": 0.1925909940401713, "survival_time": 14.950000000000076, "driven_lanedir": -1.367352616124776, "sim_render-ego": 0.06262868245442708, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.1734783411026001, "deviation-heading": 5.694184625828924, "set_robot_commands": 0.09562327146530152, "deviation-center-line": 0.2826572656098777, "driven_lanedir_consec": -1.367352616124776, "sim_compute_sim_state": 0.03853275696436565, "sim_compute_performance-ego": 0.06771088679631551, "sim_compute_robot_state-ego": 0.07421330531438192, "sim_compute_robot_state-npc0": 0.06945716778437297, "sim_compute_robot_state-npc1": 0.06921451091766358, "sim_compute_robot_state-npc2": 0.06830912987391154, "sim_compute_robot_state-npc3": 0.06749493439992268}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378320939674838, "sim_physics": 0.2010195819536845, "survival_time": 14.950000000000076, "driven_lanedir": -2.2611414102685594, "sim_render-ego": 0.06569190979003907, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.18214135646820068, "deviation-heading": 7.0891261288876, "set_robot_commands": 0.1013434147834778, "deviation-center-line": 1.0020903216633783, "driven_lanedir_consec": -1.3401047463162574, "sim_compute_sim_state": 0.041550511519114174, "sim_compute_performance-ego": 0.0723378578821818, "sim_compute_robot_state-ego": 0.07792420228322347, "sim_compute_robot_state-npc0": 0.07237727642059326, "sim_compute_robot_state-npc1": 0.07249186754226684, "sim_compute_robot_state-npc2": 0.07226024389266968, "sim_compute_robot_state-npc3": 0.0729148236910502}}
set_robot_commands_max	0.1109407941500346
set_robot_commands_mean	0.1008404312133789
set_robot_commands_median	0.10021490335464478
set_robot_commands_min	0.09562327146530152
sim_compute_performance-ego_max	0.0723378578821818
sim_compute_performance-ego_mean	0.06917815796534221
sim_compute_performance-ego_median	0.06862994273503621
sim_compute_performance-ego_min	0.06675541639328003
sim_compute_robot_state-ego_max	0.07792420228322347
sim_compute_robot_state-ego_mean	0.07543622891108195
sim_compute_robot_state-ego_median	0.07608049631118774
sim_compute_robot_state-ego_min	0.07188489596048991
sim_compute_robot_state-npc0_max	0.07293841282526652
sim_compute_robot_state-npc0_mean	0.07094128036499024
sim_compute_robot_state-npc0_median	0.07101962566375733
sim_compute_robot_state-npc0_min	0.06891391913096111
sim_compute_robot_state-npc1_max	0.07249186754226684
sim_compute_robot_state-npc1_mean	0.06979265308380127
sim_compute_robot_state-npc1_median	0.06970292091369629
sim_compute_robot_state-npc1_min	0.0666999610265096
sim_compute_robot_state-npc2_max	0.07226024389266968
sim_compute_robot_state-npc2_mean	0.07016743405659993
sim_compute_robot_state-npc2_median	0.07169504642486572
sim_compute_robot_state-npc2_min	0.06680732568105062
sim_compute_robot_state-npc3_max	0.0729148236910502
sim_compute_robot_state-npc3_mean	0.07019453191757201
sim_compute_robot_state-npc3_median	0.0696921984354655
sim_compute_robot_state-npc3_min	0.06749493439992268
sim_compute_sim_state_max	0.041550511519114174
sim_compute_sim_state_mean	0.03959339300791422
sim_compute_sim_state_median	0.03958119551340739
sim_compute_sim_state_min	0.037952491442362464
sim_physics_max	0.2010195819536845
sim_physics_mean	0.1917644739151001
sim_physics_median	0.1925909940401713
sim_physics_min	0.17587638775507608
sim_render-ego_max	0.06569190979003907
sim_render-ego_mean	0.0629505138397217
sim_render-ego_median	0.06262868245442708
sim_render-ego_min	0.060597727298736574
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20527

2499

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 14:01:26+00:00

2019-04-25 14:09:38+00:00

0:08:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.05847629630495699
survival_time_median	1.2000000000000004
deviation-center-line_median	0.05803621025397452
in-drivable-lane_median	0.10000000000000007

other stats

agent_compute-ego_max	0.19118690490722656
agent_compute-ego_mean	0.1829918089204974
agent_compute-ego_median	0.1805316905180613
agent_compute-ego_min	0.17258416905122645
deviation-center-line_max	0.09964083617726475
deviation-center-line_mean	0.0698448110316836
deviation-center-line_min	0.04305819117071389
deviation-heading_max	0.8069876484275879
deviation-heading_mean	0.6690063002936459
deviation-heading_median	0.6847184376878432
deviation-heading_min	0.5346352798697325
driven_any_max	0.20717294845570505
driven_any_mean	0.15820845599427974
driven_any_median	0.13025246155163947
driven_any_min	0.12369413189417722
driven_lanedir_consec_max	0.09437158044830074
driven_lanedir_consec_mean	0.06824360537683179
driven_lanedir_consec_min	0.044575950807127285
driven_lanedir_max	0.09437158044830074
driven_lanedir_mean	0.06824360537683179
driven_lanedir_median	0.05847629630495699
driven_lanedir_min	0.044575950807127285
in-drivable-lane_max	0.7000000000000006
in-drivable-lane_mean	0.30000000000000027
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2031416965415, "sim_physics": 0.18558626704745823, "survival_time": 1.800000000000001, "driven_lanedir": 0.056537558817468136, "sim_render-ego": 0.0634123749203152, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.17973159419165718, "deviation-heading": 0.6847184376878432, "set_robot_commands": 0.10068006647957696, "deviation-center-line": 0.05803621025397452, "driven_lanedir_consec": 0.056537558817468136, "sim_compute_sim_state": 0.04220531384150187, "sim_compute_performance-ego": 0.07183644506666395, "sim_compute_robot_state-ego": 0.08063140180375841, "sim_compute_robot_state-npc0": 0.07391838232676189, "sim_compute_robot_state-npc1": 0.07263900836308797, "sim_compute_robot_state-npc2": 0.07451545529895359, "sim_compute_robot_state-npc3": 0.0740243395169576}, "udem1-1-0": {"driven_any": 0.20717294845570505, "sim_physics": 0.2093210220336914, "survival_time": 1.7000000000000008, "driven_lanedir": 0.044575950807127285, "sim_render-ego": 0.06765916067011216, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.17258416905122645, "deviation-heading": 0.768895507183018, "set_robot_commands": 0.0998462298337151, "deviation-center-line": 0.05365395137552952, "driven_lanedir_consec": 0.044575950807127285, "sim_compute_sim_state": 0.042374772184035354, "sim_compute_performance-ego": 0.07026703918681425, "sim_compute_robot_state-ego": 0.07672049017513499, "sim_compute_robot_state-npc0": 0.07217398110558004, "sim_compute_robot_state-npc1": 0.07030726881588206, "sim_compute_robot_state-npc2": 0.07312029249527875, "sim_compute_robot_state-npc3": 0.0726178393644445}, "udem1-2-0": {"driven_any": 0.12369413189417722, "sim_physics": 0.17558792363042416, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08725664050630577, "sim_render-ego": 0.06714937997900922, "in-drivable-lane": 0, "agent_compute-ego": 0.19118690490722656, "deviation-heading": 0.549794628300048, "set_robot_commands": 0.09873282391092052, "deviation-center-line": 0.09964083617726475, "driven_lanedir_consec": 0.08725664050630577, "sim_compute_sim_state": 0.04040338682091754, "sim_compute_performance-ego": 0.0731849774070408, "sim_compute_robot_state-ego": 0.07495427131652832, "sim_compute_robot_state-npc0": 0.06868445354959239, "sim_compute_robot_state-npc1": 0.07499410795128864, "sim_compute_robot_state-npc2": 0.07508006303206734, "sim_compute_robot_state-npc3": 0.07103625587795091}, "udem1-3-0": {"driven_any": 0.13025246155163947, "sim_physics": 0.19072861256806747, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09437158044830074, "sim_render-ego": 0.0660198978755785, "in-drivable-lane": 0, "agent_compute-ego": 0.19092468593431555, "deviation-heading": 0.5346352798697325, "set_robot_commands": 0.10555591790572456, "deviation-center-line": 0.09483486618093533, "driven_lanedir_consec": 0.09437158044830074, "sim_compute_sim_state": 0.04131242503290591, "sim_compute_performance-ego": 0.07000528211178987, "sim_compute_robot_state-ego": 0.08442561522774074, "sim_compute_robot_state-npc0": 0.08017615650011145, "sim_compute_robot_state-npc1": 0.07217545094697372, "sim_compute_robot_state-npc2": 0.07500709658083708, "sim_compute_robot_state-npc3": 0.07191592714060908}, "udem1-4-0": {"driven_any": 0.12678104152837696, "sim_physics": 0.1728122035662333, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05847629630495699, "sim_render-ego": 0.06925369302431743, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1805316905180613, "deviation-heading": 0.8069876484275879, "set_robot_commands": 0.10147502024968463, "deviation-center-line": 0.04305819117071389, "driven_lanedir_consec": 0.05847629630495699, "sim_compute_sim_state": 0.03991119066874186, "sim_compute_performance-ego": 0.07839433352152507, "sim_compute_robot_state-ego": 0.08432045578956604, "sim_compute_robot_state-npc0": 0.0766010582447052, "sim_compute_robot_state-npc1": 0.07290327548980713, "sim_compute_robot_state-npc2": 0.07218349973360698, "sim_compute_robot_state-npc3": 0.07130577166875203}}
set_robot_commands_max	0.10555591790572456
set_robot_commands_mean	0.10125801167592435
set_robot_commands_median	0.10068006647957696
set_robot_commands_min	0.09873282391092052
sim_compute_performance-ego_max	0.07839433352152507
sim_compute_performance-ego_mean	0.0727376154587668
sim_compute_performance-ego_median	0.07183644506666395
sim_compute_performance-ego_min	0.07000528211178987
sim_compute_robot_state-ego_max	0.08442561522774074
sim_compute_robot_state-ego_mean	0.0802104468625457
sim_compute_robot_state-ego_median	0.08063140180375841
sim_compute_robot_state-ego_min	0.07495427131652832
sim_compute_robot_state-npc0_max	0.08017615650011145
sim_compute_robot_state-npc0_mean	0.0743108063453502
sim_compute_robot_state-npc0_median	0.07391838232676189
sim_compute_robot_state-npc0_min	0.06868445354959239
sim_compute_robot_state-npc1_max	0.07499410795128864
sim_compute_robot_state-npc1_mean	0.0726038223134079
sim_compute_robot_state-npc1_median	0.07263900836308797
sim_compute_robot_state-npc1_min	0.07030726881588206
sim_compute_robot_state-npc2_max	0.07508006303206734
sim_compute_robot_state-npc2_mean	0.07398128142814875
sim_compute_robot_state-npc2_median	0.07451545529895359
sim_compute_robot_state-npc2_min	0.07218349973360698
sim_compute_robot_state-npc3_max	0.0740243395169576
sim_compute_robot_state-npc3_mean	0.07218002671374282
sim_compute_robot_state-npc3_median	0.07191592714060908
sim_compute_robot_state-npc3_min	0.07103625587795091
sim_compute_sim_state_max	0.042374772184035354
sim_compute_sim_state_mean	0.041241417709620504
sim_compute_sim_state_median	0.04131242503290591
sim_compute_sim_state_min	0.03991119066874186
sim_physics_max	0.2093210220336914
sim_physics_mean	0.18680720576917492
sim_physics_median	0.18558626704745823
sim_physics_min	0.1728122035662333
sim_render-ego_max	0.06925369302431743
sim_render-ego_mean	0.0666989012938665
sim_render-ego_median	0.06714937997900922
sim_render-ego_min	0.0634123749203152
simulation-passed	1
survival_time_max	1.800000000000001
survival_time_mean	1.4000000000000006
survival_time_min	1.1500000000000004

No reset possible

20515

2505

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:00:12+00:00

2019-04-25 14:01:13+00:00

0:01:01

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20503

2524

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 13:58:37+00:00

2019-04-25 14:00:04+00:00

0:01:27

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20503-305684', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20503-305684', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20503-305684', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20482

2555

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:43:41+00:00

2019-04-25 13:58:02+00:00

0:14:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.09594937876651162
agent_compute-ego_mean	0.08042051066208694
agent_compute-ego_median	0.074298694624123
agent_compute-ego_min	0.07320827787572687
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.1798875088041479, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.06346699866381558, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.07320827787572687, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.09896411408077586, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.041962298479947174, "sim_compute_performance-ego": 0.07158889824693854, "sim_compute_robot_state-ego": 0.07967303557829424, "sim_compute_robot_state-npc0": 0.07106724923307245, "sim_compute_robot_state-npc1": 0.0735017874024131, "sim_compute_robot_state-npc2": 0.07300346006046642, "sim_compute_robot_state-npc3": 0.07413213361393321}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.1925098665298954, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.06550262051243935, "in-drivable-lane": 0, "agent_compute-ego": 0.07410996190963252, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.10308677919449344, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.04445483607630576, "sim_compute_performance-ego": 0.07540342884678994, "sim_compute_robot_state-ego": 0.07350150231392152, "sim_compute_robot_state-npc0": 0.0736088752746582, "sim_compute_robot_state-npc1": 0.07157443415734076, "sim_compute_robot_state-npc2": 0.07670748618341261, "sim_compute_robot_state-npc3": 0.07703986475544591}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.20673269244795991, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.0634933887644017, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.074298694624123, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.10251209921870671, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.04189124005906125, "sim_compute_performance-ego": 0.07072412206771526, "sim_compute_robot_state-ego": 0.07663197551213258, "sim_compute_robot_state-npc0": 0.07224619304034727, "sim_compute_robot_state-npc1": 0.0735570877156359, "sim_compute_robot_state-npc2": 0.0737594205436977, "sim_compute_robot_state-npc3": 0.07337146616996602}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.1884763617264597, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.061226362931100946, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.09594937876651162, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.10143558853550962, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.040424590361745734, "sim_compute_performance-ego": 0.07417895919398258, "sim_compute_robot_state-ego": 0.07310878603081954, "sim_compute_robot_state-npc0": 0.07215778702183774, "sim_compute_robot_state-npc1": 0.07090303772374203, "sim_compute_robot_state-npc2": 0.07497130444175319, "sim_compute_robot_state-npc3": 0.07041694992466976}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.1939179645457738, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.060348185015396336, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.08453624013444068, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.09172311802984964, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.03629091256101367, "sim_compute_performance-ego": 0.06703596551653365, "sim_compute_robot_state-ego": 0.07327080948252074, "sim_compute_robot_state-npc0": 0.06656994618160623, "sim_compute_robot_state-npc1": 0.06430906477108808, "sim_compute_robot_state-npc2": 0.06530581897413226, "sim_compute_robot_state-npc3": 0.06412620947394572}}
set_robot_commands_max	0.10308677919449344
set_robot_commands_mean	0.09954433981186704
set_robot_commands_median	0.10143558853550962
set_robot_commands_min	0.09172311802984964
sim_compute_performance-ego_max	0.07540342884678994
sim_compute_performance-ego_mean	0.07178627477439199
sim_compute_performance-ego_median	0.07158889824693854
sim_compute_performance-ego_min	0.06703596551653365
sim_compute_robot_state-ego_max	0.07967303557829424
sim_compute_robot_state-ego_mean	0.07523722178353773
sim_compute_robot_state-ego_median	0.07350150231392152
sim_compute_robot_state-ego_min	0.07310878603081954
sim_compute_robot_state-npc0_max	0.0736088752746582
sim_compute_robot_state-npc0_mean	0.07113001015030437
sim_compute_robot_state-npc0_median	0.07215778702183774
sim_compute_robot_state-npc0_min	0.06656994618160623
sim_compute_robot_state-npc1_max	0.0735570877156359
sim_compute_robot_state-npc1_mean	0.07076908235404397
sim_compute_robot_state-npc1_median	0.07157443415734076
sim_compute_robot_state-npc1_min	0.06430906477108808
sim_compute_robot_state-npc2_max	0.07670748618341261
sim_compute_robot_state-npc2_mean	0.07274949804069245
sim_compute_robot_state-npc2_median	0.0737594205436977
sim_compute_robot_state-npc2_min	0.06530581897413226
sim_compute_robot_state-npc3_max	0.07703986475544591
sim_compute_robot_state-npc3_mean	0.07181732478759212
sim_compute_robot_state-npc3_median	0.07337146616996602
sim_compute_robot_state-npc3_min	0.06412620947394572
sim_compute_sim_state_max	0.04445483607630576
sim_compute_sim_state_mean	0.041004775507614714
sim_compute_sim_state_median	0.04189124005906125
sim_compute_sim_state_min	0.03629091256101367
sim_physics_max	0.20673269244795991
sim_physics_mean	0.19230487881084735
sim_physics_median	0.1925098665298954
sim_physics_min	0.1798875088041479
sim_render-ego_max	0.06550262051243935
sim_render-ego_mean	0.06280751117743079
sim_render-ego_median	0.06346699866381558
sim_render-ego_min	0.060348185015396336
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20464

2586

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 13:31:31+00:00

2019-04-25 13:43:20+00:00

0:11:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.25226318045443197
survival_time_median	5.849999999999987
deviation-center-line_median	0.3257554144596751
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2563581868503871
agent_compute-ego_mean	0.2460365772988005
agent_compute-ego_median	0.2458899926769641
agent_compute-ego_min	0.23621034044207947
deviation-center-line_max	0.3751808996081484
deviation-center-line_mean	0.3315233173418302
deviation-center-line_min	0.28733588366645035
deviation-heading_max	2.9110273237531032
deviation-heading_mean	2.37249021390456
deviation-heading_median	2.5061648313797837
deviation-heading_min	1.4663797051411016
driven_any_max	0.45282993097417695
driven_any_mean	0.3101604136385311
driven_any_median	0.31098499200658153
driven_any_min	0.16776579869133268
driven_lanedir_consec_max	0.404393637587236
driven_lanedir_consec_mean	0.26300690052059783
driven_lanedir_consec_min	0.13633561715475162
driven_lanedir_max	0.404393637587236
driven_lanedir_mean	0.26300690052059783
driven_lanedir_median	0.25226318045443197
driven_lanedir_min	0.13633561715475162
in-drivable-lane_max	0.20000000000000284
in-drivable-lane_mean	0.07000000000000046
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.31098499200658153, "sim_physics": 0.11505855454338922, "survival_time": 5.849999999999987, "driven_lanedir": 0.25226318045443197, "sim_render-ego": 0.06517301665412055, "in-drivable-lane": 0, "agent_compute-ego": 0.24818267170180625, "deviation-heading": 2.9110273237531032, "set_robot_commands": 0.10225793439098912, "deviation-center-line": 0.34989329743425956, "driven_lanedir_consec": 0.25226318045443197, "sim_compute_sim_state": 0.03984806272718641, "sim_compute_performance-ego": 0.07465317514207628, "sim_compute_robot_state-ego": 0.08204952468219985}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.45282993097417695, "sim_physics": 0.11993017196655271, "survival_time": 8.249999999999982, "driven_lanedir": 0.404393637587236, "sim_render-ego": 0.06480500047857111, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.23621034044207947, "deviation-heading": 2.5061648313797837, "set_robot_commands": 0.10180782838301224, "deviation-center-line": 0.3751808996081484, "driven_lanedir_consec": 0.404393637587236, "sim_compute_sim_state": 0.040349362113259055, "sim_compute_performance-ego": 0.07309081626660896, "sim_compute_robot_state-ego": 0.07638843420780066}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16776579869133268, "sim_physics": 0.1040811992826916, "survival_time": 3.149999999999997, "driven_lanedir": 0.13633561715475162, "sim_render-ego": 0.06020653437054346, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.24354169482276553, "deviation-heading": 1.4663797051411016, "set_robot_commands": 0.09913955794440377, "deviation-center-line": 0.3257554144596751, "driven_lanedir_consec": 0.13633561715475162, "sim_compute_sim_state": 0.04020730275956411, "sim_compute_performance-ego": 0.070692293227665, "sim_compute_robot_state-ego": 0.076340637509785}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2576414500967686, "sim_physics": 0.11315606953052992, "survival_time": 4.449999999999992, "driven_lanedir": 0.20333926245902845, "sim_render-ego": 0.06396578135115377, "in-drivable-lane": 0, "agent_compute-ego": 0.2563581868503871, "deviation-heading": 2.643742962582876, "set_robot_commands": 0.0990632517953937, "deviation-center-line": 0.28733588366645035, "driven_lanedir_consec": 0.20333926245902845, "sim_compute_sim_state": 0.039183399650488, "sim_compute_performance-ego": 0.07121707616227396, "sim_compute_robot_state-ego": 0.07972788007071849}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3615798964237957, "sim_physics": 0.11344543907993523, "survival_time": 6.449999999999985, "driven_lanedir": 0.3187028049475411, "sim_render-ego": 0.0624939526698386, "in-drivable-lane": 0, "agent_compute-ego": 0.2458899926769641, "deviation-heading": 2.3351362466659316, "set_robot_commands": 0.10048966075098792, "deviation-center-line": 0.3194510915406177, "driven_lanedir_consec": 0.3187028049475411, "sim_compute_sim_state": 0.04050721678622933, "sim_compute_performance-ego": 0.07155412481736767, "sim_compute_robot_state-ego": 0.07668333090552988}}
set_robot_commands_max	0.10225793439098912
set_robot_commands_mean	0.10055164665295736
set_robot_commands_median	0.10048966075098792
set_robot_commands_min	0.0990632517953937
sim_compute_performance-ego_max	0.07465317514207628
sim_compute_performance-ego_mean	0.07224149712319837
sim_compute_performance-ego_median	0.07155412481736767
sim_compute_performance-ego_min	0.070692293227665
sim_compute_robot_state-ego_max	0.08204952468219985
sim_compute_robot_state-ego_mean	0.07823796147520677
sim_compute_robot_state-ego_median	0.07668333090552988
sim_compute_robot_state-ego_min	0.076340637509785
sim_compute_sim_state_max	0.04050721678622933
sim_compute_sim_state_mean	0.04001906880734538
sim_compute_sim_state_median	0.04020730275956411
sim_compute_sim_state_min	0.039183399650488
sim_physics_max	0.11993017196655271
sim_physics_mean	0.11313428688061974
sim_physics_median	0.11344543907993523
sim_physics_min	0.1040811992826916
sim_render-ego_max	0.06517301665412055
sim_render-ego_mean	0.06332885710484551
sim_render-ego_median	0.06396578135115377
sim_render-ego_min	0.06020653437054346
simulation-passed	1
survival_time_max	8.249999999999982
survival_time_mean	5.629999999999988
survival_time_min	3.149999999999997

No reset possible

20454

2599

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 13:23:07+00:00

2019-04-25 13:30:44+00:00

0:07:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06696732980270115
survival_time_median	1.6000000000000008
deviation-center-line_median	0.04582178182917702
in-drivable-lane_median	0.5500000000000005

other stats

agent_compute-ego_max	0.19774733781814577
agent_compute-ego_mean	0.1802422443475618
agent_compute-ego_median	0.17504886730176183
agent_compute-ego_min	0.16821972785457487
deviation-center-line_max	0.30252621006878944
deviation-center-line_mean	0.10275965315197952
deviation-center-line_min	0.03513975399644853
deviation-heading_max	4.061172516151915
deviation-heading_mean	1.37080004663523
deviation-heading_median	0.7366180506255908
deviation-heading_min	0.6158594295416759
driven_any_max	1.3473907560124836
driven_any_mean	0.3982993830503708
driven_any_median	0.17866869090426962
driven_any_min	0.10515234699744952
driven_lanedir_consec_max	0.3937543032561419
driven_lanedir_consec_mean	0.1329068528054071
driven_lanedir_consec_min	0.054740688491194955
driven_lanedir_max	0.3937543032561419
driven_lanedir_mean	0.1329068528054071
driven_lanedir_median	0.06696732980270115
driven_lanedir_min	0.054740688491194955
in-drivable-lane_max	5.250000000000006
in-drivable-lane_mean	1.3200000000000016
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3473907560124836, "sim_physics": 0.124905312005343, "survival_time": 10.650000000000016, "driven_lanedir": 0.3937543032561419, "sim_render-ego": 0.06040341977222425, "in-drivable-lane": 5.250000000000006, "agent_compute-ego": 0.17504886730176183, "deviation-heading": 4.061172516151915, "set_robot_commands": 0.10045700229949237, "deviation-center-line": 0.30252621006878944, "driven_lanedir_consec": 0.3937543032561419, "sim_compute_sim_state": 0.03730086765378854, "sim_compute_performance-ego": 0.065706300063872, "sim_compute_robot_state-ego": 0.07480872628834326}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17806705319073207, "sim_physics": 0.09999718204621344, "survival_time": 1.5500000000000007, "driven_lanedir": 0.08613970844032126, "sim_render-ego": 0.054352583423737555, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.16821972785457487, "deviation-heading": 0.7366180506255908, "set_robot_commands": 0.08796851865706905, "deviation-center-line": 0.04061167075514563, "driven_lanedir_consec": 0.08613970844032126, "sim_compute_sim_state": 0.037412489614179055, "sim_compute_performance-ego": 0.0666076906265751, "sim_compute_robot_state-ego": 0.07442605110906786}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10515234699744952, "sim_physics": 0.08728331327438354, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06696732980270115, "sim_render-ego": 0.055809056758880614, "in-drivable-lane": 0, "agent_compute-ego": 0.19774733781814577, "deviation-heading": 0.6158594295416759, "set_robot_commands": 0.10508220195770264, "deviation-center-line": 0.08969884911033703, "driven_lanedir_consec": 0.06696732980270115, "sim_compute_sim_state": 0.040107357501983645, "sim_compute_performance-ego": 0.06908159255981446, "sim_compute_robot_state-ego": 0.06989221572875977}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18221806814691932, "sim_physics": 0.12058521062135696, "survival_time": 1.6000000000000008, "driven_lanedir": 0.054740688491194955, "sim_render-ego": 0.062383659183979034, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.18594078719615936, "deviation-heading": 0.7888972376091763, "set_robot_commands": 0.09697070717811584, "deviation-center-line": 0.04582178182917702, "driven_lanedir_consec": 0.054740688491194955, "sim_compute_sim_state": 0.03906894475221634, "sim_compute_performance-ego": 0.07136575877666473, "sim_compute_robot_state-ego": 0.07540078461170197}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17866869090426962, "sim_physics": 0.10894634443170884, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06293223403667625, "sim_render-ego": 0.06465186091030345, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1742545015671674, "deviation-heading": 0.6514529992477928, "set_robot_commands": 0.09607284209307504, "deviation-center-line": 0.03513975399644853, "driven_lanedir_consec": 0.06293223403667625, "sim_compute_sim_state": 0.0376047176473281, "sim_compute_performance-ego": 0.07055284696466782, "sim_compute_robot_state-ego": 0.07629682036007152}}
set_robot_commands_max	0.10508220195770264
set_robot_commands_mean	0.097310254437091
set_robot_commands_median	0.09697070717811584
set_robot_commands_min	0.08796851865706905
sim_compute_performance-ego_max	0.07136575877666473
sim_compute_performance-ego_mean	0.0686628377983188
sim_compute_performance-ego_median	0.06908159255981446
sim_compute_performance-ego_min	0.065706300063872
sim_compute_robot_state-ego_max	0.07629682036007152
sim_compute_robot_state-ego_mean	0.07416491961958888
sim_compute_robot_state-ego_median	0.07480872628834326
sim_compute_robot_state-ego_min	0.06989221572875977
sim_compute_sim_state_max	0.040107357501983645
sim_compute_sim_state_mean	0.038298875433899135
sim_compute_sim_state_median	0.0376047176473281
sim_compute_sim_state_min	0.03730086765378854
sim_physics_max	0.124905312005343
sim_physics_mean	0.10834347247580116
sim_physics_median	0.10894634443170884
sim_physics_min	0.08728331327438354
sim_render-ego_max	0.06465186091030345
sim_render-ego_mean	0.059520116009824986
sim_render-ego_median	0.06040341977222425
sim_render-ego_min	0.054352583423737555
simulation-passed	1
survival_time_max	10.650000000000016
survival_time_mean	3.3000000000000034
survival_time_min	1.0000000000000002

No reset possible

20434

2657

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 13:00:26+00:00

2019-04-25 13:22:31+00:00

0:22:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5011172181035071
survival_time_median	7.7499999999999805
deviation-center-line_median	0.45324659531551115
in-drivable-lane_median	1.8999999999999932

other stats

agent_compute-ego_max	0.09273917953689376
agent_compute-ego_mean	0.08969540867176051
agent_compute-ego_median	0.08912999662634445
agent_compute-ego_min	0.08849413625655636
deviation-center-line_max	0.7610985637518324
deviation-center-line_mean	0.4455801515534723
deviation-center-line_min	0.24181391386242823
deviation-heading_max	4.210677731543142
deviation-heading_mean	2.79910377975492
deviation-heading_median	2.671171395378777
deviation-heading_min	1.1233388022356898
driven_any_max	1.5289622466795627
driven_any_mean	1.1804919717285736
driven_any_median	1.1915341371982895
driven_any_min	0.5328662303391837
driven_lanedir_consec_max	1.076687975410625
driven_lanedir_consec_mean	0.6095805684943283
driven_lanedir_consec_min	0.37566551420157257
driven_lanedir_max	1.076687975410625
driven_lanedir_mean	0.7054106841255838
driven_lanedir_median	0.6599772353010228
driven_lanedir_min	0.5011172181035071
in-drivable-lane_max	4.40000000000001
in-drivable-lane_mean	1.8900000000000012
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1686392587904213, "sim_physics": 0.20140483162619852, "survival_time": 7.699999999999981, "driven_lanedir": 1.076687975410625, "sim_render-ego": 0.0743406902660023, "in-drivable-lane": 0, "agent_compute-ego": 0.09273917953689376, "deviation-heading": 2.0581597967483325, "set_robot_commands": 0.11892998837805412, "deviation-center-line": 0.7610985637518324, "driven_lanedir_consec": 1.076687975410625, "sim_compute_sim_state": 0.04668170755559748, "sim_compute_performance-ego": 0.0821442867254282, "sim_compute_robot_state-ego": 0.09027612364137327, "sim_compute_robot_state-npc0": 0.08001313426277855, "sim_compute_robot_state-npc1": 0.08038341534602178, "sim_compute_robot_state-npc2": 0.08011904939428552, "sim_compute_robot_state-npc3": 0.07998685712938185}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5328662303391837, "sim_physics": 0.1902204833618582, "survival_time": 3.649999999999995, "driven_lanedir": 0.5011172181035071, "sim_render-ego": 0.0749502182006836, "in-drivable-lane": 0, "agent_compute-ego": 0.08912999662634445, "deviation-heading": 1.1233388022356898, "set_robot_commands": 0.12199215693016575, "deviation-center-line": 0.24181391386242823, "driven_lanedir_consec": 0.5011172181035071, "sim_compute_sim_state": 0.04551804882206329, "sim_compute_performance-ego": 0.07878118345182236, "sim_compute_robot_state-ego": 0.08693040886970416, "sim_compute_robot_state-npc0": 0.07919731532057671, "sim_compute_robot_state-npc1": 0.08024691882198803, "sim_compute_robot_state-npc2": 0.08051223624242496, "sim_compute_robot_state-npc3": 0.08119395987628257}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.1915341371982895, "sim_physics": 0.191619756144862, "survival_time": 7.7499999999999805, "driven_lanedir": 0.6063814068207383, "sim_render-ego": 0.06776422069918725, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.08849413625655636, "deviation-heading": 3.93217117286866, "set_robot_commands": 0.11106298200545772, "deviation-center-line": 0.45739999987267366, "driven_lanedir_consec": 0.37566551420157257, "sim_compute_sim_state": 0.042652697716989825, "sim_compute_performance-ego": 0.07836098517141034, "sim_compute_robot_state-ego": 0.09137032262740596, "sim_compute_robot_state-npc0": 0.07507145481724893, "sim_compute_robot_state-npc1": 0.07623563120442052, "sim_compute_robot_state-npc2": 0.07498625016981555, "sim_compute_robot_state-npc3": 0.07728855686803018}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4804579856354114, "sim_physics": 0.21602260879197047, "survival_time": 9.55, "driven_lanedir": 0.6828895849920258, "sim_render-ego": 0.07164329883315801, "in-drivable-lane": 3.150000000000003, "agent_compute-ego": 0.08879317538276393, "deviation-heading": 4.210677731543142, "set_robot_commands": 0.11707569791384392, "deviation-center-line": 0.45324659531551115, "driven_lanedir_consec": 0.4344548994549138, "sim_compute_sim_state": 0.04564789826957343, "sim_compute_performance-ego": 0.0823436157865674, "sim_compute_robot_state-ego": 0.09194183099956411, "sim_compute_robot_state-npc0": 0.07932414683996071, "sim_compute_robot_state-npc1": 0.08107054920096672, "sim_compute_robot_state-npc2": 0.08241479933573938, "sim_compute_robot_state-npc3": 0.08101926798595808}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5289622466795627, "sim_physics": 0.22574901822859864, "survival_time": 9.850000000000003, "driven_lanedir": 0.6599772353010228, "sim_render-ego": 0.06981137561313996, "in-drivable-lane": 4.40000000000001, "agent_compute-ego": 0.08932055555624405, "deviation-heading": 2.671171395378777, "set_robot_commands": 0.11653455622910244, "deviation-center-line": 0.3143416849649161, "driven_lanedir_consec": 0.6599772353010228, "sim_compute_sim_state": 0.045477184547385585, "sim_compute_performance-ego": 0.0801650545923843, "sim_compute_robot_state-ego": 0.08923424197937631, "sim_compute_robot_state-npc0": 0.08033007171553404, "sim_compute_robot_state-npc1": 0.08079766501024895, "sim_compute_robot_state-npc2": 0.08110211827428208, "sim_compute_robot_state-npc3": 0.08099834325954999}}
set_robot_commands_max	0.12199215693016575
set_robot_commands_mean	0.1171190762913248
set_robot_commands_median	0.11707569791384392
set_robot_commands_min	0.11106298200545772
sim_compute_performance-ego_max	0.0823436157865674
sim_compute_performance-ego_mean	0.08035902514552251
sim_compute_performance-ego_median	0.0801650545923843
sim_compute_performance-ego_min	0.07836098517141034
sim_compute_robot_state-ego_max	0.09194183099956411
sim_compute_robot_state-ego_mean	0.08995058562348476
sim_compute_robot_state-ego_median	0.09027612364137327
sim_compute_robot_state-ego_min	0.08693040886970416
sim_compute_robot_state-npc0_max	0.08033007171553404
sim_compute_robot_state-npc0_mean	0.07878722459121978
sim_compute_robot_state-npc0_median	0.07932414683996071
sim_compute_robot_state-npc0_min	0.07507145481724893
sim_compute_robot_state-npc1_max	0.08107054920096672
sim_compute_robot_state-npc1_mean	0.0797468359167292
sim_compute_robot_state-npc1_median	0.08038341534602178
sim_compute_robot_state-npc1_min	0.07623563120442052
sim_compute_robot_state-npc2_max	0.08241479933573938
sim_compute_robot_state-npc2_mean	0.0798268906833095
sim_compute_robot_state-npc2_median	0.08051223624242496
sim_compute_robot_state-npc2_min	0.07498625016981555
sim_compute_robot_state-npc3_max	0.08119395987628257
sim_compute_robot_state-npc3_mean	0.08009739702384053
sim_compute_robot_state-npc3_median	0.08099834325954999
sim_compute_robot_state-npc3_min	0.07728855686803018
sim_compute_sim_state_max	0.04668170755559748
sim_compute_sim_state_mean	0.04519550738232193
sim_compute_sim_state_median	0.04551804882206329
sim_compute_sim_state_min	0.042652697716989825
sim_physics_max	0.22574901822859864
sim_physics_mean	0.20500333963069756
sim_physics_median	0.20140483162619852
sim_physics_min	0.1902204833618582
sim_render-ego_max	0.0749502182006836
sim_render-ego_mean	0.07170196072243422
sim_render-ego_median	0.07164329883315801
sim_render-ego_min	0.06776422069918725
simulation-passed	1
survival_time_max	9.850000000000003
survival_time_mean	7.699999999999993
survival_time_min	3.649999999999995

No reset possible

20426

2648

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-25 12:59:38+00:00

2019-04-25 13:00:07+00:00

0:00:29

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20426-764898', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20426-764898', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20426-764898', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20417

2644

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 12:51:18+00:00

2019-04-25 12:59:30+00:00

0:08:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07535240054130554
agent_compute-ego_mean	0.07270049894833819
agent_compute-ego_median	0.0727149676053952
agent_compute-ego_min	0.0687031039485225
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.14441706632312976, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.06362461730053551, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.07178543115917005, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.0972150344597666, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.039710556205950286, "sim_compute_performance-ego": 0.07004881846277337, "sim_compute_robot_state-ego": 0.07411504732935052, "sim_compute_robot_state-npc0": 0.06760057650114361, "sim_compute_robot_state-npc1": 0.06682380249625758, "sim_compute_robot_state-npc2": 0.06851491802617123, "sim_compute_robot_state-npc3": 0.06869160815289146}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.1553647667169571, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.0602312907576561, "in-drivable-lane": 0, "agent_compute-ego": 0.07535240054130554, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.104431614279747, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.04143286496400833, "sim_compute_performance-ego": 0.06615321338176727, "sim_compute_robot_state-ego": 0.07469846308231354, "sim_compute_robot_state-npc0": 0.07441391795873642, "sim_compute_robot_state-npc1": 0.0740867629647255, "sim_compute_robot_state-npc2": 0.07202982157468796, "sim_compute_robot_state-npc3": 0.07077647000551224}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.17712308810307428, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.06717153695913461, "in-drivable-lane": 0, "agent_compute-ego": 0.07494659148729764, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.1000178548005911, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.03948768285604624, "sim_compute_performance-ego": 0.07298922080260056, "sim_compute_robot_state-ego": 0.07924927656467144, "sim_compute_robot_state-npc0": 0.07052149222447322, "sim_compute_robot_state-npc1": 0.07088692830159114, "sim_compute_robot_state-npc2": 0.07198212696955754, "sim_compute_robot_state-npc3": 0.07213957493121807}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.1540280519387661, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.06497717820681058, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.0727149676053952, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.10296325500194844, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.04004859007321871, "sim_compute_performance-ego": 0.07093786887633495, "sim_compute_robot_state-ego": 0.07608524652627799, "sim_compute_robot_state-npc0": 0.07089096766251785, "sim_compute_robot_state-npc1": 0.07285035573519193, "sim_compute_robot_state-npc2": 0.0728680995794443, "sim_compute_robot_state-npc3": 0.0725012039526915}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.1474325215374982, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.062129603491889104, "in-drivable-lane": 0, "agent_compute-ego": 0.0687031039485225, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.10149917779145418, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.038094034901371705, "sim_compute_performance-ego": 0.06732263388457121, "sim_compute_robot_state-ego": 0.07430283228556316, "sim_compute_robot_state-npc0": 0.06965322847719546, "sim_compute_robot_state-npc1": 0.06795352476614493, "sim_compute_robot_state-npc2": 0.07587516749346698, "sim_compute_robot_state-npc3": 0.0684454705980089}}
set_robot_commands_max	0.104431614279747
set_robot_commands_mean	0.10122538726670144
set_robot_commands_median	0.10149917779145418
set_robot_commands_min	0.0972150344597666
sim_compute_performance-ego_max	0.07298922080260056
sim_compute_performance-ego_mean	0.06949035108160947
sim_compute_performance-ego_median	0.07004881846277337
sim_compute_performance-ego_min	0.06615321338176727
sim_compute_robot_state-ego_max	0.07924927656467144
sim_compute_robot_state-ego_mean	0.07569017315763535
sim_compute_robot_state-ego_median	0.07469846308231354
sim_compute_robot_state-ego_min	0.07411504732935052
sim_compute_robot_state-npc0_max	0.07441391795873642
sim_compute_robot_state-npc0_mean	0.07061603656481331
sim_compute_robot_state-npc0_median	0.07052149222447322
sim_compute_robot_state-npc0_min	0.06760057650114361
sim_compute_robot_state-npc1_max	0.0740867629647255
sim_compute_robot_state-npc1_mean	0.07052027485278221
sim_compute_robot_state-npc1_median	0.07088692830159114
sim_compute_robot_state-npc1_min	0.06682380249625758
sim_compute_robot_state-npc2_max	0.07587516749346698
sim_compute_robot_state-npc2_mean	0.07225402672866559
sim_compute_robot_state-npc2_median	0.07202982157468796
sim_compute_robot_state-npc2_min	0.06851491802617123
sim_compute_robot_state-npc3_max	0.0725012039526915
sim_compute_robot_state-npc3_mean	0.07051086552806443
sim_compute_robot_state-npc3_median	0.07077647000551224
sim_compute_robot_state-npc3_min	0.0684454705980089
sim_compute_sim_state_max	0.04143286496400833
sim_compute_sim_state_mean	0.03975474580011905
sim_compute_sim_state_median	0.039710556205950286
sim_compute_sim_state_min	0.038094034901371705
sim_physics_max	0.17712308810307428
sim_physics_mean	0.1556730989238851
sim_physics_median	0.1540280519387661
sim_physics_min	0.14441706632312976
sim_render-ego_max	0.06717153695913461
sim_render-ego_mean	0.06362684534320519
sim_render-ego_median	0.06362461730053551
sim_render-ego_min	0.0602312907576561
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20411

2645

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

timeout

2019-04-25 12:36:46+00:00

2019-04-25 12:50:50+00:00

0:14:04

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20394

2708

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:04:02+00:00

2019-04-25 12:35:54+00:00

0:31:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.760985076787565
survival_time_median	14.950000000000076
deviation-center-line_median	0.6110008091274789
in-drivable-lane_median	2.4000000000000092

other stats

agent_compute-ego_max	0.10031129995981852
agent_compute-ego_mean	0.09715219073112194
agent_compute-ego_median	0.09742805285331532
agent_compute-ego_min	0.0920620584487915
deviation-center-line_max	1.1234495849368888
deviation-center-line_mean	0.5859240437811962
deviation-center-line_min	0.17216526921023204
deviation-heading_max	7.510608728554441
deviation-heading_mean	4.386225528440548
deviation-heading_median	5.377620278851787
deviation-heading_min	0.5370526766587093
driven_any_max	2.3483500137918556
driven_any_mean	1.627096412983692
driven_any_median	2.3328784027465814
driven_any_min	0.25964596676498836
driven_lanedir_consec_max	0.9085408473486476
driven_lanedir_consec_mean	0.6683267094475424
driven_lanedir_consec_min	0.24211879882659293
driven_lanedir_max	1.4709184163316449
driven_lanedir_mean	0.9325178183356168
driven_lanedir_median	1.04275228513507
driven_lanedir_min	0.24211879882659293
in-drivable-lane_max	5.4500000000000535
in-drivable-lane_mean	2.6100000000000216
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3328784027465814, "sim_physics": 0.2525584061940511, "survival_time": 14.950000000000076, "driven_lanedir": 1.04275228513507, "sim_render-ego": 0.0740522050857544, "in-drivable-lane": 5.200000000000045, "agent_compute-ego": 0.10031129995981852, "deviation-heading": 6.531713400148343, "set_robot_commands": 0.13044682423273724, "deviation-center-line": 0.7477913518549973, "driven_lanedir_consec": 0.760985076787565, "sim_compute_sim_state": 0.04592213948567708, "sim_compute_performance-ego": 0.08432359218597413, "sim_compute_robot_state-ego": 0.09854228655497232, "sim_compute_robot_state-npc0": 0.08425692240397135, "sim_compute_robot_state-npc1": 0.08280603011449178, "sim_compute_robot_state-npc2": 0.08310765107472738, "sim_compute_robot_state-npc3": 0.08347018639246623}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462617447445189, "sim_physics": 0.21366730758122035, "survival_time": 5.599999999999988, "driven_lanedir": 0.7781188388865394, "sim_render-ego": 0.0745418838092259, "in-drivable-lane": 0, "agent_compute-ego": 0.09577901661396028, "deviation-heading": 1.9741325579894584, "set_robot_commands": 0.1278287789651326, "deviation-center-line": 0.2752132037763842, "driven_lanedir_consec": 0.7781188388865394, "sim_compute_sim_state": 0.04587129184177944, "sim_compute_performance-ego": 0.08460780765329089, "sim_compute_robot_state-ego": 0.09731273778847284, "sim_compute_robot_state-npc0": 0.08414741711957115, "sim_compute_robot_state-npc1": 0.08234374438013349, "sim_compute_robot_state-npc2": 0.08362985508782524, "sim_compute_robot_state-npc3": 0.08487894279616219}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3483500137918556, "sim_physics": 0.23694669087727863, "survival_time": 14.950000000000076, "driven_lanedir": 1.4709184163316449, "sim_render-ego": 0.07019192934036254, "in-drivable-lane": 2.4000000000000092, "agent_compute-ego": 0.0920620584487915, "deviation-heading": 7.510608728554441, "set_robot_commands": 0.12009559710820517, "deviation-center-line": 1.1234495849368888, "driven_lanedir_consec": 0.9085408473486476, "sim_compute_sim_state": 0.043969340324401855, "sim_compute_performance-ego": 0.07900574445724487, "sim_compute_robot_state-ego": 0.09068319400151573, "sim_compute_robot_state-npc0": 0.08015515724817912, "sim_compute_robot_state-npc1": 0.07870778322219849, "sim_compute_robot_state-npc2": 0.07753921349843343, "sim_compute_robot_state-npc3": 0.07860834916432699}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.25964596676498836, "sim_physics": 0.22774715912647736, "survival_time": 1.950000000000001, "driven_lanedir": 0.24211879882659293, "sim_render-ego": 0.07387935809600048, "in-drivable-lane": 0, "agent_compute-ego": 0.09742805285331532, "deviation-heading": 0.5370526766587093, "set_robot_commands": 0.12141110346867488, "deviation-center-line": 0.17216526921023204, "driven_lanedir_consec": 0.24211879882659293, "sim_compute_sim_state": 0.04332055801000351, "sim_compute_performance-ego": 0.08278193229284042, "sim_compute_robot_state-ego": 0.09183374429360414, "sim_compute_robot_state-npc0": 0.0799721815647223, "sim_compute_robot_state-npc1": 0.0774998725988926, "sim_compute_robot_state-npc2": 0.08155001738132575, "sim_compute_robot_state-npc3": 0.08190678938841209}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3483459368705155, "sim_physics": 0.25296833356221515, "survival_time": 14.950000000000076, "driven_lanedir": 1.1286807524982376, "sim_render-ego": 0.07460779905319213, "in-drivable-lane": 5.4500000000000535, "agent_compute-ego": 0.10018052577972412, "deviation-heading": 5.377620278851787, "set_robot_commands": 0.12737329403559366, "deviation-center-line": 0.6110008091274789, "driven_lanedir_consec": 0.6518699853883667, "sim_compute_sim_state": 0.04772959391276042, "sim_compute_performance-ego": 0.08351080576578776, "sim_compute_robot_state-ego": 0.09877052783966064, "sim_compute_robot_state-npc0": 0.08503485997517904, "sim_compute_robot_state-npc1": 0.0847248101234436, "sim_compute_robot_state-npc2": 0.08421011924743653, "sim_compute_robot_state-npc3": 0.08484084288279216}}
set_robot_commands_max	0.13044682423273724
set_robot_commands_mean	0.1254311195620687
set_robot_commands_median	0.12737329403559366
set_robot_commands_min	0.12009559710820517
sim_compute_performance-ego_max	0.08460780765329089
sim_compute_performance-ego_mean	0.08284597647102761
sim_compute_performance-ego_median	0.08351080576578776
sim_compute_performance-ego_min	0.07900574445724487
sim_compute_robot_state-ego_max	0.09877052783966064
sim_compute_robot_state-ego_mean	0.09542849809564512
sim_compute_robot_state-ego_median	0.09731273778847284
sim_compute_robot_state-ego_min	0.09068319400151573
sim_compute_robot_state-npc0_max	0.08503485997517904
sim_compute_robot_state-npc0_mean	0.08271330766232458
sim_compute_robot_state-npc0_median	0.08414741711957115
sim_compute_robot_state-npc0_min	0.0799721815647223
sim_compute_robot_state-npc1_max	0.0847248101234436
sim_compute_robot_state-npc1_mean	0.08121644808783199
sim_compute_robot_state-npc1_median	0.08234374438013349
sim_compute_robot_state-npc1_min	0.0774998725988926
sim_compute_robot_state-npc2_max	0.08421011924743653
sim_compute_robot_state-npc2_mean	0.08200737125794967
sim_compute_robot_state-npc2_median	0.08310765107472738
sim_compute_robot_state-npc2_min	0.07753921349843343
sim_compute_robot_state-npc3_max	0.08487894279616219
sim_compute_robot_state-npc3_mean	0.08274102212483193
sim_compute_robot_state-npc3_median	0.08347018639246623
sim_compute_robot_state-npc3_min	0.07860834916432699
sim_compute_sim_state_max	0.04772959391276042
sim_compute_sim_state_mean	0.04536258471492446
sim_compute_sim_state_median	0.04587129184177944
sim_compute_sim_state_min	0.04332055801000351
sim_physics_max	0.25296833356221515
sim_physics_mean	0.2367775794682485
sim_physics_median	0.23694669087727863
sim_physics_min	0.21366730758122035
sim_render-ego_max	0.07460779905319213
sim_render-ego_mean	0.0734546350769071
sim_render-ego_median	0.0740522050857544
sim_render-ego_min	0.07019192934036254
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.480000000000045
survival_time_min	1.950000000000001

No reset possible

20383

2668

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

aido2-LFVI-sim-validation

2019-04-25 12:00:25+00:00

2019-04-25 12:01:27+00:00

0:01:02

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20368

2699

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:55:17+00:00

2019-04-25 12:00:04+00:00

0:04:47

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20368-792202', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20368-792202', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20368-792202', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20362

2723

jiang peng

test for ppo

step1-simulation

error

2019-04-25 11:53:40+00:00

2019-04-25 11:55:03+00:00

0:01:23

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20353

2734

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-25 11:51:20+00:00

2019-04-25 11:53:11+00:00

0:01:51

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20350

2747

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 11:49:18+00:00

2019-04-25 11:51:12+00:00

0:01:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20339

2767

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 11:38:26+00:00

2019-04-25 11:48:43+00:00

0:10:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.440708002891483
survival_time_median	4.099999999999993
deviation-center-line_median	0.3213834693025866
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.11559279881990872
agent_compute-ego_mean	0.11403552136384404
agent_compute-ego_median	0.11433609520516744
agent_compute-ego_min	0.1114047976101146
deviation-center-line_max	0.4261044001621655
deviation-center-line_mean	0.3342484087352478
deviation-center-line_min	0.23696272598564033
deviation-heading_max	3.323987081490362
deviation-heading_mean	1.5692519291482991
deviation-heading_median	1.3171904640330854
deviation-heading_min	0.4268673287533884
driven_any_max	0.9908037022346492
driven_any_mean	0.6424257417720145
driven_any_median	0.6050353555470757
driven_any_min	0.40587783279784534
driven_lanedir_consec_max	0.7462626502409044
driven_lanedir_consec_mean	0.42255726419861767
driven_lanedir_consec_min	0.14435832205446048
driven_lanedir_max	0.7462626502409044
driven_lanedir_mean	0.4816791218963317
driven_lanedir_median	0.440708002891483
driven_lanedir_min	0.2716201803474525
in-drivable-lane_max	1.2499999999999982
in-drivable-lane_mean	0.429999999999999
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.40587783279784534, "sim_physics": 0.1296755445414576, "survival_time": 2.8999999999999977, "driven_lanedir": 0.32323461609766113, "sim_render-ego": 0.0711503686576054, "in-drivable-lane": 0, "agent_compute-ego": 0.1145130889169101, "deviation-heading": 1.3171904640330854, "set_robot_commands": 0.11251421221371356, "deviation-center-line": 0.23696272598564033, "driven_lanedir_consec": 0.32323461609766113, "sim_compute_sim_state": 0.04348832985450481, "sim_compute_performance-ego": 0.08129854037843902, "sim_compute_robot_state-ego": 0.09531619219944396}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6050353555470757, "sim_physics": 0.11971305637824826, "survival_time": 4.099999999999993, "driven_lanedir": 0.2716201803474525, "sim_render-ego": 0.06976949877855254, "in-drivable-lane": 1.2499999999999982, "agent_compute-ego": 0.11433609520516744, "deviation-heading": 1.7722768034702512, "set_robot_commands": 0.11344686950125343, "deviation-center-line": 0.2940368891536158, "driven_lanedir_consec": 0.14435832205446048, "sim_compute_sim_state": 0.04361955712481243, "sim_compute_performance-ego": 0.08086115267218613, "sim_compute_robot_state-ego": 0.09065916480087652}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4444846656058909, "sim_physics": 0.12539780139923096, "survival_time": 3.099999999999997, "driven_lanedir": 0.440708002891483, "sim_render-ego": 0.07015884691669096, "in-drivable-lane": 0, "agent_compute-ego": 0.11433082626711938, "deviation-heading": 0.4268673287533884, "set_robot_commands": 0.1156984144641507, "deviation-center-line": 0.3213834693025866, "driven_lanedir_consec": 0.440708002891483, "sim_compute_sim_state": 0.04570531460546678, "sim_compute_performance-ego": 0.08311054014390515, "sim_compute_robot_state-ego": 0.09465709424787952}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7659271526746111, "sim_physics": 0.1285715056400673, "survival_time": 5.09999999999999, "driven_lanedir": 0.7462626502409044, "sim_render-ego": 0.07235999902089436, "in-drivable-lane": 0, "agent_compute-ego": 0.1114047976101146, "deviation-heading": 1.005937967994409, "set_robot_commands": 0.11340472511216708, "deviation-center-line": 0.4261044001621655, "driven_lanedir_consec": 0.7462626502409044, "sim_compute_sim_state": 0.04489718932731479, "sim_compute_performance-ego": 0.08415832706526213, "sim_compute_robot_state-ego": 0.09264196134081074}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9908037022346492, "sim_physics": 0.14097976501171405, "survival_time": 6.499999999999985, "driven_lanedir": 0.6265701599041575, "sim_render-ego": 0.07315745903895451, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.11559279881990872, "deviation-heading": 3.323987081490362, "set_robot_commands": 0.11730648370889515, "deviation-center-line": 0.3927545590722306, "driven_lanedir_consec": 0.4582227297085794, "sim_compute_sim_state": 0.0438070480640118, "sim_compute_performance-ego": 0.08224235497988187, "sim_compute_robot_state-ego": 0.09567435337946964}}
set_robot_commands_max	0.11730648370889515
set_robot_commands_mean	0.114474141000036
set_robot_commands_median	0.11344686950125343
set_robot_commands_min	0.11251421221371356
sim_compute_performance-ego_max	0.08415832706526213
sim_compute_performance-ego_mean	0.08233418304793486
sim_compute_performance-ego_median	0.08224235497988187
sim_compute_performance-ego_min	0.08086115267218613
sim_compute_robot_state-ego_max	0.09567435337946964
sim_compute_robot_state-ego_mean	0.09378975319369608
sim_compute_robot_state-ego_median	0.09465709424787952
sim_compute_robot_state-ego_min	0.09065916480087652
sim_compute_sim_state_max	0.04570531460546678
sim_compute_sim_state_mean	0.04430348779522212
sim_compute_sim_state_median	0.0438070480640118
sim_compute_sim_state_min	0.04348832985450481
sim_physics_max	0.14097976501171405
sim_physics_mean	0.12886753459414363
sim_physics_median	0.1285715056400673
sim_physics_min	0.11971305637824826
sim_render-ego_max	0.07315745903895451
sim_render-ego_mean	0.07131923448253956
sim_render-ego_median	0.0711503686576054
sim_render-ego_min	0.06976949877855254
simulation-passed	1
survival_time_max	6.499999999999985
survival_time_mean	4.339999999999993
survival_time_min	2.8999999999999977

No reset possible

20338

2778

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

aido2-LFVI-sim-validation

2019-04-25 11:37:28+00:00

2019-04-25 11:38:03+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20332

2787

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 11:36:35+00:00

2019-04-25 11:37:05+00:00

0:00:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20324

2799

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

aido2-LFVI-sim-validation

2019-04-25 11:33:56+00:00

2019-04-25 11:35:53+00:00

0:01:57

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20305

2827

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:24:27+00:00

2019-04-25 11:33:49+00:00

0:09:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1615217257354219
agent_compute-ego_mean	0.1555055930384211
agent_compute-ego_median	0.15738073587417603
agent_compute-ego_min	0.14954397082328796
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.18217380766598684, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.06174952803917651, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.1515161451303734, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.09598918905797994, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.041264324818017346, "sim_compute_performance-ego": 0.06945527949423161, "sim_compute_robot_state-ego": 0.07610693517720925, "sim_compute_robot_state-npc0": 0.07034865415321206, "sim_compute_robot_state-npc1": 0.06874282854907918, "sim_compute_robot_state-npc2": 0.06687261923304144, "sim_compute_robot_state-npc3": 0.06812943827431157}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.15868371725082395, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.062234739462534584, "in-drivable-lane": 0, "agent_compute-ego": 0.14954397082328796, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.09711199998855592, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03672740856806437, "sim_compute_performance-ego": 0.06549720962842305, "sim_compute_robot_state-ego": 0.06691397229830424, "sim_compute_robot_state-npc0": 0.06786383191744487, "sim_compute_robot_state-npc1": 0.06509097417195638, "sim_compute_robot_state-npc2": 0.06569565335909526, "sim_compute_robot_state-npc3": 0.06454705198605855}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.1934946149082507, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06548357413986981, "in-drivable-lane": 0, "agent_compute-ego": 0.1615217257354219, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.10497305352809064, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.04210371890310514, "sim_compute_performance-ego": 0.07323225878052793, "sim_compute_robot_state-ego": 0.08185911582688153, "sim_compute_robot_state-npc0": 0.07367613355992204, "sim_compute_robot_state-npc1": 0.07056077051970919, "sim_compute_robot_state-npc2": 0.07147135572918391, "sim_compute_robot_state-npc3": 0.0725157543764276}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.1920242067110741, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05960743710146112, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15756538762884623, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.09922683845132084, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.04104924606064619, "sim_compute_performance-ego": 0.06795460086757854, "sim_compute_robot_state-ego": 0.07276666770547123, "sim_compute_robot_state-npc0": 0.06997060775756836, "sim_compute_robot_state-npc1": 0.06921719292462883, "sim_compute_robot_state-npc2": 0.06925314967915164, "sim_compute_robot_state-npc3": 0.07220520003367278}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.1533164381980896, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.06293535232543945, "in-drivable-lane": 0, "agent_compute-ego": 0.15738073587417603, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.0971345067024231, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.0392866849899292, "sim_compute_performance-ego": 0.07032736539840698, "sim_compute_robot_state-ego": 0.0820908784866333, "sim_compute_robot_state-npc0": 0.06930088996887207, "sim_compute_robot_state-npc1": 0.07072452306747437, "sim_compute_robot_state-npc2": 0.07029041051864623, "sim_compute_robot_state-npc3": 0.06725602149963379}}
set_robot_commands_max	0.10497305352809064
set_robot_commands_mean	0.0988871175456741
set_robot_commands_median	0.0971345067024231
set_robot_commands_min	0.09598918905797994
sim_compute_performance-ego_max	0.07323225878052793
sim_compute_performance-ego_mean	0.06929334283383362
sim_compute_performance-ego_median	0.06945527949423161
sim_compute_performance-ego_min	0.06549720962842305
sim_compute_robot_state-ego_max	0.0820908784866333
sim_compute_robot_state-ego_mean	0.07594751389889991
sim_compute_robot_state-ego_median	0.07610693517720925
sim_compute_robot_state-ego_min	0.06691397229830424
sim_compute_robot_state-npc0_max	0.07367613355992204
sim_compute_robot_state-npc0_mean	0.07023202347140388
sim_compute_robot_state-npc0_median	0.06997060775756836
sim_compute_robot_state-npc0_min	0.06786383191744487
sim_compute_robot_state-npc1_max	0.07072452306747437
sim_compute_robot_state-npc1_mean	0.0688672578465696
sim_compute_robot_state-npc1_median	0.06921719292462883
sim_compute_robot_state-npc1_min	0.06509097417195638
sim_compute_robot_state-npc2_max	0.07147135572918391
sim_compute_robot_state-npc2_mean	0.0687166377038237
sim_compute_robot_state-npc2_median	0.06925314967915164
sim_compute_robot_state-npc2_min	0.06569565335909526
sim_compute_robot_state-npc3_max	0.0725157543764276
sim_compute_robot_state-npc3_mean	0.06893069323402086
sim_compute_robot_state-npc3_median	0.06812943827431157
sim_compute_robot_state-npc3_min	0.06454705198605855
sim_compute_sim_state_max	0.04210371890310514
sim_compute_sim_state_mean	0.04008627666795245
sim_compute_sim_state_median	0.04104924606064619
sim_compute_sim_state_min	0.03672740856806437
sim_physics_max	0.1934946149082507
sim_physics_mean	0.17593855694684502
sim_physics_median	0.18217380766598684
sim_physics_min	0.1533164381980896
sim_render-ego_max	0.06548357413986981
sim_render-ego_mean	0.0624021262136963
sim_render-ego_median	0.062234739462534584
sim_render-ego_min	0.05960743710146112
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20297

2839

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:23:17+00:00

2019-04-25 11:23:53+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20279

2880

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 11:02:42+00:00

2019-04-25 11:22:34+00:00

0:19:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.658141340093886
survival_time_median	6.999999999999983
deviation-center-line_median	0.3310166859136158
in-drivable-lane_median	2.0499999999999927

other stats

agent_compute-ego_max	0.16445061248568346
agent_compute-ego_mean	0.16054849906932414
agent_compute-ego_median	0.1589739599398204
agent_compute-ego_min	0.1583586641720363
deviation-center-line_max	0.4794323637301212
deviation-center-line_mean	0.3427896670341769
deviation-center-line_min	0.2298545284155696
deviation-heading_max	1.1504193675314938
deviation-heading_mean	0.9407336626620916
deviation-heading_median	0.9938354337214896
deviation-heading_min	0.7450586214352332
driven_any_max	1.6290075912696764
driven_any_mean	1.0117836241191598
driven_any_median	0.9970530395825568
driven_any_min	0.4251549262204664
driven_lanedir_consec_max	1.214560148863141
driven_lanedir_consec_mean	0.7110836872382787
driven_lanedir_consec_min	0.4039437775266599
driven_lanedir_max	1.214560148863141
driven_lanedir_mean	0.7110836872382787
driven_lanedir_median	0.658141340093886
driven_lanedir_min	0.4039437775266599
in-drivable-lane_max	5.000000000000038
in-drivable-lane_mean	1.8700000000000128
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.17205593075071063, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.06373628888811383, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1583586641720363, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.09882202318736484, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.039644307749611994, "sim_compute_performance-ego": 0.06898339305605207, "sim_compute_robot_state-ego": 0.07459180865968977, "sim_compute_robot_state-npc0": 0.07095036847250802, "sim_compute_robot_state-npc1": 0.07119429111480713, "sim_compute_robot_state-npc2": 0.06991058247429983, "sim_compute_robot_state-npc3": 0.07094243253980365}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.43097149972321946, "sim_physics": 0.17481787754939151, "survival_time": 3.2499999999999964, "driven_lanedir": 0.4039437775266599, "sim_render-ego": 0.0637566456427941, "in-drivable-lane": 0, "agent_compute-ego": 0.16259857691251314, "deviation-heading": 1.1504193675314938, "set_robot_commands": 0.10252596781804012, "deviation-center-line": 0.23438865875177528, "driven_lanedir_consec": 0.4039437775266599, "sim_compute_sim_state": 0.039790149835439825, "sim_compute_performance-ego": 0.07226204505333533, "sim_compute_robot_state-ego": 0.07787397824800932, "sim_compute_robot_state-npc0": 0.07124311006986178, "sim_compute_robot_state-npc1": 0.07177085142869216, "sim_compute_robot_state-npc2": 0.07263193130493165, "sim_compute_robot_state-npc3": 0.07184024590712328}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6290075912696764, "sim_physics": 0.17851558327674866, "survival_time": 11.200000000000024, "driven_lanedir": 0.8652843360363267, "sim_render-ego": 0.06203322751181466, "in-drivable-lane": 5.000000000000038, "agent_compute-ego": 0.1589739599398204, "deviation-heading": 1.007919996470557, "set_robot_commands": 0.0992854620729174, "deviation-center-line": 0.4794323637301212, "driven_lanedir_consec": 0.8652843360363267, "sim_compute_sim_state": 0.03947242668696812, "sim_compute_performance-ego": 0.07200472056865692, "sim_compute_robot_state-ego": 0.07477397258792605, "sim_compute_robot_state-npc0": 0.07015963643789291, "sim_compute_robot_state-npc1": 0.06991691674504961, "sim_compute_robot_state-npc2": 0.07138667574950627, "sim_compute_robot_state-npc3": 0.07025516884667533}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.57673106379988, "sim_physics": 0.1817690007697602, "survival_time": 10.85000000000002, "driven_lanedir": 1.214560148863141, "sim_render-ego": 0.06549253551641368, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.16445061248568346, "deviation-heading": 0.9938354337214896, "set_robot_commands": 0.10732454748197634, "deviation-center-line": 0.4392560983598026, "driven_lanedir_consec": 1.214560148863141, "sim_compute_sim_state": 0.04044880185808454, "sim_compute_performance-ego": 0.07226100824944984, "sim_compute_robot_state-ego": 0.07935429608217583, "sim_compute_robot_state-npc0": 0.07369383798766246, "sim_compute_robot_state-npc1": 0.07191507607561103, "sim_compute_robot_state-npc2": 0.07362468781009797, "sim_compute_robot_state-npc3": 0.07254307940258958}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4251549262204664, "sim_physics": 0.1473480709015377, "survival_time": 3.149999999999997, "driven_lanedir": 0.4134888336713798, "sim_render-ego": 0.06137187518770733, "in-drivable-lane": 0, "agent_compute-ego": 0.15836068183656724, "deviation-heading": 0.7450586214352332, "set_robot_commands": 0.09998539515904016, "deviation-center-line": 0.2298545284155696, "driven_lanedir_consec": 0.4134888336713798, "sim_compute_sim_state": 0.040661527996971494, "sim_compute_performance-ego": 0.06782636188325428, "sim_compute_robot_state-ego": 0.07242545248970153, "sim_compute_robot_state-npc0": 0.07195923441932314, "sim_compute_robot_state-npc1": 0.06875869962904188, "sim_compute_robot_state-npc2": 0.07240713588775151, "sim_compute_robot_state-npc3": 0.07501849674043201}}
set_robot_commands_max	0.10732454748197634
set_robot_commands_mean	0.10158867914386778
set_robot_commands_median	0.09998539515904016
set_robot_commands_min	0.09882202318736484
sim_compute_performance-ego_max	0.07226204505333533
sim_compute_performance-ego_mean	0.07066750576214968
sim_compute_performance-ego_median	0.07200472056865692
sim_compute_performance-ego_min	0.06782636188325428
sim_compute_robot_state-ego_max	0.07935429608217583
sim_compute_robot_state-ego_mean	0.07580390161350051
sim_compute_robot_state-ego_median	0.07477397258792605
sim_compute_robot_state-ego_min	0.07242545248970153
sim_compute_robot_state-npc0_max	0.07369383798766246
sim_compute_robot_state-npc0_mean	0.07160123747744966
sim_compute_robot_state-npc0_median	0.07124311006986178
sim_compute_robot_state-npc0_min	0.07015963643789291
sim_compute_robot_state-npc1_max	0.07191507607561103
sim_compute_robot_state-npc1_mean	0.07071116699864037
sim_compute_robot_state-npc1_median	0.07119429111480713
sim_compute_robot_state-npc1_min	0.06875869962904188
sim_compute_robot_state-npc2_max	0.07362468781009797
sim_compute_robot_state-npc2_mean	0.07199220264531744
sim_compute_robot_state-npc2_median	0.07240713588775151
sim_compute_robot_state-npc2_min	0.06991058247429983
sim_compute_robot_state-npc3_max	0.07501849674043201
sim_compute_robot_state-npc3_mean	0.07211988468732478
sim_compute_robot_state-npc3_median	0.07184024590712328
sim_compute_robot_state-npc3_min	0.07025516884667533
sim_compute_sim_state_max	0.040661527996971494
sim_compute_sim_state_mean	0.040003442825415195
sim_compute_sim_state_median	0.039790149835439825
sim_compute_sim_state_min	0.03947242668696812
sim_physics_max	0.1817690007697602
sim_physics_mean	0.17090129264962975
sim_physics_median	0.17481787754939151
sim_physics_min	0.1473480709015377
sim_render-ego_max	0.06549253551641368
sim_render-ego_mean	0.06327811454936873
sim_render-ego_median	0.06373628888811383
sim_render-ego_min	0.06137187518770733
simulation-passed	1
survival_time_max	11.200000000000024
survival_time_mean	7.090000000000005
survival_time_min	3.149999999999997

No reset possible

20271

2861

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:00:22+00:00

2019-04-25 11:02:04+00:00

0:01:42

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20262

2881

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-25 10:47:47+00:00

2019-04-25 11:00:04+00:00

0:12:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20262-389682', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20262-389682', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20262-389682', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20226

2977

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 10:18:31+00:00

2019-04-25 10:46:46+00:00

0:28:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.051489184068274
survival_time_median	10.95000000000002
deviation-center-line_median	0.6782279016540903
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2231224822998047
agent_compute-ego_mean	0.21201787629354651
agent_compute-ego_median	0.21669478006492376
agent_compute-ego_min	0.19681170164060988
deviation-center-line_max	0.8767562962663328
deviation-center-line_mean	0.6354043922261549
deviation-center-line_min	0.3343073211809355
deviation-heading_max	1.7404990194905254
deviation-heading_mean	1.2501332636080282
deviation-heading_median	1.152700557958266
deviation-heading_min	0.8651206762149583
driven_any_max	1.3981622261444493
driven_any_mean	1.0318967021481915
driven_any_median	1.0778149666545538
driven_any_min	0.5383703848419259
driven_lanedir_consec_max	1.3897826026208482
driven_lanedir_consec_mean	1.010680419519692
driven_lanedir_consec_min	0.4880682409343833
driven_lanedir_max	1.3897826026208482
driven_lanedir_mean	1.010680419519692
driven_lanedir_median	1.051489184068274
driven_lanedir_min	0.4880682409343833
in-drivable-lane_max	0.1999999999999993
in-drivable-lane_mean	0.060000000000000143
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5383703848419259, "sim_physics": 0.1557346592264727, "survival_time": 6.0499999999999865, "driven_lanedir": 0.4880682409343833, "sim_render-ego": 0.05590337367097208, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.19681170164060988, "deviation-heading": 1.7404990194905254, "set_robot_commands": 0.08722931097361668, "deviation-center-line": 0.3343073211809355, "driven_lanedir_consec": 0.4880682409343833, "sim_compute_sim_state": 0.03660419164610303, "sim_compute_performance-ego": 0.06191886949145104, "sim_compute_robot_state-ego": 0.06631494750661299, "sim_compute_robot_state-npc0": 0.06494296877837379, "sim_compute_robot_state-npc1": 0.06499262092527279, "sim_compute_robot_state-npc2": 0.06457674995926786, "sim_compute_robot_state-npc3": 0.06462693805536948}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3981622261444493, "sim_physics": 0.1936517834663391, "survival_time": 14.950000000000076, "driven_lanedir": 1.3897826026208482, "sim_render-ego": 0.0638486369450887, "in-drivable-lane": 0, "agent_compute-ego": 0.2231224822998047, "deviation-heading": 1.0483713842187776, "set_robot_commands": 0.10072156747182212, "deviation-center-line": 0.7788331478750178, "driven_lanedir_consec": 1.3897826026208482, "sim_compute_sim_state": 0.03987295071283976, "sim_compute_performance-ego": 0.06947321971257528, "sim_compute_robot_state-ego": 0.07505502065022786, "sim_compute_robot_state-npc0": 0.07129184802373251, "sim_compute_robot_state-npc1": 0.07038642644882202, "sim_compute_robot_state-npc2": 0.0709306271870931, "sim_compute_robot_state-npc3": 0.0719787844022115}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0493319907136776, "sim_physics": 0.179254201113009, "survival_time": 10.20000000000001, "driven_lanedir": 1.0409831498409887, "sim_render-ego": 0.06258221817951576, "in-drivable-lane": 0, "agent_compute-ego": 0.2211320446986778, "deviation-heading": 0.8651206762149583, "set_robot_commands": 0.09569379862617045, "deviation-center-line": 0.8767562962663328, "driven_lanedir_consec": 1.0409831498409887, "sim_compute_sim_state": 0.04104522864023844, "sim_compute_performance-ego": 0.06857319322286867, "sim_compute_robot_state-ego": 0.07419983429067276, "sim_compute_robot_state-npc0": 0.06962094938053805, "sim_compute_robot_state-npc1": 0.06955882030374863, "sim_compute_robot_state-npc2": 0.06990783237943463, "sim_compute_robot_state-npc3": 0.06885932473575368}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0958039423863517, "sim_physics": 0.17942330200747666, "survival_time": 11.050000000000022, "driven_lanedir": 1.083078920133965, "sim_render-ego": 0.06253810597760645, "in-drivable-lane": 0, "agent_compute-ego": 0.21669478006492376, "deviation-heading": 1.152700557958266, "set_robot_commands": 0.099548296691066, "deviation-center-line": 0.6782279016540903, "driven_lanedir_consec": 1.083078920133965, "sim_compute_sim_state": 0.03889137479514558, "sim_compute_performance-ego": 0.0698390859284552, "sim_compute_robot_state-ego": 0.07497387450205255, "sim_compute_robot_state-npc0": 0.07049006142767307, "sim_compute_robot_state-npc1": 0.06959746326256662, "sim_compute_robot_state-npc2": 0.06912154849298399, "sim_compute_robot_state-npc3": 0.06888005204869611}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0778149666545538, "sim_physics": 0.1587858287166787, "survival_time": 10.95000000000002, "driven_lanedir": 1.051489184068274, "sim_render-ego": 0.059065888461456995, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.20232837276371649, "deviation-heading": 1.443974680157614, "set_robot_commands": 0.08910973213579013, "deviation-center-line": 0.5088972941543982, "driven_lanedir_consec": 1.051489184068274, "sim_compute_sim_state": 0.037276702384426166, "sim_compute_performance-ego": 0.06468106731432213, "sim_compute_robot_state-ego": 0.06762232301442046, "sim_compute_robot_state-npc0": 0.06609071117557891, "sim_compute_robot_state-npc1": 0.06515331028803298, "sim_compute_robot_state-npc2": 0.06573417633091479, "sim_compute_robot_state-npc3": 0.06551830627058194}}
set_robot_commands_max	0.10072156747182212
set_robot_commands_mean	0.09446054117969307
set_robot_commands_median	0.09569379862617045
set_robot_commands_min	0.08722931097361668
sim_compute_performance-ego_max	0.0698390859284552
sim_compute_performance-ego_mean	0.06689708713393445
sim_compute_performance-ego_median	0.06857319322286867
sim_compute_performance-ego_min	0.06191886949145104
sim_compute_robot_state-ego_max	0.07505502065022786
sim_compute_robot_state-ego_mean	0.07163319999279731
sim_compute_robot_state-ego_median	0.07419983429067276
sim_compute_robot_state-ego_min	0.06631494750661299
sim_compute_robot_state-npc0_max	0.07129184802373251
sim_compute_robot_state-npc0_mean	0.06848730775717926
sim_compute_robot_state-npc0_median	0.06962094938053805
sim_compute_robot_state-npc0_min	0.06494296877837379
sim_compute_robot_state-npc1_max	0.07038642644882202
sim_compute_robot_state-npc1_mean	0.0679377282456886
sim_compute_robot_state-npc1_median	0.06955882030374863
sim_compute_robot_state-npc1_min	0.06499262092527279
sim_compute_robot_state-npc2_max	0.0709306271870931
sim_compute_robot_state-npc2_mean	0.06805418686993887
sim_compute_robot_state-npc2_median	0.06912154849298399
sim_compute_robot_state-npc2_min	0.06457674995926786
sim_compute_robot_state-npc3_max	0.0719787844022115
sim_compute_robot_state-npc3_mean	0.06797268110252255
sim_compute_robot_state-npc3_median	0.06885932473575368
sim_compute_robot_state-npc3_min	0.06462693805536948
sim_compute_sim_state_max	0.04104522864023844
sim_compute_sim_state_mean	0.038738089635750594
sim_compute_sim_state_median	0.03889137479514558
sim_compute_sim_state_min	0.03660419164610303
sim_physics_max	0.1936517834663391
sim_physics_mean	0.17336995490599524
sim_physics_median	0.179254201113009
sim_physics_min	0.1557346592264727
sim_render-ego_max	0.0638486369450887
sim_render-ego_mean	0.060787644646928
sim_render-ego_median	0.06253810597760645
sim_render-ego_min	0.05590337367097208
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.640000000000024
survival_time_min	6.0499999999999865

No reset possible

20176

2903

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 10:00:59+00:00

2019-04-25 10:18:09+00:00

0:17:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6699980031873563
survival_time_median	6.0499999999999865
deviation-center-line_median	0.22989190252058272
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.2719700159120166
agent_compute-ego_mean	0.2364419531267609
agent_compute-ego_median	0.24313743260441997
agent_compute-ego_min	0.19540349779457883
deviation-center-line_max	0.33201792035790856
deviation-center-line_mean	0.25256456833852975
deviation-center-line_min	0.17541972121402594
deviation-heading_max	0.981331716104171
deviation-heading_mean	0.8706154412628351
deviation-heading_median	0.8945719206665973
deviation-heading_min	0.6544662388320609
driven_any_max	1.5837655171710272
driven_any_mean	0.9967634710151348
driven_any_median	0.9985104515861262
driven_any_min	0.36957986101292273
driven_lanedir_consec_max	1.2126172562170692
driven_lanedir_consec_mean	0.7747941994764359
driven_lanedir_consec_min	0.35642054944876256
driven_lanedir_max	1.2126172562170692
driven_lanedir_mean	0.7747941994764359
driven_lanedir_median	0.6699980031873563
driven_lanedir_min	0.35642054944876256
in-drivable-lane_max	2.000000000000017
in-drivable-lane_mean	1.1300000000000057
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9985104515861262, "sim_physics": 0.1865428006353457, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6699980031873563, "sim_render-ego": 0.07416903480025362, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.2719700159120166, "deviation-heading": 0.9572691153769264, "set_robot_commands": 0.11495310018870455, "deviation-center-line": 0.22989190252058272, "driven_lanedir_consec": 0.6699980031873563, "sim_compute_sim_state": 0.043395702503929455, "sim_compute_performance-ego": 0.07529595863720602, "sim_compute_robot_state-ego": 0.08143474247829974, "sim_compute_robot_state-npc0": 0.07991837864079751, "sim_compute_robot_state-npc1": 0.07873411809117341, "sim_compute_robot_state-npc2": 0.07504760135303844, "sim_compute_robot_state-npc3": 0.07797420714512344}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4481960086074246, "sim_physics": 0.1311192430298904, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4227017642061286, "sim_render-ego": 0.05012516317696407, "in-drivable-lane": 0, "agent_compute-ego": 0.19540349779457883, "deviation-heading": 0.981331716104171, "set_robot_commands": 0.07917170277957258, "deviation-center-line": 0.20784169392406415, "driven_lanedir_consec": 0.4227017642061286, "sim_compute_sim_state": 0.03136451490994158, "sim_compute_performance-ego": 0.05743075239247289, "sim_compute_robot_state-ego": 0.0590126843288027, "sim_compute_robot_state-npc0": 0.057139844729982577, "sim_compute_robot_state-npc1": 0.05673177077852447, "sim_compute_robot_state-npc2": 0.055828102703752186, "sim_compute_robot_state-npc3": 0.05639857259289971}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5837655171710272, "sim_physics": 0.1666039342575885, "survival_time": 9.4, "driven_lanedir": 1.212233424322863, "sim_render-ego": 0.056519749316763374, "in-drivable-lane": 2.000000000000017, "agent_compute-ego": 0.22603319553618736, "deviation-heading": 0.8945719206665973, "set_robot_commands": 0.09123211845438532, "deviation-center-line": 0.33201792035790856, "driven_lanedir_consec": 1.212233424322863, "sim_compute_sim_state": 0.0358970748617294, "sim_compute_performance-ego": 0.06254666409593948, "sim_compute_robot_state-ego": 0.06986217929961834, "sim_compute_robot_state-npc0": 0.06611060715736226, "sim_compute_robot_state-npc1": 0.06373430059311237, "sim_compute_robot_state-npc2": 0.06482471557373697, "sim_compute_robot_state-npc3": 0.06351832633322858}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5837655166981723, "sim_physics": 0.18216652312177292, "survival_time": 9.4, "driven_lanedir": 1.2126172562170692, "sim_render-ego": 0.06006362590383976, "in-drivable-lane": 2.000000000000017, "agent_compute-ego": 0.2456656237866016, "deviation-heading": 0.8654382153344199, "set_robot_commands": 0.09548687300783525, "deviation-center-line": 0.31765160367606743, "driven_lanedir_consec": 1.2126172562170692, "sim_compute_sim_state": 0.03991684000542824, "sim_compute_performance-ego": 0.06819245663095028, "sim_compute_robot_state-ego": 0.072059968684582, "sim_compute_robot_state-npc0": 0.06887669766202886, "sim_compute_robot_state-npc1": 0.06792349003730937, "sim_compute_robot_state-npc2": 0.06641379315802391, "sim_compute_robot_state-npc3": 0.06784779340662855}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36957986101292273, "sim_physics": 0.16125876076367435, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35642054944876256, "sim_render-ego": 0.0634650892140914, "in-drivable-lane": 0, "agent_compute-ego": 0.24313743260441997, "deviation-heading": 0.6544662388320609, "set_robot_commands": 0.10508578650805415, "deviation-center-line": 0.17541972121402594, "driven_lanedir_consec": 0.35642054944876256, "sim_compute_sim_state": 0.04038845276346012, "sim_compute_performance-ego": 0.07008060143918407, "sim_compute_robot_state-ego": 0.07861473608990105, "sim_compute_robot_state-npc0": 0.07302814600419025, "sim_compute_robot_state-npc1": 0.07265251996565839, "sim_compute_robot_state-npc2": 0.0711364308182074, "sim_compute_robot_state-npc3": 0.06883593481414173}}
set_robot_commands_max	0.11495310018870455
set_robot_commands_mean	0.09718591618771036
set_robot_commands_median	0.09548687300783525
set_robot_commands_min	0.07917170277957258
sim_compute_performance-ego_max	0.07529595863720602
sim_compute_performance-ego_mean	0.06670928663915054
sim_compute_performance-ego_median	0.06819245663095028
sim_compute_performance-ego_min	0.05743075239247289
sim_compute_robot_state-ego_max	0.08143474247829974
sim_compute_robot_state-ego_mean	0.07219686217624076
sim_compute_robot_state-ego_median	0.072059968684582
sim_compute_robot_state-ego_min	0.0590126843288027
sim_compute_robot_state-npc0_max	0.07991837864079751
sim_compute_robot_state-npc0_mean	0.06901473483887229
sim_compute_robot_state-npc0_median	0.06887669766202886
sim_compute_robot_state-npc0_min	0.057139844729982577
sim_compute_robot_state-npc1_max	0.07873411809117341
sim_compute_robot_state-npc1_mean	0.06795523989315559
sim_compute_robot_state-npc1_median	0.06792349003730937
sim_compute_robot_state-npc1_min	0.05673177077852447
sim_compute_robot_state-npc2_max	0.07504760135303844
sim_compute_robot_state-npc2_mean	0.06665012872135179
sim_compute_robot_state-npc2_median	0.06641379315802391
sim_compute_robot_state-npc2_min	0.055828102703752186
sim_compute_robot_state-npc3_max	0.07797420714512344
sim_compute_robot_state-npc3_mean	0.06691496685840441
sim_compute_robot_state-npc3_median	0.06784779340662855
sim_compute_robot_state-npc3_min	0.05639857259289971
sim_compute_sim_state_max	0.043395702503929455
sim_compute_sim_state_mean	0.03819251700889776
sim_compute_sim_state_median	0.03991684000542824
sim_compute_sim_state_min	0.03136451490994158
sim_physics_max	0.1865428006353457
sim_physics_mean	0.16553825236165437
sim_physics_median	0.1666039342575885
sim_physics_min	0.1311192430298904
sim_render-ego_max	0.07416903480025362
sim_render-ego_mean	0.06086853248238244
sim_render-ego_median	0.06006362590383976
sim_render-ego_min	0.05012516317696407
simulation-passed	1
survival_time_max	9.4
survival_time_mean	6.0399999999999965
survival_time_min	2.4499999999999993

No reset possible

20145

2981

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 09:43:28+00:00

2019-04-25 10:00:04+00:00

0:16:36

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20145-442491', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20145-442491', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20145-442491', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20133

3002

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 09:40:37+00:00

2019-04-25 09:43:21+00:00

0:02:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20127

3007

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:39:45+00:00

2019-04-25 09:40:18+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20121

3023

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:38:41+00:00

2019-04-25 09:39:14+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20115

3030

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:37:20+00:00

2019-04-25 09:37:52+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20113

3038

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 09:35:16+00:00

2019-04-25 09:36:54+00:00

0:01:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20059

2981

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 09:01:00+00:00

2019-04-25 09:34:24+00:00

0:33:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.796500330327973
survival_time_median	12.500000000000044
deviation-center-line_median	0.7452233481855224
in-drivable-lane_median	0.4000000000000057

other stats

agent_compute-ego_max	0.25250343227386474
agent_compute-ego_mean	0.22565219860748936
agent_compute-ego_median	0.2187781540552775
agent_compute-ego_min	0.20222271718251864
deviation-center-line_max	1.528307182122037
deviation-center-line_mean	0.775218697300698
deviation-center-line_min	0.3071931139680738
deviation-heading_max	3.2748605217423115
deviation-heading_mean	1.853900629629477
deviation-heading_median	1.7028199695757853
deviation-heading_min	1.0574302857592397
driven_any_max	1.4516339657301265
driven_any_mean	1.0714683081081555
driven_any_median	1.036287573468929
driven_any_min	0.5155328846316134
driven_lanedir_consec_max	1.4438455579343608
driven_lanedir_consec_mean	0.8555442943584473
driven_lanedir_consec_min	0.46287869910859136
driven_lanedir_max	1.4438463768642216
driven_lanedir_mean	0.9155305300593632
driven_lanedir_median	0.796500330327973
driven_lanedir_min	0.46287869910859136
in-drivable-lane_max	3.100000000000044
in-drivable-lane_mean	1.340000000000018
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.4516339657301265, "sim_physics": 0.19141278187433877, "survival_time": 14.950000000000076, "driven_lanedir": 1.4438463768642216, "sim_render-ego": 0.06040642499923706, "in-drivable-lane": 0, "agent_compute-ego": 0.2187781540552775, "deviation-heading": 1.101958463463376, "set_robot_commands": 0.0943346349398295, "deviation-center-line": 0.7452233481855224, "driven_lanedir_consec": 1.4438455579343608, "sim_compute_sim_state": 0.03786991119384766, "sim_compute_performance-ego": 0.06772764841715495, "sim_compute_robot_state-ego": 0.07224817911783854, "sim_compute_robot_state-npc0": 0.06793147643407185, "sim_compute_robot_state-npc1": 0.0669261113802592, "sim_compute_robot_state-npc2": 0.06771408398946126, "sim_compute_robot_state-npc3": 0.06683202743530274}, "udem1-1-0": {"driven_any": 0.5155328846316134, "sim_physics": 0.2017549628303165, "survival_time": 5.249999999999989, "driven_lanedir": 0.46287869910859136, "sim_render-ego": 0.0671299866267613, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.24859430676414856, "deviation-heading": 1.7028199695757853, "set_robot_commands": 0.10441247395106724, "deviation-center-line": 0.3071931139680738, "driven_lanedir_consec": 0.46287869910859136, "sim_compute_sim_state": 0.041381452197120305, "sim_compute_performance-ego": 0.07664172308785575, "sim_compute_robot_state-ego": 0.08032850992111933, "sim_compute_robot_state-npc0": 0.07579798017229353, "sim_compute_robot_state-npc1": 0.07390458924429757, "sim_compute_robot_state-npc2": 0.07380413782028925, "sim_compute_robot_state-npc3": 0.07274983723958334}, "udem1-2-0": {"driven_any": 1.0258012175161269, "sim_physics": 0.24295668029785156, "survival_time": 12.500000000000044, "driven_lanedir": 0.6967370835285025, "sim_render-ego": 0.07069477272033692, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.25250343227386474, "deviation-heading": 2.1324339076066727, "set_robot_commands": 0.10816091442108154, "deviation-center-line": 0.8285918534803651, "driven_lanedir_consec": 0.6697161760894526, "sim_compute_sim_state": 0.04194530391693115, "sim_compute_performance-ego": 0.07683091449737549, "sim_compute_robot_state-ego": 0.08453001499176026, "sim_compute_robot_state-npc0": 0.07481835746765136, "sim_compute_robot_state-npc1": 0.07490974140167236, "sim_compute_robot_state-npc2": 0.07720311069488525, "sim_compute_robot_state-npc3": 0.075101149559021}, "udem1-3-0": {"driven_any": 1.328085899193982, "sim_physics": 0.20061177015304563, "survival_time": 14.950000000000076, "driven_lanedir": 1.1776901604675276, "sim_render-ego": 0.05835441589355469, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.20616238276163737, "deviation-heading": 3.2748605217423115, "set_robot_commands": 0.08903122901916503, "deviation-center-line": 1.528307182122037, "driven_lanedir_consec": 0.9047807083318588, "sim_compute_sim_state": 0.035684523582458494, "sim_compute_performance-ego": 0.06566506306330364, "sim_compute_robot_state-ego": 0.06966731548309327, "sim_compute_robot_state-npc0": 0.06509890953699747, "sim_compute_robot_state-npc1": 0.06506760994593302, "sim_compute_robot_state-npc2": 0.06467763106028239, "sim_compute_robot_state-npc3": 0.0648064120610555}, "udem1-4-0": {"driven_any": 1.036287573468929, "sim_physics": 0.1815117902285315, "survival_time": 11.150000000000023, "driven_lanedir": 0.796500330327973, "sim_render-ego": 0.05713496828293052, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.20222271718251864, "deviation-heading": 1.0574302857592397, "set_robot_commands": 0.08823284226148118, "deviation-center-line": 0.46677798874749143, "driven_lanedir_consec": 0.796500330327973, "sim_compute_sim_state": 0.03691483399258601, "sim_compute_performance-ego": 0.06461701692487093, "sim_compute_robot_state-ego": 0.06629267615587722, "sim_compute_robot_state-npc0": 0.0659252303598173, "sim_compute_robot_state-npc1": 0.06402161303122482, "sim_compute_robot_state-npc2": 0.065402401936963, "sim_compute_robot_state-npc3": 0.0639213040270613}}
set_robot_commands_max	0.10816091442108154
set_robot_commands_mean	0.09683441891852491
set_robot_commands_median	0.0943346349398295
set_robot_commands_min	0.08823284226148118
sim_compute_performance-ego_max	0.07683091449737549
sim_compute_performance-ego_mean	0.07029647319811215
sim_compute_performance-ego_median	0.06772764841715495
sim_compute_performance-ego_min	0.06461701692487093
sim_compute_robot_state-ego_max	0.08453001499176026
sim_compute_robot_state-ego_mean	0.07461333913393772
sim_compute_robot_state-ego_median	0.07224817911783854
sim_compute_robot_state-ego_min	0.06629267615587722
sim_compute_robot_state-npc0_max	0.07579798017229353
sim_compute_robot_state-npc0_mean	0.06991439079416631
sim_compute_robot_state-npc0_median	0.06793147643407185
sim_compute_robot_state-npc0_min	0.06509890953699747
sim_compute_robot_state-npc1_max	0.07490974140167236
sim_compute_robot_state-npc1_mean	0.06896593300067741
sim_compute_robot_state-npc1_median	0.0669261113802592
sim_compute_robot_state-npc1_min	0.06402161303122482
sim_compute_robot_state-npc2_max	0.07720311069488525
sim_compute_robot_state-npc2_mean	0.06976027310037622
sim_compute_robot_state-npc2_median	0.06771408398946126
sim_compute_robot_state-npc2_min	0.06467763106028239
sim_compute_robot_state-npc3_max	0.075101149559021
sim_compute_robot_state-npc3_mean	0.06868214606440479
sim_compute_robot_state-npc3_median	0.06683202743530274
sim_compute_robot_state-npc3_min	0.0639213040270613
sim_compute_sim_state_max	0.04194530391693115
sim_compute_sim_state_mean	0.038759204976588725
sim_compute_sim_state_median	0.03786991119384766
sim_compute_sim_state_min	0.035684523582458494
sim_physics_max	0.24295668029785156
sim_physics_mean	0.2036495970768168
sim_physics_median	0.20061177015304563
sim_physics_min	0.1815117902285315
sim_render-ego_max	0.07069477272033692
sim_render-ego_mean	0.06274411370456409
sim_render-ego_median	0.06040642499923706
sim_render-ego_min	0.05713496828293052
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.760000000000042
survival_time_min	5.249999999999989

No reset possible

20047

2864

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 08:59:29+00:00

2019-04-25 09:00:53+00:00

0:01:24

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20047-828550', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20047-828550', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20047-828550', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20033

2365

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 08:49:35+00:00

2019-04-25 08:50:34+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19967

2555

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 08:41:36+00:00

2019-04-25 08:49:27+00:00

0:07:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4677520238097679
survival_time_median	2.849999999999998
deviation-center-line_median	0.13993923038273243
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.07941649578235767
agent_compute-ego_mean	0.0574322988108517
agent_compute-ego_median	0.05304785442959731
agent_compute-ego_min	0.04836439458947433
deviation-center-line_max	0.441991081977021
deviation-center-line_mean	0.24301419493149473
deviation-center-line_min	0.11233303566656118
deviation-heading_max	1.965590298952019
deviation-heading_mean	0.904977224642509
deviation-heading_median	0.6817498444220604
deviation-heading_min	0.23880859753921196
driven_any_max	2.234618045439434
driven_any_mean	1.1136680430892796
driven_any_median	0.7854280860806753
driven_any_min	0.3734823939695258
driven_lanedir_consec_max	1.4162453958283412
driven_lanedir_consec_mean	0.7217431069832176
driven_lanedir_consec_min	0.3618460409658957
driven_lanedir_max	1.4162453958283412
driven_lanedir_mean	0.7217431069832176
driven_lanedir_median	0.4677520238097679
driven_lanedir_min	0.3618460409658957
in-drivable-lane_max	3.2999999999999883
in-drivable-lane_mean	0.9999999999999964
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.034176380011686096, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.0441323723762658, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.05304785442959731, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.07140248444429628, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.02840289644374969, "sim_compute_performance-ego": 0.046666831727240496, "sim_compute_robot_state-ego": 0.05107283895942056, "sim_compute_robot_state-npc0": 0.04987436646868469, "sim_compute_robot_state-npc1": 0.05108277509166936, "sim_compute_robot_state-npc2": 0.04950888597281875, "sim_compute_robot_state-npc3": 0.05068665704909404}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.027678094412151136, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.042296422155279866, "in-drivable-lane": 0, "agent_compute-ego": 0.04836439458947433, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.06090846814607319, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.026418447494506836, "sim_compute_performance-ego": 0.04489059197275262, "sim_compute_robot_state-ego": 0.048647284507751465, "sim_compute_robot_state-npc0": 0.05315191494791131, "sim_compute_robot_state-npc1": 0.0441277591805709, "sim_compute_robot_state-npc2": 0.04405034843244051, "sim_compute_robot_state-npc3": 0.044326292841058025}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.0306048686044258, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.04332118285329718, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.051068669871280066, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.06546783028987416, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.028331488893743147, "sim_compute_performance-ego": 0.04898548962777121, "sim_compute_robot_state-ego": 0.04954894802026581, "sim_compute_robot_state-npc0": 0.04680171347500985, "sim_compute_robot_state-npc1": 0.046468902052494515, "sim_compute_robot_state-npc2": 0.048536317390308045, "sim_compute_robot_state-npc3": 0.04876030118841874}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.03621620602077908, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.05218430801674172, "in-drivable-lane": 0, "agent_compute-ego": 0.07941649578235767, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.08052823278639051, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.03211894741764775, "sim_compute_performance-ego": 0.05751843805666323, "sim_compute_robot_state-ego": 0.05971126203183775, "sim_compute_robot_state-npc0": 0.05705696565133554, "sim_compute_robot_state-npc1": 0.05733074965300383, "sim_compute_robot_state-npc2": 0.05793341883906611, "sim_compute_robot_state-npc3": 0.058673099235252095}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.03481745152246384, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.04730530958327036, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.05526407938154917, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.07212406680697486, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.031256179960947185, "sim_compute_performance-ego": 0.05115520575689891, "sim_compute_robot_state-ego": 0.05882079449910966, "sim_compute_robot_state-npc0": 0.0532911599628509, "sim_compute_robot_state-npc1": 0.05421050957271031, "sim_compute_robot_state-npc2": 0.05313349337804885, "sim_compute_robot_state-npc3": 0.055929691072494264}}
set_robot_commands_max	0.08052823278639051
set_robot_commands_mean	0.0700862164947218
set_robot_commands_median	0.07140248444429628
set_robot_commands_min	0.06090846814607319
sim_compute_performance-ego_max	0.05751843805666323
sim_compute_performance-ego_mean	0.0498433114282653
sim_compute_performance-ego_median	0.04898548962777121
sim_compute_performance-ego_min	0.04489059197275262
sim_compute_robot_state-ego_max	0.05971126203183775
sim_compute_robot_state-ego_mean	0.05356022560367705
sim_compute_robot_state-ego_median	0.05107283895942056
sim_compute_robot_state-ego_min	0.048647284507751465
sim_compute_robot_state-npc0_max	0.05705696565133554
sim_compute_robot_state-npc0_mean	0.05203522410115846
sim_compute_robot_state-npc0_median	0.05315191494791131
sim_compute_robot_state-npc0_min	0.04680171347500985
sim_compute_robot_state-npc1_max	0.05733074965300383
sim_compute_robot_state-npc1_mean	0.05064413911008978
sim_compute_robot_state-npc1_median	0.05108277509166936
sim_compute_robot_state-npc1_min	0.0441277591805709
sim_compute_robot_state-npc2_max	0.05793341883906611
sim_compute_robot_state-npc2_mean	0.050632492802536455
sim_compute_robot_state-npc2_median	0.04950888597281875
sim_compute_robot_state-npc2_min	0.04405034843244051
sim_compute_robot_state-npc3_max	0.058673099235252095
sim_compute_robot_state-npc3_mean	0.05167520827726344
sim_compute_robot_state-npc3_median	0.05068665704909404
sim_compute_robot_state-npc3_min	0.044326292841058025
sim_compute_sim_state_max	0.03211894741764775
sim_compute_sim_state_mean	0.02930559204211892
sim_compute_sim_state_median	0.02840289644374969
sim_compute_sim_state_min	0.026418447494506836
sim_physics_max	0.03621620602077908
sim_physics_mean	0.03269860011430119
sim_physics_median	0.034176380011686096
sim_physics_min	0.027678094412151136
sim_render-ego_max	0.05218430801674172
sim_render-ego_mean	0.045847918996970986
sim_render-ego_median	0.0441323723762658
sim_render-ego_min	0.042296422155279866
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	4.049999999999993
survival_time_min	1.3500000000000003

No reset possible

19958

2677

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:40:37+00:00

2019-04-25 08:41:29+00:00

0:00:52

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19937

2867

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:39:05+00:00

2019-04-25 08:39:52+00:00

0:00:47

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19923

3031

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 08:38:09+00:00

2019-04-25 08:38:48+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19909

2657

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:37:07+00:00

2019-04-25 08:37:55+00:00

0:00:48

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19866

2910

FANG MEIYI 🇸🇬

test

step1-simulation

error

2019-04-25 08:33:05+00:00

2019-04-25 08:36:59+00:00

0:03:54

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19848

3007

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 08:30:53+00:00

2019-04-25 08:32:51+00:00

0:01:58

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19830

2648

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 08:21:14+00:00

2019-04-25 08:30:39+00:00

0:09:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4677520238097679
survival_time_median	2.849999999999998
deviation-center-line_median	0.13993923038273243
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.07362192555477745
agent_compute-ego_mean	0.06373487125153937
agent_compute-ego_median	0.06214032659105435
agent_compute-ego_min	0.05863240030076769
deviation-center-line_max	0.441991081977021
deviation-center-line_mean	0.24301419493149473
deviation-center-line_min	0.11233303566656118
deviation-heading_max	1.965590298952019
deviation-heading_mean	0.904977224642509
deviation-heading_median	0.6817498444220604
deviation-heading_min	0.23880859753921196
driven_any_max	2.234618045439434
driven_any_mean	1.1136680430892796
driven_any_median	0.7854280860806753
driven_any_min	0.3734823939695258
driven_lanedir_consec_max	1.4162453958283412
driven_lanedir_consec_mean	0.7217431069832176
driven_lanedir_consec_min	0.3618460409658957
driven_lanedir_max	1.4162453958283412
driven_lanedir_mean	0.7217431069832176
driven_lanedir_median	0.4677520238097679
driven_lanedir_min	0.3618460409658957
in-drivable-lane_max	3.2999999999999883
in-drivable-lane_mean	0.9999999999999964
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.040694330907930995, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.05581242111837788, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.06214032659105435, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.08614198113702665, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.03425112499552927, "sim_compute_performance-ego": 0.060230341686564645, "sim_compute_robot_state-ego": 0.06416006149000424, "sim_compute_robot_state-npc0": 0.060738142888257456, "sim_compute_robot_state-npc1": 0.061677410344409336, "sim_compute_robot_state-npc2": 0.0621870596697376, "sim_compute_robot_state-npc3": 0.06229408683290907}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.04317961868486906, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.06451784309587981, "in-drivable-lane": 0, "agent_compute-ego": 0.07362192555477745, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.10676964333182888, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.03909109768114592, "sim_compute_performance-ego": 0.06884559204703883, "sim_compute_robot_state-ego": 0.07980730031666003, "sim_compute_robot_state-npc0": 0.06844053142949154, "sim_compute_robot_state-npc1": 0.06698169833735416, "sim_compute_robot_state-npc2": 0.06730593505658601, "sim_compute_robot_state-npc3": 0.06819523635663484}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.0413729517083419, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.06012443074008875, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.06394784074080617, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.09089995267098412, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.03476369171811823, "sim_compute_performance-ego": 0.06038392635813931, "sim_compute_robot_state-ego": 0.06624020191661098, "sim_compute_robot_state-npc0": 0.060578279327927975, "sim_compute_robot_state-npc1": 0.06049540586638869, "sim_compute_robot_state-npc2": 0.05985806699384723, "sim_compute_robot_state-npc3": 0.060990182976973686}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.04132414747167517, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.07457515045448586, "in-drivable-lane": 0, "agent_compute-ego": 0.05863240030076769, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.07641862939905238, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.0337022410498725, "sim_compute_performance-ego": 0.07584123258237485, "sim_compute_robot_state-ego": 0.08406573754769785, "sim_compute_robot_state-npc0": 0.05807103934111418, "sim_compute_robot_state-npc1": 0.06916152989422833, "sim_compute_robot_state-npc2": 0.058692490613019024, "sim_compute_robot_state-npc3": 0.05780448736967864}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.04031470465281653, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.05660377986847408, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06033186307029119, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.08278136593954903, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.034790419396899995, "sim_compute_performance-ego": 0.059259346553257534, "sim_compute_robot_state-ego": 0.06385381070394365, "sim_compute_robot_state-npc0": 0.06012761971307179, "sim_compute_robot_state-npc1": 0.06050877533261738, "sim_compute_robot_state-npc2": 0.06069159886193654, "sim_compute_robot_state-npc3": 0.05912845664554172}}
set_robot_commands_max	0.10676964333182888
set_robot_commands_mean	0.0886023144956882
set_robot_commands_median	0.08614198113702665
set_robot_commands_min	0.07641862939905238
sim_compute_performance-ego_max	0.07584123258237485
sim_compute_performance-ego_mean	0.06491208784547503
sim_compute_performance-ego_median	0.06038392635813931
sim_compute_performance-ego_min	0.059259346553257534
sim_compute_robot_state-ego_max	0.08406573754769785
sim_compute_robot_state-ego_mean	0.07162542239498335
sim_compute_robot_state-ego_median	0.06624020191661098
sim_compute_robot_state-ego_min	0.06385381070394365
sim_compute_robot_state-npc0_max	0.06844053142949154
sim_compute_robot_state-npc0_mean	0.061591122539972586
sim_compute_robot_state-npc0_median	0.060578279327927975
sim_compute_robot_state-npc0_min	0.05807103934111418
sim_compute_robot_state-npc1_max	0.06916152989422833
sim_compute_robot_state-npc1_mean	0.06376496395499959
sim_compute_robot_state-npc1_median	0.061677410344409336
sim_compute_robot_state-npc1_min	0.06049540586638869
sim_compute_robot_state-npc2_max	0.06730593505658601
sim_compute_robot_state-npc2_mean	0.06174703023902528
sim_compute_robot_state-npc2_median	0.06069159886193654
sim_compute_robot_state-npc2_min	0.058692490613019024
sim_compute_robot_state-npc3_max	0.06819523635663484
sim_compute_robot_state-npc3_mean	0.06168249003634759
sim_compute_robot_state-npc3_median	0.060990182976973686
sim_compute_robot_state-npc3_min	0.05780448736967864
sim_compute_sim_state_max	0.03909109768114592
sim_compute_sim_state_mean	0.03531971496831318
sim_compute_sim_state_median	0.03476369171811823
sim_compute_sim_state_min	0.0337022410498725
sim_physics_max	0.04317961868486906
sim_physics_mean	0.041377150685126735
sim_physics_median	0.04132414747167517
sim_physics_min	0.04031470465281653
sim_render-ego_max	0.07457515045448586
sim_render-ego_mean	0.062326725055461274
sim_render-ego_median	0.06012443074008875
sim_render-ego_min	0.05581242111837788
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	4.049999999999993
survival_time_min	1.3500000000000003

No reset possible

19783

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 08:00:21+00:00

2019-04-25 08:21:02+00:00

0:20:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6901360175647038
survival_time_median	10.650000000000016
deviation-center-line_median	0.4039313142790796
in-drivable-lane_median	0.6000000000000085

other stats

agent_compute-ego_max	0.16288886864980062
agent_compute-ego_mean	0.13757024503168713
agent_compute-ego_median	0.1369975463885097
agent_compute-ego_min	0.11693833424494816
deviation-center-line_max	0.9036494815724962
deviation-center-line_mean	0.4973531693381113
deviation-center-line_min	0.2311413759150724
deviation-heading_max	2.6534330145643485
deviation-heading_mean	1.257401153787074
deviation-heading_median	0.9653047879124452
deviation-heading_min	0.7284890770541999
driven_any_max	2.1984483527409555
driven_any_mean	1.347894490995063
driven_any_median	1.552620499061873
driven_any_min	0.4064770712157617
driven_lanedir_consec_max	2.104424594597506
driven_lanedir_consec_mean	1.0762202721064849
driven_lanedir_consec_min	0.39472830997852393
driven_lanedir_max	2.1044675097701213
driven_lanedir_mean	1.076281468554041
driven_lanedir_median	0.6901360175647038
driven_lanedir_min	0.39472830997852393
in-drivable-lane_max	5.600000000000026
in-drivable-lane_mean	1.5800000000000058
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5569031012111356, "sim_physics": 0.03779405633979869, "survival_time": 10.700000000000015, "driven_lanedir": 1.5502659426823462, "sim_render-ego": 0.051780968068916106, "in-drivable-lane": 0, "agent_compute-ego": 0.1287579302475831, "deviation-heading": 0.917584903294301, "set_robot_commands": 0.09068393150222635, "deviation-center-line": 0.5991921834049575, "driven_lanedir_consec": 1.55000287561718, "sim_compute_sim_state": 0.03887178184830139, "sim_compute_performance-ego": 0.06991271772117258, "sim_compute_robot_state-ego": 0.05805483488278968, "sim_compute_robot_state-npc0": 0.06002091692986889, "sim_compute_robot_state-npc1": 0.0575959838439371, "sim_compute_robot_state-npc2": 0.05863791759883132, "sim_compute_robot_state-npc3": 0.06061556183289145}, "udem1-1-0": {"driven_any": 1.0250234307455888, "sim_physics": 0.03183308514681729, "survival_time": 7.149999999999983, "driven_lanedir": 0.6418095627745097, "sim_render-ego": 0.04602285365124682, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.11693833424494816, "deviation-heading": 2.6534330145643485, "set_robot_commands": 0.07344128368617771, "deviation-center-line": 0.4039313142790796, "driven_lanedir_consec": 0.6418095627745097, "sim_compute_sim_state": 0.029361359722964418, "sim_compute_performance-ego": 0.04988655010303417, "sim_compute_robot_state-ego": 0.05252293606738111, "sim_compute_robot_state-npc0": 0.051510405707192584, "sim_compute_robot_state-npc1": 0.051010973803646914, "sim_compute_robot_state-npc2": 0.05033849002598049, "sim_compute_robot_state-npc3": 0.05122678596656639}, "udem1-2-0": {"driven_any": 1.552620499061873, "sim_physics": 0.03638331319244815, "survival_time": 10.650000000000016, "driven_lanedir": 0.6901360175647038, "sim_render-ego": 0.056097330621710406, "in-drivable-lane": 5.600000000000026, "agent_compute-ego": 0.1369975463885097, "deviation-heading": 1.0221939861100755, "set_robot_commands": 0.08447442703963445, "deviation-center-line": 0.3488514915189506, "driven_lanedir_consec": 0.6901360175647038, "sim_compute_sim_state": 0.03289220814413868, "sim_compute_performance-ego": 0.06416054846535266, "sim_compute_robot_state-ego": 0.06336889244581052, "sim_compute_robot_state-npc0": 0.06020026027876447, "sim_compute_robot_state-npc1": 0.06041545487345664, "sim_compute_robot_state-npc2": 0.05865638916481269, "sim_compute_robot_state-npc3": 0.059865443359518274}, "udem1-3-0": {"driven_any": 2.1984483527409555, "sim_physics": 0.03722669363021851, "survival_time": 14.950000000000076, "driven_lanedir": 2.1044675097701213, "sim_render-ego": 0.05650542894999186, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.142268545627594, "deviation-heading": 0.9653047879124452, "set_robot_commands": 0.08625896612803141, "deviation-center-line": 0.9036494815724962, "driven_lanedir_consec": 2.104424594597506, "sim_compute_sim_state": 0.034980152448018394, "sim_compute_performance-ego": 0.06203893740971883, "sim_compute_robot_state-ego": 0.06571340163548788, "sim_compute_robot_state-npc0": 0.062527441183726, "sim_compute_robot_state-npc1": 0.06191541274388631, "sim_compute_robot_state-npc2": 0.06145999113718669, "sim_compute_robot_state-npc3": 0.061413919925689696}, "udem1-4-0": {"driven_any": 0.4064770712157617, "sim_physics": 0.04884496132532755, "survival_time": 2.9999999999999973, "driven_lanedir": 0.39472830997852393, "sim_render-ego": 0.06198824644088745, "in-drivable-lane": 0, "agent_compute-ego": 0.16288886864980062, "deviation-heading": 0.7284890770541999, "set_robot_commands": 0.09749075174331664, "deviation-center-line": 0.2311413759150724, "driven_lanedir_consec": 0.39472830997852393, "sim_compute_sim_state": 0.037095820903778075, "sim_compute_performance-ego": 0.0668578823407491, "sim_compute_robot_state-ego": 0.07259361743927002, "sim_compute_robot_state-npc0": 0.06984785795211793, "sim_compute_robot_state-npc1": 0.06700145800908407, "sim_compute_robot_state-npc2": 0.06760838826497396, "sim_compute_robot_state-npc3": 0.06609239180882771}}
set_robot_commands_max	0.09749075174331664
set_robot_commands_mean	0.08646987201987733
set_robot_commands_median	0.08625896612803141
set_robot_commands_min	0.07344128368617771
sim_compute_performance-ego_max	0.06991271772117258
sim_compute_performance-ego_mean	0.06257132720800547
sim_compute_performance-ego_median	0.06416054846535266
sim_compute_performance-ego_min	0.04988655010303417
sim_compute_robot_state-ego_max	0.07259361743927002
sim_compute_robot_state-ego_mean	0.06245073649414784
sim_compute_robot_state-ego_median	0.06336889244581052
sim_compute_robot_state-ego_min	0.05252293606738111
sim_compute_robot_state-npc0_max	0.06984785795211793
sim_compute_robot_state-npc0_mean	0.06082137641033397
sim_compute_robot_state-npc0_median	0.06020026027876447
sim_compute_robot_state-npc0_min	0.051510405707192584
sim_compute_robot_state-npc1_max	0.06700145800908407
sim_compute_robot_state-npc1_mean	0.05958785665480221
sim_compute_robot_state-npc1_median	0.06041545487345664
sim_compute_robot_state-npc1_min	0.051010973803646914
sim_compute_robot_state-npc2_max	0.06760838826497396
sim_compute_robot_state-npc2_mean	0.059340235238357034
sim_compute_robot_state-npc2_median	0.05865638916481269
sim_compute_robot_state-npc2_min	0.05033849002598049
sim_compute_robot_state-npc3_max	0.06609239180882771
sim_compute_robot_state-npc3_mean	0.059842820578698705
sim_compute_robot_state-npc3_median	0.06061556183289145
sim_compute_robot_state-npc3_min	0.05122678596656639
sim_compute_sim_state_max	0.03887178184830139
sim_compute_sim_state_mean	0.03464026461344019
sim_compute_sim_state_median	0.034980152448018394
sim_compute_sim_state_min	0.029361359722964418
sim_physics_max	0.04884496132532755
sim_physics_mean	0.03841642192692204
sim_physics_median	0.03722669363021851
sim_physics_min	0.03183308514681729
sim_render-ego_max	0.06198824644088745
sim_render-ego_mean	0.05447896554655053
sim_render-ego_median	0.056097330621710406
sim_render-ego_min	0.04602285365124682
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.29000000000002
survival_time_min	2.9999999999999973

No reset possible

19753

2660

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 07:46:05+00:00

2019-04-25 08:00:04+00:00

0:13:59

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19753-298298', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19753-298298', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19753-298298', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19734

3043

challenge-aido_LF-template-tensorflow

step1-simulation

error