Evaluator 806

step1-simulation

success

aido2-AMOD-service_quality

2019-04-26 17:18:07+00:00

2019-04-26 17:25:58+00:00

0:07:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5010810913194428
survival_time_median	3.7499999999999942
deviation-center-line_median	0.28935992135005617
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.07076335827509563
agent_compute-ego_mean	0.06790778729771338
agent_compute-ego_median	0.06772772719462712
agent_compute-ego_min	0.06426034927368164
deviation-center-line_max	1.0361962683167227
deviation-center-line_mean	0.4390941451101266
deviation-center-line_min	0.19276729378040153
deviation-heading_max	6.509815489851463
deviation-heading_mean	2.547102184528488
deviation-heading_median	1.5673992625771926
deviation-heading_min	0.473973186615092
driven_any_max	2.348791775879949
driven_any_mean	0.9092116489421798
driven_any_median	0.5489559579308317
driven_any_min	0.4203452006969904
driven_lanedir_consec_max	1.9089953017431132
driven_lanedir_consec_mean	0.6959571454629346
driven_lanedir_consec_min	0.18615410696419277
driven_lanedir_max	1.9612840018424056
driven_lanedir_mean	0.7187716338585373
driven_lanedir_median	0.5010810913194428
driven_lanedir_min	0.2479378488429136
in-drivable-lane_max	0.949999999999998
in-drivable-lane_mean	0.3100000000000006
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5103702037538602, "sim_physics": 0.04703442479523135, "survival_time": 3.5499999999999954, "driven_lanedir": 0.2479378488429136, "sim_render-ego": 0.03538964499889965, "in-drivable-lane": 0.949999999999998, "agent_compute-ego": 0.06603206043512048, "deviation-heading": 1.5673992625771926, "set_robot_commands": 0.05541094591919805, "deviation-center-line": 0.2477957066182248, "driven_lanedir_consec": 0.18615410696419277, "sim_compute_sim_state": 0.023408231600909164, "sim_compute_performance-ego": 0.03925216030067121, "sim_compute_robot_state-ego": 0.04076706859427438}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348791775879949, "sim_physics": 0.057504994869232176, "survival_time": 14.950000000000076, "driven_lanedir": 1.9612840018424056, "sim_render-ego": 0.035868368943532306, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.07076335827509563, "deviation-heading": 6.509815489851463, "set_robot_commands": 0.05523284912109375, "deviation-center-line": 1.0361962683167227, "driven_lanedir_consec": 1.9089953017431132, "sim_compute_sim_state": 0.023149081071217856, "sim_compute_performance-ego": 0.0396230419476827, "sim_compute_robot_state-ego": 0.04158411741256714}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5489559579308317, "sim_physics": 0.04605293909708659, "survival_time": 3.7499999999999942, "driven_lanedir": 0.5441297089122941, "sim_render-ego": 0.03544610977172852, "in-drivable-lane": 0, "agent_compute-ego": 0.06426034927368164, "deviation-heading": 0.473973186615092, "set_robot_commands": 0.05582097371419271, "deviation-center-line": 0.4293515354852281, "driven_lanedir_consec": 0.5441297089122941, "sim_compute_sim_state": 0.022767362594604493, "sim_compute_performance-ego": 0.03970629374186198, "sim_compute_robot_state-ego": 0.04067830721537272}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7175951064492678, "sim_physics": 0.05068582544724146, "survival_time": 4.799999999999991, "driven_lanedir": 0.5010810913194428, "sim_render-ego": 0.03574917962153753, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06772772719462712, "deviation-heading": 2.828976031534714, "set_robot_commands": 0.05525873353083929, "deviation-center-line": 0.28935992135005617, "driven_lanedir_consec": 0.5010810913194428, "sim_compute_sim_state": 0.02345038205385208, "sim_compute_performance-ego": 0.03969458490610123, "sim_compute_robot_state-ego": 0.04113008826971054}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4203452006969904, "sim_physics": 0.04900147551197117, "survival_time": 2.9499999999999975, "driven_lanedir": 0.3394255183756303, "sim_render-ego": 0.03624381857403254, "in-drivable-lane": 0, "agent_compute-ego": 0.07075544131004204, "deviation-heading": 1.3553469520639787, "set_robot_commands": 0.05474880186177916, "deviation-center-line": 0.19276729378040153, "driven_lanedir_consec": 0.3394255183756303, "sim_compute_sim_state": 0.023467803405503095, "sim_compute_performance-ego": 0.039544845031479654, "sim_compute_robot_state-ego": 0.04189759997998254}}
set_robot_commands_max	0.05582097371419271
set_robot_commands_mean	0.05529446082942059
set_robot_commands_median	0.05525873353083929
set_robot_commands_min	0.05474880186177916
sim_compute_performance-ego_max	0.03970629374186198
sim_compute_performance-ego_mean	0.039564185185559354
sim_compute_performance-ego_median	0.0396230419476827
sim_compute_performance-ego_min	0.03925216030067121
sim_compute_robot_state-ego_max	0.04189759997998254
sim_compute_robot_state-ego_mean	0.04121143629438147
sim_compute_robot_state-ego_median	0.04113008826971054
sim_compute_robot_state-ego_min	0.04067830721537272
sim_compute_sim_state_max	0.023467803405503095
sim_compute_sim_state_mean	0.02324857214521734
sim_compute_sim_state_median	0.023408231600909164
sim_compute_sim_state_min	0.022767362594604493
sim_physics_max	0.057504994869232176
sim_physics_mean	0.05005593194415255
sim_physics_median	0.04900147551197117
sim_physics_min	0.04605293909708659
sim_render-ego_max	0.03624381857403254
sim_render-ego_mean	0.035739424381946105
sim_render-ego_median	0.03574917962153753
sim_render-ego_min	0.03538964499889965
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.00000000000001
survival_time_min	2.9499999999999975

No reset possible

20664

3081

Andrea Censi 🇨🇭

Java template

step1-simulation

success

yes

2019-04-26 10:25:29+00:00

2019-04-26 10:29:05+00:00

0:03:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20653

3078

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 10:02:21+00:00

2019-04-26 10:22:23+00:00

0:20:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8598500455000533
survival_time_median	14.950000000000076
deviation-center-line_median	0.6335830095093654
in-drivable-lane_median	2.3500000000000334

other stats

agent_compute-ego_max	0.15259432315826416
agent_compute-ego_mean	0.14897427689427076
agent_compute-ego_median	0.14921315193176268
agent_compute-ego_min	0.14351353741655443
deviation-center-line_max	1.138337358233289
deviation-center-line_mean	0.6459587478464813
deviation-center-line_min	0.39602713017350016
deviation-heading_max	1.6169617108817438
deviation-heading_mean	1.372258184580145
deviation-heading_median	1.5509541180001003
deviation-heading_min	1.0034579567056208
driven_any_max	1.37631853889084
driven_any_mean	1.0155406317101097
driven_any_median	1.3740996226529705
driven_any_min	0.4335428665924545
driven_lanedir_consec_max	0.9136747134381976
driven_lanedir_consec_mean	0.7138091140563189
driven_lanedir_consec_min	0.4231274396910571
driven_lanedir_max	1.1481951066084384
driven_lanedir_mean	0.760713192690367
driven_lanedir_median	0.8598500455000533
driven_lanedir_min	0.4231274396910571
in-drivable-lane_max	5.350000000000076
in-drivable-lane_mean	2.5800000000000365
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3740996226529705, "sim_physics": 0.13636199792226156, "survival_time": 14.950000000000076, "driven_lanedir": 1.1481951066084384, "sim_render-ego": 0.0448730206489563, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.14921315193176268, "deviation-heading": 1.0034579567056208, "set_robot_commands": 0.06945419311523438, "deviation-center-line": 1.138337358233289, "driven_lanedir_consec": 0.9136747134381976, "sim_compute_sim_state": 0.02809152285257975, "sim_compute_performance-ego": 0.04875191450119019, "sim_compute_robot_state-ego": 0.049183061122894285, "sim_compute_robot_state-npc0": 0.0517041277885437, "sim_compute_robot_state-npc1": 0.05022218306859334, "sim_compute_robot_state-npc2": 0.049630112648010254, "sim_compute_robot_state-npc3": 0.05008474270502726}, "udem1-1-0": {"driven_any": 0.5181769074497181, "sim_physics": 0.11444664816571096, "survival_time": 5.849999999999987, "driven_lanedir": 0.49834048968136546, "sim_render-ego": 0.04625109933380388, "in-drivable-lane": 0, "agent_compute-ego": 0.1486001014709473, "deviation-heading": 1.6169617108817438, "set_robot_commands": 0.08056961776863815, "deviation-center-line": 0.4237993323563654, "driven_lanedir_consec": 0.49834048968136546, "sim_compute_sim_state": 0.02811600611760066, "sim_compute_performance-ego": 0.048120749302399464, "sim_compute_robot_state-ego": 0.04902988621312329, "sim_compute_robot_state-npc0": 0.0510763001238179, "sim_compute_robot_state-npc1": 0.05026258158887553, "sim_compute_robot_state-npc2": 0.04991523832337469, "sim_compute_robot_state-npc3": 0.049899563830122985}, "udem1-2-0": {"driven_any": 1.37631853889084, "sim_physics": 0.13412185986836753, "survival_time": 14.950000000000076, "driven_lanedir": 0.8598500455000533, "sim_render-ego": 0.047834348678588864, "in-drivable-lane": 5.350000000000076, "agent_compute-ego": 0.15259432315826416, "deviation-heading": 1.5931021022087843, "set_robot_commands": 0.06713432312011719, "deviation-center-line": 0.6380469089598867, "driven_lanedir_consec": 0.8598500455000533, "sim_compute_sim_state": 0.028228673934936523, "sim_compute_performance-ego": 0.05012722571690877, "sim_compute_robot_state-ego": 0.05035706440607707, "sim_compute_robot_state-npc0": 0.05295372088750203, "sim_compute_robot_state-npc1": 0.0511016591389974, "sim_compute_robot_state-npc2": 0.05071205933888753, "sim_compute_robot_state-npc3": 0.05131919225056966}, "udem1-3-0": {"driven_any": 1.3755652229645652, "sim_physics": 0.13376397053400677, "survival_time": 14.950000000000076, "driven_lanedir": 0.8740528819709206, "sim_render-ego": 0.04650853315989176, "in-drivable-lane": 5.200000000000074, "agent_compute-ego": 0.15095027049382528, "deviation-heading": 1.5509541180001003, "set_robot_commands": 0.06839813788731892, "deviation-center-line": 0.6335830095093654, "driven_lanedir_consec": 0.8740528819709206, "sim_compute_sim_state": 0.0283641521135966, "sim_compute_performance-ego": 0.05099442402521769, "sim_compute_robot_state-ego": 0.051096305052439374, "sim_compute_robot_state-npc0": 0.05446773131688436, "sim_compute_robot_state-npc1": 0.050070823033650715, "sim_compute_robot_state-npc2": 0.04969764153162638, "sim_compute_robot_state-npc3": 0.049842587312062585}, "udem1-4-0": {"driven_any": 0.4335428665924545, "sim_physics": 0.10645018442712648, "survival_time": 4.94999999999999, "driven_lanedir": 0.4231274396910571, "sim_render-ego": 0.04194112016697123, "in-drivable-lane": 0, "agent_compute-ego": 0.14351353741655443, "deviation-heading": 1.0968150351044763, "set_robot_commands": 0.06369721287428731, "deviation-center-line": 0.39602713017350016, "driven_lanedir_consec": 0.4231274396910571, "sim_compute_sim_state": 0.026306149935481523, "sim_compute_performance-ego": 0.045664765618064186, "sim_compute_robot_state-ego": 0.047914242503618955, "sim_compute_robot_state-npc0": 0.04847835771965258, "sim_compute_robot_state-npc1": 0.04919589890374078, "sim_compute_robot_state-npc2": 0.04747278280932494, "sim_compute_robot_state-npc3": 0.04718656973405318}}
set_robot_commands_max	0.08056961776863815
set_robot_commands_mean	0.06985069695311918
set_robot_commands_median	0.06839813788731892
set_robot_commands_min	0.06369721287428731
sim_compute_performance-ego_max	0.05099442402521769
sim_compute_performance-ego_mean	0.048731815832756056
sim_compute_performance-ego_median	0.04875191450119019
sim_compute_performance-ego_min	0.045664765618064186
sim_compute_robot_state-ego_max	0.051096305052439374
sim_compute_robot_state-ego_mean	0.04951611185963059
sim_compute_robot_state-ego_median	0.049183061122894285
sim_compute_robot_state-ego_min	0.047914242503618955
sim_compute_robot_state-npc0_max	0.05446773131688436
sim_compute_robot_state-npc0_mean	0.05173604756728012
sim_compute_robot_state-npc0_median	0.0517041277885437
sim_compute_robot_state-npc0_min	0.04847835771965258
sim_compute_robot_state-npc1_max	0.0511016591389974
sim_compute_robot_state-npc1_mean	0.05017062914677155
sim_compute_robot_state-npc1_median	0.05022218306859334
sim_compute_robot_state-npc1_min	0.04919589890374078
sim_compute_robot_state-npc2_max	0.05071205933888753
sim_compute_robot_state-npc2_mean	0.049485566930244765
sim_compute_robot_state-npc2_median	0.04969764153162638
sim_compute_robot_state-npc2_min	0.04747278280932494
sim_compute_robot_state-npc3_max	0.05131919225056966
sim_compute_robot_state-npc3_mean	0.049666531166367135
sim_compute_robot_state-npc3_median	0.049899563830122985
sim_compute_robot_state-npc3_min	0.04718656973405318
sim_compute_sim_state_max	0.0283641521135966
sim_compute_sim_state_mean	0.027821300990839008
sim_compute_sim_state_median	0.02811600611760066
sim_compute_sim_state_min	0.026306149935481523
sim_physics_max	0.13636199792226156
sim_physics_mean	0.12502893218349467
sim_physics_median	0.13376397053400677
sim_physics_min	0.10645018442712648
sim_render-ego_max	0.047834348678588864
sim_render-ego_mean	0.0454816243976424
sim_render-ego_median	0.04625109933380388
sim_render-ego_min	0.04194112016697123
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.130000000000042
survival_time_min	4.94999999999999

No reset possible

20646

3065

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 16:55:41+00:00

2019-04-25 17:00:05+00:00

0:04:24

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20646-81880', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20646-81880', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20646-81880', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20635

2384

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 15:09:49+00:00

2019-04-25 15:15:31+00:00

0:05:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06187868441499644
survival_time_median	1.6000000000000008
deviation-center-line_median	0.04272335268548906
in-drivable-lane_median	0.4500000000000004

other stats

agent_compute-ego_max	0.1599857423688982
agent_compute-ego_mean	0.1465922218720952
agent_compute-ego_median	0.15594843300906094
agent_compute-ego_min	0.10666988835190282
deviation-center-line_max	0.15989698687950604
deviation-center-line_mean	0.0694399715661356
deviation-center-line_min	0.02830496247853142
deviation-heading_max	2.7898097399820316
deviation-heading_mean	1.0886061102394886
deviation-heading_median	0.6708352408298317
deviation-heading_min	0.6256329683124823
driven_any_max	0.9211311549505682
driven_any_mean	0.3147551487979646
driven_any_median	0.18601816950027103
driven_any_min	0.08509403059536731
driven_lanedir_consec_max	0.3362060906184938
driven_lanedir_consec_mean	0.11687476229950512
driven_lanedir_consec_min	0.030874925413984844
driven_lanedir_max	0.3362060906184938
driven_lanedir_mean	0.11687476229950512
driven_lanedir_median	0.06187868441499644
driven_lanedir_min	0.030874925413984844
in-drivable-lane_max	3.249999999999992
in-drivable-lane_mean	0.9699999999999986
in-drivable-lane_min	0.15000000000000002
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9211311549505682, "sim_physics": 0.1052431726789141, "survival_time": 7.149999999999983, "driven_lanedir": 0.3362060906184938, "sim_render-ego": 0.06023404481527689, "in-drivable-lane": 3.249999999999992, "agent_compute-ego": 0.1599857423688982, "deviation-heading": 2.7898097399820316, "set_robot_commands": 0.08801350060042802, "deviation-center-line": 0.15989698687950604, "driven_lanedir_consec": 0.3362060906184938, "sim_compute_sim_state": 0.03771155197303612, "sim_compute_performance-ego": 0.06585636839166388, "sim_compute_robot_state-ego": 0.06956742526767971}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1736070255686064, "sim_physics": 0.0818688948949178, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06187868441499644, "sim_render-ego": 0.05637882550557454, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.15309805075327557, "deviation-heading": 0.6256329683124823, "set_robot_commands": 0.0809350570042928, "deviation-center-line": 0.02830496247853142, "driven_lanedir_consec": 0.06187868441499644, "sim_compute_sim_state": 0.0356783390045166, "sim_compute_performance-ego": 0.06553929646809896, "sim_compute_robot_state-ego": 0.06976948579152426}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08509403059536731, "sim_physics": 0.07833255421031605, "survival_time": 1.1000000000000003, "driven_lanedir": 0.030874925413984844, "sim_render-ego": 0.05873346328735352, "in-drivable-lane": 0.15000000000000002, "agent_compute-ego": 0.15594843300906094, "deviation-heading": 0.6708352408298317, "set_robot_commands": 0.08527033979242499, "deviation-center-line": 0.07537505040059012, "driven_lanedir_consec": 0.030874925413984844, "sim_compute_sim_state": 0.035703420639038086, "sim_compute_performance-ego": 0.07527151974764737, "sim_compute_robot_state-ego": 0.06382575902071866}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18601816950027103, "sim_physics": 0.0947389230132103, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05875577280594513, "sim_render-ego": 0.05932379513978958, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1572589948773384, "deviation-heading": 0.7209316647681425, "set_robot_commands": 0.08863284438848495, "deviation-center-line": 0.04089950538656141, "driven_lanedir_consec": 0.05875577280594513, "sim_compute_sim_state": 0.03542858362197876, "sim_compute_performance-ego": 0.059450216591358185, "sim_compute_robot_state-ego": 0.06262357532978058}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20792536337501005, "sim_physics": 0.07027998115077164, "survival_time": 1.6500000000000008, "driven_lanedir": 0.0966583382441053, "sim_render-ego": 0.04250970753756436, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.10666988835190282, "deviation-heading": 0.6358209373049564, "set_robot_commands": 0.06150085998303963, "deviation-center-line": 0.04272335268548906, "driven_lanedir_consec": 0.0966583382441053, "sim_compute_sim_state": 0.0259063821850401, "sim_compute_performance-ego": 0.04712531060883493, "sim_compute_robot_state-ego": 0.04742583361538974}}
set_robot_commands_max	0.08863284438848495
set_robot_commands_mean	0.08087052035373407
set_robot_commands_median	0.08527033979242499
set_robot_commands_min	0.06150085998303963
sim_compute_performance-ego_max	0.07527151974764737
sim_compute_performance-ego_mean	0.06264854236152066
sim_compute_performance-ego_median	0.06553929646809896
sim_compute_performance-ego_min	0.04712531060883493
sim_compute_robot_state-ego_max	0.06976948579152426
sim_compute_robot_state-ego_mean	0.06264241580501859
sim_compute_robot_state-ego_median	0.06382575902071866
sim_compute_robot_state-ego_min	0.04742583361538974
sim_compute_sim_state_max	0.03771155197303612
sim_compute_sim_state_mean	0.034085655484721936
sim_compute_sim_state_median	0.0356783390045166
sim_compute_sim_state_min	0.0259063821850401
sim_physics_max	0.1052431726789141
sim_physics_mean	0.08609270518962597
sim_physics_median	0.0818688948949178
sim_physics_min	0.07027998115077164
sim_render-ego_max	0.06023404481527689
sim_render-ego_mean	0.05543596725711177
sim_render-ego_median	0.05873346328735352
sim_render-ego_min	0.04250970753756436
simulation-passed	1
survival_time_max	7.149999999999983
survival_time_mean	2.599999999999997
survival_time_min	1.1000000000000003

No reset possible

20626

2366

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 15:00:33+00:00

2019-04-25 15:09:08+00:00

0:08:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14354910265724613
agent_compute-ego_mean	0.12741354741847866
agent_compute-ego_median	0.1259853314545195
agent_compute-ego_min	0.11604644854863484
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.19588283547815288, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.06676017563298063, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.14354910265724613, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.1025636668475169, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.04168599731517288, "sim_compute_performance-ego": 0.07443411620158069, "sim_compute_robot_state-ego": 0.07753676063609573, "sim_compute_robot_state-npc0": 0.07481395523503141, "sim_compute_robot_state-npc1": 0.07510644309925583, "sim_compute_robot_state-npc2": 0.07398365803484647, "sim_compute_robot_state-npc3": 0.07465670468672267}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.14378629128138223, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.0591032604376475, "in-drivable-lane": 0, "agent_compute-ego": 0.11604644854863484, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.08644220232963562, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.04364784558614095, "sim_compute_performance-ego": 0.07138198614120483, "sim_compute_robot_state-ego": 0.07434544960657756, "sim_compute_robot_state-npc0": 0.06903548041979472, "sim_compute_robot_state-npc1": 0.07308909296989441, "sim_compute_robot_state-npc2": 0.06749118367830913, "sim_compute_robot_state-npc3": 0.06771966814994812}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.1598872330229161, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.05925840442463503, "in-drivable-lane": 0, "agent_compute-ego": 0.12698511349952826, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09012748427310233, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.0386059769129349, "sim_compute_performance-ego": 0.06447687391507423, "sim_compute_robot_state-ego": 0.06705580727528718, "sim_compute_robot_state-npc0": 0.06615976559913765, "sim_compute_robot_state-npc1": 0.06806586556515451, "sim_compute_robot_state-npc2": 0.06650580390024993, "sim_compute_robot_state-npc3": 0.06644235627125886}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.1697139780400163, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05652744083081262, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1259853314545195, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.08443701873391361, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.03358649399320958, "sim_compute_performance-ego": 0.0635491468138614, "sim_compute_robot_state-ego": 0.06486701157133458, "sim_compute_robot_state-npc0": 0.061369613065557965, "sim_compute_robot_state-npc1": 0.06143985764454987, "sim_compute_robot_state-npc2": 0.059767424050024, "sim_compute_robot_state-npc3": 0.05910617618237512}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.14240667819976807, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.05735824108123779, "in-drivable-lane": 0, "agent_compute-ego": 0.1245017409324646, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.08976237773895264, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.04811204671859741, "sim_compute_performance-ego": 0.06571692228317261, "sim_compute_robot_state-ego": 0.07403576374053955, "sim_compute_robot_state-npc0": 0.0662508487701416, "sim_compute_robot_state-npc1": 0.06376725435256958, "sim_compute_robot_state-npc2": 0.0642080545425415, "sim_compute_robot_state-npc3": 0.06746296882629395}}
set_robot_commands_max	0.1025636668475169
set_robot_commands_mean	0.0906665499846242
set_robot_commands_median	0.08976237773895264
set_robot_commands_min	0.08443701873391361
sim_compute_performance-ego_max	0.07443411620158069
sim_compute_performance-ego_mean	0.06791180907097875
sim_compute_performance-ego_median	0.06571692228317261
sim_compute_performance-ego_min	0.0635491468138614
sim_compute_robot_state-ego_max	0.07753676063609573
sim_compute_robot_state-ego_mean	0.07156815856596692
sim_compute_robot_state-ego_median	0.07403576374053955
sim_compute_robot_state-ego_min	0.06486701157133458
sim_compute_robot_state-npc0_max	0.07481395523503141
sim_compute_robot_state-npc0_mean	0.06752593261793266
sim_compute_robot_state-npc0_median	0.0662508487701416
sim_compute_robot_state-npc0_min	0.061369613065557965
sim_compute_robot_state-npc1_max	0.07510644309925583
sim_compute_robot_state-npc1_mean	0.06829370272628485
sim_compute_robot_state-npc1_median	0.06806586556515451
sim_compute_robot_state-npc1_min	0.06143985764454987
sim_compute_robot_state-npc2_max	0.07398365803484647
sim_compute_robot_state-npc2_mean	0.06639122484119422
sim_compute_robot_state-npc2_median	0.06650580390024993
sim_compute_robot_state-npc2_min	0.059767424050024
sim_compute_robot_state-npc3_max	0.07465670468672267
sim_compute_robot_state-npc3_mean	0.06707757482331975
sim_compute_robot_state-npc3_median	0.06746296882629395
sim_compute_robot_state-npc3_min	0.05910617618237512
sim_compute_sim_state_max	0.04811204671859741
sim_compute_sim_state_mean	0.04112767210521114
sim_compute_sim_state_median	0.04168599731517288
sim_compute_sim_state_min	0.03358649399320958
sim_physics_max	0.19588283547815288
sim_physics_mean	0.16233540320444712
sim_physics_median	0.1598872330229161
sim_physics_min	0.14240667819976807
sim_render-ego_max	0.06676017563298063
sim_render-ego_mean	0.05980150448146272
sim_render-ego_median	0.0591032604376475
sim_render-ego_min	0.05652744083081262
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20578

2413

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 14:29:12+00:00

2019-04-25 15:00:05+00:00

0:30:53

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20578-317905', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20578-317905', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20578-317905', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20577

2416

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 14:23:21+00:00

2019-04-25 14:28:38+00:00

0:05:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.1484246063232422
agent_compute-ego_mean	0.13043917183698406
agent_compute-ego_median	0.12457549571990968
agent_compute-ego_min	0.1218609944829401
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.08841296411910148, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.05829161967871324, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1218609944829401, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.08537104894530098, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03724091008024396, "sim_compute_performance-ego": 0.06416731060675855, "sim_compute_robot_state-ego": 0.06727374274775667}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.09565408871724056, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.05726794554637028, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12420471356465268, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.08147642245659462, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03341727531873263, "sim_compute_performance-ego": 0.06304530914013202, "sim_compute_robot_state-ego": 0.0641209758245028}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.07733649677700466, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.05407459206051297, "in-drivable-lane": 0, "agent_compute-ego": 0.12457549571990968, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.08661421140034993, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.033342560132344566, "sim_compute_performance-ego": 0.05697192086113824, "sim_compute_robot_state-ego": 0.060839547051323786}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.11772847175598145, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.06399462699890136, "in-drivable-lane": 0, "agent_compute-ego": 0.1484246063232422, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.11496745109558106, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.04237865447998047, "sim_compute_performance-ego": 0.07072216987609864, "sim_compute_robot_state-ego": 0.07663969993591309}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.09231097881610575, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06021928787231445, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.13313004909417567, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.09520914004399228, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.038982956837385126, "sim_compute_performance-ego": 0.06685496599246295, "sim_compute_robot_state-ego": 0.07177797953287761}}
set_robot_commands_max	0.11496745109558106
set_robot_commands_mean	0.09272765478836376
set_robot_commands_median	0.08661421140034993
set_robot_commands_min	0.08147642245659462
sim_compute_performance-ego_max	0.07072216987609864
sim_compute_performance-ego_mean	0.06435233529531807
sim_compute_performance-ego_median	0.06416731060675855
sim_compute_performance-ego_min	0.05697192086113824
sim_compute_robot_state-ego_max	0.07663969993591309
sim_compute_robot_state-ego_mean	0.06813038901847479
sim_compute_robot_state-ego_median	0.06727374274775667
sim_compute_robot_state-ego_min	0.060839547051323786
sim_compute_sim_state_max	0.04237865447998047
sim_compute_sim_state_mean	0.03707247136973735
sim_compute_sim_state_median	0.03724091008024396
sim_compute_sim_state_min	0.033342560132344566
sim_physics_max	0.11772847175598145
sim_physics_mean	0.09428860003708678
sim_physics_median	0.09231097881610575
sim_physics_min	0.07733649677700466
sim_render-ego_max	0.06399462699890136
sim_render-ego_mean	0.05876961443136246
sim_render-ego_median	0.05829161967871324
sim_render-ego_min	0.05407459206051297
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20569

2428

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 14:21:41+00:00

2019-04-25 14:22:52+00:00

0:01:11

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20561

2442

Jacopo Tani

random_agent

step1-simulation

success

2019-04-25 14:13:30+00:00

2019-04-25 14:21:28+00:00

0:07:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.15582617325118825
agent_compute-ego_mean	0.14706294564115044
agent_compute-ego_median	0.14321268046343769
agent_compute-ego_min	0.14104549839811506
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.12391449820320562, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.05733953781847684, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.14104549839811506, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.08946532573340074, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.034265329252998786, "sim_compute_performance-ego": 0.0640829104297566, "sim_compute_robot_state-ego": 0.06770255430689398, "sim_compute_robot_state-npc0": 0.06269765350053895, "sim_compute_robot_state-npc1": 0.06351266267164699, "sim_compute_robot_state-npc2": 0.06070823039648668, "sim_compute_robot_state-npc3": 0.06251238876918577}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.12702946479503924, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.05723856962644137, "in-drivable-lane": 0, "agent_compute-ego": 0.14239072799682617, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.08944173959585336, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.03427379864912767, "sim_compute_performance-ego": 0.06399214267730713, "sim_compute_robot_state-ego": 0.0658270579117995, "sim_compute_robot_state-npc0": 0.06792217951554519, "sim_compute_robot_state-npc1": 0.06853316380427434, "sim_compute_robot_state-npc2": 0.0671982215001033, "sim_compute_robot_state-npc3": 0.06525636636293851}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.13681137875506752, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.05883712203879105, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.15283964809618497, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.08763141694821809, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.038364943705107034, "sim_compute_performance-ego": 0.06538489304090801, "sim_compute_robot_state-ego": 0.06699005553596898, "sim_compute_robot_state-npc0": 0.06446653604507446, "sim_compute_robot_state-npc1": 0.0655286061136346, "sim_compute_robot_state-npc2": 0.06656415838944285, "sim_compute_robot_state-npc3": 0.06671951946459319}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.1568760962425908, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.0644276443916031, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.15582617325118825, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.09586751310131218, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03922328164305868, "sim_compute_performance-ego": 0.07437512240832365, "sim_compute_robot_state-ego": 0.07810226875015452, "sim_compute_robot_state-npc0": 0.06837569309186332, "sim_compute_robot_state-npc1": 0.06872469865823094, "sim_compute_robot_state-npc2": 0.07099254523651509, "sim_compute_robot_state-npc3": 0.0701519869550874}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.11956075385764792, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.060329454916494864, "in-drivable-lane": 0, "agent_compute-ego": 0.14321268046343769, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.09158747284500687, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.03509564752931948, "sim_compute_performance-ego": 0.06844194730122884, "sim_compute_robot_state-ego": 0.06787323068689417, "sim_compute_robot_state-npc0": 0.06553783240141692, "sim_compute_robot_state-npc1": 0.06311431637516728, "sim_compute_robot_state-npc2": 0.06160830568384241, "sim_compute_robot_state-npc3": 0.06632604422392668}}
set_robot_commands_max	0.09586751310131218
set_robot_commands_mean	0.09079869364475826
set_robot_commands_median	0.08946532573340074
set_robot_commands_min	0.08763141694821809
sim_compute_performance-ego_max	0.07437512240832365
sim_compute_performance-ego_mean	0.06725540317150484
sim_compute_performance-ego_median	0.06538489304090801
sim_compute_performance-ego_min	0.06399214267730713
sim_compute_robot_state-ego_max	0.07810226875015452
sim_compute_robot_state-ego_mean	0.06929903343834223
sim_compute_robot_state-ego_median	0.06770255430689398
sim_compute_robot_state-ego_min	0.0658270579117995
sim_compute_robot_state-npc0_max	0.06837569309186332
sim_compute_robot_state-npc0_mean	0.06579997891088776
sim_compute_robot_state-npc0_median	0.06553783240141692
sim_compute_robot_state-npc0_min	0.06269765350053895
sim_compute_robot_state-npc1_max	0.06872469865823094
sim_compute_robot_state-npc1_mean	0.06588268952459084
sim_compute_robot_state-npc1_median	0.0655286061136346
sim_compute_robot_state-npc1_min	0.06311431637516728
sim_compute_robot_state-npc2_max	0.07099254523651509
sim_compute_robot_state-npc2_mean	0.06541429224127807
sim_compute_robot_state-npc2_median	0.06656415838944285
sim_compute_robot_state-npc2_min	0.06070823039648668
sim_compute_robot_state-npc3_max	0.0701519869550874
sim_compute_robot_state-npc3_mean	0.06619326115514632
sim_compute_robot_state-npc3_median	0.06632604422392668
sim_compute_robot_state-npc3_min	0.06251238876918577
sim_compute_sim_state_max	0.03922328164305868
sim_compute_sim_state_mean	0.03624460015592233
sim_compute_sim_state_median	0.03509564752931948
sim_compute_sim_state_min	0.034265329252998786
sim_physics_max	0.1568760962425908
sim_physics_mean	0.13283843837071024
sim_physics_median	0.12702946479503924
sim_physics_min	0.11956075385764792
sim_render-ego_max	0.0644276443916031
sim_render-ego_mean	0.05963446575836144
sim_render-ego_median	0.05883712203879105
sim_render-ego_min	0.05723856962644137
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20545

2467

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 14:08:04+00:00

2019-04-25 14:13:05+00:00

0:05:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.1703669097688463
agent_compute-ego_mean	0.14554025505812124
agent_compute-ego_median	0.1399866008758545
agent_compute-ego_min	0.12278606952765048
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.1044283408039021, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06016778496076476, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.15897240728702186, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09658516577954562, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03979331592343888, "sim_compute_performance-ego": 0.07055183176724415, "sim_compute_robot_state-ego": 0.07996344566345215}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.08830619775331937, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.05512186197134165, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.13558928783123309, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.08515178698759812, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.036351414827200085, "sim_compute_performance-ego": 0.06560736436110276, "sim_compute_robot_state-ego": 0.06348444406802838}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.1112570497724745, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06953223546346028, "in-drivable-lane": 0, "agent_compute-ego": 0.1703669097688463, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.10914270083109538, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.044099768002827965, "sim_compute_performance-ego": 0.07245245244767931, "sim_compute_robot_state-ego": 0.08506684833102757}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.10082474708557128, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.056777515411376954, "in-drivable-lane": 0, "agent_compute-ego": 0.1399866008758545, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.08807233810424804, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.03845444679260254, "sim_compute_performance-ego": 0.06231435775756835, "sim_compute_robot_state-ego": 0.07310694694519043}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.07794391497587547, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.052282984440143294, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.12278606952765048, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.07992700735727946, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.03188621997833252, "sim_compute_performance-ego": 0.05747571358313927, "sim_compute_robot_state-ego": 0.061606248219807945}}
set_robot_commands_max	0.10914270083109538
set_robot_commands_mean	0.09177579981195332
set_robot_commands_median	0.08807233810424804
set_robot_commands_min	0.07992700735727946
sim_compute_performance-ego_max	0.07245245244767931
sim_compute_performance-ego_mean	0.06568034398334677
sim_compute_performance-ego_median	0.06560736436110276
sim_compute_performance-ego_min	0.05747571358313927
sim_compute_robot_state-ego_max	0.08506684833102757
sim_compute_robot_state-ego_mean	0.07264558664550129
sim_compute_robot_state-ego_median	0.07310694694519043
sim_compute_robot_state-ego_min	0.061606248219807945
sim_compute_sim_state_max	0.044099768002827965
sim_compute_sim_state_mean	0.0381170331048804
sim_compute_sim_state_median	0.03845444679260254
sim_compute_sim_state_min	0.03188621997833252
sim_physics_max	0.1112570497724745
sim_physics_mean	0.09655205007822856
sim_physics_median	0.10082474708557128
sim_physics_min	0.07794391497587547
sim_render-ego_max	0.06953223546346028
sim_render-ego_mean	0.05877647644941739
sim_render-ego_median	0.056777515411376954
sim_render-ego_min	0.052282984440143294
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20516

2632

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 14:00:13+00:00

2019-04-25 14:07:49+00:00

0:07:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.2168785311141104
agent_compute-ego_mean	0.15367474444373694
agent_compute-ego_median	0.15210742216843826
agent_compute-ego_min	0.10089468642284996
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.08862615081499207, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.055699101034200414, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.2168785311141104, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.07302644117823187, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.029287248287560803, "sim_compute_performance-ego": 0.04706324721282383, "sim_compute_robot_state-ego": 0.04558730125427246, "sim_compute_robot_state-npc0": 0.07883954498003114, "sim_compute_robot_state-npc1": 0.05249814267428416, "sim_compute_robot_state-npc2": 0.07015720403419351, "sim_compute_robot_state-npc3": 0.06768552762157512}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.13709577230306771, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.05731500112093412, "in-drivable-lane": 0, "agent_compute-ego": 0.15210742216843826, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.09812885981339677, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.03992620798257681, "sim_compute_performance-ego": 0.06028549487774189, "sim_compute_robot_state-ego": 0.06366918637202336, "sim_compute_robot_state-npc0": 0.06291767267080453, "sim_compute_robot_state-npc1": 0.06369405526381272, "sim_compute_robot_state-npc2": 0.06503979976360615, "sim_compute_robot_state-npc3": 0.09520213420574482}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.09868411641371876, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.04072403907775879, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.10089468642284996, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.06198320577019139, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.026883457836351897, "sim_compute_performance-ego": 0.04414096004084537, "sim_compute_robot_state-ego": 0.04572730315359015, "sim_compute_robot_state-npc0": 0.04677301645278931, "sim_compute_robot_state-npc1": 0.0473489196676957, "sim_compute_robot_state-npc2": 0.04643498282683523, "sim_compute_robot_state-npc3": 0.04594100462762933}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.13512034054043923, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.05061560944665836, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.1364483984210823, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.08550021920023085, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.034236331529255155, "sim_compute_performance-ego": 0.06055170976662937, "sim_compute_robot_state-ego": 0.06395437747617311, "sim_compute_robot_state-npc0": 0.057616339454168, "sim_compute_robot_state-npc1": 0.05734381192847143, "sim_compute_robot_state-npc2": 0.05702688422384141, "sim_compute_robot_state-npc3": 0.05774521827697754}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.16039917204115126, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06470742049040618, "in-drivable-lane": 0, "agent_compute-ego": 0.16204468409220377, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.1076219081878662, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.04066709235862449, "sim_compute_performance-ego": 0.07303506356698496, "sim_compute_robot_state-ego": 0.08034359967267071, "sim_compute_robot_state-npc0": 0.07670934995015462, "sim_compute_robot_state-npc1": 0.0747525868592439, "sim_compute_robot_state-npc2": 0.07183668348524305, "sim_compute_robot_state-npc3": 0.07067640622456868}}
set_robot_commands_max	0.1076219081878662
set_robot_commands_mean	0.08525212682998343
set_robot_commands_median	0.08550021920023085
set_robot_commands_min	0.06198320577019139
sim_compute_performance-ego_max	0.07303506356698496
sim_compute_performance-ego_mean	0.05701529509300508
sim_compute_performance-ego_median	0.06028549487774189
sim_compute_performance-ego_min	0.04414096004084537
sim_compute_robot_state-ego_max	0.08034359967267071
sim_compute_robot_state-ego_mean	0.05985635358574596
sim_compute_robot_state-ego_median	0.06366918637202336
sim_compute_robot_state-ego_min	0.04558730125427246
sim_compute_robot_state-npc0_max	0.07883954498003114
sim_compute_robot_state-npc0_mean	0.06457118470158951
sim_compute_robot_state-npc0_median	0.06291767267080453
sim_compute_robot_state-npc0_min	0.04677301645278931
sim_compute_robot_state-npc1_max	0.0747525868592439
sim_compute_robot_state-npc1_mean	0.059127503278701574
sim_compute_robot_state-npc1_median	0.05734381192847143
sim_compute_robot_state-npc1_min	0.0473489196676957
sim_compute_robot_state-npc2_max	0.07183668348524305
sim_compute_robot_state-npc2_mean	0.06209911086674387
sim_compute_robot_state-npc2_median	0.06503979976360615
sim_compute_robot_state-npc2_min	0.04643498282683523
sim_compute_robot_state-npc3_max	0.09520213420574482
sim_compute_robot_state-npc3_mean	0.0674500581912991
sim_compute_robot_state-npc3_median	0.06768552762157512
sim_compute_robot_state-npc3_min	0.04594100462762933
sim_compute_sim_state_max	0.04066709235862449
sim_compute_sim_state_mean	0.034200067598873826
sim_compute_sim_state_median	0.034236331529255155
sim_compute_sim_state_min	0.026883457836351897
sim_physics_max	0.16039917204115126
sim_physics_mean	0.12398511042267382
sim_physics_median	0.13512034054043923
sim_physics_min	0.08862615081499207
sim_render-ego_max	0.06470742049040618
sim_render-ego_mean	0.05381223423399158
sim_render-ego_median	0.055699101034200414
sim_render-ego_min	0.04072403907775879
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20507

2510

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 13:59:12+00:00

2019-04-25 13:59:47+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20495

2533

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-25 13:55:16+00:00

2019-04-25 13:59:05+00:00

0:03:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20485

2548

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:49:34+00:00

2019-04-25 13:55:08+00:00

0:05:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.07007999472565703
agent_compute-ego_mean	0.05795518160397613
agent_compute-ego_median	0.061921889131719414
agent_compute-ego_min	0.03912583986918131
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.08109124083268016, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.06150387149108084, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.0674960644621598, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.09225131963428698, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.03800809069683677, "sim_compute_performance-ego": 0.06787912469161184, "sim_compute_robot_state-ego": 0.07005349899593152}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.04718224898628567, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.035045502842336464, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.03912583986918131, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.053548094155131905, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.022620619207188705, "sim_compute_performance-ego": 0.03830715193264726, "sim_compute_robot_state-ego": 0.03983031494030054}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.07836036248640581, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.06212050264531916, "in-drivable-lane": 0, "agent_compute-ego": 0.061921889131719414, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.09054389866915616, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.04057151621038264, "sim_compute_performance-ego": 0.06372356414794922, "sim_compute_robot_state-ego": 0.06794303113763983}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.061427150453839986, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.04641495432172503, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07007999472565703, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.08376411291269156, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.028895655831137856, "sim_compute_performance-ego": 0.07520340039179875, "sim_compute_robot_state-ego": 0.05313294798463256}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.04873537530704421, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.035140132417484204, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.05115211983116306, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.05491647671680061, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.02264915437114482, "sim_compute_performance-ego": 0.03822142493968107, "sim_compute_robot_state-ego": 0.042305909857458}}
set_robot_commands_max	0.09225131963428698
set_robot_commands_mean	0.07500478041761344
set_robot_commands_median	0.08376411291269156
set_robot_commands_min	0.053548094155131905
sim_compute_performance-ego_max	0.07520340039179875
sim_compute_performance-ego_mean	0.056666933220737625
sim_compute_performance-ego_median	0.06372356414794922
sim_compute_performance-ego_min	0.03822142493968107
sim_compute_robot_state-ego_max	0.07005349899593152
sim_compute_robot_state-ego_mean	0.05465314058319248
sim_compute_robot_state-ego_median	0.05313294798463256
sim_compute_robot_state-ego_min	0.03983031494030054
sim_compute_sim_state_max	0.04057151621038264
sim_compute_sim_state_mean	0.030549007263338153
sim_compute_sim_state_median	0.028895655831137856
sim_compute_sim_state_min	0.022620619207188705
sim_physics_max	0.08109124083268016
sim_physics_mean	0.06335927561325116
sim_physics_median	0.061427150453839986
sim_physics_min	0.04718224898628567
sim_render-ego_max	0.06212050264531916
sim_render-ego_mean	0.04804499274358914
sim_render-ego_median	0.04641495432172503
sim_render-ego_min	0.035045502842336464
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20477

2564

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:41:35+00:00

2019-04-25 13:49:14+00:00

0:07:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07138923498300406
agent_compute-ego_mean	0.06668233269559407
agent_compute-ego_median	0.06608247443249352
agent_compute-ego_min	0.06224994361400604
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.1297908205735056, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.05512877200779162, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.06608247443249352, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.08981106783214368, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.03584012232328716, "sim_compute_performance-ego": 0.06216452937377127, "sim_compute_robot_state-ego": 0.07239683050858348, "sim_compute_robot_state-npc0": 0.06319172445096467, "sim_compute_robot_state-npc1": 0.06424917672809802, "sim_compute_robot_state-npc2": 0.06569380509225946, "sim_compute_robot_state-npc3": 0.06295908752240632}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.13001909852027893, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.05798228830099106, "in-drivable-lane": 0, "agent_compute-ego": 0.06224994361400604, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.09104973077774048, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.03604016453027725, "sim_compute_performance-ego": 0.06725138425827026, "sim_compute_robot_state-ego": 0.07041969895362854, "sim_compute_robot_state-npc0": 0.07007163017988205, "sim_compute_robot_state-npc1": 0.07261092215776443, "sim_compute_robot_state-npc2": 0.06676658242940903, "sim_compute_robot_state-npc3": 0.065931536257267}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.14673901521242583, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.06055015784043532, "in-drivable-lane": 0, "agent_compute-ego": 0.07006352681380051, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.09703902097848746, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.037430524826049805, "sim_compute_performance-ego": 0.06776028871536255, "sim_compute_robot_state-ego": 0.07074793943992028, "sim_compute_robot_state-npc0": 0.06802192101111779, "sim_compute_robot_state-npc1": 0.06674906382193932, "sim_compute_robot_state-npc2": 0.06790286302566528, "sim_compute_robot_state-npc3": 0.06624890290773831}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.1323624176856799, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.0574565392274123, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07138923498300406, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.08925777826553737, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.03724462863726494, "sim_compute_performance-ego": 0.06276447956378643, "sim_compute_robot_state-ego": 0.06653446723253299, "sim_compute_robot_state-npc0": 0.06444850640419202, "sim_compute_robot_state-npc1": 0.06348437223678981, "sim_compute_robot_state-npc2": 0.06475205910511506, "sim_compute_robot_state-npc3": 0.06579830401983017}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.12744900032326026, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.05930489080923575, "in-drivable-lane": 0, "agent_compute-ego": 0.06362648363466616, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.08399727609422472, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.035808704517505785, "sim_compute_performance-ego": 0.06381350976449472, "sim_compute_robot_state-ego": 0.06788900163438585, "sim_compute_robot_state-npc0": 0.06264620357089573, "sim_compute_robot_state-npc1": 0.06192379527621799, "sim_compute_robot_state-npc2": 0.06156661775377062, "sim_compute_robot_state-npc3": 0.06285227669609918}}
set_robot_commands_max	0.09703902097848746
set_robot_commands_mean	0.09023097478962674
set_robot_commands_median	0.08981106783214368
set_robot_commands_min	0.08399727609422472
sim_compute_performance-ego_max	0.06776028871536255
sim_compute_performance-ego_mean	0.06475083833513705
sim_compute_performance-ego_median	0.06381350976449472
sim_compute_performance-ego_min	0.06216452937377127
sim_compute_robot_state-ego_max	0.07239683050858348
sim_compute_robot_state-ego_mean	0.06959758755381022
sim_compute_robot_state-ego_median	0.07041969895362854
sim_compute_robot_state-ego_min	0.06653446723253299
sim_compute_robot_state-npc0_max	0.07007163017988205
sim_compute_robot_state-npc0_mean	0.06567599712341045
sim_compute_robot_state-npc0_median	0.06444850640419202
sim_compute_robot_state-npc0_min	0.06264620357089573
sim_compute_robot_state-npc1_max	0.07261092215776443
sim_compute_robot_state-npc1_mean	0.06580346604416192
sim_compute_robot_state-npc1_median	0.06424917672809802
sim_compute_robot_state-npc1_min	0.06192379527621799
sim_compute_robot_state-npc2_max	0.06790286302566528
sim_compute_robot_state-npc2_mean	0.0653363854812439
sim_compute_robot_state-npc2_median	0.06569380509225946
sim_compute_robot_state-npc2_min	0.06156661775377062
sim_compute_robot_state-npc3_max	0.06624890290773831
sim_compute_robot_state-npc3_mean	0.0647580214806682
sim_compute_robot_state-npc3_median	0.06579830401983017
sim_compute_robot_state-npc3_min	0.06285227669609918
sim_compute_sim_state_max	0.037430524826049805
sim_compute_sim_state_mean	0.036472828966876994
sim_compute_sim_state_median	0.03604016453027725
sim_compute_sim_state_min	0.035808704517505785
sim_physics_max	0.14673901521242583
sim_physics_mean	0.13327207046303008
sim_physics_median	0.13001909852027893
sim_physics_min	0.12744900032326026
sim_render-ego_max	0.06055015784043532
sim_render-ego_mean	0.05808452963717321
sim_render-ego_median	0.05798228830099106
sim_render-ego_min	0.05512877200779162
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20461

2591

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 13:28:15+00:00

2019-04-25 13:41:09+00:00

0:12:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.26950328172591886
survival_time_median	5.599999999999988
deviation-center-line_median	0.3827737361737958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.23952173836090984
agent_compute-ego_mean	0.2084251044838349
agent_compute-ego_median	0.20368114614908675
agent_compute-ego_min	0.1823049340929304
deviation-center-line_max	0.4905627197594762
deviation-center-line_mean	0.3816136692580802
deviation-center-line_min	0.2359307085366832
deviation-heading_max	2.8697244090862832
deviation-heading_mean	2.102396574962247
deviation-heading_median	2.0218247185851665
deviation-heading_min	1.3608616050549116
driven_any_max	0.34099667556915286
driven_any_mean	0.2930107026368073
driven_any_median	0.3193449563656162
driven_any_min	0.188587798756088
driven_lanedir_consec_max	0.29180406406049464
driven_lanedir_consec_mean	0.25316601662942356
driven_lanedir_consec_min	0.1481881348473557
driven_lanedir_max	0.29180406406049464
driven_lanedir_mean	0.25316601662942356
driven_lanedir_median	0.26950328172591886
driven_lanedir_min	0.1481881348473557
in-drivable-lane_max	0.14999999999999947
in-drivable-lane_mean	0.04999999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.34099667556915286, "sim_physics": 0.16447745050702775, "survival_time": 6.299999999999986, "driven_lanedir": 0.28870920064250294, "sim_render-ego": 0.061727313768296016, "in-drivable-lane": 0, "agent_compute-ego": 0.2308645626855275, "deviation-heading": 2.863456479210133, "set_robot_commands": 0.0941711323601859, "deviation-center-line": 0.3827737361737958, "driven_lanedir_consec": 0.28870920064250294, "sim_compute_sim_state": 0.0391412027298458, "sim_compute_performance-ego": 0.06796965334150526, "sim_compute_robot_state-ego": 0.07385949482993474, "sim_compute_robot_state-npc0": 0.06813455952538384, "sim_compute_robot_state-npc1": 0.0684066272917248, "sim_compute_robot_state-npc2": 0.06870924858819871, "sim_compute_robot_state-npc3": 0.06873455501738049}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3193449563656162, "sim_physics": 0.1114906349352428, "survival_time": 5.599999999999988, "driven_lanedir": 0.2676254018708457, "sim_render-ego": 0.051931266273771017, "in-drivable-lane": 0, "agent_compute-ego": 0.18575314113071983, "deviation-heading": 2.8697244090862832, "set_robot_commands": 0.08428600856236049, "deviation-center-line": 0.3548674646284441, "driven_lanedir_consec": 0.2676254018708457, "sim_compute_sim_state": 0.029019638895988464, "sim_compute_performance-ego": 0.052815882222993035, "sim_compute_robot_state-ego": 0.05498495485101427, "sim_compute_robot_state-npc0": 0.05482139970575061, "sim_compute_robot_state-npc1": 0.05432201496192387, "sim_compute_robot_state-npc2": 0.05383386143616268, "sim_compute_robot_state-npc3": 0.051997208169528415}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.32001917954242337, "sim_physics": 0.13889394608219113, "survival_time": 5.649999999999988, "driven_lanedir": 0.29180406406049464, "sim_render-ego": 0.05597686556588232, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.20368114614908675, "deviation-heading": 1.3608616050549116, "set_robot_commands": 0.10092542023785346, "deviation-center-line": 0.4905627197594762, "driven_lanedir_consec": 0.29180406406049464, "sim_compute_sim_state": 0.0333086959028666, "sim_compute_performance-ego": 0.07775269567438986, "sim_compute_robot_state-ego": 0.06294314840198618, "sim_compute_robot_state-npc0": 0.11486757962049636, "sim_compute_robot_state-npc1": 0.05933668339146977, "sim_compute_robot_state-npc2": 0.06467718571688222, "sim_compute_robot_state-npc3": 0.06666336861331906}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2961049029507558, "sim_physics": 0.1185577914828346, "survival_time": 5.249999999999989, "driven_lanedir": 0.26950328172591886, "sim_render-ego": 0.04813549632117862, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.1823049340929304, "deviation-heading": 1.396115662874739, "set_robot_commands": 0.07827686355227516, "deviation-center-line": 0.4439337171920019, "driven_lanedir_consec": 0.26950328172591886, "sim_compute_sim_state": 0.03142974036080497, "sim_compute_performance-ego": 0.05648998078845796, "sim_compute_robot_state-ego": 0.05560293878827776, "sim_compute_robot_state-npc0": 0.05494543484279087, "sim_compute_robot_state-npc1": 0.05469898950485956, "sim_compute_robot_state-npc2": 0.054953211829775854, "sim_compute_robot_state-npc3": 0.059674644470214845}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.188587798756088, "sim_physics": 0.12274052816278794, "survival_time": 3.399999999999996, "driven_lanedir": 0.1481881348473557, "sim_render-ego": 0.05946971388424144, "in-drivable-lane": 0, "agent_compute-ego": 0.23952173836090984, "deviation-heading": 2.0218247185851665, "set_robot_commands": 0.09444075472214644, "deviation-center-line": 0.2359307085366832, "driven_lanedir_consec": 0.1481881348473557, "sim_compute_sim_state": 0.03557963932261748, "sim_compute_performance-ego": 0.06677639835021075, "sim_compute_robot_state-ego": 0.07360652264426737, "sim_compute_robot_state-npc0": 0.0640760905602399, "sim_compute_robot_state-npc1": 0.06469219221788294, "sim_compute_robot_state-npc2": 0.06497209562974818, "sim_compute_robot_state-npc3": 0.0637505475212546}}
set_robot_commands_max	0.10092542023785346
set_robot_commands_mean	0.09042003588696428
set_robot_commands_median	0.0941711323601859
set_robot_commands_min	0.07827686355227516
sim_compute_performance-ego_max	0.07775269567438986
sim_compute_performance-ego_mean	0.06436092207551138
sim_compute_performance-ego_median	0.06677639835021075
sim_compute_performance-ego_min	0.052815882222993035
sim_compute_robot_state-ego_max	0.07385949482993474
sim_compute_robot_state-ego_mean	0.06419941190309607
sim_compute_robot_state-ego_median	0.06294314840198618
sim_compute_robot_state-ego_min	0.05498495485101427
sim_compute_robot_state-npc0_max	0.11486757962049636
sim_compute_robot_state-npc0_mean	0.0713690128509323
sim_compute_robot_state-npc0_median	0.0640760905602399
sim_compute_robot_state-npc0_min	0.05482139970575061
sim_compute_robot_state-npc1_max	0.0684066272917248
sim_compute_robot_state-npc1_mean	0.06029130147357218
sim_compute_robot_state-npc1_median	0.05933668339146977
sim_compute_robot_state-npc1_min	0.05432201496192387
sim_compute_robot_state-npc2_max	0.06870924858819871
sim_compute_robot_state-npc2_mean	0.06142912064015353
sim_compute_robot_state-npc2_median	0.06467718571688222
sim_compute_robot_state-npc2_min	0.05383386143616268
sim_compute_robot_state-npc3_max	0.06873455501738049
sim_compute_robot_state-npc3_mean	0.06216406475833948
sim_compute_robot_state-npc3_median	0.0637505475212546
sim_compute_robot_state-npc3_min	0.051997208169528415
sim_compute_sim_state_max	0.0391412027298458
sim_compute_sim_state_mean	0.033695783442424666
sim_compute_sim_state_median	0.0333086959028666
sim_compute_sim_state_min	0.029019638895988464
sim_physics_max	0.16447745050702775
sim_physics_mean	0.13123207023401684
sim_physics_median	0.12274052816278794
sim_physics_min	0.1114906349352428
sim_render-ego_max	0.061727313768296016
sim_render-ego_mean	0.055448131162673886
sim_render-ego_median	0.05597686556588232
sim_render-ego_min	0.04813549632117862
simulation-passed	1
survival_time_max	6.299999999999986
survival_time_mean	5.2399999999999896
survival_time_min	3.399999999999996

No reset possible

20447

2609

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:19:37+00:00

2019-04-25 13:27:06+00:00

0:07:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07682954823529278
agent_compute-ego_mean	0.069171488381367
agent_compute-ego_median	0.06747698783874512
agent_compute-ego_min	0.06449288893968631
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.11936044379284508, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.056645763547796955, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.06589720123692562, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.09328830869574296, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.03376804213774832, "sim_compute_performance-ego": 0.06328221057590686, "sim_compute_robot_state-ego": 0.06753463180441606, "sim_compute_robot_state-npc0": 0.06330000726800215, "sim_compute_robot_state-npc1": 0.06659142280879773, "sim_compute_robot_state-npc2": 0.06572820010938142, "sim_compute_robot_state-npc3": 0.06335395260861046}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.1458151936531067, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.06085159629583359, "in-drivable-lane": 0, "agent_compute-ego": 0.07116081565618515, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.09602650254964828, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.03591983765363693, "sim_compute_performance-ego": 0.07042727619409561, "sim_compute_robot_state-ego": 0.07227843999862671, "sim_compute_robot_state-npc0": 0.06697512418031693, "sim_compute_robot_state-npc1": 0.06805545091629028, "sim_compute_robot_state-npc2": 0.0680573359131813, "sim_compute_robot_state-npc3": 0.06459672003984451}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.15122538346510667, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.05409755615087656, "in-drivable-lane": 0, "agent_compute-ego": 0.06747698783874512, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.08915420220448421, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.03444761954821073, "sim_compute_performance-ego": 0.06132372067524837, "sim_compute_robot_state-ego": 0.06567508899248563, "sim_compute_robot_state-npc0": 0.06411707401275635, "sim_compute_robot_state-npc1": 0.06595087051391602, "sim_compute_robot_state-npc2": 0.06366679760125968, "sim_compute_robot_state-npc3": 0.06463366746902466}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.13655530183743209, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.05753718278346918, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.06449288893968631, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.08870082329481076, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.0376591499035175, "sim_compute_performance-ego": 0.06539379633389987, "sim_compute_robot_state-ego": 0.06751111837533805, "sim_compute_robot_state-npc0": 0.06158904540233123, "sim_compute_robot_state-npc1": 0.06240466313484388, "sim_compute_robot_state-npc2": 0.06495389877221523, "sim_compute_robot_state-npc3": 0.06419206582582913}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.1670957053149188, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.06689638561672634, "in-drivable-lane": 0, "agent_compute-ego": 0.07682954823529278, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.10866008864508736, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.040968109060216834, "sim_compute_performance-ego": 0.07224501503838433, "sim_compute_robot_state-ego": 0.08059111347904911, "sim_compute_robot_state-npc0": 0.0749411318037245, "sim_compute_robot_state-npc1": 0.07670864352473507, "sim_compute_robot_state-npc2": 0.07399598757425944, "sim_compute_robot_state-npc3": 0.09705408414204916}}
set_robot_commands_max	0.10866008864508736
set_robot_commands_mean	0.09516598507795472
set_robot_commands_median	0.09328830869574296
set_robot_commands_min	0.08870082329481076
sim_compute_performance-ego_max	0.07224501503838433
sim_compute_performance-ego_mean	0.066534403763507
sim_compute_performance-ego_median	0.06539379633389987
sim_compute_performance-ego_min	0.06132372067524837
sim_compute_robot_state-ego_max	0.08059111347904911
sim_compute_robot_state-ego_mean	0.0707180785299831
sim_compute_robot_state-ego_median	0.06753463180441606
sim_compute_robot_state-ego_min	0.06567508899248563
sim_compute_robot_state-npc0_max	0.0749411318037245
sim_compute_robot_state-npc0_mean	0.06618447653342623
sim_compute_robot_state-npc0_median	0.06411707401275635
sim_compute_robot_state-npc0_min	0.06158904540233123
sim_compute_robot_state-npc1_max	0.07670864352473507
sim_compute_robot_state-npc1_mean	0.06794221017971659
sim_compute_robot_state-npc1_median	0.06659142280879773
sim_compute_robot_state-npc1_min	0.06240466313484388
sim_compute_robot_state-npc2_max	0.07399598757425944
sim_compute_robot_state-npc2_mean	0.06728044399405941
sim_compute_robot_state-npc2_median	0.06572820010938142
sim_compute_robot_state-npc2_min	0.06366679760125968
sim_compute_robot_state-npc3_max	0.09705408414204916
sim_compute_robot_state-npc3_mean	0.07076609801707158
sim_compute_robot_state-npc3_median	0.06459672003984451
sim_compute_robot_state-npc3_min	0.06335395260861046
sim_compute_sim_state_max	0.040968109060216834
sim_compute_sim_state_mean	0.03655255166066606
sim_compute_sim_state_median	0.03591983765363693
sim_compute_sim_state_min	0.03376804213774832
sim_physics_max	0.1670957053149188
sim_physics_mean	0.14401040561268186
sim_physics_median	0.1458151936531067
sim_physics_min	0.11936044379284508
sim_render-ego_max	0.06689638561672634
sim_render-ego_mean	0.05920569687894053
sim_render-ego_median	0.05753718278346918
sim_render-ego_min	0.05409755615087656
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20444

2617

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:13:56+00:00

2019-04-25 13:19:31+00:00

0:05:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.1682921314239502
agent_compute-ego_mean	0.15944368487545568
agent_compute-ego_median	0.1550922393798828
agent_compute-ego_min	0.15197973067943865
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.1019911046298045, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06720961264844211, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1550922393798828, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.10114051261038152, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03967899196552781, "sim_compute_performance-ego": 0.07530496705253169, "sim_compute_robot_state-ego": 0.08790050362640957}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.10094966338231014, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06055902976256151, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15473153499456552, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.09534055453080398, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.037783604401808515, "sim_compute_performance-ego": 0.07151653674932626, "sim_compute_robot_state-ego": 0.07048673354662381}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.08959350321027967, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06837650140126546, "in-drivable-lane": 0, "agent_compute-ego": 0.16712278789944118, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.10052733951144747, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.04081455866495768, "sim_compute_performance-ego": 0.07309109634823269, "sim_compute_robot_state-ego": 0.0780368513531155}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.11132946968078614, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.06592336654663086, "in-drivable-lane": 0, "agent_compute-ego": 0.1682921314239502, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.10786778450012208, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.04130688667297363, "sim_compute_performance-ego": 0.07837522506713868, "sim_compute_robot_state-ego": 0.08579485893249511}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.09318188214913392, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06196287656441713, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.15197973067943865, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.09453866726312882, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.0381693564928495, "sim_compute_performance-ego": 0.06663975348839393, "sim_compute_robot_state-ego": 0.07312859021700345}}
set_robot_commands_max	0.10786778450012208
set_robot_commands_mean	0.09988297168317677
set_robot_commands_median	0.10052733951144747
set_robot_commands_min	0.09453866726312882
sim_compute_performance-ego_max	0.07837522506713868
sim_compute_performance-ego_mean	0.07298551574112463
sim_compute_performance-ego_median	0.07309109634823269
sim_compute_performance-ego_min	0.06663975348839393
sim_compute_robot_state-ego_max	0.08790050362640957
sim_compute_robot_state-ego_mean	0.0790695075351295
sim_compute_robot_state-ego_median	0.0780368513531155
sim_compute_robot_state-ego_min	0.07048673354662381
sim_compute_sim_state_max	0.04130688667297363
sim_compute_sim_state_mean	0.03955067963962343
sim_compute_sim_state_median	0.03967899196552781
sim_compute_sim_state_min	0.037783604401808515
sim_physics_max	0.11132946968078614
sim_physics_mean	0.09940912461046288
sim_physics_median	0.10094966338231014
sim_physics_min	0.08959350321027967
sim_render-ego_max	0.06837650140126546
sim_render-ego_mean	0.06480627738466341
sim_render-ego_median	0.06592336654663086
sim_render-ego_min	0.06055902976256151
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20438

2628

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:07:52+00:00

2019-04-25 13:13:34+00:00

0:05:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.16640389442443848
agent_compute-ego_mean	0.15433182240778198
agent_compute-ego_median	0.15263883272806802
agent_compute-ego_min	0.14908676777245863
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.0929149051882186, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.0619047407834035, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.14908676777245863, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.08833413753869399, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03840755066781674, "sim_compute_performance-ego": 0.06952131019448335, "sim_compute_robot_state-ego": 0.07043577590078678}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.10888244555546688, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.05790985547579252, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15003393246577337, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.09503547044900748, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03660908112159142, "sim_compute_performance-ego": 0.0639263758292565, "sim_compute_robot_state-ego": 0.06880749188936673}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.08127188682556152, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06181685129801432, "in-drivable-lane": 0, "agent_compute-ego": 0.15263883272806802, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.10061248143513996, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.04334241814083523, "sim_compute_performance-ego": 0.06705448362562391, "sim_compute_robot_state-ego": 0.07109579775068495}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.10880873680114746, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.06596242904663085, "in-drivable-lane": 0, "agent_compute-ego": 0.16640389442443848, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.11051262855529784, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.04501285552978516, "sim_compute_performance-ego": 0.0730142593383789, "sim_compute_robot_state-ego": 0.0863986873626709}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.10161777337392172, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06253807972639035, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.15349568464817143, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.0991681661361303, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.04004328984480638, "sim_compute_performance-ego": 0.06909135366097474, "sim_compute_robot_state-ego": 0.07805254520514072}}
set_robot_commands_max	0.11051262855529784
set_robot_commands_mean	0.09873257682285393
set_robot_commands_median	0.0991681661361303
set_robot_commands_min	0.08833413753869399
sim_compute_performance-ego_max	0.0730142593383789
sim_compute_performance-ego_mean	0.06852155652974348
sim_compute_performance-ego_median	0.06909135366097474
sim_compute_performance-ego_min	0.0639263758292565
sim_compute_robot_state-ego_max	0.0863986873626709
sim_compute_robot_state-ego_mean	0.07495805962173001
sim_compute_robot_state-ego_median	0.07109579775068495
sim_compute_robot_state-ego_min	0.06880749188936673
sim_compute_sim_state_max	0.04501285552978516
sim_compute_sim_state_mean	0.04068303906096698
sim_compute_sim_state_median	0.04004328984480638
sim_compute_sim_state_min	0.03660908112159142
sim_physics_max	0.10888244555546688
sim_physics_mean	0.09869914954886325
sim_physics_median	0.10161777337392172
sim_physics_min	0.08127188682556152
sim_render-ego_max	0.06596242904663085
sim_render-ego_mean	0.06202639126604631
sim_render-ego_median	0.0619047407834035
sim_render-ego_min	0.05790985547579252
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20429

2629

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:00:20+00:00

2019-04-25 13:07:16+00:00

0:06:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.20901874776156443
agent_compute-ego_mean	0.1719967150720468
agent_compute-ego_median	0.15640252113342284
agent_compute-ego_min	0.13767631848653158
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.1484737756117335, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.07877941401499622, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.20901874776156443, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.14386818543919977, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.050332802646564985, "sim_compute_performance-ego": 0.09103663012666524, "sim_compute_robot_state-ego": 0.10425418277956404}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.13178917536368737, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.07751010931455173, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.2029833197593689, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.13596201401490432, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.049093232705042913, "sim_compute_performance-ego": 0.09063350237332858, "sim_compute_robot_state-ego": 0.1013427789394672}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.08434581756591797, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06338381767272949, "in-drivable-lane": 0, "agent_compute-ego": 0.13767631848653158, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.09094689952002633, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.04049817721048991, "sim_compute_performance-ego": 0.06699212392171223, "sim_compute_robot_state-ego": 0.07195177343156603}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.1040428066253662, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.06503541946411133, "in-drivable-lane": 0, "agent_compute-ego": 0.15640252113342284, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.107105712890625, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.04050600051879883, "sim_compute_performance-ego": 0.07157816886901855, "sim_compute_robot_state-ego": 0.07107261657714843}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.09459456113668588, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06188465081728422, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.15390266821934626, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.099211790622809, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.03861006100972494, "sim_compute_performance-ego": 0.06955158404814892, "sim_compute_robot_state-ego": 0.07832352014688346}}
set_robot_commands_max	0.14386818543919977
set_robot_commands_mean	0.11541892049751289
set_robot_commands_median	0.107105712890625
set_robot_commands_min	0.09094689952002633
sim_compute_performance-ego_max	0.09103663012666524
sim_compute_performance-ego_mean	0.07795840186777471
sim_compute_performance-ego_median	0.07157816886901855
sim_compute_performance-ego_min	0.06699212392171223
sim_compute_robot_state-ego_max	0.10425418277956404
sim_compute_robot_state-ego_mean	0.08538897437492583
sim_compute_robot_state-ego_median	0.07832352014688346
sim_compute_robot_state-ego_min	0.07107261657714843
sim_compute_sim_state_max	0.050332802646564985
sim_compute_sim_state_mean	0.04380805481812432
sim_compute_sim_state_median	0.04050600051879883
sim_compute_sim_state_min	0.03861006100972494
sim_physics_max	0.1484737756117335
sim_physics_mean	0.1126492272606782
sim_physics_median	0.1040428066253662
sim_physics_min	0.08434581756591797
sim_render-ego_max	0.07877941401499622
sim_render-ego_mean	0.0693186822567346
sim_render-ego_median	0.06503541946411133
sim_render-ego_min	0.06188465081728422
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20406

2656

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 12:32:25+00:00

2019-04-25 13:00:03+00:00

0:27:38

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20406-465362', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20406-465362', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20406-465362', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20380

2684

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:00:15+00:00

2019-04-25 12:31:56+00:00

0:31:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5971598230269324
survival_time_median	12.950000000000047
deviation-center-line_median	0.7656200752197939
in-drivable-lane_median	3.300000000000022

other stats

agent_compute-ego_max	0.09440551201502484
agent_compute-ego_mean	0.08940831519661416
agent_compute-ego_median	0.0886403952786361
agent_compute-ego_min	0.08631301641464234
deviation-center-line_max	0.944799255396706
deviation-center-line_mean	0.5906332457761053
deviation-center-line_min	0.14643070822789162
deviation-heading_max	5.920359360452256
deviation-heading_mean	3.931742197994501
deviation-heading_median	5.547351090152932
deviation-heading_min	0.5293973448189738
driven_any_max	2.3487580566742774
driven_any_mean	1.5323973366441557
driven_any_median	2.0268481685387787
driven_any_min	0.2355257397606468
driven_lanedir_consec_max	1.357313735045066
driven_lanedir_consec_mean	0.7853630601520072
driven_lanedir_consec_min	0.2118181112575792
driven_lanedir_max	1.5091452256380613
driven_lanedir_mean	0.9377233413681024
driven_lanedir_median	0.9497526185014116
driven_lanedir_min	0.2118181112575792
in-drivable-lane_max	4.1500000000000385
in-drivable-lane_mean	2.220000000000019
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.333209343245738, "sim_physics": 0.2551531600952148, "survival_time": 14.950000000000076, "driven_lanedir": 1.4429321740584884, "sim_render-ego": 0.0724745512008667, "in-drivable-lane": 3.300000000000022, "agent_compute-ego": 0.08944346427917481, "deviation-heading": 5.762891857985308, "set_robot_commands": 0.11429096301396688, "deviation-center-line": 0.8756564337694842, "driven_lanedir_consec": 1.1855550540454851, "sim_compute_sim_state": 0.04510169267654419, "sim_compute_performance-ego": 0.08039204438527425, "sim_compute_robot_state-ego": 0.0886276110013326, "sim_compute_robot_state-npc0": 0.077726415793101, "sim_compute_robot_state-npc1": 0.07988660812377929, "sim_compute_robot_state-npc2": 0.0809373156229655, "sim_compute_robot_state-npc3": 0.07986126104990642}, "udem1-1-0": {"driven_any": 0.7176453750013377, "sim_physics": 0.210178904235363, "survival_time": 4.799999999999991, "driven_lanedir": 0.5749685773849729, "sim_render-ego": 0.07303873697916667, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.08823918799559276, "deviation-heading": 1.8987113365630353, "set_robot_commands": 0.11233567943175632, "deviation-center-line": 0.22065975626665055, "driven_lanedir_consec": 0.5749685773849729, "sim_compute_sim_state": 0.04455617815256119, "sim_compute_performance-ego": 0.07882650693257649, "sim_compute_robot_state-ego": 0.08803117523590724, "sim_compute_robot_state-npc0": 0.07851460079352061, "sim_compute_robot_state-npc1": 0.07880295068025589, "sim_compute_robot_state-npc2": 0.08189793676137924, "sim_compute_robot_state-npc3": 0.07931950936714809}, "udem1-2-0": {"driven_any": 2.0268481685387787, "sim_physics": 0.25048160276818, "survival_time": 12.950000000000047, "driven_lanedir": 0.9497526185014116, "sim_render-ego": 0.07163917972314311, "in-drivable-lane": 4.1500000000000385, "agent_compute-ego": 0.0886403952786361, "deviation-heading": 5.920359360452256, "set_robot_commands": 0.1129259409591498, "deviation-center-line": 0.7656200752197939, "driven_lanedir_consec": 0.5971598230269324, "sim_compute_sim_state": 0.044772443624076695, "sim_compute_performance-ego": 0.07984045205429254, "sim_compute_robot_state-ego": 0.08887145970318769, "sim_compute_robot_state-npc0": 0.07907517812426947, "sim_compute_robot_state-npc1": 0.07916334513071421, "sim_compute_robot_state-npc2": 0.07764500816816529, "sim_compute_robot_state-npc3": 0.07874479901376379}, "udem1-3-0": {"driven_any": 0.2355257397606468, "sim_physics": 0.23090138037999472, "survival_time": 1.800000000000001, "driven_lanedir": 0.2118181112575792, "sim_render-ego": 0.07413960165447658, "in-drivable-lane": 0, "agent_compute-ego": 0.09440551201502484, "deviation-heading": 0.5293973448189738, "set_robot_commands": 0.1163856652047899, "deviation-center-line": 0.14643070822789162, "driven_lanedir_consec": 0.2118181112575792, "sim_compute_sim_state": 0.04890404144922892, "sim_compute_performance-ego": 0.08054072989357842, "sim_compute_robot_state-ego": 0.08947688341140747, "sim_compute_robot_state-npc0": 0.0829464660750495, "sim_compute_robot_state-npc1": 0.08097790347205268, "sim_compute_robot_state-npc2": 0.08397365940941705, "sim_compute_robot_state-npc3": 0.08190797434912787}, "udem1-4-0": {"driven_any": 2.3487580566742774, "sim_physics": 0.25843815644582113, "survival_time": 14.950000000000076, "driven_lanedir": 1.5091452256380613, "sim_render-ego": 0.07090535799662272, "in-drivable-lane": 3.3000000000000345, "agent_compute-ego": 0.08631301641464234, "deviation-heading": 5.547351090152932, "set_robot_commands": 0.11415209134419758, "deviation-center-line": 0.944799255396706, "driven_lanedir_consec": 1.357313735045066, "sim_compute_sim_state": 0.04460232973098755, "sim_compute_performance-ego": 0.08011264403661092, "sim_compute_robot_state-ego": 0.090209375222524, "sim_compute_robot_state-npc0": 0.07903702815373738, "sim_compute_robot_state-npc1": 0.07879406213760376, "sim_compute_robot_state-npc2": 0.07935180981953939, "sim_compute_robot_state-npc3": 0.07822619676589966}}
set_robot_commands_max	0.1163856652047899
set_robot_commands_mean	0.1140180679907721
set_robot_commands_median	0.11415209134419758
set_robot_commands_min	0.11233567943175632
sim_compute_performance-ego_max	0.08054072989357842
sim_compute_performance-ego_mean	0.07994247546046651
sim_compute_performance-ego_median	0.08011264403661092
sim_compute_performance-ego_min	0.07882650693257649
sim_compute_robot_state-ego_max	0.090209375222524
sim_compute_robot_state-ego_mean	0.08904330091487181
sim_compute_robot_state-ego_median	0.08887145970318769
sim_compute_robot_state-ego_min	0.08803117523590724
sim_compute_robot_state-npc0_max	0.0829464660750495
sim_compute_robot_state-npc0_mean	0.07945993778793559
sim_compute_robot_state-npc0_median	0.07903702815373738
sim_compute_robot_state-npc0_min	0.077726415793101
sim_compute_robot_state-npc1_max	0.08097790347205268
sim_compute_robot_state-npc1_mean	0.07952497390888116
sim_compute_robot_state-npc1_median	0.07916334513071421
sim_compute_robot_state-npc1_min	0.07879406213760376
sim_compute_robot_state-npc2_max	0.08397365940941705
sim_compute_robot_state-npc2_mean	0.08076114595629329
sim_compute_robot_state-npc2_median	0.0809373156229655
sim_compute_robot_state-npc2_min	0.07764500816816529
sim_compute_robot_state-npc3_max	0.08190797434912787
sim_compute_robot_state-npc3_mean	0.07961194810916916
sim_compute_robot_state-npc3_median	0.07931950936714809
sim_compute_robot_state-npc3_min	0.07822619676589966
sim_compute_sim_state_max	0.04890404144922892
sim_compute_sim_state_mean	0.04558733712667971
sim_compute_sim_state_median	0.044772443624076695
sim_compute_sim_state_min	0.04455617815256119
sim_physics_max	0.25843815644582113
sim_physics_mean	0.24103064078491476
sim_physics_median	0.25048160276818
sim_physics_min	0.210178904235363
sim_render-ego_max	0.07413960165447658
sim_render-ego_mean	0.07243948551085516
sim_render-ego_median	0.0724745512008667
sim_render-ego_min	0.07090535799662272
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.89000000000004
survival_time_min	1.800000000000001

No reset possible

20374

2708

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:55:57+00:00

2019-04-25 12:00:08+00:00

0:04:11

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20374-292562', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20374-292562', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20374-292562', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20365

2716

test for ppo

step1-simulation

error

2019-04-25 11:54:42+00:00

2019-04-25 11:55:50+00:00

0:01:08

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20363

2723

test for ppo

step1-simulation

error

2019-04-25 11:53:45+00:00

2019-04-25 11:54:34+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20356

2735

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-25 11:52:01+00:00

2019-04-25 11:53:32+00:00

0:01:31

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20351

2742

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 11:49:51+00:00

2019-04-25 11:51:28+00:00

0:01:37

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20345

2758

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 11:41:31+00:00

2019-04-25 11:49:37+00:00

0:08:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07664828237734343
agent_compute-ego_mean	0.0698256628543992
agent_compute-ego_median	0.07089828222225873
agent_compute-ego_min	0.06134702541210033
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.1363217924770556, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.06222958627500033, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.07664828237734343, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.100434400533375, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.03867829473395096, "sim_compute_performance-ego": 0.07071261343203093, "sim_compute_robot_state-ego": 0.07319853807750501, "sim_compute_robot_state-npc0": 0.07070630161385787, "sim_compute_robot_state-npc1": 0.07012110321145308, "sim_compute_robot_state-npc2": 0.07103077361458227, "sim_compute_robot_state-npc3": 0.06945160501881649}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.1572224125266075, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.06682419031858444, "in-drivable-lane": 0, "agent_compute-ego": 0.06880544871091843, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.09226324409246443, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.041775450110435486, "sim_compute_performance-ego": 0.07015227526426315, "sim_compute_robot_state-ego": 0.0747561827301979, "sim_compute_robot_state-npc0": 0.07032083719968796, "sim_compute_robot_state-npc1": 0.06732707470655441, "sim_compute_robot_state-npc2": 0.07037339359521866, "sim_compute_robot_state-npc3": 0.06538678705692291}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.17015129786271316, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.06593833519862248, "in-drivable-lane": 0, "agent_compute-ego": 0.07142927554937509, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.10385942000609176, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.04086399995363676, "sim_compute_performance-ego": 0.06959559825750497, "sim_compute_robot_state-ego": 0.0796239238518935, "sim_compute_robot_state-npc0": 0.07580870389938354, "sim_compute_robot_state-npc1": 0.07397000606243427, "sim_compute_robot_state-npc2": 0.07367217082243699, "sim_compute_robot_state-npc3": 0.07157898407716018}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.1406563978928786, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.060947311230194874, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07089828222225873, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.09771775893675975, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.03940637906392416, "sim_compute_performance-ego": 0.0701128152700571, "sim_compute_robot_state-ego": 0.07139883591578557, "sim_compute_robot_state-npc0": 0.06860859883137238, "sim_compute_robot_state-npc1": 0.07055476384285168, "sim_compute_robot_state-npc2": 0.07040957304147574, "sim_compute_robot_state-npc3": 0.07031052234845284}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.11560265223185222, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.05668822041264287, "in-drivable-lane": 0, "agent_compute-ego": 0.06134702541210033, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.08024733154862015, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.032132863998413086, "sim_compute_performance-ego": 0.06094733874003092, "sim_compute_robot_state-ego": 0.06655249772248445, "sim_compute_robot_state-npc0": 0.06073341546235261, "sim_compute_robot_state-npc1": 0.06119066697579843, "sim_compute_robot_state-npc2": 0.06281078303301776, "sim_compute_robot_state-npc3": 0.059568970291702834}}
set_robot_commands_max	0.10385942000609176
set_robot_commands_mean	0.09490443102346222
set_robot_commands_median	0.09771775893675975
set_robot_commands_min	0.08024733154862015
sim_compute_performance-ego_max	0.07071261343203093
sim_compute_performance-ego_mean	0.06830412819277742
sim_compute_performance-ego_median	0.0701128152700571
sim_compute_performance-ego_min	0.06094733874003092
sim_compute_robot_state-ego_max	0.0796239238518935
sim_compute_robot_state-ego_mean	0.07310599565957329
sim_compute_robot_state-ego_median	0.07319853807750501
sim_compute_robot_state-ego_min	0.06655249772248445
sim_compute_robot_state-npc0_max	0.07580870389938354
sim_compute_robot_state-npc0_mean	0.06923557140133088
sim_compute_robot_state-npc0_median	0.07032083719968796
sim_compute_robot_state-npc0_min	0.06073341546235261
sim_compute_robot_state-npc1_max	0.07397000606243427
sim_compute_robot_state-npc1_mean	0.06863272295981838
sim_compute_robot_state-npc1_median	0.07012110321145308
sim_compute_robot_state-npc1_min	0.06119066697579843
sim_compute_robot_state-npc2_max	0.07367217082243699
sim_compute_robot_state-npc2_mean	0.0696593388213463
sim_compute_robot_state-npc2_median	0.07040957304147574
sim_compute_robot_state-npc2_min	0.06281078303301776
sim_compute_robot_state-npc3_max	0.07157898407716018
sim_compute_robot_state-npc3_mean	0.06725937375861105
sim_compute_robot_state-npc3_median	0.06945160501881649
sim_compute_robot_state-npc3_min	0.059568970291702834
sim_compute_sim_state_max	0.041775450110435486
sim_compute_sim_state_mean	0.03857139757207209
sim_compute_sim_state_median	0.03940637906392416
sim_compute_sim_state_min	0.032132863998413086
sim_physics_max	0.17015129786271316
sim_physics_mean	0.1439909105982214
sim_physics_median	0.1406563978928786
sim_physics_min	0.11560265223185222
sim_render-ego_max	0.06682419031858444
sim_render-ego_mean	0.062525528687009
sim_render-ego_median	0.06222958627500033
sim_render-ego_min	0.05668822041264287
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20319

2808

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-25 11:33:21+00:00

2019-04-25 11:41:10+00:00

0:07:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.166133961587582
agent_compute-ego_mean	0.15038131488895945
agent_compute-ego_median	0.15460333039488974
agent_compute-ego_min	0.13392558850740133
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.14334140183790675, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06163212488282402, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.166133961587582, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.1022546021443493, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.040352947307082845, "sim_compute_performance-ego": 0.06779435895523934, "sim_compute_robot_state-ego": 0.0749960665432912, "sim_compute_robot_state-npc0": 0.07272248897912367, "sim_compute_robot_state-npc1": 0.07262280752074043, "sim_compute_robot_state-npc2": 0.0797340510026464, "sim_compute_robot_state-npc3": 0.06777046761422786}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.1369533630517813, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.05630645385155311, "in-drivable-lane": 0, "agent_compute-ego": 0.13677029426281267, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.08947372436523438, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.035914797049302324, "sim_compute_performance-ego": 0.06264011676494892, "sim_compute_robot_state-ego": 0.06748239810650165, "sim_compute_robot_state-npc0": 0.06167963834909292, "sim_compute_robot_state-npc1": 0.061805770947383, "sim_compute_robot_state-npc2": 0.06368277623103215, "sim_compute_robot_state-npc3": 0.06283401525937594}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.12933270554793508, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.05430005726061369, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.13392558850740133, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.08171040133426064, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.034159597597624124, "sim_compute_performance-ego": 0.05869627312610024, "sim_compute_robot_state-ego": 0.06107674146953382, "sim_compute_robot_state-npc0": 0.05976952063409906, "sim_compute_robot_state-npc1": 0.06078471008100008, "sim_compute_robot_state-npc2": 0.0618463723283065, "sim_compute_robot_state-npc3": 0.06165111064910889}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.15125234217583378, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.062404584281052215, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.15460333039488974, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.0962009007417703, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.040649314469928984, "sim_compute_performance-ego": 0.07171653494050231, "sim_compute_robot_state-ego": 0.07522197011150891, "sim_compute_robot_state-npc0": 0.07021981251390674, "sim_compute_robot_state-npc1": 0.07049133506002306, "sim_compute_robot_state-npc2": 0.06913804404343231, "sim_compute_robot_state-npc3": 0.06939742233179792}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.14437232194123445, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06067749306007668, "in-drivable-lane": 0, "agent_compute-ego": 0.16047339969211155, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.10283457791363752, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.041577957294605394, "sim_compute_performance-ego": 0.06828761100769043, "sim_compute_robot_state-ego": 0.07811501291063097, "sim_compute_robot_state-npc0": 0.07141030276263202, "sim_compute_robot_state-npc1": 0.06810831140588831, "sim_compute_robot_state-npc2": 0.06817255196747957, "sim_compute_robot_state-npc3": 0.07136230998569065}}
set_robot_commands_max	0.10283457791363752
set_robot_commands_mean	0.09449484129985042
set_robot_commands_median	0.0962009007417703
set_robot_commands_min	0.08171040133426064
sim_compute_performance-ego_max	0.07171653494050231
sim_compute_performance-ego_mean	0.06582697895889625
sim_compute_performance-ego_median	0.06779435895523934
sim_compute_performance-ego_min	0.05869627312610024
sim_compute_robot_state-ego_max	0.07811501291063097
sim_compute_robot_state-ego_mean	0.07137843782829331
sim_compute_robot_state-ego_median	0.0749960665432912
sim_compute_robot_state-ego_min	0.06107674146953382
sim_compute_robot_state-npc0_max	0.07272248897912367
sim_compute_robot_state-npc0_mean	0.0671603526477709
sim_compute_robot_state-npc0_median	0.07021981251390674
sim_compute_robot_state-npc0_min	0.05976952063409906
sim_compute_robot_state-npc1_max	0.07262280752074043
sim_compute_robot_state-npc1_mean	0.06676258700300698
sim_compute_robot_state-npc1_median	0.06810831140588831
sim_compute_robot_state-npc1_min	0.06078471008100008
sim_compute_robot_state-npc2_max	0.0797340510026464
sim_compute_robot_state-npc2_mean	0.06851475911457938
sim_compute_robot_state-npc2_median	0.06817255196747957
sim_compute_robot_state-npc2_min	0.0618463723283065
sim_compute_robot_state-npc3_max	0.07136230998569065
sim_compute_robot_state-npc3_mean	0.06660306516804025
sim_compute_robot_state-npc3_median	0.06777046761422786
sim_compute_robot_state-npc3_min	0.06165111064910889
sim_compute_sim_state_max	0.041577957294605394
sim_compute_sim_state_mean	0.038530922743708736
sim_compute_sim_state_median	0.040352947307082845
sim_compute_sim_state_min	0.034159597597624124
sim_physics_max	0.15125234217583378
sim_physics_mean	0.14105042691093828
sim_physics_median	0.14334140183790675
sim_physics_min	0.12933270554793508
sim_render-ego_max	0.062404584281052215
sim_render-ego_mean	0.05906414266722394
sim_render-ego_median	0.06067749306007668
sim_render-ego_min	0.05430005726061369
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20307

2826

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:24:29+00:00

2019-04-25 11:33:08+00:00

0:08:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16115303309458606
agent_compute-ego_mean	0.14984812620097598
agent_compute-ego_median	0.15066306789716086
agent_compute-ego_min	0.14157822132110595
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.17713812387214517, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.0634474776825815, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.16115303309458606, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.09850694773332128, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03999368424685496, "sim_compute_performance-ego": 0.07591973835567259, "sim_compute_robot_state-ego": 0.07506580622691028, "sim_compute_robot_state-npc0": 0.07240312954164901, "sim_compute_robot_state-npc1": 0.0699550430729704, "sim_compute_robot_state-npc2": 0.06841814967821229, "sim_compute_robot_state-npc3": 0.06931216086981432}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.13638441761334738, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.06058019399642944, "in-drivable-lane": 0, "agent_compute-ego": 0.15066306789716086, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.0922597845395406, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03260993957519531, "sim_compute_performance-ego": 0.067085862159729, "sim_compute_robot_state-ego": 0.07312718033790588, "sim_compute_robot_state-npc0": 0.06557414929072063, "sim_compute_robot_state-npc1": 0.06477959950764973, "sim_compute_robot_state-npc2": 0.0643742283185323, "sim_compute_robot_state-npc3": 0.06401822964350383}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.17836742481942905, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.05985783318341789, "in-drivable-lane": 0, "agent_compute-ego": 0.14518279140278445, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09514444965427205, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.038504733877666925, "sim_compute_performance-ego": 0.06585942284535554, "sim_compute_robot_state-ego": 0.07320781885567358, "sim_compute_robot_state-npc0": 0.06727166903221, "sim_compute_robot_state-npc1": 0.06642475774732687, "sim_compute_robot_state-npc2": 0.06784771660626945, "sim_compute_robot_state-npc3": 0.06649678036317987}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.1832435898861643, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.06367379527980999, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15066351728924252, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.09298923056004411, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.03702960580082263, "sim_compute_performance-ego": 0.07087898254394531, "sim_compute_robot_state-ego": 0.07414531707763672, "sim_compute_robot_state-npc0": 0.06506679017665022, "sim_compute_robot_state-npc1": 0.06622040473808677, "sim_compute_robot_state-npc2": 0.06605483717837576, "sim_compute_robot_state-npc3": 0.06737704196218718}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.1184200406074524, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.0539933443069458, "in-drivable-lane": 0, "agent_compute-ego": 0.14157822132110595, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.08724626302719116, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03174694776535034, "sim_compute_performance-ego": 0.05246291160583496, "sim_compute_robot_state-ego": 0.059112954139709475, "sim_compute_robot_state-npc0": 0.0601814866065979, "sim_compute_robot_state-npc1": 0.06655211448669433, "sim_compute_robot_state-npc2": 0.06081058979034424, "sim_compute_robot_state-npc3": 0.061209917068481445}}
set_robot_commands_max	0.09850694773332128
set_robot_commands_mean	0.09322933510287384
set_robot_commands_median	0.09298923056004411
set_robot_commands_min	0.08724626302719116
sim_compute_performance-ego_max	0.07591973835567259
sim_compute_performance-ego_mean	0.06644138350210747
sim_compute_performance-ego_median	0.067085862159729
sim_compute_performance-ego_min	0.05246291160583496
sim_compute_robot_state-ego_max	0.07506580622691028
sim_compute_robot_state-ego_mean	0.07093181532756718
sim_compute_robot_state-ego_median	0.07320781885567358
sim_compute_robot_state-ego_min	0.059112954139709475
sim_compute_robot_state-npc0_max	0.07240312954164901
sim_compute_robot_state-npc0_mean	0.06609944492956556
sim_compute_robot_state-npc0_median	0.06557414929072063
sim_compute_robot_state-npc0_min	0.0601814866065979
sim_compute_robot_state-npc1_max	0.0699550430729704
sim_compute_robot_state-npc1_mean	0.06678638391054562
sim_compute_robot_state-npc1_median	0.06642475774732687
sim_compute_robot_state-npc1_min	0.06477959950764973
sim_compute_robot_state-npc2_max	0.06841814967821229
sim_compute_robot_state-npc2_mean	0.06550110431434682
sim_compute_robot_state-npc2_median	0.06605483717837576
sim_compute_robot_state-npc2_min	0.06081058979034424
sim_compute_robot_state-npc3_max	0.06931216086981432
sim_compute_robot_state-npc3_mean	0.06568282598143332
sim_compute_robot_state-npc3_median	0.06649678036317987
sim_compute_robot_state-npc3_min	0.061209917068481445
sim_compute_sim_state_max	0.03999368424685496
sim_compute_sim_state_mean	0.03597698225317803
sim_compute_sim_state_median	0.03702960580082263
sim_compute_sim_state_min	0.03174694776535034
sim_physics_max	0.1832435898861643
sim_physics_mean	0.15871071935970765
sim_physics_median	0.17713812387214517
sim_physics_min	0.1184200406074524
sim_render-ego_max	0.06367379527980999
sim_render-ego_mean	0.06031052888983692
sim_render-ego_median	0.06058019399642944
sim_render-ego_min	0.0539933443069458
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20300

2839

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:23:32+00:00

2019-04-25 11:24:13+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20286

2857

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 11:10:49+00:00

2019-04-25 11:23:25+00:00

0:12:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.32026437129432717
survival_time_median	4.99999999999999
deviation-center-line_median	0.23639700828006063
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.11049767740729714
agent_compute-ego_mean	0.10747492286643316
agent_compute-ego_median	0.10792935768763225
agent_compute-ego_min	0.10356364167969802
deviation-center-line_max	0.3492827166267816
deviation-center-line_mean	0.21744333687051523
deviation-center-line_min	0.0982762526879876
deviation-heading_max	2.7249701155273667
deviation-heading_mean	1.7648042919293183
deviation-heading_median	1.5694283490769612
deviation-heading_min	1.0570915360043496
driven_any_max	1.17126806589078
driven_any_mean	0.4964176807277776
driven_any_median	0.37492233427138
driven_any_min	0.16598353037712607
driven_lanedir_consec_max	0.4930988891027126
driven_lanedir_consec_mean	0.30545352475449106
driven_lanedir_consec_min	0.13211030782987743
driven_lanedir_max	0.4981177959661107
driven_lanedir_mean	0.3064573061271706
driven_lanedir_median	0.32026437129432717
driven_lanedir_min	0.13211030782987743
in-drivable-lane_max	7.350000000000091
in-drivable-lane_mean	1.7200000000000173
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.17126806589078, "sim_physics": 0.1354211036364237, "survival_time": 14.950000000000076, "driven_lanedir": 0.4981177959661107, "sim_render-ego": 0.06693665107091268, "in-drivable-lane": 7.350000000000091, "agent_compute-ego": 0.10792935768763225, "deviation-heading": 2.7249701155273667, "set_robot_commands": 0.10979958295822144, "deviation-center-line": 0.3492827166267816, "driven_lanedir_consec": 0.4930988891027126, "sim_compute_sim_state": 0.04282971223195394, "sim_compute_performance-ego": 0.07636579434076946, "sim_compute_robot_state-ego": 0.08322672923405965}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20615383608162188, "sim_physics": 0.1063844499916866, "survival_time": 2.8999999999999977, "driven_lanedir": 0.13211030782987743, "sim_render-ego": 0.06716730265781798, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.10356364167969802, "deviation-heading": 1.47490388534188, "set_robot_commands": 0.10363979997306036, "deviation-center-line": 0.0982762526879876, "driven_lanedir_consec": 0.13211030782987743, "sim_compute_sim_state": 0.041821611338648305, "sim_compute_performance-ego": 0.07361362720357961, "sim_compute_robot_state-ego": 0.08310672332500589}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16598353037712607, "sim_physics": 0.10856984555721284, "survival_time": 2.3999999999999995, "driven_lanedir": 0.14240820317474956, "sim_render-ego": 0.0648000289996465, "in-drivable-lane": 0, "agent_compute-ego": 0.10675073166688284, "deviation-heading": 1.0570915360043496, "set_robot_commands": 0.11001915733019511, "deviation-center-line": 0.23639700828006063, "driven_lanedir_consec": 0.14240820317474956, "sim_compute_sim_state": 0.05244670808315277, "sim_compute_performance-ego": 0.07876006762186687, "sim_compute_robot_state-ego": 0.0796919862429301}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.37492233427138, "sim_physics": 0.1155915117263794, "survival_time": 4.99999999999999, "driven_lanedir": 0.32026437129432717, "sim_render-ego": 0.06662656545639038, "in-drivable-lane": 0, "agent_compute-ego": 0.10863320589065552, "deviation-heading": 1.9976275736960336, "set_robot_commands": 0.11113007545471192, "deviation-center-line": 0.2380034890310394, "driven_lanedir_consec": 0.32026437129432717, "sim_compute_sim_state": 0.04331161022186279, "sim_compute_performance-ego": 0.07580661535263061, "sim_compute_robot_state-ego": 0.0793672752380371}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5637606370179798, "sim_physics": 0.13279878687696392, "survival_time": 7.349999999999982, "driven_lanedir": 0.4393858523707883, "sim_render-ego": 0.06895679194910996, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.11049767740729714, "deviation-heading": 1.5694283490769612, "set_robot_commands": 0.1109798424908904, "deviation-center-line": 0.16525721772670687, "driven_lanedir_consec": 0.4393858523707883, "sim_compute_sim_state": 0.042168451815235375, "sim_compute_performance-ego": 0.07981437079760494, "sim_compute_robot_state-ego": 0.0860204858844783}}
set_robot_commands_max	0.11113007545471192
set_robot_commands_mean	0.10911369164141584
set_robot_commands_median	0.11001915733019511
set_robot_commands_min	0.10363979997306036
sim_compute_performance-ego_max	0.07981437079760494
sim_compute_performance-ego_mean	0.0768720950632903
sim_compute_performance-ego_median	0.07636579434076946
sim_compute_performance-ego_min	0.07361362720357961
sim_compute_robot_state-ego_max	0.0860204858844783
sim_compute_robot_state-ego_mean	0.0822826399849022
sim_compute_robot_state-ego_median	0.08310672332500589
sim_compute_robot_state-ego_min	0.0793672752380371
sim_compute_sim_state_max	0.05244670808315277
sim_compute_sim_state_mean	0.04451561873817064
sim_compute_sim_state_median	0.04282971223195394
sim_compute_sim_state_min	0.041821611338648305
sim_physics_max	0.1354211036364237
sim_physics_mean	0.11975313955773328
sim_physics_median	0.1155915117263794
sim_physics_min	0.1063844499916866
sim_render-ego_max	0.06895679194910996
sim_render-ego_mean	0.06689746802677551
sim_render-ego_median	0.06693665107091268
sim_render-ego_min	0.0648000289996465
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.5200000000000085
survival_time_min	2.3999999999999995

No reset possible

20277

2871

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 11:00:24+00:00

2019-04-25 11:10:34+00:00

0:10:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6649499384692693
survival_time_median	2.3
deviation-center-line_median	0.1262939178786419
in-drivable-lane_median	1.0000000000000009

other stats

agent_compute-ego_max	0.20698062233302905
agent_compute-ego_mean	0.1853095372985639
agent_compute-ego_median	0.18311431442481885
agent_compute-ego_min	0.17301498389825587
deviation-center-line_max	0.16931250856720276
deviation-center-line_mean	0.12945834148349644
deviation-center-line_min	0.08639760352575765
deviation-heading_max	1.3626706579071617
deviation-heading_mean	0.6495594711429618
deviation-heading_median	0.6964899875791629
deviation-heading_min	0.15671581276571656
driven_any_max	1.8785757361339328
driven_any_mean	1.3151773031704783
driven_any_median	1.0517356081456524
driven_any_min	0.9184111002795364
driven_lanedir_consec_max	0.9124500239069502
driven_lanedir_consec_mean	0.601871271232273
driven_lanedir_consec_min	0.35307780017355217
driven_lanedir_max	0.9124500239069502
driven_lanedir_mean	0.633621503622611
driven_lanedir_median	0.6769198993384373
driven_lanedir_min	0.35307780017355217
in-drivable-lane_max	1.4999999999999991
in-drivable-lane_mean	1.0499999999999994
in-drivable-lane_min	0.4999999999999989
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9184111002795364, "sim_physics": 0.11277700662612916, "survival_time": 2.000000000000001, "driven_lanedir": 0.35307780017355217, "sim_render-ego": 0.059813845157623294, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.1849449753761291, "deviation-heading": 0.15671581276571656, "set_robot_commands": 0.1020939826965332, "deviation-center-line": 0.0996236030762754, "driven_lanedir_consec": 0.35307780017355217, "sim_compute_sim_state": 0.03866460919380188, "sim_compute_performance-ego": 0.07369781136512757, "sim_compute_robot_state-ego": 0.07792633771896362}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8785757361339328, "sim_physics": 0.09467573165893554, "survival_time": 3.999999999999994, "driven_lanedir": 0.8237011004209592, "sim_render-ego": 0.060013186931610105, "in-drivable-lane": 1.4999999999999991, "agent_compute-ego": 0.17849279046058655, "deviation-heading": 1.3626706579071617, "set_robot_commands": 0.09597597420215606, "deviation-center-line": 0.16566407436960448, "driven_lanedir_consec": 0.6649499384692693, "sim_compute_sim_state": 0.03991920650005341, "sim_compute_performance-ego": 0.06572327017784119, "sim_compute_robot_state-ego": 0.07141636312007904}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7606731725856108, "sim_physics": 0.1039392326189124, "survival_time": 3.4499999999999957, "driven_lanedir": 0.9124500239069502, "sim_render-ego": 0.06283184410869211, "in-drivable-lane": 1.2499999999999971, "agent_compute-ego": 0.18311431442481885, "deviation-heading": 0.8389816022482658, "set_robot_commands": 0.09733016249062358, "deviation-center-line": 0.16931250856720276, "driven_lanedir_consec": 0.9124500239069502, "sim_compute_sim_state": 0.03954124105149421, "sim_compute_performance-ego": 0.06851554607999498, "sim_compute_robot_state-ego": 0.0730634357618249}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0517356081456524, "sim_physics": 0.11400977424953294, "survival_time": 2.3, "driven_lanedir": 0.6769198993384373, "sim_render-ego": 0.06447712234828783, "in-drivable-lane": 0.4999999999999989, "agent_compute-ego": 0.20698062233302905, "deviation-heading": 0.6964899875791629, "set_robot_commands": 0.1055012785870096, "deviation-center-line": 0.1262939178786419, "driven_lanedir_consec": 0.6769198993384373, "sim_compute_sim_state": 0.04102382452591606, "sim_compute_performance-ego": 0.07166286655094313, "sim_compute_robot_state-ego": 0.08366796763046928}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9664908987076588, "sim_physics": 0.12319049602601588, "survival_time": 2.0500000000000007, "driven_lanedir": 0.40195869427315634, "sim_render-ego": 0.06173939821196765, "in-drivable-lane": 1.0000000000000004, "agent_compute-ego": 0.17301498389825587, "deviation-heading": 0.19293929521450137, "set_robot_commands": 0.09449902394922768, "deviation-center-line": 0.08639760352575765, "driven_lanedir_consec": 0.40195869427315634, "sim_compute_sim_state": 0.04029690347066739, "sim_compute_performance-ego": 0.06966992703879751, "sim_compute_robot_state-ego": 0.07660448260423613}}
set_robot_commands_max	0.1055012785870096
set_robot_commands_mean	0.09908008438511004
set_robot_commands_median	0.09733016249062358
set_robot_commands_min	0.09449902394922768
sim_compute_performance-ego_max	0.07369781136512757
sim_compute_performance-ego_mean	0.06985388424254087
sim_compute_performance-ego_median	0.06966992703879751
sim_compute_performance-ego_min	0.06572327017784119
sim_compute_robot_state-ego_max	0.08366796763046928
sim_compute_robot_state-ego_mean	0.07653571736711459
sim_compute_robot_state-ego_median	0.07660448260423613
sim_compute_robot_state-ego_min	0.07141636312007904
sim_compute_sim_state_max	0.04102382452591606
sim_compute_sim_state_mean	0.03988915694838659
sim_compute_sim_state_median	0.03991920650005341
sim_compute_sim_state_min	0.03866460919380188
sim_physics_max	0.12319049602601588
sim_physics_mean	0.10971844823590518
sim_physics_median	0.11277700662612916
sim_physics_min	0.09467573165893554
sim_render-ego_max	0.06447712234828783
sim_render-ego_mean	0.06177507935163619
sim_render-ego_median	0.06173939821196765
sim_render-ego_min	0.059813845157623294
simulation-passed	1
survival_time_max	3.999999999999994
survival_time_mean	2.759999999999998
survival_time_min	2.000000000000001

No reset possible

20265

2872

Peter Almasi 🇭🇺

challenge-aido_LF-template-pytorch

step1-simulation

host-error

2019-04-25 10:57:26+00:00

2019-04-25 11:00:06+00:00

0:02:40

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20265-399604', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20265-399604', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20265-399604', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20252

2921

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 10:41:02+00:00

2019-04-25 10:56:43+00:00

0:15:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24692540755789372
survival_time_median	7.84999999999998
deviation-center-line_median	0.1961123918344563
in-drivable-lane_median	3.749999999999991

other stats

agent_compute-ego_max	0.1746827553791605
agent_compute-ego_mean	0.1669440600545313
agent_compute-ego_median	0.16591753313938776
agent_compute-ego_min	0.1611250564455986
deviation-center-line_max	0.6243529807533017
deviation-center-line_mean	0.24014967594419576
deviation-center-line_min	0.0774001247419856
deviation-heading_max	5.911013301159539
deviation-heading_mean	3.3824597917584023
deviation-heading_median	2.886701302129825
deviation-heading_min	0.6836081132587063
driven_any_max	1.2685080421392356
driven_any_mean	0.7477320008350861
driven_any_median	0.713490563561596
driven_any_min	0.1110433566356977
driven_lanedir_consec_max	0.46482478612490485
driven_lanedir_consec_mean	0.2642853628477388
driven_lanedir_consec_min	0.05157501332382575
driven_lanedir_max	0.46482478612490485
driven_lanedir_mean	0.2642853628477388
driven_lanedir_median	0.24692540755789372
driven_lanedir_min	0.05157501332382575
in-drivable-lane_max	6.800000000000032
in-drivable-lane_mean	3.9400000000000097
in-drivable-lane_min	0.5500000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.713490563561596, "sim_physics": 0.10825094751491668, "survival_time": 7.84999999999998, "driven_lanedir": 0.24692540755789372, "sim_render-ego": 0.06193397607013678, "in-drivable-lane": 3.749999999999991, "agent_compute-ego": 0.1746827553791605, "deviation-heading": 2.886701302129825, "set_robot_commands": 0.09515797408523072, "deviation-center-line": 0.1961123918344563, "driven_lanedir_consec": 0.24692540755789372, "sim_compute_sim_state": 0.0377870699402633, "sim_compute_performance-ego": 0.07255363160637533, "sim_compute_robot_state-ego": 0.07650836713754447}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4003917121008076, "sim_physics": 0.0934898629784584, "survival_time": 4.799999999999991, "driven_lanedir": 0.1241937841922658, "sim_render-ego": 0.06526240954796474, "in-drivable-lane": 2.1999999999999957, "agent_compute-ego": 0.16591753313938776, "deviation-heading": 1.7355604086566183, "set_robot_commands": 0.09486026813586552, "deviation-center-line": 0.0774001247419856, "driven_lanedir_consec": 0.1241937841922658, "sim_compute_sim_state": 0.03864272932211558, "sim_compute_performance-ego": 0.07079419245322545, "sim_compute_robot_state-ego": 0.07203650722901027}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1110433566356977, "sim_physics": 0.10312427580356598, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05157501332382575, "sim_render-ego": 0.06146940588951111, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1611250564455986, "deviation-heading": 0.6836081132587063, "set_robot_commands": 0.09618698060512544, "deviation-center-line": 0.08827588549689414, "driven_lanedir_consec": 0.05157501332382575, "sim_compute_sim_state": 0.040399737656116486, "sim_compute_performance-ego": 0.06879083812236786, "sim_compute_robot_state-ego": 0.07557547837495804}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2685080421392356, "sim_physics": 0.11274359876459294, "survival_time": 13.75000000000006, "driven_lanedir": 0.4339078230398039, "sim_render-ego": 0.05898995052684437, "in-drivable-lane": 6.400000000000027, "agent_compute-ego": 0.16809877308932217, "deviation-heading": 5.695415833587324, "set_robot_commands": 0.09117966391823508, "deviation-center-line": 0.21460699689434096, "driven_lanedir_consec": 0.4339078230398039, "sim_compute_sim_state": 0.03735230966047807, "sim_compute_performance-ego": 0.06647068890658292, "sim_compute_robot_state-ego": 0.07151219628073953}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2452263297380934, "sim_physics": 0.12239210923512776, "survival_time": 14.950000000000076, "driven_lanedir": 0.46482478612490485, "sim_render-ego": 0.060312155882517496, "in-drivable-lane": 6.800000000000032, "agent_compute-ego": 0.16489618221918742, "deviation-heading": 5.911013301159539, "set_robot_commands": 0.09253453016281128, "deviation-center-line": 0.6243529807533017, "driven_lanedir_consec": 0.46482478612490485, "sim_compute_sim_state": 0.037706568241119384, "sim_compute_performance-ego": 0.06772583643595377, "sim_compute_robot_state-ego": 0.07712823549906413}}
set_robot_commands_max	0.09618698060512544
set_robot_commands_mean	0.0939838833814536
set_robot_commands_median	0.09486026813586552
set_robot_commands_min	0.09117966391823508
sim_compute_performance-ego_max	0.07255363160637533
sim_compute_performance-ego_mean	0.06926703750490107
sim_compute_performance-ego_median	0.06879083812236786
sim_compute_performance-ego_min	0.06647068890658292
sim_compute_robot_state-ego_max	0.07712823549906413
sim_compute_robot_state-ego_mean	0.07455215690426328
sim_compute_robot_state-ego_median	0.07557547837495804
sim_compute_robot_state-ego_min	0.07151219628073953
sim_compute_sim_state_max	0.040399737656116486
sim_compute_sim_state_mean	0.03837768296401857
sim_compute_sim_state_median	0.0377870699402633
sim_compute_sim_state_min	0.03735230966047807
sim_physics_max	0.12239210923512776
sim_physics_mean	0.10800015885933235
sim_physics_median	0.10825094751491668
sim_physics_min	0.0934898629784584
sim_render-ego_max	0.06526240954796474
sim_render-ego_mean	0.0615935795833949
sim_render-ego_median	0.06146940588951111
sim_render-ego_min	0.05898995052684437
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.590000000000021
survival_time_min	1.6000000000000008

No reset possible

20233

2956

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 10:25:53+00:00

2019-04-25 10:40:18+00:00

0:14:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6397323094968099
survival_time_median	8.649999999999988
deviation-center-line_median	0.40836793473539473
in-drivable-lane_median	2.0999999999999943

other stats

agent_compute-ego_max	0.21952901073008277
agent_compute-ego_mean	0.1996079161047767
agent_compute-ego_median	0.19520728747049967
agent_compute-ego_min	0.19161408898458315
deviation-center-line_max	0.9140010329632198
deviation-center-line_mean	0.4536884940052305
deviation-center-line_min	0.2280551923572
deviation-heading_max	2.2527295526522235
deviation-heading_mean	1.7398877248686482
deviation-heading_median	1.7200553359896766
deviation-heading_min	1.3439208650742205
driven_any_max	1.6699496734125951
driven_any_mean	0.9989952559812518
driven_any_median	1.013283695351049
driven_any_min	0.5698294498760952
driven_lanedir_consec_max	1.5308358671912168
driven_lanedir_consec_mean	0.6702802451849388
driven_lanedir_consec_min	0.23247955915083415
driven_lanedir_max	1.5308358671912168
driven_lanedir_mean	0.6742020590263157
driven_lanedir_median	0.6566359254258232
driven_lanedir_min	0.23344732836959903
in-drivable-lane_max	2.200000000000008
in-drivable-lane_mean	1.7700000000000002
in-drivable-lane_min	0.8000000000000114
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1087280010336935, "sim_physics": 0.10838346374767452, "survival_time": 8.949999999999992, "driven_lanedir": 0.6567526563980413, "sim_render-ego": 0.06350997306781109, "in-drivable-lane": 2.200000000000008, "agent_compute-ego": 0.21952901073008277, "deviation-heading": 2.2527295526522235, "set_robot_commands": 0.09965942825019028, "deviation-center-line": 0.40836793473539473, "driven_lanedir_consec": 0.6397323094968099, "sim_compute_sim_state": 0.03975731167713357, "sim_compute_performance-ego": 0.06970986307666288, "sim_compute_robot_state-ego": 0.07684340157322378}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6699496734125951, "sim_physics": 0.11350349903106688, "survival_time": 14.950000000000076, "driven_lanedir": 1.5308358671912168, "sim_render-ego": 0.056383084456125894, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.19520728747049967, "deviation-heading": 1.99368024719704, "set_robot_commands": 0.08843966563542684, "deviation-center-line": 0.9140010329632198, "driven_lanedir_consec": 1.5308358671912168, "sim_compute_sim_state": 0.037401285171508786, "sim_compute_performance-ego": 0.06519550879796346, "sim_compute_robot_state-ego": 0.06762666543324788}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6331854602328261, "sim_physics": 0.09717114210128784, "survival_time": 4.99999999999999, "driven_lanedir": 0.2933385177468981, "sim_render-ego": 0.05979462623596191, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.19803044557571411, "deviation-heading": 1.3439208650742205, "set_robot_commands": 0.08607776880264283, "deviation-center-line": 0.2280551923572, "driven_lanedir_consec": 0.2933385177468981, "sim_compute_sim_state": 0.037890992164611816, "sim_compute_performance-ego": 0.06453206777572632, "sim_compute_robot_state-ego": 0.0676681637763977}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5698294498760952, "sim_physics": 0.087899183327297, "survival_time": 5.299999999999989, "driven_lanedir": 0.23344732836959903, "sim_render-ego": 0.05374647986214116, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.19365874776300393, "deviation-heading": 1.389052623430081, "set_robot_commands": 0.08487171047138718, "deviation-center-line": 0.2971023812810442, "driven_lanedir_consec": 0.23247955915083415, "sim_compute_sim_state": 0.03493408437045115, "sim_compute_performance-ego": 0.0631552462307912, "sim_compute_robot_state-ego": 0.06345493613548998}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.013283695351049, "sim_physics": 0.10110643282102022, "survival_time": 8.649999999999988, "driven_lanedir": 0.6566359254258232, "sim_render-ego": 0.05717926493958931, "in-drivable-lane": 2.0999999999999943, "agent_compute-ego": 0.19161408898458315, "deviation-heading": 1.7200553359896766, "set_robot_commands": 0.0883962377647444, "deviation-center-line": 0.42091592868929345, "driven_lanedir_consec": 0.6550149723389347, "sim_compute_sim_state": 0.035863154196325756, "sim_compute_performance-ego": 0.06494841548059717, "sim_compute_robot_state-ego": 0.06890789484013023}}
set_robot_commands_max	0.09965942825019028
set_robot_commands_mean	0.0894889621848783
set_robot_commands_median	0.0883962377647444
set_robot_commands_min	0.08487171047138718
sim_compute_performance-ego_max	0.06970986307666288
sim_compute_performance-ego_mean	0.0655082202723482
sim_compute_performance-ego_median	0.06494841548059717
sim_compute_performance-ego_min	0.0631552462307912
sim_compute_robot_state-ego_max	0.07684340157322378
sim_compute_robot_state-ego_mean	0.06890021235169791
sim_compute_robot_state-ego_median	0.0676681637763977
sim_compute_robot_state-ego_min	0.06345493613548998
sim_compute_sim_state_max	0.03975731167713357
sim_compute_sim_state_mean	0.03716936551600621
sim_compute_sim_state_median	0.037401285171508786
sim_compute_sim_state_min	0.03493408437045115
sim_physics_max	0.11350349903106688
sim_physics_mean	0.1016127442056693
sim_physics_median	0.10110643282102022
sim_physics_min	0.087899183327297
sim_render-ego_max	0.06350997306781109
sim_render-ego_mean	0.05812268571232587
sim_render-ego_median	0.05717926493958931
sim_render-ego_min	0.05374647986214116
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.570000000000007
survival_time_min	4.99999999999999

No reset possible

20173

2865

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 10:00:21+00:00

2019-04-25 10:25:33+00:00

0:25:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.42092024400740513
survival_time_median	6.199999999999986
deviation-center-line_median	0.39887631758881914
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.12848677558283653
agent_compute-ego_mean	0.10449558528299778
agent_compute-ego_median	0.1003039589634648
agent_compute-ego_min	0.09175318962818868
deviation-center-line_max	0.6814184811135475
deviation-center-line_mean	0.39868467575164573
deviation-center-line_min	0.14808359038981317
deviation-heading_max	5.682032472228424
deviation-heading_mean	3.0991916846309637
deviation-heading_median	2.196694509997698
deviation-heading_min	1.4831008157431294
driven_any_max	1.1745078055093283
driven_any_mean	0.6555289219567875
driven_any_median	0.4713653277787152
driven_any_min	0.1900877791161716
driven_lanedir_consec_max	0.6296003873719687
driven_lanedir_consec_mean	0.3870279121704267
driven_lanedir_consec_min	0.1476423557944071
driven_lanedir_max	0.8653004836600253
driven_lanedir_mean	0.4573524156901631
driven_lanedir_median	0.42092024400740513
driven_lanedir_min	0.1476423557944071
in-drivable-lane_max	4.150000000000059
in-drivable-lane_mean	1.4000000000000168
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.26723155429561457, "sim_physics": 0.1482917875856967, "survival_time": 3.699999999999995, "driven_lanedir": 0.15577862660395891, "sim_render-ego": 0.05678098910563701, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.09175318962818868, "deviation-heading": 1.5475188810563432, "set_robot_commands": 0.08243754425564327, "deviation-center-line": 0.15955196419172768, "driven_lanedir_consec": 0.15577862660395891, "sim_compute_sim_state": 0.034379649806667016, "sim_compute_performance-ego": 0.06056144753017941, "sim_compute_robot_state-ego": 0.06450259041141819, "sim_compute_robot_state-npc0": 0.060341035997545395, "sim_compute_robot_state-npc1": 0.06002761866595294, "sim_compute_robot_state-npc2": 0.05916655708003689, "sim_compute_robot_state-npc3": 0.060257492838679136}, "udem1-1-0": {"driven_any": 0.4713653277787152, "sim_physics": 0.1531128921816426, "survival_time": 6.199999999999986, "driven_lanedir": 0.42092024400740513, "sim_render-ego": 0.05556020236784412, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.12848677558283653, "deviation-heading": 2.196694509997698, "set_robot_commands": 0.09240400791168212, "deviation-center-line": 0.39887631758881914, "driven_lanedir_consec": 0.42092024400740513, "sim_compute_sim_state": 0.03503909803205921, "sim_compute_performance-ego": 0.059861367748629664, "sim_compute_robot_state-ego": 0.06515246245168871, "sim_compute_robot_state-npc0": 0.06554988891847673, "sim_compute_robot_state-npc1": 0.06384849163793749, "sim_compute_robot_state-npc2": 0.06162073343030868, "sim_compute_robot_state-npc3": 0.06205556469578897}, "udem1-2-0": {"driven_any": 1.1744521430841075, "sim_physics": 0.20364309708277384, "survival_time": 14.950000000000076, "driven_lanedir": 0.6971203683850193, "sim_render-ego": 0.06236762205759684, "in-drivable-lane": 4.150000000000059, "agent_compute-ego": 0.09743817726771035, "deviation-heading": 4.5866117441292245, "set_robot_commands": 0.09243290821711224, "deviation-center-line": 0.605493025474321, "driven_lanedir_consec": 0.6296003873719687, "sim_compute_sim_state": 0.037642247676849365, "sim_compute_performance-ego": 0.06497902154922486, "sim_compute_robot_state-ego": 0.0707712467511495, "sim_compute_robot_state-npc0": 0.0669618312517802, "sim_compute_robot_state-npc1": 0.0662138319015503, "sim_compute_robot_state-npc2": 0.06739532629648845, "sim_compute_robot_state-npc3": 0.06705923398335775}, "udem1-3-0": {"driven_any": 1.1745078055093283, "sim_physics": 0.21288268009821573, "survival_time": 14.950000000000076, "driven_lanedir": 0.8653004836600253, "sim_render-ego": 0.06408434947331747, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.10449582497278848, "deviation-heading": 5.682032472228424, "set_robot_commands": 0.09722180604934692, "deviation-center-line": 0.6814184811135475, "driven_lanedir_consec": 0.581197947074394, "sim_compute_sim_state": 0.039928827285766605, "sim_compute_performance-ego": 0.0702626895904541, "sim_compute_robot_state-ego": 0.07384480158487956, "sim_compute_robot_state-npc0": 0.0709614634513855, "sim_compute_robot_state-npc1": 0.0706700332959493, "sim_compute_robot_state-npc2": 0.07016832033793131, "sim_compute_robot_state-npc3": 0.06969287633895874}, "udem1-4-0": {"driven_any": 0.1900877791161716, "sim_physics": 0.16485004071836118, "survival_time": 2.6999999999999984, "driven_lanedir": 0.1476423557944071, "sim_render-ego": 0.06168314704188594, "in-drivable-lane": 0, "agent_compute-ego": 0.1003039589634648, "deviation-heading": 1.4831008157431294, "set_robot_commands": 0.09520169099171956, "deviation-center-line": 0.14808359038981317, "driven_lanedir_consec": 0.1476423557944071, "sim_compute_sim_state": 0.04013618716487178, "sim_compute_performance-ego": 0.06676040755377875, "sim_compute_robot_state-ego": 0.06879414010930944, "sim_compute_robot_state-npc0": 0.07266768261238381, "sim_compute_robot_state-npc1": 0.06789219379425049, "sim_compute_robot_state-npc2": 0.0689603708408497, "sim_compute_robot_state-npc3": 0.06881527105967204}}
set_robot_commands_max	0.09722180604934692
set_robot_commands_mean	0.0919395914851008
set_robot_commands_median	0.09243290821711224
set_robot_commands_min	0.08243754425564327
sim_compute_performance-ego_max	0.0702626895904541
sim_compute_performance-ego_mean	0.06448498679445336
sim_compute_performance-ego_median	0.06497902154922486
sim_compute_performance-ego_min	0.059861367748629664
sim_compute_robot_state-ego_max	0.07384480158487956
sim_compute_robot_state-ego_mean	0.06861304826168908
sim_compute_robot_state-ego_median	0.06879414010930944
sim_compute_robot_state-ego_min	0.06450259041141819
sim_compute_robot_state-npc0_max	0.07266768261238381
sim_compute_robot_state-npc0_mean	0.06729638044631432
sim_compute_robot_state-npc0_median	0.0669618312517802
sim_compute_robot_state-npc0_min	0.060341035997545395
sim_compute_robot_state-npc1_max	0.0706700332959493
sim_compute_robot_state-npc1_mean	0.0657304338591281
sim_compute_robot_state-npc1_median	0.0662138319015503
sim_compute_robot_state-npc1_min	0.06002761866595294
sim_compute_robot_state-npc2_max	0.07016832033793131
sim_compute_robot_state-npc2_mean	0.06546226159712301
sim_compute_robot_state-npc2_median	0.06739532629648845
sim_compute_robot_state-npc2_min	0.05916655708003689
sim_compute_robot_state-npc3_max	0.06969287633895874
sim_compute_robot_state-npc3_mean	0.06557608778329133
sim_compute_robot_state-npc3_median	0.06705923398335775
sim_compute_robot_state-npc3_min	0.060257492838679136
sim_compute_sim_state_max	0.04013618716487178
sim_compute_sim_state_mean	0.0374252019932428
sim_compute_sim_state_median	0.037642247676849365
sim_compute_sim_state_min	0.034379649806667016
sim_physics_max	0.21288268009821573
sim_physics_mean	0.176556099533338
sim_physics_median	0.16485004071836118
sim_physics_min	0.1482917875856967
sim_render-ego_max	0.06408434947331747
sim_render-ego_mean	0.06009526200925628
sim_render-ego_median	0.06168314704188594
sim_render-ego_min	0.05556020236784412
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.500000000000027
survival_time_min	2.6999999999999984

No reset possible

20149

2974

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 09:46:17+00:00

2019-04-25 10:00:05+00:00

0:13:48

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20149-280917', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20149-280917', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20149-280917', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20098

2661

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 09:26:20+00:00

2019-04-25 09:45:59+00:00

0:19:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5153728527490467
survival_time_median	5.04999999999999
deviation-center-line_median	0.4774793591731336
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1088150437672933
agent_compute-ego_mean	0.0947365410029247
agent_compute-ego_median	0.09152434511882504
agent_compute-ego_min	0.09005748169331611
deviation-center-line_max	1.2703296352681768
deviation-center-line_mean	0.6225252863301984
deviation-center-line_min	0.12429787663719288
deviation-heading_max	3.8486491625318178
deviation-heading_mean	1.9185937962112063
deviation-heading_median	1.639863461160151
deviation-heading_min	0.818609558463323
driven_any_max	2.3535024348892386
driven_any_mean	1.0318644122031373
driven_any_median	0.7517191331611924
driven_any_min	0.2802092707462073
driven_lanedir_consec_max	2.0034040152174724
driven_lanedir_consec_mean	0.7458442968669248
driven_lanedir_consec_min	0.2155558043476371
driven_lanedir_max	2.229990495620983
driven_lanedir_mean	0.9254602982554048
driven_lanedir_median	0.5153728527490467
driven_lanedir_min	0.2155558043476371
in-drivable-lane_max	0.7499999999999989
in-drivable-lane_mean	0.1699999999999997
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.7517191331611924, "sim_physics": 0.09369491822648757, "survival_time": 5.04999999999999, "driven_lanedir": 0.49308699862882566, "sim_render-ego": 0.07262909530413032, "in-drivable-lane": 0.7499999999999989, "agent_compute-ego": 0.09094265663977896, "deviation-heading": 2.137237436289557, "set_robot_commands": 0.1147918701171875, "deviation-center-line": 0.4774793591731336, "driven_lanedir_consec": 0.2714063207334855, "sim_compute_sim_state": 0.043358795713670184, "sim_compute_performance-ego": 0.07895808644814066, "sim_compute_robot_state-ego": 0.09155515869065088, "sim_compute_robot_state-npc0": 0.07858721572573822, "sim_compute_robot_state-npc1": 0.08000097416415072, "sim_compute_robot_state-npc2": 0.07972140595464423, "sim_compute_robot_state-npc3": 0.0782349959458455}, "udem1-1-0": {"driven_any": 0.2802092707462073, "sim_physics": 0.10039535964407573, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2155558043476371, "sim_render-ego": 0.07218746441166575, "in-drivable-lane": 0, "agent_compute-ego": 0.09152434511882504, "deviation-heading": 1.1486093626111824, "set_robot_commands": 0.11244115596864282, "deviation-center-line": 0.12429787663719288, "driven_lanedir_consec": 0.2155558043476371, "sim_compute_sim_state": 0.04621996530672399, "sim_compute_performance-ego": 0.07612532522620225, "sim_compute_robot_state-ego": 0.0855548265503674, "sim_compute_robot_state-npc0": 0.07703985237493748, "sim_compute_robot_state-npc1": 0.0807340145111084, "sim_compute_robot_state-npc2": 0.08015311636575838, "sim_compute_robot_state-npc3": 0.07833324990621428}, "udem1-2-0": {"driven_any": 0.5534557035431907, "sim_physics": 0.1039464219411214, "survival_time": 3.7499999999999942, "driven_lanedir": 0.5153728527490467, "sim_render-ego": 0.07067530949910482, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.09234317779541017, "deviation-heading": 0.818609558463323, "set_robot_commands": 0.11763627370198568, "deviation-center-line": 0.37275685575468825, "driven_lanedir_consec": 0.5153728527490467, "sim_compute_sim_state": 0.04510208447774251, "sim_compute_performance-ego": 0.08017452557881673, "sim_compute_robot_state-ego": 0.0854439894358317, "sim_compute_robot_state-npc0": 0.08137070973714193, "sim_compute_robot_state-npc1": 0.07998869895935058, "sim_compute_robot_state-npc2": 0.08064198811848958, "sim_compute_robot_state-npc3": 0.08173619588216145}, "udem1-3-0": {"driven_any": 1.2204355186758564, "sim_physics": 0.09233342695839795, "survival_time": 7.89999999999998, "driven_lanedir": 1.173295339930532, "sim_render-ego": 0.07248600826987737, "in-drivable-lane": 0, "agent_compute-ego": 0.09005748169331611, "deviation-heading": 1.639863461160151, "set_robot_commands": 0.11265112780317477, "deviation-center-line": 0.8677627048178003, "driven_lanedir_consec": 0.7234824912869822, "sim_compute_sim_state": 0.04584302027014237, "sim_compute_performance-ego": 0.07788381395460683, "sim_compute_robot_state-ego": 0.08980985834628721, "sim_compute_robot_state-npc0": 0.07870401310015328, "sim_compute_robot_state-npc1": 0.07872690882863878, "sim_compute_robot_state-npc2": 0.07852107814595669, "sim_compute_robot_state-npc3": 0.07940643044966686}, "udem1-4-0": {"driven_any": 2.3535024348892386, "sim_physics": 0.07488661845525106, "survival_time": 14.950000000000076, "driven_lanedir": 2.229990495620983, "sim_render-ego": 0.06247033596038818, "in-drivable-lane": 0, "agent_compute-ego": 0.1088150437672933, "deviation-heading": 3.8486491625318178, "set_robot_commands": 0.0995963184038798, "deviation-center-line": 1.2703296352681768, "driven_lanedir_consec": 2.0034040152174724, "sim_compute_sim_state": 0.03919271151224772, "sim_compute_performance-ego": 0.07018791755040486, "sim_compute_robot_state-ego": 0.07216073354085287, "sim_compute_robot_state-npc0": 0.07037095149358114, "sim_compute_robot_state-npc1": 0.07535582621892294, "sim_compute_robot_state-npc2": 0.07089246988296509, "sim_compute_robot_state-npc3": 0.07515254020690917}}
set_robot_commands_max	0.11763627370198568
set_robot_commands_mean	0.11142334919897412
set_robot_commands_median	0.11265112780317477
set_robot_commands_min	0.0995963184038798
sim_compute_performance-ego_max	0.08017452557881673
sim_compute_performance-ego_mean	0.07666593375163426
sim_compute_performance-ego_median	0.07788381395460683
sim_compute_performance-ego_min	0.07018791755040486
sim_compute_robot_state-ego_max	0.09155515869065088
sim_compute_robot_state-ego_mean	0.08490491331279801
sim_compute_robot_state-ego_median	0.0855548265503674
sim_compute_robot_state-ego_min	0.07216073354085287
sim_compute_robot_state-npc0_max	0.08137070973714193
sim_compute_robot_state-npc0_mean	0.0772145484863104
sim_compute_robot_state-npc0_median	0.07858721572573822
sim_compute_robot_state-npc0_min	0.07037095149358114
sim_compute_robot_state-npc1_max	0.0807340145111084
sim_compute_robot_state-npc1_mean	0.07896128453643428
sim_compute_robot_state-npc1_median	0.07998869895935058
sim_compute_robot_state-npc1_min	0.07535582621892294
sim_compute_robot_state-npc2_max	0.08064198811848958
sim_compute_robot_state-npc2_mean	0.0779860116935628
sim_compute_robot_state-npc2_median	0.07972140595464423
sim_compute_robot_state-npc2_min	0.07089246988296509
sim_compute_robot_state-npc3_max	0.08173619588216145
sim_compute_robot_state-npc3_mean	0.07857268247815945
sim_compute_robot_state-npc3_median	0.07833324990621428
sim_compute_robot_state-npc3_min	0.07515254020690917
sim_compute_sim_state_max	0.04621996530672399
sim_compute_sim_state_mean	0.04394331545610536
sim_compute_sim_state_median	0.04510208447774251
sim_compute_sim_state_min	0.03919271151224772
sim_physics_max	0.1039464219411214
sim_physics_mean	0.09305134904506676
sim_physics_median	0.09369491822648757
sim_physics_min	0.07488661845525106
sim_render-ego_max	0.07262909530413032
sim_render-ego_mean	0.0700896426890333
sim_render-ego_median	0.07218746441166575
sim_render-ego_min	0.06247033596038818
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.740000000000009
survival_time_min	2.0500000000000007

No reset possible

20079

2594

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 09:11:37+00:00

2019-04-25 09:26:13+00:00

0:14:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2232499989766601
survival_time_median	5.1999999999999895
deviation-center-line_median	0.36132840376823366
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2666531801223755
agent_compute-ego_mean	0.2387567414673308
agent_compute-ego_median	0.23199537704730855
agent_compute-ego_min	0.2295814140422924
deviation-center-line_max	0.48996564348395494
deviation-center-line_mean	0.37467085778438874
deviation-center-line_min	0.2459740990065488
deviation-heading_max	2.8637015894360047
deviation-heading_mean	2.254017317393336
deviation-heading_median	1.9512042603164592
deviation-heading_min	1.7768706267750032
driven_any_max	0.31835686665902174
driven_any_mean	0.26050716125880713
driven_any_median	0.2627361763537997
driven_any_min	0.2061399868003768
driven_lanedir_consec_max	0.26320802903107365
driven_lanedir_consec_mean	0.21878549946508297
driven_lanedir_consec_min	0.16590445524271846
driven_lanedir_max	0.26320802903107365
driven_lanedir_mean	0.21878549946508297
driven_lanedir_median	0.2232499989766601
driven_lanedir_min	0.16590445524271846
in-drivable-lane_max	0.04999999999999982
in-drivable-lane_mean	0.019999999999999928
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.31835686665902174, "sim_physics": 0.17231443627127285, "survival_time": 5.799999999999987, "driven_lanedir": 0.26320802903107365, "sim_render-ego": 0.06336518608290574, "in-drivable-lane": 0, "agent_compute-ego": 0.23199537704730855, "deviation-heading": 2.834402751593352, "set_robot_commands": 0.09588367774568755, "deviation-center-line": 0.36132840376823366, "driven_lanedir_consec": 0.26320802903107365, "sim_compute_sim_state": 0.03931802305681952, "sim_compute_performance-ego": 0.06918649426822004, "sim_compute_robot_state-ego": 0.07511472907559626, "sim_compute_robot_state-npc0": 0.06819679202704594, "sim_compute_robot_state-npc1": 0.06845141895886125, "sim_compute_robot_state-npc2": 0.06864799302199791, "sim_compute_robot_state-npc3": 0.06797572867623691}, "udem1-1-0": {"driven_any": 0.2627361763537997, "sim_physics": 0.1730396721952705, "survival_time": 4.6499999999999915, "driven_lanedir": 0.20175349926920516, "sim_render-ego": 0.06631881959976689, "in-drivable-lane": 0, "agent_compute-ego": 0.2311103420872842, "deviation-heading": 2.8637015894360047, "set_robot_commands": 0.09551035460605416, "deviation-center-line": 0.3034831892655414, "driven_lanedir_consec": 0.20175349926920516, "sim_compute_sim_state": 0.03970135668272613, "sim_compute_performance-ego": 0.07019454945800124, "sim_compute_robot_state-ego": 0.07280039274564354, "sim_compute_robot_state-npc0": 0.07067859301003077, "sim_compute_robot_state-npc1": 0.06914600505623766, "sim_compute_robot_state-npc2": 0.06976961833174511, "sim_compute_robot_state-npc3": 0.07035666896450904}, "udem1-2-0": {"driven_any": 0.2511548846123868, "sim_physics": 0.20281288944757905, "survival_time": 5.1999999999999895, "driven_lanedir": 0.2232499989766601, "sim_render-ego": 0.06188976535430321, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.23444339403739345, "deviation-heading": 1.7768706267750032, "set_robot_commands": 0.09484919447165269, "deviation-center-line": 0.4726029533976647, "driven_lanedir_consec": 0.2232499989766601, "sim_compute_sim_state": 0.03948574112011837, "sim_compute_performance-ego": 0.06727762864186214, "sim_compute_robot_state-ego": 0.07326551813345689, "sim_compute_robot_state-npc0": 0.06805723905563354, "sim_compute_robot_state-npc1": 0.06841282431895916, "sim_compute_robot_state-npc2": 0.0677520541044382, "sim_compute_robot_state-npc3": 0.06914848547715408}, "udem1-3-0": {"driven_any": 0.26414789186845067, "sim_physics": 0.17547029417914314, "survival_time": 5.549999999999988, "driven_lanedir": 0.23981151480575735, "sim_render-ego": 0.06202911686252903, "in-drivable-lane": 0, "agent_compute-ego": 0.2295814140422924, "deviation-heading": 1.8439073588458623, "set_robot_commands": 0.09057567570660566, "deviation-center-line": 0.48996564348395494, "driven_lanedir_consec": 0.23981151480575735, "sim_compute_sim_state": 0.03679737958822164, "sim_compute_performance-ego": 0.06647460954683321, "sim_compute_robot_state-ego": 0.07259752084543039, "sim_compute_robot_state-npc0": 0.06656927246231216, "sim_compute_robot_state-npc1": 0.06531286024832511, "sim_compute_robot_state-npc2": 0.06508588576102042, "sim_compute_robot_state-npc3": 0.06536660752854906}, "udem1-4-0": {"driven_any": 0.2061399868003768, "sim_physics": 0.16207578115993077, "survival_time": 3.599999999999995, "driven_lanedir": 0.16590445524271846, "sim_render-ego": 0.05994481510586209, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2666531801223755, "deviation-heading": 1.9512042603164592, "set_robot_commands": 0.10530954930517408, "deviation-center-line": 0.2459740990065488, "driven_lanedir_consec": 0.16590445524271846, "sim_compute_sim_state": 0.036901738908555776, "sim_compute_performance-ego": 0.06698083215289646, "sim_compute_robot_state-ego": 0.07007152173254225, "sim_compute_robot_state-npc0": 0.06815114617347717, "sim_compute_robot_state-npc1": 0.07880930105845134, "sim_compute_robot_state-npc2": 0.07819253206253052, "sim_compute_robot_state-npc3": 0.06553067101372613}}
set_robot_commands_max	0.10530954930517408
set_robot_commands_mean	0.09642569036703484
set_robot_commands_median	0.09551035460605416
set_robot_commands_min	0.09057567570660566
sim_compute_performance-ego_max	0.07019454945800124
sim_compute_performance-ego_mean	0.06802282281356262
sim_compute_performance-ego_median	0.06727762864186214
sim_compute_performance-ego_min	0.06647460954683321
sim_compute_robot_state-ego_max	0.07511472907559626
sim_compute_robot_state-ego_mean	0.07276993650653388
sim_compute_robot_state-ego_median	0.07280039274564354
sim_compute_robot_state-ego_min	0.07007152173254225
sim_compute_robot_state-npc0_max	0.07067859301003077
sim_compute_robot_state-npc0_mean	0.06833060854569992
sim_compute_robot_state-npc0_median	0.06815114617347717
sim_compute_robot_state-npc0_min	0.06656927246231216
sim_compute_robot_state-npc1_max	0.07880930105845134
sim_compute_robot_state-npc1_mean	0.0700264819281669
sim_compute_robot_state-npc1_median	0.06845141895886125
sim_compute_robot_state-npc1_min	0.06531286024832511
sim_compute_robot_state-npc2_max	0.07819253206253052
sim_compute_robot_state-npc2_mean	0.06988961665634644
sim_compute_robot_state-npc2_median	0.06864799302199791
sim_compute_robot_state-npc2_min	0.06508588576102042
sim_compute_robot_state-npc3_max	0.07035666896450904
sim_compute_robot_state-npc3_mean	0.06767563233203504
sim_compute_robot_state-npc3_median	0.06797572867623691
sim_compute_robot_state-npc3_min	0.06536660752854906
sim_compute_sim_state_max	0.03970135668272613
sim_compute_sim_state_mean	0.038440847871288285
sim_compute_sim_state_median	0.03931802305681952
sim_compute_sim_state_min	0.03679737958822164
sim_physics_max	0.20281288944757905
sim_physics_mean	0.17714261465063927
sim_physics_median	0.1730396721952705
sim_physics_min	0.16207578115993077
sim_render-ego_max	0.06631881959976689
sim_render-ego_mean	0.0627095406010734
sim_render-ego_median	0.06202911686252903
sim_render-ego_min	0.05994481510586209
simulation-passed	1
survival_time_max	5.799999999999987
survival_time_mean	4.959999999999989
survival_time_min	3.599999999999995

No reset possible

20058

2812

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-25 09:00:59+00:00

2019-04-25 09:11:11+00:00

0:10:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1631710893016751
agent_compute-ego_mean	0.1561632575078657
agent_compute-ego_median	0.1576876977704606
agent_compute-ego_min	0.14669943849245706
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.16678567652432424, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.06100744571325914, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.1576876977704606, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.0932136301724416, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03744988396482648, "sim_compute_performance-ego": 0.07024102390937086, "sim_compute_robot_state-ego": 0.07025609376295558, "sim_compute_robot_state-npc0": 0.06869368283253796, "sim_compute_robot_state-npc1": 0.06744288723423796, "sim_compute_robot_state-npc2": 0.07297437146024884, "sim_compute_robot_state-npc3": 0.06735523241870808}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.14717270930608117, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.06115709741910299, "in-drivable-lane": 0, "agent_compute-ego": 0.14669943849245706, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.09796377023061116, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.036348591248194374, "sim_compute_performance-ego": 0.06973201036453247, "sim_compute_robot_state-ego": 0.07042526205380757, "sim_compute_robot_state-npc0": 0.06446642676989238, "sim_compute_robot_state-npc1": 0.06484804550806682, "sim_compute_robot_state-npc2": 0.0664216975371043, "sim_compute_robot_state-npc3": 0.07168277104695638}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.1917939751835193, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06667685508728027, "in-drivable-lane": 0, "agent_compute-ego": 0.1631710893016751, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09827472395816092, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03997618061001018, "sim_compute_performance-ego": 0.07717152773323706, "sim_compute_robot_state-ego": 0.07666028960276458, "sim_compute_robot_state-npc0": 0.06954463457657119, "sim_compute_robot_state-npc1": 0.07069262407593808, "sim_compute_robot_state-npc2": 0.06953084670891196, "sim_compute_robot_state-npc3": 0.06696753986811234}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.1929453348709365, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.06330151477102507, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15791572150537522, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.10361984624701032, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.040510153366347494, "sim_compute_performance-ego": 0.07103015608706717, "sim_compute_robot_state-ego": 0.07644541788909395, "sim_compute_robot_state-npc0": 0.07478440414040775, "sim_compute_robot_state-npc1": 0.07180875438754841, "sim_compute_robot_state-npc2": 0.07212059376603466, "sim_compute_robot_state-npc3": 0.07087382623704813}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.14125012159347533, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.06062405109405518, "in-drivable-lane": 0, "agent_compute-ego": 0.15534234046936035, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.08960118293762206, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03984876871109009, "sim_compute_performance-ego": 0.06564868688583374, "sim_compute_robot_state-ego": 0.06878899335861206, "sim_compute_robot_state-npc0": 0.06299346685409546, "sim_compute_robot_state-npc1": 0.06068648099899292, "sim_compute_robot_state-npc2": 0.0613540768623352, "sim_compute_robot_state-npc3": 0.07038689851760864}}
set_robot_commands_max	0.10361984624701032
set_robot_commands_mean	0.0965346307091692
set_robot_commands_median	0.09796377023061116
set_robot_commands_min	0.08960118293762206
sim_compute_performance-ego_max	0.07717152773323706
sim_compute_performance-ego_mean	0.07076468099600827
sim_compute_performance-ego_median	0.07024102390937086
sim_compute_performance-ego_min	0.06564868688583374
sim_compute_robot_state-ego_max	0.07666028960276458
sim_compute_robot_state-ego_mean	0.07251521133344675
sim_compute_robot_state-ego_median	0.07042526205380757
sim_compute_robot_state-ego_min	0.06878899335861206
sim_compute_robot_state-npc0_max	0.07478440414040775
sim_compute_robot_state-npc0_mean	0.06809652303470096
sim_compute_robot_state-npc0_median	0.06869368283253796
sim_compute_robot_state-npc0_min	0.06299346685409546
sim_compute_robot_state-npc1_max	0.07180875438754841
sim_compute_robot_state-npc1_mean	0.06709575844095685
sim_compute_robot_state-npc1_median	0.06744288723423796
sim_compute_robot_state-npc1_min	0.06068648099899292
sim_compute_robot_state-npc2_max	0.07297437146024884
sim_compute_robot_state-npc2_mean	0.06848031726692698
sim_compute_robot_state-npc2_median	0.06953084670891196
sim_compute_robot_state-npc2_min	0.0613540768623352
sim_compute_robot_state-npc3_max	0.07168277104695638
sim_compute_robot_state-npc3_mean	0.06945325361768671
sim_compute_robot_state-npc3_median	0.07038689851760864
sim_compute_robot_state-npc3_min	0.06696753986811234
sim_compute_sim_state_max	0.040510153366347494
sim_compute_sim_state_mean	0.03882671558009372
sim_compute_sim_state_median	0.03984876871109009
sim_compute_sim_state_min	0.036348591248194374
sim_physics_max	0.1929453348709365
sim_physics_mean	0.16798956349566732
sim_physics_median	0.16678567652432424
sim_physics_min	0.14125012159347533
sim_render-ego_max	0.06667685508728027
sim_render-ego_mean	0.06255339281694453
sim_render-ego_median	0.06115709741910299
sim_render-ego_min	0.06062405109405518
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20039

2964

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 08:59:25+00:00

2019-04-25 09:00:38+00:00

0:01:13

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20039-550927', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20039-550927', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20039-550927', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20025

2384

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:47:23+00:00

2019-04-25 08:49:41+00:00

0:02:18

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20015

2411

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:45:49+00:00

2019-04-25 08:47:17+00:00

0:01:28

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20006

2429

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 08:45:06+00:00

2019-04-25 08:45:42+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19998

2463

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:44:13+00:00

2019-04-25 08:44:51+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19986

2492

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 08:42:46+00:00

2019-04-25 08:44:06+00:00

0:01:20

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19959

2716

test for ppo

step1-simulation

error

2019-04-25 08:40:48+00:00

2019-04-25 08:42:26+00:00

0:01:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19945

2792

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:39:45+00:00

2019-04-25 08:40:32+00:00

0:00:47

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19933

2909

Ashwin Ram 🇸🇬

challenge-aido_LF-template-random

step1-simulation

error

2019-04-25 08:38:43+00:00

2019-04-25 08:39:30+00:00

0:00:47

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19917

2645

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:37:46+00:00

2019-04-25 08:38:37+00:00

0:00:51

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19897

2743

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:36:21+00:00

2019-04-25 08:37:15+00:00

0:00:54

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19882

2823

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

error

2019-04-25 08:34:55+00:00

2019-04-25 08:35:50+00:00

0:00:55

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19871

2881

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

error

2019-04-25 08:33:23+00:00

2019-04-25 08:34:34+00:00

0:01:11

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19812

2907

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 08:12:06+00:00

2019-04-25 08:33:09+00:00

0:21:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.3657481511859062
survival_time_median	8.14999999999998
deviation-center-line_median	0.5178532019846503
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.23122706281857228
agent_compute-ego_mean	0.2244337284701169
agent_compute-ego_median	0.2232519920667013
agent_compute-ego_min	0.2146448021286104
deviation-center-line_max	1.0242612694838515
deviation-center-line_mean	0.5096593806438563
deviation-center-line_min	0.1815526271000825
deviation-heading_max	0.9674399631512608
deviation-heading_mean	0.8238858024519191
deviation-heading_median	0.8365673366477469
deviation-heading_min	0.652446569096452
driven_any_max	2.560662071793361
driven_any_mean	1.3849108674230155
driven_any_median	1.3726816424954706
driven_any_min	0.3768745879918225
driven_lanedir_consec_max	2.334869913840255
driven_lanedir_consec_mean	1.254310834511854
driven_lanedir_consec_min	0.3635532519031195
driven_lanedir_max	2.334890533701104
driven_lanedir_mean	1.254395821241331
driven_lanedir_median	1.3661324625614164
driven_lanedir_min	0.3635532519031195
in-drivable-lane_max	2.10000000000003
in-drivable-lane_mean	0.6700000000000095
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3726816424954706, "sim_physics": 0.03895895027675512, "survival_time": 8.14999999999998, "driven_lanedir": 1.3661324625614164, "sim_render-ego": 0.05635785763980421, "in-drivable-lane": 0, "agent_compute-ego": 0.2146448021286104, "deviation-heading": 0.7816631421766453, "set_robot_commands": 0.08892458933262737, "deviation-center-line": 0.5178532019846503, "driven_lanedir_consec": 1.3657481511859062, "sim_compute_sim_state": 0.036888545276197185, "sim_compute_performance-ego": 0.06153873870709191, "sim_compute_robot_state-ego": 0.06633593407145306, "sim_compute_robot_state-npc0": 0.063327451425096, "sim_compute_robot_state-npc1": 0.06308432883280186, "sim_compute_robot_state-npc2": 0.06321366871792845, "sim_compute_robot_state-npc3": 0.06290936616300805}, "udem1-1-0": {"driven_any": 0.4467557255407116, "sim_physics": 0.04655099333378307, "survival_time": 2.849999999999998, "driven_lanedir": 0.4211752092136716, "sim_render-ego": 0.061390387384515056, "in-drivable-lane": 0, "agent_compute-ego": 0.2222591575823332, "deviation-heading": 0.9674399631512608, "set_robot_commands": 0.09260055056789464, "deviation-center-line": 0.20389877857690455, "driven_lanedir_consec": 0.4211752092136716, "sim_compute_sim_state": 0.038025646878961934, "sim_compute_performance-ego": 0.06816473760102924, "sim_compute_robot_state-ego": 0.07216779809249074, "sim_compute_robot_state-npc0": 0.06522871318616365, "sim_compute_robot_state-npc1": 0.06545306506909822, "sim_compute_robot_state-npc2": 0.06485025924548768, "sim_compute_robot_state-npc3": 0.06523562732495759}, "udem1-2-0": {"driven_any": 2.167580309293714, "sim_physics": 0.04202029930325005, "survival_time": 12.700000000000044, "driven_lanedir": 1.786227648827344, "sim_render-ego": 0.061475147412517875, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.23122706281857228, "deviation-heading": 0.8813120011874904, "set_robot_commands": 0.0956243783470214, "deviation-center-line": 0.6207310260737929, "driven_lanedir_consec": 1.7862076464163166, "sim_compute_sim_state": 0.0398214398406622, "sim_compute_performance-ego": 0.0667864027924425, "sim_compute_robot_state-ego": 0.07224338824354758, "sim_compute_robot_state-npc0": 0.06924859745295968, "sim_compute_robot_state-npc1": 0.06739056298113245, "sim_compute_robot_state-npc2": 0.06779248789539487, "sim_compute_robot_state-npc3": 0.06800875513572392}, "udem1-3-0": {"driven_any": 2.560662071793361, "sim_physics": 0.04152500867843628, "survival_time": 14.950000000000076, "driven_lanedir": 2.334890533701104, "sim_render-ego": 0.060413526693979896, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.2232519920667013, "deviation-heading": 0.8365673366477469, "set_robot_commands": 0.0936980438232422, "deviation-center-line": 1.0242612694838515, "driven_lanedir_consec": 2.334869913840255, "sim_compute_sim_state": 0.038380480607350664, "sim_compute_performance-ego": 0.06629988590876261, "sim_compute_robot_state-ego": 0.06952337503433227, "sim_compute_robot_state-npc0": 0.0672299567858378, "sim_compute_robot_state-npc1": 0.06758277893066406, "sim_compute_robot_state-npc2": 0.06802114009857178, "sim_compute_robot_state-npc3": 0.06916581233342489}, "udem1-4-0": {"driven_any": 0.3768745879918225, "sim_physics": 0.042881342829490195, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3635532519031195, "sim_render-ego": 0.06235292493080606, "in-drivable-lane": 0, "agent_compute-ego": 0.23078562775436712, "deviation-heading": 0.652446569096452, "set_robot_commands": 0.09671393219305544, "deviation-center-line": 0.1815526271000825, "driven_lanedir_consec": 0.3635532519031195, "sim_compute_sim_state": 0.03800110427700743, "sim_compute_performance-ego": 0.06889706241841219, "sim_compute_robot_state-ego": 0.06991883686610631, "sim_compute_robot_state-npc0": 0.06787790084371761, "sim_compute_robot_state-npc1": 0.06872049156500369, "sim_compute_robot_state-npc2": 0.06764856649904835, "sim_compute_robot_state-npc3": 0.06771560104525819}}
set_robot_commands_max	0.09671393219305544
set_robot_commands_mean	0.0935122988527682
set_robot_commands_median	0.0936980438232422
set_robot_commands_min	0.08892458933262737
sim_compute_performance-ego_max	0.06889706241841219
sim_compute_performance-ego_mean	0.0663373654855477
sim_compute_performance-ego_median	0.0667864027924425
sim_compute_performance-ego_min	0.06153873870709191
sim_compute_robot_state-ego_max	0.07224338824354758
sim_compute_robot_state-ego_mean	0.07003786646158598
sim_compute_robot_state-ego_median	0.06991883686610631
sim_compute_robot_state-ego_min	0.06633593407145306
sim_compute_robot_state-npc0_max	0.06924859745295968
sim_compute_robot_state-npc0_mean	0.06658252393875494
sim_compute_robot_state-npc0_median	0.0672299567858378
sim_compute_robot_state-npc0_min	0.063327451425096
sim_compute_robot_state-npc1_max	0.06872049156500369
sim_compute_robot_state-npc1_mean	0.06644624547574006
sim_compute_robot_state-npc1_median	0.06739056298113245
sim_compute_robot_state-npc1_min	0.06308432883280186
sim_compute_robot_state-npc2_max	0.06802114009857178
sim_compute_robot_state-npc2_mean	0.06630522449128624
sim_compute_robot_state-npc2_median	0.06764856649904835
sim_compute_robot_state-npc2_min	0.06321366871792845
sim_compute_robot_state-npc3_max	0.06916581233342489
sim_compute_robot_state-npc3_mean	0.06660703240047453
sim_compute_robot_state-npc3_median	0.06771560104525819
sim_compute_robot_state-npc3_min	0.06290936616300805
sim_compute_sim_state_max	0.0398214398406622
sim_compute_sim_state_mean	0.03822344337603588
sim_compute_sim_state_median	0.038025646878961934
sim_compute_sim_state_min	0.036888545276197185
sim_physics_max	0.04655099333378307
sim_physics_mean	0.04238731888434294
sim_physics_median	0.04202029930325005
sim_physics_min	0.03895895027675512
sim_render-ego_max	0.06235292493080606
sim_render-ego_mean	0.06039796881232462
sim_render-ego_median	0.061390387384515056
sim_render-ego_min	0.05635785763980421
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.220000000000022
survival_time_min	2.4499999999999993

No reset possible

19804

3038

Manfred Diaz

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 08:10:37+00:00

2019-04-25 08:11:58+00:00

0:01:21

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19800

2436

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 08:09:14+00:00

2019-04-25 08:10:06+00:00

0:00:52

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19777

2636

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 08:00:18+00:00

2019-04-25 08:08:50+00:00

0:08:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.630782078032722
survival_time_median	2.6499999999999986
deviation-center-line_median	0.10342694179960472
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.15847547186745536
agent_compute-ego_mean	0.14153729935901785
agent_compute-ego_median	0.13924699080617806
agent_compute-ego_min	0.12411592624805592
deviation-center-line_max	0.24274593434117447
deviation-center-line_mean	0.1423794188959262
deviation-center-line_min	0.05838775199208855
deviation-heading_max	0.9510803390140998
deviation-heading_mean	0.5404741772455786
deviation-heading_median	0.4662935751765816
deviation-heading_min	0.3138996563005005
driven_any_max	2.1937495917222662
driven_any_mean	1.101203967779493
driven_any_median	1.072953759306336
driven_any_min	0.3121624499492532
driven_lanedir_consec_max	1.8128454170816104
driven_lanedir_consec_mean	0.8194262040404128
driven_lanedir_consec_min	0.29255031695938905
driven_lanedir_max	1.8128454170816104
driven_lanedir_mean	0.8194262040404128
driven_lanedir_median	0.630782078032722
driven_lanedir_min	0.29255031695938905
in-drivable-lane_max	1.0499999999999965
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.04939344194200304, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.06374393900235494, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15847547186745536, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.09829820858107673, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.04024270508024427, "sim_compute_performance-ego": 0.06921533743540446, "sim_compute_robot_state-ego": 0.07429697116216023, "sim_compute_robot_state-npc0": 0.06985017326143053, "sim_compute_robot_state-npc1": 0.06956612732675341, "sim_compute_robot_state-npc2": 0.06919448574384053, "sim_compute_robot_state-npc3": 0.06927926341692607}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.03220079563282154, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.05289977568167227, "in-drivable-lane": 0, "agent_compute-ego": 0.12411592624805592, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.0779589193838614, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.0309027389243797, "sim_compute_performance-ego": 0.05310279351693613, "sim_compute_robot_state-ego": 0.05219656449777109, "sim_compute_robot_state-npc0": 0.06113533620481138, "sim_compute_robot_state-npc1": 0.06155713399251302, "sim_compute_robot_state-npc2": 0.062337787063033494, "sim_compute_robot_state-npc3": 0.05922427883854619}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.04414173237328391, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.06084996056788176, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15379082346425474, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.0949914663740732, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.039540978311335, "sim_compute_performance-ego": 0.06660199859767284, "sim_compute_robot_state-ego": 0.07115528884443265, "sim_compute_robot_state-npc0": 0.0698921749892744, "sim_compute_robot_state-npc1": 0.06974733917458543, "sim_compute_robot_state-npc2": 0.06820412283962213, "sim_compute_robot_state-npc3": 0.06910438676482265}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.041673493835161314, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.059804480030851544, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.13205728440914513, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.08338847700155007, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.03407497226067309, "sim_compute_performance-ego": 0.06394214900034778, "sim_compute_robot_state-ego": 0.06412130481791946, "sim_compute_robot_state-npc0": 0.0624632385541808, "sim_compute_robot_state-npc1": 0.06001893079505777, "sim_compute_robot_state-npc2": 0.06016007009542213, "sim_compute_robot_state-npc3": 0.05840286218895102}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.041268461628964075, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.0570097847988731, "in-drivable-lane": 0, "agent_compute-ego": 0.13924699080617806, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.0938354542380885, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.037980656874807256, "sim_compute_performance-ego": 0.060915821476986536, "sim_compute_robot_state-ego": 0.06410154543424908, "sim_compute_robot_state-npc0": 0.06659039698149029, "sim_compute_robot_state-npc1": 0.06862686809740569, "sim_compute_robot_state-npc2": 0.0686308835682116, "sim_compute_robot_state-npc3": 0.06952722449051707}}
set_robot_commands_max	0.09829820858107673
set_robot_commands_mean	0.08969450511572999
set_robot_commands_median	0.0938354542380885
set_robot_commands_min	0.0779589193838614
sim_compute_performance-ego_max	0.06921533743540446
sim_compute_performance-ego_mean	0.06275562000546955
sim_compute_performance-ego_median	0.06394214900034778
sim_compute_performance-ego_min	0.05310279351693613
sim_compute_robot_state-ego_max	0.07429697116216023
sim_compute_robot_state-ego_mean	0.0651743349513065
sim_compute_robot_state-ego_median	0.06412130481791946
sim_compute_robot_state-ego_min	0.05219656449777109
sim_compute_robot_state-npc0_max	0.0698921749892744
sim_compute_robot_state-npc0_mean	0.06598626399823747
sim_compute_robot_state-npc0_median	0.06659039698149029
sim_compute_robot_state-npc0_min	0.06113533620481138
sim_compute_robot_state-npc1_max	0.06974733917458543
sim_compute_robot_state-npc1_mean	0.06590327987726306
sim_compute_robot_state-npc1_median	0.06862686809740569
sim_compute_robot_state-npc1_min	0.06001893079505777
sim_compute_robot_state-npc2_max	0.06919448574384053
sim_compute_robot_state-npc2_mean	0.06570546986202598
sim_compute_robot_state-npc2_median	0.06820412283962213
sim_compute_robot_state-npc2_min	0.06016007009542213
sim_compute_robot_state-npc3_max	0.06952722449051707
sim_compute_robot_state-npc3_mean	0.06510760313995259
sim_compute_robot_state-npc3_median	0.06910438676482265
sim_compute_robot_state-npc3_min	0.05840286218895102
sim_compute_sim_state_max	0.04024270508024427
sim_compute_sim_state_mean	0.03654841029028787
sim_compute_sim_state_median	0.037980656874807256
sim_compute_sim_state_min	0.0309027389243797
sim_physics_max	0.04939344194200304
sim_physics_mean	0.04173558508244678
sim_physics_median	0.041673493835161314
sim_physics_min	0.03220079563282154
sim_render-ego_max	0.06374393900235494
sim_render-ego_mean	0.05886158801632672
sim_render-ego_median	0.059804480030851544
sim_render-ego_min	0.05289977568167227
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.739999999999997
survival_time_min	0.9500000000000004

No reset possible

19767

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 07:53:11+00:00

2019-04-25 08:00:03+00:00

0:06:52

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19767-19735', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19767-19735', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19767-19735', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19758

3026

Manfred Diaz

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 07:47:01+00:00

2019-04-25 07:52:57+00:00

0:05:56

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19732

3051

Manfred Diaz

challenge-aido_LF-template-tensorflow

step1-simulation

error