Evaluator 800

step1-simulation

success

2019-04-26 21:43:57+00:00

2019-04-26 21:57:27+00:00

0:13:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3681291166573782
survival_time_median	14.950000000000076
deviation-center-line_median	0.6457031985251082
in-drivable-lane_median	5.80000000000004

other stats

agent_compute-ego_max	0.12780359029769897
agent_compute-ego_mean	0.1275218627790903
agent_compute-ego_median	0.12759555180867513
agent_compute-ego_min	0.12710635305389645
deviation-center-line_max	0.9872122648236104
deviation-center-line_mean	0.6602023516800636
deviation-center-line_min	0.4920490467347587
deviation-heading_max	3.226051968757323
deviation-heading_mean	2.0716894554126624
deviation-heading_median	1.7023123127630109
deviation-heading_min	1.1858007752722803
driven_any_max	0.9441978828422172
driven_any_mean	0.8642390504111365
driven_any_median	0.9283050501990115
driven_any_min	0.7019746281731368
driven_lanedir_consec_max	0.8144224463575127
driven_lanedir_consec_mean	0.5143655290423343
driven_lanedir_consec_min	0.3176880279801262
driven_lanedir_max	0.8144224463575127
driven_lanedir_mean	0.5143655290423343
driven_lanedir_median	0.3681291166573782
driven_lanedir_min	0.3176880279801262
in-drivable-lane_max	9.20000000000009
in-drivable-lane_mean	5.100000000000049
in-drivable-lane_min	1.550000000000022
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8047769996183237, "sim_physics": 0.06394513948695867, "survival_time": 12.700000000000044, "driven_lanedir": 0.3681291166573782, "sim_render-ego": 0.036467926708732064, "in-drivable-lane": 6.600000000000059, "agent_compute-ego": 0.12710635305389645, "deviation-heading": 1.1858007752722803, "set_robot_commands": 0.05592144098807507, "deviation-center-line": 0.6457031985251082, "driven_lanedir_consec": 0.3681291166573782, "sim_compute_sim_state": 0.023505847285112996, "sim_compute_performance-ego": 0.04259317972528653, "sim_compute_robot_state-ego": 0.042664840465455545}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9283050501990115, "sim_physics": 0.06535706917444865, "survival_time": 14.950000000000076, "driven_lanedir": 0.3176880279801262, "sim_render-ego": 0.036488765080769855, "in-drivable-lane": 9.20000000000009, "agent_compute-ego": 0.12759555180867513, "deviation-heading": 1.7023123127630109, "set_robot_commands": 0.05530249834060669, "deviation-center-line": 0.4920490467347587, "driven_lanedir_consec": 0.3176880279801262, "sim_compute_sim_state": 0.023831942876180012, "sim_compute_performance-ego": 0.03949689785639445, "sim_compute_robot_state-ego": 0.04268626928329468}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9441978828422172, "sim_physics": 0.06886027097702026, "survival_time": 14.950000000000076, "driven_lanedir": 0.7537006215646826, "sim_render-ego": 0.03648068507512411, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.12778517723083496, "deviation-heading": 3.226051968757323, "set_robot_commands": 0.05641780217488607, "deviation-center-line": 0.9872122648236104, "driven_lanedir_consec": 0.7537006215646826, "sim_compute_sim_state": 0.02381529331207275, "sim_compute_performance-ego": 0.03980115969975789, "sim_compute_robot_state-ego": 0.04205511093139649}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9419406912229932, "sim_physics": 0.06672739267349242, "survival_time": 14.950000000000076, "driven_lanedir": 0.8144224463575127, "sim_render-ego": 0.03618314504623413, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.12780359029769897, "deviation-heading": 2.7473703170537465, "set_robot_commands": 0.055814048449198406, "deviation-center-line": 0.6485717954099242, "driven_lanedir_consec": 0.8144224463575127, "sim_compute_sim_state": 0.023691774209340412, "sim_compute_performance-ego": 0.03954375743865967, "sim_compute_robot_state-ego": 0.04187532504399617}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7019746281731368, "sim_physics": 0.06008609934144665, "survival_time": 11.450000000000028, "driven_lanedir": 0.31788743265197184, "sim_render-ego": 0.03626227378845215, "in-drivable-lane": 5.80000000000004, "agent_compute-ego": 0.12731864150434602, "deviation-heading": 1.4969119032169518, "set_robot_commands": 0.0559019813371017, "deviation-center-line": 0.5274754529069167, "driven_lanedir_consec": 0.31788743265197184, "sim_compute_sim_state": 0.024011225679555836, "sim_compute_performance-ego": 0.0399577700935597, "sim_compute_robot_state-ego": 0.04209303335331413}}
set_robot_commands_max	0.05641780217488607
set_robot_commands_mean	0.05587155425797359
set_robot_commands_median	0.0559019813371017
set_robot_commands_min	0.05530249834060669
sim_compute_performance-ego_max	0.04259317972528653
sim_compute_performance-ego_mean	0.04027855296273165
sim_compute_performance-ego_median	0.03980115969975789
sim_compute_performance-ego_min	0.03949689785639445
sim_compute_robot_state-ego_max	0.04268626928329468
sim_compute_robot_state-ego_mean	0.04227491581549141
sim_compute_robot_state-ego_median	0.04209303335331413
sim_compute_robot_state-ego_min	0.04187532504399617
sim_compute_sim_state_max	0.024011225679555836
sim_compute_sim_state_mean	0.023771216672452404
sim_compute_sim_state_median	0.02381529331207275
sim_compute_sim_state_min	0.023505847285112996
sim_physics_max	0.06886027097702026
sim_physics_mean	0.06499519433067333
sim_physics_median	0.06535706917444865
sim_physics_min	0.06008609934144665
sim_render-ego_max	0.036488765080769855
sim_render-ego_mean	0.036376559139862465
sim_render-ego_median	0.036467926708732064
sim_render-ego_min	0.03618314504623413
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.800000000000065
survival_time_min	11.450000000000028

No reset possible

20701

3098

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

success

aido2-AMOD-service_quality

2019-04-26 20:16:21+00:00

2019-04-26 20:30:35+00:00

0:14:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6639813416740894
survival_time_median	12.750000000000046
deviation-center-line_median	0.5779233259181636
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1695952817505481
agent_compute-ego_mean	0.16635386846838687
agent_compute-ego_median	0.16659535859760485
agent_compute-ego_min	0.1614722426299455
deviation-center-line_max	0.917264774507531
deviation-center-line_mean	0.6201968785227758
deviation-center-line_min	0.41939247730478346
deviation-heading_max	3.742939424744096
deviation-heading_mean	2.2877300250256374
deviation-heading_median	1.8182712165589163
deviation-heading_min	0.8420926390445757
driven_any_max	1.201392793917899
driven_any_mean	0.7922128406542749
driven_any_median	0.9975278835298332
driven_any_min	0.27770009405015406
driven_lanedir_consec_max	1.1768258374816152
driven_lanedir_consec_mean	0.6775907367701787
driven_lanedir_consec_min	0.2707826916509428
driven_lanedir_max	1.1768258374816152
driven_lanedir_mean	0.6775907367701787
driven_lanedir_median	0.6639813416740894
driven_lanedir_min	0.2707826916509428
in-drivable-lane_max	3.250000000000046
in-drivable-lane_mean	0.8900000000000127
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.025315227557716, "sim_physics": 0.08614646228834813, "survival_time": 12.850000000000048, "driven_lanedir": 0.6639813416740894, "sim_render-ego": 0.04702980787373702, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.1614722426299455, "deviation-heading": 3.742939424744096, "set_robot_commands": 0.07300325590348893, "deviation-center-line": 0.5779233259181636, "driven_lanedir_consec": 0.6639813416740894, "sim_compute_sim_state": 0.031589991387690086, "sim_compute_performance-ego": 0.05404023623188182, "sim_compute_robot_state-ego": 0.05670658530892101}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9975278835298332, "sim_physics": 0.08712179146560968, "survival_time": 12.750000000000046, "driven_lanedir": 0.8386579431480254, "sim_render-ego": 0.05001536257126752, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.1695952817505481, "deviation-heading": 3.218259807483326, "set_robot_commands": 0.07256966385186887, "deviation-center-line": 0.917264774507531, "driven_lanedir_consec": 0.8386579431480254, "sim_compute_sim_state": 0.031697963265811695, "sim_compute_performance-ego": 0.05435267803715725, "sim_compute_robot_state-ego": 0.05605950636022231}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.27770009405015406, "sim_physics": 0.0704140631776107, "survival_time": 3.7999999999999945, "driven_lanedir": 0.2707826916509428, "sim_render-ego": 0.051622246441088225, "in-drivable-lane": 0, "agent_compute-ego": 0.16659535859760485, "deviation-heading": 0.8420926390445757, "set_robot_commands": 0.07190594861381933, "deviation-center-line": 0.41939247730478346, "driven_lanedir_consec": 0.2707826916509428, "sim_compute_sim_state": 0.031737067197498525, "sim_compute_performance-ego": 0.05506824192247893, "sim_compute_robot_state-ego": 0.058172492604506645}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45912820421577255, "sim_physics": 0.08393298076982257, "survival_time": 5.949999999999987, "driven_lanedir": 0.4377058698962206, "sim_render-ego": 0.05114438754169881, "in-drivable-lane": 0, "agent_compute-ego": 0.1663502865478772, "deviation-heading": 1.817087037297275, "set_robot_commands": 0.07272737767516065, "deviation-center-line": 0.4414992567500641, "driven_lanedir_consec": 0.4377058698962206, "sim_compute_sim_state": 0.031171936948760217, "sim_compute_performance-ego": 0.0530046414928276, "sim_compute_robot_state-ego": 0.056187006605773415}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.201392793917899, "sim_physics": 0.09049822489420573, "survival_time": 14.950000000000076, "driven_lanedir": 1.1768258374816152, "sim_render-ego": 0.04971244891484578, "in-drivable-lane": 0, "agent_compute-ego": 0.16775617281595867, "deviation-heading": 1.8182712165589163, "set_robot_commands": 0.0737137754758199, "deviation-center-line": 0.7449045581333368, "driven_lanedir_consec": 1.1768258374816152, "sim_compute_sim_state": 0.03110012928644816, "sim_compute_performance-ego": 0.05273362557093302, "sim_compute_robot_state-ego": 0.056535960833231605}}
set_robot_commands_max	0.0737137754758199
set_robot_commands_mean	0.07278400430403154
set_robot_commands_median	0.07272737767516065
set_robot_commands_min	0.07190594861381933
sim_compute_performance-ego_max	0.05506824192247893
sim_compute_performance-ego_mean	0.05383988465105573
sim_compute_performance-ego_median	0.05404023623188182
sim_compute_performance-ego_min	0.05273362557093302
sim_compute_robot_state-ego_max	0.058172492604506645
sim_compute_robot_state-ego_mean	0.056732310342531
sim_compute_robot_state-ego_median	0.056535960833231605
sim_compute_robot_state-ego_min	0.05605950636022231
sim_compute_sim_state_max	0.031737067197498525
sim_compute_sim_state_mean	0.03145941761724173
sim_compute_sim_state_median	0.031589991387690086
sim_compute_sim_state_min	0.03110012928644816
sim_physics_max	0.09049822489420573
sim_physics_mean	0.08362270451911936
sim_physics_median	0.08614646228834813
sim_physics_min	0.0704140631776107
sim_render-ego_max	0.051622246441088225
sim_render-ego_mean	0.04990485066852747
sim_render-ego_median	0.05001536257126752
sim_render-ego_min	0.04702980787373702
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.06000000000003
survival_time_min	3.7999999999999945

No reset possible

20690

3093

Claudio Ruch

Python template

step1-simulation

success

yes

2019-04-26 13:48:25+00:00

2019-04-26 13:51:50+00:00

0:03:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20685

3091

Claudio Ruch

Java template from Webinar

aido2-AMOD-fleet_size

step1-simulation

success

yes

2019-04-26 13:37:51+00:00

2019-04-26 13:41:02+00:00

0:03:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20677

3086

Claudio Ruch

Python template

aido2-AMOD-efficiency

step1-simulation

host-error

yes

aido2-AMOD-service_quality

2019-04-26 12:39:57+00:00

2019-04-26 13:05:11+00:00

0:25:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20677-422117', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20677-422117', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20677-422117', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20666

3081

Andrea Censi 🇨🇭

Java template

step2-scoring

success

yes

2019-04-26 10:29:30+00:00

2019-04-26 10:30:23+00:00

0:00:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-32.77804632683164

other stats

efficiency	-63.9236253073247
fleet_size	-1000000000

No reset possible

20660

3074

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 10:02:59+00:00

2019-04-26 10:28:37+00:00

0:25:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6252564079824441
survival_time_median	10.90000000000002
deviation-center-line_median	0.5497619343944397
in-drivable-lane_median	3.7000000000000375

other stats

agent_compute-ego_max	0.2461181440923968
agent_compute-ego_mean	0.2095082470513575
agent_compute-ego_median	0.21716805219650268
agent_compute-ego_min	0.1733728035291036
deviation-center-line_max	0.6105796368808647
deviation-center-line_mean	0.5326843414510729
deviation-center-line_min	0.4265911055808853
deviation-heading_max	1.6572896225144285
deviation-heading_mean	1.373540311410888
deviation-heading_median	1.5505443028328485
deviation-heading_min	0.995550644228636
driven_any_max	1.3765833276269832
driven_any_mean	0.954410752955812
driven_any_median	0.993369029947842
driven_any_min	0.5077784412651525
driven_lanedir_consec_max	0.8158891092623266
driven_lanedir_consec_mean	0.6485002295118368
driven_lanedir_consec_min	0.4987776919144906
driven_lanedir_max	0.8158891092623266
driven_lanedir_mean	0.6485002295118368
driven_lanedir_median	0.6252564079824441
driven_lanedir_min	0.4987776919144906
in-drivable-lane_max	5.9500000000000846
in-drivable-lane_mean	3.090000000000041
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993369029947842, "sim_physics": 0.18166217891448136, "survival_time": 10.90000000000002, "driven_lanedir": 0.6252564079824441, "sim_render-ego": 0.06474437079298387, "in-drivable-lane": 3.7000000000000375, "agent_compute-ego": 0.2302436795803385, "deviation-heading": 0.995550644228636, "set_robot_commands": 0.10151448271690158, "deviation-center-line": 0.5497619343944397, "driven_lanedir_consec": 0.6252564079824441, "sim_compute_sim_state": 0.04067010945136394, "sim_compute_performance-ego": 0.07207684560653267, "sim_compute_robot_state-ego": 0.07690611782423946, "sim_compute_robot_state-npc0": 0.07084206812972323, "sim_compute_robot_state-npc1": 0.07109135334644842, "sim_compute_robot_state-npc2": 0.07025663896438179, "sim_compute_robot_state-npc3": 0.07174881991990116}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5192316224192188, "sim_physics": 0.1936846940945356, "survival_time": 5.849999999999987, "driven_lanedir": 0.4987776919144906, "sim_render-ego": 0.0666763864011846, "in-drivable-lane": 0, "agent_compute-ego": 0.2461181440923968, "deviation-heading": 1.6572896225144285, "set_robot_commands": 0.0992094940609402, "deviation-center-line": 0.4265911055808853, "driven_lanedir_consec": 0.4987776919144906, "sim_compute_sim_state": 0.04053475510360848, "sim_compute_performance-ego": 0.07528719127687633, "sim_compute_robot_state-ego": 0.08256379355732192, "sim_compute_robot_state-npc0": 0.07301675560127975, "sim_compute_robot_state-npc1": 0.07358446895566761, "sim_compute_robot_state-npc2": 0.07343417558914576, "sim_compute_robot_state-npc3": 0.07521959247752133}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3750913435198628, "sim_physics": 0.18793190240859983, "survival_time": 14.950000000000076, "driven_lanedir": 0.8158891092623266, "sim_render-ego": 0.06399287303288778, "in-drivable-lane": 5.800000000000082, "agent_compute-ego": 0.21716805219650268, "deviation-heading": 1.5860135311724932, "set_robot_commands": 0.0985011307398478, "deviation-center-line": 0.6105796368808647, "driven_lanedir_consec": 0.8158891092623266, "sim_compute_sim_state": 0.04067982514699301, "sim_compute_performance-ego": 0.07059929688771566, "sim_compute_robot_state-ego": 0.07385589917500814, "sim_compute_robot_state-npc0": 0.07036459604899088, "sim_compute_robot_state-npc1": 0.07123101870218913, "sim_compute_robot_state-npc2": 0.07079687833786011, "sim_compute_robot_state-npc3": 0.07089617729187012}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3765833276269832, "sim_physics": 0.13456451495488483, "survival_time": 14.950000000000076, "driven_lanedir": 0.8036115560527115, "sim_render-ego": 0.0504516331354777, "in-drivable-lane": 5.9500000000000846, "agent_compute-ego": 0.1733728035291036, "deviation-heading": 1.5505443028328485, "set_robot_commands": 0.07489888191223144, "deviation-center-line": 0.5963414544281409, "driven_lanedir_consec": 0.8036115560527115, "sim_compute_sim_state": 0.03148557186126709, "sim_compute_performance-ego": 0.0538028073310852, "sim_compute_robot_state-ego": 0.0584551199277242, "sim_compute_robot_state-npc0": 0.05618382215499878, "sim_compute_robot_state-npc1": 0.05473668893178304, "sim_compute_robot_state-npc2": 0.055513339042663576, "sim_compute_robot_state-npc3": 0.055360991954803464}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5077784412651525, "sim_physics": 0.12865406119305153, "survival_time": 5.749999999999988, "driven_lanedir": 0.4989663823472117, "sim_render-ego": 0.05181103996608568, "in-drivable-lane": 0, "agent_compute-ego": 0.1806385558584462, "deviation-heading": 1.0783034563060343, "set_robot_commands": 0.07982260455255923, "deviation-center-line": 0.4801475759710336, "driven_lanedir_consec": 0.4989663823472117, "sim_compute_sim_state": 0.0323423779529074, "sim_compute_performance-ego": 0.05765278235725735, "sim_compute_robot_state-ego": 0.06020608777585237, "sim_compute_robot_state-npc0": 0.058683710512907605, "sim_compute_robot_state-npc1": 0.05659669793170431, "sim_compute_robot_state-npc2": 0.05811421974845554, "sim_compute_robot_state-npc3": 0.058487624707429305}}
set_robot_commands_max	0.10151448271690158
set_robot_commands_mean	0.09078931879649606
set_robot_commands_median	0.0985011307398478
set_robot_commands_min	0.07489888191223144
sim_compute_performance-ego_max	0.07528719127687633
sim_compute_performance-ego_mean	0.06588378469189345
sim_compute_performance-ego_median	0.07059929688771566
sim_compute_performance-ego_min	0.0538028073310852
sim_compute_robot_state-ego_max	0.08256379355732192
sim_compute_robot_state-ego_mean	0.07039740365202922
sim_compute_robot_state-ego_median	0.07385589917500814
sim_compute_robot_state-ego_min	0.0584551199277242
sim_compute_robot_state-npc0_max	0.07301675560127975
sim_compute_robot_state-npc0_mean	0.06581819048958006
sim_compute_robot_state-npc0_median	0.07036459604899088
sim_compute_robot_state-npc0_min	0.05618382215499878
sim_compute_robot_state-npc1_max	0.07358446895566761
sim_compute_robot_state-npc1_mean	0.0654480455735585
sim_compute_robot_state-npc1_median	0.07109135334644842
sim_compute_robot_state-npc1_min	0.05473668893178304
sim_compute_robot_state-npc2_max	0.07343417558914576
sim_compute_robot_state-npc2_mean	0.06562305033650136
sim_compute_robot_state-npc2_median	0.07025663896438179
sim_compute_robot_state-npc2_min	0.055513339042663576
sim_compute_robot_state-npc3_max	0.07521959247752133
sim_compute_robot_state-npc3_mean	0.06634264127030506
sim_compute_robot_state-npc3_median	0.07089617729187012
sim_compute_robot_state-npc3_min	0.055360991954803464
sim_compute_sim_state_max	0.04067982514699301
sim_compute_sim_state_mean	0.03714252790322799
sim_compute_sim_state_median	0.04053475510360848
sim_compute_sim_state_min	0.03148557186126709
sim_physics_max	0.1936846940945356
sim_physics_mean	0.16529947031311065
sim_physics_median	0.18166217891448136
sim_physics_min	0.12865406119305153
sim_render-ego_max	0.0666763864011846
sim_render-ego_mean	0.05953526066572392
sim_render-ego_median	0.06399287303288778
sim_render-ego_min	0.0504516331354777
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.480000000000029
survival_time_min	5.749999999999988

No reset possible

20624

2413

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 15:00:32+00:00

2019-04-25 15:33:29+00:00

0:32:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3401138062222346
survival_time_median	14.950000000000076
deviation-center-line_median	1.0020906406379184
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.1797993540763855
agent_compute-ego_mean	0.14860574865341186
agent_compute-ego_median	0.13208555301030478
agent_compute-ego_min	0.13132417837778726
deviation-center-line_max	1.5200592903810726
deviation-center-line_mean	0.9234183234449912
deviation-center-line_min	0.28265732013386635
deviation-heading_max	8.488415384770875
deviation-heading_mean	7.083018992579007
deviation-heading_median	7.089126128887597
deviation-heading_min	5.694184625828925
driven_any_max	4.378320939674843
driven_any_mean	4.378320939674839
driven_any_median	4.378320939674839
driven_any_min	4.378320939674832
driven_lanedir_consec_max	-1.2731239579032123
driven_lanedir_consec_mean	-1.331671690718409
driven_lanedir_consec_min	-1.3673592918445536
driven_lanedir_max	-1.366645308459499
driven_lanedir_mean	-2.07783178706321
driven_lanedir_median	-2.2611460594308452
driven_lanedir_min	-2.711272030505655
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.630000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"udem1-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.22403071641922, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272030505655, "sim_render-ego": 0.06472851991653443, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.1797993540763855, "deviation-heading": 8.371542541054898, "set_robot_commands": 0.1014937424659729, "deviation-center-line": 1.5194332899756515, "driven_lanedir_consec": -1.3111160891625455, "sim_compute_sim_state": 0.04110947688420614, "sim_compute_performance-ego": 0.07246825853983561, "sim_compute_robot_state-ego": 0.07838472207387288, "sim_compute_robot_state-npc0": 0.07410438219706217, "sim_compute_robot_state-npc1": 0.07349639813105266, "sim_compute_robot_state-npc2": 0.0728090484937032, "sim_compute_robot_state-npc3": 0.07221918344497681}, "udem1-1-0": {"driven_any": 4.378320939674842, "sim_physics": 0.20379688501358031, "survival_time": 14.950000000000076, "driven_lanedir": -2.682736245075499, "sim_render-ego": 0.06100676933924357, "in-drivable-lane": 2.2000000000000113, "agent_compute-ego": 0.16792758623758952, "deviation-heading": 8.488415384770875, "set_robot_commands": 0.09276975631713869, "deviation-center-line": 1.5200592903810726, "driven_lanedir_consec": -1.2731239579032123, "sim_compute_sim_state": 0.03756741444269816, "sim_compute_performance-ego": 0.06624902327855428, "sim_compute_robot_state-ego": 0.0710274076461792, "sim_compute_robot_state-npc0": 0.06783333539962769, "sim_compute_robot_state-npc1": 0.06765778462092081, "sim_compute_robot_state-npc2": 0.06633307298024495, "sim_compute_robot_state-npc3": 0.0676662532488505}, "udem1-2-0": {"driven_any": 4.378320939674832, "sim_physics": 0.15865564584732056, "survival_time": 14.950000000000076, "driven_lanedir": -1.366645308459499, "sim_render-ego": 0.0491823681195577, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.13208555301030478, "deviation-heading": 5.771826282352732, "set_robot_commands": 0.07430078188578287, "deviation-center-line": 0.2928510760964476, "driven_lanedir_consec": -1.366645308459499, "sim_compute_sim_state": 0.03123964707056681, "sim_compute_performance-ego": 0.052854139804840085, "sim_compute_robot_state-ego": 0.05608413696289063, "sim_compute_robot_state-npc0": 0.0552385409673055, "sim_compute_robot_state-npc1": 0.05486971934636434, "sim_compute_robot_state-npc2": 0.05423479159673055, "sim_compute_robot_state-npc3": 0.05455691973368327}, "udem1-3-0": {"driven_any": 4.378320939674839, "sim_physics": 0.1607561985651652, "survival_time": 14.950000000000076, "driven_lanedir": -1.3673592918445536, "sim_render-ego": 0.04931539138158163, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.13189207156499227, "deviation-heading": 5.694184625828925, "set_robot_commands": 0.07250374714533488, "deviation-center-line": 0.28265732013386635, "driven_lanedir_consec": -1.3673592918445536, "sim_compute_sim_state": 0.03121577262878418, "sim_compute_performance-ego": 0.053724360466003415, "sim_compute_robot_state-ego": 0.055701297918955485, "sim_compute_robot_state-npc0": 0.05481777270634969, "sim_compute_robot_state-npc1": 0.05411311388015747, "sim_compute_robot_state-npc2": 0.053900700410207114, "sim_compute_robot_state-npc3": 0.05467500686645508}, "udem1-4-0": {"driven_any": 4.378320939674835, "sim_physics": 0.15898443778355917, "survival_time": 14.950000000000076, "driven_lanedir": -2.2611460594308452, "sim_render-ego": 0.04801544666290283, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.13132417837778726, "deviation-heading": 7.089126128887597, "set_robot_commands": 0.07267741123835246, "deviation-center-line": 1.0020906406379184, "driven_lanedir_consec": -1.3401138062222346, "sim_compute_sim_state": 0.030467317899068196, "sim_compute_performance-ego": 0.05294678052266439, "sim_compute_robot_state-ego": 0.05536337455113729, "sim_compute_robot_state-npc0": 0.05571883678436279, "sim_compute_robot_state-npc1": 0.05392607609430949, "sim_compute_robot_state-npc2": 0.05364914735158285, "sim_compute_robot_state-npc3": 0.05428709348042806}}
set_robot_commands_max	0.1014937424659729
set_robot_commands_mean	0.08274908781051635
set_robot_commands_median	0.07430078188578287
set_robot_commands_min	0.07250374714533488
sim_compute_performance-ego_max	0.07246825853983561
sim_compute_performance-ego_mean	0.05964851252237955
sim_compute_performance-ego_median	0.053724360466003415
sim_compute_performance-ego_min	0.052854139804840085
sim_compute_robot_state-ego_max	0.07838472207387288
sim_compute_robot_state-ego_mean	0.06331218783060709
sim_compute_robot_state-ego_median	0.05608413696289063
sim_compute_robot_state-ego_min	0.05536337455113729
sim_compute_robot_state-npc0_max	0.07410438219706217
sim_compute_robot_state-npc0_mean	0.06154257361094157
sim_compute_robot_state-npc0_median	0.05571883678436279
sim_compute_robot_state-npc0_min	0.05481777270634969
sim_compute_robot_state-npc1_max	0.07349639813105266
sim_compute_robot_state-npc1_mean	0.06081261841456096
sim_compute_robot_state-npc1_median	0.05486971934636434
sim_compute_robot_state-npc1_min	0.05392607609430949
sim_compute_robot_state-npc2_max	0.0728090484937032
sim_compute_robot_state-npc2_mean	0.06018535216649373
sim_compute_robot_state-npc2_median	0.05423479159673055
sim_compute_robot_state-npc2_min	0.05364914735158285
sim_compute_robot_state-npc3_max	0.07221918344497681
sim_compute_robot_state-npc3_mean	0.06068089135487874
sim_compute_robot_state-npc3_median	0.05467500686645508
sim_compute_robot_state-npc3_min	0.05428709348042806
sim_compute_sim_state_max	0.04110947688420614
sim_compute_sim_state_mean	0.034319925785064695
sim_compute_sim_state_median	0.03123964707056681
sim_compute_sim_state_min	0.030467317899068196
sim_physics_max	0.22403071641922
sim_physics_mean	0.18124477672576905
sim_physics_median	0.1607561985651652
sim_physics_min	0.15865564584732056
sim_render-ego_max	0.06472851991653443
sim_render-ego_mean	0.05444969908396404
sim_render-ego_median	0.04931539138158163
sim_render-ego_min	0.04801544666290283
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20614

2376

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

host-error

2019-04-25 14:59:11+00:00

2019-04-25 15:00:25+00:00

0:01:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20614-278575', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20614-278575', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20614-278575', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20585

2406

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:38:17+00:00

2019-04-25 14:58:59+00:00

0:20:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06411135765516018
survival_time_median	1.5500000000000007
deviation-center-line_median	0.09736152196719658
in-drivable-lane_median	0.6000000000000004

other stats

agent_compute-ego_max	0.18671024999310892
agent_compute-ego_mean	0.18205708256357156
agent_compute-ego_median	0.18332165220509403
agent_compute-ego_min	0.17583494836633856
deviation-center-line_max	0.4089692015706666
deviation-center-line_mean	0.18454675814427177
deviation-center-line_min	0.02374884884846118
deviation-heading_max	5.920324440050042
deviation-heading_mean	2.7430002828236315
deviation-heading_median	0.6781961502519732
deviation-heading_min	0.6051357055333364
driven_any_max	1.792948981526464
driven_any_mean	0.7699480242447336
driven_any_median	0.1419710044454065
driven_any_min	0.10090244106543468
driven_lanedir_consec_max	0.5510126043856145
driven_lanedir_consec_mean	0.24405197601320344
driven_lanedir_consec_min	0.03879587240601978
driven_lanedir_max	0.5510126043856145
driven_lanedir_mean	0.24405197601320344
driven_lanedir_median	0.06411135765516018
driven_lanedir_min	0.03879587240601978
in-drivable-lane_max	7.650000000000046
in-drivable-lane_mean	3.1300000000000177
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.7112126892332629, "sim_physics": 0.2201776218414307, "survival_time": 14.950000000000076, "driven_lanedir": 0.5510126043856145, "sim_render-ego": 0.06598657608032227, "in-drivable-lane": 7.350000000000044, "agent_compute-ego": 0.18429348707199095, "deviation-heading": 5.920324440050042, "set_robot_commands": 0.10421672741572062, "deviation-center-line": 0.4089692015706666, "driven_lanedir_consec": 0.5510126043856145, "sim_compute_sim_state": 0.04104522466659546, "sim_compute_performance-ego": 0.07184536139170329, "sim_compute_robot_state-ego": 0.07764269113540649, "sim_compute_robot_state-npc0": 0.07340985059738159, "sim_compute_robot_state-npc1": 0.07404908974965413, "sim_compute_robot_state-npc2": 0.07113200664520264, "sim_compute_robot_state-npc3": 0.07225031614303588}, "udem1-1-0": {"driven_any": 1.792948981526464, "sim_physics": 0.2183773406346639, "survival_time": 14.950000000000076, "driven_lanedir": 0.509854728105267, "sim_render-ego": 0.06543149391810099, "in-drivable-lane": 7.650000000000046, "agent_compute-ego": 0.18012507518132528, "deviation-heading": 5.895826358033077, "set_robot_commands": 0.0991606044769287, "deviation-center-line": 0.30500894000032625, "driven_lanedir_consec": 0.509854728105267, "sim_compute_sim_state": 0.04108332395553589, "sim_compute_performance-ego": 0.07015074968338013, "sim_compute_robot_state-ego": 0.07570113817850749, "sim_compute_robot_state-npc0": 0.07057243426640829, "sim_compute_robot_state-npc1": 0.0698455007870992, "sim_compute_robot_state-npc2": 0.06964123725891114, "sim_compute_robot_state-npc3": 0.06933054129282633}, "udem1-2-0": {"driven_any": 0.1027050049531006, "sim_physics": 0.18985209681771015, "survival_time": 1.1000000000000003, "driven_lanedir": 0.06411135765516018, "sim_render-ego": 0.06237404996698553, "in-drivable-lane": 0, "agent_compute-ego": 0.17583494836633856, "deviation-heading": 0.6051357055333364, "set_robot_commands": 0.09814773906360973, "deviation-center-line": 0.09736152196719658, "driven_lanedir_consec": 0.06411135765516018, "sim_compute_sim_state": 0.03967030481858687, "sim_compute_performance-ego": 0.06676267493854869, "sim_compute_robot_state-ego": 0.0692388577894731, "sim_compute_robot_state-npc0": 0.07067561149597168, "sim_compute_robot_state-npc1": 0.07079001990231601, "sim_compute_robot_state-npc2": 0.07177754965695468, "sim_compute_robot_state-npc3": 0.07219722054221413}, "udem1-3-0": {"driven_any": 0.10090244106543468, "sim_physics": 0.1814858809761379, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05648531751395569, "sim_render-ego": 0.06593034578406293, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18332165220509403, "deviation-heading": 0.6155187602497312, "set_robot_commands": 0.1012842551521633, "deviation-center-line": 0.08764527833470809, "driven_lanedir_consec": 0.05648531751395569, "sim_compute_sim_state": 0.042369355326113495, "sim_compute_performance-ego": 0.06984115683514139, "sim_compute_robot_state-ego": 0.07735315613124681, "sim_compute_robot_state-npc0": 0.07213093923485797, "sim_compute_robot_state-npc1": 0.07078483830327573, "sim_compute_robot_state-npc2": 0.06822694902834685, "sim_compute_robot_state-npc3": 0.0680815655252208}, "udem1-4-0": {"driven_any": 0.1419710044454065, "sim_physics": 0.17402274377884402, "survival_time": 1.5500000000000007, "driven_lanedir": 0.03879587240601978, "sim_render-ego": 0.06264255123753701, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.18671024999310892, "deviation-heading": 0.6781961502519732, "set_robot_commands": 0.10900148268668884, "deviation-center-line": 0.02374884884846118, "driven_lanedir_consec": 0.03879587240601978, "sim_compute_sim_state": 0.04175179235396847, "sim_compute_performance-ego": 0.07151638307879048, "sim_compute_robot_state-ego": 0.07558927997466057, "sim_compute_robot_state-npc0": 0.07061942931144469, "sim_compute_robot_state-npc1": 0.07077030212648454, "sim_compute_robot_state-npc2": 0.07310455845248315, "sim_compute_robot_state-npc3": 0.07282583175166961}}
set_robot_commands_max	0.10900148268668884
set_robot_commands_mean	0.10236216175902224
set_robot_commands_median	0.1012842551521633
set_robot_commands_min	0.09814773906360973
sim_compute_performance-ego_max	0.07184536139170329
sim_compute_performance-ego_mean	0.0700232651855128
sim_compute_performance-ego_median	0.07015074968338013
sim_compute_performance-ego_min	0.06676267493854869
sim_compute_robot_state-ego_max	0.07764269113540649
sim_compute_robot_state-ego_mean	0.07510502464185889
sim_compute_robot_state-ego_median	0.07570113817850749
sim_compute_robot_state-ego_min	0.0692388577894731
sim_compute_robot_state-npc0_max	0.07340985059738159
sim_compute_robot_state-npc0_mean	0.07148165298121285
sim_compute_robot_state-npc0_median	0.07067561149597168
sim_compute_robot_state-npc0_min	0.07057243426640829
sim_compute_robot_state-npc1_max	0.07404908974965413
sim_compute_robot_state-npc1_mean	0.07124795017376592
sim_compute_robot_state-npc1_median	0.07078483830327573
sim_compute_robot_state-npc1_min	0.0698455007870992
sim_compute_robot_state-npc2_max	0.07310455845248315
sim_compute_robot_state-npc2_mean	0.07077646020837969
sim_compute_robot_state-npc2_median	0.07113200664520264
sim_compute_robot_state-npc2_min	0.06822694902834685
sim_compute_robot_state-npc3_max	0.07282583175166961
sim_compute_robot_state-npc3_mean	0.07093709505099335
sim_compute_robot_state-npc3_median	0.07219722054221413
sim_compute_robot_state-npc3_min	0.0680815655252208
sim_compute_sim_state_max	0.042369355326113495
sim_compute_sim_state_mean	0.04118400022416003
sim_compute_sim_state_median	0.04108332395553589
sim_compute_sim_state_min	0.03967030481858687
sim_physics_max	0.2201776218414307
sim_physics_mean	0.19678313680975737
sim_physics_median	0.18985209681771015
sim_physics_min	0.17402274377884402
sim_render-ego_max	0.06598657608032227
sim_render-ego_mean	0.06447300339740174
sim_render-ego_median	0.06543149391810099
sim_render-ego_min	0.06237404996698553
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.740000000000032
survival_time_min	1.1000000000000003

No reset possible

20556

2447

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:12:01+00:00

2019-04-25 14:37:28+00:00

0:25:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3397390356601346
survival_time_median	14.950000000000076
deviation-center-line_median	1.401141803909748
in-drivable-lane_median	2.500000000000013

other stats

agent_compute-ego_max	0.17872465054194134
agent_compute-ego_mean	0.17594698572158812
agent_compute-ego_median	0.17681152502695718
agent_compute-ego_min	0.17167923847834268
deviation-center-line_max	1.5194332589791988
deviation-center-line_mean	1.1743762518416452
deviation-center-line_min	0.26891847472491964
deviation-heading_max	8.492476633385415
deviation-heading_mean	7.583649780851511
deviation-heading_median	8.165190079878816
deviation-heading_min	5.589657549909816
driven_any_max	4.378320939674851
driven_any_mean	4.378320939674839
driven_any_median	4.3783209396748415
driven_any_min	4.378320939674831
driven_lanedir_consec_max	-1.3111163275808764
driven_lanedir_consec_mean	-1.342604284062788
driven_lanedir_consec_min	-1.3761077892801137
driven_lanedir_max	-1.3397390356601346
driven_lanedir_mean	-2.354812195437246
driven_lanedir_median	-2.597977359892488
driven_lanedir_min	-2.711272268924253
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	3.570000000000019
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.12382895469665528, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272268924253, "sim_render-ego": 0.06301186720530193, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17167923847834268, "deviation-heading": 8.371542541054902, "set_robot_commands": 0.09765432437260946, "deviation-center-line": 1.5194332589791988, "driven_lanedir_consec": -1.3111163275808764, "sim_compute_sim_state": 0.03987095276514689, "sim_compute_performance-ego": 0.069855371316274, "sim_compute_robot_state-ego": 0.0744441803296407}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378320939674851, "sim_physics": 0.14237064599990845, "survival_time": 14.950000000000076, "driven_lanedir": -2.448035866142366, "sim_render-ego": 0.06508981307347615, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.17872465054194134, "deviation-heading": 7.299382100028609, "set_robot_commands": 0.09828083117802938, "deviation-center-line": 1.1659435662933817, "driven_lanedir_consec": -1.3761077892801137, "sim_compute_sim_state": 0.04044453541437785, "sim_compute_performance-ego": 0.07225424687067668, "sim_compute_robot_state-ego": 0.08228212038675944}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.3783209396748415, "sim_physics": 0.13426026105880737, "survival_time": 14.950000000000076, "driven_lanedir": -1.3397390356601346, "sim_render-ego": 0.06264137824376424, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.17410045941670735, "deviation-heading": 5.589657549909816, "set_robot_commands": 0.09914289792378744, "deviation-center-line": 0.26891847472491964, "driven_lanedir_consec": -1.3397390356601346, "sim_compute_sim_state": 0.04012993097305298, "sim_compute_performance-ego": 0.06995485782623291, "sim_compute_robot_state-ego": 0.07800721327463786}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378320939674831, "sim_physics": 0.13289080222447713, "survival_time": 14.950000000000076, "driven_lanedir": -2.677036446566989, "sim_render-ego": 0.06476713180541992, "in-drivable-lane": 2.2000000000000117, "agent_compute-ego": 0.17681152502695718, "deviation-heading": 8.492476633385415, "set_robot_commands": 0.09934173901875812, "deviation-center-line": 1.5164441553009778, "driven_lanedir_consec": -1.3182655771745324, "sim_compute_sim_state": 0.03991084496180217, "sim_compute_performance-ego": 0.0739937694867452, "sim_compute_robot_state-ego": 0.07803952137629191}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378320939674831, "sim_physics": 0.13701330184936522, "survival_time": 14.950000000000076, "driven_lanedir": -2.597977359892488, "sim_render-ego": 0.06450748523076376, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.17841905514399212, "deviation-heading": 8.165190079878816, "set_robot_commands": 0.10123149871826172, "deviation-center-line": 1.401141803909748, "driven_lanedir_consec": -1.367792690618283, "sim_compute_sim_state": 0.04097437699635824, "sim_compute_performance-ego": 0.07191862185796102, "sim_compute_robot_state-ego": 0.07847327947616577}}
set_robot_commands_max	0.10123149871826172
set_robot_commands_mean	0.09913025824228924
set_robot_commands_median	0.09914289792378744
set_robot_commands_min	0.09765432437260946
sim_compute_performance-ego_max	0.0739937694867452
sim_compute_performance-ego_mean	0.07159537347157796
sim_compute_performance-ego_median	0.07191862185796102
sim_compute_performance-ego_min	0.069855371316274
sim_compute_robot_state-ego_max	0.08228212038675944
sim_compute_robot_state-ego_mean	0.07824926296869913
sim_compute_robot_state-ego_median	0.07803952137629191
sim_compute_robot_state-ego_min	0.0744441803296407
sim_compute_sim_state_max	0.04097437699635824
sim_compute_sim_state_mean	0.040266128222147625
sim_compute_sim_state_median	0.04012993097305298
sim_compute_sim_state_min	0.03987095276514689
sim_physics_max	0.14237064599990845
sim_physics_mean	0.1340727931658427
sim_physics_median	0.13426026105880737
sim_physics_min	0.12382895469665528
sim_render-ego_max	0.06508981307347615
sim_render-ego_mean	0.0640035351117452
sim_render-ego_median	0.06450748523076376
sim_render-ego_min	0.06264137824376424
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20528

2500

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 14:01:28+00:00

2019-04-25 14:11:47+00:00

0:10:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08176419621234876
survival_time_median	1.7000000000000008
deviation-center-line_median	0.10915532474961943
in-drivable-lane_median	0.7000000000000006

other stats

agent_compute-ego_max	0.17987164025454178
agent_compute-ego_mean	0.164620234958301
agent_compute-ego_median	0.17058552765264745
agent_compute-ego_min	0.12704467072206385
deviation-center-line_max	0.11641124769068124
deviation-center-line_mean	0.08523906812103088
deviation-center-line_min	0.024801022546783208
deviation-heading_max	2.137043253940666
deviation-heading_mean	0.9671002417684984
deviation-heading_median	0.682862593621718
deviation-heading_min	0.6332834004430332
driven_any_max	0.522198373717471
driven_any_mean	0.2280348301915743
driven_any_median	0.14676583412314098
driven_any_min	0.11699219221259465
driven_lanedir_consec_max	0.20334201381566075
driven_lanedir_consec_mean	0.10019577932867949
driven_lanedir_consec_min	0.03987048436486251
driven_lanedir_max	0.20334201381566075
driven_lanedir_mean	0.10019577932867949
driven_lanedir_median	0.08176419621234876
driven_lanedir_min	0.03987048436486251
in-drivable-lane_max	2.0499999999999963
in-drivable-lane_mean	0.7299999999999994
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2210591644391892, "sim_physics": 0.1784987391495123, "survival_time": 2.0500000000000007, "driven_lanedir": 0.06406317452323029, "sim_render-ego": 0.06222757479039634, "in-drivable-lane": 0.9000000000000004, "agent_compute-ego": 0.17058552765264745, "deviation-heading": 0.682862593621718, "set_robot_commands": 0.09647838080801614, "deviation-center-line": 0.06010908516906496, "driven_lanedir_consec": 0.06406317452323029, "sim_compute_sim_state": 0.03885388374328613, "sim_compute_performance-ego": 0.06794848674681128, "sim_compute_robot_state-ego": 0.07306083237252585, "sim_compute_robot_state-npc0": 0.07215682471670755, "sim_compute_robot_state-npc1": 0.07103258807484697, "sim_compute_robot_state-npc2": 0.07238200815712534, "sim_compute_robot_state-npc3": 0.06899108537813513}, "udem1-1-0": {"driven_any": 0.522198373717471, "sim_physics": 0.2003865389479804, "survival_time": 4.849999999999991, "driven_lanedir": 0.20334201381566075, "sim_render-ego": 0.06442974277378358, "in-drivable-lane": 2.0499999999999963, "agent_compute-ego": 0.17987164025454178, "deviation-heading": 2.137043253940666, "set_robot_commands": 0.10062863654697064, "deviation-center-line": 0.10915532474961943, "driven_lanedir_consec": 0.20334201381566075, "sim_compute_sim_state": 0.04000893327378735, "sim_compute_performance-ego": 0.07248338473211859, "sim_compute_robot_state-ego": 0.07676675639201685, "sim_compute_robot_state-npc0": 0.0712049326945826, "sim_compute_robot_state-npc1": 0.07091858460731112, "sim_compute_robot_state-npc2": 0.06958560353701877, "sim_compute_robot_state-npc3": 0.07148375462010964}, "udem1-2-0": {"driven_any": 0.11699219221259465, "sim_physics": 0.20857708270733172, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08176419621234876, "sim_render-ego": 0.06317008458651029, "in-drivable-lane": 0, "agent_compute-ego": 0.1757646340590257, "deviation-heading": 0.6730545166425065, "set_robot_commands": 0.09613208587353046, "deviation-center-line": 0.11641124769068124, "driven_lanedir_consec": 0.08176419621234876, "sim_compute_sim_state": 0.03694868087768555, "sim_compute_performance-ego": 0.06867925020364615, "sim_compute_robot_state-ego": 0.0716703671675462, "sim_compute_robot_state-npc0": 0.0751645748431866, "sim_compute_robot_state-npc1": 0.07157133175776555, "sim_compute_robot_state-npc2": 0.06464923345125638, "sim_compute_robot_state-npc3": 0.06642789107102615}, "udem1-3-0": {"driven_any": 0.14676583412314098, "sim_physics": 0.17765904355932166, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11193902772729514, "sim_render-ego": 0.06633545734264233, "in-drivable-lane": 0, "agent_compute-ego": 0.16983470210322626, "deviation-heading": 0.6332834004430332, "set_robot_commands": 0.10259363386366102, "deviation-center-line": 0.11571866044900551, "driven_lanedir_consec": 0.11193902772729514, "sim_compute_sim_state": 0.03668765668515806, "sim_compute_performance-ego": 0.06852105811790184, "sim_compute_robot_state-ego": 0.07144435246785481, "sim_compute_robot_state-npc0": 0.06709822901973019, "sim_compute_robot_state-npc1": 0.06631434405291523, "sim_compute_robot_state-npc2": 0.06603059062251339, "sim_compute_robot_state-npc3": 0.06634872047989457}, "udem1-4-0": {"driven_any": 0.13315858646547585, "sim_physics": 0.12611760111416087, "survival_time": 1.7000000000000008, "driven_lanedir": 0.03987048436486251, "sim_render-ego": 0.04627307723550235, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.12704467072206385, "deviation-heading": 0.7092574441945673, "set_robot_commands": 0.07424799834980685, "deviation-center-line": 0.024801022546783208, "driven_lanedir_consec": 0.03987048436486251, "sim_compute_sim_state": 0.030211729161879596, "sim_compute_performance-ego": 0.051014318185694074, "sim_compute_robot_state-ego": 0.05564452620113597, "sim_compute_robot_state-npc0": 0.05388540380141314, "sim_compute_robot_state-npc1": 0.05315298893872429, "sim_compute_robot_state-npc2": 0.05261071990518009, "sim_compute_robot_state-npc3": 0.05061666404499727}}
set_robot_commands_max	0.10259363386366102
set_robot_commands_mean	0.09401614708839702
set_robot_commands_median	0.09647838080801614
set_robot_commands_min	0.07424799834980685
sim_compute_performance-ego_max	0.07248338473211859
sim_compute_performance-ego_mean	0.06572929959723439
sim_compute_performance-ego_median	0.06852105811790184
sim_compute_performance-ego_min	0.051014318185694074
sim_compute_robot_state-ego_max	0.07676675639201685
sim_compute_robot_state-ego_mean	0.06971736692021593
sim_compute_robot_state-ego_median	0.0716703671675462
sim_compute_robot_state-ego_min	0.05564452620113597
sim_compute_robot_state-npc0_max	0.0751645748431866
sim_compute_robot_state-npc0_mean	0.06790199301512402
sim_compute_robot_state-npc0_median	0.0712049326945826
sim_compute_robot_state-npc0_min	0.05388540380141314
sim_compute_robot_state-npc1_max	0.07157133175776555
sim_compute_robot_state-npc1_mean	0.06659796748631262
sim_compute_robot_state-npc1_median	0.07091858460731112
sim_compute_robot_state-npc1_min	0.05315298893872429
sim_compute_robot_state-npc2_max	0.07238200815712534
sim_compute_robot_state-npc2_mean	0.06505163113461879
sim_compute_robot_state-npc2_median	0.06603059062251339
sim_compute_robot_state-npc2_min	0.05261071990518009
sim_compute_robot_state-npc3_max	0.07148375462010964
sim_compute_robot_state-npc3_mean	0.06477362311883256
sim_compute_robot_state-npc3_median	0.06642789107102615
sim_compute_robot_state-npc3_min	0.05061666404499727
sim_compute_sim_state_max	0.04000893327378735
sim_compute_sim_state_mean	0.036542176748359335
sim_compute_sim_state_median	0.03694868087768555
sim_compute_sim_state_min	0.030211729161879596
sim_physics_max	0.20857708270733172
sim_physics_mean	0.1782478010956614
sim_physics_median	0.1784987391495123
sim_physics_min	0.12611760111416087
sim_render-ego_max	0.06633545734264233
sim_render-ego_mean	0.06048718734576698
sim_render-ego_median	0.06317008458651029
sim_render-ego_min	0.04627307723550235
simulation-passed	1
survival_time_max	4.849999999999991
survival_time_mean	2.249999999999999
survival_time_min	1.3000000000000005

No reset possible

20514

2506

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:00:11+00:00

2019-04-25 14:01:14+00:00

0:01:03

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20502

2521

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 13:58:35+00:00

2019-04-25 14:00:04+00:00

0:01:29

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20502-5476', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20502-5476', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20502-5476', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20493

2537

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-25 13:54:38+00:00

2019-04-25 13:58:01+00:00

0:03:23

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20489

2541

test for ppo

step1-simulation

error

2019-04-25 13:52:02+00:00

2019-04-25 13:54:24+00:00

0:02:22

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20480

2561

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:43:24+00:00

2019-04-25 13:51:34+00:00

0:08:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.07763515002485635
agent_compute-ego_mean	0.07336440151182025
agent_compute-ego_median	0.07278886133310747
agent_compute-ego_min	0.06850433349609375
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.09883151870024832, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.06445872783660889, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.07532301388288799, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.10307035006974873, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.041819126982437935, "sim_compute_performance-ego": 0.0709624541433234, "sim_compute_robot_state-ego": 0.07637823255438554}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.11134128985197649, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.06724062864331232, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07763515002485635, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.10947839073512863, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.0417279575182044, "sim_compute_performance-ego": 0.07858471248460852, "sim_compute_robot_state-ego": 0.08752106929170912}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.09045529365539552, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.06006317788904363, "in-drivable-lane": 0, "agent_compute-ego": 0.06850433349609375, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.10209500789642334, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.03738965771415017, "sim_compute_performance-ego": 0.06820217045870694, "sim_compute_robot_state-ego": 0.07257180864160712}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.09767584486322088, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.06263892467205341, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07257064882215562, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.1001637401161613, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.03838182543660258, "sim_compute_performance-ego": 0.07279152136582595, "sim_compute_robot_state-ego": 0.07814950733394413}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.10277345715736856, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.06330259722106311, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.07278886133310747, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.0997249885481231, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.03966542166106555, "sim_compute_performance-ego": 0.06936075979349565, "sim_compute_robot_state-ego": 0.07531397683279854}}
set_robot_commands_max	0.10947839073512863
set_robot_commands_mean	0.10290649547311705
set_robot_commands_median	0.10209500789642334
set_robot_commands_min	0.0997249885481231
sim_compute_performance-ego_max	0.07858471248460852
sim_compute_performance-ego_mean	0.07198032364919209
sim_compute_performance-ego_median	0.0709624541433234
sim_compute_performance-ego_min	0.06820217045870694
sim_compute_robot_state-ego_max	0.08752106929170912
sim_compute_robot_state-ego_mean	0.0779869189308889
sim_compute_robot_state-ego_median	0.07637823255438554
sim_compute_robot_state-ego_min	0.07257180864160712
sim_compute_sim_state_max	0.041819126982437935
sim_compute_sim_state_mean	0.03979679786249212
sim_compute_sim_state_median	0.03966542166106555
sim_compute_sim_state_min	0.03738965771415017
sim_physics_max	0.11134128985197649
sim_physics_mean	0.10021548084564194
sim_physics_median	0.09883151870024832
sim_physics_min	0.09045529365539552
sim_render-ego_max	0.06724062864331232
sim_render-ego_mean	0.06354081125241627
sim_render-ego_median	0.06330259722106311
sim_render-ego_min	0.06006317788904363
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20460

2590

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 13:28:11+00:00

2019-04-25 13:43:17+00:00

0:15:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.26088513363478816
survival_time_median	5.549999999999988
deviation-center-line_median	0.3561745053885247
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.25899887786192055
agent_compute-ego_mean	0.2503790531855025
agent_compute-ego_median	0.25450149263654437
agent_compute-ego_min	0.2336866855621338
deviation-center-line_max	0.4905794853837811
deviation-center-line_mean	0.3760424243718319
deviation-center-line_min	0.23570296420357015
deviation-heading_max	2.964136918073061
deviation-heading_mean	2.1301198895897615
deviation-heading_median	2.022106171954113
deviation-heading_min	1.3608775900276913
driven_any_max	0.32003902583431515
driven_any_mean	0.2856335648247731
driven_any_median	0.3103831817228642
driven_any_min	0.18853913659284172
driven_lanedir_consec_max	0.29181525359615357
driven_lanedir_consec_mean	0.24393492972503675
driven_lanedir_consec_min	0.1480919233038177
driven_lanedir_max	0.29181525359615357
driven_lanedir_mean	0.24393492972503675
driven_lanedir_median	0.26088513363478816
driven_lanedir_min	0.1480919233038177
in-drivable-lane_max	0.14999999999999947
in-drivable-lane_mean	0.04999999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3103831817228642, "sim_physics": 0.15159226482750005, "survival_time": 5.849999999999987, "driven_lanedir": 0.24951730485097112, "sim_render-ego": 0.06295603768438356, "in-drivable-lane": 0, "agent_compute-ego": 0.2336866855621338, "deviation-heading": 2.964136918073061, "set_robot_commands": 0.0945486696357401, "deviation-center-line": 0.3540204173904656, "driven_lanedir_consec": 0.24951730485097112, "sim_compute_sim_state": 0.037135450249044306, "sim_compute_performance-ego": 0.06802475554311377, "sim_compute_robot_state-ego": 0.07435332608019185, "sim_compute_robot_state-npc0": 0.06753410233391656, "sim_compute_robot_state-npc1": 0.07001742746076013, "sim_compute_robot_state-npc2": 0.06882476806640625, "sim_compute_robot_state-npc3": 0.06803108891870221}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3131330351686867, "sim_physics": 0.1651984335065962, "survival_time": 5.549999999999988, "driven_lanedir": 0.26088513363478816, "sim_render-ego": 0.06488696089735976, "in-drivable-lane": 0, "agent_compute-ego": 0.24636995470201647, "deviation-heading": 2.906554555973049, "set_robot_commands": 0.10162831426740766, "deviation-center-line": 0.3561745053885247, "driven_lanedir_consec": 0.26088513363478816, "sim_compute_sim_state": 0.04111173775818971, "sim_compute_performance-ego": 0.07192605894965094, "sim_compute_robot_state-ego": 0.07731838484068175, "sim_compute_robot_state-npc0": 0.07133181460268863, "sim_compute_robot_state-npc1": 0.07423348254985637, "sim_compute_robot_state-npc2": 0.0759792929297095, "sim_compute_robot_state-npc3": 0.07196622066669636}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.32003902583431515, "sim_physics": 0.17600806624488494, "survival_time": 5.649999999999988, "driven_lanedir": 0.29181525359615357, "sim_render-ego": 0.06536233108655541, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.25833825516489756, "deviation-heading": 1.3608775900276913, "set_robot_commands": 0.1069402525910234, "deviation-center-line": 0.4905794853837811, "driven_lanedir_consec": 0.29181525359615357, "sim_compute_sim_state": 0.04199553801950101, "sim_compute_performance-ego": 0.07262437533488315, "sim_compute_robot_state-ego": 0.08117845628113873, "sim_compute_robot_state-npc0": 0.07426294816278778, "sim_compute_robot_state-npc1": 0.0715626552041653, "sim_compute_robot_state-npc2": 0.07215680485278105, "sim_compute_robot_state-npc3": 0.07626546378684256}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.29607344480515796, "sim_physics": 0.16987874167306083, "survival_time": 5.249999999999989, "driven_lanedir": 0.26936503323945304, "sim_render-ego": 0.06631964501880463, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.25450149263654437, "deviation-heading": 1.3969242119208924, "set_robot_commands": 0.10368839445568266, "deviation-center-line": 0.44373474949281794, "driven_lanedir_consec": 0.26936503323945304, "sim_compute_sim_state": 0.04185843921843029, "sim_compute_performance-ego": 0.0711383478982108, "sim_compute_robot_state-ego": 0.07752697127205985, "sim_compute_robot_state-npc0": 0.07323331832885742, "sim_compute_robot_state-npc1": 0.07604943230038598, "sim_compute_robot_state-npc2": 0.07299615542093912, "sim_compute_robot_state-npc3": 0.07460891632806688}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18853913659284172, "sim_physics": 0.1486498012262232, "survival_time": 3.399999999999996, "driven_lanedir": 0.1480919233038177, "sim_render-ego": 0.0674942696795744, "in-drivable-lane": 0, "agent_compute-ego": 0.25899887786192055, "deviation-heading": 2.022106171954113, "set_robot_commands": 0.10556050959755392, "deviation-center-line": 0.23570296420357015, "driven_lanedir_consec": 0.1480919233038177, "sim_compute_sim_state": 0.04308624477947459, "sim_compute_performance-ego": 0.07316408788456637, "sim_compute_robot_state-ego": 0.07930174995871152, "sim_compute_robot_state-npc0": 0.07568788528442383, "sim_compute_robot_state-npc1": 0.0726880290929009, "sim_compute_robot_state-npc2": 0.07302707083085004, "sim_compute_robot_state-npc3": 0.07330002504236557}}
set_robot_commands_max	0.1069402525910234
set_robot_commands_mean	0.10247322810948156
set_robot_commands_median	0.10368839445568266
set_robot_commands_min	0.0945486696357401
sim_compute_performance-ego_max	0.07316408788456637
sim_compute_performance-ego_mean	0.07137552512208499
sim_compute_performance-ego_median	0.07192605894965094
sim_compute_performance-ego_min	0.06802475554311377
sim_compute_robot_state-ego_max	0.08117845628113873
sim_compute_robot_state-ego_mean	0.07793577768655675
sim_compute_robot_state-ego_median	0.07752697127205985
sim_compute_robot_state-ego_min	0.07435332608019185
sim_compute_robot_state-npc0_max	0.07568788528442383
sim_compute_robot_state-npc0_mean	0.07241001374253483
sim_compute_robot_state-npc0_median	0.07323331832885742
sim_compute_robot_state-npc0_min	0.06753410233391656
sim_compute_robot_state-npc1_max	0.07604943230038598
sim_compute_robot_state-npc1_mean	0.07291020532161374
sim_compute_robot_state-npc1_median	0.0726880290929009
sim_compute_robot_state-npc1_min	0.07001742746076013
sim_compute_robot_state-npc2_max	0.0759792929297095
sim_compute_robot_state-npc2_mean	0.07259681842013718
sim_compute_robot_state-npc2_median	0.07299615542093912
sim_compute_robot_state-npc2_min	0.06882476806640625
sim_compute_robot_state-npc3_max	0.07626546378684256
sim_compute_robot_state-npc3_mean	0.07283434294853472
sim_compute_robot_state-npc3_median	0.07330002504236557
sim_compute_robot_state-npc3_min	0.06803108891870221
sim_compute_sim_state_max	0.04308624477947459
sim_compute_sim_state_mean	0.04103748200492798
sim_compute_sim_state_median	0.04185843921843029
sim_compute_sim_state_min	0.037135450249044306
sim_physics_max	0.17600806624488494
sim_physics_mean	0.16226546149565305
sim_physics_median	0.1651984335065962
sim_physics_min	0.1486498012262232
sim_render-ego_max	0.0674942696795744
sim_render-ego_mean	0.06540384887333554
sim_render-ego_median	0.06536233108655541
sim_render-ego_min	0.06295603768438356
simulation-passed	1
survival_time_max	5.849999999999987
survival_time_mean	5.139999999999989
survival_time_min	3.399999999999996

No reset possible

20452

2604

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:21:26+00:00

2019-04-25 13:27:41+00:00

0:06:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.07376105444771903
agent_compute-ego_mean	0.06584813018196789
agent_compute-ego_median	0.07004778627036275
agent_compute-ego_min	0.05571083589033647
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.07514123226466932, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.04806429461428994, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.05623974298176013, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.0784338116645813, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.03420609863180863, "sim_compute_performance-ego": 0.05572431338460822, "sim_compute_robot_state-ego": 0.05942519401249133}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.09635976086492123, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.05964229072349659, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07004778627036275, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.09544698051784348, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.0382656947426174, "sim_compute_performance-ego": 0.06565668271935504, "sim_compute_robot_state-ego": 0.07206906443056853}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.06505550037730824, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.04560387134552002, "in-drivable-lane": 0, "agent_compute-ego": 0.05571083589033647, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.07248465581373735, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.030700412663546475, "sim_compute_performance-ego": 0.05308002775365656, "sim_compute_robot_state-ego": 0.05554680390791459}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.09642920651278652, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.059209359871162166, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.07376105444771903, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.09519709335578667, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.03786295062893039, "sim_compute_performance-ego": 0.06795057621630994, "sim_compute_robot_state-ego": 0.07015222769517165}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.11609111270126032, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.06139676181637511, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.07348123131966104, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.10017056611119483, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.04025921772937385, "sim_compute_performance-ego": 0.0757485141559523, "sim_compute_robot_state-ego": 0.07602230140141078}}
set_robot_commands_max	0.10017056611119483
set_robot_commands_mean	0.08834662149262874
set_robot_commands_median	0.09519709335578667
set_robot_commands_min	0.07248465581373735
sim_compute_performance-ego_max	0.0757485141559523
sim_compute_performance-ego_mean	0.06363202284597641
sim_compute_performance-ego_median	0.06565668271935504
sim_compute_performance-ego_min	0.05308002775365656
sim_compute_robot_state-ego_max	0.07602230140141078
sim_compute_robot_state-ego_mean	0.06664311828951137
sim_compute_robot_state-ego_median	0.07015222769517165
sim_compute_robot_state-ego_min	0.05554680390791459
sim_compute_sim_state_max	0.04025921772937385
sim_compute_sim_state_mean	0.036258874879255346
sim_compute_sim_state_median	0.03786295062893039
sim_compute_sim_state_min	0.030700412663546475
sim_physics_max	0.11609111270126032
sim_physics_mean	0.08981536254418912
sim_physics_median	0.09635976086492123
sim_physics_min	0.06505550037730824
sim_render-ego_max	0.06139676181637511
sim_render-ego_mean	0.05478331567416876
sim_render-ego_median	0.059209359871162166
sim_render-ego_min	0.04560387134552002
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20431

2656

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 13:00:20+00:00

2019-04-25 13:21:18+00:00

0:20:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7397823570764444
survival_time_median	8.09999999999998
deviation-center-line_median	0.41799270007985806
in-drivable-lane_median	0.4500000000000064

other stats

agent_compute-ego_max	0.09283982824396204
agent_compute-ego_mean	0.08989450704442678
agent_compute-ego_median	0.08960068418133643
agent_compute-ego_min	0.08756456953106505
deviation-center-line_max	0.4841220879236416
deviation-center-line_mean	0.3769610020202509
deviation-center-line_min	0.154379631589892
deviation-heading_max	3.5205428848084814
deviation-heading_mean	2.6544447164245653
deviation-heading_median	3.2369725409072174
deviation-heading_min	0.361172346051457
driven_any_max	1.4729445818803413
driven_any_mean	1.0600091170645398
driven_any_median	1.2325514515516265
driven_any_min	0.2114273025698404
driven_lanedir_consec_max	1.272793406531726
driven_lanedir_consec_mean	0.7228359954187997
driven_lanedir_consec_min	0.2024935719987715
driven_lanedir_max	1.272793406531726
driven_lanedir_mean	0.7228359954187997
driven_lanedir_median	0.7397823570764444
driven_lanedir_min	0.2024935719987715
in-drivable-lane_max	3.799999999999996
in-drivable-lane_mean	1.1799999999999995
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2325514515516265, "sim_physics": 0.22220447328355575, "survival_time": 8.09999999999998, "driven_lanedir": 0.7397823570764444, "sim_render-ego": 0.07391621595547523, "in-drivable-lane": 1.649999999999995, "agent_compute-ego": 0.09283982824396204, "deviation-heading": 3.5205428848084814, "set_robot_commands": 0.11492526236875558, "deviation-center-line": 0.41799270007985806, "driven_lanedir_consec": 0.7397823570764444, "sim_compute_sim_state": 0.04564890007913849, "sim_compute_performance-ego": 0.08268138508737823, "sim_compute_robot_state-ego": 0.0922409134146608, "sim_compute_robot_state-npc0": 0.08096005298473218, "sim_compute_robot_state-npc1": 0.0815593269136217, "sim_compute_robot_state-npc2": 0.08134333734159116, "sim_compute_robot_state-npc3": 0.081771245709172}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4729445818803413, "sim_physics": 0.2314050185052972, "survival_time": 9.5, "driven_lanedir": 1.272793406531726, "sim_render-ego": 0.07328413536674099, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.09024920338078549, "deviation-heading": 3.2369725409072174, "set_robot_commands": 0.11544641444557592, "deviation-center-line": 0.4841220879236416, "driven_lanedir_consec": 1.272793406531726, "sim_compute_sim_state": 0.04377157186207018, "sim_compute_performance-ego": 0.08636606617977745, "sim_compute_robot_state-ego": 0.08978991508483887, "sim_compute_robot_state-npc0": 0.0783004923870689, "sim_compute_robot_state-npc1": 0.07969473286678916, "sim_compute_robot_state-npc2": 0.0797072034133108, "sim_compute_robot_state-npc3": 0.07906194988049958}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2114273025698404, "sim_physics": 0.2006035429058653, "survival_time": 1.6500000000000008, "driven_lanedir": 0.2024935719987715, "sim_render-ego": 0.06177201415553237, "in-drivable-lane": 0, "agent_compute-ego": 0.08756456953106505, "deviation-heading": 0.361172346051457, "set_robot_commands": 0.102823662035393, "deviation-center-line": 0.154379631589892, "driven_lanedir_consec": 0.2024935719987715, "sim_compute_sim_state": 0.0390221711361047, "sim_compute_performance-ego": 0.07151129751494437, "sim_compute_robot_state-ego": 0.07845574436765729, "sim_compute_robot_state-npc0": 0.07528847636598529, "sim_compute_robot_state-npc1": 0.07233415950428355, "sim_compute_robot_state-npc2": 0.07493881023291385, "sim_compute_robot_state-npc3": 0.07839776530410304}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.440539562187055, "sim_physics": 0.2224463608957106, "survival_time": 9.299999999999995, "driven_lanedir": 0.6181699220411669, "sim_render-ego": 0.07273097961179671, "in-drivable-lane": 3.799999999999996, "agent_compute-ego": 0.08921824988498482, "deviation-heading": 3.240724083197988, "set_robot_commands": 0.11620673056571716, "deviation-center-line": 0.3928554724101284, "driven_lanedir_consec": 0.6181699220411669, "sim_compute_sim_state": 0.04476086554988738, "sim_compute_performance-ego": 0.08191101269055438, "sim_compute_robot_state-ego": 0.09030297751067788, "sim_compute_robot_state-npc0": 0.08023747321098082, "sim_compute_robot_state-npc1": 0.07999793944820281, "sim_compute_robot_state-npc2": 0.08175416787465413, "sim_compute_robot_state-npc3": 0.08071986962390203}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9425826871338364, "sim_physics": 0.1990439026586471, "survival_time": 6.199999999999986, "driven_lanedir": 0.7809407194458895, "sim_render-ego": 0.07169916937428136, "in-drivable-lane": 0, "agent_compute-ego": 0.08960068418133643, "deviation-heading": 2.912811727157682, "set_robot_commands": 0.11893236829388526, "deviation-center-line": 0.4354551180977342, "driven_lanedir_consec": 0.7809407194458895, "sim_compute_sim_state": 0.04603015030584027, "sim_compute_performance-ego": 0.08022645019715832, "sim_compute_robot_state-ego": 0.08881517571787681, "sim_compute_robot_state-npc0": 0.07864627145951794, "sim_compute_robot_state-npc1": 0.07940783616035216, "sim_compute_robot_state-npc2": 0.07991586962053852, "sim_compute_robot_state-npc3": 0.08159442294028497}}
set_robot_commands_max	0.11893236829388526
set_robot_commands_mean	0.11366688754186538
set_robot_commands_median	0.11544641444557592
set_robot_commands_min	0.102823662035393
sim_compute_performance-ego_max	0.08636606617977745
sim_compute_performance-ego_mean	0.08053924233396255
sim_compute_performance-ego_median	0.08191101269055438
sim_compute_performance-ego_min	0.07151129751494437
sim_compute_robot_state-ego_max	0.0922409134146608
sim_compute_robot_state-ego_mean	0.08792094521914232
sim_compute_robot_state-ego_median	0.08978991508483887
sim_compute_robot_state-ego_min	0.07845574436765729
sim_compute_robot_state-npc0_max	0.08096005298473218
sim_compute_robot_state-npc0_mean	0.07868655328165704
sim_compute_robot_state-npc0_median	0.07864627145951794
sim_compute_robot_state-npc0_min	0.07528847636598529
sim_compute_robot_state-npc1_max	0.0815593269136217
sim_compute_robot_state-npc1_mean	0.07859879897864988
sim_compute_robot_state-npc1_median	0.07969473286678916
sim_compute_robot_state-npc1_min	0.07233415950428355
sim_compute_robot_state-npc2_max	0.08175416787465413
sim_compute_robot_state-npc2_mean	0.0795318776966017
sim_compute_robot_state-npc2_median	0.07991586962053852
sim_compute_robot_state-npc2_min	0.07493881023291385
sim_compute_robot_state-npc3_max	0.081771245709172
sim_compute_robot_state-npc3_mean	0.08030905069159232
sim_compute_robot_state-npc3_median	0.08071986962390203
sim_compute_robot_state-npc3_min	0.07839776530410304
sim_compute_sim_state_max	0.04603015030584027
sim_compute_sim_state_mean	0.04384673178660821
sim_compute_sim_state_median	0.04476086554988738
sim_compute_sim_state_min	0.0390221711361047
sim_physics_max	0.2314050185052972
sim_physics_mean	0.2151406596498152
sim_physics_median	0.22220447328355575
sim_physics_min	0.1990439026586471
sim_render-ego_max	0.07391621595547523
sim_render-ego_mean	0.07068050289276533
sim_render-ego_median	0.07273097961179671
sim_render-ego_min	0.06177201415553237
simulation-passed	1
survival_time_max	9.5
survival_time_mean	6.949999999999993
survival_time_min	1.6500000000000008

No reset possible

20420

2644

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-25 12:52:07+00:00

2019-04-25 13:00:05+00:00

0:07:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20420-300852', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20420-300852', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20420-300852', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20400

2695

challenge-aido_LF-baseline-duckietown

step1-simulation

timeout

2019-04-25 12:23:25+00:00

2019-04-25 12:51:00+00:00

0:27:35

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20395

2707

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:04:02+00:00

2019-04-25 12:22:28+00:00

0:18:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3735765436876388
survival_time_median	4.099999999999993
deviation-center-line_median	0.3000010871348648
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.10673763693832768
agent_compute-ego_mean	0.10034551974667225
agent_compute-ego_median	0.10020739010402134
agent_compute-ego_min	0.09568119404920893
deviation-center-line_max	0.5048306708180472
deviation-center-line_mean	0.288037127808292
deviation-center-line_min	0.14995794171326127
deviation-heading_max	4.132275290977632
deviation-heading_mean	1.7227536647153372
deviation-heading_median	0.9494178402583634
deviation-heading_min	0.44122817888830096
driven_any_max	1.5608916325326776
driven_any_mean	0.7482586868669036
driven_any_median	0.6051888307092602
driven_any_min	0.22749881741451777
driven_lanedir_consec_max	0.5851979391324885
driven_lanedir_consec_mean	0.39546743983033206
driven_lanedir_consec_min	0.21413555287343877
driven_lanedir_max	0.7602786149280263
driven_lanedir_mean	0.43103926996088504
driven_lanedir_median	0.3735765436876388
driven_lanedir_min	0.21413555287343877
in-drivable-lane_max	3.400000000000011
in-drivable-lane_mean	1.36
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1121797351270557, "sim_physics": 0.24156442304857736, "survival_time": 7.349999999999982, "driven_lanedir": 0.3735765436876388, "sim_render-ego": 0.07458122246930389, "in-drivable-lane": 3.3999999999999893, "agent_compute-ego": 0.1007229114065365, "deviation-heading": 2.639619114557924, "set_robot_commands": 0.1329965656306468, "deviation-center-line": 0.3322470078306945, "driven_lanedir_consec": 0.3735765436876388, "sim_compute_sim_state": 0.04579567747051213, "sim_compute_performance-ego": 0.08387442186576169, "sim_compute_robot_state-ego": 0.09868024968776572, "sim_compute_robot_state-npc0": 0.08420712931626508, "sim_compute_robot_state-npc1": 0.08259302742627202, "sim_compute_robot_state-npc2": 0.08446115701376987, "sim_compute_robot_state-npc3": 0.08267854508899507}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5608916325326776, "sim_physics": 0.24541840980302043, "survival_time": 10.050000000000008, "driven_lanedir": 0.7602786149280263, "sim_render-ego": 0.07421676317850749, "in-drivable-lane": 3.400000000000011, "agent_compute-ego": 0.09568119404920893, "deviation-heading": 4.132275290977632, "set_robot_commands": 0.12475746425230112, "deviation-center-line": 0.5048306708180472, "driven_lanedir_consec": 0.5824194642752616, "sim_compute_sim_state": 0.04661719241545568, "sim_compute_performance-ego": 0.08337724505372308, "sim_compute_robot_state-ego": 0.09849866587131176, "sim_compute_robot_state-npc0": 0.08169924797703378, "sim_compute_robot_state-npc1": 0.08278349382960382, "sim_compute_robot_state-npc2": 0.08139509822598737, "sim_compute_robot_state-npc3": 0.08340629890783509}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22749881741451777, "sim_physics": 0.23862596920558385, "survival_time": 1.7500000000000009, "driven_lanedir": 0.21413555287343877, "sim_render-ego": 0.0743117196219308, "in-drivable-lane": 0, "agent_compute-ego": 0.10020739010402134, "deviation-heading": 0.44122817888830096, "set_robot_commands": 0.13211924689156668, "deviation-center-line": 0.15314893154459228, "driven_lanedir_consec": 0.21413555287343877, "sim_compute_sim_state": 0.04787132399422782, "sim_compute_performance-ego": 0.08411129542759486, "sim_compute_robot_state-ego": 0.09978196961539132, "sim_compute_robot_state-npc0": 0.08510093007768904, "sim_compute_robot_state-npc1": 0.08650789942060198, "sim_compute_robot_state-npc2": 0.08779966490609305, "sim_compute_robot_state-npc3": 0.08668319157191685}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.23553441855100687, "sim_physics": 0.2379635837343004, "survival_time": 1.800000000000001, "driven_lanedir": 0.2220076991828326, "sim_render-ego": 0.07295554876327515, "in-drivable-lane": 0, "agent_compute-ego": 0.0983784662352668, "deviation-heading": 0.4512278988944648, "set_robot_commands": 0.12644946575164795, "deviation-center-line": 0.14995794171326127, "driven_lanedir_consec": 0.2220076991828326, "sim_compute_sim_state": 0.04800573984781901, "sim_compute_performance-ego": 0.082217984729343, "sim_compute_robot_state-ego": 0.09576551781760322, "sim_compute_robot_state-npc0": 0.08806802829106648, "sim_compute_robot_state-npc1": 0.08070152335696751, "sim_compute_robot_state-npc2": 0.08345562219619751, "sim_compute_robot_state-npc3": 0.0836170580652025}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6051888307092602, "sim_physics": 0.2023014033712992, "survival_time": 4.099999999999993, "driven_lanedir": 0.5851979391324885, "sim_render-ego": 0.08077648209362495, "in-drivable-lane": 0, "agent_compute-ego": 0.10673763693832768, "deviation-heading": 0.9494178402583634, "set_robot_commands": 0.13754577462266132, "deviation-center-line": 0.3000010871348648, "driven_lanedir_consec": 0.5851979391324885, "sim_compute_sim_state": 0.04866914342089397, "sim_compute_performance-ego": 0.09039370897339612, "sim_compute_robot_state-ego": 0.10004379981901589, "sim_compute_robot_state-npc0": 0.08652486161487859, "sim_compute_robot_state-npc1": 0.08874334940096228, "sim_compute_robot_state-npc2": 0.08835331695835764, "sim_compute_robot_state-npc3": 0.08995828686690913}}
set_robot_commands_max	0.13754577462266132
set_robot_commands_mean	0.13077370342976477
set_robot_commands_median	0.13211924689156668
set_robot_commands_min	0.12475746425230112
sim_compute_performance-ego_max	0.09039370897339612
sim_compute_performance-ego_mean	0.08479493120996376
sim_compute_performance-ego_median	0.08387442186576169
sim_compute_performance-ego_min	0.082217984729343
sim_compute_robot_state-ego_max	0.10004379981901589
sim_compute_robot_state-ego_mean	0.0985540405622176
sim_compute_robot_state-ego_median	0.09868024968776572
sim_compute_robot_state-ego_min	0.09576551781760322
sim_compute_robot_state-npc0_max	0.08806802829106648
sim_compute_robot_state-npc0_mean	0.08512003945538658
sim_compute_robot_state-npc0_median	0.08510093007768904
sim_compute_robot_state-npc0_min	0.08169924797703378
sim_compute_robot_state-npc1_max	0.08874334940096228
sim_compute_robot_state-npc1_mean	0.08426585868688152
sim_compute_robot_state-npc1_median	0.08278349382960382
sim_compute_robot_state-npc1_min	0.08070152335696751
sim_compute_robot_state-npc2_max	0.08835331695835764
sim_compute_robot_state-npc2_mean	0.08509297186008108
sim_compute_robot_state-npc2_median	0.08446115701376987
sim_compute_robot_state-npc2_min	0.08139509822598737
sim_compute_robot_state-npc3_max	0.08995828686690913
sim_compute_robot_state-npc3_mean	0.08526867610017172
sim_compute_robot_state-npc3_median	0.0836170580652025
sim_compute_robot_state-npc3_min	0.08267854508899507
sim_compute_sim_state_max	0.04866914342089397
sim_compute_sim_state_mean	0.04739181542978173
sim_compute_sim_state_median	0.04787132399422782
sim_compute_sim_state_min	0.04579567747051213
sim_physics_max	0.24541840980302043
sim_physics_mean	0.2331747578325562
sim_physics_median	0.23862596920558385
sim_physics_min	0.2023014033712992
sim_render-ego_max	0.08077648209362495
sim_render-ego_mean	0.07536834722532845
sim_render-ego_median	0.0743117196219308
sim_render-ego_min	0.07295554876327515
simulation-passed	1
survival_time_max	10.050000000000008
survival_time_mean	5.009999999999997
survival_time_min	1.7500000000000009

No reset possible

20384

2673

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-25 12:00:25+00:00

2019-04-25 12:01:29+00:00

0:01:04

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20377

2708

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:56:12+00:00

2019-04-25 12:00:07+00:00

0:03:55

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20377-371339', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20377-371339', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20377-371339', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20342

2763

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 11:38:55+00:00

2019-04-25 11:54:45+00:00

0:15:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.08765220642089844
agent_compute-ego_mean	0.07895946579622495
agent_compute-ego_median	0.0834512710571289
agent_compute-ego_min	0.06942736224124306
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.21988513252951883, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.07016911560838873, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.08415629917925055, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.11358612504872408, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.04605444452979348, "sim_compute_performance-ego": 0.08156817338683388, "sim_compute_robot_state-ego": 0.08945952762256969, "sim_compute_robot_state-npc0": 0.07959094643592834, "sim_compute_robot_state-npc1": 0.07928737998008728, "sim_compute_robot_state-npc2": 0.07934242486953735, "sim_compute_robot_state-npc3": 0.07491391355341132}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.2271643146391838, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.0752454650017523, "in-drivable-lane": 0, "agent_compute-ego": 0.08765220642089844, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.11812346981417748, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.04624196021787582, "sim_compute_performance-ego": 0.08312386082064721, "sim_compute_robot_state-ego": 0.09630097112348004, "sim_compute_robot_state-npc0": 0.08017758400209489, "sim_compute_robot_state-npc1": 0.07937641297617266, "sim_compute_robot_state-npc2": 0.07939560951725129, "sim_compute_robot_state-npc3": 0.07965764691752772}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.22459495997597984, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.07144614314356594, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.0834512710571289, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.11290988347209092, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.04422950913720097, "sim_compute_performance-ego": 0.0804058034369286, "sim_compute_robot_state-ego": 0.08796939782217039, "sim_compute_robot_state-npc0": 0.07987984359687102, "sim_compute_robot_state-npc1": 0.07921694694681371, "sim_compute_robot_state-npc2": 0.08160072691897129, "sim_compute_robot_state-npc3": 0.07892243067423503}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.19443641963757963, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.06009844980741802, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.06942736224124306, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.09762545384858784, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.036297421706350225, "sim_compute_performance-ego": 0.06654347871479235, "sim_compute_robot_state-ego": 0.07404485250774183, "sim_compute_robot_state-npc0": 0.06835691803380063, "sim_compute_robot_state-npc1": 0.06711555782117341, "sim_compute_robot_state-npc2": 0.06653422054491545, "sim_compute_robot_state-npc3": 0.06773125748885306}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.19978331847929617, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.06006908416748047, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.07011019008260377, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.0959380159915333, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.039157101805780976, "sim_compute_performance-ego": 0.06764495372772217, "sim_compute_robot_state-ego": 0.073844936532034, "sim_compute_robot_state-npc0": 0.0670163396378638, "sim_compute_robot_state-npc1": 0.0655622683780294, "sim_compute_robot_state-npc2": 0.06826404786445725, "sim_compute_robot_state-npc3": 0.06637771196768318}}
set_robot_commands_max	0.11812346981417748
set_robot_commands_mean	0.10763658963502272
set_robot_commands_median	0.11290988347209092
set_robot_commands_min	0.0959380159915333
sim_compute_performance-ego_max	0.08312386082064721
sim_compute_performance-ego_mean	0.07585725401738483
sim_compute_performance-ego_median	0.0804058034369286
sim_compute_performance-ego_min	0.06654347871479235
sim_compute_robot_state-ego_max	0.09630097112348004
sim_compute_robot_state-ego_mean	0.08432393712159919
sim_compute_robot_state-ego_median	0.08796939782217039
sim_compute_robot_state-ego_min	0.073844936532034
sim_compute_robot_state-npc0_max	0.08017758400209489
sim_compute_robot_state-npc0_mean	0.07500432634131174
sim_compute_robot_state-npc0_median	0.07959094643592834
sim_compute_robot_state-npc0_min	0.0670163396378638
sim_compute_robot_state-npc1_max	0.07937641297617266
sim_compute_robot_state-npc1_mean	0.07411171322045529
sim_compute_robot_state-npc1_median	0.07921694694681371
sim_compute_robot_state-npc1_min	0.0655622683780294
sim_compute_robot_state-npc2_max	0.08160072691897129
sim_compute_robot_state-npc2_mean	0.07502740594302652
sim_compute_robot_state-npc2_median	0.07934242486953735
sim_compute_robot_state-npc2_min	0.06653422054491545
sim_compute_robot_state-npc3_max	0.07965764691752772
sim_compute_robot_state-npc3_mean	0.07352059212034205
sim_compute_robot_state-npc3_median	0.07491391355341132
sim_compute_robot_state-npc3_min	0.06637771196768318
sim_compute_sim_state_max	0.04624196021787582
sim_compute_sim_state_mean	0.042396087479400296
sim_compute_sim_state_median	0.04422950913720097
sim_compute_sim_state_min	0.036297421706350225
sim_physics_max	0.2271643146391838
sim_physics_mean	0.2131728290523117
sim_physics_median	0.21988513252951883
sim_physics_min	0.19443641963757963
sim_render-ego_max	0.0752454650017523
sim_render-ego_mean	0.06740565154572109
sim_render-ego_median	0.07016911560838873
sim_render-ego_min	0.06006908416748047
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20320

2805

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-25 11:33:41+00:00

2019-04-25 11:38:40+00:00

0:04:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.163185457013688
agent_compute-ego_mean	0.13090645377494853
agent_compute-ego_median	0.12751724243164062
agent_compute-ego_min	0.09362957212660047
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.11347757645373074, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.062486500110266345, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.163185457013688, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.10460104582444676, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.039471072970696214, "sim_compute_performance-ego": 0.07173082513629266, "sim_compute_robot_state-ego": 0.08025035768185022}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.07230448264342088, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.04637288130246676, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.11851180975253764, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.07233480765269353, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03054966376377986, "sim_compute_performance-ego": 0.05272895097732544, "sim_compute_robot_state-ego": 0.05503993309461153}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.04796679814656576, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.03913244936201307, "in-drivable-lane": 0, "agent_compute-ego": 0.09362957212660047, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.05843493673536512, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.024861825837029353, "sim_compute_performance-ego": 0.04025717576344808, "sim_compute_robot_state-ego": 0.043315357632107206}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.08972789764404297, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.04725066184997559, "in-drivable-lane": 0, "agent_compute-ego": 0.12751724243164062, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.07464323997497559, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.02980353355407715, "sim_compute_performance-ego": 0.055421762466430664, "sim_compute_robot_state-ego": 0.06480020523071289}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.09313733455462334, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.05713798449589656, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.15168818755027574, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.09724150254176211, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.03590192244603084, "sim_compute_performance-ego": 0.062820465136797, "sim_compute_robot_state-ego": 0.07205703930977063}}
set_robot_commands_max	0.10460104582444676
set_robot_commands_mean	0.08145110654584863
set_robot_commands_median	0.07464323997497559
set_robot_commands_min	0.05843493673536512
sim_compute_performance-ego_max	0.07173082513629266
sim_compute_performance-ego_mean	0.05659183589605876
sim_compute_performance-ego_median	0.055421762466430664
sim_compute_performance-ego_min	0.04025717576344808
sim_compute_robot_state-ego_max	0.08025035768185022
sim_compute_robot_state-ego_mean	0.0630925785898105
sim_compute_robot_state-ego_median	0.06480020523071289
sim_compute_robot_state-ego_min	0.043315357632107206
sim_compute_sim_state_max	0.039471072970696214
sim_compute_sim_state_mean	0.032117603714322686
sim_compute_sim_state_median	0.03054966376377986
sim_compute_sim_state_min	0.024861825837029353
sim_physics_max	0.11347757645373074
sim_physics_mean	0.08332281788847673
sim_physics_median	0.08972789764404297
sim_physics_min	0.04796679814656576
sim_render-ego_max	0.062486500110266345
sim_render-ego_mean	0.050476095424123665
sim_render-ego_median	0.04725066184997559
sim_render-ego_min	0.03913244936201307
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20314

2819

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:27:43+00:00

2019-04-25 11:33:35+00:00

0:05:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.16360331535339356
agent_compute-ego_mean	0.1577384289285672
agent_compute-ego_median	0.15776006230768166
agent_compute-ego_min	0.1524656613667806
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.1089509388185897, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06362056282331359, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.15776006230768166, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09312220339505176, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03898578769755813, "sim_compute_performance-ego": 0.07153720225927965, "sim_compute_robot_state-ego": 0.07913976795268508}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.10201149261914769, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06292199630003709, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1558893322944641, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.09954404372435348, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03863481833384587, "sim_compute_performance-ego": 0.07079592117896447, "sim_compute_robot_state-ego": 0.07370545313908504}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.09488810433281793, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06398510932922363, "in-drivable-lane": 0, "agent_compute-ego": 0.1524656613667806, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.09195272127787273, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.039876580238342285, "sim_compute_performance-ego": 0.07145941257476807, "sim_compute_robot_state-ego": 0.07573588689168294}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.10118583679199218, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.06349033355712891, "in-drivable-lane": 0, "agent_compute-ego": 0.16360331535339356, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.10406978607177736, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.0412796688079834, "sim_compute_performance-ego": 0.07057591438293458, "sim_compute_robot_state-ego": 0.08701580047607421}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.10697268522702733, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06580943022018824, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.15897377332051596, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.10271658958532871, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.04162615690475855, "sim_compute_performance-ego": 0.07096659220181979, "sim_compute_robot_state-ego": 0.0809854024495834}}
set_robot_commands_max	0.10406978607177736
set_robot_commands_mean	0.0982810688108768
set_robot_commands_median	0.09954404372435348
set_robot_commands_min	0.09195272127787273
sim_compute_performance-ego_max	0.07153720225927965
sim_compute_performance-ego_mean	0.0710670085195533
sim_compute_performance-ego_median	0.07096659220181979
sim_compute_performance-ego_min	0.07057591438293458
sim_compute_robot_state-ego_max	0.08701580047607421
sim_compute_robot_state-ego_mean	0.07931646218182213
sim_compute_robot_state-ego_median	0.07913976795268508
sim_compute_robot_state-ego_min	0.07370545313908504
sim_compute_sim_state_max	0.04162615690475855
sim_compute_sim_state_mean	0.04008060239649765
sim_compute_sim_state_median	0.039876580238342285
sim_compute_sim_state_min	0.03863481833384587
sim_physics_max	0.1089509388185897
sim_physics_mean	0.10280181155791494
sim_physics_median	0.10201149261914769
sim_physics_min	0.09488810433281793
sim_render-ego_max	0.06580943022018824
sim_render-ego_mean	0.0639654864459783
sim_render-ego_median	0.06362056282331359
sim_render-ego_min	0.06292199630003709
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20281

2908

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 11:02:45+00:00

2019-04-25 11:27:25+00:00

0:24:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.3583553380163131
survival_time_median	8.14999999999998
deviation-center-line_median	0.517427437031693
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2562585575827237
agent_compute-ego_mean	0.2473122347646163
agent_compute-ego_median	0.2466696834564209
agent_compute-ego_min	0.24086864709854125
deviation-center-line_max	1.08677366954943
deviation-center-line_mean	0.5281292505247385
deviation-center-line_min	0.1829676816078264
deviation-heading_max	0.9828968556129474
deviation-heading_mean	0.8282562995455519
deviation-heading_median	0.8446782271773426
deviation-heading_min	0.6643836524907397
driven_any_max	2.55336719354077
driven_any_mean	1.3828571007613224
driven_any_median	1.3653867595701237
driven_any_min	0.3783149598878067
driven_lanedir_consec_max	2.294833320738774
driven_lanedir_consec_mean	1.241158385840899
driven_lanedir_consec_min	0.36500236206727954
driven_lanedir_max	2.2948619821402314
driven_lanedir_mean	1.2412507201952745
driven_lanedir_median	1.3587581874441947
driven_lanedir_min	0.36500236206727954
in-drivable-lane_max	2.250000000000032
in-drivable-lane_mean	0.7400000000000105
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3653867595701237, "sim_physics": 0.19921083391809755, "survival_time": 8.14999999999998, "driven_lanedir": 1.3587581874441947, "sim_render-ego": 0.06498461705775349, "in-drivable-lane": 0, "agent_compute-ego": 0.24458805037422415, "deviation-heading": 0.7869872359047251, "set_robot_commands": 0.09894352456543344, "deviation-center-line": 0.517427437031693, "driven_lanedir_consec": 1.3583553380163131, "sim_compute_sim_state": 0.03995008702658437, "sim_compute_performance-ego": 0.07106081108374099, "sim_compute_robot_state-ego": 0.076256120131791, "sim_compute_robot_state-npc0": 0.07152984624991388, "sim_compute_robot_state-npc1": 0.07110774005117591, "sim_compute_robot_state-npc2": 0.07311045026486637, "sim_compute_robot_state-npc3": 0.07279515120149391}, "udem1-1-0": {"driven_any": 0.4481960084886939, "sim_physics": 0.17779055135003452, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226103432659749, "sim_render-ego": 0.06298786607281916, "in-drivable-lane": 0, "agent_compute-ego": 0.2562585575827237, "deviation-heading": 0.9828968556129474, "set_robot_commands": 0.10388434344324572, "deviation-center-line": 0.20821387548418732, "driven_lanedir_consec": 0.4226103432659749, "sim_compute_sim_state": 0.03910306404376852, "sim_compute_performance-ego": 0.07185780179911647, "sim_compute_robot_state-ego": 0.07933882598219247, "sim_compute_robot_state-npc0": 0.07254202201448638, "sim_compute_robot_state-npc1": 0.0695528819643218, "sim_compute_robot_state-npc2": 0.07023183230696053, "sim_compute_robot_state-npc3": 0.07174591771487532}, "udem1-2-0": {"driven_any": 2.1690205823192175, "sim_physics": 0.21211587681489832, "survival_time": 12.750000000000046, "driven_lanedir": 1.765020726058691, "sim_render-ego": 0.06548961938596239, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.2481762353111716, "deviation-heading": 0.8623355265420046, "set_robot_commands": 0.10238203721887926, "deviation-center-line": 0.6452635889505561, "driven_lanedir_consec": 1.7649905651161537, "sim_compute_sim_state": 0.04080886092840456, "sim_compute_performance-ego": 0.07241875798094506, "sim_compute_robot_state-ego": 0.0770627451877968, "sim_compute_robot_state-npc0": 0.07314858156092027, "sim_compute_robot_state-npc1": 0.07405324730218625, "sim_compute_robot_state-npc2": 0.07242516442841175, "sim_compute_robot_state-npc3": 0.07220641491459866}, "udem1-3-0": {"driven_any": 2.55336719354077, "sim_physics": 0.20718611001968384, "survival_time": 14.950000000000076, "driven_lanedir": 2.2948619821402314, "sim_render-ego": 0.06371342102686564, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.24086864709854125, "deviation-heading": 0.8446782271773426, "set_robot_commands": 0.09779228687286376, "deviation-center-line": 1.08677366954943, "driven_lanedir_consec": 2.294833320738774, "sim_compute_sim_state": 0.039763282934824624, "sim_compute_performance-ego": 0.06907971620559693, "sim_compute_robot_state-ego": 0.07444447755813599, "sim_compute_robot_state-npc0": 0.07021111965179444, "sim_compute_robot_state-npc1": 0.06986165444056193, "sim_compute_robot_state-npc2": 0.06927131175994873, "sim_compute_robot_state-npc3": 0.06909387509028117}, "udem1-4-0": {"driven_any": 0.3783149598878067, "sim_physics": 0.1811009454727173, "survival_time": 2.499999999999999, "driven_lanedir": 0.36500236206727954, "sim_render-ego": 0.06514935493469239, "in-drivable-lane": 0, "agent_compute-ego": 0.2466696834564209, "deviation-heading": 0.6643836524907397, "set_robot_commands": 0.10309797763824465, "deviation-center-line": 0.1829676816078264, "driven_lanedir_consec": 0.36500236206727954, "sim_compute_sim_state": 0.04120561122894287, "sim_compute_performance-ego": 0.0723451566696167, "sim_compute_robot_state-ego": 0.07952983856201172, "sim_compute_robot_state-npc0": 0.07149721145629882, "sim_compute_robot_state-npc1": 0.07266698360443115, "sim_compute_robot_state-npc2": 0.07336066722869873, "sim_compute_robot_state-npc3": 0.0727502965927124}}
set_robot_commands_max	0.10388434344324572
set_robot_commands_mean	0.10122003394773338
set_robot_commands_median	0.10238203721887926
set_robot_commands_min	0.09779228687286376
sim_compute_performance-ego_max	0.07241875798094506
sim_compute_performance-ego_mean	0.07135244874780323
sim_compute_performance-ego_median	0.07185780179911647
sim_compute_performance-ego_min	0.06907971620559693
sim_compute_robot_state-ego_max	0.07952983856201172
sim_compute_robot_state-ego_mean	0.0773264014843856
sim_compute_robot_state-ego_median	0.0770627451877968
sim_compute_robot_state-ego_min	0.07444447755813599
sim_compute_robot_state-npc0_max	0.07314858156092027
sim_compute_robot_state-npc0_mean	0.07178575618668277
sim_compute_robot_state-npc0_median	0.07152984624991388
sim_compute_robot_state-npc0_min	0.07021111965179444
sim_compute_robot_state-npc1_max	0.07405324730218625
sim_compute_robot_state-npc1_mean	0.07144850147253541
sim_compute_robot_state-npc1_median	0.07110774005117591
sim_compute_robot_state-npc1_min	0.0695528819643218
sim_compute_robot_state-npc2_max	0.07336066722869873
sim_compute_robot_state-npc2_mean	0.07167988519777721
sim_compute_robot_state-npc2_median	0.07242516442841175
sim_compute_robot_state-npc2_min	0.06927131175994873
sim_compute_robot_state-npc3_max	0.07279515120149391
sim_compute_robot_state-npc3_mean	0.07171833110279228
sim_compute_robot_state-npc3_median	0.07220641491459866
sim_compute_robot_state-npc3_min	0.06909387509028117
sim_compute_sim_state_max	0.04120561122894287
sim_compute_sim_state_mean	0.04016618123250499
sim_compute_sim_state_median	0.03995008702658437
sim_compute_sim_state_min	0.03910306404376852
sim_physics_max	0.21211587681489832
sim_physics_mean	0.19548086351508628
sim_physics_median	0.19921083391809755
sim_physics_min	0.17779055135003452
sim_render-ego_max	0.06548961938596239
sim_render-ego_mean	0.06446497569561861
sim_render-ego_median	0.06498461705775349
sim_render-ego_min	0.06298786607281916
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.25000000000002
survival_time_min	2.499999999999999

No reset possible

20272

2864

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:00:22+00:00

2019-04-25 11:02:05+00:00

0:01:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20237

2948

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 10:33:35+00:00

2019-04-25 11:00:04+00:00

0:26:29

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20237-910651', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20237-910651', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20237-910651', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20234

2953

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 10:25:53+00:00

2019-04-25 10:33:21+00:00

0:07:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1660651177994621
survival_time_median	1.4000000000000006
deviation-center-line_median	0.09799480797298596
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.19276030858357748
agent_compute-ego_mean	0.17572106148145214
agent_compute-ego_median	0.1706444906151813
agent_compute-ego_min	0.16913754145304363
deviation-center-line_max	0.11917926261676588
deviation-center-line_mean	0.0959382314061793
deviation-center-line_min	0.05580382394923149
deviation-heading_max	1.0060030847894106
deviation-heading_mean	0.6947685599282433
deviation-heading_median	0.7839757709094033
deviation-heading_min	0.373817186077754
driven_any_max	0.254021274203624
driven_any_mean	0.21638961342795737
driven_any_median	0.23932043859534327
driven_any_min	0.1456215186612058
driven_lanedir_consec_max	0.21825885224017272
driven_lanedir_consec_mean	0.15971356017930124
driven_lanedir_consec_min	0.08638064956951186
driven_lanedir_max	0.21825885224017272
driven_lanedir_mean	0.15971356017930124
driven_lanedir_median	0.1660651177994621
driven_lanedir_min	0.08638064956951186
in-drivable-lane_max	0.05000000000000005
in-drivable-lane_mean	0.020000000000000014
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.23932043859534327, "sim_physics": 0.175534886698569, "survival_time": 1.5500000000000007, "driven_lanedir": 0.1660651177994621, "sim_render-ego": 0.061668365232406125, "in-drivable-lane": 0, "agent_compute-ego": 0.1698145866394043, "deviation-heading": 0.8889647271545723, "set_robot_commands": 0.09418109924562516, "deviation-center-line": 0.09799480797298596, "driven_lanedir_consec": 0.1660651177994621, "sim_compute_sim_state": 0.03858920835679577, "sim_compute_performance-ego": 0.06943311229828865, "sim_compute_robot_state-ego": 0.07013941580249418, "sim_compute_robot_state-npc0": 0.0667474962049915, "sim_compute_robot_state-npc1": 0.06833991696757655, "sim_compute_robot_state-npc2": 0.06970041028914913, "sim_compute_robot_state-npc3": 0.06918968692902595}, "udem1-1-0": {"driven_any": 0.20356025635420028, "sim_physics": 0.1866668771814417, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1216305931973838, "sim_render-ego": 0.06793801872818558, "in-drivable-lane": 0, "agent_compute-ego": 0.19276030858357748, "deviation-heading": 1.0060030847894106, "set_robot_commands": 0.10675893006501376, "deviation-center-line": 0.09121560550030962, "driven_lanedir_consec": 0.1216305931973838, "sim_compute_sim_state": 0.03970025203846119, "sim_compute_performance-ego": 0.07447542967619719, "sim_compute_robot_state-ego": 0.0824610568858959, "sim_compute_robot_state-npc0": 0.07491167386372884, "sim_compute_robot_state-npc1": 0.07307230101691352, "sim_compute_robot_state-npc2": 0.07399430098357024, "sim_compute_robot_state-npc3": 0.07263678091543692}, "udem1-2-0": {"driven_any": 0.2394245793254135, "sim_physics": 0.21539063964571273, "survival_time": 1.4000000000000006, "driven_lanedir": 0.2062325880899758, "sim_render-ego": 0.06926502500261579, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17624838011605398, "deviation-heading": 0.373817186077754, "set_robot_commands": 0.09994175604411534, "deviation-center-line": 0.11549765699160353, "driven_lanedir_consec": 0.2062325880899758, "sim_compute_sim_state": 0.03966844081878662, "sim_compute_performance-ego": 0.07374403306416102, "sim_compute_robot_state-ego": 0.08019730874470302, "sim_compute_robot_state-npc0": 0.07213063750948225, "sim_compute_robot_state-npc1": 0.07378400223595756, "sim_compute_robot_state-npc2": 0.07384257657187325, "sim_compute_robot_state-npc3": 0.06882164308003016}, "udem1-3-0": {"driven_any": 0.254021274203624, "sim_physics": 0.19155096213022868, "survival_time": 1.5000000000000009, "driven_lanedir": 0.21825885224017272, "sim_render-ego": 0.06669232845306397, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16913754145304363, "deviation-heading": 0.42108203071007577, "set_robot_commands": 0.10129201412200928, "deviation-center-line": 0.11917926261676588, "driven_lanedir_consec": 0.21825885224017272, "sim_compute_sim_state": 0.04001779556274414, "sim_compute_performance-ego": 0.07005159854888916, "sim_compute_robot_state-ego": 0.07326831022898356, "sim_compute_robot_state-npc0": 0.07169211705525716, "sim_compute_robot_state-npc1": 0.07017590204874674, "sim_compute_robot_state-npc2": 0.07186548709869385, "sim_compute_robot_state-npc3": 0.07011326948801676}, "udem1-4-0": {"driven_any": 0.1456215186612058, "sim_physics": 0.16387262551680856, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08638064956951186, "sim_render-ego": 0.06382369995117188, "in-drivable-lane": 0, "agent_compute-ego": 0.1706444906151813, "deviation-heading": 0.7839757709094033, "set_robot_commands": 0.09835525180982509, "deviation-center-line": 0.05580382394923149, "driven_lanedir_consec": 0.08638064956951186, "sim_compute_sim_state": 0.03965619336003843, "sim_compute_performance-ego": 0.0665404174638831, "sim_compute_robot_state-ego": 0.07256294333416483, "sim_compute_robot_state-npc0": 0.0703792261040729, "sim_compute_robot_state-npc1": 0.07350771323494289, "sim_compute_robot_state-npc2": 0.07294268193452255, "sim_compute_robot_state-npc3": 0.07052553218343983}}
set_robot_commands_max	0.10675893006501376
set_robot_commands_mean	0.10010581025731773
set_robot_commands_median	0.09994175604411534
set_robot_commands_min	0.09418109924562516
sim_compute_performance-ego_max	0.07447542967619719
sim_compute_performance-ego_mean	0.07084891821028383
sim_compute_performance-ego_median	0.07005159854888916
sim_compute_performance-ego_min	0.0665404174638831
sim_compute_robot_state-ego_max	0.0824610568858959
sim_compute_robot_state-ego_mean	0.07572580699924829
sim_compute_robot_state-ego_median	0.07326831022898356
sim_compute_robot_state-ego_min	0.07013941580249418
sim_compute_robot_state-npc0_max	0.07491167386372884
sim_compute_robot_state-npc0_mean	0.07117223014750654
sim_compute_robot_state-npc0_median	0.07169211705525716
sim_compute_robot_state-npc0_min	0.0667474962049915
sim_compute_robot_state-npc1_max	0.07378400223595756
sim_compute_robot_state-npc1_mean	0.07177596710082744
sim_compute_robot_state-npc1_median	0.07307230101691352
sim_compute_robot_state-npc1_min	0.06833991696757655
sim_compute_robot_state-npc2_max	0.07399430098357024
sim_compute_robot_state-npc2_mean	0.07246909137556182
sim_compute_robot_state-npc2_median	0.07294268193452255
sim_compute_robot_state-npc2_min	0.06970041028914913
sim_compute_robot_state-npc3_max	0.07263678091543692
sim_compute_robot_state-npc3_mean	0.07025738251918992
sim_compute_robot_state-npc3_median	0.07011326948801676
sim_compute_robot_state-npc3_min	0.06882164308003016
sim_compute_sim_state_max	0.04001779556274414
sim_compute_sim_state_mean	0.03952637802736523
sim_compute_sim_state_median	0.03966844081878662
sim_compute_sim_state_min	0.03858920835679577
sim_physics_max	0.21539063964571273
sim_physics_mean	0.18660319823455213
sim_physics_median	0.1866668771814417
sim_physics_min	0.16387262551680856
sim_render-ego_max	0.06926502500261579
sim_render-ego_mean	0.06587748747348868
sim_render-ego_median	0.06669232845306397
sim_render-ego_min	0.061668365232406125
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.3900000000000006
survival_time_min	1.1500000000000004

No reset possible

20175

3054

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-25 10:00:58+00:00

2019-04-25 10:25:23+00:00

0:24:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.0002899177104858097
survival_time_median	14.950000000000076
deviation-center-line_median	0.4556840711244427
in-drivable-lane_median	7.650000000000041

other stats

agent_compute-ego_max	0.16942147890726725
agent_compute-ego_mean	0.15305041885375978
agent_compute-ego_median	0.150349071820577
agent_compute-ego_min	0.14380385001500448
deviation-center-line_max	0.56158233038212
deviation-center-line_mean	0.3843787837350768
deviation-center-line_min	0.1377857232578268
deviation-heading_max	5.954688203243268
deviation-heading_mean	5.64539335130318
deviation-heading_median	5.656741799274124
deviation-heading_min	5.366591917889959
driven_any_max	0.026994866629984765
driven_any_mean	0.025026630137878057
driven_any_median	0.025845567204834465
driven_any_min	0.0221106304422465
driven_lanedir_consec_max	0.0024792245869211804
driven_lanedir_consec_mean	-0.000226709968211658
driven_lanedir_consec_min	-0.0033655945211097382
driven_lanedir_max	0.0024792245869211804
driven_lanedir_mean	-0.000226709968211658
driven_lanedir_median	-0.0002899177104858097
driven_lanedir_min	-0.0033655945211097382
in-drivable-lane_max	7.650000000000045
in-drivable-lane_mean	7.610000000000042
in-drivable-lane_min	7.500000000000041
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026994866629984765, "sim_physics": 0.1454458745320638, "survival_time": 14.950000000000076, "driven_lanedir": 0.0024792245869211804, "sim_render-ego": 0.06991010904312134, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.16942147890726725, "deviation-heading": 5.656741799274124, "set_robot_commands": 0.1091899339358012, "deviation-center-line": 0.56158233038212, "driven_lanedir_consec": 0.0024792245869211804, "sim_compute_sim_state": 0.04249518632888794, "sim_compute_performance-ego": 0.07717119137446085, "sim_compute_robot_state-ego": 0.08303178548812866}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025845567204834465, "sim_physics": 0.1288403590520223, "survival_time": 14.950000000000076, "driven_lanedir": -0.0033655945211097382, "sim_render-ego": 0.05958898305892944, "in-drivable-lane": 7.650000000000045, "agent_compute-ego": 0.14947495301564534, "deviation-heading": 5.366591917889959, "set_robot_commands": 0.0940859087308248, "deviation-center-line": 0.1377857232578268, "driven_lanedir_consec": -0.0033655945211097382, "sim_compute_sim_state": 0.03839475393295288, "sim_compute_performance-ego": 0.06800702810287476, "sim_compute_robot_state-ego": 0.07275034904479981}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.024318396942425016, "sim_physics": 0.12295323689778646, "survival_time": 14.950000000000076, "driven_lanedir": 0.002366558833728938, "sim_render-ego": 0.0584454083442688, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.150349071820577, "deviation-heading": 5.954688203243268, "set_robot_commands": 0.09437897205352784, "deviation-center-line": 0.483344128978024, "driven_lanedir_consec": 0.002366558833728938, "sim_compute_sim_state": 0.03918690999348958, "sim_compute_performance-ego": 0.06620126485824585, "sim_compute_robot_state-ego": 0.07325954834620158}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.0221106304422465, "sim_physics": 0.11092296520868936, "survival_time": 14.950000000000076, "driven_lanedir": -0.0023238210301128603, "sim_render-ego": 0.060236331621805826, "in-drivable-lane": 7.650000000000041, "agent_compute-ego": 0.15220274051030477, "deviation-heading": 5.796593889452949, "set_robot_commands": 0.08982278903325398, "deviation-center-line": 0.4556840711244427, "driven_lanedir_consec": -0.0023238210301128603, "sim_compute_sim_state": 0.03818927049636841, "sim_compute_performance-ego": 0.06190414428710937, "sim_compute_robot_state-ego": 0.06644740422566732}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.025863689469899528, "sim_physics": 0.12652997573216757, "survival_time": 14.950000000000076, "driven_lanedir": -0.0002899177104858097, "sim_render-ego": 0.059303998947143555, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.14380385001500448, "deviation-heading": 5.452350946655598, "set_robot_commands": 0.0917123246192932, "deviation-center-line": 0.2834976649329702, "driven_lanedir_consec": -0.0002899177104858097, "sim_compute_sim_state": 0.0379667337735494, "sim_compute_performance-ego": 0.06599121967951457, "sim_compute_robot_state-ego": 0.07400377035140991}}
set_robot_commands_max	0.1091899339358012
set_robot_commands_mean	0.0958379856745402
set_robot_commands_median	0.0940859087308248
set_robot_commands_min	0.08982278903325398
sim_compute_performance-ego_max	0.07717119137446085
sim_compute_performance-ego_mean	0.06785496966044109
sim_compute_performance-ego_median	0.06620126485824585
sim_compute_performance-ego_min	0.06190414428710937
sim_compute_robot_state-ego_max	0.08303178548812866
sim_compute_robot_state-ego_mean	0.07389857149124146
sim_compute_robot_state-ego_median	0.07325954834620158
sim_compute_robot_state-ego_min	0.06644740422566732
sim_compute_sim_state_max	0.04249518632888794
sim_compute_sim_state_mean	0.03924657090504964
sim_compute_sim_state_median	0.03839475393295288
sim_compute_sim_state_min	0.0379667337735494
sim_physics_max	0.1454458745320638
sim_physics_mean	0.1269384822845459
sim_physics_median	0.12652997573216757
sim_physics_min	0.11092296520868936
sim_render-ego_max	0.06991010904312134
sim_render-ego_mean	0.0614969662030538
sim_render-ego_median	0.05958898305892944
sim_render-ego_min	0.0584454083442688
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20164

2751

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 09:58:42+00:00

2019-04-25 10:00:05+00:00

0:01:23

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20164-204441', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20164-204441', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20164-204441', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20151

2970

Andrea Censi 🇨🇭

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 09:47:27+00:00

2019-04-25 09:57:55+00:00

0:10:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6626660484899323
survival_time_median	6.949999999999983
deviation-center-line_median	0.3940780087873003
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.15194786919487846
agent_compute-ego_mean	0.14653049970370796
agent_compute-ego_median	0.14616631785183087
agent_compute-ego_min	0.1430896460581169
deviation-center-line_max	0.5818115374266422
deviation-center-line_mean	0.41505058781606213
deviation-center-line_min	0.23705977948807375
deviation-heading_max	1.8208638832332895
deviation-heading_mean	0.9378964755874734
deviation-heading_median	0.7829514707449345
deviation-heading_min	0.4929316813680339
driven_any_max	1.579666858337654
driven_any_mean	0.910879096199228
driven_any_median	0.9935985300650886
driven_any_min	0.2856531368039494
driven_lanedir_consec_max	0.910115169290383
driven_lanedir_consec_mean	0.6618036048723077
driven_lanedir_consec_min	0.27902056808188513
driven_lanedir_max	0.910115169290383
driven_lanedir_mean	0.6618036048723077
driven_lanedir_median	0.6626660484899323
driven_lanedir_min	0.27902056808188513
in-drivable-lane_max	5.100000000000032
in-drivable-lane_mean	1.4900000000000049
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9935985300650886, "sim_physics": 0.03953958243774853, "survival_time": 6.949999999999983, "driven_lanedir": 0.6552787023427018, "sim_render-ego": 0.057568701051121995, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1430896460581169, "deviation-heading": 0.7829514707449345, "set_robot_commands": 0.09400370138154614, "deviation-center-line": 0.3289247323901235, "driven_lanedir_consec": 0.6552787023427018, "sim_compute_sim_state": 0.036430882035399514, "sim_compute_performance-ego": 0.06459161532010964, "sim_compute_robot_state-ego": 0.07119807579534516}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0181947346383888, "sim_physics": 0.04396102107163017, "survival_time": 7.049999999999983, "driven_lanedir": 0.910115169290383, "sim_render-ego": 0.06097676229815111, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14616631785183087, "deviation-heading": 1.8208638832332895, "set_robot_commands": 0.09254932572655644, "deviation-center-line": 0.5333788809881709, "driven_lanedir_consec": 0.910115169290383, "sim_compute_sim_state": 0.037689203911639275, "sim_compute_performance-ego": 0.06815073507051941, "sim_compute_robot_state-ego": 0.07184760790344671}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2856531368039494, "sim_physics": 0.04466804928249783, "survival_time": 2.25, "driven_lanedir": 0.27902056808188513, "sim_render-ego": 0.06246132320827908, "in-drivable-lane": 0, "agent_compute-ego": 0.15194786919487846, "deviation-heading": 0.4929316813680339, "set_robot_commands": 0.09390016661749946, "deviation-center-line": 0.23705977948807375, "driven_lanedir_consec": 0.27902056808188513, "sim_compute_sim_state": 0.037503650453355575, "sim_compute_performance-ego": 0.06547103457980685, "sim_compute_robot_state-ego": 0.06920475959777832}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6772822211510588, "sim_physics": 0.04209409405787786, "survival_time": 4.799999999999991, "driven_lanedir": 0.6626660484899323, "sim_render-ego": 0.05882387111584345, "in-drivable-lane": 0, "agent_compute-ego": 0.14342857152223587, "deviation-heading": 0.9646905111792942, "set_robot_commands": 0.08830896268288295, "deviation-center-line": 0.3940780087873003, "driven_lanedir_consec": 0.6626660484899323, "sim_compute_sim_state": 0.03659080465634664, "sim_compute_performance-ego": 0.06672819703817368, "sim_compute_robot_state-ego": 0.06806671371062596}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.579666858337654, "sim_physics": 0.04348196302141462, "survival_time": 10.85000000000002, "driven_lanedir": 0.8019375361566361, "sim_render-ego": 0.058849902746314825, "in-drivable-lane": 5.100000000000032, "agent_compute-ego": 0.1480200938914778, "deviation-heading": 0.6280448314118138, "set_robot_commands": 0.09005913976150724, "deviation-center-line": 0.5818115374266422, "driven_lanedir_consec": 0.8019375361566361, "sim_compute_sim_state": 0.036000545123755105, "sim_compute_performance-ego": 0.06507657310380364, "sim_compute_robot_state-ego": 0.07108187345865136}}
set_robot_commands_max	0.09400370138154614
set_robot_commands_mean	0.09176425923399845
set_robot_commands_median	0.09254932572655644
set_robot_commands_min	0.08830896268288295
sim_compute_performance-ego_max	0.06815073507051941
sim_compute_performance-ego_mean	0.06600363102248265
sim_compute_performance-ego_median	0.06547103457980685
sim_compute_performance-ego_min	0.06459161532010964
sim_compute_robot_state-ego_max	0.07184760790344671
sim_compute_robot_state-ego_mean	0.0702798060931695
sim_compute_robot_state-ego_median	0.07108187345865136
sim_compute_robot_state-ego_min	0.06806671371062596
sim_compute_sim_state_max	0.037689203911639275
sim_compute_sim_state_mean	0.03684301723609922
sim_compute_sim_state_median	0.03659080465634664
sim_compute_sim_state_min	0.036000545123755105
sim_physics_max	0.04466804928249783
sim_physics_mean	0.0427489419742338
sim_physics_median	0.04348196302141462
sim_physics_min	0.03953958243774853
sim_render-ego_max	0.06246132320827908
sim_render-ego_mean	0.0597361120839421
sim_render-ego_median	0.058849902746314825
sim_render-ego_min	0.057568701051121995
simulation-passed	1
survival_time_max	10.85000000000002
survival_time_mean	6.379999999999995
survival_time_min	2.25

No reset possible

20103

3055

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-25 09:27:41+00:00

2019-04-25 09:47:01+00:00

0:19:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.0005475306520854595
survival_time_median	14.950000000000076
deviation-center-line_median	0.4751036937952701
in-drivable-lane_median	7.550000000000043

other stats

agent_compute-ego_max	0.15419615427652994
agent_compute-ego_mean	0.14164033412933347
agent_compute-ego_median	0.14259918133417765
agent_compute-ego_min	0.13320579290390014
deviation-center-line_max	0.556068910796392
deviation-center-line_mean	0.3895061244663202
deviation-center-line_min	0.14514552024423696
deviation-heading_max	6.039767599662579
deviation-heading_mean	5.763921961552656
deviation-heading_median	5.767844541062104
deviation-heading_min	5.560681575562554
driven_any_max	0.028934981635126217
driven_any_mean	0.0265495383263842
driven_any_median	0.025958363654255467
driven_any_min	0.024158897917020104
driven_lanedir_consec_max	0.0029212565811485014
driven_lanedir_consec_mean	-5.1621543168867136e-05
driven_lanedir_consec_min	-0.003893767360947819
driven_lanedir_max	0.0029212565811485014
driven_lanedir_mean	-5.1621543168867136e-05
driven_lanedir_median	-0.0005475306520854595
driven_lanedir_min	-0.003893767360947819
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	7.550000000000043
in-drivable-lane_min	7.500000000000041
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.028934981635126217, "sim_physics": 0.0400286595026652, "survival_time": 14.950000000000076, "driven_lanedir": 0.002754464494397091, "sim_render-ego": 0.05734513839085897, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.14259918133417765, "deviation-heading": 5.767844541062104, "set_robot_commands": 0.0886507248878479, "deviation-center-line": 0.556068910796392, "driven_lanedir_consec": 0.002754464494397091, "sim_compute_sim_state": 0.036205583413441975, "sim_compute_performance-ego": 0.06233092705408732, "sim_compute_robot_state-ego": 0.0679778520266215}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025958363654255467, "sim_physics": 0.04120352586110433, "survival_time": 14.950000000000076, "driven_lanedir": -0.003893767360947819, "sim_render-ego": 0.05838875452677409, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.14306319157282513, "deviation-heading": 5.560681575562554, "set_robot_commands": 0.09202278296152752, "deviation-center-line": 0.14514552024423696, "driven_lanedir_consec": -0.003893767360947819, "sim_compute_sim_state": 0.03704983393351237, "sim_compute_performance-ego": 0.06512476364771524, "sim_compute_robot_state-ego": 0.07209426800409953}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.02575465114235495, "sim_physics": 0.03997177362442016, "survival_time": 14.950000000000076, "driven_lanedir": 0.0029212565811485014, "sim_render-ego": 0.05377616326014201, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.13513735055923462, "deviation-heading": 5.815918488019714, "set_robot_commands": 0.08362160762151083, "deviation-center-line": 0.4751036937952701, "driven_lanedir_consec": 0.0029212565811485014, "sim_compute_sim_state": 0.03475313027699788, "sim_compute_performance-ego": 0.060107138156890866, "sim_compute_robot_state-ego": 0.06502723534901937}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.024158897917020104, "sim_physics": 0.0403787358601888, "survival_time": 14.950000000000076, "driven_lanedir": -0.0014925307783566488, "sim_render-ego": 0.05714847485224406, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.13320579290390014, "deviation-heading": 6.039767599662579, "set_robot_commands": 0.08481997887293498, "deviation-center-line": 0.4766251667427719, "driven_lanedir_consec": -0.0014925307783566488, "sim_compute_sim_state": 0.03546831210454305, "sim_compute_performance-ego": 0.0600622566541036, "sim_compute_robot_state-ego": 0.06499961773554484}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.027940797283164263, "sim_physics": 0.043218119144439696, "survival_time": 14.950000000000076, "driven_lanedir": -0.0005475306520854595, "sim_render-ego": 0.05977933645248413, "in-drivable-lane": 7.550000000000043, "agent_compute-ego": 0.15419615427652994, "deviation-heading": 5.635397603456328, "set_robot_commands": 0.09271059115727742, "deviation-center-line": 0.2945873307529301, "driven_lanedir_consec": -0.0005475306520854595, "sim_compute_sim_state": 0.03717846870422363, "sim_compute_performance-ego": 0.06637331247329711, "sim_compute_robot_state-ego": 0.0714359418551127}}
set_robot_commands_max	0.09271059115727742
set_robot_commands_mean	0.08836513710021973
set_robot_commands_median	0.0886507248878479
set_robot_commands_min	0.08362160762151083
sim_compute_performance-ego_max	0.06637331247329711
sim_compute_performance-ego_mean	0.06279967959721884
sim_compute_performance-ego_median	0.06233092705408732
sim_compute_performance-ego_min	0.0600622566541036
sim_compute_robot_state-ego_max	0.07209426800409953
sim_compute_robot_state-ego_mean	0.06830698299407958
sim_compute_robot_state-ego_median	0.0679778520266215
sim_compute_robot_state-ego_min	0.06499961773554484
sim_compute_sim_state_max	0.03717846870422363
sim_compute_sim_state_mean	0.036131065686543784
sim_compute_sim_state_median	0.036205583413441975
sim_compute_sim_state_min	0.03475313027699788
sim_physics_max	0.043218119144439696
sim_physics_mean	0.04096016279856364
sim_physics_median	0.0403787358601888
sim_physics_min	0.03997177362442016
sim_render-ego_max	0.05977933645248413
sim_render-ego_mean	0.057287573496500654
sim_render-ego_median	0.05734513839085897
sim_render-ego_min	0.05377616326014201
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20095

2751

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 09:24:59+00:00

2019-04-25 09:26:46+00:00

0:01:47

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20073

2698

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 09:05:54+00:00

2019-04-25 09:24:53+00:00

0:18:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5828104728384891
survival_time_median	4.749999999999991
deviation-center-line_median	0.3593970064543642
in-drivable-lane_median	0.2499999999999991

other stats

agent_compute-ego_max	0.08809613359385524
agent_compute-ego_mean	0.08583374622062825
agent_compute-ego_median	0.08622377259390694
agent_compute-ego_min	0.08289570331573487
deviation-center-line_max	0.7578748550826134
deviation-center-line_mean	0.4252836859734712
deviation-center-line_min	0.22938217902489977
deviation-heading_max	5.132185448566655
deviation-heading_mean	2.3478866467603523
deviation-heading_median	1.9403769043008492
deviation-heading_min	0.6508983147339267
driven_any_max	2.3482389694868884
driven_any_mean	0.981275740590954
driven_any_median	0.709620412324745
driven_any_min	0.45249693401610186
driven_lanedir_consec_max	1.3948860516607122
driven_lanedir_consec_mean	0.6517150026926075
driven_lanedir_consec_min	0.17239946904909442
driven_lanedir_max	1.3948860516607122
driven_lanedir_mean	0.7006971328499124
driven_lanedir_median	0.5828104728384891
driven_lanedir_min	0.39586095762811646
in-drivable-lane_max	4.100000000000048
in-drivable-lane_mean	0.9400000000000092
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.6301880486356805, "sim_physics": 0.23142735437415113, "survival_time": 4.3499999999999925, "driven_lanedir": 0.39586095762811646, "sim_render-ego": 0.07044427696315722, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.08809613359385524, "deviation-heading": 2.5288019023517396, "set_robot_commands": 0.11169895358469296, "deviation-center-line": 0.4483494781443147, "driven_lanedir_consec": 0.17239946904909442, "sim_compute_sim_state": 0.04319884585238051, "sim_compute_performance-ego": 0.07951176029512252, "sim_compute_robot_state-ego": 0.08976989504934728, "sim_compute_robot_state-npc0": 0.07581757677012477, "sim_compute_robot_state-npc1": 0.07450804765197053, "sim_compute_robot_state-npc2": 0.07577869535862715, "sim_compute_robot_state-npc3": 0.07577998884792986}, "udem1-1-0": {"driven_any": 0.709620412324745, "sim_physics": 0.2003134476511102, "survival_time": 4.749999999999991, "driven_lanedir": 0.5828104728384891, "sim_render-ego": 0.07123530036524722, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.08653010318153782, "deviation-heading": 1.9403769043008492, "set_robot_commands": 0.10392483410082363, "deviation-center-line": 0.22938217902489977, "driven_lanedir_consec": 0.5828104728384891, "sim_compute_sim_state": 0.04097030288294742, "sim_compute_performance-ego": 0.07361961665906404, "sim_compute_robot_state-ego": 0.08252721334758557, "sim_compute_robot_state-npc0": 0.07586070612857217, "sim_compute_robot_state-npc1": 0.07651464311700118, "sim_compute_robot_state-npc2": 0.0740091323852539, "sim_compute_robot_state-npc3": 0.07495956671865363}, "udem1-2-0": {"driven_any": 0.7658343384913548, "sim_physics": 0.2190346928203807, "survival_time": 5.09999999999999, "driven_lanedir": 0.7100810577737608, "sim_render-ego": 0.06827557320688285, "in-drivable-lane": 0, "agent_compute-ego": 0.08542301841810637, "deviation-heading": 1.4871706638485918, "set_robot_commands": 0.1061180970248054, "deviation-center-line": 0.3593970064543642, "driven_lanedir_consec": 0.6886318955662583, "sim_compute_sim_state": 0.0429687079261331, "sim_compute_performance-ego": 0.0753389924180274, "sim_compute_robot_state-ego": 0.08360616599812228, "sim_compute_robot_state-npc0": 0.07413431008656819, "sim_compute_robot_state-npc1": 0.07508329316681507, "sim_compute_robot_state-npc2": 0.07480999535205317, "sim_compute_robot_state-npc3": 0.07342355625302184}, "udem1-3-0": {"driven_any": 0.45249693401610186, "sim_physics": 0.2041582909841386, "survival_time": 3.149999999999997, "driven_lanedir": 0.4198471243484836, "sim_render-ego": 0.06933394689408559, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.08622377259390694, "deviation-heading": 0.6508983147339267, "set_robot_commands": 0.10676115656655932, "deviation-center-line": 0.3314149111611641, "driven_lanedir_consec": 0.4198471243484836, "sim_compute_sim_state": 0.04244618945651584, "sim_compute_performance-ego": 0.07526687970237127, "sim_compute_robot_state-ego": 0.079268251146589, "sim_compute_robot_state-npc0": 0.07238727524167016, "sim_compute_robot_state-npc1": 0.07353041664002434, "sim_compute_robot_state-npc2": 0.0756001245407831, "sim_compute_robot_state-npc3": 0.07488474013313415}, "udem1-4-0": {"driven_any": 2.3482389694868884, "sim_physics": 0.2428627785046895, "survival_time": 14.950000000000076, "driven_lanedir": 1.3948860516607122, "sim_render-ego": 0.0683492120107015, "in-drivable-lane": 4.100000000000048, "agent_compute-ego": 0.08289570331573487, "deviation-heading": 5.132185448566655, "set_robot_commands": 0.10660394112269084, "deviation-center-line": 0.7578748550826134, "driven_lanedir_consec": 1.3948860516607122, "sim_compute_sim_state": 0.04462448596954346, "sim_compute_performance-ego": 0.07622801542282104, "sim_compute_robot_state-ego": 0.08451764424641928, "sim_compute_robot_state-npc0": 0.07487389246622721, "sim_compute_robot_state-npc1": 0.0739982295036316, "sim_compute_robot_state-npc2": 0.07560788869857787, "sim_compute_robot_state-npc3": 0.07462878545125326}}
set_robot_commands_max	0.11169895358469296
set_robot_commands_mean	0.10702139647991445
set_robot_commands_median	0.10660394112269084
set_robot_commands_min	0.10392483410082363
sim_compute_performance-ego_max	0.07951176029512252
sim_compute_performance-ego_mean	0.07599305289948124
sim_compute_performance-ego_median	0.0753389924180274
sim_compute_performance-ego_min	0.07361961665906404
sim_compute_robot_state-ego_max	0.08976989504934728
sim_compute_robot_state-ego_mean	0.08393783395761267
sim_compute_robot_state-ego_median	0.08360616599812228
sim_compute_robot_state-ego_min	0.079268251146589
sim_compute_robot_state-npc0_max	0.07586070612857217
sim_compute_robot_state-npc0_mean	0.0746147521386325
sim_compute_robot_state-npc0_median	0.07487389246622721
sim_compute_robot_state-npc0_min	0.07238727524167016
sim_compute_robot_state-npc1_max	0.07651464311700118
sim_compute_robot_state-npc1_mean	0.07472692601588855
sim_compute_robot_state-npc1_median	0.07450804765197053
sim_compute_robot_state-npc1_min	0.07353041664002434
sim_compute_robot_state-npc2_max	0.07577869535862715
sim_compute_robot_state-npc2_mean	0.07516116726705904
sim_compute_robot_state-npc2_median	0.0756001245407831
sim_compute_robot_state-npc2_min	0.0740091323852539
sim_compute_robot_state-npc3_max	0.07577998884792986
sim_compute_robot_state-npc3_mean	0.07473532748079854
sim_compute_robot_state-npc3_median	0.07488474013313415
sim_compute_robot_state-npc3_min	0.07342355625302184
sim_compute_sim_state_max	0.04462448596954346
sim_compute_sim_state_mean	0.04284170641750407
sim_compute_sim_state_median	0.0429687079261331
sim_compute_sim_state_min	0.04097030288294742
sim_physics_max	0.2428627785046895
sim_physics_mean	0.2195593128668941
sim_physics_median	0.2190346928203807
sim_physics_min	0.2003134476511102
sim_render-ego_max	0.07123530036524722
sim_render-ego_mean	0.06952766188801487
sim_render-ego_median	0.06933394689408559
sim_render-ego_min	0.06827557320688285
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.460000000000011
survival_time_min	3.149999999999997

No reset possible

20069

2723

test for ppo

step1-simulation

error

2019-04-25 09:03:58+00:00

2019-04-25 09:05:41+00:00

0:01:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20063

2799

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 09:01:34+00:00

2019-04-25 09:03:25+00:00

0:01:51

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20044

2928

challenge-aido_LF-template-pytorch

step1-simulation

host-error

2019-04-25 08:59:26+00:00

2019-04-25 09:00:58+00:00

0:01:32

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20044-956824', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20044-956824', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20044-956824', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20026

2379

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-25 08:47:37+00:00

2019-04-25 08:56:38+00:00

0:09:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5561853907226295
survival_time_median	5.4999999999999885
deviation-center-line_median	0.3609540735492193
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.0528973254290494
agent_compute-ego_mean	0.04501124654989379
agent_compute-ego_median	0.04312819242477417
agent_compute-ego_min	0.04230567477396782
deviation-center-line_max	0.514356460090703
deviation-center-line_mean	0.30541078688337764
deviation-center-line_min	0.10494591683577394
deviation-heading_max	0.602451292294937
deviation-heading_mean	0.496384559404231
deviation-heading_median	0.495342105041175
deviation-heading_min	0.40899398941370746
driven_any_max	2.762168920118755
driven_any_mean	1.4661734934066817
driven_any_median	1.5621689201187343
driven_any_min	0.3771872678408435
driven_lanedir_consec_max	1.9018012187122744
driven_lanedir_consec_mean	1.1938402082836792
driven_lanedir_consec_min	0.364132329464548
driven_lanedir_max	1.9018596605710023
driven_lanedir_mean	1.1939063060065134
driven_lanedir_median	1.5563931374178386
driven_lanedir_min	0.364132329464548
in-drivable-lane_max	2.8500000000000156
in-drivable-lane_mean	0.8700000000000021
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5621689201187343, "sim_physics": 0.035890566218983046, "survival_time": 5.4999999999999885, "driven_lanedir": 1.5563931374178386, "sim_render-ego": 0.05582618930123069, "in-drivable-lane": 0, "agent_compute-ego": 0.0528973254290494, "deviation-heading": 0.4699848786101311, "set_robot_commands": 0.08119107376445424, "deviation-center-line": 0.3609540735492193, "driven_lanedir_consec": 1.5561853907226295, "sim_compute_sim_state": 0.03658812046051026, "sim_compute_performance-ego": 0.05866879983381792, "sim_compute_robot_state-ego": 0.06185004711151123, "sim_compute_robot_state-npc0": 0.05957213315096768, "sim_compute_robot_state-npc1": 0.05907933061773127, "sim_compute_robot_state-npc2": 0.059900762818076395, "sim_compute_robot_state-npc3": 0.05865103764967485}, "udem1-1-0": {"driven_any": 0.45217343883638383, "sim_physics": 0.02627807855606079, "survival_time": 1.800000000000001, "driven_lanedir": 0.4270847091079229, "sim_render-ego": 0.04370958937538995, "in-drivable-lane": 0, "agent_compute-ego": 0.04312819242477417, "deviation-heading": 0.602451292294937, "set_robot_commands": 0.06310910648769802, "deviation-center-line": 0.12740341389171098, "driven_lanedir_consec": 0.4270847091079229, "sim_compute_sim_state": 0.026977042357126873, "sim_compute_performance-ego": 0.04725854926639133, "sim_compute_robot_state-ego": 0.04767492082383898, "sim_compute_robot_state-npc0": 0.04688288768132528, "sim_compute_robot_state-npc1": 0.04743689960903592, "sim_compute_robot_state-npc2": 0.04803674088584052, "sim_compute_robot_state-npc3": 0.047778156068589955}, "udem1-2-0": {"driven_any": 2.1771689201186923, "sim_physics": 0.027400623094167145, "survival_time": 7.549999999999981, "driven_lanedir": 1.7200616934712554, "sim_render-ego": 0.04553924964753208, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.04230567477396782, "deviation-heading": 0.5051505316612044, "set_robot_commands": 0.06389012873567493, "deviation-center-line": 0.41939407004948054, "driven_lanedir_consec": 1.7199973934110218, "sim_compute_sim_state": 0.0259325567460218, "sim_compute_performance-ego": 0.045119726105241585, "sim_compute_robot_state-ego": 0.04601222316160897, "sim_compute_robot_state-npc0": 0.04689369454289114, "sim_compute_robot_state-npc1": 0.046225284109052446, "sim_compute_robot_state-npc2": 0.0458760072063926, "sim_compute_robot_state-npc3": 0.04539497009176292}, "udem1-3-0": {"driven_any": 2.762168920118755, "sim_physics": 0.027520093164945903, "survival_time": 9.5, "driven_lanedir": 1.9018596605710023, "sim_render-ego": 0.04316599996466386, "in-drivable-lane": 2.8500000000000156, "agent_compute-ego": 0.04267633086756656, "deviation-heading": 0.495342105041175, "set_robot_commands": 0.06488299495295474, "deviation-center-line": 0.514356460090703, "driven_lanedir_consec": 1.9018012187122744, "sim_compute_sim_state": 0.02695364701120477, "sim_compute_performance-ego": 0.04607517970235724, "sim_compute_robot_state-ego": 0.04852494315097206, "sim_compute_robot_state-npc0": 0.04893645361850136, "sim_compute_robot_state-npc1": 0.04751271699604235, "sim_compute_robot_state-npc2": 0.04769286607441149, "sim_compute_robot_state-npc3": 0.05190051229376542}, "udem1-4-0": {"driven_any": 0.3771872678408435, "sim_physics": 0.025907408806585496, "survival_time": 1.5500000000000007, "driven_lanedir": 0.364132329464548, "sim_render-ego": 0.04552298976529029, "in-drivable-lane": 0, "agent_compute-ego": 0.044048709254111015, "deviation-heading": 0.40899398941370746, "set_robot_commands": 0.06830658451203377, "deviation-center-line": 0.10494591683577394, "driven_lanedir_consec": 0.364132329464548, "sim_compute_sim_state": 0.027444901004914316, "sim_compute_performance-ego": 0.04731379785845356, "sim_compute_robot_state-ego": 0.04927422923426474, "sim_compute_robot_state-npc0": 0.052703142166137695, "sim_compute_robot_state-npc1": 0.0472412109375, "sim_compute_robot_state-npc2": 0.050259059475314234, "sim_compute_robot_state-npc3": 0.053476895055463235}}
set_robot_commands_max	0.08119107376445424
set_robot_commands_mean	0.06827597769056312
set_robot_commands_median	0.06488299495295474
set_robot_commands_min	0.06310910648769802
sim_compute_performance-ego_max	0.05866879983381792
sim_compute_performance-ego_mean	0.048887210553252326
sim_compute_performance-ego_median	0.04725854926639133
sim_compute_performance-ego_min	0.045119726105241585
sim_compute_robot_state-ego_max	0.06185004711151123
sim_compute_robot_state-ego_mean	0.05066727269643919
sim_compute_robot_state-ego_median	0.04852494315097206
sim_compute_robot_state-ego_min	0.04601222316160897
sim_compute_robot_state-npc0_max	0.05957213315096768
sim_compute_robot_state-npc0_mean	0.05099766223196463
sim_compute_robot_state-npc0_median	0.04893645361850136
sim_compute_robot_state-npc0_min	0.04688288768132528
sim_compute_robot_state-npc1_max	0.05907933061773127
sim_compute_robot_state-npc1_mean	0.049499088453872395
sim_compute_robot_state-npc1_median	0.04743689960903592
sim_compute_robot_state-npc1_min	0.046225284109052446
sim_compute_robot_state-npc2_max	0.059900762818076395
sim_compute_robot_state-npc2_mean	0.05035308729200705
sim_compute_robot_state-npc2_median	0.04803674088584052
sim_compute_robot_state-npc2_min	0.0458760072063926
sim_compute_robot_state-npc3_max	0.05865103764967485
sim_compute_robot_state-npc3_mean	0.05144031423185127
sim_compute_robot_state-npc3_median	0.05190051229376542
sim_compute_robot_state-npc3_min	0.04539497009176292
sim_compute_sim_state_max	0.03658812046051026
sim_compute_sim_state_mean	0.02877925351595561
sim_compute_sim_state_median	0.026977042357126873
sim_compute_sim_state_min	0.0259325567460218
sim_physics_max	0.035890566218983046
sim_physics_mean	0.028599353968148472
sim_physics_median	0.027400623094167145
sim_physics_min	0.025907408806585496
sim_render-ego_max	0.05582618930123069
sim_render-ego_mean	0.046752803610821375
sim_render-ego_median	0.04552298976529029
sim_render-ego_min	0.04316599996466386
simulation-passed	1
survival_time_max	9.5
survival_time_mean	5.179999999999994
survival_time_min	1.5500000000000007

No reset possible

20013

2409

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:45:47+00:00

2019-04-25 08:47:30+00:00

0:01:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20001

2442

Jacopo Tani

random_agent

step1-simulation

error

2019-04-25 08:44:43+00:00

2019-04-25 08:45:28+00:00

0:00:45

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19993

2468

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

error

2019-04-25 08:43:34+00:00

2019-04-25 08:44:22+00:00

0:00:48

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19988

2521

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:42:47+00:00

2019-04-25 08:43:18+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19969

2561

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:41:38+00:00

2019-04-25 08:42:26+00:00

0:00:48

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19948

2653

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:40:19+00:00

2019-04-25 08:41:16+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19939

2805

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

error

2019-04-25 08:39:22+00:00

2019-04-25 08:40:12+00:00

0:00:50

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19928

2900

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-25 08:38:13+00:00

2019-04-25 08:39:15+00:00

0:01:02

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19902

2731

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:36:41+00:00

2019-04-25 08:37:48+00:00

0:01:07

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19838

2568

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 08:27:02+00:00

2019-04-25 08:36:26+00:00

0:09:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4677520238097679
survival_time_median	2.849999999999998
deviation-center-line_median	0.13993923038273243
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.10793745517730712
agent_compute-ego_mean	0.07255333986191292
agent_compute-ego_median	0.06654074944947895
agent_compute-ego_min	0.04909107977883857
deviation-center-line_max	0.441991081977021
deviation-center-line_mean	0.24301419493149473
deviation-center-line_min	0.11233303566656118
deviation-heading_max	1.965590298952019
deviation-heading_mean	0.904977224642509
deviation-heading_median	0.6817498444220604
deviation-heading_min	0.23880859753921196
driven_any_max	2.234618045439434
driven_any_mean	1.1136680430892796
driven_any_median	0.7854280860806753
driven_any_min	0.3734823939695258
driven_lanedir_consec_max	1.4162453958283412
driven_lanedir_consec_mean	0.7217431069832176
driven_lanedir_consec_min	0.3618460409658957
driven_lanedir_max	1.4162453958283412
driven_lanedir_mean	0.7217431069832176
driven_lanedir_median	0.4677520238097679
driven_lanedir_min	0.3618460409658957
in-drivable-lane_max	3.2999999999999883
in-drivable-lane_mean	0.9999999999999964
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.037559550279265, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.057377516084415894, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.06343595541206895, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.08794672929557265, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.03559883233088597, "sim_compute_performance-ego": 0.061649111425800686, "sim_compute_robot_state-ego": 0.06436108479833906, "sim_compute_robot_state-npc0": 0.06255469656294319, "sim_compute_robot_state-npc1": 0.06176670949170544, "sim_compute_robot_state-npc2": 0.06189585491350502, "sim_compute_robot_state-npc3": 0.06142718169339903}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.04608936686264841, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.05868719753466154, "in-drivable-lane": 0, "agent_compute-ego": 0.06654074944947895, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.0847188485296149, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.03615609595650121, "sim_compute_performance-ego": 0.05991782640155993, "sim_compute_robot_state-ego": 0.06621958707508288, "sim_compute_robot_state-npc0": 0.06966160473070647, "sim_compute_robot_state-npc1": 0.06464109922710218, "sim_compute_robot_state-npc2": 0.06640401012019108, "sim_compute_robot_state-npc3": 0.06641537892191034}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.0281550549624259, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.04539442898934347, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.04909107977883857, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.06416801820721543, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.027214932859989636, "sim_compute_performance-ego": 0.04604519459239224, "sim_compute_robot_state-ego": 0.046895010429516173, "sim_compute_robot_state-npc0": 0.050086694851256254, "sim_compute_robot_state-npc1": 0.048310020513701854, "sim_compute_robot_state-npc2": 0.04727683987533837, "sim_compute_robot_state-npc3": 0.04617884702849807}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.046562380260891385, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.06520596256962528, "in-drivable-lane": 0, "agent_compute-ego": 0.07576145949187102, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.09672101338704428, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.03902451197306315, "sim_compute_performance-ego": 0.06573751237657335, "sim_compute_robot_state-ego": 0.0682531197865804, "sim_compute_robot_state-npc0": 0.06715870786596227, "sim_compute_robot_state-npc1": 0.06753432309186017, "sim_compute_robot_state-npc2": 0.06782774572019223, "sim_compute_robot_state-npc3": 0.07269909646775988}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.03594499353378538, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.04881251236749074, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.10793745517730712, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.07564974777282231, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.031177420464773023, "sim_compute_performance-ego": 0.059195707714746866, "sim_compute_robot_state-ego": 0.05602900754837763, "sim_compute_robot_state-npc0": 0.054897824923197426, "sim_compute_robot_state-npc1": 0.05446715203542558, "sim_compute_robot_state-npc2": 0.05419677401345874, "sim_compute_robot_state-npc3": 0.05314086164746966}}
set_robot_commands_max	0.09672101338704428
set_robot_commands_mean	0.08184087143845391
set_robot_commands_median	0.0847188485296149
set_robot_commands_min	0.06416801820721543
sim_compute_performance-ego_max	0.06573751237657335
sim_compute_performance-ego_mean	0.058509070502214613
sim_compute_performance-ego_median	0.05991782640155993
sim_compute_performance-ego_min	0.04604519459239224
sim_compute_robot_state-ego_max	0.0682531197865804
sim_compute_robot_state-ego_mean	0.06035156192757922
sim_compute_robot_state-ego_median	0.06436108479833906
sim_compute_robot_state-ego_min	0.046895010429516173
sim_compute_robot_state-npc0_max	0.06966160473070647
sim_compute_robot_state-npc0_mean	0.06087190578681312
sim_compute_robot_state-npc0_median	0.06255469656294319
sim_compute_robot_state-npc0_min	0.050086694851256254
sim_compute_robot_state-npc1_max	0.06753432309186017
sim_compute_robot_state-npc1_mean	0.059343860871959045
sim_compute_robot_state-npc1_median	0.06176670949170544
sim_compute_robot_state-npc1_min	0.048310020513701854
sim_compute_robot_state-npc2_max	0.06782774572019223
sim_compute_robot_state-npc2_mean	0.059520244928537094
sim_compute_robot_state-npc2_median	0.06189585491350502
sim_compute_robot_state-npc2_min	0.04727683987533837
sim_compute_robot_state-npc3_max	0.07269909646775988
sim_compute_robot_state-npc3_mean	0.059972273151807386
sim_compute_robot_state-npc3_median	0.06142718169339903
sim_compute_robot_state-npc3_min	0.04617884702849807
sim_compute_sim_state_max	0.03902451197306315
sim_compute_sim_state_mean	0.0338343587170426
sim_compute_sim_state_median	0.03559883233088597
sim_compute_sim_state_min	0.027214932859989636
sim_physics_max	0.046562380260891385
sim_physics_mean	0.03886226917980322
sim_physics_median	0.037559550279265
sim_physics_min	0.0281550549624259
sim_render-ego_max	0.06520596256962528
sim_render-ego_mean	0.05509552350910739
sim_render-ego_median	0.057377516084415894
sim_render-ego_min	0.04539442898934347
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	4.049999999999993
survival_time_min	1.3500000000000003

No reset possible

19823

2762

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 08:17:10+00:00

2019-04-25 08:26:38+00:00

0:09:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4677520238097679
survival_time_median	2.849999999999998
deviation-center-line_median	0.13993923038273243
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.06947800763853036
agent_compute-ego_mean	0.0646434581873045
agent_compute-ego_median	0.06473587688646819
agent_compute-ego_min	0.06003295747857345
deviation-center-line_max	0.441991081977021
deviation-center-line_mean	0.24301419493149473
deviation-center-line_min	0.11233303566656118
deviation-heading_max	1.965590298952019
deviation-heading_mean	0.904977224642509
deviation-heading_median	0.6817498444220604
deviation-heading_min	0.23880859753921196
driven_any_max	2.234618045439434
driven_any_mean	1.1136680430892796
driven_any_median	0.7854280860806753
driven_any_min	0.3734823939695258
driven_lanedir_consec_max	1.4162453958283412
driven_lanedir_consec_mean	0.7217431069832176
driven_lanedir_consec_min	0.3618460409658957
driven_lanedir_max	1.4162453958283412
driven_lanedir_mean	0.7217431069832176
driven_lanedir_median	0.4677520238097679
driven_lanedir_min	0.3618460409658957
in-drivable-lane_max	3.2999999999999883
in-drivable-lane_mean	0.9999999999999964
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.04236355860521839, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.06008501569176935, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.06947800763853036, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.09184101432751698, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.03657559680331285, "sim_compute_performance-ego": 0.06573300908325584, "sim_compute_robot_state-ego": 0.07020825337452494, "sim_compute_robot_state-npc0": 0.06559298144783943, "sim_compute_robot_state-npc1": 0.06420793958530305, "sim_compute_robot_state-npc2": 0.06428164281662863, "sim_compute_robot_state-npc3": 0.06602163223703955}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.03526498769458972, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.05904713429902729, "in-drivable-lane": 0, "agent_compute-ego": 0.06473587688646819, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.08369195461273193, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.03421623455850702, "sim_compute_performance-ego": 0.059363634962784614, "sim_compute_robot_state-ego": 0.06070618880422492, "sim_compute_robot_state-npc0": 0.059661607993276494, "sim_compute_robot_state-npc1": 0.057435437252647, "sim_compute_robot_state-npc2": 0.062394675455595315, "sim_compute_robot_state-npc3": 0.06004041747043008}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.03645985586601391, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.05703197027507581, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.06003295747857345, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.08007520960088362, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.03357405411569696, "sim_compute_performance-ego": 0.06125096270912572, "sim_compute_robot_state-ego": 0.06245375934400057, "sim_compute_robot_state-npc0": 0.0608192995974892, "sim_compute_robot_state-npc1": 0.06303244724608305, "sim_compute_robot_state-npc2": 0.060510693934925815, "sim_compute_robot_state-npc3": 0.06242689751742179}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.034875587180808736, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.05072370281925908, "in-drivable-lane": 0, "agent_compute-ego": 0.06011721822950575, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.0789644894776521, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.033354255888197154, "sim_compute_performance-ego": 0.058951757572315355, "sim_compute_robot_state-ego": 0.05584758299368399, "sim_compute_robot_state-npc0": 0.05365845009132668, "sim_compute_robot_state-npc1": 0.05084016587999132, "sim_compute_robot_state-npc2": 0.057753677721376774, "sim_compute_robot_state-npc3": 0.05708841041282371}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.04659710233173673, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.061370978279719275, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.0688532307034447, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.09256070190005831, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.037394430902269155, "sim_compute_performance-ego": 0.0689672174907866, "sim_compute_robot_state-ego": 0.07243238933502681, "sim_compute_robot_state-npc0": 0.06637928977845207, "sim_compute_robot_state-npc1": 0.06657306542472234, "sim_compute_robot_state-npc2": 0.06662396968357147, "sim_compute_robot_state-npc3": 0.06744358653113955}}
set_robot_commands_max	0.09256070190005831
set_robot_commands_mean	0.0854266739837686
set_robot_commands_median	0.08369195461273193
set_robot_commands_min	0.0789644894776521
sim_compute_performance-ego_max	0.0689672174907866
sim_compute_performance-ego_mean	0.06285331636365363
sim_compute_performance-ego_median	0.06125096270912572
sim_compute_performance-ego_min	0.058951757572315355
sim_compute_robot_state-ego_max	0.07243238933502681
sim_compute_robot_state-ego_mean	0.06432963477029226
sim_compute_robot_state-ego_median	0.06245375934400057
sim_compute_robot_state-ego_min	0.05584758299368399
sim_compute_robot_state-npc0_max	0.06637928977845207
sim_compute_robot_state-npc0_mean	0.06122232578167678
sim_compute_robot_state-npc0_median	0.0608192995974892
sim_compute_robot_state-npc0_min	0.05365845009132668
sim_compute_robot_state-npc1_max	0.06657306542472234
sim_compute_robot_state-npc1_mean	0.06041781107774935
sim_compute_robot_state-npc1_median	0.06303244724608305
sim_compute_robot_state-npc1_min	0.05084016587999132
sim_compute_robot_state-npc2_max	0.06662396968357147
sim_compute_robot_state-npc2_mean	0.0623129319224196
sim_compute_robot_state-npc2_median	0.062394675455595315
sim_compute_robot_state-npc2_min	0.057753677721376774
sim_compute_robot_state-npc3_max	0.06744358653113955
sim_compute_robot_state-npc3_mean	0.06260418883377092
sim_compute_robot_state-npc3_median	0.06242689751742179
sim_compute_robot_state-npc3_min	0.05708841041282371
sim_compute_sim_state_max	0.037394430902269155
sim_compute_sim_state_mean	0.03502291445359663
sim_compute_sim_state_median	0.03421623455850702
sim_compute_sim_state_min	0.033354255888197154
sim_physics_max	0.04659710233173673
sim_physics_mean	0.0391122183356735
sim_physics_median	0.03645985586601391
sim_physics_min	0.034875587180808736
sim_render-ego_max	0.061370978279719275
sim_render-ego_mean	0.05765176027297016
sim_render-ego_median	0.05904713429902729
sim_render-ego_min	0.05072370281925908
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	4.049999999999993
survival_time_min	1.3500000000000003

No reset possible

19801

2443

Jacopo Tani

random_agent

step1-simulation

success

2019-04-25 08:09:23+00:00

2019-04-25 08:16:57+00:00

0:07:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.630782078032722
survival_time_median	2.6499999999999986
deviation-center-line_median	0.10342694179960472
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.13560895317966498
agent_compute-ego_mean	0.12851182453576976
agent_compute-ego_median	0.124824511377435
agent_compute-ego_min	0.12242440713776484
deviation-center-line_max	0.24274593434117447
deviation-center-line_mean	0.1423794188959262
deviation-center-line_min	0.05838775199208855
deviation-heading_max	0.9510803390140998
deviation-heading_mean	0.5404741772455786
deviation-heading_median	0.4662935751765816
deviation-heading_min	0.3138996563005005
driven_any_max	2.1937495917222662
driven_any_mean	1.101203967779493
driven_any_median	1.072953759306336
driven_any_min	0.3121624499492532
driven_lanedir_consec_max	1.8128454170816104
driven_lanedir_consec_mean	0.8194262040404128
driven_lanedir_consec_min	0.29255031695938905
driven_lanedir_max	1.8128454170816104
driven_lanedir_mean	0.8194262040404128
driven_lanedir_median	0.630782078032722
driven_lanedir_min	0.29255031695938905
in-drivable-lane_max	1.0499999999999965
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.0389083292749193, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.05364161729812622, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.12242440713776484, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.07821219828393725, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.03355409370528327, "sim_compute_performance-ego": 0.057764023542404175, "sim_compute_robot_state-ego": 0.05921874112553067, "sim_compute_robot_state-npc0": 0.06035397450129191, "sim_compute_robot_state-npc1": 0.05952709913253784, "sim_compute_robot_state-npc2": 0.05881980392667982, "sim_compute_robot_state-npc3": 0.05892566508717007}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.0368764841998065, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.05758798563921893, "in-drivable-lane": 0, "agent_compute-ego": 0.12428980403476292, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.08525187880904586, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.03549894580134639, "sim_compute_performance-ego": 0.06079191631740994, "sim_compute_robot_state-ego": 0.06297152130692094, "sim_compute_robot_state-npc0": 0.06239006254408094, "sim_compute_robot_state-npc1": 0.06336411723384151, "sim_compute_robot_state-npc2": 0.06411649562694409, "sim_compute_robot_state-npc3": 0.06546853206775806}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.04042688851217622, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.05749824209120667, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13560895317966498, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.08587686297962967, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.03564228594881817, "sim_compute_performance-ego": 0.06234768061961943, "sim_compute_robot_state-ego": 0.06607304961935988, "sim_compute_robot_state-npc0": 0.06241645627808802, "sim_compute_robot_state-npc1": 0.06163189249131286, "sim_compute_robot_state-npc2": 0.062020165248981955, "sim_compute_robot_state-npc3": 0.06305526529701011}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.04383547351045428, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.05707222560666642, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.13541144694922105, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.0871871642346652, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.03746329163605312, "sim_compute_performance-ego": 0.06144162393965811, "sim_compute_robot_state-ego": 0.07202713894394208, "sim_compute_robot_state-npc0": 0.06276145071353552, "sim_compute_robot_state-npc1": 0.06287861770054079, "sim_compute_robot_state-npc2": 0.06338413706365621, "sim_compute_robot_state-npc3": 0.06545431658906757}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.036057748292621816, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.05476691848353336, "in-drivable-lane": 0, "agent_compute-ego": 0.124824511377435, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.07754658397875334, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.032128334045410156, "sim_compute_performance-ego": 0.06287432971753572, "sim_compute_robot_state-ego": 0.056121374431409334, "sim_compute_robot_state-npc0": 0.05916727216620194, "sim_compute_robot_state-npc1": 0.0619697696284244, "sim_compute_robot_state-npc2": 0.06379571713899311, "sim_compute_robot_state-npc3": 0.06017964764645225}}
set_robot_commands_max	0.0871871642346652
set_robot_commands_mean	0.08281493765720627
set_robot_commands_median	0.08525187880904586
set_robot_commands_min	0.07754658397875334
sim_compute_performance-ego_max	0.06287432971753572
sim_compute_performance-ego_mean	0.06104391482732548
sim_compute_performance-ego_median	0.06144162393965811
sim_compute_performance-ego_min	0.057764023542404175
sim_compute_robot_state-ego_max	0.07202713894394208
sim_compute_robot_state-ego_mean	0.06328236508543258
sim_compute_robot_state-ego_median	0.06297152130692094
sim_compute_robot_state-ego_min	0.056121374431409334
sim_compute_robot_state-npc0_max	0.06276145071353552
sim_compute_robot_state-npc0_mean	0.06141784324063966
sim_compute_robot_state-npc0_median	0.06239006254408094
sim_compute_robot_state-npc0_min	0.05916727216620194
sim_compute_robot_state-npc1_max	0.06336411723384151
sim_compute_robot_state-npc1_mean	0.061874299237331475
sim_compute_robot_state-npc1_median	0.0619697696284244
sim_compute_robot_state-npc1_min	0.05952709913253784
sim_compute_robot_state-npc2_max	0.06411649562694409
sim_compute_robot_state-npc2_mean	0.062427263801051035
sim_compute_robot_state-npc2_median	0.06338413706365621
sim_compute_robot_state-npc2_min	0.05881980392667982
sim_compute_robot_state-npc3_max	0.06546853206775806
sim_compute_robot_state-npc3_mean	0.06261668533749161
sim_compute_robot_state-npc3_median	0.06305526529701011
sim_compute_robot_state-npc3_min	0.05892566508717007
sim_compute_sim_state_max	0.03746329163605312
sim_compute_sim_state_mean	0.034857390227382226
sim_compute_sim_state_median	0.03549894580134639
sim_compute_sim_state_min	0.032128334045410156
sim_physics_max	0.04383547351045428
sim_physics_mean	0.03922098475799562
sim_physics_median	0.0389083292749193
sim_physics_min	0.036057748292621816
sim_render-ego_max	0.05758798563921893
sim_render-ego_mean	0.05611339782375032
sim_render-ego_median	0.05707222560666642
sim_render-ego_min	0.05364161729812622
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.739999999999997
survival_time_min	0.9500000000000004

No reset possible

19798

2463

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:08:09+00:00

2019-04-25 08:08:41+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19796

2487

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:07:14+00:00

2019-04-25 08:07:56+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19793

2512

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:04:54+00:00

2019-04-25 08:06:55+00:00

0:02:01

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19784

2581

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:00:21+00:00

2019-04-25 08:04:47+00:00

0:04:26

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19773

2612

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-25 07:55:10+00:00

2019-04-25 08:00:08+00:00

0:04:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19773-71876', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19773-71876', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19773-71876', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19770

2672

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-25 07:54:10+00:00

2019-04-25 07:54:46+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19763

2750

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 07:52:17+00:00

2019-04-25 07:54:03+00:00

0:01:46

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19745

3014

Manfred Diaz

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 07:45:29+00:00

2019-04-25 07:52:03+00:00

0:06:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19733

3042

Manfred Diaz

challenge-aido_LF-template-tensorflow

step1-simulation

error