Evaluator 799

aido2-AMOD-service_quality

2019-04-26 11:58:12+00:00

2019-04-26 11:58:54+00:00

0:00:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-76.76604139020243

other stats

fleet_size	-1000000000
service_quality	-35.53683034755051

No reset possible

20667

3081

Andrea Censi 🇨🇭

Java template

step2-scoring

success

yes

2019-04-26 10:30:00+00:00

2019-04-26 10:30:45+00:00

0:00:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

service_quality

-32.77804632683164

other stats

efficiency	-63.9236253073247
fleet_size	-1000000000

No reset possible

20645

3064

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 16:53:36+00:00

2019-04-25 17:00:05+00:00

0:06:29

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20645-948128', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20645-948128', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20645-948128', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20631

2411

jiang peng

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 15:06:07+00:00

2019-04-25 15:32:05+00:00

0:25:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3401047463162574
survival_time_median	14.950000000000076
deviation-center-line_median	1.0020903216633783
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.17176002820332845
agent_compute-ego_mean	0.12204015366236368
agent_compute-ego_median	0.11248900810877482
agent_compute-ego_min	0.09440053383509318
deviation-center-line_max	1.5200593248921646
deviation-center-line_mean	0.9234182563504314
deviation-center-line_min	0.2826572656098777
deviation-heading_max	8.488415384770876
deviation-heading_mean	7.083018992579007
deviation-heading_median	7.0891261288876
deviation-heading_min	5.694184625828924
driven_any_max	4.378320939674847
driven_any_mean	4.378320939674838
driven_any_median	4.378320939674838
driven_any_min	4.378320939674826
driven_lanedir_consec_max	-1.273127772600478
driven_lanedir_consec_mean	-1.3316670653980158
driven_lanedir_consec_min	-1.367352616124776
driven_lanedir_max	-1.3666338643676914
driven_lanedir_mean	-2.0778269948498607
driven_lanedir_median	-2.2611414102685594
driven_lanedir_min	-2.711272268924253
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.630000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.19129326740900676, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272268924253, "sim_render-ego": 0.06343587795893352, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17176002820332845, "deviation-heading": 8.371542541054902, "set_robot_commands": 0.09772371212641398, "deviation-center-line": 1.5194332589791988, "driven_lanedir_consec": -1.3111163275808764, "sim_compute_sim_state": 0.039373788038889565, "sim_compute_performance-ego": 0.07034837643305461, "sim_compute_robot_state-ego": 0.07692952553431193, "sim_compute_robot_state-npc0": 0.07080392916997273, "sim_compute_robot_state-npc1": 0.07028461933135986, "sim_compute_robot_state-npc2": 0.07049554586410522, "sim_compute_robot_state-npc3": 0.0695264220237732}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378320939674847, "sim_physics": 0.1340763250986735, "survival_time": 14.950000000000076, "driven_lanedir": -2.682734814564024, "sim_render-ego": 0.05039045810699463, "in-drivable-lane": 2.2000000000000113, "agent_compute-ego": 0.1363119093577067, "deviation-heading": 8.488415384770876, "set_robot_commands": 0.07534023523330688, "deviation-center-line": 1.5200593248921646, "driven_lanedir_consec": -1.273127772600478, "sim_compute_sim_state": 0.03233621517817179, "sim_compute_performance-ego": 0.056222188472747806, "sim_compute_robot_state-ego": 0.05874327262242635, "sim_compute_robot_state-npc0": 0.05570621569951376, "sim_compute_robot_state-npc1": 0.05592594067255656, "sim_compute_robot_state-npc2": 0.0549956758817037, "sim_compute_robot_state-npc3": 0.05695647875467936}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378320939674833, "sim_physics": 0.1098434829711914, "survival_time": 14.950000000000076, "driven_lanedir": -1.3666338643676914, "sim_render-ego": 0.04247534434000651, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.11248900810877482, "deviation-heading": 5.77182628235273, "set_robot_commands": 0.062308974266052246, "deviation-center-line": 0.2928511106075376, "driven_lanedir_consec": -1.3666338643676914, "sim_compute_sim_state": 0.025874507427215577, "sim_compute_performance-ego": 0.04513632376988729, "sim_compute_robot_state-ego": 0.04728602091471354, "sim_compute_robot_state-npc0": 0.04693693081537882, "sim_compute_robot_state-npc1": 0.04644408146540324, "sim_compute_robot_state-npc2": 0.04493984699249268, "sim_compute_robot_state-npc3": 0.045886677900950114}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378320939674826, "sim_physics": 0.09544845422108968, "survival_time": 14.950000000000076, "driven_lanedir": -1.367352616124776, "sim_render-ego": 0.03542572418848673, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.09523928880691528, "deviation-heading": 5.694184625828924, "set_robot_commands": 0.05361903111139933, "deviation-center-line": 0.2826572656098777, "driven_lanedir_consec": -1.367352616124776, "sim_compute_sim_state": 0.022737232049306232, "sim_compute_performance-ego": 0.03837134838104248, "sim_compute_robot_state-ego": 0.03998934984207153, "sim_compute_robot_state-npc0": 0.039894153277079264, "sim_compute_robot_state-npc1": 0.039584770997365314, "sim_compute_robot_state-npc2": 0.03912154754002889, "sim_compute_robot_state-npc3": 0.039034960269927976}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378320939674838, "sim_physics": 0.09071681499481202, "survival_time": 14.950000000000076, "driven_lanedir": -2.2611414102685594, "sim_render-ego": 0.03550846735636393, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.09440053383509318, "deviation-heading": 7.0891261288876, "set_robot_commands": 0.05380910158157349, "deviation-center-line": 1.0020903216633783, "driven_lanedir_consec": -1.3401047463162574, "sim_compute_sim_state": 0.02244178533554077, "sim_compute_performance-ego": 0.03796476602554321, "sim_compute_robot_state-ego": 0.03993637402852376, "sim_compute_robot_state-npc0": 0.039798295497894286, "sim_compute_robot_state-npc1": 0.03899137655893962, "sim_compute_robot_state-npc2": 0.038736046950022376, "sim_compute_robot_state-npc3": 0.03888755480448405}}
set_robot_commands_max	0.09772371212641398
set_robot_commands_mean	0.06856021086374918
set_robot_commands_median	0.062308974266052246
set_robot_commands_min	0.05361903111139933
sim_compute_performance-ego_max	0.07034837643305461
sim_compute_performance-ego_mean	0.04960860061645509
sim_compute_performance-ego_median	0.04513632376988729
sim_compute_performance-ego_min	0.03796476602554321
sim_compute_robot_state-ego_max	0.07692952553431193
sim_compute_robot_state-ego_mean	0.052576908588409424
sim_compute_robot_state-ego_median	0.04728602091471354
sim_compute_robot_state-ego_min	0.03993637402852376
sim_compute_robot_state-npc0_max	0.07080392916997273
sim_compute_robot_state-npc0_mean	0.050627904891967765
sim_compute_robot_state-npc0_median	0.04693693081537882
sim_compute_robot_state-npc0_min	0.039798295497894286
sim_compute_robot_state-npc1_max	0.07028461933135986
sim_compute_robot_state-npc1_mean	0.050246157805124925
sim_compute_robot_state-npc1_median	0.04644408146540324
sim_compute_robot_state-npc1_min	0.03899137655893962
sim_compute_robot_state-npc2_max	0.07049554586410522
sim_compute_robot_state-npc2_mean	0.04965773264567057
sim_compute_robot_state-npc2_median	0.04493984699249268
sim_compute_robot_state-npc2_min	0.038736046950022376
sim_compute_robot_state-npc3_max	0.0695264220237732
sim_compute_robot_state-npc3_mean	0.05005841875076293
sim_compute_robot_state-npc3_median	0.045886677900950114
sim_compute_robot_state-npc3_min	0.03888755480448405
sim_compute_sim_state_max	0.039373788038889565
sim_compute_sim_state_mean	0.02855270560582479
sim_compute_sim_state_median	0.025874507427215577
sim_compute_sim_state_min	0.02244178533554077
sim_physics_max	0.19129326740900676
sim_physics_mean	0.12427566893895468
sim_physics_median	0.1098434829711914
sim_physics_min	0.09071681499481202
sim_render-ego_max	0.06343587795893352
sim_render-ego_mean	0.045447174390157066
sim_render-ego_median	0.04247534434000651
sim_render-ego_min	0.03542572418848673
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20617

2372

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-25 14:59:58+00:00

2019-04-25 15:00:12+00:00

0:00:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20617-293671', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20617-293671', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20617-293671', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20604

2387

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:53:40+00:00

2019-04-25 14:59:22+00:00

0:05:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08686491948408959
survival_time_median	1.2500000000000004
deviation-center-line_median	0.0734608066701356
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18032453276894309
agent_compute-ego_mean	0.169384933959197
agent_compute-ego_median	0.172618523887966
agent_compute-ego_min	0.15701388276141623
deviation-center-line_max	0.10486262989674536
deviation-center-line_mean	0.0799815716637785
deviation-center-line_min	0.05447500238481362
deviation-heading_max	0.9459134884619168
deviation-heading_mean	0.7468630106710579
deviation-heading_median	0.8203771655433735
deviation-heading_min	0.5236091479359667
driven_any_max	0.2137891436995623
driven_any_mean	0.16291485759041585
driven_any_median	0.13727494835738543
driven_any_min	0.1190856108416936
driven_lanedir_consec_max	0.09847101259977876
driven_lanedir_consec_mean	0.08873363282868545
driven_lanedir_consec_min	0.07480462838142965
driven_lanedir_max	0.09847101259977876
driven_lanedir_mean	0.08873363282868545
driven_lanedir_median	0.08686491948408959
driven_lanedir_min	0.07480462838142965
in-drivable-lane_max	0.4000000000000003
in-drivable-lane_mean	0.14000000000000012
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2137891436995623, "sim_physics": 0.15612768404411548, "survival_time": 1.6500000000000008, "driven_lanedir": 0.0976754447548236, "sim_render-ego": 0.05993844523574367, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.1583611820683335, "deviation-heading": 0.8413153731463963, "set_robot_commands": 0.08895105304140033, "deviation-center-line": 0.0734608066701356, "driven_lanedir_consec": 0.0976754447548236, "sim_compute_sim_state": 0.036610357689135, "sim_compute_performance-ego": 0.06789969675468677, "sim_compute_robot_state-ego": 0.07698304725415779, "sim_compute_robot_state-npc0": 0.06111175363714045, "sim_compute_robot_state-npc1": 0.0629859042890144, "sim_compute_robot_state-npc2": 0.06414031259941333, "sim_compute_robot_state-npc3": 0.06420529249942664}, "udem1-1-0": {"driven_any": 0.20906813288843024, "sim_physics": 0.1812153874021588, "survival_time": 1.6500000000000008, "driven_lanedir": 0.08585215892330567, "sim_render-ego": 0.06517910234855884, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.18032453276894309, "deviation-heading": 0.9459134884619168, "set_robot_commands": 0.09001133658669212, "deviation-center-line": 0.06746981364142746, "driven_lanedir_consec": 0.08585215892330567, "sim_compute_sim_state": 0.037609678326231064, "sim_compute_performance-ego": 0.06444196990042021, "sim_compute_robot_state-ego": 0.0707916563207453, "sim_compute_robot_state-npc0": 0.07330583081100926, "sim_compute_robot_state-npc1": 0.06315497196081912, "sim_compute_robot_state-npc2": 0.061172528700395065, "sim_compute_robot_state-npc3": 0.06424450874328613}, "udem1-2-0": {"driven_any": 0.1190856108416936, "sim_physics": 0.19387840188067892, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08686491948408959, "sim_render-ego": 0.06072193643321162, "in-drivable-lane": 0, "agent_compute-ego": 0.172618523887966, "deviation-heading": 0.5236091479359667, "set_robot_commands": 0.10238660936770232, "deviation-center-line": 0.09963960572577052, "driven_lanedir_consec": 0.08686491948408959, "sim_compute_sim_state": 0.04007086546524712, "sim_compute_performance-ego": 0.06683098751565685, "sim_compute_robot_state-ego": 0.07517341945482336, "sim_compute_robot_state-npc0": 0.07475049599357274, "sim_compute_robot_state-npc1": 0.07666993141174316, "sim_compute_robot_state-npc2": 0.06947185682213824, "sim_compute_robot_state-npc3": 0.06865937813468602}, "udem1-3-0": {"driven_any": 0.13727494835738543, "sim_physics": 0.1822307014465332, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09847101259977876, "sim_render-ego": 0.06447862625122071, "in-drivable-lane": 0, "agent_compute-ego": 0.17860654830932618, "deviation-heading": 0.6030998782676362, "set_robot_commands": 0.09788979530334473, "deviation-center-line": 0.10486262989674536, "driven_lanedir_consec": 0.09847101259977876, "sim_compute_sim_state": 0.037667150497436526, "sim_compute_performance-ego": 0.07013145446777344, "sim_compute_robot_state-ego": 0.07598311424255372, "sim_compute_robot_state-npc0": 0.06987318992614747, "sim_compute_robot_state-npc1": 0.06900105476379395, "sim_compute_robot_state-npc2": 0.07163698196411133, "sim_compute_robot_state-npc3": 0.07078768730163575}, "udem1-4-0": {"driven_any": 0.13535645216500758, "sim_physics": 0.14581749750220258, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07480462838142965, "sim_render-ego": 0.06020696266837742, "in-drivable-lane": 0, "agent_compute-ego": 0.15701388276141623, "deviation-heading": 0.8203771655433735, "set_robot_commands": 0.09190194503120754, "deviation-center-line": 0.05447500238481362, "driven_lanedir_consec": 0.07480462838142965, "sim_compute_sim_state": 0.03893532960311226, "sim_compute_performance-ego": 0.061395728069802986, "sim_compute_robot_state-ego": 0.06371567560278851, "sim_compute_robot_state-npc0": 0.06351493752521017, "sim_compute_robot_state-npc1": 0.0608373206594716, "sim_compute_robot_state-npc2": 0.06231337008268937, "sim_compute_robot_state-npc3": 0.060292596402375595}}
set_robot_commands_max	0.10238660936770232
set_robot_commands_mean	0.0942281478660694
set_robot_commands_median	0.09190194503120754
set_robot_commands_min	0.08895105304140033
sim_compute_performance-ego_max	0.07013145446777344
sim_compute_performance-ego_mean	0.06613996734166805
sim_compute_performance-ego_median	0.06683098751565685
sim_compute_performance-ego_min	0.061395728069802986
sim_compute_robot_state-ego_max	0.07698304725415779
sim_compute_robot_state-ego_mean	0.07252938257501373
sim_compute_robot_state-ego_median	0.07517341945482336
sim_compute_robot_state-ego_min	0.06371567560278851
sim_compute_robot_state-npc0_max	0.07475049599357274
sim_compute_robot_state-npc0_mean	0.06851124157861603
sim_compute_robot_state-npc0_median	0.06987318992614747
sim_compute_robot_state-npc0_min	0.06111175363714045
sim_compute_robot_state-npc1_max	0.07666993141174316
sim_compute_robot_state-npc1_mean	0.06652983661696846
sim_compute_robot_state-npc1_median	0.06315497196081912
sim_compute_robot_state-npc1_min	0.0608373206594716
sim_compute_robot_state-npc2_max	0.07163698196411133
sim_compute_robot_state-npc2_mean	0.06574701003374947
sim_compute_robot_state-npc2_median	0.06414031259941333
sim_compute_robot_state-npc2_min	0.061172528700395065
sim_compute_robot_state-npc3_max	0.07078768730163575
sim_compute_robot_state-npc3_mean	0.06563789261628203
sim_compute_robot_state-npc3_median	0.06424450874328613
sim_compute_robot_state-npc3_min	0.060292596402375595
sim_compute_sim_state_max	0.04007086546524712
sim_compute_sim_state_mean	0.0381786763162324
sim_compute_sim_state_median	0.037667150497436526
sim_compute_sim_state_min	0.036610357689135
sim_physics_max	0.19387840188067892
sim_physics_mean	0.1718539344551378
sim_physics_median	0.1812153874021588
sim_physics_min	0.14581749750220258
sim_render-ego_max	0.06517910234855884
sim_render-ego_mean	0.06210501458742245
sim_render-ego_median	0.06072193643321162
sim_render-ego_min	0.05993844523574367
simulation-passed	1
survival_time_max	1.6500000000000008
survival_time_mean	1.3700000000000006
survival_time_min	1.1500000000000004

No reset possible

20593

2402

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:47:25+00:00

2019-04-25 14:53:04+00:00

0:05:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09919907807580886
survival_time_median	1.5000000000000009
deviation-center-line_median	0.06971172657469797
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.1942539135615031
agent_compute-ego_mean	0.16613489606166548
agent_compute-ego_median	0.1643351157506307
agent_compute-ego_min	0.1296726042224515
deviation-center-line_max	0.081242689658235
deviation-center-line_mean	0.06702556003202452
deviation-center-line_min	0.037570072821287645
deviation-heading_max	0.9291207793480484
deviation-heading_mean	0.7503092535192172
deviation-heading_median	0.7713197616144701
deviation-heading_min	0.5904978211385428
driven_any_max	0.21271905744068045
driven_any_mean	0.17915112688452092
driven_any_median	0.20178821289645243
driven_any_min	0.09315216224994802
driven_lanedir_consec_max	0.13812494474702763
driven_lanedir_consec_mean	0.1042791946118461
driven_lanedir_consec_min	0.05662537925199107
driven_lanedir_max	0.13812494474702763
driven_lanedir_mean	0.1042791946118461
driven_lanedir_median	0.09919907807580886
driven_lanedir_min	0.05662537925199107
in-drivable-lane_max	0.30000000000000027
in-drivable-lane_mean	0.1200000000000001
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20727970424482117, "sim_physics": 0.07140488778391192, "survival_time": 1.5500000000000007, "driven_lanedir": 0.09726441259548092, "sim_render-ego": 0.051401292124102195, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.1296726042224515, "deviation-heading": 0.7713197616144701, "set_robot_commands": 0.0683577214517901, "deviation-center-line": 0.06971172657469797, "driven_lanedir_consec": 0.09726441259548092, "sim_compute_sim_state": 0.029374453329270887, "sim_compute_performance-ego": 0.05531363333425214, "sim_compute_robot_state-ego": 0.05277263733648485}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1808164975907026, "sim_physics": 0.10897693634033204, "survival_time": 1.5000000000000009, "driven_lanedir": 0.09919907807580886, "sim_render-ego": 0.06688135464986165, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1942539135615031, "deviation-heading": 0.6578766457102113, "set_robot_commands": 0.09832218488057456, "deviation-center-line": 0.037570072821287645, "driven_lanedir_consec": 0.09919907807580886, "sim_compute_sim_state": 0.03932268619537353, "sim_compute_performance-ego": 0.0702286958694458, "sim_compute_robot_state-ego": 0.07811230818430583}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09315216224994802, "sim_physics": 0.08917550036781713, "survival_time": 0.9500000000000004, "driven_lanedir": 0.05662537925199107, "sim_render-ego": 0.06038717219704076, "in-drivable-lane": 0, "agent_compute-ego": 0.1627673726332815, "deviation-heading": 0.5904978211385428, "set_robot_commands": 0.0967300063685367, "deviation-center-line": 0.081242689658235, "driven_lanedir_consec": 0.05662537925199107, "sim_compute_sim_state": 0.03651459593521921, "sim_compute_performance-ego": 0.06912349399767424, "sim_compute_robot_state-ego": 0.07728812569066097}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20178821289645243, "sim_physics": 0.10217443796304557, "survival_time": 1.3000000000000005, "driven_lanedir": 0.130182158388922, "sim_render-ego": 0.06572989317087027, "in-drivable-lane": 0, "agent_compute-ego": 0.17964547414046067, "deviation-heading": 0.9291207793480484, "set_robot_commands": 0.09843094532306378, "deviation-center-line": 0.07976585676496195, "driven_lanedir_consec": 0.130182158388922, "sim_compute_sim_state": 0.03879849727337177, "sim_compute_performance-ego": 0.07360493219815768, "sim_compute_robot_state-ego": 0.07813216172731839}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21271905744068045, "sim_physics": 0.09940402507781984, "survival_time": 1.5000000000000009, "driven_lanedir": 0.13812494474702763, "sim_render-ego": 0.06575761636098226, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1643351157506307, "deviation-heading": 0.8027312597848134, "set_robot_commands": 0.08569619655609131, "deviation-center-line": 0.06683745434094007, "driven_lanedir_consec": 0.13812494474702763, "sim_compute_sim_state": 0.036327179272969565, "sim_compute_performance-ego": 0.06521886984507243, "sim_compute_robot_state-ego": 0.06820969581604004}}
set_robot_commands_max	0.09843094532306378
set_robot_commands_mean	0.08950741091601129
set_robot_commands_median	0.0967300063685367
set_robot_commands_min	0.0683577214517901
sim_compute_performance-ego_max	0.07360493219815768
sim_compute_performance-ego_mean	0.06669792504892046
sim_compute_performance-ego_median	0.06912349399767424
sim_compute_performance-ego_min	0.05531363333425214
sim_compute_robot_state-ego_max	0.07813216172731839
sim_compute_robot_state-ego_mean	0.07090298575096202
sim_compute_robot_state-ego_median	0.07728812569066097
sim_compute_robot_state-ego_min	0.05277263733648485
sim_compute_sim_state_max	0.03932268619537353
sim_compute_sim_state_mean	0.03606748240124099
sim_compute_sim_state_median	0.03651459593521921
sim_compute_sim_state_min	0.029374453329270887
sim_physics_max	0.10897693634033204
sim_physics_mean	0.0942271575065853
sim_physics_median	0.09940402507781984
sim_physics_min	0.07140488778391192
sim_render-ego_max	0.06688135464986165
sim_render-ego_mean	0.06203146570057143
sim_render-ego_median	0.06572989317087027
sim_render-ego_min	0.051401292124102195
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.3600000000000008
survival_time_min	0.9500000000000004

No reset possible

20555

2450

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:10:21+00:00

2019-04-25 14:47:19+00:00

0:36:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3401138062222346
survival_time_median	14.950000000000076
deviation-center-line_median	1.0020906406379184
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.16174415508906043
agent_compute-ego_mean	0.15938228130340576
agent_compute-ego_median	0.1594925864537557
agent_compute-ego_min	0.15699501355489096
deviation-center-line_max	1.5200592903810726
deviation-center-line_mean	0.9234183234449912
deviation-center-line_min	0.28265732013386635
deviation-heading_max	8.488415384770875
deviation-heading_mean	7.083018992579007
deviation-heading_median	7.089126128887597
deviation-heading_min	5.694184625828925
driven_any_max	4.378320939674843
driven_any_mean	4.378320939674839
driven_any_median	4.378320939674839
driven_any_min	4.378320939674832
driven_lanedir_consec_max	-1.2731239579032123
driven_lanedir_consec_mean	-1.331671690718409
driven_lanedir_consec_min	-1.3673592918445536
driven_lanedir_max	-1.366645308459499
driven_lanedir_mean	-2.07783178706321
driven_lanedir_median	-2.2611460594308452
driven_lanedir_min	-2.711272030505655
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.630000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"udem1-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.19731568336486816, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272030505655, "sim_render-ego": 0.05951244592666626, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16005189736684164, "deviation-heading": 8.371542541054898, "set_robot_commands": 0.09191433350245158, "deviation-center-line": 1.5194332899756515, "driven_lanedir_consec": -1.3111160891625455, "sim_compute_sim_state": 0.03795253117879232, "sim_compute_performance-ego": 0.06452972968419393, "sim_compute_robot_state-ego": 0.06895569006601969, "sim_compute_robot_state-npc0": 0.0674901779492696, "sim_compute_robot_state-npc1": 0.06580619653066, "sim_compute_robot_state-npc2": 0.06489685694376628, "sim_compute_robot_state-npc3": 0.06602426052093506}, "udem1-1-0": {"driven_any": 4.378320939674842, "sim_physics": 0.2091931406656901, "survival_time": 14.950000000000076, "driven_lanedir": -2.682736245075499, "sim_render-ego": 0.06061723391215006, "in-drivable-lane": 2.2000000000000113, "agent_compute-ego": 0.15862775405248006, "deviation-heading": 8.488415384770875, "set_robot_commands": 0.09201850255330404, "deviation-center-line": 1.5200592903810726, "driven_lanedir_consec": -1.2731239579032123, "sim_compute_sim_state": 0.03865094582239787, "sim_compute_performance-ego": 0.06677956660588583, "sim_compute_robot_state-ego": 0.0693455449740092, "sim_compute_robot_state-npc0": 0.06725589911142985, "sim_compute_robot_state-npc1": 0.06646379868189493, "sim_compute_robot_state-npc2": 0.06552303393681844, "sim_compute_robot_state-npc3": 0.066727614402771}, "udem1-2-0": {"driven_any": 4.378320939674832, "sim_physics": 0.19589363177617392, "survival_time": 14.950000000000076, "driven_lanedir": -1.366645308459499, "sim_render-ego": 0.05982870578765869, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.15699501355489096, "deviation-heading": 5.771826282352732, "set_robot_commands": 0.09169785261154174, "deviation-center-line": 0.2928510760964476, "driven_lanedir_consec": -1.366645308459499, "sim_compute_sim_state": 0.03711856444676717, "sim_compute_performance-ego": 0.06597498178482056, "sim_compute_robot_state-ego": 0.06988596439361572, "sim_compute_robot_state-npc0": 0.06580821673075359, "sim_compute_robot_state-npc1": 0.06703041156133016, "sim_compute_robot_state-npc2": 0.06641181071599324, "sim_compute_robot_state-npc3": 0.0656856377919515}, "udem1-3-0": {"driven_any": 4.378320939674839, "sim_physics": 0.20104711612065632, "survival_time": 14.950000000000076, "driven_lanedir": -1.3673592918445536, "sim_render-ego": 0.06074178298314412, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.16174415508906043, "deviation-heading": 5.694184625828925, "set_robot_commands": 0.09073220173517862, "deviation-center-line": 0.28265732013386635, "driven_lanedir_consec": -1.3673592918445536, "sim_compute_sim_state": 0.037414021492004394, "sim_compute_performance-ego": 0.06485916296641032, "sim_compute_robot_state-ego": 0.06981304963429769, "sim_compute_robot_state-npc0": 0.06554241180419922, "sim_compute_robot_state-npc1": 0.06683822472890218, "sim_compute_robot_state-npc2": 0.06652715126673381, "sim_compute_robot_state-npc3": 0.06650982936223349}, "udem1-4-0": {"driven_any": 4.378320939674835, "sim_physics": 0.19979225794474284, "survival_time": 14.950000000000076, "driven_lanedir": -2.2611460594308452, "sim_render-ego": 0.06055862744649251, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.1594925864537557, "deviation-heading": 7.089126128887597, "set_robot_commands": 0.0904445473353068, "deviation-center-line": 1.0020906406379184, "driven_lanedir_consec": -1.3401138062222346, "sim_compute_sim_state": 0.03771708806355794, "sim_compute_performance-ego": 0.06381249745686848, "sim_compute_robot_state-ego": 0.06672102292378744, "sim_compute_robot_state-npc0": 0.06511565287907918, "sim_compute_robot_state-npc1": 0.06627665837605794, "sim_compute_robot_state-npc2": 0.06589659929275513, "sim_compute_robot_state-npc3": 0.06699304342269898}}
set_robot_commands_max	0.09201850255330404
set_robot_commands_mean	0.09136148754755656
set_robot_commands_median	0.09169785261154174
set_robot_commands_min	0.0904445473353068
sim_compute_performance-ego_max	0.06677956660588583
sim_compute_performance-ego_mean	0.06519118769963583
sim_compute_performance-ego_median	0.06485916296641032
sim_compute_performance-ego_min	0.06381249745686848
sim_compute_robot_state-ego_max	0.06988596439361572
sim_compute_robot_state-ego_mean	0.06894425439834595
sim_compute_robot_state-ego_median	0.0693455449740092
sim_compute_robot_state-ego_min	0.06672102292378744
sim_compute_robot_state-npc0_max	0.0674901779492696
sim_compute_robot_state-npc0_mean	0.06624247169494629
sim_compute_robot_state-npc0_median	0.06580821673075359
sim_compute_robot_state-npc0_min	0.06511565287907918
sim_compute_robot_state-npc1_max	0.06703041156133016
sim_compute_robot_state-npc1_mean	0.06648305797576905
sim_compute_robot_state-npc1_median	0.06646379868189493
sim_compute_robot_state-npc1_min	0.06580619653066
sim_compute_robot_state-npc2_max	0.06652715126673381
sim_compute_robot_state-npc2_mean	0.06585109043121337
sim_compute_robot_state-npc2_median	0.06589659929275513
sim_compute_robot_state-npc2_min	0.06489685694376628
sim_compute_robot_state-npc3_max	0.06699304342269898
sim_compute_robot_state-npc3_mean	0.066388077100118
sim_compute_robot_state-npc3_median	0.06650982936223349
sim_compute_robot_state-npc3_min	0.0656856377919515
sim_compute_sim_state_max	0.03865094582239787
sim_compute_sim_state_mean	0.03777063020070394
sim_compute_sim_state_median	0.03771708806355794
sim_compute_sim_state_min	0.03711856444676717
sim_physics_max	0.2091931406656901
sim_physics_mean	0.2006483659744263
sim_physics_median	0.19979225794474284
sim_physics_min	0.19589363177617392
sim_render-ego_max	0.06074178298314412
sim_render-ego_mean	0.06025175921122232
sim_render-ego_median	0.06055862744649251
sim_render-ego_min	0.05951244592666626
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20550

2456

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:09:22+00:00

2019-04-25 14:09:59+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20548

2463

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:08:32+00:00

2019-04-25 14:09:08+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20533

2495

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

aido2-LFV-sim-testing

step1-simulation

success

2019-04-25 14:02:03+00:00

2019-04-25 14:08:16+00:00

0:06:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.05840043451070765
survival_time_median	1.5000000000000009
deviation-center-line_median	0.057983672740139214
in-drivable-lane_median	0.5500000000000004

other stats

agent_compute-ego_max	0.1671301738635914
agent_compute-ego_mean	0.163092034901453
agent_compute-ego_median	0.16456514416318951
agent_compute-ego_min	0.1582916108044711
deviation-center-line_max	0.09916785264767544
deviation-center-line_mean	0.06450442137020852
deviation-center-line_min	0.02169134246647757
deviation-heading_max	0.8660063540683592
deviation-heading_mean	0.6732093482161077
deviation-heading_median	0.6776764511986206
deviation-heading_min	0.5433143610997189
driven_any_max	0.21273778336072305
driven_any_mean	0.15344436153299967
driven_any_median	0.1461964909250659
driven_any_min	0.09663190687685354
driven_lanedir_consec_max	0.08039911366629315
driven_lanedir_consec_mean	0.05962821084741267
driven_lanedir_consec_min	0.03424306708800262
driven_lanedir_max	0.08039911366629315
driven_lanedir_mean	0.05962821084741267
driven_lanedir_median	0.05840043451070765
driven_lanedir_min	0.03424306708800262
in-drivable-lane_max	0.7000000000000006
in-drivable-lane_mean	0.3600000000000003
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21273778336072305, "sim_physics": 0.15114204303638354, "survival_time": 1.850000000000001, "driven_lanedir": 0.06754617947151598, "sim_render-ego": 0.05912376094508816, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1671301738635914, "deviation-heading": 0.702806500858648, "set_robot_commands": 0.08883318385562382, "deviation-center-line": 0.057983672740139214, "driven_lanedir_consec": 0.06754617947151598, "sim_compute_sim_state": 0.03807912646113215, "sim_compute_performance-ego": 0.06713472830282675, "sim_compute_robot_state-ego": 0.06981633804939888, "sim_compute_robot_state-npc0": 0.06872731930500753, "sim_compute_robot_state-npc1": 0.06741938719878325, "sim_compute_robot_state-npc2": 0.0645506188676164, "sim_compute_robot_state-npc3": 0.06603063763798894}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19710992066790511, "sim_physics": 0.1486805063305479, "survival_time": 1.6500000000000008, "driven_lanedir": 0.05840043451070765, "sim_render-ego": 0.05873425801595052, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16456514416318951, "deviation-heading": 0.8660063540683592, "set_robot_commands": 0.09278001207293886, "deviation-center-line": 0.05755306929059554, "driven_lanedir_consec": 0.05840043451070765, "sim_compute_sim_state": 0.04019129637515906, "sim_compute_performance-ego": 0.06920178731282552, "sim_compute_robot_state-ego": 0.07248243418606845, "sim_compute_robot_state-npc0": 0.06509285984617291, "sim_compute_robot_state-npc1": 0.06609383496371182, "sim_compute_robot_state-npc2": 0.06837898312192975, "sim_compute_robot_state-npc3": 0.06890150994965524}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11454570583445074, "sim_physics": 0.12979774889738663, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08039911366629315, "sim_render-ego": 0.06552003777545432, "in-drivable-lane": 0, "agent_compute-ego": 0.16487237681513248, "deviation-heading": 0.5433143610997189, "set_robot_commands": 0.08376206522402556, "deviation-center-line": 0.09916785264767544, "driven_lanedir_consec": 0.08039911366629315, "sim_compute_sim_state": 0.03650963824728261, "sim_compute_performance-ego": 0.06340082832004713, "sim_compute_robot_state-ego": 0.06332112395245096, "sim_compute_robot_state-npc0": 0.06703002556510594, "sim_compute_robot_state-npc1": 0.0675574489261793, "sim_compute_robot_state-npc2": 0.06419330057890518, "sim_compute_robot_state-npc3": 0.06513993636421535}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.09663190687685354, "sim_physics": 0.13192784786224365, "survival_time": 1.1000000000000003, "driven_lanedir": 0.05755225950054399, "sim_render-ego": 0.05792556025765159, "in-drivable-lane": 0, "agent_compute-ego": 0.1582916108044711, "deviation-heading": 0.576243073855191, "set_robot_commands": 0.0913158655166626, "deviation-center-line": 0.08612616970615482, "driven_lanedir_consec": 0.05755225950054399, "sim_compute_sim_state": 0.03671166029843417, "sim_compute_performance-ego": 0.06470096111297607, "sim_compute_robot_state-ego": 0.06744510477239435, "sim_compute_robot_state-npc0": 0.06459318507801402, "sim_compute_robot_state-npc1": 0.0649980523369529, "sim_compute_robot_state-npc2": 0.06792818416248668, "sim_compute_robot_state-npc3": 0.06300534985282204}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1461964909250659, "sim_physics": 0.15759464899698894, "survival_time": 1.5000000000000009, "driven_lanedir": 0.03424306708800262, "sim_render-ego": 0.058864680926005046, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.16060086886088054, "deviation-heading": 0.6776764511986206, "set_robot_commands": 0.08964550495147705, "deviation-center-line": 0.02169134246647757, "driven_lanedir_consec": 0.03424306708800262, "sim_compute_sim_state": 0.03614068031311035, "sim_compute_performance-ego": 0.06397759914398193, "sim_compute_robot_state-ego": 0.07304197947184245, "sim_compute_robot_state-npc0": 0.06412814458211263, "sim_compute_robot_state-npc1": 0.059529654184977215, "sim_compute_robot_state-npc2": 0.06049371560414632, "sim_compute_robot_state-npc3": 0.06393036842346192}}
set_robot_commands_max	0.09278001207293886
set_robot_commands_mean	0.08926732632414558
set_robot_commands_median	0.08964550495147705
set_robot_commands_min	0.08376206522402556
sim_compute_performance-ego_max	0.06920178731282552
sim_compute_performance-ego_mean	0.06568318083853149
sim_compute_performance-ego_median	0.06470096111297607
sim_compute_performance-ego_min	0.06340082832004713
sim_compute_robot_state-ego_max	0.07304197947184245
sim_compute_robot_state-ego_mean	0.069221396086431
sim_compute_robot_state-ego_median	0.06981633804939888
sim_compute_robot_state-ego_min	0.06332112395245096
sim_compute_robot_state-npc0_max	0.06872731930500753
sim_compute_robot_state-npc0_mean	0.06591430687528262
sim_compute_robot_state-npc0_median	0.06509285984617291
sim_compute_robot_state-npc0_min	0.06412814458211263
sim_compute_robot_state-npc1_max	0.0675574489261793
sim_compute_robot_state-npc1_mean	0.0651196755221209
sim_compute_robot_state-npc1_median	0.06609383496371182
sim_compute_robot_state-npc1_min	0.059529654184977215
sim_compute_robot_state-npc2_max	0.06837898312192975
sim_compute_robot_state-npc2_mean	0.06510896046701686
sim_compute_robot_state-npc2_median	0.0645506188676164
sim_compute_robot_state-npc2_min	0.06049371560414632
sim_compute_robot_state-npc3_max	0.06890150994965524
sim_compute_robot_state-npc3_mean	0.0654015604456287
sim_compute_robot_state-npc3_median	0.06513993636421535
sim_compute_robot_state-npc3_min	0.06300534985282204
sim_compute_sim_state_max	0.04019129637515906
sim_compute_sim_state_mean	0.03752648033902367
sim_compute_sim_state_median	0.03671166029843417
sim_compute_sim_state_min	0.03614068031311035
sim_physics_max	0.15759464899698894
sim_physics_mean	0.14382855902471012
sim_physics_median	0.1486805063305479
sim_physics_min	0.12979774889738663
sim_render-ego_max	0.06552003777545432
sim_render-ego_mean	0.06003365958402992
sim_render-ego_median	0.058864680926005046
sim_render-ego_min	0.05792556025765159
simulation-passed	1
survival_time_max	1.850000000000001
survival_time_mean	1.4500000000000006
survival_time_min	1.1000000000000003

No reset possible

20525

2517

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 14:01:15+00:00

2019-04-25 14:01:57+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20501

2520

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido2-LFV-sim-testing

step1-simulation

host-error

2019-04-25 13:58:34+00:00

2019-04-25 14:00:49+00:00

0:02:15

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20501-323299', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20501-323299', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20501-323299', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20490

2543

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:52:09+00:00

2019-04-25 13:58:06+00:00

0:05:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.16187433242797852
agent_compute-ego_mean	0.15074345991438848
agent_compute-ego_median	0.15190384522923883
agent_compute-ego_min	0.13948434438460913
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.09196606222188698, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06419485919880417, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.15190384522923883, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09062499370215074, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03599645956507269, "sim_compute_performance-ego": 0.069232850704553, "sim_compute_robot_state-ego": 0.07417896558653633}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.10401236093961276, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06151379071749174, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14515238541823167, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.09080899220246536, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03797851159022404, "sim_compute_performance-ego": 0.0678869760953463, "sim_compute_robot_state-ego": 0.0705083837875953}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.088253034485711, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.05915877554151747, "in-drivable-lane": 0, "agent_compute-ego": 0.15530239211188424, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.10099877251519096, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.036013285319010414, "sim_compute_performance-ego": 0.065808547867669, "sim_compute_robot_state-ego": 0.07888360818227132}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.10426565170288088, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.06522687911987304, "in-drivable-lane": 0, "agent_compute-ego": 0.16187433242797852, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.09635517120361328, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.041132335662841794, "sim_compute_performance-ego": 0.07313747406005859, "sim_compute_robot_state-ego": 0.09257198333740234}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.08797476841853215, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.05555608639350304, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.13948434438460913, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.0892880543684348, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.036045001103327826, "sim_compute_performance-ego": 0.0629181281114236, "sim_compute_robot_state-ego": 0.06574435723133576}}
set_robot_commands_max	0.10099877251519096
set_robot_commands_mean	0.09361519679837102
set_robot_commands_median	0.09080899220246536
set_robot_commands_min	0.0892880543684348
sim_compute_performance-ego_max	0.07313747406005859
sim_compute_performance-ego_mean	0.06779679536781011
sim_compute_performance-ego_median	0.0678869760953463
sim_compute_performance-ego_min	0.0629181281114236
sim_compute_robot_state-ego_max	0.09257198333740234
sim_compute_robot_state-ego_mean	0.0763774596250282
sim_compute_robot_state-ego_median	0.07417896558653633
sim_compute_robot_state-ego_min	0.06574435723133576
sim_compute_sim_state_max	0.041132335662841794
sim_compute_sim_state_mean	0.03743311864809536
sim_compute_sim_state_median	0.036045001103327826
sim_compute_sim_state_min	0.03599645956507269
sim_physics_max	0.10426565170288088
sim_physics_mean	0.09529437555372476
sim_physics_median	0.09196606222188698
sim_physics_min	0.08797476841853215
sim_render-ego_max	0.06522687911987304
sim_render-ego_mean	0.0611300781942379
sim_render-ego_median	0.06151379071749174
sim_render-ego_min	0.05555608639350304
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20483

2552

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:44:36+00:00

2019-04-25 13:51:53+00:00

0:07:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07189483077902543
agent_compute-ego_mean	0.06429241066381015
agent_compute-ego_median	0.069158856685345
agent_compute-ego_min	0.053405180955544494
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.1351474962736431, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.06274065845891048, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.07189483077902543, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.09804940537402504, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.03848558036904586, "sim_compute_performance-ego": 0.06851600345812346, "sim_compute_robot_state-ego": 0.07273799808401811, "sim_compute_robot_state-npc0": 0.06802991816872045, "sim_compute_robot_state-npc1": 0.07023647898121883, "sim_compute_robot_state-npc2": 0.07193742614043386, "sim_compute_robot_state-npc3": 0.0664051520197015}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.15623223781585693, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.06040588766336441, "in-drivable-lane": 0, "agent_compute-ego": 0.07158011943101883, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.09006083756685257, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.03635920584201813, "sim_compute_performance-ego": 0.0686703771352768, "sim_compute_robot_state-ego": 0.07382159680128098, "sim_compute_robot_state-npc0": 0.08035140484571457, "sim_compute_robot_state-npc1": 0.06362920999526978, "sim_compute_robot_state-npc2": 0.0625515952706337, "sim_compute_robot_state-npc3": 0.06492123752832413}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.15081251584566557, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.05905574560165405, "in-drivable-lane": 0, "agent_compute-ego": 0.069158856685345, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.09267466343366185, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.03533717760672936, "sim_compute_performance-ego": 0.06659387625180758, "sim_compute_robot_state-ego": 0.06646203994750977, "sim_compute_robot_state-npc0": 0.06651131464884831, "sim_compute_robot_state-npc1": 0.06921554070252639, "sim_compute_robot_state-npc2": 0.0668876262811514, "sim_compute_robot_state-npc3": 0.06586532867871799}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.10602349501389724, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.04762297715896215, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.053405180955544494, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.07421637192750588, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.02748996477860671, "sim_compute_performance-ego": 0.05193571860973652, "sim_compute_robot_state-ego": 0.0537180870007246, "sim_compute_robot_state-npc0": 0.054092498926016, "sim_compute_robot_state-npc1": 0.05023296979757456, "sim_compute_robot_state-npc2": 0.05414963685549223, "sim_compute_robot_state-npc3": 0.05157932562705798}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.10686760478549534, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.04556289425602666, "in-drivable-lane": 0, "agent_compute-ego": 0.055423065468117046, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.06961989402770996, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.030148877037896052, "sim_compute_performance-ego": 0.05090253441422074, "sim_compute_robot_state-ego": 0.05359021822611491, "sim_compute_robot_state-npc0": 0.05730105329442907, "sim_compute_robot_state-npc1": 0.05391465293036567, "sim_compute_robot_state-npc2": 0.05339892705281576, "sim_compute_robot_state-npc3": 0.05232651145369918}}
set_robot_commands_max	0.09804940537402504
set_robot_commands_mean	0.08492423446595106
set_robot_commands_median	0.09006083756685257
set_robot_commands_min	0.06961989402770996
sim_compute_performance-ego_max	0.0686703771352768
sim_compute_performance-ego_mean	0.06132370197383301
sim_compute_performance-ego_median	0.06659387625180758
sim_compute_performance-ego_min	0.05090253441422074
sim_compute_robot_state-ego_max	0.07382159680128098
sim_compute_robot_state-ego_mean	0.06406598801192967
sim_compute_robot_state-ego_median	0.06646203994750977
sim_compute_robot_state-ego_min	0.05359021822611491
sim_compute_robot_state-npc0_max	0.08035140484571457
sim_compute_robot_state-npc0_mean	0.06525723797674568
sim_compute_robot_state-npc0_median	0.06651131464884831
sim_compute_robot_state-npc0_min	0.054092498926016
sim_compute_robot_state-npc1_max	0.07023647898121883
sim_compute_robot_state-npc1_mean	0.06144577048139105
sim_compute_robot_state-npc1_median	0.06362920999526978
sim_compute_robot_state-npc1_min	0.05023296979757456
sim_compute_robot_state-npc2_max	0.07193742614043386
sim_compute_robot_state-npc2_mean	0.061785042320105385
sim_compute_robot_state-npc2_median	0.0625515952706337
sim_compute_robot_state-npc2_min	0.05339892705281576
sim_compute_robot_state-npc3_max	0.0664051520197015
sim_compute_robot_state-npc3_mean	0.06021951106150014
sim_compute_robot_state-npc3_median	0.06492123752832413
sim_compute_robot_state-npc3_min	0.05157932562705798
sim_compute_sim_state_max	0.03848558036904586
sim_compute_sim_state_mean	0.03356416112685923
sim_compute_sim_state_median	0.03533717760672936
sim_compute_sim_state_min	0.02748996477860671
sim_physics_max	0.15623223781585693
sim_physics_mean	0.1310166699469116
sim_physics_median	0.1351474962736431
sim_physics_min	0.10602349501389724
sim_render-ego_max	0.06274065845891048
sim_render-ego_mean	0.05507763262778355
sim_render-ego_median	0.05905574560165405
sim_render-ego_min	0.04556289425602666
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20479

2557

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 13:43:24+00:00

2019-04-25 13:44:10+00:00

0:00:46

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20451

2601

FANG MEIYI 🇸🇬

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 13:21:22+00:00

2019-04-25 13:43:10+00:00

0:21:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2923609386443409
survival_time_median	10.600000000000016
deviation-center-line_median	0.3279209980546206
in-drivable-lane_median	1.399999999999996

other stats

agent_compute-ego_max	0.16593740571219967
agent_compute-ego_mean	0.15567094396289563
agent_compute-ego_median	0.157464388478009
agent_compute-ego_min	0.14546014229456583
deviation-center-line_max	0.7479330820577772
deviation-center-line_mean	0.4331284378758325
deviation-center-line_min	0.2418400920757667
deviation-heading_max	2.0594142410751712
deviation-heading_mean	1.582188009796709
deviation-heading_median	1.6016201777852366
deviation-heading_min	1.1048863108780962
driven_any_max	3.2358976600865956
driven_any_mean	2.2794310305680523
driven_any_median	1.8996898747367352
driven_any_min	1.603851028782279
driven_lanedir_consec_max	3.2178872476501357
driven_lanedir_consec_mean	1.906971439772254
driven_lanedir_consec_min	0.8055230446577141
driven_lanedir_max	3.2178872476501357
driven_lanedir_mean	1.9091462968476505
driven_lanedir_median	1.2923609386443409
driven_lanedir_min	0.8055230446577141
in-drivable-lane_max	5.900000000000024
in-drivable-lane_mean	1.8100000000000052
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.8996898747367352, "sim_physics": 0.12500765975916162, "survival_time": 10.600000000000016, "driven_lanedir": 0.8055230446577141, "sim_render-ego": 0.06417418088553087, "in-drivable-lane": 5.900000000000024, "agent_compute-ego": 0.16593740571219967, "deviation-heading": 1.1048863108780962, "set_robot_commands": 0.10138647736243482, "deviation-center-line": 0.2418400920757667, "driven_lanedir_consec": 0.8055230446577141, "sim_compute_sim_state": 0.04001212569902528, "sim_compute_performance-ego": 0.07278034259688179, "sim_compute_robot_state-ego": 0.07992818670452766}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.2358976600865956, "sim_physics": 0.10757330099741616, "survival_time": 14.950000000000076, "driven_lanedir": 3.2178872476501357, "sim_render-ego": 0.05594729900360108, "in-drivable-lane": 0, "agent_compute-ego": 0.14546014229456583, "deviation-heading": 1.3291623206664565, "set_robot_commands": 0.08953420718510946, "deviation-center-line": 0.5853403035977088, "driven_lanedir_consec": 3.2178872476501357, "sim_compute_sim_state": 0.03625918308893839, "sim_compute_performance-ego": 0.06420333623886108, "sim_compute_robot_state-ego": 0.06720511754353842}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.968910742005263, "sim_physics": 0.12302615404129028, "survival_time": 14.950000000000076, "driven_lanedir": 2.938987271492939, "sim_render-ego": 0.06319275299708048, "in-drivable-lane": 0, "agent_compute-ego": 0.15985137065251667, "deviation-heading": 1.8158569985785835, "set_robot_commands": 0.09567319869995115, "deviation-center-line": 0.7479330820577772, "driven_lanedir_consec": 2.938987271492939, "sim_compute_sim_state": 0.03806705713272095, "sim_compute_performance-ego": 0.06764271100362142, "sim_compute_robot_state-ego": 0.07274333000183106}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.688805847229389, "sim_physics": 0.1046485404747759, "survival_time": 8.649999999999988, "driven_lanedir": 1.2923609386443409, "sim_render-ego": 0.059100258557093624, "in-drivable-lane": 1.7500000000000044, "agent_compute-ego": 0.157464388478009, "deviation-heading": 1.6016201777852366, "set_robot_commands": 0.09590100552994392, "deviation-center-line": 0.3279209980546206, "driven_lanedir_consec": 1.2923609386443409, "sim_compute_sim_state": 0.03840271585938559, "sim_compute_performance-ego": 0.06629479551590936, "sim_compute_robot_state-ego": 0.07066093566100722}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.603851028782279, "sim_physics": 0.1033355322751132, "survival_time": 8.249999999999982, "driven_lanedir": 1.290972981793122, "sim_render-ego": 0.05750328121763287, "in-drivable-lane": 1.399999999999996, "agent_compute-ego": 0.14964141267718692, "deviation-heading": 2.0594142410751712, "set_robot_commands": 0.08619331880049272, "deviation-center-line": 0.2626077135932887, "driven_lanedir_consec": 1.2800986964161418, "sim_compute_sim_state": 0.03549942247795336, "sim_compute_performance-ego": 0.06486948764685428, "sim_compute_robot_state-ego": 0.06912201101129706}}
set_robot_commands_max	0.10138647736243482
set_robot_commands_mean	0.09373764151558642
set_robot_commands_median	0.09567319869995115
set_robot_commands_min	0.08619331880049272
sim_compute_performance-ego_max	0.07278034259688179
sim_compute_performance-ego_mean	0.06715813460042559
sim_compute_performance-ego_median	0.06629479551590936
sim_compute_performance-ego_min	0.06420333623886108
sim_compute_robot_state-ego_max	0.07992818670452766
sim_compute_robot_state-ego_mean	0.07193191618444028
sim_compute_robot_state-ego_median	0.07066093566100722
sim_compute_robot_state-ego_min	0.06720511754353842
sim_compute_sim_state_max	0.04001212569902528
sim_compute_sim_state_mean	0.037648100851604714
sim_compute_sim_state_median	0.03806705713272095
sim_compute_sim_state_min	0.03549942247795336
sim_physics_max	0.12500765975916162
sim_physics_mean	0.11271823750955144
sim_physics_median	0.10757330099741616
sim_physics_min	0.1033355322751132
sim_render-ego_max	0.06417418088553087
sim_render-ego_mean	0.059983554532187774
sim_render-ego_median	0.059100258557093624
sim_render-ego_min	0.05594729900360108
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.480000000000029
survival_time_min	8.249999999999982

No reset possible

20445

2616

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:14:51+00:00

2019-04-25 13:20:43+00:00

0:05:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.17221434911092123
agent_compute-ego_mean	0.1610684604388709
agent_compute-ego_median	0.16072937677491386
agent_compute-ego_min	0.15326734078236115
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.10654031105761258, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06376164364364911, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.16072937677491386, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.10163891090537017, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.040026147410554706, "sim_compute_performance-ego": 0.07248751172479594, "sim_compute_robot_state-ego": 0.07900724770887843}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.12468405411793636, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.06690951035572933, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1612646717291612, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.10371027084497306, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.04209200235513541, "sim_compute_performance-ego": 0.07411964581562923, "sim_compute_robot_state-ego": 0.08188083080145028}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.09813038508097333, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06703796651628283, "in-drivable-lane": 0, "agent_compute-ego": 0.17221434911092123, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.10877707269456652, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.04228960143195258, "sim_compute_performance-ego": 0.07657292154100206, "sim_compute_robot_state-ego": 0.09851641125149196}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.10277898788452149, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.06392674446105957, "in-drivable-lane": 0, "agent_compute-ego": 0.15786656379699707, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.10973898887634276, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.043522281646728514, "sim_compute_performance-ego": 0.0713318157196045, "sim_compute_robot_state-ego": 0.07846258163452148}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.0982138957732763, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.06265450440920316, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.15326734078236115, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.09689587201827612, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.040726738098340154, "sim_compute_performance-ego": 0.0713731600688054, "sim_compute_robot_state-ego": 0.07886053965641902}}
set_robot_commands_max	0.10973898887634276
set_robot_commands_mean	0.10415222306790572
set_robot_commands_median	0.10371027084497306
set_robot_commands_min	0.09689587201827612
sim_compute_performance-ego_max	0.07657292154100206
sim_compute_performance-ego_mean	0.07317701097396742
sim_compute_performance-ego_median	0.07248751172479594
sim_compute_performance-ego_min	0.0713318157196045
sim_compute_robot_state-ego_max	0.09851641125149196
sim_compute_robot_state-ego_mean	0.08334552221055223
sim_compute_robot_state-ego_median	0.07900724770887843
sim_compute_robot_state-ego_min	0.07846258163452148
sim_compute_sim_state_max	0.043522281646728514
sim_compute_sim_state_mean	0.04173135418854227
sim_compute_sim_state_median	0.04209200235513541
sim_compute_sim_state_min	0.040026147410554706
sim_physics_max	0.12468405411793636
sim_physics_mean	0.106069526782864
sim_physics_median	0.10277898788452149
sim_physics_min	0.09813038508097333
sim_render-ego_max	0.06703796651628283
sim_render-ego_mean	0.06485807387718481
sim_render-ego_median	0.06392674446105957
sim_render-ego_min	0.06265450440920316
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20433

2695

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 13:00:25+00:00

2019-04-25 13:14:37+00:00

0:14:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47351267291765
survival_time_median	4.6499999999999915
deviation-center-line_median	0.3504319369371014
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.08714370056986809
agent_compute-ego_mean	0.0835009149957206
agent_compute-ego_median	0.08453743432157783
agent_compute-ego_min	0.07709556818008423
deviation-center-line_max	0.4976693863793951
deviation-center-line_mean	0.36487417331688565
deviation-center-line_min	0.27910725673296183
deviation-heading_max	2.825726835773546
deviation-heading_mean	1.9015130036851808
deviation-heading_median	2.0976489533891343
deviation-heading_min	0.7852383628138486
driven_any_max	1.111306151827255
driven_any_mean	0.7210106124572125
driven_any_median	0.6934540526810856
driven_any_min	0.445419995851316
driven_lanedir_consec_max	0.6250437801734882
driven_lanedir_consec_mean	0.4787587959495102
driven_lanedir_consec_min	0.31586131432404274
driven_lanedir_max	0.6328239118724968
driven_lanedir_mean	0.5106210437404796
driven_lanedir_median	0.5250569344528344
driven_lanedir_min	0.31586131432404274
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6199999999999978
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.445419995851316, "sim_physics": 0.18147212639451027, "survival_time": 3.1999999999999966, "driven_lanedir": 0.31586131432404274, "sim_render-ego": 0.06800100207328796, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.08714370056986809, "deviation-heading": 1.440711144550846, "set_robot_commands": 0.10915322974324226, "deviation-center-line": 0.2882968101546002, "driven_lanedir_consec": 0.31586131432404274, "sim_compute_sim_state": 0.03996101394295693, "sim_compute_performance-ego": 0.07792449742555618, "sim_compute_robot_state-ego": 0.0847446471452713, "sim_compute_robot_state-npc0": 0.07476537302136421, "sim_compute_robot_state-npc1": 0.07555815577507019, "sim_compute_robot_state-npc2": 0.07508257031440735, "sim_compute_robot_state-npc3": 0.07440732792019844}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6934540526810856, "sim_physics": 0.1739571914877943, "survival_time": 4.6499999999999915, "driven_lanedir": 0.45431927787953574, "sim_render-ego": 0.06625776649803243, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.08453743432157783, "deviation-heading": 2.35823972189853, "set_robot_commands": 0.10415658643168788, "deviation-center-line": 0.27910725673296183, "driven_lanedir_consec": 0.45431927787953574, "sim_compute_sim_state": 0.04272365313704296, "sim_compute_performance-ego": 0.07462978106673046, "sim_compute_robot_state-ego": 0.08064796847681846, "sim_compute_robot_state-npc0": 0.0764452616373698, "sim_compute_robot_state-npc1": 0.07513677432972898, "sim_compute_robot_state-npc2": 0.07632759565948158, "sim_compute_robot_state-npc3": 0.07866427462588074}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.111306151827255, "sim_physics": 0.19350314469173036, "survival_time": 7.249999999999982, "driven_lanedir": 0.6328239118724968, "sim_render-ego": 0.06683212477585365, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.08328476609854862, "deviation-heading": 2.0976489533891343, "set_robot_commands": 0.10931471298480856, "deviation-center-line": 0.4976693863793951, "driven_lanedir_consec": 0.47351267291765, "sim_compute_sim_state": 0.043421960699147194, "sim_compute_performance-ego": 0.07785551959070666, "sim_compute_robot_state-ego": 0.08175267515511349, "sim_compute_robot_state-npc0": 0.07707814183728448, "sim_compute_robot_state-npc1": 0.07680586617568444, "sim_compute_robot_state-npc2": 0.07583343571630018, "sim_compute_robot_state-npc3": 0.07605778102217049}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7175215080329159, "sim_physics": 0.15332564214865366, "survival_time": 4.799999999999991, "driven_lanedir": 0.5250569344528344, "sim_render-ego": 0.06185645361741384, "in-drivable-lane": 0, "agent_compute-ego": 0.07709556818008423, "deviation-heading": 2.825726835773546, "set_robot_commands": 0.0953344280521075, "deviation-center-line": 0.40886547638036985, "driven_lanedir_consec": 0.5250569344528344, "sim_compute_sim_state": 0.03726516912380854, "sim_compute_performance-ego": 0.06986595193545024, "sim_compute_robot_state-ego": 0.07513394703467687, "sim_compute_robot_state-npc0": 0.06751379370689392, "sim_compute_robot_state-npc1": 0.0681006908416748, "sim_compute_robot_state-npc2": 0.0668054570754369, "sim_compute_robot_state-npc3": 0.06757655988136928}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6373513538934907, "sim_physics": 0.16928684988687204, "survival_time": 4.299999999999993, "driven_lanedir": 0.6250437801734882, "sim_render-ego": 0.06979656773944233, "in-drivable-lane": 0, "agent_compute-ego": 0.0854431058085242, "deviation-heading": 0.7852383628138486, "set_robot_commands": 0.10980241797691168, "deviation-center-line": 0.3504319369371014, "driven_lanedir_consec": 0.6250437801734882, "sim_compute_sim_state": 0.043296192967614465, "sim_compute_performance-ego": 0.0771087879358336, "sim_compute_robot_state-ego": 0.08415688747583433, "sim_compute_robot_state-npc0": 0.0718851089477539, "sim_compute_robot_state-npc1": 0.07338992107746213, "sim_compute_robot_state-npc2": 0.07412408119024233, "sim_compute_robot_state-npc3": 0.07330813518790312}}
set_robot_commands_max	0.10980241797691168
set_robot_commands_mean	0.10555227503775158
set_robot_commands_median	0.10915322974324226
set_robot_commands_min	0.0953344280521075
sim_compute_performance-ego_max	0.07792449742555618
sim_compute_performance-ego_mean	0.07547690759085543
sim_compute_performance-ego_median	0.0771087879358336
sim_compute_performance-ego_min	0.06986595193545024
sim_compute_robot_state-ego_max	0.0847446471452713
sim_compute_robot_state-ego_mean	0.08128722505754289
sim_compute_robot_state-ego_median	0.08175267515511349
sim_compute_robot_state-ego_min	0.07513394703467687
sim_compute_robot_state-npc0_max	0.07707814183728448
sim_compute_robot_state-npc0_mean	0.07353753583013327
sim_compute_robot_state-npc0_median	0.07476537302136421
sim_compute_robot_state-npc0_min	0.06751379370689392
sim_compute_robot_state-npc1_max	0.07680586617568444
sim_compute_robot_state-npc1_mean	0.07379828163992411
sim_compute_robot_state-npc1_median	0.07513677432972898
sim_compute_robot_state-npc1_min	0.0681006908416748
sim_compute_robot_state-npc2_max	0.07632759565948158
sim_compute_robot_state-npc2_mean	0.07363462799117367
sim_compute_robot_state-npc2_median	0.07508257031440735
sim_compute_robot_state-npc2_min	0.0668054570754369
sim_compute_robot_state-npc3_max	0.07866427462588074
sim_compute_robot_state-npc3_mean	0.07400281572750442
sim_compute_robot_state-npc3_median	0.07440732792019844
sim_compute_robot_state-npc3_min	0.06757655988136928
sim_compute_sim_state_max	0.043421960699147194
sim_compute_sim_state_mean	0.04133359797411402
sim_compute_sim_state_median	0.04272365313704296
sim_compute_sim_state_min	0.03726516912380854
sim_physics_max	0.19350314469173036
sim_physics_mean	0.17430899092191213
sim_physics_median	0.1739571914877943
sim_physics_min	0.15332564214865366
sim_render-ego_max	0.06979656773944233
sim_render-ego_mean	0.06654878294080604
sim_render-ego_median	0.06683212477585365
sim_render-ego_min	0.06185645361741384
simulation-passed	1
survival_time_max	7.249999999999982
survival_time_mean	4.839999999999991
survival_time_min	3.1999999999999966

No reset possible

20421

2645

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

aido2-LFVI-sim-validation

2019-04-25 12:52:32+00:00

2019-04-25 13:00:08+00:00

0:07:36

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20421-729659', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20421-729659', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20421-729659', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20397

2699

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

timeout

2019-04-25 12:18:16+00:00

2019-04-25 12:51:00+00:00

0:32:44

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20389

2676

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:01:23+00:00

2019-04-25 12:18:01+00:00

0:16:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6414507384399326
survival_time_median	7.84999999999998
deviation-center-line_median	0.4326091304196939
in-drivable-lane_median	3.0999999999999934

other stats

agent_compute-ego_max	0.10043107345700264
agent_compute-ego_mean	0.09025374280067286
agent_compute-ego_median	0.08909995577953479
agent_compute-ego_min	0.08522342999776204
deviation-center-line_max	0.5421157908956298
deviation-center-line_mean	0.41506170041864754
deviation-center-line_min	0.2859628110731143
deviation-heading_max	5.672762660199323
deviation-heading_mean	2.8555063934094815
deviation-heading_median	2.840101647554727
deviation-heading_min	0.46302943039476574
driven_any_max	2.3476347813639458
driven_any_mean	1.265457207367953
driven_any_median	1.2075180640897292
driven_any_min	0.4454423992276929
driven_lanedir_consec_max	0.9476155776444192
driven_lanedir_consec_mean	0.598713549906398
driven_lanedir_consec_min	0.3302108044674239
driven_lanedir_max	1.0483084495337258
driven_lanedir_mean	0.6513004023278045
driven_lanedir_median	0.6414507384399326
driven_lanedir_min	0.3302108044674239
in-drivable-lane_max	5.700000000000037
in-drivable-lane_mean	2.6600000000000064
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4454423992276929, "sim_physics": 0.1466299295425415, "survival_time": 3.1999999999999966, "driven_lanedir": 0.3302108044674239, "sim_render-ego": 0.0768769234418869, "in-drivable-lane": 0, "agent_compute-ego": 0.10043107345700264, "deviation-heading": 1.6209814157480873, "set_robot_commands": 0.12702864035964012, "deviation-center-line": 0.2859628110731143, "driven_lanedir_consec": 0.3302108044674239, "sim_compute_sim_state": 0.047550443559885025, "sim_compute_performance-ego": 0.08457131311297417, "sim_compute_robot_state-ego": 0.10405806079506874}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2075180640897292, "sim_physics": 0.14289484509996547, "survival_time": 7.84999999999998, "driven_lanedir": 0.5110582934685279, "sim_render-ego": 0.07230501569760074, "in-drivable-lane": 3.0999999999999934, "agent_compute-ego": 0.0903508298715968, "deviation-heading": 2.840101647554727, "set_robot_commands": 0.11954835114205718, "deviation-center-line": 0.4326091304196939, "driven_lanedir_consec": 0.34881690325080217, "sim_compute_sim_state": 0.046990210842934386, "sim_compute_performance-ego": 0.08417147739677672, "sim_compute_robot_state-ego": 0.0939989864446555}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6453926249244959, "sim_physics": 0.10985647672894357, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6414507384399326, "sim_render-ego": 0.06815586418941103, "in-drivable-lane": 0, "agent_compute-ego": 0.08616342489746795, "deviation-heading": 0.46302943039476574, "set_robot_commands": 0.1118841856375508, "deviation-center-line": 0.4867676369691286, "driven_lanedir_consec": 0.6414507384399326, "sim_compute_sim_state": 0.041904052098592125, "sim_compute_performance-ego": 0.07719280253881695, "sim_compute_robot_state-ego": 0.08864373448251307}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6812981672339016, "sim_physics": 0.1520342230796814, "survival_time": 10.800000000000018, "driven_lanedir": 0.7254737257294122, "sim_render-ego": 0.07260257667965359, "in-drivable-lane": 4.500000000000002, "agent_compute-ego": 0.08909995577953479, "deviation-heading": 3.680656813150504, "set_robot_commands": 0.11708927596056903, "deviation-center-line": 0.3278531327356712, "driven_lanedir_consec": 0.7254737257294122, "sim_compute_sim_state": 0.045711380464059335, "sim_compute_performance-ego": 0.08185615252565455, "sim_compute_robot_state-ego": 0.0938121356345989}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3476347813639458, "sim_physics": 0.1636940058072408, "survival_time": 14.950000000000076, "driven_lanedir": 1.0483084495337258, "sim_render-ego": 0.06823385953903198, "in-drivable-lane": 5.700000000000037, "agent_compute-ego": 0.08522342999776204, "deviation-heading": 5.672762660199323, "set_robot_commands": 0.10884817202885944, "deviation-center-line": 0.5421157908956298, "driven_lanedir_consec": 0.9476155776444192, "sim_compute_sim_state": 0.04320944706598918, "sim_compute_performance-ego": 0.07818224589029948, "sim_compute_robot_state-ego": 0.08791393995285034}}
set_robot_commands_max	0.12702864035964012
set_robot_commands_mean	0.11687972502573532
set_robot_commands_median	0.11708927596056903
set_robot_commands_min	0.10884817202885944
sim_compute_performance-ego_max	0.08457131311297417
sim_compute_performance-ego_mean	0.08119479829290437
sim_compute_performance-ego_median	0.08185615252565455
sim_compute_performance-ego_min	0.07719280253881695
sim_compute_robot_state-ego_max	0.10405806079506874
sim_compute_robot_state-ego_mean	0.09368537146193733
sim_compute_robot_state-ego_median	0.0938121356345989
sim_compute_robot_state-ego_min	0.08791393995285034
sim_compute_sim_state_max	0.047550443559885025
sim_compute_sim_state_mean	0.045073106806292014
sim_compute_sim_state_median	0.045711380464059335
sim_compute_sim_state_min	0.041904052098592125
sim_physics_max	0.1636940058072408
sim_physics_mean	0.14302189605167454
sim_physics_median	0.1466299295425415
sim_physics_min	0.10985647672894357
sim_render-ego_max	0.0768769234418869
sim_render-ego_mean	0.07163484790951685
sim_render-ego_median	0.07230501569760074
sim_render-ego_min	0.06815586418941103
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.230000000000013
survival_time_min	3.1999999999999966

No reset possible

20369

2703

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:55:18+00:00

2019-04-25 12:00:07+00:00

0:04:49

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20369-206669', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20369-206669', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20369-206669', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20360

2730

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-25 11:53:14+00:00

2019-04-25 11:54:58+00:00

0:01:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20340

2766

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 11:38:26+00:00

2019-04-25 11:52:58+00:00

0:14:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6393210849374573
survival_time_median	5.09999999999999
deviation-center-line_median	0.5386115394130049
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.10762449105580647
agent_compute-ego_mean	0.10161635026924172
agent_compute-ego_median	0.10044742027918498
agent_compute-ego_min	0.09626110206216068
deviation-center-line_max	0.6438735370454763
deviation-center-line_mean	0.4873009119774061
deviation-center-line_min	0.25422529074398215
deviation-heading_max	5.549042393034549
deviation-heading_mean	2.6992384410422736
deviation-heading_median	1.4472751812155789
deviation-heading_min	0.6986866260141271
driven_any_max	2.316236122114833
driven_any_mean	1.22403678266176
driven_any_median	0.7659271526746111
driven_any_min	0.42192194109501385
driven_lanedir_consec_max	0.7462626502409044
driven_lanedir_consec_mean	0.5604736126838316
driven_lanedir_consec_min	0.32121010056738397
driven_lanedir_max	0.903128730888478
driven_lanedir_mean	0.6877961044893671
driven_lanedir_median	0.7462626502409044
driven_lanedir_min	0.32121010056738397
in-drivable-lane_max	6.800000000000061
in-drivable-lane_mean	2.280000000000018
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.42192194109501385, "sim_physics": 0.11091851790746052, "survival_time": 2.9999999999999973, "driven_lanedir": 0.32121010056738397, "sim_render-ego": 0.06209574540456136, "in-drivable-lane": 0, "agent_compute-ego": 0.10044742027918498, "deviation-heading": 1.4472751812155789, "set_robot_commands": 0.1020915667215983, "deviation-center-line": 0.25422529074398215, "driven_lanedir_consec": 0.32121010056738397, "sim_compute_sim_state": 0.04079160690307617, "sim_compute_performance-ego": 0.07262694040934245, "sim_compute_robot_state-ego": 0.07490251461664836}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8983871033033, "sim_physics": 0.1379271210956966, "survival_time": 12.150000000000038, "driven_lanedir": 0.7592512188573799, "sim_render-ego": 0.06698365564699527, "in-drivable-lane": 4.600000000000028, "agent_compute-ego": 0.09930693857954365, "deviation-heading": 5.549042393034549, "set_robot_commands": 0.10470162791970336, "deviation-center-line": 0.6438735370454763, "driven_lanedir_consec": 0.3864464057807227, "sim_compute_sim_state": 0.042214215047074934, "sim_compute_performance-ego": 0.07610413861372833, "sim_compute_robot_state-ego": 0.0809490190121372}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7177115941210425, "sim_physics": 0.11723591138919194, "survival_time": 4.799999999999991, "driven_lanedir": 0.7091278218926895, "sim_render-ego": 0.06732002645730972, "in-drivable-lane": 0, "agent_compute-ego": 0.10762449105580647, "deviation-heading": 0.6986866260141271, "set_robot_commands": 0.118619903922081, "deviation-center-line": 0.5386115394130049, "driven_lanedir_consec": 0.7091278218926895, "sim_compute_sim_state": 0.043705557783444725, "sim_compute_performance-ego": 0.07786345481872559, "sim_compute_robot_state-ego": 0.09452051172653834}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7659271526746111, "sim_physics": 0.1277758654426126, "survival_time": 5.09999999999999, "driven_lanedir": 0.7462626502409044, "sim_render-ego": 0.07032691964916155, "in-drivable-lane": 0, "agent_compute-ego": 0.10444179936951282, "deviation-heading": 1.005937967994409, "set_robot_commands": 0.1062864719652662, "deviation-center-line": 0.4261044001621655, "driven_lanedir_consec": 0.7462626502409044, "sim_compute_sim_state": 0.04164628421559053, "sim_compute_performance-ego": 0.07754992036258473, "sim_compute_robot_state-ego": 0.08675940130271163}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.316236122114833, "sim_physics": 0.1372119604530981, "survival_time": 14.750000000000076, "driven_lanedir": 0.903128730888478, "sim_render-ego": 0.061963784492621986, "in-drivable-lane": 6.800000000000061, "agent_compute-ego": 0.09626110206216068, "deviation-heading": 4.795250036952704, "set_robot_commands": 0.0961662648087841, "deviation-center-line": 0.5736897925224012, "driven_lanedir_consec": 0.6393210849374573, "sim_compute_sim_state": 0.038801983655509305, "sim_compute_performance-ego": 0.07022674689858646, "sim_compute_robot_state-ego": 0.07525397155244472}}
set_robot_commands_max	0.118619903922081
set_robot_commands_mean	0.10557316706748658
set_robot_commands_median	0.10470162791970336
set_robot_commands_min	0.0961662648087841
sim_compute_performance-ego_max	0.07786345481872559
sim_compute_performance-ego_mean	0.0748742402205935
sim_compute_performance-ego_median	0.07610413861372833
sim_compute_performance-ego_min	0.07022674689858646
sim_compute_robot_state-ego_max	0.09452051172653834
sim_compute_robot_state-ego_mean	0.08247708364209606
sim_compute_robot_state-ego_median	0.0809490190121372
sim_compute_robot_state-ego_min	0.07490251461664836
sim_compute_sim_state_max	0.043705557783444725
sim_compute_sim_state_mean	0.04143192952093913
sim_compute_sim_state_median	0.04164628421559053
sim_compute_sim_state_min	0.038801983655509305
sim_physics_max	0.1379271210956966
sim_physics_mean	0.12621387525761196
sim_physics_median	0.1277758654426126
sim_physics_min	0.11091851790746052
sim_render-ego_max	0.07032691964916155
sim_render-ego_mean	0.06573802633012997
sim_render-ego_median	0.06698365564699527
sim_render-ego_min	0.061963784492621986
simulation-passed	1
survival_time_max	14.750000000000076
survival_time_mean	7.960000000000018
survival_time_min	2.9999999999999973

No reset possible

20337

2778

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 11:37:25+00:00

2019-04-25 11:37:57+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20331

2779

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 11:36:17+00:00

2019-04-25 11:36:50+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20323

2799

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 11:33:53+00:00

2019-04-25 11:35:43+00:00

0:01:50

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20311

2823

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:25:10+00:00

2019-04-25 11:33:18+00:00

0:08:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.15672551958184494
agent_compute-ego_mean	0.1417332132465968
agent_compute-ego_median	0.14016468120071124
agent_compute-ego_min	0.12500487400006643
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.14387718686517678, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.056427244870167856, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.14016468120071124, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.08425077402366782, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.04108016445951642, "sim_compute_performance-ego": 0.06109764890850715, "sim_compute_robot_state-ego": 0.0669700154718363, "sim_compute_robot_state-npc0": 0.06226031735258283, "sim_compute_robot_state-npc1": 0.06316600655609707, "sim_compute_robot_state-npc2": 0.06321150401853165, "sim_compute_robot_state-npc3": 0.06350498829247817}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.14227347190563494, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.05905569516695463, "in-drivable-lane": 0, "agent_compute-ego": 0.13825591710897592, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.08440572481888992, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.03942851836864765, "sim_compute_performance-ego": 0.06607212470127986, "sim_compute_robot_state-ego": 0.06956885411189152, "sim_compute_robot_state-npc0": 0.06606711791111873, "sim_compute_robot_state-npc1": 0.06504086347726676, "sim_compute_robot_state-npc2": 0.06947455956385686, "sim_compute_robot_state-npc3": 0.0697109240752}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.16340562230662295, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.0629691481590271, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.15672551958184494, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.0976778645264475, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.03804141596743935, "sim_compute_performance-ego": 0.07093229105598048, "sim_compute_robot_state-ego": 0.07954224159843043, "sim_compute_robot_state-npc0": 0.06816150640186511, "sim_compute_robot_state-npc1": 0.07128149271011353, "sim_compute_robot_state-npc2": 0.06908246090537623, "sim_compute_robot_state-npc3": 0.06820647967489142}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.11943518059163154, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.05033168309851538, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.12500487400006643, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.07543094248711309, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.030413437493239777, "sim_compute_performance-ego": 0.05557217779038827, "sim_compute_robot_state-ego": 0.05838272239588484, "sim_compute_robot_state-npc0": 0.05751846711846847, "sim_compute_robot_state-npc1": 0.05810249606265298, "sim_compute_robot_state-npc2": 0.05679338491415676, "sim_compute_robot_state-npc3": 0.054497459266759175}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.14288446638319227, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06363431612650554, "in-drivable-lane": 0, "agent_compute-ego": 0.14851507434138544, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.09636917820683231, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.036917138982702186, "sim_compute_performance-ego": 0.06622434545446325, "sim_compute_robot_state-ego": 0.07324158703839337, "sim_compute_robot_state-npc0": 0.06472285588582356, "sim_compute_robot_state-npc1": 0.0647438367207845, "sim_compute_robot_state-npc2": 0.06396034911826805, "sim_compute_robot_state-npc3": 0.06415978184452763}}
set_robot_commands_max	0.0976778645264475
set_robot_commands_mean	0.08762689681259013
set_robot_commands_median	0.08440572481888992
set_robot_commands_min	0.07543094248711309
sim_compute_performance-ego_max	0.07093229105598048
sim_compute_performance-ego_mean	0.06397971758212381
sim_compute_performance-ego_median	0.06607212470127986
sim_compute_performance-ego_min	0.05557217779038827
sim_compute_robot_state-ego_max	0.07954224159843043
sim_compute_robot_state-ego_mean	0.0695410841232873
sim_compute_robot_state-ego_median	0.06956885411189152
sim_compute_robot_state-ego_min	0.05838272239588484
sim_compute_robot_state-npc0_max	0.06816150640186511
sim_compute_robot_state-npc0_mean	0.06374605293397173
sim_compute_robot_state-npc0_median	0.06472285588582356
sim_compute_robot_state-npc0_min	0.05751846711846847
sim_compute_robot_state-npc1_max	0.07128149271011353
sim_compute_robot_state-npc1_mean	0.06446693910538297
sim_compute_robot_state-npc1_median	0.0647438367207845
sim_compute_robot_state-npc1_min	0.05810249606265298
sim_compute_robot_state-npc2_max	0.06947455956385686
sim_compute_robot_state-npc2_mean	0.0645044517040379
sim_compute_robot_state-npc2_median	0.06396034911826805
sim_compute_robot_state-npc2_min	0.05679338491415676
sim_compute_robot_state-npc3_max	0.0697109240752
sim_compute_robot_state-npc3_mean	0.06401592663077128
sim_compute_robot_state-npc3_median	0.06415978184452763
sim_compute_robot_state-npc3_min	0.054497459266759175
sim_compute_sim_state_max	0.04108016445951642
sim_compute_sim_state_mean	0.03717613505430907
sim_compute_sim_state_median	0.03804141596743935
sim_compute_sim_state_min	0.030413437493239777
sim_physics_max	0.16340562230662295
sim_physics_mean	0.14237518561045168
sim_physics_median	0.14288446638319227
sim_physics_min	0.11943518059163154
sim_render-ego_max	0.06363431612650554
sim_render-ego_mean	0.0584836174842341
sim_render-ego_median	0.05905569516695463
sim_render-ego_min	0.05033168309851538
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20270

2907

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 11:00:22+00:00

2019-04-25 11:24:37+00:00

0:24:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.3935483196426444
survival_time_median	8.349999999999984
deviation-center-line_median	0.5319314045213592
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.28810887993452794
agent_compute-ego_mean	0.23703320917070583
agent_compute-ego_median	0.2311811033884684
agent_compute-ego_min	0.19590728759765624
deviation-center-line_max	1.089013276901404
deviation-center-line_mean	0.5315124114826804
deviation-center-line_min	0.1829676816078264
deviation-heading_max	0.9829718785711904
deviation-heading_mean	0.8286973801164391
deviation-heading_median	0.8466877216275525
deviation-heading_min	0.6643836524907397
driven_any_max	2.5533671935689743
driven_any_mean	1.389845221202196
driven_any_median	1.4003273617491212
driven_any_min	0.3783149598878067
driven_lanedir_consec_max	2.294813131089062
driven_lanedir_consec_mean	1.2481922666886047
driven_lanedir_consec_min	0.36500236206727954
driven_lanedir_max	2.29484233855185
driven_lanedir_mean	1.2482735826147096
driven_lanedir_median	1.3938954635608076
driven_lanedir_min	0.36500236206727954
in-drivable-lane_max	2.250000000000032
in-drivable-lane_mean	0.7400000000000105
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.4003273617491212, "sim_physics": 0.21468650366731745, "survival_time": 8.349999999999984, "driven_lanedir": 1.3938954635608076, "sim_render-ego": 0.06715622776282762, "in-drivable-lane": 0, "agent_compute-ego": 0.28810887993452794, "deviation-heading": 0.786989947500488, "set_robot_commands": 0.13301449907040166, "deviation-center-line": 0.5319314045213592, "driven_lanedir_consec": 1.3935483196426444, "sim_compute_sim_state": 0.04210104485471806, "sim_compute_performance-ego": 0.07972024871917542, "sim_compute_robot_state-ego": 0.08244256202332274, "sim_compute_robot_state-npc0": 0.07403660677150338, "sim_compute_robot_state-npc1": 0.0736078116708173, "sim_compute_robot_state-npc2": 0.07341389456195031, "sim_compute_robot_state-npc3": 0.07763123512268066}, "udem1-1-0": {"driven_any": 0.4481960084795964, "sim_physics": 0.17050946992019128, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226073390807623, "sim_render-ego": 0.06062748514372727, "in-drivable-lane": 0, "agent_compute-ego": 0.21864735258036647, "deviation-heading": 0.9829718785711904, "set_robot_commands": 0.0955142646000303, "deviation-center-line": 0.20822502421497932, "driven_lanedir_consec": 0.4226073390807623, "sim_compute_sim_state": 0.03767829105771821, "sim_compute_performance-ego": 0.06707748051347404, "sim_compute_robot_state-ego": 0.07189721485664105, "sim_compute_robot_state-npc0": 0.06927385823480015, "sim_compute_robot_state-npc1": 0.07014765410587706, "sim_compute_robot_state-npc2": 0.06697002772627206, "sim_compute_robot_state-npc3": 0.06592323040140086}, "udem1-2-0": {"driven_any": 2.169020582325481, "sim_physics": 0.18318534364887312, "survival_time": 12.750000000000046, "driven_lanedir": 1.7650204098128477, "sim_render-ego": 0.05992717462427476, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.2513214223525103, "deviation-heading": 0.8624537003922248, "set_robot_commands": 0.09336328786962172, "deviation-center-line": 0.6454246701678333, "driven_lanedir_consec": 1.764990181563276, "sim_compute_sim_state": 0.03757199119119083, "sim_compute_performance-ego": 0.06382770444832596, "sim_compute_robot_state-ego": 0.06940328280131022, "sim_compute_robot_state-npc0": 0.06789968901989507, "sim_compute_robot_state-npc1": 0.066836851718379, "sim_compute_robot_state-npc2": 0.06555170545391008, "sim_compute_robot_state-npc3": 0.06641572409985112}, "udem1-3-0": {"driven_any": 2.5533671935689743, "sim_physics": 0.1949417432149251, "survival_time": 14.950000000000076, "driven_lanedir": 2.29484233855185, "sim_render-ego": 0.06125612497329712, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.2311811033884684, "deviation-heading": 0.8466877216275525, "set_robot_commands": 0.09215030034383138, "deviation-center-line": 1.089013276901404, "driven_lanedir_consec": 2.294813131089062, "sim_compute_sim_state": 0.03772512038548787, "sim_compute_performance-ego": 0.06754132270812989, "sim_compute_robot_state-ego": 0.07296149253845215, "sim_compute_robot_state-npc0": 0.06726473251978557, "sim_compute_robot_state-npc1": 0.06883942365646362, "sim_compute_robot_state-npc2": 0.06706049124399821, "sim_compute_robot_state-npc3": 0.06607783158620198}, "udem1-4-0": {"driven_any": 0.3783149598878067, "sim_physics": 0.1428041934967041, "survival_time": 2.499999999999999, "driven_lanedir": 0.36500236206727954, "sim_render-ego": 0.053736095428466794, "in-drivable-lane": 0, "agent_compute-ego": 0.19590728759765624, "deviation-heading": 0.6643836524907397, "set_robot_commands": 0.08305534839630127, "deviation-center-line": 0.1829676816078264, "driven_lanedir_consec": 0.36500236206727954, "sim_compute_sim_state": 0.03607606887817383, "sim_compute_performance-ego": 0.05989656448364258, "sim_compute_robot_state-ego": 0.06263020038604736, "sim_compute_robot_state-npc0": 0.0584454345703125, "sim_compute_robot_state-npc1": 0.05910097122192383, "sim_compute_robot_state-npc2": 0.059918761253356934, "sim_compute_robot_state-npc3": 0.06120214939117432}}
set_robot_commands_max	0.13301449907040166
set_robot_commands_mean	0.09941954005603726
set_robot_commands_median	0.09336328786962172
set_robot_commands_min	0.08305534839630127
sim_compute_performance-ego_max	0.07972024871917542
sim_compute_performance-ego_mean	0.06761266417454957
sim_compute_performance-ego_median	0.06707748051347404
sim_compute_performance-ego_min	0.05989656448364258
sim_compute_robot_state-ego_max	0.08244256202332274
sim_compute_robot_state-ego_mean	0.0718669505211547
sim_compute_robot_state-ego_median	0.07189721485664105
sim_compute_robot_state-ego_min	0.06263020038604736
sim_compute_robot_state-npc0_max	0.07403660677150338
sim_compute_robot_state-npc0_mean	0.06738406422325934
sim_compute_robot_state-npc0_median	0.06789968901989507
sim_compute_robot_state-npc0_min	0.0584454345703125
sim_compute_robot_state-npc1_max	0.0736078116708173
sim_compute_robot_state-npc1_mean	0.06770654247469216
sim_compute_robot_state-npc1_median	0.06883942365646362
sim_compute_robot_state-npc1_min	0.05910097122192383
sim_compute_robot_state-npc2_max	0.07341389456195031
sim_compute_robot_state-npc2_mean	0.06658297604789752
sim_compute_robot_state-npc2_median	0.06697002772627206
sim_compute_robot_state-npc2_min	0.059918761253356934
sim_compute_robot_state-npc3_max	0.07763123512268066
sim_compute_robot_state-npc3_mean	0.06745003412026178
sim_compute_robot_state-npc3_median	0.06607783158620198
sim_compute_robot_state-npc3_min	0.06120214939117432
sim_compute_sim_state_max	0.04210104485471806
sim_compute_sim_state_mean	0.03823050327345776
sim_compute_sim_state_median	0.03767829105771821
sim_compute_sim_state_min	0.03607606887817383
sim_physics_max	0.21468650366731745
sim_physics_mean	0.18122545078960223
sim_physics_median	0.18318534364887312
sim_physics_min	0.1428041934967041
sim_render-ego_max	0.06715622776282762
sim_render-ego_mean	0.06054062158651872
sim_render-ego_median	0.06062748514372727
sim_render-ego_min	0.053736095428466794
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.29000000000002
survival_time_min	2.499999999999999

No reset possible

20261

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-25 10:47:14+00:00

2019-04-25 11:00:07+00:00

0:12:53

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20261-897017', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20261-897017', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20261-897017', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20250

2928

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 10:39:23+00:00

2019-04-25 10:46:39+00:00

0:07:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.058611630922204894
survival_time_median	1.5000000000000009
deviation-center-line_median	0.08500689939663075
in-drivable-lane_median	0.5000000000000004

other stats

agent_compute-ego_max	0.1816295573585912
agent_compute-ego_mean	0.15472184399135727
agent_compute-ego_median	0.15900650231734567
agent_compute-ego_min	0.11967772245407104
deviation-center-line_max	0.12030766901851885
deviation-center-line_mean	0.07747998519833799
deviation-center-line_min	0.03131212256896728
deviation-heading_max	2.0565521394700306
deviation-heading_mean	0.9223222909710552
deviation-heading_median	0.6559844935000466
deviation-heading_min	0.5755515717898871
driven_any_max	0.5634438390562012
driven_any_mean	0.2274505546556766
driven_any_median	0.14515109058249992
driven_any_min	0.1009111609932225
driven_lanedir_consec_max	0.17735417690179256
driven_lanedir_consec_mean	0.08043172909591037
driven_lanedir_consec_min	0.04690882138906716
driven_lanedir_max	0.17735417690179256
driven_lanedir_mean	0.08043172909591037
driven_lanedir_median	0.058611630922204894
driven_lanedir_min	0.04690882138906716
in-drivable-lane_max	1.999999999999997
in-drivable-lane_mean	0.6899999999999997
in-drivable-lane_min	0.05000000000000005
per-episodes	details {"udem1-0-0": {"driven_any": 0.21824222014616532, "sim_physics": 0.18620711878726356, "survival_time": 1.900000000000001, "driven_lanedir": 0.058611630922204894, "sim_render-ego": 0.06438482435126054, "in-drivable-lane": 0.8000000000000007, "agent_compute-ego": 0.1816295573585912, "deviation-heading": 0.6559844935000466, "set_robot_commands": 0.09098792703528154, "deviation-center-line": 0.05862950141661416, "driven_lanedir_consec": 0.058611630922204894, "sim_compute_sim_state": 0.03794292399757787, "sim_compute_performance-ego": 0.06812031018106561, "sim_compute_robot_state-ego": 0.07083452375311601, "sim_compute_robot_state-npc0": 0.06799331464265522, "sim_compute_robot_state-npc1": 0.0683168612028423, "sim_compute_robot_state-npc2": 0.07068201115256861, "sim_compute_robot_state-npc3": 0.06721672886296322}, "udem1-1-0": {"driven_any": 0.5634438390562012, "sim_physics": 0.17647437210921402, "survival_time": 4.549999999999992, "driven_lanedir": 0.17735417690179256, "sim_render-ego": 0.06193002239688413, "in-drivable-lane": 1.999999999999997, "agent_compute-ego": 0.16704923504001493, "deviation-heading": 2.0565521394700306, "set_robot_commands": 0.09145191213586829, "deviation-center-line": 0.12030766901851885, "driven_lanedir_consec": 0.17735417690179256, "sim_compute_sim_state": 0.03677667628277789, "sim_compute_performance-ego": 0.06626860126034244, "sim_compute_robot_state-ego": 0.07051023022159116, "sim_compute_robot_state-npc0": 0.06669426226353907, "sim_compute_robot_state-npc1": 0.06877307839446016, "sim_compute_robot_state-npc2": 0.06588270376016805, "sim_compute_robot_state-npc3": 0.06726040944948301}, "udem1-2-0": {"driven_any": 0.1009111609932225, "sim_physics": 0.15952620298966116, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0578038958569822, "sim_render-ego": 0.0586983120959738, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15900650231734567, "deviation-heading": 0.6039934331193598, "set_robot_commands": 0.0794587860936704, "deviation-center-line": 0.09214373359095893, "driven_lanedir_consec": 0.0578038958569822, "sim_compute_sim_state": 0.03351228133491848, "sim_compute_performance-ego": 0.06644464575726053, "sim_compute_robot_state-ego": 0.06812617053156314, "sim_compute_robot_state-npc0": 0.056524224903272545, "sim_compute_robot_state-npc1": 0.06334226027778957, "sim_compute_robot_state-npc2": 0.06240491245103919, "sim_compute_robot_state-npc3": 0.06133069162783415}, "udem1-3-0": {"driven_any": 0.1095044625002941, "sim_physics": 0.11492957671483356, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06148012040950501, "sim_render-ego": 0.043525258700052895, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.11967772245407104, "deviation-heading": 0.5755515717898871, "set_robot_commands": 0.06803600986798604, "deviation-center-line": 0.08500689939663075, "driven_lanedir_consec": 0.06148012040950501, "sim_compute_sim_state": 0.028322925170262653, "sim_compute_performance-ego": 0.04508798321088155, "sim_compute_robot_state-ego": 0.05146882931391398, "sim_compute_robot_state-npc0": 0.05141308903694153, "sim_compute_robot_state-npc1": 0.04918187856674194, "sim_compute_robot_state-npc2": 0.05083773533503214, "sim_compute_robot_state-npc3": 0.05073457956314087}, "udem1-4-0": {"driven_any": 0.14515109058249992, "sim_physics": 0.15428438981374104, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04690882138906716, "sim_render-ego": 0.050658186276753746, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1462462027867635, "deviation-heading": 0.7195298169759522, "set_robot_commands": 0.07939666112263997, "deviation-center-line": 0.03131212256896728, "driven_lanedir_consec": 0.04690882138906716, "sim_compute_sim_state": 0.03388619422912598, "sim_compute_performance-ego": 0.05631806055704753, "sim_compute_robot_state-ego": 0.06069429715474447, "sim_compute_robot_state-npc0": 0.055466413497924805, "sim_compute_robot_state-npc1": 0.05485081672668457, "sim_compute_robot_state-npc2": 0.05642879009246826, "sim_compute_robot_state-npc3": 0.056200695037841794}}
set_robot_commands_max	0.09145191213586829
set_robot_commands_mean	0.08186625925108924
set_robot_commands_median	0.0794587860936704
set_robot_commands_min	0.06803600986798604
sim_compute_performance-ego_max	0.06812031018106561
sim_compute_performance-ego_mean	0.060447920193319536
sim_compute_performance-ego_median	0.06626860126034244
sim_compute_performance-ego_min	0.04508798321088155
sim_compute_robot_state-ego_max	0.07083452375311601
sim_compute_robot_state-ego_mean	0.06432681019498575
sim_compute_robot_state-ego_median	0.06812617053156314
sim_compute_robot_state-ego_min	0.05146882931391398
sim_compute_robot_state-npc0_max	0.06799331464265522
sim_compute_robot_state-npc0_mean	0.05961826086886664
sim_compute_robot_state-npc0_median	0.056524224903272545
sim_compute_robot_state-npc0_min	0.05141308903694153
sim_compute_robot_state-npc1_max	0.06877307839446016
sim_compute_robot_state-npc1_mean	0.060892979033703706
sim_compute_robot_state-npc1_median	0.06334226027778957
sim_compute_robot_state-npc1_min	0.04918187856674194
sim_compute_robot_state-npc2_max	0.07068201115256861
sim_compute_robot_state-npc2_mean	0.06124723055825525
sim_compute_robot_state-npc2_median	0.06240491245103919
sim_compute_robot_state-npc2_min	0.05083773533503214
sim_compute_robot_state-npc3_max	0.06726040944948301
sim_compute_robot_state-npc3_mean	0.060548620908252616
sim_compute_robot_state-npc3_median	0.06133069162783415
sim_compute_robot_state-npc3_min	0.05073457956314087
sim_compute_sim_state_max	0.03794292399757787
sim_compute_sim_state_mean	0.03408820020293258
sim_compute_sim_state_median	0.03388619422912598
sim_compute_sim_state_min	0.028322925170262653
sim_physics_max	0.18620711878726356
sim_physics_mean	0.15828433208294268
sim_physics_median	0.15952620298966116
sim_physics_min	0.11492957671483356
sim_render-ego_max	0.06438482435126054
sim_render-ego_mean	0.05583932076418502
sim_render-ego_median	0.0586983120959738
sim_render-ego_min	0.043525258700052895
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.0599999999999987
survival_time_min	1.1500000000000004

No reset possible

20239

2944

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 10:35:15+00:00

2019-04-25 10:39:16+00:00

0:04:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09937937660573049
survival_time_median	1.5500000000000007
deviation-center-line_median	0.06474938175326798
in-drivable-lane_median	0.10000000000000007

other stats

agent_compute-ego_max	0.15675621032714843
agent_compute-ego_mean	0.1273234369117509
agent_compute-ego_median	0.12047218141101657
agent_compute-ego_min	0.09910621181611091
deviation-center-line_max	0.09855491508240248
deviation-center-line_mean	0.07212885815410056
deviation-center-line_min	0.055591149553548096
deviation-heading_max	0.9393675182970456
deviation-heading_mean	0.8395322097463929
deviation-heading_median	0.8778653372653008
deviation-heading_min	0.5874846654597325
driven_any_max	0.21113909560539557
driven_any_mean	0.17979973979813252
driven_any_median	0.18445590130505085
driven_any_min	0.12127732852500006
driven_lanedir_consec_max	0.1404789881598859
driven_lanedir_consec_mean	0.0993588787044373
driven_lanedir_consec_min	0.06582878732014841
driven_lanedir_max	0.1404789881598859
driven_lanedir_mean	0.0993588787044373
driven_lanedir_median	0.09937937660573049
driven_lanedir_min	0.06582878732014841
in-drivable-lane_max	0.30000000000000027
in-drivable-lane_mean	0.14000000000000012
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21113909560539557, "sim_physics": 0.09767632484436035, "survival_time": 1.7500000000000009, "driven_lanedir": 0.09937937660573049, "sim_render-ego": 0.06090803827558245, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15675621032714843, "deviation-heading": 0.9393675182970456, "set_robot_commands": 0.08553045817783901, "deviation-center-line": 0.08038669476360147, "driven_lanedir_consec": 0.09937937660573049, "sim_compute_sim_state": 0.0376119749886649, "sim_compute_performance-ego": 0.06564655985151019, "sim_compute_robot_state-ego": 0.07172727584838867}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21052708090404856, "sim_physics": 0.08505551742784905, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1404789881598859, "sim_render-ego": 0.056551889939741654, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15436668107003876, "deviation-heading": 0.8778653372653008, "set_robot_commands": 0.08722650643550989, "deviation-center-line": 0.06474938175326798, "driven_lanedir_consec": 0.1404789881598859, "sim_compute_sim_state": 0.03661899133162065, "sim_compute_performance-ego": 0.06335750493136319, "sim_compute_robot_state-ego": 0.06939273892026959}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12127732852500006, "sim_physics": 0.06361200695946104, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08911721580493248, "sim_render-ego": 0.04549657730829148, "in-drivable-lane": 0, "agent_compute-ego": 0.12047218141101657, "deviation-heading": 0.5874846654597325, "set_robot_commands": 0.06732009706043061, "deviation-center-line": 0.09855491508240248, "driven_lanedir_consec": 0.08911721580493248, "sim_compute_sim_state": 0.030967746462140764, "sim_compute_performance-ego": 0.0512391726175944, "sim_compute_robot_state-ego": 0.05047127178737095}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17159929265116752, "sim_physics": 0.06642136902644716, "survival_time": 1.4500000000000006, "driven_lanedir": 0.06582878732014841, "sim_render-ego": 0.041519255473695955, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.10591589993443982, "deviation-heading": 0.9209278051806182, "set_robot_commands": 0.06213553198452654, "deviation-center-line": 0.055591149553548096, "driven_lanedir_consec": 0.06582878732014841, "sim_compute_sim_state": 0.026445561441881905, "sim_compute_performance-ego": 0.043650199627054145, "sim_compute_robot_state-ego": 0.044763227988933695}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18445590130505085, "sim_physics": 0.05629166480033628, "survival_time": 1.5500000000000007, "driven_lanedir": 0.10199002563148918, "sim_render-ego": 0.03922958527841876, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09910621181611091, "deviation-heading": 0.8720157225292676, "set_robot_commands": 0.05550853667720672, "deviation-center-line": 0.06136214961768277, "driven_lanedir_consec": 0.10199002563148918, "sim_compute_sim_state": 0.025051662998814735, "sim_compute_performance-ego": 0.04294404675883631, "sim_compute_robot_state-ego": 0.04395674120995306}}
set_robot_commands_max	0.08722650643550989
set_robot_commands_mean	0.07154422606710256
set_robot_commands_median	0.06732009706043061
set_robot_commands_min	0.05550853667720672
sim_compute_performance-ego_max	0.06564655985151019
sim_compute_performance-ego_mean	0.053367496757271635
sim_compute_performance-ego_median	0.0512391726175944
sim_compute_performance-ego_min	0.04294404675883631
sim_compute_robot_state-ego_max	0.07172727584838867
sim_compute_robot_state-ego_mean	0.0560622511509832
sim_compute_robot_state-ego_median	0.05047127178737095
sim_compute_robot_state-ego_min	0.04395674120995306
sim_compute_sim_state_max	0.0376119749886649
sim_compute_sim_state_mean	0.03133918744462459
sim_compute_sim_state_median	0.030967746462140764
sim_compute_sim_state_min	0.025051662998814735
sim_physics_max	0.09767632484436035
sim_physics_mean	0.07381137661169077
sim_physics_median	0.06642136902644716
sim_physics_min	0.05629166480033628
sim_render-ego_max	0.06090803827558245
sim_render-ego_mean	0.04874106925514606
sim_render-ego_median	0.04549657730829148
sim_render-ego_min	0.03922958527841876
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.4900000000000009
survival_time_min	1.0500000000000005

No reset possible

20235

2952

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 10:27:42+00:00

2019-04-25 10:34:41+00:00

0:06:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07427465723422921
survival_time_median	1.3000000000000005
deviation-center-line_median	0.08500996313379416
in-drivable-lane_median	0.15000000000000013

other stats

agent_compute-ego_max	0.182798490524292
agent_compute-ego_mean	0.1586161852377314
agent_compute-ego_median	0.15955827288005664
agent_compute-ego_min	0.12280226790386696
deviation-center-line_max	0.09790593702878948
deviation-center-line_mean	0.07836361408988309
deviation-center-line_min	0.04904994012082901
deviation-heading_max	2.0178092627237527
deviation-heading_mean	0.9627457179539995
deviation-heading_median	0.8042965250842299
deviation-heading_min	0.5740487045947265
driven_any_max	0.4981160637046057
driven_any_mean	0.20814835267568585
driven_any_median	0.13734470379055125
driven_any_min	0.09716700012444808
driven_lanedir_consec_max	0.15618302712096055
driven_lanedir_consec_mean	0.08493617015267411
driven_lanedir_consec_min	0.048227459041394694
driven_lanedir_max	0.15618302712096055
driven_lanedir_mean	0.08493617015267411
driven_lanedir_median	0.07427465723422921
driven_lanedir_min	0.048227459041394694
in-drivable-lane_max	2.049999999999997
in-drivable-lane_mean	0.6099999999999997
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.1990441961426676, "sim_physics": 0.16170785977290228, "survival_time": 1.950000000000001, "driven_lanedir": 0.07427465723422921, "sim_render-ego": 0.060573480068108976, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1580632466536302, "deviation-heading": 0.8042965250842299, "set_robot_commands": 0.08843541756654397, "deviation-center-line": 0.06590008650256156, "driven_lanedir_consec": 0.07427465723422921, "sim_compute_sim_state": 0.037253355368589744, "sim_compute_performance-ego": 0.06647081864185822, "sim_compute_robot_state-ego": 0.07143915616548978, "sim_compute_robot_state-npc0": 0.06723323235144982, "sim_compute_robot_state-npc1": 0.06523819458790314, "sim_compute_robot_state-npc2": 0.0636902100000626, "sim_compute_robot_state-npc3": 0.06441971583244128}, "udem1-1-0": {"driven_any": 0.4981160637046057, "sim_physics": 0.155655386655227, "survival_time": 4.599999999999992, "driven_lanedir": 0.15618302712096055, "sim_render-ego": 0.05977756303289662, "in-drivable-lane": 2.049999999999997, "agent_compute-ego": 0.15955827288005664, "deviation-heading": 2.0178092627237527, "set_robot_commands": 0.0912615294041841, "deviation-center-line": 0.0939521436634412, "driven_lanedir_consec": 0.15618302712096055, "sim_compute_sim_state": 0.037378420000490936, "sim_compute_performance-ego": 0.06849316928697669, "sim_compute_robot_state-ego": 0.0708670305169147, "sim_compute_robot_state-npc0": 0.06665353671364162, "sim_compute_robot_state-npc1": 0.0652940351030101, "sim_compute_robot_state-npc2": 0.06294268369674683, "sim_compute_robot_state-npc3": 0.06345894544020943}, "udem1-2-0": {"driven_any": 0.10906979961615662, "sim_physics": 0.13439442800438922, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07557883219127781, "sim_render-ego": 0.047799172608748726, "in-drivable-lane": 0, "agent_compute-ego": 0.12280226790386696, "deviation-heading": 0.5740487045947265, "set_robot_commands": 0.07106713626695715, "deviation-center-line": 0.09790593702878948, "driven_lanedir_consec": 0.07557883219127781, "sim_compute_sim_state": 0.031112961147142498, "sim_compute_performance-ego": 0.05087991382764733, "sim_compute_robot_state-ego": 0.05359138613161833, "sim_compute_robot_state-npc0": 0.057572551395582115, "sim_compute_robot_state-npc1": 0.05300703256026558, "sim_compute_robot_state-npc2": 0.05410373729208241, "sim_compute_robot_state-npc3": 0.05591613313426142}, "udem1-3-0": {"driven_any": 0.09716700012444808, "sim_physics": 0.1756064510345459, "survival_time": 1.2500000000000004, "driven_lanedir": 0.048227459041394694, "sim_render-ego": 0.06521432876586913, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.182798490524292, "deviation-heading": 0.6045353031953202, "set_robot_commands": 0.093342924118042, "deviation-center-line": 0.08500996313379416, "driven_lanedir_consec": 0.048227459041394694, "sim_compute_sim_state": 0.03797979354858398, "sim_compute_performance-ego": 0.07065297126770019, "sim_compute_robot_state-ego": 0.07853339195251464, "sim_compute_robot_state-npc0": 0.06687660217285156, "sim_compute_robot_state-npc1": 0.06837141990661622, "sim_compute_robot_state-npc2": 0.0684835147857666, "sim_compute_robot_state-npc3": 0.06865105628967286}, "udem1-4-0": {"driven_any": 0.13734470379055125, "sim_physics": 0.15730132506443903, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07041687517550832, "sim_render-ego": 0.0649943626843966, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.16985864822681135, "deviation-heading": 0.8130387941719684, "set_robot_commands": 0.09695848134847788, "deviation-center-line": 0.04904994012082901, "driven_lanedir_consec": 0.07041687517550832, "sim_compute_sim_state": 0.04011202775515043, "sim_compute_performance-ego": 0.06978122087625357, "sim_compute_robot_state-ego": 0.0700605374116164, "sim_compute_robot_state-npc0": 0.07266783714294434, "sim_compute_robot_state-npc1": 0.06912684440612793, "sim_compute_robot_state-npc2": 0.06813376683455247, "sim_compute_robot_state-npc3": 0.06790195061610295}}
set_robot_commands_max	0.09695848134847788
set_robot_commands_mean	0.088213097740841
set_robot_commands_median	0.0912615294041841
set_robot_commands_min	0.07106713626695715
sim_compute_performance-ego_max	0.07065297126770019
sim_compute_performance-ego_mean	0.0652556187800872
sim_compute_performance-ego_median	0.06849316928697669
sim_compute_performance-ego_min	0.05087991382764733
sim_compute_robot_state-ego_max	0.07853339195251464
sim_compute_robot_state-ego_mean	0.06889830043563076
sim_compute_robot_state-ego_median	0.0708670305169147
sim_compute_robot_state-ego_min	0.05359138613161833
sim_compute_robot_state-npc0_max	0.07266783714294434
sim_compute_robot_state-npc0_mean	0.06620075195529389
sim_compute_robot_state-npc0_median	0.06687660217285156
sim_compute_robot_state-npc0_min	0.057572551395582115
sim_compute_robot_state-npc1_max	0.06912684440612793
sim_compute_robot_state-npc1_mean	0.0642075053127846
sim_compute_robot_state-npc1_median	0.0652940351030101
sim_compute_robot_state-npc1_min	0.05300703256026558
sim_compute_robot_state-npc2_max	0.0684835147857666
sim_compute_robot_state-npc2_mean	0.06347078252184217
sim_compute_robot_state-npc2_median	0.0636902100000626
sim_compute_robot_state-npc2_min	0.05410373729208241
sim_compute_robot_state-npc3_max	0.06865105628967286
sim_compute_robot_state-npc3_mean	0.06406956026253759
sim_compute_robot_state-npc3_median	0.06441971583244128
sim_compute_robot_state-npc3_min	0.05591613313426142
sim_compute_sim_state_max	0.04011202775515043
sim_compute_sim_state_mean	0.03676731156399152
sim_compute_sim_state_median	0.037378420000490936
sim_compute_sim_state_min	0.031112961147142498
sim_physics_max	0.1756064510345459
sim_physics_mean	0.1569330901063007
sim_physics_median	0.15730132506443903
sim_physics_min	0.13439442800438922
sim_render-ego_max	0.06521432876586913
sim_render-ego_mean	0.05967178143200401
sim_render-ego_median	0.060573480068108976
sim_render-ego_min	0.047799172608748726
simulation-passed	1
survival_time_max	4.599999999999992
survival_time_mean	2.049999999999999
survival_time_min	1.1500000000000004

No reset possible

20182

2894

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

aido2-LFVI-sim-validation

2019-04-25 10:03:25+00:00

2019-04-25 10:27:15+00:00

0:23:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5182481082640255
survival_time_median	14.950000000000076
deviation-center-line_median	0.8773976882756186
in-drivable-lane_median	3.3500000000000245

other stats

agent_compute-ego_max	0.17799432833989462
agent_compute-ego_mean	0.1710217104236031
agent_compute-ego_median	0.17290895144144694
agent_compute-ego_min	0.15848958551587156
deviation-center-line_max	1.0544944036127857
deviation-center-line_mean	0.782600638137475
deviation-center-line_min	0.3529804115204541
deviation-heading_max	6.850058024828836
deviation-heading_mean	4.500661620100965
deviation-heading_median	5.1003538537015904
deviation-heading_min	2.0565978091006984
driven_any_max	0.8246128043905556
driven_any_mean	0.674624944041731
driven_any_median	0.7326854679630929
driven_any_min	0.4703270837849535
driven_lanedir_consec_max	0.7337657580967467
driven_lanedir_consec_mean	0.4456217534655097
driven_lanedir_consec_min	0.15455857354779343
driven_lanedir_max	0.7337657580967467
driven_lanedir_mean	0.4519749072271943
driven_lanedir_median	0.5182481082640255
driven_lanedir_min	0.15455857354779343
in-drivable-lane_max	5.6500000000000155
in-drivable-lane_mean	2.9400000000000226
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7326854679630929, "sim_physics": 0.11780566215515136, "survival_time": 14.950000000000076, "driven_lanedir": 0.6200358981000944, "sim_render-ego": 0.059891708691914874, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.17290895144144694, "deviation-heading": 5.479335344942426, "set_robot_commands": 0.09306578954060872, "deviation-center-line": 0.8773976882756186, "driven_lanedir_consec": 0.5996860421001902, "sim_compute_sim_state": 0.03796908617019654, "sim_compute_performance-ego": 0.0666141700744629, "sim_compute_robot_state-ego": 0.07031938155492147}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8246128043905556, "sim_physics": 0.12638866901397705, "survival_time": 14.950000000000076, "driven_lanedir": 0.5182481082640255, "sim_render-ego": 0.06212830622990926, "in-drivable-lane": 4.700000000000057, "agent_compute-ego": 0.17799432833989462, "deviation-heading": 3.016963067931276, "set_robot_commands": 0.09298924922943116, "deviation-center-line": 1.0544944036127857, "driven_lanedir_consec": 0.5182481082640255, "sim_compute_sim_state": 0.03817348162333171, "sim_compute_performance-ego": 0.06914032220840455, "sim_compute_robot_state-ego": 0.07527557770411174}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5559305590674383, "sim_physics": 0.11931882585797993, "survival_time": 12.25000000000004, "driven_lanedir": 0.23326619812731145, "sim_render-ego": 0.06332022803170341, "in-drivable-lane": 3.3500000000000245, "agent_compute-ego": 0.17732195172991072, "deviation-heading": 6.850058024828836, "set_robot_commands": 0.09436700684683665, "deviation-center-line": 0.5885029770414923, "driven_lanedir_consec": 0.22185028531879247, "sim_compute_sim_state": 0.03952629809476891, "sim_compute_performance-ego": 0.07107390870853346, "sim_compute_robot_state-ego": 0.07587172936420052}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7895688050026155, "sim_physics": 0.1181023414929708, "survival_time": 14.950000000000076, "driven_lanedir": 0.7337657580967467, "sim_render-ego": 0.06111155430475871, "in-drivable-lane": 0, "agent_compute-ego": 0.16839373509089153, "deviation-heading": 5.1003538537015904, "set_robot_commands": 0.09361920992533368, "deviation-center-line": 1.039627710237025, "driven_lanedir_consec": 0.7337657580967467, "sim_compute_sim_state": 0.038119281927744546, "sim_compute_performance-ego": 0.06647245009740194, "sim_compute_robot_state-ego": 0.07178274234135945}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4703270837849535, "sim_physics": 0.10685745281959648, "survival_time": 10.050000000000008, "driven_lanedir": 0.15455857354779343, "sim_render-ego": 0.056429695727220223, "in-drivable-lane": 5.6500000000000155, "agent_compute-ego": 0.15848958551587156, "deviation-heading": 2.0565978091006984, "set_robot_commands": 0.0864405548987697, "deviation-center-line": 0.3529804115204541, "driven_lanedir_consec": 0.15455857354779343, "sim_compute_sim_state": 0.03731882512865968, "sim_compute_performance-ego": 0.06124889672692142, "sim_compute_robot_state-ego": 0.06798566751812228}}
set_robot_commands_max	0.09436700684683665
set_robot_commands_mean	0.09209636208819598
set_robot_commands_median	0.09306578954060872
set_robot_commands_min	0.0864405548987697
sim_compute_performance-ego_max	0.07107390870853346
sim_compute_performance-ego_mean	0.06690994956314486
sim_compute_performance-ego_median	0.0666141700744629
sim_compute_performance-ego_min	0.06124889672692142
sim_compute_robot_state-ego_max	0.07587172936420052
sim_compute_robot_state-ego_mean	0.0722470196965431
sim_compute_robot_state-ego_median	0.07178274234135945
sim_compute_robot_state-ego_min	0.06798566751812228
sim_compute_sim_state_max	0.03952629809476891
sim_compute_sim_state_mean	0.03822139458894027
sim_compute_sim_state_median	0.038119281927744546
sim_compute_sim_state_min	0.03731882512865968
sim_physics_max	0.12638866901397705
sim_physics_mean	0.11769459026793512
sim_physics_median	0.1181023414929708
sim_physics_min	0.10685745281959648
sim_render-ego_max	0.06332022803170341
sim_render-ego_mean	0.060576298597101286
sim_render-ego_median	0.06111155430475871
sim_render-ego_min	0.056429695727220223
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.430000000000057
survival_time_min	10.050000000000008

No reset possible

20172

2751

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

aido2-LFVI-sim-validation

2019-04-25 10:00:21+00:00

2019-04-25 10:02:05+00:00

0:01:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20159

2865

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 09:52:52+00:00

2019-04-25 10:00:04+00:00

0:07:12

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20159-239117', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20159-239117', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20159-239117', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20082

3062

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-25 09:16:36+00:00

2019-04-25 09:52:31+00:00

0:35:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0004615556694189671
survival_time_median	14.950000000000076
deviation-center-line_median	0.4893543511348479
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.16103732109069824
agent_compute-ego_mean	0.14596489906311036
agent_compute-ego_median	0.14446020285288494
agent_compute-ego_min	0.1374941110610962
deviation-center-line_max	0.6110634223668668
deviation-center-line_mean	0.420093337748217
deviation-center-line_min	0.01675128614096042
deviation-heading_max	5.828528410212022
deviation-heading_mean	5.666366635305937
deviation-heading_median	5.656741799274124
deviation-heading_min	5.45365698365684
driven_any_max	0.02699486662998817
driven_any_mean	0.025026630137878515
driven_any_median	0.025845567204838143
driven_any_min	0.022110630442247207
driven_lanedir_consec_max	0.0024811319357622708
driven_lanedir_consec_mean	-0.0002839237876270495
driven_lanedir_consec_min	-0.003723902623983477
driven_lanedir_max	0.0024811319357622708
driven_lanedir_mean	-0.0002839237876270495
driven_lanedir_median	0.0004615556694189671
driven_lanedir_min	-0.003723902623983477
in-drivable-lane_max	7.650000000000045
in-drivable-lane_mean	7.610000000000044
in-drivable-lane_min	7.550000000000044
per-episodes	details {"udem1-0-0": {"driven_any": 0.02699486662998817, "sim_physics": 0.22390522082646688, "survival_time": 14.950000000000076, "driven_lanedir": 0.0024811319357622708, "sim_render-ego": 0.06542349418004353, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.16103732109069824, "deviation-heading": 5.656741799274124, "set_robot_commands": 0.09998620907465616, "deviation-center-line": 0.5615811912624447, "driven_lanedir_consec": 0.0024811319357622708, "sim_compute_sim_state": 0.04123018582661946, "sim_compute_performance-ego": 0.072381272315979, "sim_compute_robot_state-ego": 0.0773886775970459, "sim_compute_robot_state-npc0": 0.07266901652018229, "sim_compute_robot_state-npc1": 0.0725654109319051, "sim_compute_robot_state-npc2": 0.07227930625279745, "sim_compute_robot_state-npc3": 0.07198638359705607}, "udem1-1-0": {"driven_any": 0.025845567204838143, "sim_physics": 0.2096066721280416, "survival_time": 14.950000000000076, "driven_lanedir": -0.003723902623983477, "sim_render-ego": 0.05980729103088379, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.14446020285288494, "deviation-heading": 5.792980334963804, "set_robot_commands": 0.08816522121429443, "deviation-center-line": 0.6110634223668668, "driven_lanedir_consec": -0.003723902623983477, "sim_compute_sim_state": 0.03778418223063151, "sim_compute_performance-ego": 0.06455643574396769, "sim_compute_robot_state-ego": 0.0687049126625061, "sim_compute_robot_state-npc0": 0.064991668065389, "sim_compute_robot_state-npc1": 0.06589174509048462, "sim_compute_robot_state-npc2": 0.06515753030776977, "sim_compute_robot_state-npc3": 0.0650699774424235}, "udem1-2-0": {"driven_any": 0.024318396942412283, "sim_physics": 0.19486528317133583, "survival_time": 14.950000000000076, "driven_lanedir": 0.0019934477256953187, "sim_render-ego": 0.05996107737223307, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.14868297656377158, "deviation-heading": 5.599925648422895, "set_robot_commands": 0.09147826353708904, "deviation-center-line": 0.4893543511348479, "driven_lanedir_consec": 0.0019934477256953187, "sim_compute_sim_state": 0.03830707629521688, "sim_compute_performance-ego": 0.06595314900080362, "sim_compute_robot_state-ego": 0.07019559383392333, "sim_compute_robot_state-npc0": 0.06802011648813884, "sim_compute_robot_state-npc1": 0.06802461544672649, "sim_compute_robot_state-npc2": 0.06744101047515869, "sim_compute_robot_state-npc3": 0.0680962332089742}, "udem1-3-0": {"driven_any": 0.022110630442247207, "sim_physics": 0.187325013478597, "survival_time": 14.950000000000076, "driven_lanedir": -0.002631851645028327, "sim_render-ego": 0.0562375013033549, "in-drivable-lane": 7.650000000000045, "agent_compute-ego": 0.1374941110610962, "deviation-heading": 5.45365698365684, "set_robot_commands": 0.08328045845031738, "deviation-center-line": 0.4217164378359653, "driven_lanedir_consec": -0.002631851645028327, "sim_compute_sim_state": 0.03455947001775106, "sim_compute_performance-ego": 0.06063616037368774, "sim_compute_robot_state-ego": 0.06530216932296753, "sim_compute_robot_state-npc0": 0.062270208199818926, "sim_compute_robot_state-npc1": 0.06150432904561361, "sim_compute_robot_state-npc2": 0.06059768756230672, "sim_compute_robot_state-npc3": 0.059804217020670576}, "udem1-4-0": {"driven_any": 0.025863689469906782, "sim_physics": 0.1894346841176351, "survival_time": 14.950000000000076, "driven_lanedir": 0.0004615556694189671, "sim_render-ego": 0.05724972486495972, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.13814988374710083, "deviation-heading": 5.828528410212022, "set_robot_commands": 0.08427951892217, "deviation-center-line": 0.01675128614096042, "driven_lanedir_consec": 0.0004615556694189671, "sim_compute_sim_state": 0.036272288958231605, "sim_compute_performance-ego": 0.062457648118337, "sim_compute_robot_state-ego": 0.06772436062494913, "sim_compute_robot_state-npc0": 0.06300768454869589, "sim_compute_robot_state-npc1": 0.06284603754679362, "sim_compute_robot_state-npc2": 0.0644355050722758, "sim_compute_robot_state-npc3": 0.06378551483154297}}
set_robot_commands_max	0.09998620907465616
set_robot_commands_mean	0.0894379342397054
set_robot_commands_median	0.08816522121429443
set_robot_commands_min	0.08328045845031738
sim_compute_performance-ego_max	0.072381272315979
sim_compute_performance-ego_mean	0.06519693311055501
sim_compute_performance-ego_median	0.06455643574396769
sim_compute_performance-ego_min	0.06063616037368774
sim_compute_robot_state-ego_max	0.0773886775970459
sim_compute_robot_state-ego_mean	0.06986314280827839
sim_compute_robot_state-ego_median	0.0687049126625061
sim_compute_robot_state-ego_min	0.06530216932296753
sim_compute_robot_state-npc0_max	0.07266901652018229
sim_compute_robot_state-npc0_mean	0.06619173876444498
sim_compute_robot_state-npc0_median	0.064991668065389
sim_compute_robot_state-npc0_min	0.062270208199818926
sim_compute_robot_state-npc1_max	0.0725654109319051
sim_compute_robot_state-npc1_mean	0.06616642761230469
sim_compute_robot_state-npc1_median	0.06589174509048462
sim_compute_robot_state-npc1_min	0.06150432904561361
sim_compute_robot_state-npc2_max	0.07227930625279745
sim_compute_robot_state-npc2_mean	0.06598220793406169
sim_compute_robot_state-npc2_median	0.06515753030776977
sim_compute_robot_state-npc2_min	0.06059768756230672
sim_compute_robot_state-npc3_max	0.07198638359705607
sim_compute_robot_state-npc3_mean	0.06574846522013347
sim_compute_robot_state-npc3_median	0.0650699774424235
sim_compute_robot_state-npc3_min	0.059804217020670576
sim_compute_sim_state_max	0.04123018582661946
sim_compute_sim_state_mean	0.03763064066569011
sim_compute_sim_state_median	0.03778418223063151
sim_compute_sim_state_min	0.03455947001775106
sim_physics_max	0.22390522082646688
sim_physics_mean	0.2010273747444153
sim_physics_median	0.19486528317133583
sim_physics_min	0.187325013478597
sim_render-ego_max	0.06542349418004353
sim_render-ego_mean	0.05973581775029499
sim_render-ego_median	0.05980729103088379
sim_render-ego_min	0.0562375013033549
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20064

2762

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 09:01:56+00:00

2019-04-25 09:15:53+00:00

0:13:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.08009653527971725
agent_compute-ego_mean	0.06840955771703905
agent_compute-ego_median	0.0658660396452873
agent_compute-ego_min	0.059357773173939095
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.1634979789907282, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.05094911022619768, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.059357773173939095, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.0820703235539523, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.03382330591028387, "sim_compute_performance-ego": 0.07517138123512268, "sim_compute_robot_state-ego": 0.06399671868844466, "sim_compute_robot_state-npc0": 0.05856206742199985, "sim_compute_robot_state-npc1": 0.060031907124952835, "sim_compute_robot_state-npc2": 0.06220699982209639, "sim_compute_robot_state-npc3": 0.05981211499734358}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.1571065148999614, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.058716189476751515, "in-drivable-lane": 0, "agent_compute-ego": 0.0658660396452873, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.08938581712784306, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.03786991488549017, "sim_compute_performance-ego": 0.0660258570025044, "sim_compute_robot_state-ego": 0.07057687544053601, "sim_compute_robot_state-npc0": 0.06387789787784699, "sim_compute_robot_state-npc1": 0.0644365741360572, "sim_compute_robot_state-npc2": 0.06507225190439532, "sim_compute_robot_state-npc3": 0.06716256756936351}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.16047740658969745, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.052466881190631406, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.059631379783576265, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.07997556612001243, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.032417824927796705, "sim_compute_performance-ego": 0.05837364399686773, "sim_compute_robot_state-ego": 0.062463094156684607, "sim_compute_robot_state-npc0": 0.05616029610870578, "sim_compute_robot_state-npc1": 0.055243405889957506, "sim_compute_robot_state-npc2": 0.05490100468304141, "sim_compute_robot_state-npc3": 0.056040412145303496}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.20080598780983372, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.06640256831520482, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.07709606070267527, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.10678520453603645, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.043645918996710525, "sim_compute_performance-ego": 0.07392852682816355, "sim_compute_robot_state-ego": 0.0807641957935534, "sim_compute_robot_state-npc0": 0.07415751908954821, "sim_compute_robot_state-npc1": 0.07469257555509869, "sim_compute_robot_state-npc2": 0.07451435139304713, "sim_compute_robot_state-npc3": 0.07329765119050678}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.23362115906997463, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.06935425543449295, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.08009653527971725, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.10612161730376768, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.041841276934449105, "sim_compute_performance-ego": 0.07723664397924719, "sim_compute_robot_state-ego": 0.08378406141845274, "sim_compute_robot_state-npc0": 0.07589886054186754, "sim_compute_robot_state-npc1": 0.07540759402261653, "sim_compute_robot_state-npc2": 0.07532391581736819, "sim_compute_robot_state-npc3": 0.07562852577424385}}
set_robot_commands_max	0.10678520453603645
set_robot_commands_mean	0.0928677057283224
set_robot_commands_median	0.08938581712784306
set_robot_commands_min	0.07997556612001243
sim_compute_performance-ego_max	0.07723664397924719
sim_compute_performance-ego_mean	0.07014721060838111
sim_compute_performance-ego_median	0.07392852682816355
sim_compute_performance-ego_min	0.05837364399686773
sim_compute_robot_state-ego_max	0.08378406141845274
sim_compute_robot_state-ego_mean	0.07231698909953428
sim_compute_robot_state-ego_median	0.07057687544053601
sim_compute_robot_state-ego_min	0.062463094156684607
sim_compute_robot_state-npc0_max	0.07589886054186754
sim_compute_robot_state-npc0_mean	0.06573132820799368
sim_compute_robot_state-npc0_median	0.06387789787784699
sim_compute_robot_state-npc0_min	0.05616029610870578
sim_compute_robot_state-npc1_max	0.07540759402261653
sim_compute_robot_state-npc1_mean	0.06596241134573655
sim_compute_robot_state-npc1_median	0.0644365741360572
sim_compute_robot_state-npc1_min	0.055243405889957506
sim_compute_robot_state-npc2_max	0.07532391581736819
sim_compute_robot_state-npc2_mean	0.06640370472398968
sim_compute_robot_state-npc2_median	0.06507225190439532
sim_compute_robot_state-npc2_min	0.05490100468304141
sim_compute_robot_state-npc3_max	0.07562852577424385
sim_compute_robot_state-npc3_mean	0.06638825433535224
sim_compute_robot_state-npc3_median	0.06716256756936351
sim_compute_robot_state-npc3_min	0.056040412145303496
sim_compute_sim_state_max	0.043645918996710525
sim_compute_sim_state_mean	0.03791964833094608
sim_compute_sim_state_median	0.03786991488549017
sim_compute_sim_state_min	0.032417824927796705
sim_physics_max	0.23362115906997463
sim_physics_mean	0.18310180947203908
sim_physics_median	0.1634979789907282
sim_physics_min	0.1571065148999614
sim_render-ego_max	0.06935425543449295
sim_render-ego_mean	0.05957780092865568
sim_render-ego_median	0.058716189476751515
sim_render-ego_min	0.05094911022619768
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20052

2839

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 09:00:23+00:00

2019-04-25 09:01:37+00:00

0:01:14

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20037

3014

Manfred Diaz

challenge-aido_LF-template-pytorch

step1-simulation

host-error

2019-04-25 08:59:24+00:00

2019-04-25 09:00:07+00:00

0:00:43

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20037-583566', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20037-583566', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20037-583566', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20024

2406

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 08:47:07+00:00

2019-04-25 08:51:56+00:00

0:04:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0963222223570508
survival_time_median	1.2000000000000004
deviation-center-line_median	0.08298652817985716
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17792969736559638
agent_compute-ego_mean	0.1443692554247829
agent_compute-ego_median	0.13512459008590036
agent_compute-ego_min	0.131279726823171
deviation-center-line_max	0.1055070388121181
deviation-center-line_mean	0.08319605413509064
deviation-center-line_min	0.06484944015695825
deviation-heading_max	1.0197237119838984
deviation-heading_mean	0.7648266324259195
deviation-heading_median	0.8416969102280941
deviation-heading_min	0.5341346348196923
driven_any_max	0.2418566362793421
driven_any_mean	0.1686595526121764
driven_any_median	0.14844913907636342
driven_any_min	0.12152881046535428
driven_lanedir_consec_max	0.13257402751031844
driven_lanedir_consec_mean	0.10210377701435916
driven_lanedir_consec_min	0.08700008897811506
driven_lanedir_max	0.13257402751031844
driven_lanedir_mean	0.10210377701435916
driven_lanedir_median	0.0963222223570508
driven_lanedir_min	0.08700008897811506
in-drivable-lane_max	0.2500000000000002
in-drivable-lane_mean	0.08000000000000007
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2418566362793421, "sim_physics": 0.03066530648399802, "survival_time": 1.7000000000000008, "driven_lanedir": 0.13257402751031844, "sim_render-ego": 0.04767472603741814, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.13350183823529413, "deviation-heading": 0.8871966384102746, "set_robot_commands": 0.07026109975927017, "deviation-center-line": 0.08298652817985716, "driven_lanedir_consec": 0.13257402751031844, "sim_compute_sim_state": 0.02823816327487721, "sim_compute_performance-ego": 0.053287961903740376, "sim_compute_robot_state-ego": 0.050615177435033465, "sim_compute_robot_state-npc0": 0.05684861014871037, "sim_compute_robot_state-npc1": 0.05753132876227884, "sim_compute_robot_state-npc2": 0.057369505657869226, "sim_compute_robot_state-npc3": 0.05654515939600328}, "udem1-1-0": {"driven_any": 0.20274679678336796, "sim_physics": 0.03946721964869006, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1020891167904554, "sim_render-ego": 0.06656807866589777, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17792969736559638, "deviation-heading": 1.0197237119838984, "set_robot_commands": 0.08824276924133301, "deviation-center-line": 0.07159646478344552, "driven_lanedir_consec": 0.1020891167904554, "sim_compute_sim_state": 0.034387596722306873, "sim_compute_performance-ego": 0.06624109169532513, "sim_compute_robot_state-ego": 0.06612729204112086, "sim_compute_robot_state-npc0": 0.06348539220875707, "sim_compute_robot_state-npc1": 0.059368733702034784, "sim_compute_robot_state-npc2": 0.060444716749520136, "sim_compute_robot_state-npc3": 0.06180117048066238}, "udem1-2-0": {"driven_any": 0.1287163804564543, "sim_physics": 0.034479068673175316, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0963222223570508, "sim_render-ego": 0.051523053127786385, "in-drivable-lane": 0, "agent_compute-ego": 0.13512459008590036, "deviation-heading": 0.5413812666876383, "set_robot_commands": 0.07809263726939326, "deviation-center-line": 0.1055070388121181, "driven_lanedir_consec": 0.0963222223570508, "sim_compute_sim_state": 0.02932527790898862, "sim_compute_performance-ego": 0.05367569301439368, "sim_compute_robot_state-ego": 0.0551510997440504, "sim_compute_robot_state-npc0": 0.05849171721416971, "sim_compute_robot_state-npc1": 0.05410243117290994, "sim_compute_robot_state-npc2": 0.05660208411838697, "sim_compute_robot_state-npc3": 0.0540033423382303}, "udem1-3-0": {"driven_any": 0.12152881046535428, "sim_physics": 0.041535139083862305, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08700008897811506, "sim_render-ego": 0.05359886993061413, "in-drivable-lane": 0, "agent_compute-ego": 0.14401042461395264, "deviation-heading": 0.5341346348196923, "set_robot_commands": 0.07661186565052379, "deviation-center-line": 0.09104079874307412, "driven_lanedir_consec": 0.08700008897811506, "sim_compute_sim_state": 0.037465897473421966, "sim_compute_performance-ego": 0.059041467579928314, "sim_compute_robot_state-ego": 0.0645370375026356, "sim_compute_robot_state-npc0": 0.058187679810957474, "sim_compute_robot_state-npc1": 0.05673278461803089, "sim_compute_robot_state-npc2": 0.05686118386008523, "sim_compute_robot_state-npc3": 0.05209314823150635}, "udem1-4-0": {"driven_any": 0.14844913907636342, "sim_physics": 0.0321254034837087, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09253342943585618, "sim_render-ego": 0.049697707096735634, "in-drivable-lane": 0, "agent_compute-ego": 0.131279726823171, "deviation-heading": 0.8416969102280941, "set_robot_commands": 0.07738882303237915, "deviation-center-line": 0.06484944015695825, "driven_lanedir_consec": 0.09253342943585618, "sim_compute_sim_state": 0.03123229742050171, "sim_compute_performance-ego": 0.05463720361391703, "sim_compute_robot_state-ego": 0.05510340134302775, "sim_compute_robot_state-npc0": 0.05405293901761373, "sim_compute_robot_state-npc1": 0.054170350233713783, "sim_compute_robot_state-npc2": 0.05527225136756897, "sim_compute_robot_state-npc3": 0.05461265643437704}}
set_robot_commands_max	0.08824276924133301
set_robot_commands_mean	0.07811943899057988
set_robot_commands_median	0.07738882303237915
set_robot_commands_min	0.07026109975927017
sim_compute_performance-ego_max	0.06624109169532513
sim_compute_performance-ego_mean	0.0573766835614609
sim_compute_performance-ego_median	0.05463720361391703
sim_compute_performance-ego_min	0.053287961903740376
sim_compute_robot_state-ego_max	0.06612729204112086
sim_compute_robot_state-ego_mean	0.05830680161317362
sim_compute_robot_state-ego_median	0.0551510997440504
sim_compute_robot_state-ego_min	0.050615177435033465
sim_compute_robot_state-npc0_max	0.06348539220875707
sim_compute_robot_state-npc0_mean	0.05821326768004167
sim_compute_robot_state-npc0_median	0.058187679810957474
sim_compute_robot_state-npc0_min	0.05405293901761373
sim_compute_robot_state-npc1_max	0.059368733702034784
sim_compute_robot_state-npc1_mean	0.056381125697793646
sim_compute_robot_state-npc1_median	0.05673278461803089
sim_compute_robot_state-npc1_min	0.05410243117290994
sim_compute_robot_state-npc2_max	0.060444716749520136
sim_compute_robot_state-npc2_mean	0.057309948350686105
sim_compute_robot_state-npc2_median	0.05686118386008523
sim_compute_robot_state-npc2_min	0.05527225136756897
sim_compute_robot_state-npc3_max	0.06180117048066238
sim_compute_robot_state-npc3_mean	0.05581109537615586
sim_compute_robot_state-npc3_median	0.05461265643437704
sim_compute_robot_state-npc3_min	0.05209314823150635
sim_compute_sim_state_max	0.037465897473421966
sim_compute_sim_state_mean	0.03212984656001928
sim_compute_sim_state_median	0.03123229742050171
sim_compute_sim_state_min	0.02823816327487721
sim_physics_max	0.041535139083862305
sim_physics_mean	0.03565442747468688
sim_physics_median	0.034479068673175316
sim_physics_min	0.03066530648399802
sim_render-ego_max	0.06656807866589777
sim_render-ego_mean	0.05381248697169041
sim_render-ego_median	0.051523053127786385
sim_render-ego_min	0.04767472603741814
simulation-passed	1
survival_time_max	1.7000000000000008
survival_time_mean	1.3200000000000005
survival_time_min	1.1000000000000003

No reset possible

20007

2449

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:45:06+00:00

2019-04-25 08:46:40+00:00

0:01:34

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19973

2536

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-25 08:42:08+00:00

2019-04-25 08:44:58+00:00

0:02:50

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19961

2601

FANG MEIYI 🇸🇬

baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-25 08:40:58+00:00

2019-04-25 08:42:02+00:00

0:01:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19929

2921

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 08:38:28+00:00

2019-04-25 08:40:48+00:00

0:02:20

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19912

2633

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

error

2019-04-25 08:37:26+00:00

2019-04-25 08:38:13+00:00

0:00:47

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19896

2747

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:36:15+00:00

2019-04-25 08:37:13+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19892

2779

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:35:37+00:00

2019-04-25 08:36:08+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19877

2861

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:34:23+00:00

2019-04-25 08:35:21+00:00

0:00:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19862

2937

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:32:34+00:00

2019-04-25 08:34:02+00:00

0:01:28

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19828

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 08:20:02+00:00

2019-04-25 08:32:26+00:00

0:12:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.20196476931509144
survival_time_median	3.899999999999994
deviation-center-line_median	0.13579188546069812
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08333459252216777
agent_compute-ego_mean	0.0773472295014392
agent_compute-ego_median	0.07784191156044984
agent_compute-ego_min	0.06913622429496363
deviation-center-line_max	1.0691710859923156
deviation-center-line_mean	0.39727257508095526
deviation-center-line_min	0.11576092170039644
deviation-heading_max	5.110236499659155
deviation-heading_mean	1.6043957737987882
deviation-heading_median	0.7437819421590548
deviation-heading_min	0.5214667938027785
driven_any_max	1.91363348929201
driven_any_mean	0.7414837320457457
driven_any_median	0.5688685670295942
driven_any_min	0.19401072418745632
driven_lanedir_consec_max	1.427840252441052
driven_lanedir_consec_mean	0.5372449500754062
driven_lanedir_consec_min	0.1337089548344874
driven_lanedir_max	1.6063273307065389
driven_lanedir_mean	0.5729423657285035
driven_lanedir_median	0.20196476931509144
driven_lanedir_min	0.1337089548344874
in-drivable-lane_max	2.499999999999994
in-drivable-lane_mean	0.5499999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.5688685670295942, "sim_physics": 0.04942018252152663, "survival_time": 3.899999999999994, "driven_lanedir": 0.1337089548344874, "sim_render-ego": 0.06283321747413048, "in-drivable-lane": 2.499999999999994, "agent_compute-ego": 0.07784191156044984, "deviation-heading": 0.5540002661322662, "set_robot_commands": 0.09446548192928998, "deviation-center-line": 0.13579188546069812, "driven_lanedir_consec": 0.1337089548344874, "sim_compute_sim_state": 0.0369643828807733, "sim_compute_performance-ego": 0.06655854139572535, "sim_compute_robot_state-ego": 0.06877048504658234, "sim_compute_robot_state-npc0": 0.0651107873672094, "sim_compute_robot_state-npc1": 0.06436498348529522, "sim_compute_robot_state-npc2": 0.06682708018865341, "sim_compute_robot_state-npc3": 0.06524704969846286}, "udem1-1-0": {"driven_any": 0.2583002897390766, "sim_physics": 0.03642156877015766, "survival_time": 1.900000000000001, "driven_lanedir": 0.20196476931509144, "sim_render-ego": 0.05096481975756193, "in-drivable-lane": 0, "agent_compute-ego": 0.06913622429496363, "deviation-heading": 1.092493367240685, "set_robot_commands": 0.07743522995396664, "deviation-center-line": 0.11576092170039644, "driven_lanedir_consec": 0.20196476931509144, "sim_compute_sim_state": 0.03404708285080759, "sim_compute_performance-ego": 0.056932581098456135, "sim_compute_robot_state-ego": 0.056624343520716616, "sim_compute_robot_state-npc0": 0.06078180513883892, "sim_compute_robot_state-npc1": 0.06157575782976652, "sim_compute_robot_state-npc2": 0.05905569854535555, "sim_compute_robot_state-npc3": 0.05906123864023309}, "udem1-2-0": {"driven_any": 0.7726055899805913, "sim_physics": 0.05256632496328915, "survival_time": 5.09999999999999, "driven_lanedir": 0.7597232449019115, "sim_render-ego": 0.06495357962215648, "in-drivable-lane": 0, "agent_compute-ego": 0.08082847735461067, "deviation-heading": 0.7437819421590548, "set_robot_commands": 0.1009216402091232, "deviation-center-line": 0.5453392234425578, "driven_lanedir_consec": 0.7597232449019115, "sim_compute_sim_state": 0.04011364310395484, "sim_compute_performance-ego": 0.07026080056732777, "sim_compute_robot_state-ego": 0.07750139984430052, "sim_compute_robot_state-npc0": 0.07168397482703714, "sim_compute_robot_state-npc1": 0.07187369524263869, "sim_compute_robot_state-npc2": 0.06996678371055454, "sim_compute_robot_state-npc3": 0.06946990069221048}, "udem1-3-0": {"driven_any": 0.19401072418745632, "sim_physics": 0.04438775380452474, "survival_time": 1.5000000000000009, "driven_lanedir": 0.16298752888448864, "sim_render-ego": 0.06133123238881429, "in-drivable-lane": 0, "agent_compute-ego": 0.07559494177500407, "deviation-heading": 0.5214667938027785, "set_robot_commands": 0.09024439652760824, "deviation-center-line": 0.12029975880880844, "driven_lanedir_consec": 0.16298752888448864, "sim_compute_sim_state": 0.04432329336802165, "sim_compute_performance-ego": 0.06454325517018636, "sim_compute_robot_state-ego": 0.06748818556467692, "sim_compute_robot_state-npc0": 0.0671176830927531, "sim_compute_robot_state-npc1": 0.07252813180287679, "sim_compute_robot_state-npc2": 0.0667712926864624, "sim_compute_robot_state-npc3": 0.06648504734039307}, "udem1-4-0": {"driven_any": 1.91363348929201, "sim_physics": 0.0413861059751667, "survival_time": 12.200000000000038, "driven_lanedir": 1.6063273307065389, "sim_render-ego": 0.06395566365757926, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.08333459252216777, "deviation-heading": 5.110236499659155, "set_robot_commands": 0.09165856193323604, "deviation-center-line": 1.0691710859923156, "driven_lanedir_consec": 1.427840252441052, "sim_compute_sim_state": 0.03738631283650633, "sim_compute_performance-ego": 0.06381339518750301, "sim_compute_robot_state-ego": 0.06728443454523556, "sim_compute_robot_state-npc0": 0.0654529294029611, "sim_compute_robot_state-npc1": 0.06448007607069171, "sim_compute_robot_state-npc2": 0.06382835888471759, "sim_compute_robot_state-npc3": 0.06340705273581333}}
set_robot_commands_max	0.1009216402091232
set_robot_commands_mean	0.09094506211064482
set_robot_commands_median	0.09165856193323604
set_robot_commands_min	0.07743522995396664
sim_compute_performance-ego_max	0.07026080056732777
sim_compute_performance-ego_mean	0.06442171468383971
sim_compute_performance-ego_median	0.06454325517018636
sim_compute_performance-ego_min	0.056932581098456135
sim_compute_robot_state-ego_max	0.07750139984430052
sim_compute_robot_state-ego_mean	0.06753376970430239
sim_compute_robot_state-ego_median	0.06748818556467692
sim_compute_robot_state-ego_min	0.056624343520716616
sim_compute_robot_state-npc0_max	0.07168397482703714
sim_compute_robot_state-npc0_mean	0.06602943596575994
sim_compute_robot_state-npc0_median	0.0654529294029611
sim_compute_robot_state-npc0_min	0.06078180513883892
sim_compute_robot_state-npc1_max	0.07252813180287679
sim_compute_robot_state-npc1_mean	0.06696452888625379
sim_compute_robot_state-npc1_median	0.06448007607069171
sim_compute_robot_state-npc1_min	0.06157575782976652
sim_compute_robot_state-npc2_max	0.06996678371055454
sim_compute_robot_state-npc2_mean	0.0652898428031487
sim_compute_robot_state-npc2_median	0.0667712926864624
sim_compute_robot_state-npc2_min	0.05905569854535555
sim_compute_robot_state-npc3_max	0.06946990069221048
sim_compute_robot_state-npc3_mean	0.06473405782142257
sim_compute_robot_state-npc3_median	0.06524704969846286
sim_compute_robot_state-npc3_min	0.05906123864023309
sim_compute_sim_state_max	0.04432329336802165
sim_compute_sim_state_mean	0.03856694300801274
sim_compute_sim_state_median	0.03738631283650633
sim_compute_sim_state_min	0.03404708285080759
sim_physics_max	0.05256632496328915
sim_physics_mean	0.044836387206932976
sim_physics_median	0.04438775380452474
sim_physics_min	0.03642156877015766
sim_render-ego_max	0.06495357962215648
sim_render-ego_mean	0.06080770258004849
sim_render-ego_median	0.06283321747413048
sim_render-ego_min	0.05096481975756193
simulation-passed	1
survival_time_max	12.200000000000038
survival_time_mean	4.920000000000004
survival_time_min	1.5000000000000009

No reset possible

19824

2738

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-25 08:18:11+00:00

2019-04-25 08:19:46+00:00

0:01:35

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19820

2799

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 08:15:45+00:00

2019-04-25 08:17:31+00:00

0:01:46

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19785

2660

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 08:00:22+00:00

2019-04-25 08:15:31+00:00

0:15:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.590545989884475
survival_time_median	4.049999999999994
deviation-center-line_median	0.4154343882918444
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08911264687776566
agent_compute-ego_mean	0.08351740237668737
agent_compute-ego_median	0.08302743094308036
agent_compute-ego_min	0.08095749051947343
deviation-center-line_max	0.9494562903675527
deviation-center-line_mean	0.49500183260475633
deviation-center-line_min	0.12905295618091642
deviation-heading_max	2.41248308148414
deviation-heading_mean	1.284507081837006
deviation-heading_median	1.155052743487068
deviation-heading_min	0.5041323878744777
driven_any_max	1.8493711640216144
driven_any_mean	0.8845581534377885
driven_any_median	0.6038526640592228
driven_any_min	0.21009525590710537
driven_lanedir_consec_max	1.43478998902125
driven_lanedir_consec_mean	0.7629448342885939
driven_lanedir_consec_min	0.18651150255237892
driven_lanedir_max	1.4349757163310457
driven_lanedir_mean	0.7635661025527746
driven_lanedir_median	0.590545989884475
driven_lanedir_min	0.18651150255237892
in-drivable-lane_max	2.400000000000034
in-drivable-lane_mean	0.4800000000000068
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.469030749513949, "sim_physics": 0.04519731621993216, "survival_time": 9.5, "driven_lanedir": 1.4349757163310457, "sim_render-ego": 0.06362477227261192, "in-drivable-lane": 0, "agent_compute-ego": 0.08095749051947343, "deviation-heading": 1.7033642977205472, "set_robot_commands": 0.09972510965246904, "deviation-center-line": 0.8465798591571909, "driven_lanedir_consec": 1.43478998902125, "sim_compute_sim_state": 0.040288341672796955, "sim_compute_performance-ego": 0.06976835853175113, "sim_compute_robot_state-ego": 0.07413327819422671, "sim_compute_robot_state-npc0": 0.06954736835078189, "sim_compute_robot_state-npc1": 0.06956626741509689, "sim_compute_robot_state-npc2": 0.0720025614688271, "sim_compute_robot_state-npc3": 0.07121028523696096}, "udem1-1-0": {"driven_any": 0.29044093368705126, "sim_physics": 0.042930495171319874, "survival_time": 2.1000000000000005, "driven_lanedir": 0.22562558192707716, "sim_render-ego": 0.06434291317349389, "in-drivable-lane": 0, "agent_compute-ego": 0.08302743094308036, "deviation-heading": 1.155052743487068, "set_robot_commands": 0.10479334422520228, "deviation-center-line": 0.12905295618091642, "driven_lanedir_consec": 0.22562558192707716, "sim_compute_sim_state": 0.03919201805478051, "sim_compute_performance-ego": 0.06957720007215228, "sim_compute_robot_state-ego": 0.07314364683060419, "sim_compute_robot_state-npc0": 0.07073850291115898, "sim_compute_robot_state-npc1": 0.07023842561812628, "sim_compute_robot_state-npc2": 0.07178938956487746, "sim_compute_robot_state-npc3": 0.07078553381420317}, "udem1-2-0": {"driven_any": 0.6038526640592228, "sim_physics": 0.04992270764009452, "survival_time": 4.049999999999994, "driven_lanedir": 0.590545989884475, "sim_render-ego": 0.06392122492378141, "in-drivable-lane": 0, "agent_compute-ego": 0.08108757160328052, "deviation-heading": 0.6475028986187973, "set_robot_commands": 0.0994557598490774, "deviation-center-line": 0.4154343882918444, "driven_lanedir_consec": 0.590545989884475, "sim_compute_sim_state": 0.04042870321391541, "sim_compute_performance-ego": 0.07051234186431508, "sim_compute_robot_state-ego": 0.07514324600313917, "sim_compute_robot_state-npc0": 0.06861940136662235, "sim_compute_robot_state-npc1": 0.07039709738743158, "sim_compute_robot_state-npc2": 0.06958462868207767, "sim_compute_robot_state-npc3": 0.06999025227111062}, "udem1-3-0": {"driven_any": 0.21009525590710537, "sim_physics": 0.045076556503772736, "survival_time": 1.6000000000000008, "driven_lanedir": 0.18651150255237892, "sim_render-ego": 0.05893561244010925, "in-drivable-lane": 0, "agent_compute-ego": 0.08911264687776566, "deviation-heading": 0.5041323878744777, "set_robot_commands": 0.10126835107803343, "deviation-center-line": 0.13448566902627723, "driven_lanedir_consec": 0.18651150255237892, "sim_compute_sim_state": 0.03604152053594589, "sim_compute_performance-ego": 0.06617554277181625, "sim_compute_robot_state-ego": 0.07057269662618637, "sim_compute_robot_state-npc0": 0.06844186037778854, "sim_compute_robot_state-npc1": 0.07050904631614685, "sim_compute_robot_state-npc2": 0.0676681250333786, "sim_compute_robot_state-npc3": 0.0723525807261467}, "udem1-4-0": {"driven_any": 1.8493711640216144, "sim_physics": 0.04773965932555118, "survival_time": 11.800000000000033, "driven_lanedir": 1.380171722068896, "sim_render-ego": 0.06729685957148923, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.08340187193983692, "deviation-heading": 2.41248308148414, "set_robot_commands": 0.1034508125256684, "deviation-center-line": 0.9494562903675527, "driven_lanedir_consec": 1.3772511080577885, "sim_compute_sim_state": 0.0417491955272222, "sim_compute_performance-ego": 0.07157579316931256, "sim_compute_robot_state-ego": 0.07782294285499443, "sim_compute_robot_state-npc0": 0.07201796770095825, "sim_compute_robot_state-npc1": 0.07442135831057015, "sim_compute_robot_state-npc2": 0.0728130896212691, "sim_compute_robot_state-npc3": 0.07277283830157781}}
set_robot_commands_max	0.10479334422520228
set_robot_commands_mean	0.1017386754660901
set_robot_commands_median	0.10126835107803343
set_robot_commands_min	0.0994557598490774
sim_compute_performance-ego_max	0.07157579316931256
sim_compute_performance-ego_mean	0.06952184728186947
sim_compute_performance-ego_median	0.06976835853175113
sim_compute_performance-ego_min	0.06617554277181625
sim_compute_robot_state-ego_max	0.07782294285499443
sim_compute_robot_state-ego_mean	0.07416316210183017
sim_compute_robot_state-ego_median	0.07413327819422671
sim_compute_robot_state-ego_min	0.07057269662618637
sim_compute_robot_state-npc0_max	0.07201796770095825
sim_compute_robot_state-npc0_mean	0.069873020141462
sim_compute_robot_state-npc0_median	0.06954736835078189
sim_compute_robot_state-npc0_min	0.06844186037778854
sim_compute_robot_state-npc1_max	0.07442135831057015
sim_compute_robot_state-npc1_mean	0.07102643900947436
sim_compute_robot_state-npc1_median	0.07039709738743158
sim_compute_robot_state-npc1_min	0.06956626741509689
sim_compute_robot_state-npc2_max	0.0728130896212691
sim_compute_robot_state-npc2_mean	0.07077155887408598
sim_compute_robot_state-npc2_median	0.07178938956487746
sim_compute_robot_state-npc2_min	0.0676681250333786
sim_compute_robot_state-npc3_max	0.07277283830157781
sim_compute_robot_state-npc3_mean	0.07142229806999986
sim_compute_robot_state-npc3_median	0.07121028523696096
sim_compute_robot_state-npc3_min	0.06999025227111062
sim_compute_sim_state_max	0.0417491955272222
sim_compute_sim_state_mean	0.0395399558009322
sim_compute_sim_state_median	0.040288341672796955
sim_compute_sim_state_min	0.03604152053594589
sim_physics_max	0.04992270764009452
sim_physics_mean	0.04617334697213409
sim_physics_median	0.04519731621993216
sim_physics_min	0.042930495171319874
sim_render-ego_max	0.06729685957148923
sim_render-ego_mean	0.06362427647629713
sim_render-ego_median	0.06392122492378141
sim_render-ego_min	0.05893561244010925
simulation-passed	1
survival_time_max	11.800000000000033
survival_time_mean	5.810000000000006
survival_time_min	1.6000000000000008

No reset possible

19774

2594

Julian Zilly

baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 07:56:15+00:00

2019-04-25 08:00:07+00:00

0:03:52

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19774-961903', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19774-961903', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19774-961903', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19746

2928

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 07:45:29+00:00

2019-04-25 07:55:24+00:00

0:09:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09076968114424933
survival_time_median	1.2000000000000004
deviation-center-line_median	0.07574729719771221
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18765891682017932
agent_compute-ego_mean	0.15486929944533406
agent_compute-ego_median	0.15130990743637085
agent_compute-ego_min	0.12305127420733052
deviation-center-line_max	0.10086201069832414
deviation-center-line_mean	0.07670697738465
deviation-center-line_min	0.050392683787761273
deviation-heading_max	0.931018076271082
deviation-heading_mean	0.6964188797315903
deviation-heading_median	0.7472365123559765
deviation-heading_min	0.45795369576702194
driven_any_max	0.2147032707953708
driven_any_mean	0.1641486488192156
driven_any_median	0.14904749465960904
driven_any_min	0.13267431669987714
driven_lanedir_consec_max	0.10491225019507676
driven_lanedir_consec_mean	0.08686909888162671
driven_lanedir_consec_min	0.05777274562688417
driven_lanedir_max	0.10491225019507676
driven_lanedir_mean	0.08686909888162671
driven_lanedir_median	0.09076968114424933
driven_lanedir_min	0.05777274562688417
in-drivable-lane_max	0.6500000000000006
in-drivable-lane_mean	0.18000000000000016
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.1900094348913524, "sim_physics": 0.027010948427261844, "survival_time": 1.5500000000000007, "driven_lanedir": 0.081128669396626, "sim_render-ego": 0.04900140147055349, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.12305127420733052, "deviation-heading": 0.931018076271082, "set_robot_commands": 0.07192751669114636, "deviation-center-line": 0.07574729719771221, "driven_lanedir_consec": 0.081128669396626, "sim_compute_sim_state": 0.028382901222475113, "sim_compute_performance-ego": 0.05394947144293016, "sim_compute_robot_state-ego": 0.05178977597144342, "sim_compute_robot_state-npc0": 0.05155445683387018, "sim_compute_robot_state-npc1": 0.05328282233207456, "sim_compute_robot_state-npc2": 0.05290861283579181, "sim_compute_robot_state-npc3": 0.052258368461362774}, "udem1-1-0": {"driven_any": 0.2147032707953708, "sim_physics": 0.039991414908206825, "survival_time": 1.6500000000000008, "driven_lanedir": 0.05777274562688417, "sim_render-ego": 0.0613515449292732, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.16274853186173874, "deviation-heading": 0.7472365123559765, "set_robot_commands": 0.08501282605257901, "deviation-center-line": 0.050392683787761273, "driven_lanedir_consec": 0.05777274562688417, "sim_compute_sim_state": 0.03453438209764885, "sim_compute_performance-ego": 0.06170346520163796, "sim_compute_robot_state-ego": 0.06431526126283588, "sim_compute_robot_state-npc0": 0.05696521383343321, "sim_compute_robot_state-npc1": 0.058805747465653854, "sim_compute_robot_state-npc2": 0.05786137869863799, "sim_compute_robot_state-npc3": 0.06416895895293265}, "udem1-2-0": {"driven_any": 0.13267431669987714, "sim_physics": 0.05622563578865745, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10491225019507676, "sim_render-ego": 0.06752016327597878, "in-drivable-lane": 0, "agent_compute-ego": 0.18765891682017932, "deviation-heading": 0.45795369576702194, "set_robot_commands": 0.09892815893346613, "deviation-center-line": 0.09700242446482311, "driven_lanedir_consec": 0.10491225019507676, "sim_compute_sim_state": 0.04292755777185613, "sim_compute_performance-ego": 0.07417575879530473, "sim_compute_robot_state-ego": 0.07746257565238258, "sim_compute_robot_state-npc0": 0.07106614112854004, "sim_compute_robot_state-npc1": 0.06872845779765736, "sim_compute_robot_state-npc2": 0.0710263577374545, "sim_compute_robot_state-npc3": 0.07240876284512607}, "udem1-3-0": {"driven_any": 0.13430872704986857, "sim_physics": 0.038422991832097374, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09976214804529726, "sim_render-ego": 0.05873976151148478, "in-drivable-lane": 0, "agent_compute-ego": 0.15130990743637085, "deviation-heading": 0.5737128830244003, "set_robot_commands": 0.08785590529441833, "deviation-center-line": 0.10086201069832414, "driven_lanedir_consec": 0.09976214804529726, "sim_compute_sim_state": 0.03392711281776428, "sim_compute_performance-ego": 0.06245903174082438, "sim_compute_robot_state-ego": 0.06135379274686178, "sim_compute_robot_state-npc0": 0.06625520189603169, "sim_compute_robot_state-npc1": 0.0641806423664093, "sim_compute_robot_state-npc2": 0.055570244789123535, "sim_compute_robot_state-npc3": 0.05605248610178629}, "udem1-4-0": {"driven_any": 0.14904749465960904, "sim_physics": 0.03706010905179111, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09076968114424933, "sim_render-ego": 0.05638109553943981, "in-drivable-lane": 0, "agent_compute-ego": 0.1495778669010509, "deviation-heading": 0.7721732312394708, "set_robot_commands": 0.08154007521542636, "deviation-center-line": 0.05953047077462925, "driven_lanedir_consec": 0.09076968114424933, "sim_compute_sim_state": 0.03995409878817471, "sim_compute_performance-ego": 0.06018779494545677, "sim_compute_robot_state-ego": 0.06524667956612328, "sim_compute_robot_state-npc0": 0.06238511475649747, "sim_compute_robot_state-npc1": 0.06146915392442183, "sim_compute_robot_state-npc2": 0.06246483325958252, "sim_compute_robot_state-npc3": 0.052429730241948906}}
set_robot_commands_max	0.09892815893346613
set_robot_commands_mean	0.08505289643740724
set_robot_commands_median	0.08501282605257901
set_robot_commands_min	0.07192751669114636
sim_compute_performance-ego_max	0.07417575879530473
sim_compute_performance-ego_mean	0.062495104425230805
sim_compute_performance-ego_median	0.06170346520163796
sim_compute_performance-ego_min	0.05394947144293016
sim_compute_robot_state-ego_max	0.07746257565238258
sim_compute_robot_state-ego_mean	0.0640336170399294
sim_compute_robot_state-ego_median	0.06431526126283588
sim_compute_robot_state-ego_min	0.05178977597144342
sim_compute_robot_state-npc0_max	0.07106614112854004
sim_compute_robot_state-npc0_mean	0.06164522568967453
sim_compute_robot_state-npc0_median	0.06238511475649747
sim_compute_robot_state-npc0_min	0.05155445683387018
sim_compute_robot_state-npc1_max	0.06872845779765736
sim_compute_robot_state-npc1_mean	0.06129336477724338
sim_compute_robot_state-npc1_median	0.06146915392442183
sim_compute_robot_state-npc1_min	0.05328282233207456
sim_compute_robot_state-npc2_max	0.0710263577374545
sim_compute_robot_state-npc2_mean	0.059966285464118065
sim_compute_robot_state-npc2_median	0.05786137869863799
sim_compute_robot_state-npc2_min	0.05290861283579181
sim_compute_robot_state-npc3_max	0.07240876284512607
sim_compute_robot_state-npc3_mean	0.059463661320631335
sim_compute_robot_state-npc3_median	0.05605248610178629
sim_compute_robot_state-npc3_min	0.052258368461362774
sim_compute_sim_state_max	0.04292755777185613
sim_compute_sim_state_mean	0.03594521053958381
sim_compute_sim_state_median	0.03453438209764885
sim_compute_sim_state_min	0.028382901222475113
sim_physics_max	0.05622563578865745
sim_physics_mean	0.03974222000160292
sim_physics_median	0.038422991832097374
sim_physics_min	0.027010948427261844
sim_render-ego_max	0.06752016327597878
sim_render-ego_mean	0.05859879334534601
sim_render-ego_median	0.05873976151148478
sim_render-ego_min	0.04900140147055349
simulation-passed	1
survival_time_max	1.6500000000000008
survival_time_mean	1.3200000000000005
survival_time_min	1.1000000000000003

No reset possible

19735

3050

Manfred Diaz

challenge-aido_LF-template-tensorflow

step1-simulation

error