Evaluator 808

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 16:36:39+00:00

2019-04-25 16:58:47+00:00

0:22:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3401047463162574
survival_time_median	14.950000000000076
deviation-center-line_median	1.0020903216633783
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.100390944480896
agent_compute-ego_mean	0.09500701888402303
agent_compute-ego_median	0.09392880121866862
agent_compute-ego_min	0.09288891633351644
deviation-center-line_max	1.5200593248921646
deviation-center-line_mean	0.9234182563504314
deviation-center-line_min	0.2826572656098777
deviation-heading_max	8.488415384770876
deviation-heading_mean	7.083018992579007
deviation-heading_median	7.0891261288876
deviation-heading_min	5.694184625828924
driven_any_max	4.378320939674847
driven_any_mean	4.378320939674838
driven_any_median	4.378320939674838
driven_any_min	4.378320939674826
driven_lanedir_consec_max	-1.273127772600478
driven_lanedir_consec_mean	-1.3316670653980158
driven_lanedir_consec_min	-1.367352616124776
driven_lanedir_max	-1.3666338643676914
driven_lanedir_mean	-2.0778269948498607
driven_lanedir_median	-2.2611414102685594
driven_lanedir_min	-2.711272268924253
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.630000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.09423027674357096, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272268924253, "sim_render-ego": 0.03568955262502035, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.09392880121866862, "deviation-heading": 8.371542541054902, "set_robot_commands": 0.05581964651743571, "deviation-center-line": 1.5194332589791988, "driven_lanedir_consec": -1.3111163275808764, "sim_compute_sim_state": 0.022571581999460855, "sim_compute_performance-ego": 0.03885886271794637, "sim_compute_robot_state-ego": 0.03982422987620036, "sim_compute_robot_state-npc0": 0.039860313733418785, "sim_compute_robot_state-npc1": 0.03924168904622396, "sim_compute_robot_state-npc2": 0.03914509693781535, "sim_compute_robot_state-npc3": 0.03928098519643148}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378320939674847, "sim_physics": 0.08978577057520548, "survival_time": 14.950000000000076, "driven_lanedir": -2.682734814564024, "sim_render-ego": 0.035749943256378175, "in-drivable-lane": 2.2000000000000113, "agent_compute-ego": 0.0939854900042216, "deviation-heading": 8.488415384770876, "set_robot_commands": 0.055609358151753746, "deviation-center-line": 1.5200593248921646, "driven_lanedir_consec": -1.273127772600478, "sim_compute_sim_state": 0.02256022294362386, "sim_compute_performance-ego": 0.041234289010365806, "sim_compute_robot_state-ego": 0.03965859810511271, "sim_compute_robot_state-npc0": 0.03988780339558919, "sim_compute_robot_state-npc1": 0.03962260564168294, "sim_compute_robot_state-npc2": 0.041346787611643475, "sim_compute_robot_state-npc3": 0.03939359267552694}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378320939674833, "sim_physics": 0.09088050603866576, "survival_time": 14.950000000000076, "driven_lanedir": -1.3666338643676914, "sim_render-ego": 0.035565989017486574, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.0938409423828125, "deviation-heading": 5.77182628235273, "set_robot_commands": 0.05519185860951741, "deviation-center-line": 0.2928511106075376, "driven_lanedir_consec": -1.3666338643676914, "sim_compute_sim_state": 0.02244669516881307, "sim_compute_performance-ego": 0.03899251143137614, "sim_compute_robot_state-ego": 0.03987764358520507, "sim_compute_robot_state-npc0": 0.03979287306467692, "sim_compute_robot_state-npc1": 0.03937340180079142, "sim_compute_robot_state-npc2": 0.039203646977742514, "sim_compute_robot_state-npc3": 0.03946371714274088}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378320939674826, "sim_physics": 0.09238080898920696, "survival_time": 14.950000000000076, "driven_lanedir": -1.367352616124776, "sim_render-ego": 0.03541675011316935, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.09288891633351644, "deviation-heading": 5.694184625828924, "set_robot_commands": 0.05444709936777751, "deviation-center-line": 0.2826572656098777, "driven_lanedir_consec": -1.367352616124776, "sim_compute_sim_state": 0.02236626704533895, "sim_compute_performance-ego": 0.03835429986317952, "sim_compute_robot_state-ego": 0.03960042317708334, "sim_compute_robot_state-npc0": 0.03964278856913249, "sim_compute_robot_state-npc1": 0.03995199998219808, "sim_compute_robot_state-npc2": 0.038865811824798584, "sim_compute_robot_state-npc3": 0.04003175814946493}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378320939674838, "sim_physics": 0.1003782598177592, "survival_time": 14.950000000000076, "driven_lanedir": -2.2611414102685594, "sim_render-ego": 0.037888392607371014, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.100390944480896, "deviation-heading": 7.0891261288876, "set_robot_commands": 0.05690531094868978, "deviation-center-line": 1.0020903216633783, "driven_lanedir_consec": -1.3401047463162574, "sim_compute_sim_state": 0.024451334476470948, "sim_compute_performance-ego": 0.04143339077631632, "sim_compute_robot_state-ego": 0.04233127037684123, "sim_compute_robot_state-npc0": 0.042328364849090576, "sim_compute_robot_state-npc1": 0.042290737628936766, "sim_compute_robot_state-npc2": 0.04124053398768107, "sim_compute_robot_state-npc3": 0.04132982571919759}}
set_robot_commands_max	0.05690531094868978
set_robot_commands_mean	0.05559465471903483
set_robot_commands_median	0.055609358151753746
set_robot_commands_min	0.05444709936777751
sim_compute_performance-ego_max	0.04143339077631632
sim_compute_performance-ego_mean	0.03977467075983683
sim_compute_performance-ego_median	0.03899251143137614
sim_compute_performance-ego_min	0.03835429986317952
sim_compute_robot_state-ego_max	0.04233127037684123
sim_compute_robot_state-ego_mean	0.04025843302408854
sim_compute_robot_state-ego_median	0.03982422987620036
sim_compute_robot_state-ego_min	0.03960042317708334
sim_compute_robot_state-npc0_max	0.042328364849090576
sim_compute_robot_state-npc0_mean	0.04030242872238159
sim_compute_robot_state-npc0_median	0.039860313733418785
sim_compute_robot_state-npc0_min	0.03964278856913249
sim_compute_robot_state-npc1_max	0.042290737628936766
sim_compute_robot_state-npc1_mean	0.04009608681996663
sim_compute_robot_state-npc1_median	0.03962260564168294
sim_compute_robot_state-npc1_min	0.03924168904622396
sim_compute_robot_state-npc2_max	0.041346787611643475
sim_compute_robot_state-npc2_mean	0.03996037546793619
sim_compute_robot_state-npc2_median	0.039203646977742514
sim_compute_robot_state-npc2_min	0.038865811824798584
sim_compute_robot_state-npc3_max	0.04132982571919759
sim_compute_robot_state-npc3_mean	0.03989997577667235
sim_compute_robot_state-npc3_median	0.03946371714274088
sim_compute_robot_state-npc3_min	0.03928098519643148
sim_compute_sim_state_max	0.024451334476470948
sim_compute_sim_state_mean	0.022879220326741535
sim_compute_sim_state_median	0.02256022294362386
sim_compute_sim_state_min	0.02236626704533895
sim_physics_max	0.1003782598177592
sim_physics_mean	0.09353112443288168
sim_physics_median	0.09238080898920696
sim_physics_min	0.08978577057520548
sim_render-ego_max	0.037888392607371014
sim_render-ego_mean	0.03606212552388509
sim_render-ego_median	0.03568955262502035
sim_render-ego_min	0.03541675011316935
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20628

2371

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 15:01:20+00:00

2019-04-25 15:16:57+00:00

0:15:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.658141340093886
survival_time_median	6.999999999999983
deviation-center-line_median	0.3310166859136158
in-drivable-lane_median	2.0499999999999927

other stats

agent_compute-ego_max	0.1492038607597351
agent_compute-ego_mean	0.12890423505283424
agent_compute-ego_median	0.13786485365458898
agent_compute-ego_min	0.09230365071977888
deviation-center-line_max	0.4794323637301212
deviation-center-line_mean	0.3427896670341769
deviation-center-line_min	0.2298545284155696
deviation-heading_max	1.1504193675314938
deviation-heading_mean	0.9407336626620916
deviation-heading_median	0.9938354337214896
deviation-heading_min	0.7450586214352332
driven_any_max	1.6290075912696764
driven_any_mean	1.0117836241191598
driven_any_median	0.9970530395825568
driven_any_min	0.4251549262204664
driven_lanedir_consec_max	1.214560148863141
driven_lanedir_consec_mean	0.7110836872382787
driven_lanedir_consec_min	0.4039437775266599
driven_lanedir_max	1.214560148863141
driven_lanedir_mean	0.7110836872382787
driven_lanedir_median	0.658141340093886
driven_lanedir_min	0.4039437775266599
in-drivable-lane_max	5.000000000000038
in-drivable-lane_mean	1.8700000000000128
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.1563179067202977, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.06240279504231045, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1492038607597351, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.09574595860072543, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.03980357136045184, "sim_compute_performance-ego": 0.06869776589529855, "sim_compute_robot_state-ego": 0.07299213409423828, "sim_compute_robot_state-npc0": 0.07022363458360945, "sim_compute_robot_state-npc1": 0.07042279924665179, "sim_compute_robot_state-npc2": 0.06898683139256069, "sim_compute_robot_state-npc3": 0.06944186176572527}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.43097149972321946, "sim_physics": 0.113435488480788, "survival_time": 3.2499999999999964, "driven_lanedir": 0.4039437775266599, "sim_render-ego": 0.0500859443957989, "in-drivable-lane": 0, "agent_compute-ego": 0.1205030477963961, "deviation-heading": 1.1504193675314938, "set_robot_commands": 0.07627775485698994, "deviation-center-line": 0.23438865875177528, "driven_lanedir_consec": 0.4039437775266599, "sim_compute_sim_state": 0.028546960537250227, "sim_compute_performance-ego": 0.05612020492553711, "sim_compute_robot_state-ego": 0.05816995180570162, "sim_compute_robot_state-npc0": 0.0557341979100154, "sim_compute_robot_state-npc1": 0.05550820644085224, "sim_compute_robot_state-npc2": 0.05563403643094576, "sim_compute_robot_state-npc3": 0.056011577752920295}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6290075912696764, "sim_physics": 0.14926221753869737, "survival_time": 11.200000000000024, "driven_lanedir": 0.8652843360363267, "sim_render-ego": 0.055061383971146176, "in-drivable-lane": 5.000000000000038, "agent_compute-ego": 0.13786485365458898, "deviation-heading": 1.007919996470557, "set_robot_commands": 0.08543869533709117, "deviation-center-line": 0.4794323637301212, "driven_lanedir_consec": 0.8652843360363267, "sim_compute_sim_state": 0.03547916880675724, "sim_compute_performance-ego": 0.06086437829903194, "sim_compute_robot_state-ego": 0.06409481912851334, "sim_compute_robot_state-npc0": 0.06448650040796824, "sim_compute_robot_state-npc1": 0.06395020548786436, "sim_compute_robot_state-npc2": 0.06258223737989153, "sim_compute_robot_state-npc3": 0.0629078501037189}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.57673106379988, "sim_physics": 0.1592961269589613, "survival_time": 10.85000000000002, "driven_lanedir": 1.214560148863141, "sim_render-ego": 0.05808624913615565, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.14464576233367216, "deviation-heading": 0.9938354337214896, "set_robot_commands": 0.09062084844035488, "deviation-center-line": 0.4392560983598026, "driven_lanedir_consec": 1.214560148863141, "sim_compute_sim_state": 0.03735799503765897, "sim_compute_performance-ego": 0.06391710839513261, "sim_compute_robot_state-ego": 0.06787533144797048, "sim_compute_robot_state-npc0": 0.0671603624721826, "sim_compute_robot_state-npc1": 0.0655659662413707, "sim_compute_robot_state-npc2": 0.06557554693265993, "sim_compute_robot_state-npc3": 0.06555387940824306}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4251549262204664, "sim_physics": 0.07214424723670596, "survival_time": 3.149999999999997, "driven_lanedir": 0.4134888336713798, "sim_render-ego": 0.0350949347965301, "in-drivable-lane": 0, "agent_compute-ego": 0.09230365071977888, "deviation-heading": 0.7450586214352332, "set_robot_commands": 0.05255184854779925, "deviation-center-line": 0.2298545284155696, "driven_lanedir_consec": 0.4134888336713798, "sim_compute_sim_state": 0.02234417294699048, "sim_compute_performance-ego": 0.03794668969653901, "sim_compute_robot_state-ego": 0.039190103137303915, "sim_compute_robot_state-npc0": 0.03962783586411249, "sim_compute_robot_state-npc1": 0.03882044080703977, "sim_compute_robot_state-npc2": 0.03848060350569467, "sim_compute_robot_state-npc3": 0.03869532781933981}}
set_robot_commands_max	0.09574595860072543
set_robot_commands_mean	0.08012702115659213
set_robot_commands_median	0.08543869533709117
set_robot_commands_min	0.05255184854779925
sim_compute_performance-ego_max	0.06869776589529855
sim_compute_performance-ego_mean	0.05750922944230785
sim_compute_performance-ego_median	0.06086437829903194
sim_compute_performance-ego_min	0.03794668969653901
sim_compute_robot_state-ego_max	0.07299213409423828
sim_compute_robot_state-ego_mean	0.06046446792274553
sim_compute_robot_state-ego_median	0.06409481912851334
sim_compute_robot_state-ego_min	0.039190103137303915
sim_compute_robot_state-npc0_max	0.07022363458360945
sim_compute_robot_state-npc0_mean	0.05944650624757765
sim_compute_robot_state-npc0_median	0.06448650040796824
sim_compute_robot_state-npc0_min	0.03962783586411249
sim_compute_robot_state-npc1_max	0.07042279924665179
sim_compute_robot_state-npc1_mean	0.05885352364475577
sim_compute_robot_state-npc1_median	0.06395020548786436
sim_compute_robot_state-npc1_min	0.03882044080703977
sim_compute_robot_state-npc2_max	0.06898683139256069
sim_compute_robot_state-npc2_mean	0.05825185112835052
sim_compute_robot_state-npc2_median	0.06258223737989153
sim_compute_robot_state-npc2_min	0.03848060350569467
sim_compute_robot_state-npc3_max	0.06944186176572527
sim_compute_robot_state-npc3_mean	0.058522099369989464
sim_compute_robot_state-npc3_median	0.0629078501037189
sim_compute_robot_state-npc3_min	0.03869532781933981
sim_compute_sim_state_max	0.03980357136045184
sim_compute_sim_state_mean	0.03270637373782175
sim_compute_sim_state_median	0.03547916880675724
sim_compute_sim_state_min	0.02234417294699048
sim_physics_max	0.1592961269589613
sim_physics_mean	0.13009119738709007
sim_physics_median	0.14926221753869737
sim_physics_min	0.07214424723670596
sim_render-ego_max	0.06240279504231045
sim_render-ego_mean	0.05214626146838826
sim_render-ego_median	0.055061383971146176
sim_render-ego_min	0.0350949347965301
simulation-passed	1
survival_time_max	11.200000000000024
survival_time_mean	7.090000000000005
survival_time_min	3.149999999999997

No reset possible

20605

2386

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 14:54:33+00:00

2019-04-25 15:00:07+00:00

0:05:34

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20605-660952', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20605-660952', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20605-660952', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20582

2408

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:31:46+00:00

2019-04-25 14:54:05+00:00

0:22:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3397390356601346
survival_time_median	14.950000000000076
deviation-center-line_median	1.401141803909748
in-drivable-lane_median	2.500000000000013

other stats

agent_compute-ego_max	0.1604947193463643
agent_compute-ego_mean	0.15500361824035644
agent_compute-ego_median	0.15810248772303262
agent_compute-ego_min	0.14558961470921836
deviation-center-line_max	1.5194332589791988
deviation-center-line_mean	1.1743762518416452
deviation-center-line_min	0.26891847472491964
deviation-heading_max	8.492476633385415
deviation-heading_mean	7.583649780851511
deviation-heading_median	8.165190079878816
deviation-heading_min	5.589657549909816
driven_any_max	4.378320939674851
driven_any_mean	4.378320939674839
driven_any_median	4.3783209396748415
driven_any_min	4.378320939674831
driven_lanedir_consec_max	-1.3111163275808764
driven_lanedir_consec_mean	-1.342604284062788
driven_lanedir_consec_min	-1.3761077892801137
driven_lanedir_max	-1.3397390356601346
driven_lanedir_mean	-2.354812195437246
driven_lanedir_median	-2.597977359892488
driven_lanedir_min	-2.711272268924253
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	3.570000000000019
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.11607852220535278, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272268924253, "sim_render-ego": 0.05941663980484009, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15810248772303262, "deviation-heading": 8.371542541054902, "set_robot_commands": 0.09062736749649047, "deviation-center-line": 1.5194332589791988, "driven_lanedir_consec": -1.3111163275808764, "sim_compute_sim_state": 0.0371649169921875, "sim_compute_performance-ego": 0.06655102570851644, "sim_compute_robot_state-ego": 0.07019980271657308}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378320939674851, "sim_physics": 0.10086636384328208, "survival_time": 14.950000000000076, "driven_lanedir": -2.448035866142366, "sim_render-ego": 0.05347743670145671, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.14558961470921836, "deviation-heading": 7.299382100028609, "set_robot_commands": 0.08138416210810344, "deviation-center-line": 1.1659435662933817, "driven_lanedir_consec": -1.3761077892801137, "sim_compute_sim_state": 0.03366039514541626, "sim_compute_performance-ego": 0.058471313317616784, "sim_compute_robot_state-ego": 0.06053648153940837}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.3783209396748415, "sim_physics": 0.1114931337038676, "survival_time": 14.950000000000076, "driven_lanedir": -1.3397390356601346, "sim_render-ego": 0.0603556219736735, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.1604947193463643, "deviation-heading": 5.589657549909816, "set_robot_commands": 0.09617259581883748, "deviation-center-line": 0.26891847472491964, "driven_lanedir_consec": -1.3397390356601346, "sim_compute_sim_state": 0.038798542817433675, "sim_compute_performance-ego": 0.06627976417541503, "sim_compute_robot_state-ego": 0.07210729519526164}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378320939674831, "sim_physics": 0.11006642580032348, "survival_time": 14.950000000000076, "driven_lanedir": -2.677036446566989, "sim_render-ego": 0.05757925907770792, "in-drivable-lane": 2.2000000000000117, "agent_compute-ego": 0.15111708323160808, "deviation-heading": 8.492476633385415, "set_robot_commands": 0.08765934944152833, "deviation-center-line": 1.5164441553009778, "driven_lanedir_consec": -1.3182655771745324, "sim_compute_sim_state": 0.03646346807479858, "sim_compute_performance-ego": 0.06409963289896647, "sim_compute_robot_state-ego": 0.0658456023534139}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378320939674831, "sim_physics": 0.11230632384618124, "survival_time": 14.950000000000076, "driven_lanedir": -2.597977359892488, "sim_render-ego": 0.05902156670888265, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.15971418619155883, "deviation-heading": 8.165190079878816, "set_robot_commands": 0.09546696583429971, "deviation-center-line": 1.401141803909748, "driven_lanedir_consec": -1.367792690618283, "sim_compute_sim_state": 0.03702625036239624, "sim_compute_performance-ego": 0.06445456266403199, "sim_compute_robot_state-ego": 0.06777452707290649}}
set_robot_commands_max	0.09617259581883748
set_robot_commands_mean	0.09026208813985188
set_robot_commands_median	0.09062736749649047
set_robot_commands_min	0.08138416210810344
sim_compute_performance-ego_max	0.06655102570851644
sim_compute_performance-ego_mean	0.06397125975290935
sim_compute_performance-ego_median	0.06445456266403199
sim_compute_performance-ego_min	0.058471313317616784
sim_compute_robot_state-ego_max	0.07210729519526164
sim_compute_robot_state-ego_mean	0.0672927417755127
sim_compute_robot_state-ego_median	0.06777452707290649
sim_compute_robot_state-ego_min	0.06053648153940837
sim_compute_sim_state_max	0.038798542817433675
sim_compute_sim_state_mean	0.03662271467844645
sim_compute_sim_state_median	0.03702625036239624
sim_compute_sim_state_min	0.03366039514541626
sim_physics_max	0.11607852220535278
sim_physics_mean	0.11016215387980144
sim_physics_median	0.1114931337038676
sim_physics_min	0.10086636384328208
sim_render-ego_max	0.0603556219736735
sim_render-ego_mean	0.05797010485331218
sim_render-ego_median	0.05902156670888265
sim_render-ego_min	0.05347743670145671
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20576

2420

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 14:23:19+00:00

2019-04-25 14:31:19+00:00

0:08:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.14701372605782967
agent_compute-ego_mean	0.13180894866840398
agent_compute-ego_median	0.13306297446196935
agent_compute-ego_min	0.11119806615612177
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.14286369197773482, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.05898644789209906, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.13306297446196935, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09070373031328308, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.038590111822452186, "sim_compute_performance-ego": 0.06610036346147645, "sim_compute_robot_state-ego": 0.07321372571981179, "sim_compute_robot_state-npc0": 0.06551794735890515, "sim_compute_robot_state-npc1": 0.06692247570685621, "sim_compute_robot_state-npc2": 0.06461866396778035, "sim_compute_robot_state-npc3": 0.06674363928021125}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.15005085101494425, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.06490725737351638, "in-drivable-lane": 0, "agent_compute-ego": 0.13613641262054443, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.09368317860823412, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.03765266675215501, "sim_compute_performance-ego": 0.07123545499948356, "sim_compute_robot_state-ego": 0.07373462273524357, "sim_compute_robot_state-npc0": 0.06824002816126896, "sim_compute_robot_state-npc1": 0.07174932956695557, "sim_compute_robot_state-npc2": 0.07129981884589562, "sim_compute_robot_state-npc3": 0.07049335883213924}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.1547346742529618, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.06411922919122796, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.1316335640455547, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.09332256881814252, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.039426558896114954, "sim_compute_performance-ego": 0.07109639205430683, "sim_compute_robot_state-ego": 0.07502979981271844, "sim_compute_robot_state-npc0": 0.07042930628124036, "sim_compute_robot_state-npc1": 0.070474248183401, "sim_compute_robot_state-npc2": 0.06870750690761365, "sim_compute_robot_state-npc3": 0.06938699358387997}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.11993524092662183, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.05160915398899513, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.11119806615612177, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.08494582055490228, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03112484533575517, "sim_compute_performance-ego": 0.05733514737479294, "sim_compute_robot_state-ego": 0.056382496145707145, "sim_compute_robot_state-npc0": 0.058204512052898165, "sim_compute_robot_state-npc1": 0.05473797230780879, "sim_compute_robot_state-npc2": 0.055034782313093354, "sim_compute_robot_state-npc3": 0.05526002751121038}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.14462380056028012, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06937260980959292, "in-drivable-lane": 0, "agent_compute-ego": 0.14701372605782967, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.09850698047214083, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.04053433736165365, "sim_compute_performance-ego": 0.07488893579553675, "sim_compute_robot_state-ego": 0.07704641200878003, "sim_compute_robot_state-npc0": 0.07537178640012387, "sim_compute_robot_state-npc1": 0.06386234142162182, "sim_compute_robot_state-npc2": 0.06364515975669578, "sim_compute_robot_state-npc3": 0.06949508631670917}}
set_robot_commands_max	0.09850698047214083
set_robot_commands_mean	0.09223245575334058
set_robot_commands_median	0.09332256881814252
set_robot_commands_min	0.08494582055490228
sim_compute_performance-ego_max	0.07488893579553675
sim_compute_performance-ego_mean	0.06813125873711931
sim_compute_performance-ego_median	0.07109639205430683
sim_compute_performance-ego_min	0.05733514737479294
sim_compute_robot_state-ego_max	0.07704641200878003
sim_compute_robot_state-ego_mean	0.0710814112844522
sim_compute_robot_state-ego_median	0.07373462273524357
sim_compute_robot_state-ego_min	0.056382496145707145
sim_compute_robot_state-npc0_max	0.07537178640012387
sim_compute_robot_state-npc0_mean	0.0675527160508873
sim_compute_robot_state-npc0_median	0.06824002816126896
sim_compute_robot_state-npc0_min	0.058204512052898165
sim_compute_robot_state-npc1_max	0.07174932956695557
sim_compute_robot_state-npc1_mean	0.06554927343732868
sim_compute_robot_state-npc1_median	0.06692247570685621
sim_compute_robot_state-npc1_min	0.05473797230780879
sim_compute_robot_state-npc2_max	0.07129981884589562
sim_compute_robot_state-npc2_mean	0.06466118635821574
sim_compute_robot_state-npc2_median	0.06461866396778035
sim_compute_robot_state-npc2_min	0.055034782313093354
sim_compute_robot_state-npc3_max	0.07049335883213924
sim_compute_robot_state-npc3_mean	0.06627582110483002
sim_compute_robot_state-npc3_median	0.06938699358387997
sim_compute_robot_state-npc3_min	0.05526002751121038
sim_compute_sim_state_max	0.04053433736165365
sim_compute_sim_state_mean	0.037465704033626195
sim_compute_sim_state_median	0.038590111822452186
sim_compute_sim_state_min	0.03112484533575517
sim_physics_max	0.1547346742529618
sim_physics_mean	0.14244165174650855
sim_physics_median	0.14462380056028012
sim_physics_min	0.11993524092662183
sim_render-ego_max	0.06937260980959292
sim_render-ego_mean	0.06179893965108629
sim_render-ego_median	0.06411922919122796
sim_render-ego_min	0.05160915398899513
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20567

2436

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 14:21:37+00:00

2019-04-25 14:22:52+00:00

0:01:15

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20558

2444

Jacopo Tani

random_agent

step1-simulation

success

2019-04-25 14:12:55+00:00

2019-04-25 14:21:30+00:00

0:08:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.153209561008518
agent_compute-ego_mean	0.1394289032816442
agent_compute-ego_median	0.14120133044356006
agent_compute-ego_min	0.11991067427509236
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1635914186261735, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.0492788035914583, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.11991067427509236, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.07806550331835477, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.031741270479166285, "sim_compute_performance-ego": 0.05502381189814154, "sim_compute_robot_state-ego": 0.05870550083664229, "sim_compute_robot_state-npc0": 0.05621714636964618, "sim_compute_robot_state-npc1": 0.056013966506382205, "sim_compute_robot_state-npc2": 0.05432252614003307, "sim_compute_robot_state-npc3": 0.05346550806513373}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.14168729384740197, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.06345027685165405, "in-drivable-lane": 0, "agent_compute-ego": 0.14993776877721152, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.08739176392555237, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.0364745557308197, "sim_compute_performance-ego": 0.06301334500312805, "sim_compute_robot_state-ego": 0.07139661908149719, "sim_compute_robot_state-npc0": 0.06344360113143921, "sim_compute_robot_state-npc1": 0.059733678897221885, "sim_compute_robot_state-npc2": 0.06226140260696411, "sim_compute_robot_state-npc3": 0.06235623359680176}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.16852442692902128, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.061444452253438656, "in-drivable-lane": 0, "agent_compute-ego": 0.14120133044356006, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.08929090580697786, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03799269563060695, "sim_compute_performance-ego": 0.07109030222488662, "sim_compute_robot_state-ego": 0.07244651600465936, "sim_compute_robot_state-npc0": 0.06722040903770317, "sim_compute_robot_state-npc1": 0.08070068440194857, "sim_compute_robot_state-npc2": 0.06720993074320131, "sim_compute_robot_state-npc3": 0.06563450118242684}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.1874751640578448, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.06309844679751639, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.153209561008518, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.08998439271571272, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.038936029046268784, "sim_compute_performance-ego": 0.06649494979341151, "sim_compute_robot_state-ego": 0.07160841408422437, "sim_compute_robot_state-npc0": 0.06675885087352688, "sim_compute_robot_state-npc1": 0.06767861317780058, "sim_compute_robot_state-npc2": 0.06849224688643116, "sim_compute_robot_state-npc3": 0.06866767042774265}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.12889044284820556, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.05567889213562012, "in-drivable-lane": 0, "agent_compute-ego": 0.1328851819038391, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.09112048149108888, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.0364147424697876, "sim_compute_performance-ego": 0.06571750640869141, "sim_compute_robot_state-ego": 0.0667448878288269, "sim_compute_robot_state-npc0": 0.06373125314712524, "sim_compute_robot_state-npc1": 0.06361346244812012, "sim_compute_robot_state-npc2": 0.06276811361312866, "sim_compute_robot_state-npc3": 0.06186209917068482}}
set_robot_commands_max	0.09112048149108888
set_robot_commands_mean	0.08717060945153732
set_robot_commands_median	0.08929090580697786
set_robot_commands_min	0.07806550331835477
sim_compute_performance-ego_max	0.07109030222488662
sim_compute_performance-ego_mean	0.06426798306565182
sim_compute_performance-ego_median	0.06571750640869141
sim_compute_performance-ego_min	0.05502381189814154
sim_compute_robot_state-ego_max	0.07244651600465936
sim_compute_robot_state-ego_mean	0.06818038756717001
sim_compute_robot_state-ego_median	0.07139661908149719
sim_compute_robot_state-ego_min	0.05870550083664229
sim_compute_robot_state-npc0_max	0.06722040903770317
sim_compute_robot_state-npc0_mean	0.06347425211188815
sim_compute_robot_state-npc0_median	0.06373125314712524
sim_compute_robot_state-npc0_min	0.05621714636964618
sim_compute_robot_state-npc1_max	0.08070068440194857
sim_compute_robot_state-npc1_mean	0.06554808108629467
sim_compute_robot_state-npc1_median	0.06361346244812012
sim_compute_robot_state-npc1_min	0.056013966506382205
sim_compute_robot_state-npc2_max	0.06849224688643116
sim_compute_robot_state-npc2_mean	0.06301084399795166
sim_compute_robot_state-npc2_median	0.06276811361312866
sim_compute_robot_state-npc2_min	0.05432252614003307
sim_compute_robot_state-npc3_max	0.06866767042774265
sim_compute_robot_state-npc3_mean	0.06239720248855796
sim_compute_robot_state-npc3_median	0.06235623359680176
sim_compute_robot_state-npc3_min	0.05346550806513373
sim_compute_sim_state_max	0.038936029046268784
sim_compute_sim_state_mean	0.03631185867132986
sim_compute_sim_state_median	0.0364745557308197
sim_compute_sim_state_min	0.031741270479166285
sim_physics_max	0.1874751640578448
sim_physics_mean	0.15803374926172942
sim_physics_median	0.1635914186261735
sim_physics_min	0.12889044284820556
sim_render-ego_max	0.06345027685165405
sim_render-ego_mean	0.05859017432593751
sim_render-ego_median	0.061444452253438656
sim_render-ego_min	0.0492788035914583
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20542

2472

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 14:04:53+00:00

2019-04-25 14:12:38+00:00

0:07:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.15142080019105156
agent_compute-ego_mean	0.1402667296106888
agent_compute-ego_median	0.1421989579743977
agent_compute-ego_min	0.12965221588428205
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.13467847626164275, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.062213506338731295, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.15142080019105156, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09552363179764656, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03794079906535598, "sim_compute_performance-ego": 0.0678728886370389, "sim_compute_robot_state-ego": 0.07014542255761488, "sim_compute_robot_state-npc0": 0.06742094147880122, "sim_compute_robot_state-npc1": 0.064801868402733, "sim_compute_robot_state-npc2": 0.064200500272355, "sim_compute_robot_state-npc3": 0.06605164959745587}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.11738035312065712, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.054882086240328275, "in-drivable-lane": 0, "agent_compute-ego": 0.12965221588428205, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.07706378056452824, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.03396574350503775, "sim_compute_performance-ego": 0.05771041833437406, "sim_compute_robot_state-ego": 0.06062761636880728, "sim_compute_robot_state-npc0": 0.05918463376852182, "sim_compute_robot_state-npc1": 0.05786276780641996, "sim_compute_robot_state-npc2": 0.05847626466017503, "sim_compute_robot_state-npc3": 0.057816083614642806}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.1387233389051337, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.05349941943821154, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.13082320752896762, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.08322018384933472, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.032672420928352756, "sim_compute_performance-ego": 0.060480171128323205, "sim_compute_robot_state-ego": 0.06440926225561845, "sim_compute_robot_state-npc0": 0.05913807216443514, "sim_compute_robot_state-npc1": 0.060611530354148464, "sim_compute_robot_state-npc2": 0.05862435227946231, "sim_compute_robot_state-npc3": 0.0596780588752345}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.13721690902227088, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.05875629111181332, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.1421989579743977, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.09336232535446748, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03595676904992212, "sim_compute_performance-ego": 0.0664608116391339, "sim_compute_robot_state-ego": 0.06701111189926727, "sim_compute_robot_state-npc0": 0.0641338945944098, "sim_compute_robot_state-npc1": 0.06467542165442358, "sim_compute_robot_state-npc2": 0.06380979018875316, "sim_compute_robot_state-npc3": 0.06561693662329565}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.1423346996307373, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06214220435531051, "in-drivable-lane": 0, "agent_compute-ego": 0.147238466474745, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.08927775312353063, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.0385993586646186, "sim_compute_performance-ego": 0.06663603252834743, "sim_compute_robot_state-ego": 0.06861973691869665, "sim_compute_robot_state-npc0": 0.06954715870044849, "sim_compute_robot_state-npc1": 0.06881986724005805, "sim_compute_robot_state-npc2": 0.06818142643681278, "sim_compute_robot_state-npc3": 0.0684779926582619}}
set_robot_commands_max	0.09552363179764656
set_robot_commands_mean	0.08768953493790152
set_robot_commands_median	0.08927775312353063
set_robot_commands_min	0.07706378056452824
sim_compute_performance-ego_max	0.0678728886370389
sim_compute_performance-ego_mean	0.0638320644534435
sim_compute_performance-ego_median	0.0664608116391339
sim_compute_performance-ego_min	0.05771041833437406
sim_compute_robot_state-ego_max	0.07014542255761488
sim_compute_robot_state-ego_mean	0.06616263000000092
sim_compute_robot_state-ego_median	0.06701111189926727
sim_compute_robot_state-ego_min	0.06062761636880728
sim_compute_robot_state-npc0_max	0.06954715870044849
sim_compute_robot_state-npc0_mean	0.0638849401413233
sim_compute_robot_state-npc0_median	0.0641338945944098
sim_compute_robot_state-npc0_min	0.05913807216443514
sim_compute_robot_state-npc1_max	0.06881986724005805
sim_compute_robot_state-npc1_mean	0.06335429109155662
sim_compute_robot_state-npc1_median	0.06467542165442358
sim_compute_robot_state-npc1_min	0.05786276780641996
sim_compute_robot_state-npc2_max	0.06818142643681278
sim_compute_robot_state-npc2_mean	0.06265846676751166
sim_compute_robot_state-npc2_median	0.06380979018875316
sim_compute_robot_state-npc2_min	0.05847626466017503
sim_compute_robot_state-npc3_max	0.0684779926582619
sim_compute_robot_state-npc3_mean	0.06352814427377815
sim_compute_robot_state-npc3_median	0.06561693662329565
sim_compute_robot_state-npc3_min	0.057816083614642806
sim_compute_sim_state_max	0.0385993586646186
sim_compute_sim_state_mean	0.03582701824265744
sim_compute_sim_state_median	0.03595676904992212
sim_compute_sim_state_min	0.032672420928352756
sim_physics_max	0.1423346996307373
sim_physics_mean	0.13406675538808835
sim_physics_median	0.13721690902227088
sim_physics_min	0.11738035312065712
sim_render-ego_max	0.062213506338731295
sim_render-ego_mean	0.05829870149687899
sim_render-ego_median	0.05875629111181332
sim_render-ego_min	0.05349941943821154
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20520

2501

test for ppo

step1-simulation

error

2019-04-25 14:00:43+00:00

2019-04-25 14:04:11+00:00

0:03:28

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20510

2508

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

host-error

2019-04-25 13:59:42+00:00

2019-04-25 14:00:13+00:00

0:00:31

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    shutil.rmtree(wd)
  File "/usr/lib/python3.6/shutil.py", line 471, in rmtree
    onerror(os.lstat, path, sys.exc_info())
  File "/usr/lib/python3.6/shutil.py", line 469, in rmtree
    orig_st = os.lstat(path)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2508/step1-simulation-ip-172-31-25-98-2062-job20510'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20499

2525

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 13:57:33+00:00

2019-04-25 13:59:13+00:00

0:01:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20491

2542

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 13:52:28+00:00

2019-04-25 13:57:25+00:00

0:04:57

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20474

2569

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:38:59+00:00

2019-04-25 13:51:26+00:00

0:12:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.07406866934991652
agent_compute-ego_mean	0.06731916042766743
agent_compute-ego_median	0.06549010547340339
agent_compute-ego_min	0.06382338765641334
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.15282315015792847, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.05911922996694392, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.06786478107625787, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.08763579346916893, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.03743240508166226, "sim_compute_performance-ego": 0.06683931838382375, "sim_compute_robot_state-ego": 0.06738953427834944, "sim_compute_robot_state-npc0": 0.06501432440497658, "sim_compute_robot_state-npc1": 0.06721561063419688, "sim_compute_robot_state-npc2": 0.06427707184444774, "sim_compute_robot_state-npc3": 0.06378107450225136}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.1657724457402383, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.06256092748334331, "in-drivable-lane": 0, "agent_compute-ego": 0.07406866934991652, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.09776284617762412, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.03699549551933042, "sim_compute_performance-ego": 0.07593989372253418, "sim_compute_robot_state-ego": 0.06907676112267279, "sim_compute_robot_state-npc0": 0.0624634450481784, "sim_compute_robot_state-npc1": 0.06504660267983714, "sim_compute_robot_state-npc2": 0.06778458626039567, "sim_compute_robot_state-npc3": 0.06715184642422584}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.1721035656354106, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.05880790906595, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06549010547340339, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.09072359402974446, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.03743341121267765, "sim_compute_performance-ego": 0.06432947368486554, "sim_compute_robot_state-ego": 0.06930876792745387, "sim_compute_robot_state-npc0": 0.0650915338637981, "sim_compute_robot_state-npc1": 0.06325123496089421, "sim_compute_robot_state-npc2": 0.06277167881634219, "sim_compute_robot_state-npc3": 0.06304218413981985}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.16513373475325735, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.05864142116747404, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.06534885858234606, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.09135758751317076, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.035655064331857785, "sim_compute_performance-ego": 0.0640525315937243, "sim_compute_robot_state-ego": 0.068677608590377, "sim_compute_robot_state-npc0": 0.06754160429302015, "sim_compute_robot_state-npc1": 0.06546691844337865, "sim_compute_robot_state-npc2": 0.06473711415341026, "sim_compute_robot_state-npc3": 0.06453289734689813}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.1630510192521861, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.05465928937347842, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.06382338765641334, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.08332801033073747, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.034193836467366824, "sim_compute_performance-ego": 0.059974462213650555, "sim_compute_robot_state-ego": 0.06189197050014012, "sim_compute_robot_state-npc0": 0.05926821601222938, "sim_compute_robot_state-npc1": 0.05757446188322255, "sim_compute_robot_state-npc2": 0.058449597425863774, "sim_compute_robot_state-npc3": 0.05922924632757482}}
set_robot_commands_max	0.09776284617762412
set_robot_commands_mean	0.09016156630408914
set_robot_commands_median	0.09072359402974446
set_robot_commands_min	0.08332801033073747
sim_compute_performance-ego_max	0.07593989372253418
sim_compute_performance-ego_mean	0.06622713591971965
sim_compute_performance-ego_median	0.06432947368486554
sim_compute_performance-ego_min	0.059974462213650555
sim_compute_robot_state-ego_max	0.06930876792745387
sim_compute_robot_state-ego_mean	0.06726892848379865
sim_compute_robot_state-ego_median	0.068677608590377
sim_compute_robot_state-ego_min	0.06189197050014012
sim_compute_robot_state-npc0_max	0.06754160429302015
sim_compute_robot_state-npc0_mean	0.06387582472444052
sim_compute_robot_state-npc0_median	0.06501432440497658
sim_compute_robot_state-npc0_min	0.05926821601222938
sim_compute_robot_state-npc1_max	0.06721561063419688
sim_compute_robot_state-npc1_mean	0.0637109657203059
sim_compute_robot_state-npc1_median	0.06504660267983714
sim_compute_robot_state-npc1_min	0.05757446188322255
sim_compute_robot_state-npc2_max	0.06778458626039567
sim_compute_robot_state-npc2_mean	0.06360400970009192
sim_compute_robot_state-npc2_median	0.06427707184444774
sim_compute_robot_state-npc2_min	0.058449597425863774
sim_compute_robot_state-npc3_max	0.06715184642422584
sim_compute_robot_state-npc3_mean	0.06354744974815399
sim_compute_robot_state-npc3_median	0.06378107450225136
sim_compute_robot_state-npc3_min	0.05922924632757482
sim_compute_sim_state_max	0.03743341121267765
sim_compute_sim_state_mean	0.036342042522578985
sim_compute_sim_state_median	0.03699549551933042
sim_compute_sim_state_min	0.034193836467366824
sim_physics_max	0.1721035656354106
sim_physics_mean	0.16377678310780416
sim_physics_median	0.16513373475325735
sim_physics_min	0.15282315015792847
sim_render-ego_max	0.06256092748334331
sim_render-ego_mean	0.05875775541143794
sim_render-ego_median	0.05880790906595
sim_render-ego_min	0.05465928937347842
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20465

2583

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

success

2019-04-25 13:32:20+00:00

2019-04-25 13:38:38+00:00

0:06:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.14233743626138437
agent_compute-ego_mean	0.07733692080289223
agent_compute-ego_median	0.060668300609199366
agent_compute-ego_min	0.05231605876575817
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.06891161830801713, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.04855746971933465, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.07074774566449617, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.08122501875224866, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.045723874317972285, "sim_compute_performance-ego": 0.052979193235698496, "sim_compute_robot_state-ego": 0.05325312049765336}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.08702695542487546, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.05068752040033755, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14233743626138437, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.0931541781494583, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.044747532277867416, "sim_compute_performance-ego": 0.05890637895335322, "sim_compute_robot_state-ego": 0.10514710606008336}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.05930262262170965, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.04680764675140381, "in-drivable-lane": 0, "agent_compute-ego": 0.05231605876575817, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.06930384852669456, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.0323209437456998, "sim_compute_performance-ego": 0.047932971607555046, "sim_compute_robot_state-ego": 0.050078879703174935}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.09656212356064346, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.054122128329434235, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06061506271362305, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.08421846798488072, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.033133278836260785, "sim_compute_performance-ego": 0.061740256927825594, "sim_compute_robot_state-ego": 0.07053542923141312}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.08877046984069202, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.05898490973881313, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.060668300609199366, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.08304575997955944, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.036618979609742454, "sim_compute_performance-ego": 0.05998790264129639, "sim_compute_robot_state-ego": 0.0617045529034673}}
set_robot_commands_max	0.0931541781494583
set_robot_commands_mean	0.08218945467856834
set_robot_commands_median	0.08304575997955944
set_robot_commands_min	0.06930384852669456
sim_compute_performance-ego_max	0.061740256927825594
sim_compute_performance-ego_mean	0.05630934067314575
sim_compute_performance-ego_median	0.05890637895335322
sim_compute_performance-ego_min	0.047932971607555046
sim_compute_robot_state-ego_max	0.10514710606008336
sim_compute_robot_state-ego_mean	0.06814381767915842
sim_compute_robot_state-ego_median	0.0617045529034673
sim_compute_robot_state-ego_min	0.050078879703174935
sim_compute_sim_state_max	0.045723874317972285
sim_compute_sim_state_mean	0.038508921757508544
sim_compute_sim_state_median	0.036618979609742454
sim_compute_sim_state_min	0.0323209437456998
sim_physics_max	0.09656212356064346
sim_physics_mean	0.08011475795118755
sim_physics_median	0.08702695542487546
sim_physics_min	0.05930262262170965
sim_render-ego_max	0.05898490973881313
sim_render-ego_mean	0.05183193498786468
sim_render-ego_median	0.05068752040033755
sim_render-ego_min	0.04680764675140381
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20446

2613

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:19:18+00:00

2019-04-25 13:31:49+00:00

0:12:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.06809858029538934
agent_compute-ego_mean	0.06554989352232667
agent_compute-ego_median	0.06692194169567477
agent_compute-ego_min	0.059579362367328845
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.1514648659662767, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.05583128874952143, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.06809858029538934, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.09043507955291054, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.03581631725484675, "sim_compute_performance-ego": 0.06082382256334478, "sim_compute_robot_state-ego": 0.06629702990705316, "sim_compute_robot_state-npc0": 0.06341236016967079, "sim_compute_robot_state-npc1": 0.06116581234064969, "sim_compute_robot_state-npc2": 0.06363309784369035, "sim_compute_robot_state-npc3": 0.06175647540525957}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.15785659513165873, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.061784736571773406, "in-drivable-lane": 0, "agent_compute-ego": 0.06692194169567477, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.09488986384484076, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.034971198728007656, "sim_compute_performance-ego": 0.06591942233424034, "sim_compute_robot_state-ego": 0.07076646435645319, "sim_compute_robot_state-npc0": 0.0624260748586347, "sim_compute_robot_state-npc1": 0.06205860260994204, "sim_compute_robot_state-npc2": 0.06537569722821636, "sim_compute_robot_state-npc3": 0.06386126241376323}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.1728443592152697, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.06349377091049302, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06757374012723882, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.09247841564476068, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.035861906430400006, "sim_compute_performance-ego": 0.06737740158189273, "sim_compute_robot_state-ego": 0.07070282672313934, "sim_compute_robot_state-npc0": 0.06460545249019109, "sim_compute_robot_state-npc1": 0.064445564932857, "sim_compute_robot_state-npc2": 0.06434830537079074, "sim_compute_robot_state-npc3": 0.06426985382188297}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.1518877054515638, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.054950064106991416, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.059579362367328845, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.08283689398514597, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.03382192410920796, "sim_compute_performance-ego": 0.06031875108417712, "sim_compute_robot_state-ego": 0.061954887289749946, "sim_compute_robot_state-npc0": 0.05972169323971397, "sim_compute_robot_state-npc1": 0.05936688372963353, "sim_compute_robot_state-npc2": 0.058628082275390625, "sim_compute_robot_state-npc3": 0.05968408835561652}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.18288416258046325, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.056803058570539446, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.0655758431260015, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.08689852499626052, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.035297706093586664, "sim_compute_performance-ego": 0.06712796486599344, "sim_compute_robot_state-ego": 0.06557036285669031, "sim_compute_robot_state-npc0": 0.06307659182750003, "sim_compute_robot_state-npc1": 0.06138635017502476, "sim_compute_robot_state-npc2": 0.0616976173830704, "sim_compute_robot_state-npc3": 0.06088065765273403}}
set_robot_commands_max	0.09488986384484076
set_robot_commands_mean	0.0895077556047837
set_robot_commands_median	0.09043507955291054
set_robot_commands_min	0.08283689398514597
sim_compute_performance-ego_max	0.06737740158189273
sim_compute_performance-ego_mean	0.06431347248592968
sim_compute_performance-ego_median	0.06591942233424034
sim_compute_performance-ego_min	0.06031875108417712
sim_compute_robot_state-ego_max	0.07076646435645319
sim_compute_robot_state-ego_mean	0.06705831422661719
sim_compute_robot_state-ego_median	0.06629702990705316
sim_compute_robot_state-ego_min	0.061954887289749946
sim_compute_robot_state-npc0_max	0.06460545249019109
sim_compute_robot_state-npc0_mean	0.06264843451714211
sim_compute_robot_state-npc0_median	0.06307659182750003
sim_compute_robot_state-npc0_min	0.05972169323971397
sim_compute_robot_state-npc1_max	0.064445564932857
sim_compute_robot_state-npc1_mean	0.0616846427576214
sim_compute_robot_state-npc1_median	0.06138635017502476
sim_compute_robot_state-npc1_min	0.05936688372963353
sim_compute_robot_state-npc2_max	0.06537569722821636
sim_compute_robot_state-npc2_mean	0.06273656002023169
sim_compute_robot_state-npc2_median	0.06363309784369035
sim_compute_robot_state-npc2_min	0.058628082275390625
sim_compute_robot_state-npc3_max	0.06426985382188297
sim_compute_robot_state-npc3_mean	0.06209046752985127
sim_compute_robot_state-npc3_median	0.06175647540525957
sim_compute_robot_state-npc3_min	0.05968408835561652
sim_compute_sim_state_max	0.035861906430400006
sim_compute_sim_state_mean	0.0351538105232098
sim_compute_sim_state_median	0.035297706093586664
sim_compute_sim_state_min	0.03382192410920796
sim_physics_max	0.18288416258046325
sim_physics_mean	0.16338753766904643
sim_physics_median	0.15785659513165873
sim_physics_min	0.1514648659662767
sim_render-ego_max	0.06349377091049302
sim_render-ego_mean	0.05857258378186374
sim_render-ego_median	0.056803058570539446
sim_render-ego_min	0.054950064106991416
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20440

2625

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 13:09:45+00:00

2019-04-25 13:18:54+00:00

0:09:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17656054496765136
agent_compute-ego_mean	0.15532095023531253
agent_compute-ego_median	0.1535901146114997
agent_compute-ego_min	0.1395812630653381
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1790028675547186, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.061479766413850605, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.1535901146114997, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.09563335157790274, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03955344883900768, "sim_compute_performance-ego": 0.06857773492921074, "sim_compute_robot_state-ego": 0.07365190083125853, "sim_compute_robot_state-npc0": 0.06945854088045517, "sim_compute_robot_state-npc1": 0.07213936886697445, "sim_compute_robot_state-npc2": 0.07005714245562283, "sim_compute_robot_state-npc3": 0.06682008167482772}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.122979203859965, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.05449701348940531, "in-drivable-lane": 0, "agent_compute-ego": 0.1395812630653381, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.07966544230779012, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03286717335383097, "sim_compute_performance-ego": 0.060989777247111, "sim_compute_robot_state-ego": 0.058001150687535606, "sim_compute_robot_state-npc0": 0.05875082810719808, "sim_compute_robot_state-npc1": 0.05817705392837525, "sim_compute_robot_state-npc2": 0.05690686901410421, "sim_compute_robot_state-npc3": 0.05618107318878174}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.18166263224714893, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06248341980627028, "in-drivable-lane": 0, "agent_compute-ego": 0.14958972850088345, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09501183235039146, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03916432897923356, "sim_compute_performance-ego": 0.0701841782715361, "sim_compute_robot_state-ego": 0.07370896662695933, "sim_compute_robot_state-npc0": 0.06964232153811697, "sim_compute_robot_state-npc1": 0.06903754654577222, "sim_compute_robot_state-npc2": 0.06856506153688592, "sim_compute_robot_state-npc3": 0.0664952609498622}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.187640392174155, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.06273060733989133, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15728310003119, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.09823212785235906, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.04171244168685655, "sim_compute_performance-ego": 0.06944396132129733, "sim_compute_robot_state-ego": 0.07250685206914352, "sim_compute_robot_state-npc0": 0.06831375219054141, "sim_compute_robot_state-npc1": 0.06912664235648462, "sim_compute_robot_state-npc2": 0.0711827641826565, "sim_compute_robot_state-npc3": 0.06996855493319237}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.17677769660949708, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.06970834732055664, "in-drivable-lane": 0, "agent_compute-ego": 0.17656054496765136, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.10589276552200318, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.04031333923339843, "sim_compute_performance-ego": 0.0756598711013794, "sim_compute_robot_state-ego": 0.09377692937850952, "sim_compute_robot_state-npc0": 0.068771493434906, "sim_compute_robot_state-npc1": 0.07416741847991944, "sim_compute_robot_state-npc2": 0.07609791755676269, "sim_compute_robot_state-npc3": 0.07542322874069214}}
set_robot_commands_max	0.10589276552200318
set_robot_commands_mean	0.09488710392208932
set_robot_commands_median	0.09563335157790274
set_robot_commands_min	0.07966544230779012
sim_compute_performance-ego_max	0.0756598711013794
sim_compute_performance-ego_mean	0.0689711045741069
sim_compute_performance-ego_median	0.06944396132129733
sim_compute_performance-ego_min	0.060989777247111
sim_compute_robot_state-ego_max	0.09377692937850952
sim_compute_robot_state-ego_mean	0.0743291599186813
sim_compute_robot_state-ego_median	0.07365190083125853
sim_compute_robot_state-ego_min	0.058001150687535606
sim_compute_robot_state-npc0_max	0.06964232153811697
sim_compute_robot_state-npc0_mean	0.06698738723024353
sim_compute_robot_state-npc0_median	0.068771493434906
sim_compute_robot_state-npc0_min	0.05875082810719808
sim_compute_robot_state-npc1_max	0.07416741847991944
sim_compute_robot_state-npc1_mean	0.0685296060355052
sim_compute_robot_state-npc1_median	0.06912664235648462
sim_compute_robot_state-npc1_min	0.05817705392837525
sim_compute_robot_state-npc2_max	0.07609791755676269
sim_compute_robot_state-npc2_mean	0.06856195094920645
sim_compute_robot_state-npc2_median	0.07005714245562283
sim_compute_robot_state-npc2_min	0.05690686901410421
sim_compute_robot_state-npc3_max	0.07542322874069214
sim_compute_robot_state-npc3_mean	0.06697763989747123
sim_compute_robot_state-npc3_median	0.06682008167482772
sim_compute_robot_state-npc3_min	0.05618107318878174
sim_compute_sim_state_max	0.04171244168685655
sim_compute_sim_state_mean	0.038722146418465435
sim_compute_sim_state_median	0.03955344883900768
sim_compute_sim_state_min	0.03286717335383097
sim_physics_max	0.187640392174155
sim_physics_mean	0.1696125584890969
sim_physics_median	0.1790028675547186
sim_physics_min	0.122979203859965
sim_render-ego_max	0.06970834732055664
sim_render-ego_mean	0.06217983087399483
sim_render-ego_median	0.06248341980627028
sim_render-ego_min	0.05449701348940531
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20430

2645

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 13:00:20+00:00

2019-04-25 13:09:22+00:00

0:09:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3868568300517894
survival_time_median	2.5999999999999988
deviation-center-line_median	0.15225004755568958
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.095070807557357
agent_compute-ego_mean	0.07254973107468225
agent_compute-ego_median	0.06834364820409704
agent_compute-ego_min	0.0616524311212393
deviation-center-line_max	0.2226582868882649
deviation-center-line_mean	0.14955415747516515
deviation-center-line_min	0.07892312124490847
deviation-heading_max	0.6459861795320978
deviation-heading_mean	0.4218478130160275
deviation-heading_median	0.4137732464571467
deviation-heading_min	0.27336376225758874
driven_any_max	1.055875722117673
driven_any_mean	0.6977105716937329
driven_any_median	0.7159098475930167
driven_any_min	0.3467630612192843
driven_lanedir_consec_max	0.7088980300052077
driven_lanedir_consec_mean	0.48067012473886733
driven_lanedir_consec_min	0.32585193632314957
driven_lanedir_max	0.7088980300052077
driven_lanedir_mean	0.48067012473886733
driven_lanedir_median	0.3868568300517894
driven_lanedir_min	0.32585193632314957
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.6799999999999977
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.21388658410624453, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.07809746265411377, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.095070807557357, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.13967945387488917, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.04978140718058536, "sim_compute_performance-ego": 0.09182804822921752, "sim_compute_robot_state-ego": 0.10678618205221076, "sim_compute_robot_state-npc0": 0.08846340995085866, "sim_compute_robot_state-npc1": 0.08938740742833991, "sim_compute_robot_state-npc2": 0.09165769188027632, "sim_compute_robot_state-npc3": 0.09228130390769557}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3784135552892568, "sim_physics": 0.15615512430667877, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3420775634537585, "sim_render-ego": 0.059764690697193146, "in-drivable-lane": 0, "agent_compute-ego": 0.06831979751586914, "deviation-heading": 0.6459861795320978, "set_robot_commands": 0.09314531832933426, "deviation-center-line": 0.10981437189709492, "driven_lanedir_consec": 0.3420775634537585, "sim_compute_sim_state": 0.03789908438920975, "sim_compute_performance-ego": 0.06423299014568329, "sim_compute_robot_state-ego": 0.07505052536725998, "sim_compute_robot_state-npc0": 0.0666472315788269, "sim_compute_robot_state-npc1": 0.06868182122707367, "sim_compute_robot_state-npc2": 0.07028608024120331, "sim_compute_robot_state-npc3": 0.06806658208370209}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7159098475930167, "sim_physics": 0.1604068004167997, "survival_time": 2.5999999999999988, "driven_lanedir": 0.7088980300052077, "sim_render-ego": 0.0630235167650076, "in-drivable-lane": 0, "agent_compute-ego": 0.06936197097484882, "deviation-heading": 0.27336376225758874, "set_robot_commands": 0.09498011607390185, "deviation-center-line": 0.2226582868882649, "driven_lanedir_consec": 0.7088980300052077, "sim_compute_sim_state": 0.04035466909408569, "sim_compute_performance-ego": 0.06642548854534443, "sim_compute_robot_state-ego": 0.07279937542401828, "sim_compute_robot_state-npc0": 0.06844236300541805, "sim_compute_robot_state-npc1": 0.07210812201866737, "sim_compute_robot_state-npc2": 0.0673480171423692, "sim_compute_robot_state-npc3": 0.07065401627467228}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.055875722117673, "sim_physics": 0.1332325904797285, "survival_time": 3.899999999999994, "driven_lanedir": 0.6396662638604318, "sim_render-ego": 0.057873022861969776, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.0616524311212393, "deviation-heading": 0.4978669142965758, "set_robot_commands": 0.08038422083243346, "deviation-center-line": 0.15225004755568958, "driven_lanedir_consec": 0.6396662638604318, "sim_compute_sim_state": 0.035271754631629355, "sim_compute_performance-ego": 0.060411728345430814, "sim_compute_robot_state-ego": 0.06302151924524552, "sim_compute_robot_state-npc0": 0.057984462151160605, "sim_compute_robot_state-npc1": 0.059910914836785734, "sim_compute_robot_state-npc2": 0.05975184379479824, "sim_compute_robot_state-npc3": 0.059215230819506526}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3467630612192843, "sim_physics": 0.1423817299030445, "survival_time": 1.3500000000000003, "driven_lanedir": 0.32585193632314957, "sim_render-ego": 0.061706869690506545, "in-drivable-lane": 0, "agent_compute-ego": 0.06834364820409704, "deviation-heading": 0.4137732464571467, "set_robot_commands": 0.09536818221763328, "deviation-center-line": 0.07892312124490847, "driven_lanedir_consec": 0.32585193632314957, "sim_compute_sim_state": 0.04005719997264721, "sim_compute_performance-ego": 0.06950807571411133, "sim_compute_robot_state-ego": 0.07331449014169199, "sim_compute_robot_state-npc0": 0.07171635274533872, "sim_compute_robot_state-npc1": 0.07188397866708261, "sim_compute_robot_state-npc2": 0.07189853103072555, "sim_compute_robot_state-npc3": 0.070576720767551}}
set_robot_commands_max	0.13967945387488917
set_robot_commands_mean	0.1007114582656384
set_robot_commands_median	0.09498011607390185
set_robot_commands_min	0.08038422083243346
sim_compute_performance-ego_max	0.09182804822921752
sim_compute_performance-ego_mean	0.07048126619595747
sim_compute_performance-ego_median	0.06642548854534443
sim_compute_performance-ego_min	0.060411728345430814
sim_compute_robot_state-ego_max	0.10678618205221076
sim_compute_robot_state-ego_mean	0.0781944184460853
sim_compute_robot_state-ego_median	0.07331449014169199
sim_compute_robot_state-ego_min	0.06302151924524552
sim_compute_robot_state-npc0_max	0.08846340995085866
sim_compute_robot_state-npc0_mean	0.07065076388632059
sim_compute_robot_state-npc0_median	0.06844236300541805
sim_compute_robot_state-npc0_min	0.057984462151160605
sim_compute_robot_state-npc1_max	0.08938740742833991
sim_compute_robot_state-npc1_mean	0.07239444883558985
sim_compute_robot_state-npc1_median	0.07188397866708261
sim_compute_robot_state-npc1_min	0.059910914836785734
sim_compute_robot_state-npc2_max	0.09165769188027632
sim_compute_robot_state-npc2_mean	0.07218843281787453
sim_compute_robot_state-npc2_median	0.07028608024120331
sim_compute_robot_state-npc2_min	0.05975184379479824
sim_compute_robot_state-npc3_max	0.09228130390769557
sim_compute_robot_state-npc3_mean	0.07215877077062549
sim_compute_robot_state-npc3_median	0.070576720767551
sim_compute_robot_state-npc3_min	0.059215230819506526
sim_compute_sim_state_max	0.04978140718058536
sim_compute_sim_state_mean	0.04067282305363147
sim_compute_sim_state_median	0.04005719997264721
sim_compute_sim_state_min	0.035271754631629355
sim_physics_max	0.21388658410624453
sim_physics_mean	0.16121256584249918
sim_physics_median	0.15615512430667877
sim_physics_min	0.1332325904797285
sim_render-ego_max	0.07809746265411377
sim_render-ego_mean	0.06409311253375817
sim_render-ego_median	0.061706869690506545
sim_render-ego_min	0.057873022861969776
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.6499999999999977
survival_time_min	1.3500000000000003

No reset possible

20418

2657

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 12:51:36+00:00

2019-04-25 13:00:06+00:00

0:08:30

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20418-81689', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20418-81689', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20418-81689', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20408

2653

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:34:21+00:00

2019-04-25 12:51:02+00:00

0:16:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.43243009235577506
survival_time_median	7.099999999999983
deviation-center-line_median	0.3634806585093071
in-drivable-lane_median	2.799999999999995

other stats

agent_compute-ego_max	0.08863588454018176
agent_compute-ego_mean	0.08535422176506127
agent_compute-ego_median	0.08805848060011053
agent_compute-ego_min	0.07379658598648875
deviation-center-line_max	0.6165665912558665
deviation-center-line_mean	0.4186864538379061
deviation-center-line_min	0.19357724054543257
deviation-heading_max	5.413340008479595
deviation-heading_mean	3.0395021855336157
deviation-heading_median	3.02982598027934
deviation-heading_min	0.5559898270782777
driven_any_max	2.332810153879798
driven_any_mean	1.3312819368797852
driven_any_median	1.0870397734403747
driven_any_min	0.4042415011941754
driven_lanedir_consec_max	0.8942674680273544
driven_lanedir_consec_mean	0.5172318806332707
driven_lanedir_consec_min	0.3163148993328795
driven_lanedir_max	0.942139425811722
driven_lanedir_mean	0.6132439903944118
driven_lanedir_median	0.5178302012457618
driven_lanedir_min	0.3163148993328795
in-drivable-lane_max	7.050000000000035
in-drivable-lane_mean	3.220000000000012
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.332810153879798, "sim_physics": 0.151802663008372, "survival_time": 14.950000000000076, "driven_lanedir": 0.8575053332259208, "sim_render-ego": 0.07154132922490437, "in-drivable-lane": 7.050000000000035, "agent_compute-ego": 0.0879672900835673, "deviation-heading": 4.789155509378045, "set_robot_commands": 0.11422930637995402, "deviation-center-line": 0.6092223734873606, "driven_lanedir_consec": 0.4253167422045827, "sim_compute_sim_state": 0.04399826208750407, "sim_compute_performance-ego": 0.08089319229125977, "sim_compute_robot_state-ego": 0.09186344782511394}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0870397734403747, "sim_physics": 0.1392860043216759, "survival_time": 7.099999999999983, "driven_lanedir": 0.43243009235577506, "sim_render-ego": 0.0727785909679574, "in-drivable-lane": 2.799999999999995, "agent_compute-ego": 0.08863588454018176, "deviation-heading": 3.02982598027934, "set_robot_commands": 0.11324574913777095, "deviation-center-line": 0.31058540539156354, "driven_lanedir_consec": 0.43243009235577506, "sim_compute_sim_state": 0.043501281402480434, "sim_compute_performance-ego": 0.07872715130658217, "sim_compute_robot_state-ego": 0.09025506738206032}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5248375768472434, "sim_physics": 0.12454550796084934, "survival_time": 3.599999999999995, "driven_lanedir": 0.5178302012457618, "sim_render-ego": 0.0687789155377282, "in-drivable-lane": 0, "agent_compute-ego": 0.08831286761495802, "deviation-heading": 0.5559898270782777, "set_robot_commands": 0.11143142647213404, "deviation-center-line": 0.3634806585093071, "driven_lanedir_consec": 0.5178302012457618, "sim_compute_sim_state": 0.045268499188952975, "sim_compute_performance-ego": 0.0801824861102634, "sim_compute_robot_state-ego": 0.09467417332861158}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.307480679037334, "sim_physics": 0.16217728212577143, "survival_time": 14.700000000000074, "driven_lanedir": 0.942139425811722, "sim_render-ego": 0.07242819565494045, "in-drivable-lane": 6.250000000000032, "agent_compute-ego": 0.08805848060011053, "deviation-heading": 5.413340008479595, "set_robot_commands": 0.11439608878829852, "deviation-center-line": 0.6165665912558665, "driven_lanedir_consec": 0.8942674680273544, "sim_compute_sim_state": 0.0438968851452782, "sim_compute_performance-ego": 0.07959512301853724, "sim_compute_robot_state-ego": 0.0867586833279149}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4042415011941754, "sim_physics": 0.09707341277808472, "survival_time": 2.849999999999998, "driven_lanedir": 0.3163148993328795, "sim_render-ego": 0.05622910616690653, "in-drivable-lane": 0, "agent_compute-ego": 0.07379658598648875, "deviation-heading": 1.4091996024528206, "set_robot_commands": 0.0922980643155282, "deviation-center-line": 0.19357724054543257, "driven_lanedir_consec": 0.3163148993328795, "sim_compute_sim_state": 0.03628271086174145, "sim_compute_performance-ego": 0.06405350199916907, "sim_compute_robot_state-ego": 0.07089059812980786}}
set_robot_commands_max	0.11439608878829852
set_robot_commands_mean	0.10912012701873716
set_robot_commands_median	0.11324574913777095
set_robot_commands_min	0.0922980643155282
sim_compute_performance-ego_max	0.08089319229125977
sim_compute_performance-ego_mean	0.07669029094516233
sim_compute_performance-ego_median	0.07959512301853724
sim_compute_performance-ego_min	0.06405350199916907
sim_compute_robot_state-ego_max	0.09467417332861158
sim_compute_robot_state-ego_mean	0.08688839399870173
sim_compute_robot_state-ego_median	0.09025506738206032
sim_compute_robot_state-ego_min	0.07089059812980786
sim_compute_sim_state_max	0.045268499188952975
sim_compute_sim_state_mean	0.04258952773719143
sim_compute_sim_state_median	0.0438968851452782
sim_compute_sim_state_min	0.03628271086174145
sim_physics_max	0.16217728212577143
sim_physics_mean	0.13497697403895068
sim_physics_median	0.1392860043216759
sim_physics_min	0.09707341277808472
sim_render-ego_max	0.0727785909679574
sim_render-ego_mean	0.06835122751048739
sim_render-ego_median	0.07154132922490437
sim_render-ego_min	0.05622910616690653
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.640000000000025
survival_time_min	2.849999999999998

No reset possible

20398

2703

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:20:00+00:00

2019-04-25 12:33:42+00:00

0:13:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4555211069439853
survival_time_median	4.549999999999992
deviation-center-line_median	0.4768417534841044
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.09573637522183932
agent_compute-ego_mean	0.09174396489835827
agent_compute-ego_median	0.09147010066292505
agent_compute-ego_min	0.08904292976971968
deviation-center-line_max	0.6437032739980839
deviation-center-line_mean	0.4513519137782781
deviation-center-line_min	0.15806948144155783
deviation-heading_max	3.97504845522585
deviation-heading_mean	2.094855862238253
deviation-heading_median	2.140428218471292
deviation-heading_min	0.6762930640182848
driven_any_max	1.6012953289998848
driven_any_mean	0.9652868910554516
driven_any_median	0.6773701094097543
driven_any_min	0.3882076239572083
driven_lanedir_consec_max	1.4155263195668215
driven_lanedir_consec_mean	0.59776671182112
driven_lanedir_consec_min	0.17769615674301065
driven_lanedir_max	1.4155263195668215
driven_lanedir_mean	0.693955318166092
driven_lanedir_median	0.6273711152257566
driven_lanedir_min	0.3127188606260254
in-drivable-lane_max	3.6000000000000236
in-drivable-lane_mean	0.9300000000000044
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.522213658993253, "sim_physics": 0.13875392711523807, "survival_time": 9.900000000000006, "driven_lanedir": 1.4155263195668215, "sim_render-ego": 0.06994577610131467, "in-drivable-lane": 0, "agent_compute-ego": 0.09147010066292505, "deviation-heading": 2.480442055333905, "set_robot_commands": 0.11729631520280934, "deviation-center-line": 0.6394289164809781, "driven_lanedir_consec": 1.4155263195668215, "sim_compute_sim_state": 0.043167823492878614, "sim_compute_performance-ego": 0.07934195947165441, "sim_compute_robot_state-ego": 0.08546428487758444}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6773701094097543, "sim_physics": 0.12600258680490348, "survival_time": 4.549999999999992, "driven_lanedir": 0.35529948955633833, "sim_render-ego": 0.07011801331907838, "in-drivable-lane": 1.0499999999999978, "agent_compute-ego": 0.09573637522183932, "deviation-heading": 2.140428218471292, "set_robot_commands": 0.11749393599373954, "deviation-center-line": 0.33871614348666634, "driven_lanedir_consec": 0.17769615674301065, "sim_compute_sim_state": 0.045331784657069614, "sim_compute_performance-ego": 0.08080525450654082, "sim_compute_robot_state-ego": 0.09121183248666616}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6373477339171588, "sim_physics": 0.11577737608621289, "survival_time": 4.299999999999993, "driven_lanedir": 0.6273711152257566, "sim_render-ego": 0.07156632944594982, "in-drivable-lane": 0, "agent_compute-ego": 0.09275973674862883, "deviation-heading": 0.6762930640182848, "set_robot_commands": 0.1155245581338572, "deviation-center-line": 0.4768417534841044, "driven_lanedir_consec": 0.6273711152257566, "sim_compute_sim_state": 0.04562702844309252, "sim_compute_performance-ego": 0.08140020592268123, "sim_compute_robot_state-ego": 0.08873035741406818}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6012953289998848, "sim_physics": 0.1501021836567851, "survival_time": 10.300000000000011, "driven_lanedir": 0.7588608058555177, "sim_render-ego": 0.07080796042692314, "in-drivable-lane": 3.6000000000000236, "agent_compute-ego": 0.08904292976971968, "deviation-heading": 3.97504845522585, "set_robot_commands": 0.11511197946604015, "deviation-center-line": 0.6437032739980839, "driven_lanedir_consec": 0.4555211069439853, "sim_compute_sim_state": 0.04429158655185144, "sim_compute_performance-ego": 0.08110088052101505, "sim_compute_robot_state-ego": 0.09171673858050004}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3882076239572083, "sim_physics": 0.09656363400545988, "survival_time": 2.7499999999999982, "driven_lanedir": 0.3127188606260254, "sim_render-ego": 0.0624042424288663, "in-drivable-lane": 0, "agent_compute-ego": 0.08971068208867854, "deviation-heading": 1.202067518141933, "set_robot_commands": 0.09718535163185814, "deviation-center-line": 0.15806948144155783, "driven_lanedir_consec": 0.3127188606260254, "sim_compute_sim_state": 0.03962900855324485, "sim_compute_performance-ego": 0.07160218845714222, "sim_compute_robot_state-ego": 0.07041106224060059}}
set_robot_commands_max	0.11749393599373954
set_robot_commands_mean	0.11252242808566087
set_robot_commands_median	0.1155245581338572
set_robot_commands_min	0.09718535163185814
sim_compute_performance-ego_max	0.08140020592268123
sim_compute_performance-ego_mean	0.07885009777580675
sim_compute_performance-ego_median	0.08080525450654082
sim_compute_performance-ego_min	0.07160218845714222
sim_compute_robot_state-ego_max	0.09171673858050004
sim_compute_robot_state-ego_mean	0.0855068551198839
sim_compute_robot_state-ego_median	0.08873035741406818
sim_compute_robot_state-ego_min	0.07041106224060059
sim_compute_sim_state_max	0.04562702844309252
sim_compute_sim_state_mean	0.04360944633962741
sim_compute_sim_state_median	0.04429158655185144
sim_compute_sim_state_min	0.03962900855324485
sim_physics_max	0.1501021836567851
sim_physics_mean	0.12543994153371987
sim_physics_median	0.12600258680490348
sim_physics_min	0.09656363400545988
sim_render-ego_max	0.07156632944594982
sim_render-ego_mean	0.06896846434442647
sim_render-ego_median	0.07011801331907838
sim_render-ego_min	0.0624042424288663
simulation-passed	1
survival_time_max	10.300000000000011
survival_time_mean	6.359999999999999
survival_time_min	2.7499999999999982

No reset possible

20379

2680

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:00:15+00:00

2019-04-25 12:19:53+00:00

0:19:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3440505760376964
survival_time_median	3.899999999999994
deviation-center-line_median	0.3085364058559797
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08848207705729716
agent_compute-ego_mean	0.08770285211385874
agent_compute-ego_median	0.08785079255958513
agent_compute-ego_min	0.08662193530314677
deviation-center-line_max	0.5859752827064052
deviation-center-line_mean	0.3210584436700906
deviation-center-line_min	0.1574949472636814
deviation-heading_max	4.478739159985982
deviation-heading_mean	2.035514342555811
deviation-heading_median	0.6448162459336365
deviation-heading_min	0.4301825418671719
driven_any_max	2.2277789111247226
driven_any_mean	0.9217952672550924
driven_any_median	0.5730599972430763
driven_any_min	0.2435692407037807
driven_lanedir_consec_max	0.8608856031053993
driven_lanedir_consec_mean	0.4465205894840903
driven_lanedir_consec_min	0.23170034362748515
driven_lanedir_max	0.8608856031053993
driven_lanedir_mean	0.5098077707474195
driven_lanedir_median	0.563856255352441
driven_lanedir_min	0.23170034362748515
in-drivable-lane_max	7.900000000000048
in-drivable-lane_mean	1.8200000000000087
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3209985150904526, "sim_physics": 0.216126488812397, "survival_time": 8.649999999999988, "driven_lanedir": 0.8608856031053993, "sim_render-ego": 0.07027095452898499, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.08785079255958513, "deviation-heading": 4.184649242180787, "set_robot_commands": 0.11452833489875572, "deviation-center-line": 0.5859752827064052, "driven_lanedir_consec": 0.8608856031053993, "sim_compute_sim_state": 0.04469787454329474, "sim_compute_performance-ego": 0.07913829963331277, "sim_compute_robot_state-ego": 0.08833079117570998, "sim_compute_robot_state-npc0": 0.07781751720891522, "sim_compute_robot_state-npc1": 0.0790303621677994, "sim_compute_robot_state-npc2": 0.07878403994389352, "sim_compute_robot_state-npc3": 0.07903153496670585}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2277789111247226, "sim_physics": 0.22744408375780348, "survival_time": 14.200000000000069, "driven_lanedir": 0.6604864823543424, "sim_render-ego": 0.07163828611373901, "in-drivable-lane": 7.900000000000048, "agent_compute-ego": 0.08769050534342376, "deviation-heading": 4.478739159985982, "set_robot_commands": 0.11461777754232916, "deviation-center-line": 0.3932099760433071, "driven_lanedir_consec": 0.3440505760376964, "sim_compute_sim_state": 0.04496409439704788, "sim_compute_performance-ego": 0.08165973844662519, "sim_compute_robot_state-ego": 0.09079004593298468, "sim_compute_robot_state-npc0": 0.07909114595869897, "sim_compute_robot_state-npc1": 0.07958734958944186, "sim_compute_robot_state-npc2": 0.08000216013948683, "sim_compute_robot_state-npc3": 0.0792798744121068}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24356967211342956, "sim_physics": 0.20235037803649905, "survival_time": 1.850000000000001, "driven_lanedir": 0.23170034362748515, "sim_render-ego": 0.07134929863182274, "in-drivable-lane": 0, "agent_compute-ego": 0.08848207705729716, "deviation-heading": 0.4391845228114776, "set_robot_commands": 0.11714803205954062, "deviation-center-line": 0.16007560648108005, "driven_lanedir_consec": 0.23170034362748515, "sim_compute_sim_state": 0.0473457349313272, "sim_compute_performance-ego": 0.07880436407553183, "sim_compute_robot_state-ego": 0.08173889082831305, "sim_compute_robot_state-npc0": 0.08148555497865419, "sim_compute_robot_state-npc1": 0.09152960132908176, "sim_compute_robot_state-npc2": 0.08092498779296875, "sim_compute_robot_state-npc3": 0.0801737437377105}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2435692407037807, "sim_physics": 0.2056248832393337, "survival_time": 1.850000000000001, "driven_lanedir": 0.23211016929742945, "sim_render-ego": 0.0743041940637537, "in-drivable-lane": 0, "agent_compute-ego": 0.08662193530314677, "deviation-heading": 0.4301825418671719, "set_robot_commands": 0.11706586141844054, "deviation-center-line": 0.1574949472636814, "driven_lanedir_consec": 0.23211016929742945, "sim_compute_sim_state": 0.04639974800316063, "sim_compute_performance-ego": 0.07849577955297522, "sim_compute_robot_state-ego": 0.08245811591277251, "sim_compute_robot_state-npc0": 0.07686478382832296, "sim_compute_robot_state-npc1": 0.07666611671447754, "sim_compute_robot_state-npc2": 0.07789835414370976, "sim_compute_robot_state-npc3": 0.07746363974906303}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5730599972430763, "sim_physics": 0.17599191421117538, "survival_time": 3.899999999999994, "driven_lanedir": 0.563856255352441, "sim_render-ego": 0.07242219570355538, "in-drivable-lane": 0, "agent_compute-ego": 0.08786895030584091, "deviation-heading": 0.6448162459336365, "set_robot_commands": 0.11643386498475686, "deviation-center-line": 0.3085364058559797, "driven_lanedir_consec": 0.563856255352441, "sim_compute_sim_state": 0.04839789867401123, "sim_compute_performance-ego": 0.08092368566072904, "sim_compute_robot_state-ego": 0.09112039590493226, "sim_compute_robot_state-npc0": 0.08564393948286007, "sim_compute_robot_state-npc1": 0.08176817955114903, "sim_compute_robot_state-npc2": 0.0829311395302797, "sim_compute_robot_state-npc3": 0.0838000224186824}}
set_robot_commands_max	0.11714803205954062
set_robot_commands_mean	0.11595877418076458
set_robot_commands_median	0.11643386498475686
set_robot_commands_min	0.11452833489875572
sim_compute_performance-ego_max	0.08165973844662519
sim_compute_performance-ego_mean	0.07980437347383482
sim_compute_performance-ego_median	0.07913829963331277
sim_compute_performance-ego_min	0.07849577955297522
sim_compute_robot_state-ego_max	0.09112039590493226
sim_compute_robot_state-ego_mean	0.0868876479509425
sim_compute_robot_state-ego_median	0.08833079117570998
sim_compute_robot_state-ego_min	0.08173889082831305
sim_compute_robot_state-npc0_max	0.08564393948286007
sim_compute_robot_state-npc0_mean	0.08018058829149029
sim_compute_robot_state-npc0_median	0.07909114595869897
sim_compute_robot_state-npc0_min	0.07686478382832296
sim_compute_robot_state-npc1_max	0.09152960132908176
sim_compute_robot_state-npc1_mean	0.08171632187038992
sim_compute_robot_state-npc1_median	0.07958734958944186
sim_compute_robot_state-npc1_min	0.07666611671447754
sim_compute_robot_state-npc2_max	0.0829311395302797
sim_compute_robot_state-npc2_mean	0.08010813631006772
sim_compute_robot_state-npc2_median	0.08000216013948683
sim_compute_robot_state-npc2_min	0.07789835414370976
sim_compute_robot_state-npc3_max	0.0838000224186824
sim_compute_robot_state-npc3_mean	0.07994976305685372
sim_compute_robot_state-npc3_median	0.0792798744121068
sim_compute_robot_state-npc3_min	0.07746363974906303
sim_compute_sim_state_max	0.04839789867401123
sim_compute_sim_state_mean	0.04636107010976834
sim_compute_sim_state_median	0.04639974800316063
sim_compute_sim_state_min	0.04469787454329474
sim_physics_max	0.22744408375780348
sim_physics_mean	0.20550754961144171
sim_physics_median	0.2056248832393337
sim_physics_min	0.17599191421117538
sim_render-ego_max	0.0743041940637537
sim_render-ego_mean	0.07199698580837118
sim_render-ego_median	0.07163828611373901
sim_render-ego_min	0.07027095452898499
simulation-passed	1
survival_time_max	14.200000000000069
survival_time_mean	6.0900000000000105
survival_time_min	1.850000000000001

No reset possible

20373

2695

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:55:57+00:00

2019-04-25 12:00:08+00:00

0:04:11

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20373-981044', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20373-981044', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20373-981044', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20367

2715

test for ppo

step1-simulation

error

2019-04-25 11:54:48+00:00

2019-04-25 11:55:50+00:00

0:01:02

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20364

2720

test for ppo

step1-simulation

error

2019-04-25 11:53:45+00:00

2019-04-25 11:54:34+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20333

2770

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 11:37:00+00:00

2019-04-25 11:53:39+00:00

0:16:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5705203784612595
survival_time_median	5.399999999999989
deviation-center-line_median	0.326832877056509
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.09425094171806618
agent_compute-ego_mean	0.08305522498422506
agent_compute-ego_median	0.08941042502721151
agent_compute-ego_min	0.06707627853650726
deviation-center-line_max	1.0980825621180388
deviation-center-line_mean	0.5121451389736389
deviation-center-line_min	0.2590994975558414
deviation-heading_max	7.189772193033789
deviation-heading_mean	3.251785975156115
deviation-heading_median	2.5528721543502737
deviation-heading_min	0.6977572884141978
driven_any_max	2.348368207403012
driven_any_mean	1.1581605605518352
driven_any_median	0.8075950259340253
driven_any_min	0.5810966888278278
driven_lanedir_consec_max	0.9034797041246588
driven_lanedir_consec_mean	0.6110156262231354
driven_lanedir_consec_min	0.4505094023787683
driven_lanedir_max	1.342803893447554
driven_lanedir_mean	0.7332673613522087
driven_lanedir_median	0.6504216656964326
driven_lanedir_min	0.4505094023787683
in-drivable-lane_max	3.300000000000013
in-drivable-lane_mean	1.3700000000000012
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8075950259340253, "sim_physics": 0.1698051139160439, "survival_time": 5.399999999999989, "driven_lanedir": 0.6504216656964326, "sim_render-ego": 0.06249103722748933, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.09425094171806618, "deviation-heading": 2.133317976967082, "set_robot_commands": 0.09569029675589669, "deviation-center-line": 0.3265671050080293, "driven_lanedir_consec": 0.6504216656964326, "sim_compute_sim_state": 0.04003277752134535, "sim_compute_performance-ego": 0.07027917217325282, "sim_compute_robot_state-ego": 0.0735899872250027, "sim_compute_robot_state-npc0": 0.07061761176144635, "sim_compute_robot_state-npc1": 0.06945227472870438, "sim_compute_robot_state-npc2": 0.0704038209385342, "sim_compute_robot_state-npc3": 0.06936876420621518}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6613504285906531, "sim_physics": 0.112068363789762, "survival_time": 4.449999999999992, "driven_lanedir": 0.4505094023787683, "sim_render-ego": 0.04704124204228433, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06707627853650726, "deviation-heading": 2.5528721543502737, "set_robot_commands": 0.07048984859766586, "deviation-center-line": 0.2590994975558414, "driven_lanedir_consec": 0.4505094023787683, "sim_compute_sim_state": 0.028093072805511817, "sim_compute_performance-ego": 0.05043480369482148, "sim_compute_robot_state-ego": 0.053326188848259744, "sim_compute_robot_state-npc0": 0.05178442965732532, "sim_compute_robot_state-npc1": 0.05093204305413064, "sim_compute_robot_state-npc2": 0.05062897285718596, "sim_compute_robot_state-npc3": 0.051632246274626654}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3923924520036586, "sim_physics": 0.17613677581151327, "survival_time": 8.999999999999993, "driven_lanedir": 0.6520814667770289, "sim_render-ego": 0.0636879391140408, "in-drivable-lane": 2.9999999999999947, "agent_compute-ego": 0.09267656670676336, "deviation-heading": 3.685210263015233, "set_robot_commands": 0.10033386018541124, "deviation-center-line": 0.5501436531297761, "driven_lanedir_consec": 0.4801469804545579, "sim_compute_sim_state": 0.03934699959225125, "sim_compute_performance-ego": 0.06883912218941582, "sim_compute_robot_state-ego": 0.07594822380277845, "sim_compute_robot_state-npc0": 0.07128093242645264, "sim_compute_robot_state-npc1": 0.07011814647250705, "sim_compute_robot_state-npc2": 0.06949010690053305, "sim_compute_robot_state-npc3": 0.06999072233835855}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348368207403012, "sim_physics": 0.1753552460670471, "survival_time": 14.950000000000076, "driven_lanedir": 1.342803893447554, "sim_render-ego": 0.057675459384918214, "in-drivable-lane": 3.300000000000013, "agent_compute-ego": 0.08941042502721151, "deviation-heading": 7.189772193033789, "set_robot_commands": 0.09065205653508504, "deviation-center-line": 1.0980825621180388, "driven_lanedir_consec": 0.9034797041246588, "sim_compute_sim_state": 0.03675571441650391, "sim_compute_performance-ego": 0.06554767926534016, "sim_compute_robot_state-ego": 0.07039424737294515, "sim_compute_robot_state-npc0": 0.06606099367141724, "sim_compute_robot_state-npc1": 0.0649619476000468, "sim_compute_robot_state-npc2": 0.06556454579035441, "sim_compute_robot_state-npc3": 0.06503455718358357}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5810966888278278, "sim_physics": 0.10783300218702872, "survival_time": 3.949999999999994, "driven_lanedir": 0.5705203784612595, "sim_render-ego": 0.04761641236800182, "in-drivable-lane": 0, "agent_compute-ego": 0.07186191293257702, "deviation-heading": 0.6977572884141978, "set_robot_commands": 0.0741860655289662, "deviation-center-line": 0.326832877056509, "driven_lanedir_consec": 0.5705203784612595, "sim_compute_sim_state": 0.028543885750106617, "sim_compute_performance-ego": 0.05311323419401917, "sim_compute_robot_state-ego": 0.0547511758683603, "sim_compute_robot_state-npc0": 0.06074327155004574, "sim_compute_robot_state-npc1": 0.05157432676870611, "sim_compute_robot_state-npc2": 0.052051553243323216, "sim_compute_robot_state-npc3": 0.05276019965546041}}
set_robot_commands_max	0.10033386018541124
set_robot_commands_mean	0.086270425520605
set_robot_commands_median	0.09065205653508504
set_robot_commands_min	0.07048984859766586
sim_compute_performance-ego_max	0.07027917217325282
sim_compute_performance-ego_mean	0.061642802303369895
sim_compute_performance-ego_median	0.06554767926534016
sim_compute_performance-ego_min	0.05043480369482148
sim_compute_robot_state-ego_max	0.07594822380277845
sim_compute_robot_state-ego_mean	0.06560196462346926
sim_compute_robot_state-ego_median	0.07039424737294515
sim_compute_robot_state-ego_min	0.053326188848259744
sim_compute_robot_state-npc0_max	0.07128093242645264
sim_compute_robot_state-npc0_mean	0.06409744781333745
sim_compute_robot_state-npc0_median	0.06606099367141724
sim_compute_robot_state-npc0_min	0.05178442965732532
sim_compute_robot_state-npc1_max	0.07011814647250705
sim_compute_robot_state-npc1_mean	0.061407747724818995
sim_compute_robot_state-npc1_median	0.0649619476000468
sim_compute_robot_state-npc1_min	0.05093204305413064
sim_compute_robot_state-npc2_max	0.0704038209385342
sim_compute_robot_state-npc2_mean	0.061627799945986175
sim_compute_robot_state-npc2_median	0.06556454579035441
sim_compute_robot_state-npc2_min	0.05062897285718596
sim_compute_robot_state-npc3_max	0.06999072233835855
sim_compute_robot_state-npc3_mean	0.06175729793164888
sim_compute_robot_state-npc3_median	0.06503455718358357
sim_compute_robot_state-npc3_min	0.051632246274626654
sim_compute_sim_state_max	0.04003277752134535
sim_compute_sim_state_mean	0.03455449001714379
sim_compute_sim_state_median	0.03675571441650391
sim_compute_sim_state_min	0.028093072805511817
sim_physics_max	0.17613677581151327
sim_physics_mean	0.148239700354279
sim_physics_median	0.1698051139160439
sim_physics_min	0.10783300218702872
sim_render-ego_max	0.0636879391140408
sim_render-ego_mean	0.0557024180273469
sim_render-ego_median	0.057675459384918214
sim_render-ego_min	0.04704124204228433
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.55000000000001
survival_time_min	3.949999999999994

No reset possible

20329

2782

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 11:36:11+00:00

2019-04-25 11:36:46+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20322

2795

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 11:33:53+00:00

2019-04-25 11:35:46+00:00

0:01:53

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20315

2814

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:28:12+00:00

2019-04-25 11:33:38+00:00

0:05:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.16922765307956272
agent_compute-ego_mean	0.15384435600104823
agent_compute-ego_median	0.14970496015728646
agent_compute-ego_min	0.1396707663169274
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.09915208366681943, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06208470182598762, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.14970496015728646, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09622798775726894, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03976172321247605, "sim_compute_performance-ego": 0.08085171231683695, "sim_compute_robot_state-ego": 0.07558919798653081}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.09154264743511492, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.058820907886211686, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1396707663169274, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.0948105683693519, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.03723448056441087, "sim_compute_performance-ego": 0.06538937642024113, "sim_compute_robot_state-ego": 0.07088490632864144}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.08469565709431966, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06210894054836697, "in-drivable-lane": 0, "agent_compute-ego": 0.16922765307956272, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.10391321447160508, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.03955325815412733, "sim_compute_performance-ego": 0.06916489866044787, "sim_compute_robot_state-ego": 0.07717173629336888}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.10490254402160644, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.06816152572631835, "in-drivable-lane": 0, "agent_compute-ego": 0.16181405067443846, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.10568220138549804, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.04049515724182129, "sim_compute_performance-ego": 0.07229891777038575, "sim_compute_robot_state-ego": 0.08035508155822754}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.08003449745667286, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.058845981573447205, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.14880434977702606, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.087715439307384, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.036391677000583746, "sim_compute_performance-ego": 0.06294932732215294, "sim_compute_robot_state-ego": 0.0676662524541219}}
set_robot_commands_max	0.10568220138549804
set_robot_commands_mean	0.0976698822582216
set_robot_commands_median	0.09622798775726894
set_robot_commands_min	0.087715439307384
sim_compute_performance-ego_max	0.08085171231683695
sim_compute_performance-ego_mean	0.07013084649801293
sim_compute_performance-ego_median	0.06916489866044787
sim_compute_performance-ego_min	0.06294932732215294
sim_compute_robot_state-ego_max	0.08035508155822754
sim_compute_robot_state-ego_mean	0.07433343492417811
sim_compute_robot_state-ego_median	0.07558919798653081
sim_compute_robot_state-ego_min	0.0676662524541219
sim_compute_sim_state_max	0.04049515724182129
sim_compute_sim_state_mean	0.03868725923468386
sim_compute_sim_state_median	0.03955325815412733
sim_compute_sim_state_min	0.036391677000583746
sim_physics_max	0.10490254402160644
sim_physics_mean	0.09206548593490668
sim_physics_median	0.09154264743511492
sim_physics_min	0.08003449745667286
sim_render-ego_max	0.06816152572631835
sim_render-ego_mean	0.06200441151206637
sim_render-ego_median	0.06208470182598762
sim_render-ego_min	0.058820907886211686
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20287

2856

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 11:16:00+00:00

2019-04-25 11:27:49+00:00

0:11:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.32026437129432717
survival_time_median	4.99999999999999
deviation-center-line_median	0.22433152580807209
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.11094066789073329
agent_compute-ego_mean	0.0917657140161496
agent_compute-ego_median	0.09436016666645906
agent_compute-ego_min	0.07064934968948364
deviation-center-line_max	0.28295649373827414
deviation-center-line_mean	0.21137687058451632
deviation-center-line_min	0.14633562661848917
deviation-heading_max	1.9976275736960336
deviation-heading_mean	1.6239352181686797
deviation-heading_median	1.6323932747611385
deviation-heading_min	1.0267115515859992
driven_any_max	1.1712868657977291
driven_any_mean	0.49802967932853714
driven_any_median	0.37492233427138
driven_any_min	0.15794788594348075
driven_lanedir_consec_max	0.518506693994909
driven_lanedir_consec_mean	0.31706872701562994
driven_lanedir_consec_min	0.13523825379683796
driven_lanedir_max	0.518506693994909
driven_lanedir_mean	0.31706872701562994
driven_lanedir_median	0.32026437129432717
driven_lanedir_min	0.13523825379683796
in-drivable-lane_max	7.600000000000096
in-drivable-lane_mean	1.7100000000000186
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1712868657977291, "sim_physics": 0.13840338627497356, "survival_time": 14.950000000000076, "driven_lanedir": 0.518506693994909, "sim_render-ego": 0.06640582084655762, "in-drivable-lane": 7.600000000000096, "agent_compute-ego": 0.10805522918701171, "deviation-heading": 1.8935153417232644, "set_robot_commands": 0.1057717760403951, "deviation-center-line": 0.28295649373827414, "driven_lanedir_consec": 0.518506693994909, "sim_compute_sim_state": 0.0420454994837443, "sim_compute_performance-ego": 0.07562796036402385, "sim_compute_robot_state-ego": 0.08181436856587727}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22223067361211596, "sim_physics": 0.1060633005634431, "survival_time": 3.099999999999997, "driven_lanedir": 0.17194846362128724, "sim_render-ego": 0.06733611706764467, "in-drivable-lane": 0, "agent_compute-ego": 0.11094066789073329, "deviation-heading": 1.6323932747611385, "set_robot_commands": 0.10993984053211828, "deviation-center-line": 0.14633562661848917, "driven_lanedir_consec": 0.17194846362128724, "sim_compute_sim_state": 0.04232225110453944, "sim_compute_performance-ego": 0.0771867613638601, "sim_compute_robot_state-ego": 0.09199850789962276}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15794788594348075, "sim_physics": 0.07051235696543819, "survival_time": 2.3, "driven_lanedir": 0.13523825379683796, "sim_render-ego": 0.048645465270332665, "in-drivable-lane": 0, "agent_compute-ego": 0.07482315664706023, "deviation-heading": 1.0267115515859992, "set_robot_commands": 0.07626425183337668, "deviation-center-line": 0.22433152580807209, "driven_lanedir_consec": 0.13523825379683796, "sim_compute_sim_state": 0.031193106070808743, "sim_compute_performance-ego": 0.05474109753318455, "sim_compute_robot_state-ego": 0.056189987970435104}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.37492233427138, "sim_physics": 0.06486052513122559, "survival_time": 4.99999999999999, "driven_lanedir": 0.32026437129432717, "sim_render-ego": 0.04181670904159546, "in-drivable-lane": 0, "agent_compute-ego": 0.07064934968948364, "deviation-heading": 1.9976275736960336, "set_robot_commands": 0.06401082038879395, "deviation-center-line": 0.2380034890310394, "driven_lanedir_consec": 0.32026437129432717, "sim_compute_sim_state": 0.02721152067184448, "sim_compute_performance-ego": 0.05119004726409912, "sim_compute_robot_state-ego": 0.04822095155715942}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5637606370179798, "sim_physics": 0.10855822984864112, "survival_time": 7.349999999999982, "driven_lanedir": 0.4393858523707883, "sim_render-ego": 0.05911509358153051, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.09436016666645906, "deviation-heading": 1.5694283490769612, "set_robot_commands": 0.09389397238387542, "deviation-center-line": 0.16525721772670687, "driven_lanedir_consec": 0.4393858523707883, "sim_compute_sim_state": 0.03782362516234521, "sim_compute_performance-ego": 0.06849617860755142, "sim_compute_robot_state-ego": 0.07187948097177103}}
set_robot_commands_max	0.10993984053211828
set_robot_commands_mean	0.0899761322357119
set_robot_commands_median	0.09389397238387542
set_robot_commands_min	0.06401082038879395
sim_compute_performance-ego_max	0.0771867613638601
sim_compute_performance-ego_mean	0.06544840902654381
sim_compute_performance-ego_median	0.06849617860755142
sim_compute_performance-ego_min	0.05119004726409912
sim_compute_robot_state-ego_max	0.09199850789962276
sim_compute_robot_state-ego_mean	0.07002065939297313
sim_compute_robot_state-ego_median	0.07187948097177103
sim_compute_robot_state-ego_min	0.04822095155715942
sim_compute_sim_state_max	0.04232225110453944
sim_compute_sim_state_mean	0.03611920049865644
sim_compute_sim_state_median	0.03782362516234521
sim_compute_sim_state_min	0.02721152067184448
sim_physics_max	0.13840338627497356
sim_physics_mean	0.0976795597567443
sim_physics_median	0.1060633005634431
sim_physics_min	0.06486052513122559
sim_render-ego_max	0.06733611706764467
sim_render-ego_mean	0.05666384116153219
sim_render-ego_median	0.05911509358153051
sim_render-ego_min	0.04181670904159546
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.540000000000009
survival_time_min	2.3

No reset possible

20273

2866

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 11:00:22+00:00

2019-04-25 11:15:44+00:00

0:15:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.32026437129432717
survival_time_median	4.99999999999999
deviation-center-line_median	0.20648750117670708
in-drivable-lane_median	0.04999999999999982

other stats

agent_compute-ego_max	0.1093410942830196
agent_compute-ego_mean	0.09702158537872951
agent_compute-ego_median	0.09876211802164714
agent_compute-ego_min	0.07320263773895973
deviation-center-line_max	0.3162972756857362
deviation-center-line_mean	0.2109395381004365
deviation-center-line_min	0.12865220688199283
deviation-heading_max	2.2634094691667617
deviation-heading_mean	1.6854481654856168
deviation-heading_median	1.580725080955279
deviation-heading_min	1.016050354533049
driven_any_max	1.1712928874317865
driven_any_mean	0.4916013117841468
driven_any_median	0.37492233427138
driven_any_min	0.14589264208080518
driven_lanedir_consec_max	0.4902290427809377
driven_lanedir_consec_mean	0.30376597464712596
driven_lanedir_consec_min	0.12180941477814412
driven_lanedir_max	0.4902290427809377
driven_lanedir_mean	0.30376597464712596
driven_lanedir_median	0.32026437129432717
driven_lanedir_min	0.12180941477814412
in-drivable-lane_max	7.800000000000095
in-drivable-lane_mean	1.7600000000000182
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1712928874317865, "sim_physics": 0.12279395580291748, "survival_time": 14.950000000000076, "driven_lanedir": 0.4902290427809377, "sim_render-ego": 0.06139336188634237, "in-drivable-lane": 7.800000000000095, "agent_compute-ego": 0.09876211802164714, "deviation-heading": 2.2634094691667617, "set_robot_commands": 0.09909432570139567, "deviation-center-line": 0.3162972756857362, "driven_lanedir_consec": 0.4902290427809377, "sim_compute_sim_state": 0.03955795129140218, "sim_compute_performance-ego": 0.07037259737650553, "sim_compute_robot_state-ego": 0.0754185692469279}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2021380581187825, "sim_physics": 0.09134531439396372, "survival_time": 2.849999999999998, "driven_lanedir": 0.1471411920114325, "sim_render-ego": 0.05776843690035636, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.0956846371031644, "deviation-heading": 1.580725080955279, "set_robot_commands": 0.09088618713512756, "deviation-center-line": 0.12865220688199283, "driven_lanedir_consec": 0.1471411920114325, "sim_compute_sim_state": 0.0372224021376225, "sim_compute_performance-ego": 0.0652581767032021, "sim_compute_robot_state-ego": 0.06861186445805065}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14589264208080518, "sim_physics": 0.06996194151944893, "survival_time": 2.1500000000000004, "driven_lanedir": 0.12180941477814412, "sim_render-ego": 0.046827721041302346, "in-drivable-lane": 0, "agent_compute-ego": 0.07320263773895973, "deviation-heading": 1.016050354533049, "set_robot_commands": 0.07127175774685172, "deviation-center-line": 0.20648750117670708, "driven_lanedir_consec": 0.12180941477814412, "sim_compute_sim_state": 0.028671358906945516, "sim_compute_performance-ego": 0.04948337688002476, "sim_compute_robot_state-ego": 0.05341293645459552}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.37492233427138, "sim_physics": 0.13042988538742065, "survival_time": 4.99999999999999, "driven_lanedir": 0.32026437129432717, "sim_render-ego": 0.06376178979873658, "in-drivable-lane": 0, "agent_compute-ego": 0.10811743974685668, "deviation-heading": 1.9976275736960336, "set_robot_commands": 0.10784499406814577, "deviation-center-line": 0.2380034890310394, "driven_lanedir_consec": 0.32026437129432717, "sim_compute_sim_state": 0.04128532409667969, "sim_compute_performance-ego": 0.07206052541732788, "sim_compute_robot_state-ego": 0.07946613550186157}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5637606370179798, "sim_physics": 0.13567219786092538, "survival_time": 7.349999999999982, "driven_lanedir": 0.4393858523707883, "sim_render-ego": 0.06987772993489999, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.1093410942830196, "deviation-heading": 1.5694283490769612, "set_robot_commands": 0.10852316123287692, "deviation-center-line": 0.16525721772670687, "driven_lanedir_consec": 0.4393858523707883, "sim_compute_sim_state": 0.04262076591958805, "sim_compute_performance-ego": 0.0766599178314209, "sim_compute_robot_state-ego": 0.08492742590352792}}
set_robot_commands_max	0.10852316123287692
set_robot_commands_mean	0.09552408517687952
set_robot_commands_median	0.09909432570139567
set_robot_commands_min	0.07127175774685172
sim_compute_performance-ego_max	0.0766599178314209
sim_compute_performance-ego_mean	0.06676691884169624
sim_compute_performance-ego_median	0.07037259737650553
sim_compute_performance-ego_min	0.04948337688002476
sim_compute_robot_state-ego_max	0.08492742590352792
sim_compute_robot_state-ego_mean	0.07236738631299271
sim_compute_robot_state-ego_median	0.0754185692469279
sim_compute_robot_state-ego_min	0.05341293645459552
sim_compute_sim_state_max	0.04262076591958805
sim_compute_sim_state_mean	0.03787156047044758
sim_compute_sim_state_median	0.03955795129140218
sim_compute_sim_state_min	0.028671358906945516
sim_physics_max	0.13567219786092538
sim_physics_mean	0.11004065899293523
sim_physics_median	0.12279395580291748
sim_physics_min	0.06996194151944893
sim_render-ego_max	0.06987772993489999
sim_render-ego_mean	0.05992580791232752
sim_render-ego_median	0.06139336188634237
sim_render-ego_min	0.046827721041302346
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.46000000000001
survival_time_min	2.1500000000000004

No reset possible

20263

2880

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-25 10:50:09+00:00

2019-04-25 11:00:07+00:00

0:09:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20263-123184', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20263-123184', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20263-123184', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20253

2912

Thies Lennart Alff 🇩🇪

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 10:41:29+00:00

2019-04-25 10:49:48+00:00

0:08:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3913283253155253
survival_time_median	4.249999999999993
deviation-center-line_median	0.2775353582757498
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.09878551108496528
agent_compute-ego_mean	0.09535950553777096
agent_compute-ego_median	0.09758889815386604
agent_compute-ego_min	0.08994587262471516
deviation-center-line_max	0.4261044001621655
deviation-center-line_mean	0.2985614532636032
deviation-center-line_min	0.24164389621245824
deviation-heading_max	2.4747279229945778
deviation-heading_mean	1.5548684540840898
deviation-heading_median	1.5723065881295806
deviation-heading_min	0.42340499737535386
driven_any_max	1.0309322388550253
driven_any_mean	0.6488374744991171
driven_any_median	0.6291549683952957
driven_any_min	0.39626253549774826
driven_lanedir_consec_max	0.7462626502409044
driven_lanedir_consec_mean	0.4313865693320695
driven_lanedir_consec_min	0.20900296002763363
driven_lanedir_max	0.7462626502409044
driven_lanedir_mean	0.4313865693320695
driven_lanedir_median	0.3913283253155253
driven_lanedir_min	0.20900296002763363
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.7599999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4219104770729051, "sim_physics": 0.09860694805781046, "survival_time": 2.9999999999999973, "driven_lanedir": 0.307256266679806, "sim_render-ego": 0.06293892463048299, "in-drivable-lane": 0, "agent_compute-ego": 0.09202548662821453, "deviation-heading": 1.5723065881295806, "set_robot_commands": 0.10013550917307536, "deviation-center-line": 0.26178729684687474, "driven_lanedir_consec": 0.307256266679806, "sim_compute_sim_state": 0.03894963264465332, "sim_compute_performance-ego": 0.06918827692667644, "sim_compute_robot_state-ego": 0.07431036631266276}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6291549683952957, "sim_physics": 0.09787945747375489, "survival_time": 4.249999999999993, "driven_lanedir": 0.20900296002763363, "sim_render-ego": 0.06270025758182302, "in-drivable-lane": 1.4999999999999991, "agent_compute-ego": 0.09758889815386604, "deviation-heading": 2.2979647939265284, "set_robot_commands": 0.09962307425106272, "deviation-center-line": 0.24164389621245824, "driven_lanedir_consec": 0.20900296002763363, "sim_compute_sim_state": 0.04111929781296674, "sim_compute_performance-ego": 0.0682600975036621, "sim_compute_robot_state-ego": 0.0750461129581227}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.39626253549774826, "sim_physics": 0.11157737459455218, "survival_time": 2.799999999999998, "driven_lanedir": 0.3913283253155253, "sim_render-ego": 0.0666143638747079, "in-drivable-lane": 0, "agent_compute-ego": 0.09878551108496528, "deviation-heading": 0.42340499737535386, "set_robot_commands": 0.10707510794912066, "deviation-center-line": 0.2775353582757498, "driven_lanedir_consec": 0.3913283253155253, "sim_compute_sim_state": 0.04172915646008083, "sim_compute_performance-ego": 0.07521742582321167, "sim_compute_robot_state-ego": 0.08084344438144139}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7659271526746111, "sim_physics": 0.1085677333906585, "survival_time": 5.09999999999999, "driven_lanedir": 0.7462626502409044, "sim_render-ego": 0.06052057649575028, "in-drivable-lane": 0, "agent_compute-ego": 0.08994587262471516, "deviation-heading": 1.005937967994409, "set_robot_commands": 0.09524678716472552, "deviation-center-line": 0.4261044001621655, "driven_lanedir_consec": 0.7462626502409044, "sim_compute_sim_state": 0.03969650642544616, "sim_compute_performance-ego": 0.0675420176749136, "sim_compute_robot_state-ego": 0.07088261024624694}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0309322388550253, "sim_physics": 0.1191043942062943, "survival_time": 6.749999999999984, "driven_lanedir": 0.503082644396478, "sim_render-ego": 0.06493789708172834, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.09845175919709384, "deviation-heading": 2.4747279229945778, "set_robot_commands": 0.10289264961525246, "deviation-center-line": 0.28573631482076756, "driven_lanedir_consec": 0.503082644396478, "sim_compute_sim_state": 0.04067923227945964, "sim_compute_performance-ego": 0.07524738841586642, "sim_compute_robot_state-ego": 0.08441460574114765}}
set_robot_commands_max	0.10707510794912066
set_robot_commands_mean	0.10099462563064736
set_robot_commands_median	0.10013550917307536
set_robot_commands_min	0.09524678716472552
sim_compute_performance-ego_max	0.07524738841586642
sim_compute_performance-ego_mean	0.07109104126886603
sim_compute_performance-ego_median	0.06918827692667644
sim_compute_performance-ego_min	0.0675420176749136
sim_compute_robot_state-ego_max	0.08441460574114765
sim_compute_robot_state-ego_mean	0.07709942792792428
sim_compute_robot_state-ego_median	0.0750461129581227
sim_compute_robot_state-ego_min	0.07088261024624694
sim_compute_sim_state_max	0.04172915646008083
sim_compute_sim_state_mean	0.040434765124521335
sim_compute_sim_state_median	0.04067923227945964
sim_compute_sim_state_min	0.03894963264465332
sim_physics_max	0.1191043942062943
sim_physics_mean	0.10714718154461408
sim_physics_median	0.1085677333906585
sim_physics_min	0.09787945747375489
sim_render-ego_max	0.0666143638747079
sim_render-ego_mean	0.06354240393289852
sim_render-ego_median	0.06293892463048299
sim_render-ego_min	0.06052057649575028
simulation-passed	1
survival_time_max	6.749999999999984
survival_time_mean	4.379999999999993
survival_time_min	2.799999999999998

No reset possible

20238

2945

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 10:35:15+00:00

2019-04-25 10:40:59+00:00

0:05:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.11010649330309263
survival_time_median	1.5000000000000009
deviation-center-line_median	0.08454808368284959
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17152369590032668
agent_compute-ego_mean	0.15353190926973231
agent_compute-ego_median	0.15329673555162218
agent_compute-ego_min	0.13614713761114303
deviation-center-line_max	0.09811924886710192
deviation-center-line_mean	0.08292302887503931
deviation-center-line_min	0.0707284684864883
deviation-heading_max	1.0376475325493837
deviation-heading_mean	0.8531422425288676
deviation-heading_median	0.8773049955674367
deviation-heading_min	0.5217085673043934
driven_any_max	0.21009801599430145
driven_any_mean	0.18632969717029063
driven_any_median	0.2024962594654607
driven_any_min	0.13188106850490575
driven_lanedir_consec_max	0.14889841691665928
driven_lanedir_consec_mean	0.11872094175200168
driven_lanedir_consec_min	0.09987552402817944
driven_lanedir_max	0.14889841691665928
driven_lanedir_mean	0.11872094175200168
driven_lanedir_median	0.11010649330309263
driven_lanedir_min	0.09987552402817944
in-drivable-lane_max	0.05000000000000005
in-drivable-lane_mean	0.010000000000000007
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20568929298296987, "sim_physics": 0.09667707284291584, "survival_time": 1.5000000000000009, "driven_lanedir": 0.11010649330309263, "sim_render-ego": 0.053084127108256024, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15076899528503418, "deviation-heading": 0.9946729224706438, "set_robot_commands": 0.09134456316630044, "deviation-center-line": 0.0890682855522501, "driven_lanedir_consec": 0.11010649330309263, "sim_compute_sim_state": 0.0372252623240153, "sim_compute_performance-ego": 0.06256788571675619, "sim_compute_robot_state-ego": 0.06590261459350585}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21009801599430145, "sim_physics": 0.08845119322499921, "survival_time": 1.5500000000000007, "driven_lanedir": 0.14889841691665928, "sim_render-ego": 0.05515357755845593, "in-drivable-lane": 0, "agent_compute-ego": 0.15592298200053553, "deviation-heading": 0.8343771947524806, "set_robot_commands": 0.08983419018407021, "deviation-center-line": 0.0707284684864883, "driven_lanedir_consec": 0.14889841691665928, "sim_compute_sim_state": 0.03722689997765326, "sim_compute_performance-ego": 0.06463796861710087, "sim_compute_robot_state-ego": 0.06885815435840238}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13188106850490575, "sim_physics": 0.0967139062427339, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10499142036107756, "sim_render-ego": 0.059000037965320405, "in-drivable-lane": 0, "agent_compute-ego": 0.17152369590032668, "deviation-heading": 0.5217085673043934, "set_robot_commands": 0.09821689696539015, "deviation-center-line": 0.09811924886710192, "driven_lanedir_consec": 0.10499142036107756, "sim_compute_sim_state": 0.04000349271865118, "sim_compute_performance-ego": 0.07090288116818383, "sim_compute_robot_state-ego": 0.07445733887808663}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18148384890381528, "sim_physics": 0.092820441281354, "survival_time": 1.3500000000000003, "driven_lanedir": 0.09987552402817944, "sim_render-ego": 0.06461491408171477, "in-drivable-lane": 0, "agent_compute-ego": 0.15329673555162218, "deviation-heading": 1.0376475325493837, "set_robot_commands": 0.09216548778392653, "deviation-center-line": 0.08454808368284959, "driven_lanedir_consec": 0.09987552402817944, "sim_compute_sim_state": 0.038347350226508245, "sim_compute_performance-ego": 0.0656218793657091, "sim_compute_robot_state-ego": 0.07481427545900698}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2024962594654607, "sim_physics": 0.08068644615911669, "survival_time": 1.5500000000000007, "driven_lanedir": 0.12973285415099944, "sim_render-ego": 0.049995414672359344, "in-drivable-lane": 0, "agent_compute-ego": 0.13614713761114303, "deviation-heading": 0.8773049955674367, "set_robot_commands": 0.07776904875232328, "deviation-center-line": 0.07215105778650664, "driven_lanedir_consec": 0.12973285415099944, "sim_compute_sim_state": 0.030623197555541992, "sim_compute_performance-ego": 0.05426073843433011, "sim_compute_robot_state-ego": 0.0603325443883096}}
set_robot_commands_max	0.09821689696539015
set_robot_commands_mean	0.08986603737040212
set_robot_commands_median	0.09134456316630044
set_robot_commands_min	0.07776904875232328
sim_compute_performance-ego_max	0.07090288116818383
sim_compute_performance-ego_mean	0.06359827066041601
sim_compute_performance-ego_median	0.06463796861710087
sim_compute_performance-ego_min	0.05426073843433011
sim_compute_robot_state-ego_max	0.07481427545900698
sim_compute_robot_state-ego_mean	0.0688729855354623
sim_compute_robot_state-ego_median	0.06885815435840238
sim_compute_robot_state-ego_min	0.0603325443883096
sim_compute_sim_state_max	0.04000349271865118
sim_compute_sim_state_mean	0.036685240560473995
sim_compute_sim_state_median	0.03722689997765326
sim_compute_sim_state_min	0.030623197555541992
sim_physics_max	0.0967139062427339
sim_physics_mean	0.09106981195022391
sim_physics_median	0.092820441281354
sim_physics_min	0.08068644615911669
sim_render-ego_max	0.06461491408171477
sim_render-ego_mean	0.05636961427722129
sim_render-ego_median	0.05515357755845593
sim_render-ego_min	0.049995414672359344
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.4000000000000006
survival_time_min	1.0500000000000005

No reset possible

20178

3058

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-25 10:01:20+00:00

2019-04-25 10:35:07+00:00

0:33:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.00047115201695890896
survival_time_median	14.950000000000076
deviation-center-line_median	0.48935454758261704
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.15508958180745444
agent_compute-ego_mean	0.1494688401222229
agent_compute-ego_median	0.1502859091758728
agent_compute-ego_min	0.13853080034255982
deviation-center-line_max	0.6110630347807673
deviation-center-line_mean	0.420093343660332
deviation-center-line_min	0.016750786693997155
deviation-heading_max	5.828528410212024
deviation-heading_mean	5.666366635305937
deviation-heading_median	5.656741799274124
deviation-heading_min	5.45365698365684
driven_any_max	0.026994866629984765
driven_any_mean	0.025026630137880906
driven_any_median	0.02584556720483493
driven_any_min	0.022110630442246686
driven_lanedir_consec_max	0.0024792245869211804
driven_lanedir_consec_mean	-0.0002801686950645088
driven_lanedir_consec_min	-0.003729386251302813
driven_lanedir_max	0.0024792245869211804
driven_lanedir_mean	-0.0002801686950645088
driven_lanedir_median	0.00047115201695890896
driven_lanedir_min	-0.003729386251302813
in-drivable-lane_max	7.650000000000045
in-drivable-lane_mean	7.610000000000044
in-drivable-lane_min	7.550000000000044
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026994866629984765, "sim_physics": 0.14692517201105754, "survival_time": 14.950000000000076, "driven_lanedir": 0.0024792245869211804, "sim_render-ego": 0.05177771170934042, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.15508958180745444, "deviation-heading": 5.656741799274124, "set_robot_commands": 0.07788215557734171, "deviation-center-line": 0.56158233038212, "driven_lanedir_consec": 0.0024792245869211804, "sim_compute_sim_state": 0.03358376423517863, "sim_compute_performance-ego": 0.05662561019261678, "sim_compute_robot_state-ego": 0.05774827082951864, "sim_compute_robot_state-npc0": 0.055838127136230466, "sim_compute_robot_state-npc1": 0.05814485470453898, "sim_compute_robot_state-npc2": 0.05472156604131063, "sim_compute_robot_state-npc3": 0.05407703717549642}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.02584556720483493, "sim_physics": 0.16452203353246053, "survival_time": 14.950000000000076, "driven_lanedir": -0.003729386251302813, "sim_render-ego": 0.05857540210088094, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.14869258165359495, "deviation-heading": 5.792980334963805, "set_robot_commands": 0.09131826241811115, "deviation-center-line": 0.6110630347807673, "driven_lanedir_consec": -0.003729386251302813, "sim_compute_sim_state": 0.037252323627471925, "sim_compute_performance-ego": 0.06648266156514486, "sim_compute_robot_state-ego": 0.07112536112467448, "sim_compute_robot_state-npc0": 0.06737335840861003, "sim_compute_robot_state-npc1": 0.07026798248291016, "sim_compute_robot_state-npc2": 0.06619059403737386, "sim_compute_robot_state-npc3": 0.0661200753847758}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.024318396942426792, "sim_physics": 0.17615637302398682, "survival_time": 14.950000000000076, "driven_lanedir": 0.002004176561754889, "sim_render-ego": 0.06307125568389893, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.15474532763163248, "deviation-heading": 5.599925648422894, "set_robot_commands": 0.0981486177444458, "deviation-center-line": 0.48935454758261704, "driven_lanedir_consec": 0.002004176561754889, "sim_compute_sim_state": 0.04018399715423584, "sim_compute_performance-ego": 0.07055707136789957, "sim_compute_robot_state-ego": 0.07443007707595825, "sim_compute_robot_state-npc0": 0.07043732643127441, "sim_compute_robot_state-npc1": 0.0695989966392517, "sim_compute_robot_state-npc2": 0.06971060911814372, "sim_compute_robot_state-npc3": 0.06924728870391846}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022110630442246686, "sim_physics": 0.16758649587631225, "survival_time": 14.950000000000076, "driven_lanedir": -0.0026260103896547093, "sim_render-ego": 0.0606601365407308, "in-drivable-lane": 7.650000000000045, "agent_compute-ego": 0.1502859091758728, "deviation-heading": 5.45365698365684, "set_robot_commands": 0.0937523889541626, "deviation-center-line": 0.42171601886215854, "driven_lanedir_consec": -0.0026260103896547093, "sim_compute_sim_state": 0.037920315265655515, "sim_compute_performance-ego": 0.06541379769643148, "sim_compute_robot_state-ego": 0.0696918527285258, "sim_compute_robot_state-npc0": 0.06754494190216065, "sim_compute_robot_state-npc1": 0.06736692190170288, "sim_compute_robot_state-npc2": 0.06625704050064087, "sim_compute_robot_state-npc3": 0.06606499910354614}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.02586368946991136, "sim_physics": 0.16430522521336874, "survival_time": 14.950000000000076, "driven_lanedir": 0.00047115201695890896, "sim_render-ego": 0.05818943897883097, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.13853080034255982, "deviation-heading": 5.828528410212024, "set_robot_commands": 0.08664726495742797, "deviation-center-line": 0.016750786693997155, "driven_lanedir_consec": 0.00047115201695890896, "sim_compute_sim_state": 0.03572178840637207, "sim_compute_performance-ego": 0.06337541103363037, "sim_compute_robot_state-ego": 0.06705591599146525, "sim_compute_robot_state-npc0": 0.06423045555750528, "sim_compute_robot_state-npc1": 0.06306429386138916, "sim_compute_robot_state-npc2": 0.06191790421803792, "sim_compute_robot_state-npc3": 0.0637044350306193}}
set_robot_commands_max	0.0981486177444458
set_robot_commands_mean	0.08954973793029784
set_robot_commands_median	0.09131826241811115
set_robot_commands_min	0.07788215557734171
sim_compute_performance-ego_max	0.07055707136789957
sim_compute_performance-ego_mean	0.06449091037114461
sim_compute_performance-ego_median	0.06541379769643148
sim_compute_performance-ego_min	0.05662561019261678
sim_compute_robot_state-ego_max	0.07443007707595825
sim_compute_robot_state-ego_mean	0.06801029555002848
sim_compute_robot_state-ego_median	0.0696918527285258
sim_compute_robot_state-ego_min	0.05774827082951864
sim_compute_robot_state-npc0_max	0.07043732643127441
sim_compute_robot_state-npc0_mean	0.06508484188715616
sim_compute_robot_state-npc0_median	0.06737335840861003
sim_compute_robot_state-npc0_min	0.055838127136230466
sim_compute_robot_state-npc1_max	0.07026798248291016
sim_compute_robot_state-npc1_mean	0.06568860991795858
sim_compute_robot_state-npc1_median	0.06736692190170288
sim_compute_robot_state-npc1_min	0.05814485470453898
sim_compute_robot_state-npc2_max	0.06971060911814372
sim_compute_robot_state-npc2_mean	0.0637595427831014
sim_compute_robot_state-npc2_median	0.06619059403737386
sim_compute_robot_state-npc2_min	0.05472156604131063
sim_compute_robot_state-npc3_max	0.06924728870391846
sim_compute_robot_state-npc3_mean	0.06384276707967121
sim_compute_robot_state-npc3_median	0.06606499910354614
sim_compute_robot_state-npc3_min	0.05407703717549642
sim_compute_sim_state_max	0.04018399715423584
sim_compute_sim_state_mean	0.0369324377377828
sim_compute_sim_state_median	0.037252323627471925
sim_compute_sim_state_min	0.03358376423517863
sim_physics_max	0.17615637302398682
sim_physics_mean	0.1638990599314372
sim_physics_median	0.16452203353246053
sim_physics_min	0.14692517201105754
sim_render-ego_max	0.06307125568389893
sim_render-ego_mean	0.058454789002736415
sim_render-ego_median	0.05857540210088094
sim_render-ego_min	0.05177771170934042
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20153

2964

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 09:47:49+00:00

2019-04-25 10:00:07+00:00

0:12:18

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20153-493133', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20153-493133', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20153-493133', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20099

2660

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 09:26:22+00:00

2019-04-25 09:47:42+00:00

0:21:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6037021522723106
survival_time_median	4.199999999999993
deviation-center-line_median	0.4356815244714198
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.0943722788705475
agent_compute-ego_mean	0.09012527053068473
agent_compute-ego_median	0.08887768075579688
agent_compute-ego_min	0.08710401608393742
deviation-center-line_max	1.3357571089036469
deviation-center-line_mean	0.6396924407206184
deviation-center-line_min	0.15015672517498888
deviation-heading_max	5.698082646302257
deviation-heading_mean	2.5643057965122367
deviation-heading_median	1.1154935756515298
deviation-heading_min	0.6330529649870218
driven_any_max	2.353364978398695
driven_any_mean	1.2247134343492805
driven_any_median	0.6257641943439552
driven_any_min	0.32842794479948056
driven_lanedir_consec_max	1.7106795061833342
driven_lanedir_consec_mean	0.9224500675384844
driven_lanedir_consec_min	0.27985672561192576
driven_lanedir_max	2.088636535312773
driven_lanedir_mean	1.0737081346578656
driven_lanedir_median	0.6037021522723106
driven_lanedir_min	0.27985672561192576
in-drivable-lane_max	0.6500000000000092
in-drivable-lane_mean	0.25000000000000355
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.3429135017187463, "sim_physics": 0.08508819182713827, "survival_time": 14.950000000000076, "driven_lanedir": 2.088636535312773, "sim_render-ego": 0.071193106174469, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.08782548666000366, "deviation-heading": 4.4786647793142045, "set_robot_commands": 0.11299999713897706, "deviation-center-line": 0.9266853790892486, "driven_lanedir_consec": 1.7106795061833342, "sim_compute_sim_state": 0.04366261879603068, "sim_compute_performance-ego": 0.07837633689244589, "sim_compute_robot_state-ego": 0.08602755626042684, "sim_compute_robot_state-npc0": 0.07913812398910522, "sim_compute_robot_state-npc1": 0.07932165225346884, "sim_compute_robot_state-npc2": 0.07862957159678141, "sim_compute_robot_state-npc3": 0.0782655922571818}, "udem1-1-0": {"driven_any": 0.32842794479948056, "sim_physics": 0.09473462814980364, "survival_time": 2.3499999999999996, "driven_lanedir": 0.27985672561192576, "sim_render-ego": 0.07177105863043602, "in-drivable-lane": 0, "agent_compute-ego": 0.0924468902831382, "deviation-heading": 1.1154935756515298, "set_robot_commands": 0.12101224635509734, "deviation-center-line": 0.15015672517498888, "driven_lanedir_consec": 0.27985672561192576, "sim_compute_sim_state": 0.04421372109271111, "sim_compute_performance-ego": 0.07889784650599703, "sim_compute_robot_state-ego": 0.08897794053909626, "sim_compute_robot_state-npc0": 0.07912613483185464, "sim_compute_robot_state-npc1": 0.07787226108794516, "sim_compute_robot_state-npc2": 0.079391895456517, "sim_compute_robot_state-npc3": 0.08111138546720464}, "udem1-2-0": {"driven_any": 0.6257641943439552, "sim_physics": 0.09617081994102114, "survival_time": 4.199999999999993, "driven_lanedir": 0.6037021522723106, "sim_render-ego": 0.07096133345649355, "in-drivable-lane": 0, "agent_compute-ego": 0.08887768075579688, "deviation-heading": 0.8962350163061694, "set_robot_commands": 0.11173674889973231, "deviation-center-line": 0.4356815244714198, "driven_lanedir_consec": 0.6037021522723106, "sim_compute_sim_state": 0.04528051898592994, "sim_compute_performance-ego": 0.07737224442618233, "sim_compute_robot_state-ego": 0.08784122410274688, "sim_compute_robot_state-npc0": 0.07624160108112153, "sim_compute_robot_state-npc1": 0.07753493672325498, "sim_compute_robot_state-npc2": 0.08113646223431542, "sim_compute_robot_state-npc3": 0.08030714591344197}, "udem1-3-0": {"driven_any": 0.4730965524855254, "sim_physics": 0.09119018774766188, "survival_time": 3.2499999999999964, "driven_lanedir": 0.4578072071056016, "sim_render-ego": 0.06655156428997333, "in-drivable-lane": 0, "agent_compute-ego": 0.08710401608393742, "deviation-heading": 0.6330529649870218, "set_robot_commands": 0.1073477891775278, "deviation-center-line": 0.3501814659637874, "driven_lanedir_consec": 0.4578072071056016, "sim_compute_sim_state": 0.043411163183359, "sim_compute_performance-ego": 0.07244913761432355, "sim_compute_robot_state-ego": 0.07770993892963116, "sim_compute_robot_state-npc0": 0.07309075869046724, "sim_compute_robot_state-npc1": 0.07526743228618915, "sim_compute_robot_state-npc2": 0.0836636469914363, "sim_compute_robot_state-npc3": 0.07424823687626765}, "udem1-4-0": {"driven_any": 2.353364978398695, "sim_physics": 0.0857230165730352, "survival_time": 14.950000000000076, "driven_lanedir": 1.9385380529867176, "sim_render-ego": 0.0649420298062838, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.0943722788705475, "deviation-heading": 5.698082646302257, "set_robot_commands": 0.10907978995587914, "deviation-center-line": 1.3357571089036469, "driven_lanedir_consec": 1.5602047465192497, "sim_compute_sim_state": 0.04537857735037405, "sim_compute_performance-ego": 0.07275155794660383, "sim_compute_robot_state-ego": 0.0834825174465626, "sim_compute_robot_state-npc0": 0.07298404237498408, "sim_compute_robot_state-npc1": 0.07386813355130097, "sim_compute_robot_state-npc2": 0.07251875775314892, "sim_compute_robot_state-npc3": 0.07435171420757587}}
set_robot_commands_max	0.12101224635509734
set_robot_commands_mean	0.11243531430544274
set_robot_commands_median	0.11173674889973231
set_robot_commands_min	0.1073477891775278
sim_compute_performance-ego_max	0.07889784650599703
sim_compute_performance-ego_mean	0.07596942467711051
sim_compute_performance-ego_median	0.07737224442618233
sim_compute_performance-ego_min	0.07244913761432355
sim_compute_robot_state-ego_max	0.08897794053909626
sim_compute_robot_state-ego_mean	0.08480783545569273
sim_compute_robot_state-ego_median	0.08602755626042684
sim_compute_robot_state-ego_min	0.07770993892963116
sim_compute_robot_state-npc0_max	0.07913812398910522
sim_compute_robot_state-npc0_mean	0.07611613219350653
sim_compute_robot_state-npc0_median	0.07624160108112153
sim_compute_robot_state-npc0_min	0.07298404237498408
sim_compute_robot_state-npc1_max	0.07932165225346884
sim_compute_robot_state-npc1_mean	0.07677288318043182
sim_compute_robot_state-npc1_median	0.07753493672325498
sim_compute_robot_state-npc1_min	0.07386813355130097
sim_compute_robot_state-npc2_max	0.0836636469914363
sim_compute_robot_state-npc2_mean	0.07906806680643981
sim_compute_robot_state-npc2_median	0.079391895456517
sim_compute_robot_state-npc2_min	0.07251875775314892
sim_compute_robot_state-npc3_max	0.08111138546720464
sim_compute_robot_state-npc3_mean	0.07765681494433438
sim_compute_robot_state-npc3_median	0.0782655922571818
sim_compute_robot_state-npc3_min	0.07424823687626765
sim_compute_sim_state_max	0.04537857735037405
sim_compute_sim_state_mean	0.044389319881680954
sim_compute_sim_state_median	0.04421372109271111
sim_compute_sim_state_min	0.043411163183359
sim_physics_max	0.09617081994102114
sim_physics_mean	0.09058136884773205
sim_physics_median	0.09119018774766188
sim_physics_min	0.08508819182713827
sim_render-ego_max	0.07177105863043602
sim_render-ego_mean	0.06908381847153115
sim_render-ego_median	0.07096133345649355
sim_render-ego_min	0.0649420298062838
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.940000000000029
survival_time_min	2.3499999999999996

No reset possible

20056

2964

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 09:00:58+00:00

2019-04-25 09:26:04+00:00

0:25:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.28852556745626456
survival_time_median	7.549999999999981
deviation-center-line_median	0.20933429762150513
in-drivable-lane_median	2.6500000000000155

other stats

agent_compute-ego_max	0.22667296896589564
agent_compute-ego_mean	0.2146758451649023
agent_compute-ego_median	0.21437691025814767
agent_compute-ego_min	0.198419517239198
deviation-center-line_max	1.2149497111474865
deviation-center-line_mean	0.42977013848893914
deviation-center-line_min	0.169035697673801
deviation-heading_max	4.572094143268666
deviation-heading_mean	2.0168080070037737
deviation-heading_median	1.3848106940050038
deviation-heading_min	1.2201731485486895
driven_any_max	1.9136517617450857
driven_any_mean	1.1055803677406917
driven_any_median	0.725672618711466
driven_any_min	0.596295975495364
driven_lanedir_consec_max	1.1822037233566394
driven_lanedir_consec_mean	0.46469886307422026
driven_lanedir_consec_min	0.2743304061908669
driven_lanedir_max	1.1896137038682304
driven_lanedir_mean	0.46808633077117345
driven_lanedir_median	0.2944055281647606
driven_lanedir_min	0.2753525262923193
in-drivable-lane_max	11.80000000000008
in-drivable-lane_mean	4.250000000000014
in-drivable-lane_min	1.3499999999999952
per-episodes	details {"udem1-0-0": {"driven_any": 1.684111005706507, "sim_physics": 0.20366616491544048, "survival_time": 14.750000000000076, "driven_lanedir": 1.1896137038682304, "sim_render-ego": 0.0639378790128029, "in-drivable-lane": 2.6500000000000155, "agent_compute-ego": 0.21437691025814767, "deviation-heading": 4.572094143268666, "set_robot_commands": 0.09874478033033468, "deviation-center-line": 1.2149497111474865, "driven_lanedir_consec": 1.1822037233566394, "sim_compute_sim_state": 0.03769048432172355, "sim_compute_performance-ego": 0.06802665015398446, "sim_compute_robot_state-ego": 0.07205164796214993, "sim_compute_robot_state-npc0": 0.06964295354940124, "sim_compute_robot_state-npc1": 0.0695178387528759, "sim_compute_robot_state-npc2": 0.06974900213338561, "sim_compute_robot_state-npc3": 0.06823953127456923}, "udem1-1-0": {"driven_any": 0.596295975495364, "sim_physics": 0.1557772544899372, "survival_time": 4.94999999999999, "driven_lanedir": 0.2944055281647606, "sim_render-ego": 0.062235032669221514, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.208283812108666, "deviation-heading": 1.2762971127742415, "set_robot_commands": 0.09465441077646584, "deviation-center-line": 0.36142512003955835, "driven_lanedir_consec": 0.28852556745626456, "sim_compute_sim_state": 0.03879384079364815, "sim_compute_performance-ego": 0.06704639906835075, "sim_compute_robot_state-ego": 0.06987935364848435, "sim_compute_robot_state-npc0": 0.06908356059681285, "sim_compute_robot_state-npc1": 0.06732245165892321, "sim_compute_robot_state-npc2": 0.06604079766706987, "sim_compute_robot_state-npc3": 0.067379481864698}, "udem1-2-0": {"driven_any": 1.9136517617450857, "sim_physics": 0.2012199076016744, "survival_time": 14.950000000000076, "driven_lanedir": 0.2753525262923193, "sim_render-ego": 0.06359177668889364, "in-drivable-lane": 11.80000000000008, "agent_compute-ego": 0.22562601725260417, "deviation-heading": 1.3848106940050038, "set_robot_commands": 0.09926456054051716, "deviation-center-line": 0.19410586596234464, "driven_lanedir_consec": 0.2753525262923193, "sim_compute_sim_state": 0.04011881192525228, "sim_compute_performance-ego": 0.07114884455998739, "sim_compute_robot_state-ego": 0.07660428762435913, "sim_compute_robot_state-npc0": 0.07134606997172038, "sim_compute_robot_state-npc1": 0.07083915313084921, "sim_compute_robot_state-npc2": 0.07041934251785278, "sim_compute_robot_state-npc3": 0.07067558368047079}, "udem1-3-0": {"driven_any": 0.6081704770450342, "sim_physics": 0.1893977535531876, "survival_time": 4.699999999999991, "driven_lanedir": 0.27797780345554624, "sim_render-ego": 0.06299531967081923, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.22667296896589564, "deviation-heading": 1.6306649364222665, "set_robot_commands": 0.09987947535007556, "deviation-center-line": 0.20933429762150513, "driven_lanedir_consec": 0.2743304061908669, "sim_compute_sim_state": 0.04183936372716376, "sim_compute_performance-ego": 0.07106161624827284, "sim_compute_robot_state-ego": 0.07584684960385586, "sim_compute_robot_state-npc0": 0.07517171413340468, "sim_compute_robot_state-npc1": 0.07226665730172015, "sim_compute_robot_state-npc2": 0.07224392383656603, "sim_compute_robot_state-npc3": 0.07413249066535463}, "udem1-4-0": {"driven_any": 0.725672618711466, "sim_physics": 0.17338339224556423, "survival_time": 7.549999999999981, "driven_lanedir": 0.303082092075011, "sim_render-ego": 0.05420536868619603, "in-drivable-lane": 3.949999999999986, "agent_compute-ego": 0.198419517239198, "deviation-heading": 1.2201731485486895, "set_robot_commands": 0.08400013273125452, "deviation-center-line": 0.169035697673801, "driven_lanedir_consec": 0.303082092075011, "sim_compute_sim_state": 0.03305850281620657, "sim_compute_performance-ego": 0.05920880677684254, "sim_compute_robot_state-ego": 0.0740007059463602, "sim_compute_robot_state-npc0": 0.059962714744719446, "sim_compute_robot_state-npc1": 0.05988807551908177, "sim_compute_robot_state-npc2": 0.0580557118977932, "sim_compute_robot_state-npc3": 0.058432406937049715}}
set_robot_commands_max	0.09987947535007556
set_robot_commands_mean	0.09530867194572956
set_robot_commands_median	0.09874478033033468
set_robot_commands_min	0.08400013273125452
sim_compute_performance-ego_max	0.07114884455998739
sim_compute_performance-ego_mean	0.06729846336148759
sim_compute_performance-ego_median	0.06802665015398446
sim_compute_performance-ego_min	0.05920880677684254
sim_compute_robot_state-ego_max	0.07660428762435913
sim_compute_robot_state-ego_mean	0.07367656895704189
sim_compute_robot_state-ego_median	0.0740007059463602
sim_compute_robot_state-ego_min	0.06987935364848435
sim_compute_robot_state-npc0_max	0.07517171413340468
sim_compute_robot_state-npc0_mean	0.06904140259921171
sim_compute_robot_state-npc0_median	0.06964295354940124
sim_compute_robot_state-npc0_min	0.059962714744719446
sim_compute_robot_state-npc1_max	0.07226665730172015
sim_compute_robot_state-npc1_mean	0.06796683527269005
sim_compute_robot_state-npc1_median	0.0695178387528759
sim_compute_robot_state-npc1_min	0.05988807551908177
sim_compute_robot_state-npc2_max	0.07224392383656603
sim_compute_robot_state-npc2_mean	0.0673017556105335
sim_compute_robot_state-npc2_median	0.06974900213338561
sim_compute_robot_state-npc2_min	0.0580557118977932
sim_compute_robot_state-npc3_max	0.07413249066535463
sim_compute_robot_state-npc3_mean	0.06777189888442846
sim_compute_robot_state-npc3_median	0.06823953127456923
sim_compute_robot_state-npc3_min	0.058432406937049715
sim_compute_sim_state_max	0.04183936372716376
sim_compute_sim_state_mean	0.03830020071679886
sim_compute_sim_state_median	0.03879384079364815
sim_compute_sim_state_min	0.03305850281620657
sim_physics_max	0.20366616491544048
sim_physics_mean	0.18468889456116075
sim_physics_median	0.1893977535531876
sim_physics_min	0.1557772544899372
sim_render-ego_max	0.0639378790128029
sim_render-ego_mean	0.061393075345586655
sim_render-ego_median	0.06299531967081923
sim_render-ego_min	0.05420536868619603
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.380000000000024
survival_time_min	4.699999999999991

No reset possible

20042

2981

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-25 08:59:25+00:00

2019-04-25 09:00:38+00:00

0:01:13

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20042-925606', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20042-925606', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20042-925606', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20031

2372

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

error

2019-04-25 08:49:02+00:00

2019-04-25 08:49:54+00:00

0:00:52

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20020

2396

Liam Paull 🇨🇦

random_agent

step1-simulation

error

2019-04-25 08:46:43+00:00

2019-04-25 08:48:40+00:00

0:01:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20005

2421

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 08:45:05+00:00

2019-04-25 08:46:02+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19989

2511

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:43:08+00:00

2019-04-25 08:44:50+00:00

0:01:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19954

2716

test for ppo

step1-simulation

error

2019-04-25 08:40:31+00:00

2019-04-25 08:42:26+00:00

0:01:55

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19938

2877

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

error

2019-04-25 08:39:10+00:00

2019-04-25 08:40:00+00:00

0:00:50

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19924

3019

Manfred Diaz

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 08:38:09+00:00

2019-04-25 08:38:44+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19906

2695

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:36:51+00:00

2019-04-25 08:37:42+00:00

0:00:51

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19893

2796

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:35:38+00:00

2019-04-25 08:36:38+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19880

2844

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:34:36+00:00

2019-04-25 08:35:09+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19814

2864

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 08:13:04+00:00

2019-04-25 08:34:22+00:00

0:21:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5098151968740181
survival_time_median	7.599999999999981
deviation-center-line_median	0.32973887033682625
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.10772430340449016
agent_compute-ego_mean	0.09993800007106152
agent_compute-ego_median	0.09948975642522176
agent_compute-ego_min	0.08762909236707185
deviation-center-line_max	0.8134771194113879
deviation-center-line_mean	0.4471832283307705
deviation-center-line_min	0.14976205368646
deviation-heading_max	6.56252528533073
deviation-heading_mean	3.6370469597660473
deviation-heading_median	2.295541164109353
deviation-heading_min	1.4294845174705906
driven_any_max	1.177878013530824
driven_any_mean	0.7035042213305598
driven_any_median	0.5872196676413705
driven_any_min	0.20549712544006327
driven_lanedir_consec_max	0.7146618921245373
driven_lanedir_consec_mean	0.4696045182173504
driven_lanedir_consec_min	0.16563121789065471
driven_lanedir_max	0.7481007026415067
driven_lanedir_mean	0.4840951988470145
driven_lanedir_median	0.5098151968740181
driven_lanedir_min	0.16563121789065471
in-drivable-lane_max	2.9500000000000366
in-drivable-lane_mean	1.3200000000000145
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.3690618595887867, "sim_physics": 0.04446635684188532, "survival_time": 4.899999999999991, "driven_lanedir": 0.269695655264812, "sim_render-ego": 0.06096030254753269, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.09839356432155688, "deviation-heading": 1.6897782391483704, "set_robot_commands": 0.0940121533919354, "deviation-center-line": 0.19140880087795248, "driven_lanedir_consec": 0.269695655264812, "sim_compute_sim_state": 0.035958183055021326, "sim_compute_performance-ego": 0.06578371719438203, "sim_compute_robot_state-ego": 0.06684122280198701, "sim_compute_robot_state-npc0": 0.06606077174751127, "sim_compute_robot_state-npc1": 0.06812774648471755, "sim_compute_robot_state-npc2": 0.06393151137293601, "sim_compute_robot_state-npc3": 0.06731438150211257}, "udem1-1-0": {"driven_any": 0.5872196676413705, "sim_physics": 0.0442758531946885, "survival_time": 7.599999999999981, "driven_lanedir": 0.5098151968740181, "sim_render-ego": 0.06359415148433886, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.10645328383696706, "deviation-heading": 2.295541164109353, "set_robot_commands": 0.10108994653350428, "deviation-center-line": 0.32973887033682625, "driven_lanedir_consec": 0.5098151968740181, "sim_compute_sim_state": 0.039253674055400645, "sim_compute_performance-ego": 0.07101995537155553, "sim_compute_robot_state-ego": 0.07437745364088762, "sim_compute_robot_state-npc0": 0.0695958906098416, "sim_compute_robot_state-npc1": 0.07030810807880603, "sim_compute_robot_state-npc2": 0.07099415440308421, "sim_compute_robot_state-npc3": 0.07292066279210542}, "udem1-2-0": {"driven_any": 1.177864440451755, "sim_physics": 0.04269285360972087, "survival_time": 14.950000000000076, "driven_lanedir": 0.7272332215640811, "sim_render-ego": 0.06332522392272949, "in-drivable-lane": 2.9500000000000366, "agent_compute-ego": 0.10772430340449016, "deviation-heading": 6.56252528533073, "set_robot_commands": 0.1005677819252014, "deviation-center-line": 0.8134771194113879, "driven_lanedir_consec": 0.6882186289327301, "sim_compute_sim_state": 0.03852393945058187, "sim_compute_performance-ego": 0.06918526331583659, "sim_compute_robot_state-ego": 0.07180768728256226, "sim_compute_robot_state-npc0": 0.0683545192082723, "sim_compute_robot_state-npc1": 0.06933375914891561, "sim_compute_robot_state-npc2": 0.06950148661931356, "sim_compute_robot_state-npc3": 0.06943157354990641}, "udem1-3-0": {"driven_any": 1.177878013530824, "sim_physics": 0.04280190467834473, "survival_time": 14.950000000000076, "driven_lanedir": 0.7481007026415067, "sim_render-ego": 0.061336777210235595, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.09948975642522176, "deviation-heading": 6.207905592771192, "set_robot_commands": 0.100059122244517, "deviation-center-line": 0.7515292973412259, "driven_lanedir_consec": 0.7146618921245373, "sim_compute_sim_state": 0.038104658921559655, "sim_compute_performance-ego": 0.06731061617533365, "sim_compute_robot_state-ego": 0.07096880038579305, "sim_compute_robot_state-npc0": 0.06793652772903443, "sim_compute_robot_state-npc1": 0.06834995190302531, "sim_compute_robot_state-npc2": 0.06859107494354248, "sim_compute_robot_state-npc3": 0.06838201602300008}, "udem1-4-0": {"driven_any": 0.20549712544006327, "sim_physics": 0.03792891167757804, "survival_time": 2.849999999999998, "driven_lanedir": 0.16563121789065471, "sim_render-ego": 0.056168832276996816, "in-drivable-lane": 0, "agent_compute-ego": 0.08762909236707185, "deviation-heading": 1.4294845174705906, "set_robot_commands": 0.08490482966105144, "deviation-center-line": 0.14976205368646, "driven_lanedir_consec": 0.16563121789065471, "sim_compute_sim_state": 0.03530280213606985, "sim_compute_performance-ego": 0.06054039587054336, "sim_compute_robot_state-ego": 0.0623396028552139, "sim_compute_robot_state-npc0": 0.06171536445617676, "sim_compute_robot_state-npc1": 0.06189278134128504, "sim_compute_robot_state-npc2": 0.060015958652161715, "sim_compute_robot_state-npc3": 0.061053309524268434}}
set_robot_commands_max	0.10108994653350428
set_robot_commands_mean	0.0961267667512419
set_robot_commands_median	0.100059122244517
set_robot_commands_min	0.08490482966105144
sim_compute_performance-ego_max	0.07101995537155553
sim_compute_performance-ego_mean	0.06676798958553024
sim_compute_performance-ego_median	0.06731061617533365
sim_compute_performance-ego_min	0.06054039587054336
sim_compute_robot_state-ego_max	0.07437745364088762
sim_compute_robot_state-ego_mean	0.06926695339328877
sim_compute_robot_state-ego_median	0.07096880038579305
sim_compute_robot_state-ego_min	0.0623396028552139
sim_compute_robot_state-npc0_max	0.0695958906098416
sim_compute_robot_state-npc0_mean	0.06673261475016726
sim_compute_robot_state-npc0_median	0.06793652772903443
sim_compute_robot_state-npc0_min	0.06171536445617676
sim_compute_robot_state-npc1_max	0.07030810807880603
sim_compute_robot_state-npc1_mean	0.06760246939134991
sim_compute_robot_state-npc1_median	0.06834995190302531
sim_compute_robot_state-npc1_min	0.06189278134128504
sim_compute_robot_state-npc2_max	0.07099415440308421
sim_compute_robot_state-npc2_mean	0.06660683719820759
sim_compute_robot_state-npc2_median	0.06859107494354248
sim_compute_robot_state-npc2_min	0.060015958652161715
sim_compute_robot_state-npc3_max	0.07292066279210542
sim_compute_robot_state-npc3_mean	0.06782038867827858
sim_compute_robot_state-npc3_median	0.06838201602300008
sim_compute_robot_state-npc3_min	0.061053309524268434
sim_compute_sim_state_max	0.039253674055400645
sim_compute_sim_state_mean	0.037428651523726666
sim_compute_sim_state_median	0.038104658921559655
sim_compute_sim_state_min	0.03530280213606985
sim_physics_max	0.04446635684188532
sim_physics_mean	0.04243317600044349
sim_physics_median	0.04280190467834473
sim_physics_min	0.03792891167757804
sim_render-ego_max	0.06359415148433886
sim_render-ego_mean	0.06107705748836669
sim_render-ego_median	0.061336777210235595
sim_render-ego_min	0.056168832276996816
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.050000000000026
survival_time_min	2.849999999999998

No reset possible

19776

2594

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 08:00:18+00:00

2019-04-25 08:12:25+00:00

0:12:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.21999531279774456
survival_time_median	4.99999999999999
deviation-center-line_median	0.34321847915172066
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.24354519500388755
agent_compute-ego_mean	0.2099696115994898
agent_compute-ego_median	0.2092939782142639
agent_compute-ego_min	0.17902615070343017
deviation-center-line_max	0.45697961028865475
deviation-center-line_mean	0.35070116950712543
deviation-center-line_min	0.25007455044383026
deviation-heading_max	2.782138162980728
deviation-heading_mean	2.166009922626943
deviation-heading_median	2.028005482296518
deviation-heading_min	1.61616928822853
driven_any_max	0.3095467819762666
driven_any_mean	0.25286740083560905
driven_any_median	0.2524469383009854
driven_any_min	0.19897701222580724
driven_lanedir_consec_max	0.25197337312586243
driven_lanedir_consec_mean	0.2106373760396728
driven_lanedir_consec_min	0.15902090177504702
driven_lanedir_max	0.25197337312586243
driven_lanedir_mean	0.2106373760396728
driven_lanedir_median	0.21999531279774456
driven_lanedir_min	0.15902090177504702
in-drivable-lane_max	0.04999999999999982
in-drivable-lane_mean	0.009999999999999964
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.3095467819762666, "sim_physics": 0.045966988211279515, "survival_time": 5.549999999999988, "driven_lanedir": 0.25197337312586243, "sim_render-ego": 0.06621015179264653, "in-drivable-lane": 0, "agent_compute-ego": 0.24354519500388755, "deviation-heading": 2.782138162980728, "set_robot_commands": 0.1077887689745104, "deviation-center-line": 0.34321847915172066, "driven_lanedir_consec": 0.25197337312586243, "sim_compute_sim_state": 0.04063838237040752, "sim_compute_performance-ego": 0.07098040494832906, "sim_compute_robot_state-ego": 0.07558084608198286, "sim_compute_robot_state-npc0": 0.07300652469600644, "sim_compute_robot_state-npc1": 0.07354598646765356, "sim_compute_robot_state-npc2": 0.07257728104118828, "sim_compute_robot_state-npc3": 0.0730220820452716}, "udem1-1-0": {"driven_any": 0.2560583816131453, "sim_physics": 0.047210553596759665, "survival_time": 4.3499999999999925, "driven_lanedir": 0.19517555791000785, "sim_render-ego": 0.06629826556677106, "in-drivable-lane": 0, "agent_compute-ego": 0.2228908538818359, "deviation-heading": 2.695845539854186, "set_robot_commands": 0.09525034893518208, "deviation-center-line": 0.28071531709441533, "driven_lanedir_consec": 0.19517555791000785, "sim_compute_sim_state": 0.037348988412440505, "sim_compute_performance-ego": 0.06953965110340338, "sim_compute_robot_state-ego": 0.07330321169447625, "sim_compute_robot_state-npc0": 0.06824437229112647, "sim_compute_robot_state-npc1": 0.06887793266910246, "sim_compute_robot_state-npc2": 0.06938710431942995, "sim_compute_robot_state-npc3": 0.06835003282832003}, "udem1-2-0": {"driven_any": 0.2473078900618409, "sim_physics": 0.045742905139923094, "survival_time": 4.99999999999999, "driven_lanedir": 0.21999531279774456, "sim_render-ego": 0.05696948528289795, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2092939782142639, "deviation-heading": 1.7078911397747538, "set_robot_commands": 0.0851109790802002, "deviation-center-line": 0.45697961028865475, "driven_lanedir_consec": 0.21999531279774456, "sim_compute_sim_state": 0.03450425148010254, "sim_compute_performance-ego": 0.05998872995376587, "sim_compute_robot_state-ego": 0.06568702936172485, "sim_compute_robot_state-npc0": 0.06186172246932983, "sim_compute_robot_state-npc1": 0.06185907363891602, "sim_compute_robot_state-npc2": 0.061184580326080325, "sim_compute_robot_state-npc3": 0.06085504770278931}, "udem1-3-0": {"driven_any": 0.2524469383009854, "sim_physics": 0.038207309080822635, "survival_time": 5.04999999999999, "driven_lanedir": 0.2270217345897021, "sim_render-ego": 0.0507200023915508, "in-drivable-lane": 0, "agent_compute-ego": 0.19509188019403137, "deviation-heading": 1.61616928822853, "set_robot_commands": 0.08272708760629786, "deviation-center-line": 0.4225178905570061, "driven_lanedir_consec": 0.2270217345897021, "sim_compute_sim_state": 0.03212851581006947, "sim_compute_performance-ego": 0.05540061469125276, "sim_compute_robot_state-ego": 0.06007485342497873, "sim_compute_robot_state-npc0": 0.05899994208080934, "sim_compute_robot_state-npc1": 0.05717465901138759, "sim_compute_robot_state-npc2": 0.05737137086320632, "sim_compute_robot_state-npc3": 0.05920987081999826}, "udem1-4-0": {"driven_any": 0.19897701222580724, "sim_physics": 0.037882968357631136, "survival_time": 3.4999999999999956, "driven_lanedir": 0.15902090177504702, "sim_render-ego": 0.04912925447736468, "in-drivable-lane": 0, "agent_compute-ego": 0.17902615070343017, "deviation-heading": 2.028005482296518, "set_robot_commands": 0.07703292029244559, "deviation-center-line": 0.25007455044383026, "driven_lanedir_consec": 0.15902090177504702, "sim_compute_sim_state": 0.03010031495775495, "sim_compute_performance-ego": 0.05409504004887172, "sim_compute_robot_state-ego": 0.05658420154026576, "sim_compute_robot_state-npc0": 0.057487191472734726, "sim_compute_robot_state-npc1": 0.05602566174098424, "sim_compute_robot_state-npc2": 0.053217203276497975, "sim_compute_robot_state-npc3": 0.054636457988194054}}
set_robot_commands_max	0.1077887689745104
set_robot_commands_mean	0.08958202097772723
set_robot_commands_median	0.0851109790802002
set_robot_commands_min	0.07703292029244559
sim_compute_performance-ego_max	0.07098040494832906
sim_compute_performance-ego_mean	0.06200088814912456
sim_compute_performance-ego_median	0.05998872995376587
sim_compute_performance-ego_min	0.05409504004887172
sim_compute_robot_state-ego_max	0.07558084608198286
sim_compute_robot_state-ego_mean	0.0662460284206857
sim_compute_robot_state-ego_median	0.06568702936172485
sim_compute_robot_state-ego_min	0.05658420154026576
sim_compute_robot_state-npc0_max	0.07300652469600644
sim_compute_robot_state-npc0_mean	0.06391995060200137
sim_compute_robot_state-npc0_median	0.06186172246932983
sim_compute_robot_state-npc0_min	0.057487191472734726
sim_compute_robot_state-npc1_max	0.07354598646765356
sim_compute_robot_state-npc1_mean	0.06349666270560876
sim_compute_robot_state-npc1_median	0.06185907363891602
sim_compute_robot_state-npc1_min	0.05602566174098424
sim_compute_robot_state-npc2_max	0.07257728104118828
sim_compute_robot_state-npc2_mean	0.06274750796528057
sim_compute_robot_state-npc2_median	0.061184580326080325
sim_compute_robot_state-npc2_min	0.053217203276497975
sim_compute_robot_state-npc3_max	0.0730220820452716
sim_compute_robot_state-npc3_mean	0.06321469827691466
sim_compute_robot_state-npc3_median	0.06085504770278931
sim_compute_robot_state-npc3_min	0.054636457988194054
sim_compute_sim_state_max	0.04063838237040752
sim_compute_sim_state_mean	0.034944090606155
sim_compute_sim_state_median	0.03450425148010254
sim_compute_sim_state_min	0.03010031495775495
sim_physics_max	0.047210553596759665
sim_physics_mean	0.0430021448772832
sim_physics_median	0.045742905139923094
sim_physics_min	0.037882968357631136
sim_render-ego_max	0.06629826556677106
sim_render-ego_mean	0.0578654319022462
sim_render-ego_median	0.05696948528289795
sim_render-ego_min	0.04912925447736468
simulation-passed	1
survival_time_max	5.549999999999988
survival_time_mean	4.6899999999999915
survival_time_min	3.4999999999999956

No reset possible

19750

2952

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 07:45:44+00:00

2019-04-25 08:00:03+00:00

0:14:19

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19750-262910', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19750-262910', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19750-262910', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19723

3031

Manfred Diaz

challenge-aido_LF-template-pytorch

step1-simulation

error