Evaluator 803

2019-04-26 11:54:34+00:00

2019-04-26 11:57:37+00:00

0:03:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

20658

3079

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-26 10:02:32+00:00

2019-04-26 10:30:00+00:00

0:27:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8552652605306534
survival_time_median	14.950000000000076
deviation-center-line_median	0.6299211529848875
in-drivable-lane_median	2.3500000000000334

other stats

agent_compute-ego_max	0.21704580624898276
agent_compute-ego_mean	0.18099973272480704
agent_compute-ego_median	0.20021619348444492
agent_compute-ego_min	0.13134114670031
deviation-center-line_max	1.1268512253639291
deviation-center-line_mean	0.6420532775071857
deviation-center-line_min	0.39602713017350016
deviation-heading_max	1.6177934604543107
deviation-heading_mean	1.3722630533434508
deviation-heading_median	1.5509541180001003
deviation-heading_min	1.0129138199635006
driven_any_max	1.3762707981201865
driven_any_mean	1.0155024929914342
driven_any_median	1.374030399028702
driven_any_min	0.4335428665924545
driven_lanedir_consec_max	0.913911645193741
driven_lanedir_consec_mean	0.7129217152650552
driven_lanedir_consec_min	0.4231274396910571
driven_lanedir_max	1.148076981754968
driven_lanedir_mean	0.7597547825773006
driven_lanedir_median	0.8552652605306534
driven_lanedir_min	0.4231274396910571
in-drivable-lane_max	5.400000000000077
in-drivable-lane_mean	2.5900000000000367
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.374030399028702, "sim_physics": 0.1991145118077596, "survival_time": 14.950000000000076, "driven_lanedir": 1.148076981754968, "sim_render-ego": 0.0592782727877299, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.20554759899775188, "deviation-heading": 1.0129138199635006, "set_robot_commands": 0.09130494594573976, "deviation-center-line": 1.1268512253639291, "driven_lanedir_consec": 0.913911645193741, "sim_compute_sim_state": 0.036864869594573975, "sim_compute_performance-ego": 0.0667854889233907, "sim_compute_robot_state-ego": 0.06958546161651612, "sim_compute_robot_state-npc0": 0.06480738798777262, "sim_compute_robot_state-npc1": 0.06466429630915324, "sim_compute_robot_state-npc2": 0.06310917854309082, "sim_compute_robot_state-npc3": 0.06379700342814128}, "udem1-1-0": {"driven_any": 0.5181031782512632, "sim_physics": 0.1653288327730619, "survival_time": 5.849999999999987, "driven_lanedir": 0.49825134893890377, "sim_render-ego": 0.05718820115439912, "in-drivable-lane": 0, "agent_compute-ego": 0.20021619348444492, "deviation-heading": 1.6177934604543107, "set_robot_commands": 0.09232814087826982, "deviation-center-line": 0.4238838695042459, "driven_lanedir_consec": 0.49825134893890377, "sim_compute_sim_state": 0.038170745230128623, "sim_compute_performance-ego": 0.0646208922068278, "sim_compute_robot_state-ego": 0.06919744279649523, "sim_compute_robot_state-npc0": 0.06249598356393667, "sim_compute_robot_state-npc1": 0.06443189759539743, "sim_compute_robot_state-npc2": 0.06530562221494496, "sim_compute_robot_state-npc3": 0.06531676064189683}, "udem1-2-0": {"driven_any": 1.3762707981201865, "sim_physics": 0.1895594612757365, "survival_time": 14.950000000000076, "driven_lanedir": 0.8552652605306534, "sim_render-ego": 0.06104262590408325, "in-drivable-lane": 5.400000000000077, "agent_compute-ego": 0.21704580624898276, "deviation-heading": 1.5828388331948655, "set_robot_commands": 0.09201013644536336, "deviation-center-line": 0.6299211529848875, "driven_lanedir_consec": 0.8552652605306534, "sim_compute_sim_state": 0.036451849142710366, "sim_compute_performance-ego": 0.06697321176528931, "sim_compute_robot_state-ego": 0.07078291813532511, "sim_compute_robot_state-npc0": 0.0679572836558024, "sim_compute_robot_state-npc1": 0.06640398899714152, "sim_compute_robot_state-npc2": 0.06487234989802043, "sim_compute_robot_state-npc3": 0.06561144987742105}, "udem1-3-0": {"driven_any": 1.3755652229645652, "sim_physics": 0.13840012232462565, "survival_time": 14.950000000000076, "driven_lanedir": 0.8740528819709206, "sim_render-ego": 0.0448609201113383, "in-drivable-lane": 5.200000000000074, "agent_compute-ego": 0.15084791819254556, "deviation-heading": 1.5509541180001003, "set_robot_commands": 0.07095683495203654, "deviation-center-line": 0.6335830095093654, "driven_lanedir_consec": 0.8740528819709206, "sim_compute_sim_state": 0.028993585109710698, "sim_compute_performance-ego": 0.04917141755421956, "sim_compute_robot_state-ego": 0.050866858959198, "sim_compute_robot_state-npc0": 0.05216953674952189, "sim_compute_robot_state-npc1": 0.050088510513305665, "sim_compute_robot_state-npc2": 0.05008921464284261, "sim_compute_robot_state-npc3": 0.053831695715586346}, "udem1-4-0": {"driven_any": 0.4335428665924545, "sim_physics": 0.10267624710545396, "survival_time": 4.94999999999999, "driven_lanedir": 0.4231274396910571, "sim_render-ego": 0.03902101998377328, "in-drivable-lane": 0, "agent_compute-ego": 0.13134114670031, "deviation-heading": 1.0968150351044763, "set_robot_commands": 0.059974010544593885, "deviation-center-line": 0.39602713017350016, "driven_lanedir_consec": 0.4231274396910571, "sim_compute_sim_state": 0.023462950581251973, "sim_compute_performance-ego": 0.041650463836361666, "sim_compute_robot_state-ego": 0.04212750569738523, "sim_compute_robot_state-npc0": 0.04367628964510831, "sim_compute_robot_state-npc1": 0.042165260122279925, "sim_compute_robot_state-npc2": 0.04131845271948612, "sim_compute_robot_state-npc3": 0.04080918581798823}}
set_robot_commands_max	0.09232814087826982
set_robot_commands_mean	0.08131481375320068
set_robot_commands_median	0.09130494594573976
set_robot_commands_min	0.059974010544593885
sim_compute_performance-ego_max	0.06697321176528931
sim_compute_performance-ego_mean	0.05784029485721781
sim_compute_performance-ego_median	0.0646208922068278
sim_compute_performance-ego_min	0.041650463836361666
sim_compute_robot_state-ego_max	0.07078291813532511
sim_compute_robot_state-ego_mean	0.060512037440983935
sim_compute_robot_state-ego_median	0.06919744279649523
sim_compute_robot_state-ego_min	0.04212750569738523
sim_compute_robot_state-npc0_max	0.0679572836558024
sim_compute_robot_state-npc0_mean	0.058221296320428384
sim_compute_robot_state-npc0_median	0.06249598356393667
sim_compute_robot_state-npc0_min	0.04367628964510831
sim_compute_robot_state-npc1_max	0.06640398899714152
sim_compute_robot_state-npc1_mean	0.05755079070745556
sim_compute_robot_state-npc1_median	0.06443189759539743
sim_compute_robot_state-npc1_min	0.042165260122279925
sim_compute_robot_state-npc2_max	0.06530562221494496
sim_compute_robot_state-npc2_mean	0.05693896360367699
sim_compute_robot_state-npc2_median	0.06310917854309082
sim_compute_robot_state-npc2_min	0.04131845271948612
sim_compute_robot_state-npc3_max	0.06561144987742105
sim_compute_robot_state-npc3_mean	0.057873219096206754
sim_compute_robot_state-npc3_median	0.06379700342814128
sim_compute_robot_state-npc3_min	0.04080918581798823
sim_compute_sim_state_max	0.038170745230128623
sim_compute_sim_state_mean	0.032788799931675126
sim_compute_sim_state_median	0.036451849142710366
sim_compute_sim_state_min	0.023462950581251973
sim_physics_max	0.1991145118077596
sim_physics_mean	0.15901583505732753
sim_physics_median	0.1653288327730619
sim_physics_min	0.10267624710545396
sim_render-ego_max	0.06104262590408325
sim_render-ego_mean	0.05227820798826477
sim_render-ego_median	0.05718820115439912
sim_render-ego_min	0.03902101998377328
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.130000000000042
survival_time_min	4.94999999999999

No reset possible

20639

2372

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 15:11:48+00:00

2019-04-25 15:26:03+00:00

0:14:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.658141340093886
survival_time_median	6.999999999999983
deviation-center-line_median	0.3310166859136158
in-drivable-lane_median	2.0499999999999927

other stats

agent_compute-ego_max	0.15390561648777554
agent_compute-ego_mean	0.12667592140940775
agent_compute-ego_median	0.11962280528885978
agent_compute-ego_min	0.09000734298948258
deviation-center-line_max	0.4794323637301212
deviation-center-line_mean	0.3427896670341769
deviation-center-line_min	0.2298545284155696
deviation-heading_max	1.1504193675314938
deviation-heading_mean	0.9407336626620916
deviation-heading_median	0.9938354337214896
deviation-heading_min	0.7450586214352332
driven_any_max	1.6290075912696764
driven_any_mean	1.0117836241191598
driven_any_median	0.9970530395825568
driven_any_min	0.4251549262204664
driven_lanedir_consec_max	1.214560148863141
driven_lanedir_consec_mean	0.7110836872382787
driven_lanedir_consec_min	0.4039437775266599
driven_lanedir_max	1.214560148863141
driven_lanedir_mean	0.7110836872382787
driven_lanedir_median	0.658141340093886
driven_lanedir_min	0.4039437775266599
in-drivable-lane_max	5.000000000000038
in-drivable-lane_mean	1.8700000000000128
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.1528001138142177, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.062339557920183454, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15390561648777554, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.0916002767426627, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.03968163899012974, "sim_compute_performance-ego": 0.06754117012023926, "sim_compute_robot_state-ego": 0.07054943527494158, "sim_compute_robot_state-npc0": 0.06965458052498953, "sim_compute_robot_state-npc1": 0.07029910598482404, "sim_compute_robot_state-npc2": 0.06871064220155988, "sim_compute_robot_state-npc3": 0.06951752730778285}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.43097149972321946, "sim_physics": 0.1484827628502479, "survival_time": 3.2499999999999964, "driven_lanedir": 0.4039437775266599, "sim_render-ego": 0.06084691927983211, "in-drivable-lane": 0, "agent_compute-ego": 0.1510323744553786, "deviation-heading": 1.1504193675314938, "set_robot_commands": 0.09745139342087966, "deviation-center-line": 0.23438865875177528, "driven_lanedir_consec": 0.4039437775266599, "sim_compute_sim_state": 0.03726522739116962, "sim_compute_performance-ego": 0.07067939684941218, "sim_compute_robot_state-ego": 0.07306293340829703, "sim_compute_robot_state-npc0": 0.07228746047386757, "sim_compute_robot_state-npc1": 0.07042047427250789, "sim_compute_robot_state-npc2": 0.07062310805687537, "sim_compute_robot_state-npc3": 0.06813139548668494}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6290075912696764, "sim_physics": 0.11848940061671394, "survival_time": 11.200000000000024, "driven_lanedir": 0.8652843360363267, "sim_render-ego": 0.0464061764734132, "in-drivable-lane": 5.000000000000038, "agent_compute-ego": 0.11962280528885978, "deviation-heading": 1.007919996470557, "set_robot_commands": 0.07347625174692698, "deviation-center-line": 0.4794323637301212, "driven_lanedir_consec": 0.8652843360363267, "sim_compute_sim_state": 0.03074647379773004, "sim_compute_performance-ego": 0.05035947050367083, "sim_compute_robot_state-ego": 0.05331077213798251, "sim_compute_robot_state-npc0": 0.05501759797334671, "sim_compute_robot_state-npc1": 0.05323979471411024, "sim_compute_robot_state-npc2": 0.052521311811038425, "sim_compute_robot_state-npc3": 0.05350907679115023}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.57673106379988, "sim_physics": 0.12320730543356335, "survival_time": 10.85000000000002, "driven_lanedir": 1.214560148863141, "sim_render-ego": 0.04731688960905998, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.1188114678255424, "deviation-heading": 0.9938354337214896, "set_robot_commands": 0.07180648245569747, "deviation-center-line": 0.4392560983598026, "driven_lanedir_consec": 1.214560148863141, "sim_compute_sim_state": 0.03157699712410501, "sim_compute_performance-ego": 0.051480676721317974, "sim_compute_robot_state-ego": 0.052240032204834544, "sim_compute_robot_state-npc0": 0.05383568535202659, "sim_compute_robot_state-npc1": 0.05258615005950225, "sim_compute_robot_state-npc2": 0.053095424230197606, "sim_compute_robot_state-npc3": 0.05372920014341855}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4251549262204664, "sim_physics": 0.07063564800080799, "survival_time": 3.149999999999997, "driven_lanedir": 0.4134888336713798, "sim_render-ego": 0.04107583893669976, "in-drivable-lane": 0, "agent_compute-ego": 0.09000734298948258, "deviation-heading": 0.7450586214352332, "set_robot_commands": 0.054996622933281794, "deviation-center-line": 0.2298545284155696, "driven_lanedir_consec": 0.4134888336713798, "sim_compute_sim_state": 0.0220293090457008, "sim_compute_performance-ego": 0.03781843942309183, "sim_compute_robot_state-ego": 0.039784484439426, "sim_compute_robot_state-npc0": 0.03965016016884455, "sim_compute_robot_state-npc1": 0.038692391107952785, "sim_compute_robot_state-npc2": 0.03866448478093223, "sim_compute_robot_state-npc3": 0.039042419857449}}
set_robot_commands_max	0.09745139342087966
set_robot_commands_mean	0.07786620545988973
set_robot_commands_median	0.07347625174692698
set_robot_commands_min	0.054996622933281794
sim_compute_performance-ego_max	0.07067939684941218
sim_compute_performance-ego_mean	0.055575830723546424
sim_compute_performance-ego_median	0.051480676721317974
sim_compute_performance-ego_min	0.03781843942309183
sim_compute_robot_state-ego_max	0.07306293340829703
sim_compute_robot_state-ego_mean	0.05778953149309633
sim_compute_robot_state-ego_median	0.05331077213798251
sim_compute_robot_state-ego_min	0.039784484439426
sim_compute_robot_state-npc0_max	0.07228746047386757
sim_compute_robot_state-npc0_mean	0.05808909689861499
sim_compute_robot_state-npc0_median	0.05501759797334671
sim_compute_robot_state-npc0_min	0.03965016016884455
sim_compute_robot_state-npc1_max	0.07042047427250789
sim_compute_robot_state-npc1_mean	0.05704758322777944
sim_compute_robot_state-npc1_median	0.05323979471411024
sim_compute_robot_state-npc1_min	0.038692391107952785
sim_compute_robot_state-npc2_max	0.07062310805687537
sim_compute_robot_state-npc2_mean	0.056722994216120703
sim_compute_robot_state-npc2_median	0.053095424230197606
sim_compute_robot_state-npc2_min	0.03866448478093223
sim_compute_robot_state-npc3_max	0.06951752730778285
sim_compute_robot_state-npc3_mean	0.05678592391729712
sim_compute_robot_state-npc3_median	0.05372920014341855
sim_compute_robot_state-npc3_min	0.039042419857449
sim_compute_sim_state_max	0.03968163899012974
sim_compute_sim_state_mean	0.03225992926976704
sim_compute_sim_state_median	0.03157699712410501
sim_compute_sim_state_min	0.0220293090457008
sim_physics_max	0.1528001138142177
sim_physics_mean	0.12272304614311018
sim_physics_median	0.12320730543356335
sim_physics_min	0.07063564800080799
sim_render-ego_max	0.062339557920183454
sim_render-ego_mean	0.051597076443837694
sim_render-ego_median	0.04731688960905998
sim_render-ego_min	0.04107583893669976
simulation-passed	1
survival_time_max	11.200000000000024
survival_time_mean	7.090000000000005
survival_time_min	3.149999999999997

No reset possible

20621

2367

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 15:00:22+00:00

2019-04-25 15:11:36+00:00

0:11:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.20221857079919775
agent_compute-ego_mean	0.14867575092148444
agent_compute-ego_median	0.13021231909929695
agent_compute-ego_min	0.11894510984420777
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.27278356732062575, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.08592210850625667, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.20221857079919775, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.13887503462017708, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.05391313894739691, "sim_compute_performance-ego": 0.09877104804200948, "sim_compute_robot_state-ego": 0.11003096598499226, "sim_compute_robot_state-npc0": 0.09668248329522476, "sim_compute_robot_state-npc1": 0.09611159225679794, "sim_compute_robot_state-npc2": 0.09469869676625954, "sim_compute_robot_state-npc3": 0.097095750412851}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.1904051701227824, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.07288563251495361, "in-drivable-lane": 0, "agent_compute-ego": 0.16451727350552878, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.1151319642861684, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.045100897550582886, "sim_compute_performance-ego": 0.08161654074986775, "sim_compute_robot_state-ego": 0.09091344475746156, "sim_compute_robot_state-npc0": 0.08366692066192627, "sim_compute_robot_state-npc1": 0.0794592301050822, "sim_compute_robot_state-npc2": 0.08193660775820415, "sim_compute_robot_state-npc3": 0.0817495087782542}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.1733806214090121, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06069221739041603, "in-drivable-lane": 0, "agent_compute-ego": 0.13021231909929695, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09372488118834414, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.039139909259343554, "sim_compute_performance-ego": 0.06724639262183238, "sim_compute_robot_state-ego": 0.06900907371003749, "sim_compute_robot_state-npc0": 0.06676439511573921, "sim_compute_robot_state-npc1": 0.06397427542734954, "sim_compute_robot_state-npc2": 0.06494821532297942, "sim_compute_robot_state-npc3": 0.06774746361425367}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.1808814921621549, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05883791487095719, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.12748548135919086, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.09316176075046344, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.03714533983650854, "sim_compute_performance-ego": 0.06546783851364911, "sim_compute_robot_state-ego": 0.0714043439444849, "sim_compute_robot_state-npc0": 0.06924890259564934, "sim_compute_robot_state-npc1": 0.06774888200274969, "sim_compute_robot_state-npc2": 0.06705391204963296, "sim_compute_robot_state-npc3": 0.06637638706271931}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.1254905104637146, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.05433815717697144, "in-drivable-lane": 0, "agent_compute-ego": 0.11894510984420777, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.07926728725433349, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.0345726728439331, "sim_compute_performance-ego": 0.059012436866760255, "sim_compute_robot_state-ego": 0.06184121370315552, "sim_compute_robot_state-npc0": 0.06024610996246338, "sim_compute_robot_state-npc1": 0.06092649698257446, "sim_compute_robot_state-npc2": 0.05846458673477173, "sim_compute_robot_state-npc3": 0.06023273468017578}}
set_robot_commands_max	0.13887503462017708
set_robot_commands_mean	0.10403218561989731
set_robot_commands_median	0.09372488118834414
set_robot_commands_min	0.07926728725433349
sim_compute_performance-ego_max	0.09877104804200948
sim_compute_performance-ego_mean	0.07442285135882379
sim_compute_performance-ego_median	0.06724639262183238
sim_compute_performance-ego_min	0.059012436866760255
sim_compute_robot_state-ego_max	0.11003096598499226
sim_compute_robot_state-ego_mean	0.08063980842002635
sim_compute_robot_state-ego_median	0.0714043439444849
sim_compute_robot_state-ego_min	0.06184121370315552
sim_compute_robot_state-npc0_max	0.09668248329522476
sim_compute_robot_state-npc0_mean	0.07532176232620058
sim_compute_robot_state-npc0_median	0.06924890259564934
sim_compute_robot_state-npc0_min	0.06024610996246338
sim_compute_robot_state-npc1_max	0.09611159225679794
sim_compute_robot_state-npc1_mean	0.07364409535491076
sim_compute_robot_state-npc1_median	0.06774888200274969
sim_compute_robot_state-npc1_min	0.06092649698257446
sim_compute_robot_state-npc2_max	0.09469869676625954
sim_compute_robot_state-npc2_mean	0.07342040372636956
sim_compute_robot_state-npc2_median	0.06705391204963296
sim_compute_robot_state-npc2_min	0.05846458673477173
sim_compute_robot_state-npc3_max	0.097095750412851
sim_compute_robot_state-npc3_mean	0.07464036890965078
sim_compute_robot_state-npc3_median	0.06774746361425367
sim_compute_robot_state-npc3_min	0.06023273468017578
sim_compute_sim_state_max	0.05391313894739691
sim_compute_sim_state_mean	0.041974391687553
sim_compute_sim_state_median	0.039139909259343554
sim_compute_sim_state_min	0.0345726728439331
sim_physics_max	0.27278356732062575
sim_physics_mean	0.18858827229565792
sim_physics_median	0.1808814921621549
sim_physics_min	0.1254905104637146
sim_render-ego_max	0.08592210850625667
sim_render-ego_mean	0.06653520609191099
sim_render-ego_median	0.06069221739041603
sim_render-ego_min	0.05433815717697144
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20608

2383

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-25 14:55:50+00:00

2019-04-25 15:00:05+00:00

0:04:15

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20608-498005', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20608-498005', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20608-498005', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20580

2409

jiang peng

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-25 14:31:44+00:00

2019-04-25 14:55:44+00:00

0:24:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.3397390356601346
survival_time_median	14.950000000000076
deviation-center-line_median	1.401141803909748
in-drivable-lane_median	2.500000000000013

other stats

agent_compute-ego_max	0.16594029823939005
agent_compute-ego_mean	0.16167020336786905
agent_compute-ego_median	0.16087575594584147
agent_compute-ego_min	0.15768765926361084
deviation-center-line_max	1.5194332589791988
deviation-center-line_mean	1.1743762518416452
deviation-center-line_min	0.26891847472491964
deviation-heading_max	8.492476633385415
deviation-heading_mean	7.583649780851511
deviation-heading_median	8.165190079878816
deviation-heading_min	5.589657549909816
driven_any_max	4.378320939674851
driven_any_mean	4.378320939674839
driven_any_median	4.3783209396748415
driven_any_min	4.378320939674831
driven_lanedir_consec_max	-1.3111163275808764
driven_lanedir_consec_mean	-1.342604284062788
driven_lanedir_consec_min	-1.3761077892801137
driven_lanedir_max	-1.3397390356601346
driven_lanedir_mean	-2.354812195437246
driven_lanedir_median	-2.597977359892488
driven_lanedir_min	-2.711272268924253
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	3.570000000000019
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.10510260343551636, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272268924253, "sim_render-ego": 0.05693525155385335, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15768765926361084, "deviation-heading": 8.371542541054902, "set_robot_commands": 0.08645618677139283, "deviation-center-line": 1.5194332589791988, "driven_lanedir_consec": -1.3111163275808764, "sim_compute_sim_state": 0.037081972757975264, "sim_compute_performance-ego": 0.06455182790756225, "sim_compute_robot_state-ego": 0.06914166291554769}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378320939674851, "sim_physics": 0.12131864388783772, "survival_time": 14.950000000000076, "driven_lanedir": -2.448035866142366, "sim_render-ego": 0.06235872586568197, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.16594029823939005, "deviation-heading": 7.299382100028609, "set_robot_commands": 0.09458757718404134, "deviation-center-line": 1.1659435662933817, "driven_lanedir_consec": -1.3761077892801137, "sim_compute_sim_state": 0.039675626754760746, "sim_compute_performance-ego": 0.06926504055658976, "sim_compute_robot_state-ego": 0.07571401993433634}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.3783209396748415, "sim_physics": 0.1087660535176595, "survival_time": 14.950000000000076, "driven_lanedir": -1.3397390356601346, "sim_render-ego": 0.0613130005200704, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.16087575594584147, "deviation-heading": 5.589657549909816, "set_robot_commands": 0.08798852761586508, "deviation-center-line": 0.26891847472491964, "driven_lanedir_consec": -1.3397390356601346, "sim_compute_sim_state": 0.03704302946726481, "sim_compute_performance-ego": 0.0655109182993571, "sim_compute_robot_state-ego": 0.0698449691136678}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378320939674831, "sim_physics": 0.11858521064122518, "survival_time": 14.950000000000076, "driven_lanedir": -2.677036446566989, "sim_render-ego": 0.05908690849939982, "in-drivable-lane": 2.2000000000000117, "agent_compute-ego": 0.1579890553156535, "deviation-heading": 8.492476633385415, "set_robot_commands": 0.08830940643946329, "deviation-center-line": 1.5164441553009778, "driven_lanedir_consec": -1.3182655771745324, "sim_compute_sim_state": 0.03735341310501099, "sim_compute_performance-ego": 0.06443435589472453, "sim_compute_robot_state-ego": 0.07023186763127645}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378320939674831, "sim_physics": 0.13092415809631347, "survival_time": 14.950000000000076, "driven_lanedir": -2.597977359892488, "sim_render-ego": 0.06281511545181274, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.16585824807484945, "deviation-heading": 8.165190079878816, "set_robot_commands": 0.09249839067459106, "deviation-center-line": 1.401141803909748, "driven_lanedir_consec": -1.367792690618283, "sim_compute_sim_state": 0.04032243569691976, "sim_compute_performance-ego": 0.06883136590321859, "sim_compute_robot_state-ego": 0.07564660549163818}}
set_robot_commands_max	0.09458757718404134
set_robot_commands_mean	0.08996801773707072
set_robot_commands_median	0.08830940643946329
set_robot_commands_min	0.08645618677139283
sim_compute_performance-ego_max	0.06926504055658976
sim_compute_performance-ego_mean	0.06651870171229045
sim_compute_performance-ego_median	0.0655109182993571
sim_compute_performance-ego_min	0.06443435589472453
sim_compute_robot_state-ego_max	0.07571401993433634
sim_compute_robot_state-ego_mean	0.0721158250172933
sim_compute_robot_state-ego_median	0.07023186763127645
sim_compute_robot_state-ego_min	0.06914166291554769
sim_compute_sim_state_max	0.04032243569691976
sim_compute_sim_state_mean	0.03829529555638632
sim_compute_sim_state_median	0.03735341310501099
sim_compute_sim_state_min	0.03704302946726481
sim_physics_max	0.13092415809631347
sim_physics_mean	0.11693933391571046
sim_physics_median	0.11858521064122518
sim_physics_min	0.10510260343551636
sim_render-ego_max	0.06281511545181274
sim_render-ego_mean	0.06050180037816366
sim_render-ego_median	0.0613130005200704
sim_render-ego_min	0.05693525155385335
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20573

2424

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-25 14:22:55+00:00

2019-04-25 14:31:32+00:00

0:08:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1455615282058716
agent_compute-ego_mean	0.1371206818609499
agent_compute-ego_median	0.13538756613004005
agent_compute-ego_min	0.13200944999478895
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1632623200146657, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.058720779868791685, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.13200944999478895, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.09441943438547962, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03897821228459196, "sim_compute_performance-ego": 0.0687018115565462, "sim_compute_robot_state-ego": 0.07231376530989161, "sim_compute_robot_state-npc0": 0.06743716518833952, "sim_compute_robot_state-npc1": 0.065760630481648, "sim_compute_robot_state-npc2": 0.0649771510430102, "sim_compute_robot_state-npc3": 0.06674865281806802}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.1454639434814453, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.06560264031092326, "in-drivable-lane": 0, "agent_compute-ego": 0.13994588454564413, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.0901443362236023, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03933867812156677, "sim_compute_performance-ego": 0.0715980331103007, "sim_compute_robot_state-ego": 0.07027353843053182, "sim_compute_robot_state-npc0": 0.06605523824691772, "sim_compute_robot_state-npc1": 0.06555488705635071, "sim_compute_robot_state-npc2": 0.06534385681152344, "sim_compute_robot_state-npc3": 0.06908230980237325}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.17128531811601025, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.06052450406349311, "in-drivable-lane": 0, "agent_compute-ego": 0.13538756613004005, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.09212765855304264, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.03917976961297504, "sim_compute_performance-ego": 0.06683428812835177, "sim_compute_robot_state-ego": 0.07024967872490318, "sim_compute_robot_state-npc0": 0.07005933583792993, "sim_compute_robot_state-npc1": 0.07042277465432377, "sim_compute_robot_state-npc2": 0.06938367778972043, "sim_compute_robot_state-npc3": 0.0689128899978379}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.18253542609133963, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.056556240986969514, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.13269898042840472, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.0946140248896712, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.037762662111702615, "sim_compute_performance-ego": 0.0632234508708372, "sim_compute_robot_state-ego": 0.0701698489108328, "sim_compute_robot_state-npc0": 0.0642832497418937, "sim_compute_robot_state-npc1": 0.0606946783550715, "sim_compute_robot_state-npc2": 0.06333765337022684, "sim_compute_robot_state-npc3": 0.061920557991933016}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.12451684474945068, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.057179951667785646, "in-drivable-lane": 0, "agent_compute-ego": 0.1455615282058716, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.0839804768562317, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.04774531126022339, "sim_compute_performance-ego": 0.05981491804122925, "sim_compute_robot_state-ego": 0.06077196598052979, "sim_compute_robot_state-npc0": 0.05902073383331299, "sim_compute_robot_state-npc1": 0.059844911098480225, "sim_compute_robot_state-npc2": 0.05667349100112915, "sim_compute_robot_state-npc3": 0.0598939061164856}}
set_robot_commands_max	0.0946140248896712
set_robot_commands_mean	0.09105718618160548
set_robot_commands_median	0.09212765855304264
set_robot_commands_min	0.0839804768562317
sim_compute_performance-ego_max	0.0715980331103007
sim_compute_performance-ego_mean	0.06603450034145303
sim_compute_performance-ego_median	0.06683428812835177
sim_compute_performance-ego_min	0.05981491804122925
sim_compute_robot_state-ego_max	0.07231376530989161
sim_compute_robot_state-ego_mean	0.06875575947133786
sim_compute_robot_state-ego_median	0.07024967872490318
sim_compute_robot_state-ego_min	0.06077196598052979
sim_compute_robot_state-npc0_max	0.07005933583792993
sim_compute_robot_state-npc0_mean	0.06537114456967877
sim_compute_robot_state-npc0_median	0.06605523824691772
sim_compute_robot_state-npc0_min	0.05902073383331299
sim_compute_robot_state-npc1_max	0.07042277465432377
sim_compute_robot_state-npc1_mean	0.06445557632917484
sim_compute_robot_state-npc1_median	0.06555488705635071
sim_compute_robot_state-npc1_min	0.059844911098480225
sim_compute_robot_state-npc2_max	0.06938367778972043
sim_compute_robot_state-npc2_mean	0.06394316600312203
sim_compute_robot_state-npc2_median	0.0649771510430102
sim_compute_robot_state-npc2_min	0.05667349100112915
sim_compute_robot_state-npc3_max	0.06908230980237325
sim_compute_robot_state-npc3_mean	0.06531166334533955
sim_compute_robot_state-npc3_median	0.06674865281806802
sim_compute_robot_state-npc3_min	0.0598939061164856
sim_compute_sim_state_max	0.04774531126022339
sim_compute_sim_state_mean	0.040600926678211954
sim_compute_sim_state_median	0.03917976961297504
sim_compute_sim_state_min	0.037762662111702615
sim_physics_max	0.18253542609133963
sim_physics_mean	0.1574127704905823
sim_physics_median	0.1632623200146657
sim_physics_min	0.12451684474945068
sim_render-ego_max	0.06560264031092326
sim_render-ego_mean	0.05971682337959264
sim_render-ego_median	0.058720779868791685
sim_render-ego_min	0.056556240986969514
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20566

2433

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-25 14:21:36+00:00

2019-04-25 14:22:14+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20560

2441

Jacopo Tani

random_agent

step1-simulation

success

2019-04-25 14:13:24+00:00

2019-04-25 14:21:22+00:00

0:07:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.14658660951413607
agent_compute-ego_mean	0.14141180020622357
agent_compute-ego_median	0.14051537330334002
agent_compute-ego_min	0.13465515772501627
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.12555502945522093, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.05563343246028109, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1391613303490405, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.0880458894765602, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.035288653283748986, "sim_compute_performance-ego": 0.061600419710267265, "sim_compute_robot_state-ego": 0.06597751941321031, "sim_compute_robot_state-npc0": 0.06183818151366035, "sim_compute_robot_state-npc1": 0.06073564853308336, "sim_compute_robot_state-npc2": 0.05794329013464586, "sim_compute_robot_state-npc3": 0.05996015836607735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.13865923881530762, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.05742431603945219, "in-drivable-lane": 0, "agent_compute-ego": 0.14051537330334002, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.08473496253673847, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.03851565947899452, "sim_compute_performance-ego": 0.06534813000605656, "sim_compute_robot_state-ego": 0.0677875463779156, "sim_compute_robot_state-npc0": 0.0648897519478431, "sim_compute_robot_state-npc1": 0.06804702832148625, "sim_compute_robot_state-npc2": 0.07042592305403489, "sim_compute_robot_state-npc3": 0.06652389122889592}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.14877157462270638, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.05669210145347997, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.14658660951413607, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.09178916717830456, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.037126625839032625, "sim_compute_performance-ego": 0.0632998315911544, "sim_compute_robot_state-ego": 0.06936165219859074, "sim_compute_robot_state-npc0": 0.06499786439694856, "sim_compute_robot_state-npc1": 0.06586448769820363, "sim_compute_robot_state-npc2": 0.06391768706472296, "sim_compute_robot_state-npc3": 0.0656254950322603}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.1533511831790586, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.05729387983491149, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.14614053013958508, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.0902844501447074, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03827104990995383, "sim_compute_performance-ego": 0.06500127043905138, "sim_compute_robot_state-ego": 0.0697946548461914, "sim_compute_robot_state-npc0": 0.0678982463064073, "sim_compute_robot_state-npc1": 0.06757062296324139, "sim_compute_robot_state-npc2": 0.0660498987270307, "sim_compute_robot_state-npc3": 0.0670765562902523}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.12038801334522388, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.05668355800487377, "in-drivable-lane": 0, "agent_compute-ego": 0.13465515772501627, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.08878152458756058, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.03356445277178729, "sim_compute_performance-ego": 0.05697034906457971, "sim_compute_robot_state-ego": 0.059535353272049514, "sim_compute_robot_state-npc0": 0.06321509679158528, "sim_compute_robot_state-npc1": 0.0593360530005561, "sim_compute_robot_state-npc2": 0.07060218740392614, "sim_compute_robot_state-npc3": 0.05985212326049805}}
set_robot_commands_max	0.09178916717830456
set_robot_commands_mean	0.08872719878477427
set_robot_commands_median	0.08878152458756058
set_robot_commands_min	0.08473496253673847
sim_compute_performance-ego_max	0.06534813000605656
sim_compute_performance-ego_mean	0.06244400016222186
sim_compute_performance-ego_median	0.0632998315911544
sim_compute_performance-ego_min	0.05697034906457971
sim_compute_robot_state-ego_max	0.0697946548461914
sim_compute_robot_state-ego_mean	0.06649134522159152
sim_compute_robot_state-ego_median	0.0677875463779156
sim_compute_robot_state-ego_min	0.059535353272049514
sim_compute_robot_state-npc0_max	0.0678982463064073
sim_compute_robot_state-npc0_mean	0.06456782819128891
sim_compute_robot_state-npc0_median	0.0648897519478431
sim_compute_robot_state-npc0_min	0.06183818151366035
sim_compute_robot_state-npc1_max	0.06804702832148625
sim_compute_robot_state-npc1_mean	0.06431076810331415
sim_compute_robot_state-npc1_median	0.06586448769820363
sim_compute_robot_state-npc1_min	0.0593360530005561
sim_compute_robot_state-npc2_max	0.07060218740392614
sim_compute_robot_state-npc2_mean	0.06578779727687212
sim_compute_robot_state-npc2_median	0.0660498987270307
sim_compute_robot_state-npc2_min	0.05794329013464586
sim_compute_robot_state-npc3_max	0.0670765562902523
sim_compute_robot_state-npc3_mean	0.06380764483559678
sim_compute_robot_state-npc3_median	0.0656254950322603
sim_compute_robot_state-npc3_min	0.05985212326049805
sim_compute_sim_state_max	0.03851565947899452
sim_compute_sim_state_mean	0.03655328825670345
sim_compute_sim_state_median	0.037126625839032625
sim_compute_sim_state_min	0.03356445277178729
sim_physics_max	0.1533511831790586
sim_physics_mean	0.13734500788350348
sim_physics_median	0.13865923881530762
sim_physics_min	0.12038801334522388
sim_render-ego_max	0.05742431603945219
sim_render-ego_mean	0.0567454575585997
sim_render-ego_median	0.05669210145347997
sim_render-ego_min	0.05563343246028109
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20543

2471

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 14:05:21+00:00

2019-04-25 14:12:53+00:00

0:07:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.1441627043598103
agent_compute-ego_mean	0.12911485004296291
agent_compute-ego_median	0.13438054367348
agent_compute-ego_min	0.09636821196629453
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.13117703401817463, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.05560416995354418, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1441627043598103, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.0871241992374636, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.039594492822323205, "sim_compute_performance-ego": 0.06582507097496176, "sim_compute_robot_state-ego": 0.06749245355714042, "sim_compute_robot_state-npc0": 0.06114670915423699, "sim_compute_robot_state-npc1": 0.06289755173449246, "sim_compute_robot_state-npc2": 0.06584171978932507, "sim_compute_robot_state-npc3": 0.0658788321153173}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.09778730685894306, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.041894931059617266, "in-drivable-lane": 0, "agent_compute-ego": 0.09636821196629453, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.05708588086641752, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.02432695718911978, "sim_compute_performance-ego": 0.04475003939408522, "sim_compute_robot_state-ego": 0.04882595172295204, "sim_compute_robot_state-npc0": 0.04572560237004207, "sim_compute_robot_state-npc1": 0.044373429738558255, "sim_compute_robot_state-npc2": 0.04375509115365835, "sim_compute_robot_state-npc3": 0.04422012659219595}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.12647742346713417, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.05398043205863551, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.13124901997415642, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.08324378728866577, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.03253716857809769, "sim_compute_performance-ego": 0.058194605927718315, "sim_compute_robot_state-ego": 0.06189766369367901, "sim_compute_robot_state-npc0": 0.06140051076286718, "sim_compute_robot_state-npc1": 0.05687606020977622, "sim_compute_robot_state-npc2": 0.057107627391815186, "sim_compute_robot_state-npc3": 0.058698569473467375}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.1409771351874629, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.057152461402023895, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.1394137702410734, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.08317491374438322, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03488283821299106, "sim_compute_performance-ego": 0.06443446799169612, "sim_compute_robot_state-ego": 0.06999348990524872, "sim_compute_robot_state-npc0": 0.06408624407611316, "sim_compute_robot_state-npc1": 0.06229459484921226, "sim_compute_robot_state-npc2": 0.07016943979866896, "sim_compute_robot_state-npc3": 0.06207514714591111}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.10346533634044508, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.048704297454268845, "in-drivable-lane": 0, "agent_compute-ego": 0.13438054367348, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.11097107110200104, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.03018614097877785, "sim_compute_performance-ego": 0.05148457597803186, "sim_compute_robot_state-ego": 0.05233969511809172, "sim_compute_robot_state-npc0": 0.06256397565205891, "sim_compute_robot_state-npc1": 0.05629029097380461, "sim_compute_robot_state-npc2": 0.05905691782633463, "sim_compute_robot_state-npc3": 0.05561191947371871}}
set_robot_commands_max	0.11097107110200104
set_robot_commands_mean	0.08431997044778623
set_robot_commands_median	0.08324378728866577
set_robot_commands_min	0.05708588086641752
sim_compute_performance-ego_max	0.06582507097496176
sim_compute_performance-ego_mean	0.05693775205329865
sim_compute_performance-ego_median	0.058194605927718315
sim_compute_performance-ego_min	0.04475003939408522
sim_compute_robot_state-ego_max	0.06999348990524872
sim_compute_robot_state-ego_mean	0.06010985079942238
sim_compute_robot_state-ego_median	0.06189766369367901
sim_compute_robot_state-ego_min	0.04882595172295204
sim_compute_robot_state-npc0_max	0.06408624407611316
sim_compute_robot_state-npc0_mean	0.05898460840306367
sim_compute_robot_state-npc0_median	0.06140051076286718
sim_compute_robot_state-npc0_min	0.04572560237004207
sim_compute_robot_state-npc1_max	0.06289755173449246
sim_compute_robot_state-npc1_mean	0.05654638550116877
sim_compute_robot_state-npc1_median	0.05687606020977622
sim_compute_robot_state-npc1_min	0.044373429738558255
sim_compute_robot_state-npc2_max	0.07016943979866896
sim_compute_robot_state-npc2_mean	0.05918615919196044
sim_compute_robot_state-npc2_median	0.05905691782633463
sim_compute_robot_state-npc2_min	0.04375509115365835
sim_compute_robot_state-npc3_max	0.0658788321153173
sim_compute_robot_state-npc3_mean	0.05729691896012209
sim_compute_robot_state-npc3_median	0.058698569473467375
sim_compute_robot_state-npc3_min	0.04422012659219595
sim_compute_sim_state_max	0.039594492822323205
sim_compute_sim_state_mean	0.032305519556261916
sim_compute_sim_state_median	0.03253716857809769
sim_compute_sim_state_min	0.02432695718911978
sim_physics_max	0.1409771351874629
sim_physics_mean	0.11997684717443198
sim_physics_median	0.12647742346713417
sim_physics_min	0.09778730685894306
sim_render-ego_max	0.057152461402023895
sim_render-ego_mean	0.05146725838561794
sim_render-ego_median	0.05398043205863551
sim_render-ego_min	0.041894931059617266
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20540

2479

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 14:04:29+00:00

2019-04-25 14:05:00+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20536

2483

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 14:03:17+00:00

2019-04-25 14:03:59+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20531

2488

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 14:02:00+00:00

2019-04-25 14:02:44+00:00

0:00:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20523

2508

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:01:10+00:00

2019-04-25 14:01:53+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20518

2502

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 14:00:17+00:00

2019-04-25 14:00:57+00:00

0:00:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20425

2632

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-25 12:59:29+00:00

2019-04-25 13:59:50+00:00

1:00:21

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20425-175541', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20425-175541', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20425-175541', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20412

2636

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 12:50:57+00:00

2019-04-25 12:59:12+00:00

0:08:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7060476436119825
survival_time_median	2.9499999999999975
deviation-center-line_median	0.11000911211661404
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16754210894962526
agent_compute-ego_mean	0.13893214086469158
agent_compute-ego_median	0.1395300030708313
agent_compute-ego_min	0.11249103384502863
deviation-center-line_max	0.2756124593780862
deviation-center-line_mean	0.14761657707365936
deviation-center-line_min	0.05521015531316102
deviation-heading_max	1.16360603086641
deviation-heading_mean	0.4999185982159845
deviation-heading_median	0.3379975413110555
deviation-heading_min	0.23494529737543027
driven_any_max	2.1872512115945857
driven_any_mean	1.055944540531118
driven_any_median	1.167808122478256
driven_any_min	0.3209290725136122
driven_lanedir_consec_max	0.9419039350715476
driven_lanedir_consec_mean	0.6173219551829218
driven_lanedir_consec_min	0.30305117192114617
driven_lanedir_max	1.1635498459086595
driven_lanedir_mean	0.6971981394313693
driven_lanedir_median	0.7060476436119825
driven_lanedir_min	0.30305117192114617
in-drivable-lane_max	2.299999999999992
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.1851209537038263, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.06541376068906964, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.16754210894962526, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.10262489093924468, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.04235839168980436, "sim_compute_performance-ego": 0.07470819860134485, "sim_compute_robot_state-ego": 0.07926700475080958, "sim_compute_robot_state-npc0": 0.07399883360232946, "sim_compute_robot_state-npc1": 0.07994898085324269, "sim_compute_robot_state-npc2": 0.07603884867902072, "sim_compute_robot_state-npc3": 0.07638395732303835}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.14138057827949524, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.0543480118115743, "in-drivable-lane": 0, "agent_compute-ego": 0.1395300030708313, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.08824069301287334, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.03646924098332723, "sim_compute_performance-ego": 0.06252794464429219, "sim_compute_robot_state-ego": 0.06494683027267456, "sim_compute_robot_state-npc0": 0.06493814786275227, "sim_compute_robot_state-npc1": 0.06346751252810161, "sim_compute_robot_state-npc2": 0.062135517597198486, "sim_compute_robot_state-npc3": 0.05768354733784994}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.12116294392084671, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.044897083508766304, "in-drivable-lane": 0, "agent_compute-ego": 0.11249103384502863, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.06997709759211136, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.029607659679348187, "sim_compute_performance-ego": 0.0494172168990313, "sim_compute_robot_state-ego": 0.05001945818884898, "sim_compute_robot_state-npc0": 0.049627788996292374, "sim_compute_robot_state-npc1": 0.04907639956070205, "sim_compute_robot_state-npc2": 0.04907987885555978, "sim_compute_robot_state-npc3": 0.050071546586893376}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.18292273505259368, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05260913250810009, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1461134886337539, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.09854759200144622, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.0342196771654032, "sim_compute_performance-ego": 0.057954873068858, "sim_compute_robot_state-ego": 0.06556173502388647, "sim_compute_robot_state-npc0": 0.0607099856360484, "sim_compute_robot_state-npc1": 0.05936904680930962, "sim_compute_robot_state-npc2": 0.058440564042430816, "sim_compute_robot_state-npc3": 0.06128358436843096}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.1044774055480957, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.047011184692382815, "in-drivable-lane": 0, "agent_compute-ego": 0.12898406982421876, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.06775554418563842, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.03968954086303711, "sim_compute_performance-ego": 0.0519942045211792, "sim_compute_robot_state-ego": 0.05496660470962524, "sim_compute_robot_state-npc0": 0.05242974758148193, "sim_compute_robot_state-npc1": 0.05169742107391358, "sim_compute_robot_state-npc2": 0.04893317222595215, "sim_compute_robot_state-npc3": 0.049472153186798096}}
set_robot_commands_max	0.10262489093924468
set_robot_commands_mean	0.0854291635462628
set_robot_commands_median	0.08824069301287334
set_robot_commands_min	0.06775554418563842
sim_compute_performance-ego_max	0.07470819860134485
sim_compute_performance-ego_mean	0.0593204875469411
sim_compute_performance-ego_median	0.057954873068858
sim_compute_performance-ego_min	0.0494172168990313
sim_compute_robot_state-ego_max	0.07926700475080958
sim_compute_robot_state-ego_mean	0.06295232658916897
sim_compute_robot_state-ego_median	0.06494683027267456
sim_compute_robot_state-ego_min	0.05001945818884898
sim_compute_robot_state-npc0_max	0.07399883360232946
sim_compute_robot_state-npc0_mean	0.06034090073578089
sim_compute_robot_state-npc0_median	0.0607099856360484
sim_compute_robot_state-npc0_min	0.049627788996292374
sim_compute_robot_state-npc1_max	0.07994898085324269
sim_compute_robot_state-npc1_mean	0.0607118721650539
sim_compute_robot_state-npc1_median	0.05936904680930962
sim_compute_robot_state-npc1_min	0.04907639956070205
sim_compute_robot_state-npc2_max	0.07603884867902072
sim_compute_robot_state-npc2_mean	0.05892559628003239
sim_compute_robot_state-npc2_median	0.058440564042430816
sim_compute_robot_state-npc2_min	0.04893317222595215
sim_compute_robot_state-npc3_max	0.07638395732303835
sim_compute_robot_state-npc3_mean	0.05897895776060215
sim_compute_robot_state-npc3_median	0.05768354733784994
sim_compute_robot_state-npc3_min	0.049472153186798096
sim_compute_sim_state_max	0.04235839168980436
sim_compute_sim_state_mean	0.036468902076184015
sim_compute_sim_state_median	0.03646924098332723
sim_compute_sim_state_min	0.029607659679348187
sim_physics_max	0.1851209537038263
sim_physics_mean	0.14701292330097154
sim_physics_median	0.14138057827949524
sim_physics_min	0.1044774055480957
sim_render-ego_max	0.06541376068906964
sim_render-ego_mean	0.05285583464197863
sim_render-ego_median	0.05260913250810009
sim_render-ego_min	0.044897083508766304
simulation-passed	1
survival_time_max	5.299999999999989
survival_time_mean	2.679999999999997
survival_time_min	1.0000000000000002

No reset possible

20409

2649

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 12:34:40+00:00

2019-04-25 12:50:49+00:00

0:16:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48833540127088915
survival_time_median	4.749999999999991
deviation-center-line_median	0.206292958644122
in-drivable-lane_median	1.399999999999995

other stats

agent_compute-ego_max	0.07847568296617077
agent_compute-ego_mean	0.076824490180566
agent_compute-ego_median	0.07683249766176398
agent_compute-ego_min	0.07483374568778024
deviation-center-line_max	0.3912682651728664
deviation-center-line_mean	0.23227387059090404
deviation-center-line_min	0.11846104838828224
deviation-heading_max	2.4601311411745157
deviation-heading_mean	1.2781805872611902
deviation-heading_median	1.3327642896506582
deviation-heading_min	0.566903075639298
driven_any_max	2.083583756004467
driven_any_mean	1.3572645029063808
driven_any_median	1.21492227445162
driven_any_min	0.37688790065546496
driven_lanedir_consec_max	1.307826359971858
driven_lanedir_consec_mean	0.6703257890941815
driven_lanedir_consec_min	0.3420979566210387
driven_lanedir_max	1.699034370134248
driven_lanedir_mean	0.78554370039537
driven_lanedir_median	0.5549295175109604
driven_lanedir_min	0.3420979566210387
in-drivable-lane_max	3.749999999999987
in-drivable-lane_mean	1.529999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1573283753427688, "sim_physics": 0.21080400456081735, "survival_time": 4.399999999999992, "driven_lanedir": 0.5060471383003148, "sim_render-ego": 0.06783837350932034, "in-drivable-lane": 1.6999999999999948, "agent_compute-ego": 0.07683249766176398, "deviation-heading": 1.3327642896506582, "set_robot_commands": 0.10472507639364764, "deviation-center-line": 0.27749074010767844, "driven_lanedir_consec": 0.3877597081968337, "sim_compute_sim_state": 0.0429936403577978, "sim_compute_performance-ego": 0.07383998415686867, "sim_compute_robot_state-ego": 0.0831209583715959, "sim_compute_robot_state-npc0": 0.07397847825830633, "sim_compute_robot_state-npc1": 0.07497986880215732, "sim_compute_robot_state-npc2": 0.07489535483446988, "sim_compute_robot_state-npc3": 0.07416298714551059}, "udem1-1-0": {"driven_any": 0.37688790065546496, "sim_physics": 0.18505981660658313, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3420979566210387, "sim_render-ego": 0.0666606887694328, "in-drivable-lane": 0, "agent_compute-ego": 0.07847568296617077, "deviation-heading": 0.6430622098458139, "set_robot_commands": 0.10262690051909416, "deviation-center-line": 0.11846104838828224, "driven_lanedir_consec": 0.3420979566210387, "sim_compute_sim_state": 0.04265831362816595, "sim_compute_performance-ego": 0.07455871951195502, "sim_compute_robot_state-ego": 0.08057554306522492, "sim_compute_robot_state-npc0": 0.07342357020224294, "sim_compute_robot_state-npc1": 0.07335485950593025, "sim_compute_robot_state-npc2": 0.07430044297249086, "sim_compute_robot_state-npc3": 0.0733146975117345}, "udem1-2-0": {"driven_any": 2.083583756004467, "sim_physics": 0.2209834934126401, "survival_time": 7.049999999999983, "driven_lanedir": 1.699034370134248, "sim_render-ego": 0.06876968999280997, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07672501455807516, "deviation-heading": 1.3880422199956646, "set_robot_commands": 0.10569174746249584, "deviation-center-line": 0.3912682651728664, "driven_lanedir_consec": 1.307826359971858, "sim_compute_sim_state": 0.04402860005696615, "sim_compute_performance-ego": 0.07453999113529286, "sim_compute_robot_state-ego": 0.08136612303713535, "sim_compute_robot_state-npc0": 0.07606475742150706, "sim_compute_robot_state-npc1": 0.07321752047707848, "sim_compute_robot_state-npc2": 0.07503803909247649, "sim_compute_robot_state-npc3": 0.07658255353887031}, "udem1-3-0": {"driven_any": 1.21492227445162, "sim_physics": 0.20128197168049056, "survival_time": 4.749999999999991, "driven_lanedir": 0.8256095194102882, "sim_render-ego": 0.06854890271237021, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.07725551002903988, "deviation-heading": 0.566903075639298, "set_robot_commands": 0.10478890067652652, "deviation-center-line": 0.167856340641571, "driven_lanedir_consec": 0.8256095194102882, "sim_compute_sim_state": 0.041274846227545486, "sim_compute_performance-ego": 0.07521281744304456, "sim_compute_robot_state-ego": 0.07859116604453639, "sim_compute_robot_state-npc0": 0.07704472290842157, "sim_compute_robot_state-npc1": 0.07907533896596808, "sim_compute_robot_state-npc2": 0.07818281023125899, "sim_compute_robot_state-npc3": 0.07582572133917558}, "udem1-4-0": {"driven_any": 1.953600208077582, "sim_physics": 0.1976093826159625, "survival_time": 7.099999999999983, "driven_lanedir": 0.5549295175109604, "sim_render-ego": 0.06397911360566046, "in-drivable-lane": 3.749999999999987, "agent_compute-ego": 0.07483374568778024, "deviation-heading": 2.4601311411745157, "set_robot_commands": 0.09889770393640222, "deviation-center-line": 0.206292958644122, "driven_lanedir_consec": 0.48833540127088915, "sim_compute_sim_state": 0.039600954928868254, "sim_compute_performance-ego": 0.07095394000201158, "sim_compute_robot_state-ego": 0.07590839056901529, "sim_compute_robot_state-npc0": 0.0725043021457296, "sim_compute_robot_state-npc1": 0.07048670003111933, "sim_compute_robot_state-npc2": 0.07010225007231806, "sim_compute_robot_state-npc3": 0.07267888666878283}}
set_robot_commands_max	0.10569174746249584
set_robot_commands_mean	0.10334606579763328
set_robot_commands_median	0.10472507639364764
set_robot_commands_min	0.09889770393640222
sim_compute_performance-ego_max	0.07521281744304456
sim_compute_performance-ego_mean	0.07382109044983454
sim_compute_performance-ego_median	0.07453999113529286
sim_compute_performance-ego_min	0.07095394000201158
sim_compute_robot_state-ego_max	0.0831209583715959
sim_compute_robot_state-ego_mean	0.07991243621750156
sim_compute_robot_state-ego_median	0.08057554306522492
sim_compute_robot_state-ego_min	0.07590839056901529
sim_compute_robot_state-npc0_max	0.07704472290842157
sim_compute_robot_state-npc0_mean	0.07460316618724151
sim_compute_robot_state-npc0_median	0.07397847825830633
sim_compute_robot_state-npc0_min	0.0725043021457296
sim_compute_robot_state-npc1_max	0.07907533896596808
sim_compute_robot_state-npc1_mean	0.0742228575564507
sim_compute_robot_state-npc1_median	0.07335485950593025
sim_compute_robot_state-npc1_min	0.07048670003111933
sim_compute_robot_state-npc2_max	0.07818281023125899
sim_compute_robot_state-npc2_mean	0.07450377944060285
sim_compute_robot_state-npc2_median	0.07489535483446988
sim_compute_robot_state-npc2_min	0.07010225007231806
sim_compute_robot_state-npc3_max	0.07658255353887031
sim_compute_robot_state-npc3_mean	0.07451296924081477
sim_compute_robot_state-npc3_median	0.07416298714551059
sim_compute_robot_state-npc3_min	0.07267888666878283
sim_compute_sim_state_max	0.04402860005696615
sim_compute_sim_state_mean	0.04211127103986873
sim_compute_sim_state_median	0.04265831362816595
sim_compute_sim_state_min	0.039600954928868254
sim_physics_max	0.2209834934126401
sim_physics_mean	0.2031477337752987
sim_physics_median	0.20128197168049056
sim_physics_min	0.18505981660658313
sim_render-ego_max	0.06876968999280997
sim_render-ego_mean	0.06715935371791874
sim_render-ego_median	0.06783837350932034
sim_render-ego_min	0.06397911360566046
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	4.96999999999999
survival_time_min	1.5500000000000007

No reset possible

20391

2774

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 12:01:52+00:00

2019-04-25 12:33:42+00:00

0:31:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6967083669810288
survival_time_median	12.800000000000049
deviation-center-line_median	0.5055575973466313
in-drivable-lane_median	0.9500000000000136

other stats

agent_compute-ego_max	0.11771807140774196
agent_compute-ego_mean	0.1147719122560052
agent_compute-ego_median	0.11445948441823324
agent_compute-ego_min	0.11161056280136109
deviation-center-line_max	1.484986755411322
deviation-center-line_mean	0.8179648868135121
deviation-center-line_min	0.31227709963721445
deviation-heading_max	6.693215807942304
deviation-heading_mean	4.152738064382175
deviation-heading_median	3.643725187102529
deviation-heading_min	1.7979059764405578
driven_any_max	2.3485777223340354
driven_any_mean	1.614487925302463
driven_any_median	2.003020513954248
driven_any_min	0.662941123925887
driven_lanedir_consec_max	1.5547689563669989
driven_lanedir_consec_mean	0.8277970060829007
driven_lanedir_consec_min	0.24140381529034105
driven_lanedir_max	1.8224189220979872
driven_lanedir_mean	1.061701692527512
driven_lanedir_median	0.8722066221979858
driven_lanedir_min	0.44799325550004826
in-drivable-lane_max	5.7000000000000295
in-drivable-lane_mean	1.91000000000001
in-drivable-lane_min	0.49999999999999933
per-episodes	details {"udem1-0-0": {"driven_any": 0.662941123925887, "sim_physics": 0.20794872972700332, "survival_time": 4.499999999999992, "driven_lanedir": 0.44799325550004826, "sim_render-ego": 0.07359162436591254, "in-drivable-lane": 0.49999999999999933, "agent_compute-ego": 0.11771807140774196, "deviation-heading": 2.087365100564611, "set_robot_commands": 0.11297207673390706, "deviation-center-line": 0.388620360815666, "driven_lanedir_consec": 0.24140381529034105, "sim_compute_sim_state": 0.04624024232228597, "sim_compute_performance-ego": 0.07868518564436171, "sim_compute_robot_state-ego": 0.08823464711507162, "sim_compute_robot_state-npc0": 0.08158551057179769, "sim_compute_robot_state-npc1": 0.07961555322011311, "sim_compute_robot_state-npc2": 0.08046415117051867, "sim_compute_robot_state-npc3": 0.07955042256249321}, "udem1-1-0": {"driven_any": 2.003020513954248, "sim_physics": 0.27647959161549807, "survival_time": 12.800000000000049, "driven_lanedir": 0.8722066221979858, "sim_render-ego": 0.07273410353809595, "in-drivable-lane": 5.7000000000000295, "agent_compute-ego": 0.11357477679848672, "deviation-heading": 3.643725187102529, "set_robot_commands": 0.11561399511992931, "deviation-center-line": 0.5055575973466313, "driven_lanedir_consec": 0.6967083669810288, "sim_compute_sim_state": 0.0450246874243021, "sim_compute_performance-ego": 0.08098073396831751, "sim_compute_robot_state-ego": 0.09056850336492062, "sim_compute_robot_state-npc0": 0.08026297483593225, "sim_compute_robot_state-npc1": 0.07992941699922085, "sim_compute_robot_state-npc2": 0.08128921035677195, "sim_compute_robot_state-npc3": 0.07940219063311815}, "udem1-2-0": {"driven_any": 2.3483691054830182, "sim_physics": 0.2681403915087382, "survival_time": 14.950000000000076, "driven_lanedir": 1.670885541519227, "sim_render-ego": 0.07242970069249471, "in-drivable-lane": 1.7000000000000108, "agent_compute-ego": 0.11445948441823324, "deviation-heading": 6.693215807942304, "set_robot_commands": 0.11399492899576824, "deviation-center-line": 1.484986755411322, "driven_lanedir_consec": 1.1510997704538226, "sim_compute_sim_state": 0.04582558870315552, "sim_compute_performance-ego": 0.07939011176427205, "sim_compute_robot_state-ego": 0.0883777912457784, "sim_compute_robot_state-npc0": 0.0811615260442098, "sim_compute_robot_state-npc1": 0.07959033966064454, "sim_compute_robot_state-npc2": 0.08102381149927775, "sim_compute_robot_state-npc3": 0.0794432290395101}, "udem1-3-0": {"driven_any": 0.7095311608151288, "sim_physics": 0.24937923832943565, "survival_time": 4.749999999999991, "driven_lanedir": 0.49500412132231175, "sim_render-ego": 0.07556229892529939, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.11649666585420308, "deviation-heading": 1.7979059764405578, "set_robot_commands": 0.11292855614110044, "deviation-center-line": 0.31227709963721445, "driven_lanedir_consec": 0.49500412132231175, "sim_compute_sim_state": 0.04347275181820518, "sim_compute_performance-ego": 0.07971961372777035, "sim_compute_robot_state-ego": 0.09103125522011205, "sim_compute_robot_state-npc0": 0.07878106769762541, "sim_compute_robot_state-npc1": 0.07563619864614386, "sim_compute_robot_state-npc2": 0.07851387576053018, "sim_compute_robot_state-npc3": 0.07809608359085886}, "udem1-4-0": {"driven_any": 2.3485777223340354, "sim_physics": 0.2550891121228536, "survival_time": 14.950000000000076, "driven_lanedir": 1.8224189220979872, "sim_render-ego": 0.06847242752710979, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.11161056280136109, "deviation-heading": 6.541478249860876, "set_robot_commands": 0.108498694896698, "deviation-center-line": 1.3983826208567272, "driven_lanedir_consec": 1.5547689563669989, "sim_compute_sim_state": 0.04285642941792806, "sim_compute_performance-ego": 0.07462133566538492, "sim_compute_robot_state-ego": 0.08498293002446493, "sim_compute_robot_state-npc0": 0.07656595865885417, "sim_compute_robot_state-npc1": 0.07658342043558757, "sim_compute_robot_state-npc2": 0.07981063604354859, "sim_compute_robot_state-npc3": 0.07629494825998942}}
set_robot_commands_max	0.11561399511992931
set_robot_commands_mean	0.1128016503774806
set_robot_commands_median	0.11297207673390706
set_robot_commands_min	0.108498694896698
sim_compute_performance-ego_max	0.08098073396831751
sim_compute_performance-ego_mean	0.07867939615402131
sim_compute_performance-ego_median	0.07939011176427205
sim_compute_performance-ego_min	0.07462133566538492
sim_compute_robot_state-ego_max	0.09103125522011205
sim_compute_robot_state-ego_mean	0.08863902539406952
sim_compute_robot_state-ego_median	0.0883777912457784
sim_compute_robot_state-ego_min	0.08498293002446493
sim_compute_robot_state-npc0_max	0.08158551057179769
sim_compute_robot_state-npc0_mean	0.07967140756168387
sim_compute_robot_state-npc0_median	0.08026297483593225
sim_compute_robot_state-npc0_min	0.07656595865885417
sim_compute_robot_state-npc1_max	0.07992941699922085
sim_compute_robot_state-npc1_mean	0.07827098579234198
sim_compute_robot_state-npc1_median	0.07959033966064454
sim_compute_robot_state-npc1_min	0.07563619864614386
sim_compute_robot_state-npc2_max	0.08128921035677195
sim_compute_robot_state-npc2_mean	0.08022033696612943
sim_compute_robot_state-npc2_median	0.08046415117051867
sim_compute_robot_state-npc2_min	0.07851387576053018
sim_compute_robot_state-npc3_max	0.07955042256249321
sim_compute_robot_state-npc3_mean	0.07855737481719396
sim_compute_robot_state-npc3_median	0.07940219063311815
sim_compute_robot_state-npc3_min	0.07629494825998942
sim_compute_sim_state_max	0.04624024232228597
sim_compute_sim_state_mean	0.04468393993717536
sim_compute_sim_state_median	0.0450246874243021
sim_compute_sim_state_min	0.04285642941792806
sim_physics_max	0.27647959161549807
sim_physics_mean	0.2514074126607057
sim_physics_median	0.2550891121228536
sim_physics_min	0.20794872972700332
sim_render-ego_max	0.07556229892529939
sim_render-ego_mean	0.07255803100978249
sim_render-ego_median	0.07273410353809595
sim_render-ego_min	0.06847242752710979
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.390000000000038
survival_time_min	4.499999999999992

No reset possible

20386

2672

Rami Al-Naim 🇷🇺

Modidfied config

step1-simulation

error

2019-04-25 12:00:38+00:00

2019-04-25 12:01:30+00:00

0:00:52

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20372

2712

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 11:55:24+00:00

2019-04-25 12:00:07+00:00

0:04:43

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20372-621167', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20372-621167', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20372-621167', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20361

2724

jiang peng

test for ppo

step1-simulation

error

2019-04-25 11:53:27+00:00

2019-04-25 11:54:47+00:00

0:01:20

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20355

2735

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-25 11:51:29+00:00

2019-04-25 11:53:12+00:00

0:01:43

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20348

2743

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-25 11:49:12+00:00

2019-04-25 11:51:07+00:00

0:01:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20346

2755

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-25 11:41:39+00:00

2019-04-25 11:48:57+00:00

0:07:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7512916548554684
survival_time_median	3.7999999999999945
deviation-center-line_median	0.18412495978986793
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.0757999524965391
agent_compute-ego_mean	0.07097065592756831
agent_compute-ego_median	0.0715490555276676
agent_compute-ego_min	0.06702380117617156
deviation-center-line_max	0.2407793328387492
deviation-center-line_mean	0.18524304998761165
deviation-center-line_min	0.10543526712795737
deviation-heading_max	1.078034640218307
deviation-heading_mean	0.5372342619527618
deviation-heading_median	0.3838282375787499
deviation-heading_min	0.27824896253672804
driven_any_max	1.320019378772244
driven_any_mean	0.9597161700643624
driven_any_median	1.0035384623320458
driven_any_min	0.22182656237034495
driven_lanedir_consec_max	0.9856760680639272
driven_lanedir_consec_mean	0.639512700274553
driven_lanedir_consec_min	0.21092633501229985
driven_lanedir_max	0.9856760680639272
driven_lanedir_mean	0.639512700274553
driven_lanedir_median	0.7512916548554684
driven_lanedir_min	0.21092633501229985
in-drivable-lane_max	2.0499999999999936
in-drivable-lane_mean	0.9599999999999967
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9915906722494332, "sim_physics": 0.10200904858739752, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3868568300517894, "sim_render-ego": 0.0618596076965332, "in-drivable-lane": 2.0499999999999936, "agent_compute-ego": 0.06702380117617156, "deviation-heading": 0.27824896253672804, "set_robot_commands": 0.09476509847139056, "deviation-center-line": 0.18412495978986793, "driven_lanedir_consec": 0.3868568300517894, "sim_compute_sim_state": 0.04045653343200683, "sim_compute_performance-ego": 0.0692143440246582, "sim_compute_robot_state-ego": 0.0753173639899806}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0035384623320458, "sim_physics": 0.09475698332855668, "survival_time": 3.4499999999999957, "driven_lanedir": 0.7512916548554684, "sim_render-ego": 0.05992505515831104, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07331770744876585, "deviation-heading": 0.625762861497094, "set_robot_commands": 0.09442999397498976, "deviation-center-line": 0.15882900356325147, "driven_lanedir_consec": 0.7512916548554684, "sim_compute_sim_state": 0.039710345475570015, "sim_compute_performance-ego": 0.06915258324664572, "sim_compute_robot_state-ego": 0.0730879064919292}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22182656237034495, "sim_physics": 0.08451532233845103, "survival_time": 1.1000000000000003, "driven_lanedir": 0.21092633501229985, "sim_render-ego": 0.06301401961933482, "in-drivable-lane": 0, "agent_compute-ego": 0.0671627629886974, "deviation-heading": 0.3202966079329303, "set_robot_commands": 0.09009368853135542, "deviation-center-line": 0.10543526712795737, "driven_lanedir_consec": 0.21092633501229985, "sim_compute_sim_state": 0.03397417068481445, "sim_compute_performance-ego": 0.07473480701446533, "sim_compute_robot_state-ego": 0.07290182330391624}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.320019378772244, "sim_physics": 0.11843305891686744, "survival_time": 4.549999999999992, "driven_lanedir": 0.9856760680639272, "sim_render-ego": 0.07369666571145529, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.0757999524965391, "deviation-heading": 1.078034640218307, "set_robot_commands": 0.10514986908042824, "deviation-center-line": 0.2407793328387492, "driven_lanedir_consec": 0.9856760680639272, "sim_compute_sim_state": 0.04323001222296075, "sim_compute_performance-ego": 0.0813368729182652, "sim_compute_robot_state-ego": 0.09121820166870788}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2616057745977434, "sim_physics": 0.10640310511297107, "survival_time": 4.899999999999991, "driven_lanedir": 0.8628126133892802, "sim_render-ego": 0.0620163192554396, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.0715490555276676, "deviation-heading": 0.3838282375787499, "set_robot_commands": 0.09659171347715416, "deviation-center-line": 0.2370466866182324, "driven_lanedir_consec": 0.8628126133892802, "sim_compute_sim_state": 0.04077110485154755, "sim_compute_performance-ego": 0.06942978197214555, "sim_compute_robot_state-ego": 0.07138921776596381}}
set_robot_commands_max	0.10514986908042824
set_robot_commands_mean	0.09620607270706363
set_robot_commands_median	0.09476509847139056
set_robot_commands_min	0.09009368853135542
sim_compute_performance-ego_max	0.0813368729182652
sim_compute_performance-ego_mean	0.072773677835236
sim_compute_performance-ego_median	0.06942978197214555
sim_compute_performance-ego_min	0.06915258324664572
sim_compute_robot_state-ego_max	0.09121820166870788
sim_compute_robot_state-ego_mean	0.07678290264409954
sim_compute_robot_state-ego_median	0.0730879064919292
sim_compute_robot_state-ego_min	0.07138921776596381
sim_compute_sim_state_max	0.04323001222296075
sim_compute_sim_state_mean	0.03962843333337992
sim_compute_sim_state_median	0.04045653343200683
sim_compute_sim_state_min	0.03397417068481445
sim_physics_max	0.11843305891686744
sim_physics_mean	0.10122350365684876
sim_physics_median	0.10200904858739752
sim_physics_min	0.08451532233845103
sim_render-ego_max	0.07369666571145529
sim_render-ego_mean	0.06410233348821479
sim_render-ego_median	0.0620163192554396
sim_render-ego_min	0.05992505515831104
simulation-passed	1
survival_time_max	4.899999999999991
survival_time_mean	3.5599999999999943
survival_time_min	1.1000000000000003

No reset possible

20318

2809

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-25 11:33:21+00:00

2019-04-25 11:41:15+00:00

0:07:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.1562124976405391
agent_compute-ego_mean	0.1417905267705577
agent_compute-ego_median	0.14262380098041735
agent_compute-ego_min	0.12126225691575272
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.1474419134967732, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.05596748388038491, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1390266553410944, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09508228302001952, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03716142222566424, "sim_compute_performance-ego": 0.0619864913652528, "sim_compute_robot_state-ego": 0.06470282122773945, "sim_compute_robot_state-npc0": 0.06338325986322367, "sim_compute_robot_state-npc1": 0.06603945426221164, "sim_compute_robot_state-npc2": 0.0651523527109398, "sim_compute_robot_state-npc3": 0.06364729719341926}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.12349983362051156, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.04948081420018123, "in-drivable-lane": 0, "agent_compute-ego": 0.12126225691575272, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.07685687908759484, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.036141588137700006, "sim_compute_performance-ego": 0.054560138629033014, "sim_compute_robot_state-ego": 0.057345958856435925, "sim_compute_robot_state-npc0": 0.0649260924412654, "sim_compute_robot_state-npc1": 0.05641020261324369, "sim_compute_robot_state-npc2": 0.05589595207801232, "sim_compute_robot_state-npc3": 0.057201348818265475}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.13149505853652954, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.05371486513238204, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.14262380098041735, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.08174578767073781, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.03251888563758448, "sim_compute_performance-ego": 0.05755014482297396, "sim_compute_robot_state-ego": 0.06203685308757581, "sim_compute_robot_state-npc0": 0.05930336211857043, "sim_compute_robot_state-npc1": 0.05855237182817961, "sim_compute_robot_state-npc2": 0.05877422345312018, "sim_compute_robot_state-npc3": 0.05785554333737022}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.15524949604951882, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.06008261366735531, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.14982742297498486, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.09357966652399376, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03803999212723744, "sim_compute_performance-ego": 0.07007106950011434, "sim_compute_robot_state-ego": 0.0735276741317556, "sim_compute_robot_state-npc0": 0.06719990018047864, "sim_compute_robot_state-npc1": 0.06783172148692457, "sim_compute_robot_state-npc2": 0.06736414643782604, "sim_compute_robot_state-npc3": 0.06725071351739424}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.14635248537416812, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.06218562302766023, "in-drivable-lane": 0, "agent_compute-ego": 0.1562124976405391, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.09781604342990452, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.04022247702987106, "sim_compute_performance-ego": 0.07397592509234394, "sim_compute_robot_state-ego": 0.0741828547583686, "sim_compute_robot_state-npc0": 0.06849319846541793, "sim_compute_robot_state-npc1": 0.06948178785818594, "sim_compute_robot_state-npc2": 0.06814426845974392, "sim_compute_robot_state-npc3": 0.07079255139386212}}
set_robot_commands_max	0.09781604342990452
set_robot_commands_mean	0.0890161319464501
set_robot_commands_median	0.09357966652399376
set_robot_commands_min	0.07685687908759484
sim_compute_performance-ego_max	0.07397592509234394
sim_compute_performance-ego_mean	0.0636287538819436
sim_compute_performance-ego_median	0.0619864913652528
sim_compute_performance-ego_min	0.054560138629033014
sim_compute_robot_state-ego_max	0.0741828547583686
sim_compute_robot_state-ego_mean	0.06635923241237508
sim_compute_robot_state-ego_median	0.06470282122773945
sim_compute_robot_state-ego_min	0.057345958856435925
sim_compute_robot_state-npc0_max	0.06849319846541793
sim_compute_robot_state-npc0_mean	0.06466116261379122
sim_compute_robot_state-npc0_median	0.0649260924412654
sim_compute_robot_state-npc0_min	0.05930336211857043
sim_compute_robot_state-npc1_max	0.06948178785818594
sim_compute_robot_state-npc1_mean	0.0636631076097491
sim_compute_robot_state-npc1_median	0.06603945426221164
sim_compute_robot_state-npc1_min	0.05641020261324369
sim_compute_robot_state-npc2_max	0.06814426845974392
sim_compute_robot_state-npc2_mean	0.06306618862792845
sim_compute_robot_state-npc2_median	0.0651523527109398
sim_compute_robot_state-npc2_min	0.05589595207801232
sim_compute_robot_state-npc3_max	0.07079255139386212
sim_compute_robot_state-npc3_mean	0.06334949085206228
sim_compute_robot_state-npc3_median	0.06364729719341926
sim_compute_robot_state-npc3_min	0.057201348818265475
sim_compute_sim_state_max	0.04022247702987106
sim_compute_sim_state_mean	0.03681687303161145
sim_compute_sim_state_median	0.03716142222566424
sim_compute_sim_state_min	0.03251888563758448
sim_physics_max	0.15524949604951882
sim_physics_mean	0.14080775741550025
sim_physics_median	0.14635248537416812
sim_physics_min	0.12349983362051156
sim_render-ego_max	0.06218562302766023
sim_render-ego_mean	0.056286279981592746
sim_render-ego_median	0.05596748388038491
sim_render-ego_min	0.04948081420018123
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20310

2822

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 11:25:05+00:00

2019-04-25 11:33:14+00:00

0:08:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.6499999999999986
deviation-center-line_median	0.11441348272325454
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.1649848090277778
agent_compute-ego_mean	0.14913717298085216
agent_compute-ego_median	0.14708250383787516
agent_compute-ego_min	0.14205611426875275
deviation-center-line_max	0.1591461472514269
deviation-center-line_mean	0.11596609894630484
deviation-center-line_min	0.08510371473961074
deviation-heading_max	0.476664618733542
deviation-heading_mean	0.334022300897731
deviation-heading_median	0.33193430349064146
deviation-heading_min	0.19231746951364015
driven_any_max	1.6164397331284492
driven_any_mean	1.0223266277113094
driven_any_median	1.006879208370262
driven_any_min	0.431219000505003
driven_lanedir_consec_max	1.2450085389977108
driven_lanedir_consec_mean	0.7771319802171096
driven_lanedir_consec_min	0.40042409985820093
driven_lanedir_max	1.2450085389977108
driven_lanedir_mean	0.7771319802171096
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.40042409985820093
in-drivable-lane_max	0.9499999999999976
in-drivable-lane_mean	0.4999999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.1341418095354764, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.057238061473054706, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.14205611426875275, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.09090012874243394, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.03514121163566158, "sim_compute_performance-ego": 0.06598442455507675, "sim_compute_robot_state-ego": 0.06970332703500423, "sim_compute_robot_state-npc0": 0.07005530483317825, "sim_compute_robot_state-npc1": 0.06550304394847942, "sim_compute_robot_state-npc2": 0.06409643731027279, "sim_compute_robot_state-npc3": 0.06358926701095868}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.431219000505003, "sim_physics": 0.14101113722874567, "survival_time": 1.3000000000000005, "driven_lanedir": 0.40042409985820093, "sim_render-ego": 0.06206391407893254, "in-drivable-lane": 0, "agent_compute-ego": 0.14846015893496, "deviation-heading": 0.476664618733542, "set_robot_commands": 0.09670716982621412, "deviation-center-line": 0.09653468185427884, "driven_lanedir_consec": 0.40042409985820093, "sim_compute_sim_state": 0.041390189757713906, "sim_compute_performance-ego": 0.0696259645315317, "sim_compute_robot_state-ego": 0.07523555022019607, "sim_compute_robot_state-npc0": 0.06955735500042255, "sim_compute_robot_state-npc1": 0.06852364540100098, "sim_compute_robot_state-npc2": 0.06958455305833083, "sim_compute_robot_state-npc3": 0.07241338032942551}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579547507948106, "sim_physics": 0.14349093876386942, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2450085389977108, "sim_render-ego": 0.060618268816094646, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.1431022788348951, "deviation-heading": 0.37411538788852394, "set_robot_commands": 0.08802402646918046, "deviation-center-line": 0.11441348272325454, "driven_lanedir_consec": 1.2450085389977108, "sim_compute_sim_state": 0.03661346749255532, "sim_compute_performance-ego": 0.06676638440081947, "sim_compute_robot_state-ego": 0.06721029156132748, "sim_compute_robot_state-npc0": 0.0645819996532641, "sim_compute_robot_state-npc1": 0.06578749731967323, "sim_compute_robot_state-npc2": 0.06326522325214587, "sim_compute_robot_state-npc3": 0.062245889713889675}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6164397331284492, "sim_physics": 0.14750050894821745, "survival_time": 3.949999999999994, "driven_lanedir": 1.1969546012853631, "sim_render-ego": 0.057692162598235695, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.14708250383787516, "deviation-heading": 0.33193430349064146, "set_robot_commands": 0.09715490099749988, "deviation-center-line": 0.1246324681629531, "driven_lanedir_consec": 1.1969546012853631, "sim_compute_sim_state": 0.03928046890451938, "sim_compute_performance-ego": 0.06781349906438514, "sim_compute_robot_state-ego": 0.0689208266101306, "sim_compute_robot_state-npc0": 0.06932794595066505, "sim_compute_robot_state-npc1": 0.06734118884122825, "sim_compute_robot_state-npc2": 0.0648124881937534, "sim_compute_robot_state-npc3": 0.06797435615636126}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4775476886047264, "sim_physics": 0.1315971745385064, "survival_time": 1.3500000000000003, "driven_lanedir": 0.467048483396419, "sim_render-ego": 0.0637498520038746, "in-drivable-lane": 0, "agent_compute-ego": 0.1649848090277778, "deviation-heading": 0.2950797248623073, "set_robot_commands": 0.09592868663646556, "deviation-center-line": 0.08510371473961074, "driven_lanedir_consec": 0.467048483396419, "sim_compute_sim_state": 0.038828787980256255, "sim_compute_performance-ego": 0.0694204259801794, "sim_compute_robot_state-ego": 0.07042029168870714, "sim_compute_robot_state-npc0": 0.0680234255614104, "sim_compute_robot_state-npc1": 0.07023558793244539, "sim_compute_robot_state-npc2": 0.06957776458175094, "sim_compute_robot_state-npc3": 0.06742586912932219}}
set_robot_commands_max	0.09715490099749988
set_robot_commands_mean	0.0937429825343588
set_robot_commands_median	0.09592868663646556
set_robot_commands_min	0.08802402646918046
sim_compute_performance-ego_max	0.0696259645315317
sim_compute_performance-ego_mean	0.06792213970639849
sim_compute_performance-ego_median	0.06781349906438514
sim_compute_performance-ego_min	0.06598442455507675
sim_compute_robot_state-ego_max	0.07523555022019607
sim_compute_robot_state-ego_mean	0.07029805742307312
sim_compute_robot_state-ego_median	0.06970332703500423
sim_compute_robot_state-ego_min	0.06721029156132748
sim_compute_robot_state-npc0_max	0.07005530483317825
sim_compute_robot_state-npc0_mean	0.06830920619978806
sim_compute_robot_state-npc0_median	0.06932794595066505
sim_compute_robot_state-npc0_min	0.0645819996532641
sim_compute_robot_state-npc1_max	0.07023558793244539
sim_compute_robot_state-npc1_mean	0.06747819268856545
sim_compute_robot_state-npc1_median	0.06734118884122825
sim_compute_robot_state-npc1_min	0.06550304394847942
sim_compute_robot_state-npc2_max	0.06958455305833083
sim_compute_robot_state-npc2_mean	0.06626729327925077
sim_compute_robot_state-npc2_median	0.0648124881937534
sim_compute_robot_state-npc2_min	0.06326522325214587
sim_compute_robot_state-npc3_max	0.07241338032942551
sim_compute_robot_state-npc3_mean	0.06672975246799147
sim_compute_robot_state-npc3_median	0.06742586912932219
sim_compute_robot_state-npc3_min	0.062245889713889675
sim_compute_sim_state_max	0.041390189757713906
sim_compute_sim_state_mean	0.038250825154141285
sim_compute_sim_state_median	0.038828787980256255
sim_compute_sim_state_min	0.03514121163566158
sim_physics_max	0.14750050894821745
sim_physics_mean	0.13954831380296306
sim_physics_median	0.14101113722874567
sim_physics_min	0.1315971745385064
sim_render-ego_max	0.0637498520038746
sim_render-ego_mean	0.06027245179403844
sim_render-ego_median	0.060618268816094646
sim_render-ego_min	0.057238061473054706
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.609999999999998
survival_time_min	1.3000000000000005

No reset possible

20302

2832

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:23:50+00:00

2019-04-25 11:24:24+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20296

2840

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 11:23:05+00:00

2019-04-25 11:23:37+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20282

2860

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 11:03:19+00:00

2019-04-25 11:22:58+00:00

0:19:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36875035915223986
survival_time_median	6.0499999999999865
deviation-center-line_median	0.22379457906317324
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.1041470627452052
agent_compute-ego_mean	0.09736922144595124
agent_compute-ego_median	0.09975613342536677
agent_compute-ego_min	0.08528492185804579
deviation-center-line_max	0.28626035179202913
deviation-center-line_mean	0.22013988783009855
deviation-center-line_min	0.14530953188726245
deviation-heading_max	2.173975921590914
deviation-heading_mean	1.6590333981812446
deviation-heading_median	1.623157052686257
deviation-heading_min	1.3587642219386942
driven_any_max	1.1712814837759034
driven_any_mean	0.5518651089614242
driven_any_median	0.4592824276717162
driven_any_min	0.2985822991220089
driven_lanedir_consec_max	0.5015184846367295
driven_lanedir_consec_mean	0.34998038310188306
driven_lanedir_consec_min	0.22379398562318495
driven_lanedir_max	0.5015184846367295
driven_lanedir_mean	0.34998038310188306
driven_lanedir_median	0.36875035915223986
driven_lanedir_min	0.22379398562318495
in-drivable-lane_max	7.550000000000093
in-drivable-lane_mean	1.9600000000000173
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1712814837759034, "sim_physics": 0.17838665326436362, "survival_time": 14.950000000000076, "driven_lanedir": 0.5015184846367295, "sim_render-ego": 0.05897436539332072, "in-drivable-lane": 7.550000000000093, "agent_compute-ego": 0.09757434447606404, "deviation-heading": 2.173975921590914, "set_robot_commands": 0.09167154391606648, "deviation-center-line": 0.28626035179202913, "driven_lanedir_consec": 0.5015184846367295, "sim_compute_sim_state": 0.03785211245218913, "sim_compute_performance-ego": 0.0657281748453776, "sim_compute_robot_state-ego": 0.07102364699045817, "sim_compute_robot_state-npc0": 0.06538318872451782, "sim_compute_robot_state-npc1": 0.06556766112645467, "sim_compute_robot_state-npc2": 0.06470272064208984, "sim_compute_robot_state-npc3": 0.06632320880889893}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.338746696288568, "sim_physics": 0.16039248875209264, "survival_time": 4.549999999999992, "driven_lanedir": 0.22379398562318495, "sim_render-ego": 0.0605260880438836, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.09975613342536677, "deviation-heading": 1.7035902983095634, "set_robot_commands": 0.09584338586409014, "deviation-center-line": 0.18744866905603383, "driven_lanedir_consec": 0.22379398562318495, "sim_compute_sim_state": 0.0395833188360864, "sim_compute_performance-ego": 0.07101953422630226, "sim_compute_robot_state-ego": 0.077939727804163, "sim_compute_robot_state-npc0": 0.07396024924058181, "sim_compute_robot_state-npc1": 0.07080555486155081, "sim_compute_robot_state-npc2": 0.07035086181137588, "sim_compute_robot_state-npc3": 0.07021763298537705}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.491432637948924, "sim_physics": 0.17437779811001564, "survival_time": 6.449999999999985, "driven_lanedir": 0.3830067619288937, "sim_render-ego": 0.06223670087119405, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.1041470627452052, "deviation-heading": 1.623157052686257, "set_robot_commands": 0.094807179399239, "deviation-center-line": 0.14530953188726245, "driven_lanedir_consec": 0.3830067619288937, "sim_compute_sim_state": 0.03961905952571899, "sim_compute_performance-ego": 0.06827051325361858, "sim_compute_robot_state-ego": 0.07257842093475106, "sim_compute_robot_state-npc0": 0.0687263381573581, "sim_compute_robot_state-npc1": 0.06922223401624103, "sim_compute_robot_state-npc2": 0.06975118873655334, "sim_compute_robot_state-npc3": 0.0709160889766013}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4592824276717162, "sim_physics": 0.16220968813935588, "survival_time": 6.0499999999999865, "driven_lanedir": 0.36875035915223986, "sim_render-ego": 0.05685379682493604, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.10008364472507446, "deviation-heading": 1.3587642219386942, "set_robot_commands": 0.09608701832038312, "deviation-center-line": 0.22379457906317324, "driven_lanedir_consec": 0.36875035915223986, "sim_compute_sim_state": 0.03830773968341922, "sim_compute_performance-ego": 0.06497909017830841, "sim_compute_robot_state-ego": 0.06941483040486486, "sim_compute_robot_state-npc0": 0.06664451488778611, "sim_compute_robot_state-npc1": 0.06761177512239819, "sim_compute_robot_state-npc2": 0.06366897811574385, "sim_compute_robot_state-npc3": 0.06523487981685921}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2985822991220089, "sim_physics": 0.1122485355094627, "survival_time": 4.049999999999994, "driven_lanedir": 0.27283232416836734, "sim_render-ego": 0.04815617314091435, "in-drivable-lane": 0, "agent_compute-ego": 0.08528492185804579, "deviation-heading": 1.4356794963807944, "set_robot_commands": 0.07594253693097903, "deviation-center-line": 0.25788630735199414, "driven_lanedir_consec": 0.27283232416836734, "sim_compute_sim_state": 0.03824407966048629, "sim_compute_performance-ego": 0.05431131669032721, "sim_compute_robot_state-ego": 0.058249344060450424, "sim_compute_robot_state-npc0": 0.054363377300309546, "sim_compute_robot_state-npc1": 0.05705244452865035, "sim_compute_robot_state-npc2": 0.05590045304945958, "sim_compute_robot_state-npc3": 0.05634115949089145}}
set_robot_commands_max	0.09608701832038312
set_robot_commands_mean	0.09087033288615157
set_robot_commands_median	0.094807179399239
set_robot_commands_min	0.07594253693097903
sim_compute_performance-ego_max	0.07101953422630226
sim_compute_performance-ego_mean	0.06486172583878683
sim_compute_performance-ego_median	0.0657281748453776
sim_compute_performance-ego_min	0.05431131669032721
sim_compute_robot_state-ego_max	0.077939727804163
sim_compute_robot_state-ego_mean	0.0698411940389375
sim_compute_robot_state-ego_median	0.07102364699045817
sim_compute_robot_state-ego_min	0.058249344060450424
sim_compute_robot_state-npc0_max	0.07396024924058181
sim_compute_robot_state-npc0_mean	0.06581553366211067
sim_compute_robot_state-npc0_median	0.06664451488778611
sim_compute_robot_state-npc0_min	0.054363377300309546
sim_compute_robot_state-npc1_max	0.07080555486155081
sim_compute_robot_state-npc1_mean	0.06605193393105901
sim_compute_robot_state-npc1_median	0.06761177512239819
sim_compute_robot_state-npc1_min	0.05705244452865035
sim_compute_robot_state-npc2_max	0.07035086181137588
sim_compute_robot_state-npc2_mean	0.0648748404710445
sim_compute_robot_state-npc2_median	0.06470272064208984
sim_compute_robot_state-npc2_min	0.05590045304945958
sim_compute_robot_state-npc3_max	0.0709160889766013
sim_compute_robot_state-npc3_mean	0.0658065940157256
sim_compute_robot_state-npc3_median	0.06632320880889893
sim_compute_robot_state-npc3_min	0.05634115949089145
sim_compute_sim_state_max	0.03961905952571899
sim_compute_sim_state_mean	0.03872126203158001
sim_compute_sim_state_median	0.03830773968341922
sim_compute_sim_state_min	0.03785211245218913
sim_physics_max	0.17838665326436362
sim_physics_mean	0.1575230327550581
sim_physics_median	0.16220968813935588
sim_physics_min	0.1122485355094627
sim_render-ego_max	0.06223670087119405
sim_render-ego_mean	0.05734942485484975
sim_render-ego_median	0.05897436539332072
sim_render-ego_min	0.04815617314091435
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.210000000000008
survival_time_min	4.049999999999994

No reset possible

20266

2876

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-25 10:57:37+00:00

2019-04-25 11:00:04+00:00

0:02:27

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20266-376130', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20266-376130', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20266-376130', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20258

2899

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 10:45:33+00:00

2019-04-25 10:55:59+00:00

0:10:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6699225406572222
survival_time_median	6.0499999999999865
deviation-center-line_median	0.22995302634185713
in-drivable-lane_median	0.3999999999999986

other stats

agent_compute-ego_max	0.26271561029795054
agent_compute-ego_mean	0.23215412153312232
agent_compute-ego_median	0.22935166441161056
agent_compute-ego_min	0.2104056906109014
deviation-center-line_max	0.6376958782235096
deviation-center-line_mean	0.34858231261166267
deviation-center-line_min	0.18889694076709615
deviation-heading_max	1.7066130625106082
deviation-heading_mean	0.9126039245795228
deviation-heading_median	0.9021208229499248
deviation-heading_min	0.44399577672024026
driven_any_max	1.575030364392147
driven_any_mean	0.8587490532208356
driven_any_median	0.998510449511858
driven_any_min	0.2647628416295011
driven_lanedir_consec_max	1.1821171025762802
driven_lanedir_consec_mean	0.6805170112181821
driven_lanedir_consec_min	0.2571712012026639
driven_lanedir_max	1.1821171025762802
driven_lanedir_mean	0.6805170112181821
driven_lanedir_median	0.6699225406572222
driven_lanedir_min	0.2571712012026639
in-drivable-lane_max	2.2000000000000153
in-drivable-lane_mean	0.8500000000000016
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.998510449511858, "sim_physics": 0.09470441124655984, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6699225406572222, "sim_render-ego": 0.05439578206085962, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.2104056906109014, "deviation-heading": 0.9579229495443632, "set_robot_commands": 0.0913836167863578, "deviation-center-line": 0.22995302634185713, "driven_lanedir_consec": 0.6699225406572222, "sim_compute_sim_state": 0.03548059581725065, "sim_compute_performance-ego": 0.0627868155802577, "sim_compute_robot_state-ego": 0.06805208694836325}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0072456017882747, "sim_physics": 0.1149060061720551, "survival_time": 6.099999999999986, "driven_lanedir": 0.8667370328790637, "sim_render-ego": 0.060635967332808696, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.23894436046725415, "deviation-heading": 1.7066130625106082, "set_robot_commands": 0.09517870965551158, "deviation-center-line": 0.486792871069697, "driven_lanedir_consec": 0.8667370328790637, "sim_compute_sim_state": 0.038899920025809866, "sim_compute_performance-ego": 0.07131749293843254, "sim_compute_robot_state-ego": 0.07234731072285136}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2647628416295011, "sim_physics": 0.11893231804306442, "survival_time": 1.850000000000001, "driven_lanedir": 0.2571712012026639, "sim_render-ego": 0.0675089488158355, "in-drivable-lane": 0, "agent_compute-ego": 0.26271561029795054, "deviation-heading": 0.44399577672024026, "set_robot_commands": 0.10339771090327082, "deviation-center-line": 0.18889694076709615, "driven_lanedir_consec": 0.2571712012026639, "sim_compute_sim_state": 0.04111308664888949, "sim_compute_performance-ego": 0.07645503894702808, "sim_compute_robot_state-ego": 0.089217082874195}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.44819600878239807, "sim_physics": 0.10187163435179612, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4266371787756804, "sim_render-ego": 0.06005026143172692, "in-drivable-lane": 0, "agent_compute-ego": 0.22935166441161056, "deviation-heading": 0.9021208229499248, "set_robot_commands": 0.09580199060768917, "deviation-center-line": 0.19957284665615352, "driven_lanedir_consec": 0.4266371787756804, "sim_compute_sim_state": 0.038037217896560144, "sim_compute_performance-ego": 0.06733270760240226, "sim_compute_robot_state-ego": 0.07382291349871405}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.575030364392147, "sim_physics": 0.10669394737896434, "survival_time": 9.349999999999998, "driven_lanedir": 1.1821171025762802, "sim_render-ego": 0.058871547168588896, "in-drivable-lane": 2.2000000000000153, "agent_compute-ego": 0.2193532818778951, "deviation-heading": 0.5523670111724762, "set_robot_commands": 0.09161167221273332, "deviation-center-line": 0.6376958782235096, "driven_lanedir_consec": 1.1821171025762802, "sim_compute_sim_state": 0.03848479138338629, "sim_compute_performance-ego": 0.06543214563379951, "sim_compute_robot_state-ego": 0.07185689650754877}}
set_robot_commands_max	0.10339771090327082
set_robot_commands_mean	0.09547474003311254
set_robot_commands_median	0.09517870965551158
set_robot_commands_min	0.0913836167863578
sim_compute_performance-ego_max	0.07645503894702808
sim_compute_performance-ego_mean	0.06866484014038401
sim_compute_performance-ego_median	0.06733270760240226
sim_compute_performance-ego_min	0.0627868155802577
sim_compute_robot_state-ego_max	0.089217082874195
sim_compute_robot_state-ego_mean	0.0750592581103345
sim_compute_robot_state-ego_median	0.07234731072285136
sim_compute_robot_state-ego_min	0.06805208694836325
sim_compute_sim_state_max	0.04111308664888949
sim_compute_sim_state_mean	0.03840312235437929
sim_compute_sim_state_median	0.03848479138338629
sim_compute_sim_state_min	0.03548059581725065
sim_physics_max	0.11893231804306442
sim_physics_mean	0.10742166343848795
sim_physics_median	0.10669394737896434
sim_physics_min	0.09470441124655984
sim_render-ego_max	0.0675089488158355
sim_render-ego_mean	0.06029250136196392
sim_render-ego_median	0.06005026143172692
sim_render-ego_min	0.05439578206085962
simulation-passed	1
survival_time_max	9.349999999999998
survival_time_mean	5.249999999999995
survival_time_min	1.850000000000001

No reset possible

20249

2928

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-25 10:39:15+00:00

2019-04-25 10:45:06+00:00

0:05:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06383003074625648
survival_time_median	1.2000000000000004
deviation-center-line_median	0.06066678210422354
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1623095014820928
agent_compute-ego_mean	0.15533993971632762
agent_compute-ego_median	0.15700860818227133
agent_compute-ego_min	0.14542243140084402
deviation-center-line_max	0.09373261432787892
deviation-center-line_mean	0.07283215754689161
deviation-center-line_min	0.05813600937707228
deviation-heading_max	0.8960240278623242
deviation-heading_mean	0.7286718501722032
deviation-heading_median	0.7077809824052738
deviation-heading_min	0.5766624537894228
driven_any_max	0.2237313323820293
driven_any_mean	0.15166988735948334
driven_any_median	0.14860129674731049
driven_any_min	0.10187815042405528
driven_lanedir_consec_max	0.0931226017112552
driven_lanedir_consec_mean	0.06703927601359205
driven_lanedir_consec_min	0.05260975325708994
driven_lanedir_max	0.0931226017112552
driven_lanedir_mean	0.06703927601359205
driven_lanedir_median	0.06383003074625648
driven_lanedir_min	0.05260975325708994
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.18000000000000016
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2237313323820293, "sim_physics": 0.15963715144566126, "survival_time": 1.7500000000000009, "driven_lanedir": 0.07065483945414264, "sim_render-ego": 0.05552926063537598, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.14542243140084402, "deviation-heading": 0.7077809824052738, "set_robot_commands": 0.08432136263166155, "deviation-center-line": 0.05828759068046983, "driven_lanedir_consec": 0.07065483945414264, "sim_compute_sim_state": 0.03687289101736886, "sim_compute_performance-ego": 0.06225771222795759, "sim_compute_robot_state-ego": 0.06690108435494559, "sim_compute_robot_state-npc0": 0.06421638897487096, "sim_compute_robot_state-npc1": 0.06037367412022182, "sim_compute_robot_state-npc2": 0.06195557458060128, "sim_compute_robot_state-npc3": 0.06088126046316964}, "udem1-1-0": {"driven_any": 0.1809882479234302, "sim_physics": 0.16013314042772567, "survival_time": 1.4000000000000006, "driven_lanedir": 0.05260975325708994, "sim_render-ego": 0.06608951943261283, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.1576997467449733, "deviation-heading": 0.8960240278623242, "set_robot_commands": 0.08516804661069598, "deviation-center-line": 0.06066678210422354, "driven_lanedir_consec": 0.05260975325708994, "sim_compute_sim_state": 0.03506284952163696, "sim_compute_performance-ego": 0.06614981378827776, "sim_compute_robot_state-ego": 0.07074505942208427, "sim_compute_robot_state-npc0": 0.06491420950208392, "sim_compute_robot_state-npc1": 0.06494516134262085, "sim_compute_robot_state-npc2": 0.06131259884153094, "sim_compute_robot_state-npc3": 0.06126747812543597}, "udem1-2-0": {"driven_any": 0.10315040932059127, "sim_physics": 0.1709365194494074, "survival_time": 1.1000000000000003, "driven_lanedir": 0.06383003074625648, "sim_render-ego": 0.056772167032415215, "in-drivable-lane": 0, "agent_compute-ego": 0.15425941077145663, "deviation-heading": 0.5766624537894228, "set_robot_commands": 0.0914417722008445, "deviation-center-line": 0.09373261432787892, "driven_lanedir_consec": 0.06383003074625648, "sim_compute_sim_state": 0.03458516164259477, "sim_compute_performance-ego": 0.061774037101052025, "sim_compute_robot_state-ego": 0.06890606880187988, "sim_compute_robot_state-npc0": 0.07522304491563277, "sim_compute_robot_state-npc1": 0.09354686737060548, "sim_compute_robot_state-npc2": 0.06740622086958452, "sim_compute_robot_state-npc3": 0.06691148064353249}, "udem1-3-0": {"driven_any": 0.10187815042405528, "sim_physics": 0.15990788003672723, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05497915489921601, "sim_render-ego": 0.06210361356320589, "in-drivable-lane": 0, "agent_compute-ego": 0.1623095014820928, "deviation-heading": 0.6680276091304969, "set_robot_commands": 0.0939570302548616, "deviation-center-line": 0.09333779124481348, "driven_lanedir_consec": 0.05497915489921601, "sim_compute_sim_state": 0.03849531256634256, "sim_compute_performance-ego": 0.06268124995024307, "sim_compute_robot_state-ego": 0.06496333039325217, "sim_compute_robot_state-npc0": 0.06344398208286452, "sim_compute_robot_state-npc1": 0.06550549424212912, "sim_compute_robot_state-npc2": 0.061141283615775734, "sim_compute_robot_state-npc3": 0.0630609885506008}, "udem1-4-0": {"driven_any": 0.14860129674731049, "sim_physics": 0.1456972360610962, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0931226017112552, "sim_render-ego": 0.055366446574529014, "in-drivable-lane": 0, "agent_compute-ego": 0.15700860818227133, "deviation-heading": 0.7948641776734988, "set_robot_commands": 0.10025207201639812, "deviation-center-line": 0.05813600937707228, "driven_lanedir_consec": 0.0931226017112552, "sim_compute_sim_state": 0.03664450844128927, "sim_compute_performance-ego": 0.05969196557998657, "sim_compute_robot_state-ego": 0.06584190328915913, "sim_compute_robot_state-npc0": 0.062233577171961464, "sim_compute_robot_state-npc1": 0.060697356859842934, "sim_compute_robot_state-npc2": 0.06266416112581889, "sim_compute_robot_state-npc3": 0.06803173820177714}}
set_robot_commands_max	0.10025207201639812
set_robot_commands_mean	0.09102805674289235
set_robot_commands_median	0.0914417722008445
set_robot_commands_min	0.08432136263166155
sim_compute_performance-ego_max	0.06614981378827776
sim_compute_performance-ego_mean	0.06251095572950341
sim_compute_performance-ego_median	0.06225771222795759
sim_compute_performance-ego_min	0.05969196557998657
sim_compute_robot_state-ego_max	0.07074505942208427
sim_compute_robot_state-ego_mean	0.0674714892522642
sim_compute_robot_state-ego_median	0.06690108435494559
sim_compute_robot_state-ego_min	0.06496333039325217
sim_compute_robot_state-npc0_max	0.07522304491563277
sim_compute_robot_state-npc0_mean	0.06600624052948273
sim_compute_robot_state-npc0_median	0.06421638897487096
sim_compute_robot_state-npc0_min	0.062233577171961464
sim_compute_robot_state-npc1_max	0.09354686737060548
sim_compute_robot_state-npc1_mean	0.06901371078708404
sim_compute_robot_state-npc1_median	0.06494516134262085
sim_compute_robot_state-npc1_min	0.06037367412022182
sim_compute_robot_state-npc2_max	0.06740622086958452
sim_compute_robot_state-npc2_mean	0.06289596780666228
sim_compute_robot_state-npc2_median	0.06195557458060128
sim_compute_robot_state-npc2_min	0.061141283615775734
sim_compute_robot_state-npc3_max	0.06803173820177714
sim_compute_robot_state-npc3_mean	0.06403058919690321
sim_compute_robot_state-npc3_median	0.0630609885506008
sim_compute_robot_state-npc3_min	0.06088126046316964
sim_compute_sim_state_max	0.03849531256634256
sim_compute_sim_state_mean	0.03633214463784649
sim_compute_sim_state_median	0.03664450844128927
sim_compute_sim_state_min	0.03458516164259477
sim_physics_max	0.1709365194494074
sim_physics_mean	0.15926238548412355
sim_physics_median	0.15990788003672723
sim_physics_min	0.1456972360610962
sim_render-ego_max	0.06608951943261283
sim_render-ego_mean	0.05917220144762778
sim_render-ego_median	0.056772167032415215
sim_render-ego_min	0.055366446574529014
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.3200000000000005
survival_time_min	1.1000000000000003

No reset possible

20245

2932

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 10:38:15+00:00

2019-04-25 10:39:07+00:00

0:00:52

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20241

2940

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 10:37:07+00:00

2019-04-25 10:38:02+00:00

0:00:55

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20224

2974

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 10:18:25+00:00

2019-04-25 10:36:50+00:00

0:18:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.0296449864938304
survival_time_median	10.95000000000002
deviation-center-line_median	0.6574342265865306
in-drivable-lane_median	0.20000000000000284

other stats

agent_compute-ego_max	0.2397025392410603
agent_compute-ego_mean	0.20935480880426632
agent_compute-ego_median	0.20549622058868408
agent_compute-ego_min	0.19556967748536003
deviation-center-line_max	0.8082343539795617
deviation-center-line_mean	0.5664671019859062
deviation-center-line_min	0.2424632264677652
deviation-heading_max	5.233528805778606
deviation-heading_mean	2.223445572572194
deviation-heading_median	1.4118660804700076
deviation-heading_min	0.7349982072700526
driven_any_max	1.2369739133850703
driven_any_mean	0.9499711454528356
driven_any_median	1.090059841611741
driven_any_min	0.2093141190959693
driven_lanedir_consec_max	1.086978972501689
driven_lanedir_consec_mean	0.8068035397782285
driven_lanedir_consec_min	0.19828821337612412
driven_lanedir_max	1.086978972501689
driven_lanedir_mean	0.834154713894202
driven_lanedir_median	1.0296449864938304
driven_lanedir_min	0.19828821337612412
in-drivable-lane_max	4.40000000000006
in-drivable-lane_mean	1.0400000000000142
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2369739133850703, "sim_physics": 0.12170775492986044, "survival_time": 14.950000000000076, "driven_lanedir": 0.78064231537998, "sim_render-ego": 0.059358320236206054, "in-drivable-lane": 4.40000000000006, "agent_compute-ego": 0.20549622058868408, "deviation-heading": 5.233528805778606, "set_robot_commands": 0.09330103158950806, "deviation-center-line": 0.6812753883902203, "driven_lanedir_consec": 0.6438864448001118, "sim_compute_sim_state": 0.038841335773468016, "sim_compute_performance-ego": 0.06794358968734741, "sim_compute_robot_state-ego": 0.07322815100351969}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.144231960536913, "sim_physics": 0.10157909244298936, "survival_time": 14.40000000000007, "driven_lanedir": 1.086978972501689, "sim_render-ego": 0.057244140240881175, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.19556967748536003, "deviation-heading": 2.3386274922701564, "set_robot_commands": 0.08609419729974535, "deviation-center-line": 0.8082343539795617, "driven_lanedir_consec": 1.086978972501689, "sim_compute_sim_state": 0.037967471612824336, "sim_compute_performance-ego": 0.06434318754408094, "sim_compute_robot_state-ego": 0.06678272700972027}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2093141190959693, "sim_physics": 0.1125878577536725, "survival_time": 2.3499999999999996, "driven_lanedir": 0.19828821337612412, "sim_render-ego": 0.06752636077556204, "in-drivable-lane": 0, "agent_compute-ego": 0.2397025392410603, "deviation-heading": 0.7349982072700526, "set_robot_commands": 0.10573319171337373, "deviation-center-line": 0.2424632264677652, "driven_lanedir_consec": 0.19828821337612412, "sim_compute_sim_state": 0.043656947764944526, "sim_compute_performance-ego": 0.07491802154703343, "sim_compute_robot_state-ego": 0.08164704606888142}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.090059841611741, "sim_physics": 0.10931904043131206, "survival_time": 10.050000000000008, "driven_lanedir": 1.075219081719387, "sim_render-ego": 0.05907246485278381, "in-drivable-lane": 0, "agent_compute-ego": 0.1957507916350863, "deviation-heading": 1.3982072770721476, "set_robot_commands": 0.08984737135284576, "deviation-center-line": 0.6574342265865306, "driven_lanedir_consec": 1.075219081719387, "sim_compute_sim_state": 0.03821532050175453, "sim_compute_performance-ego": 0.06582926517695337, "sim_compute_robot_state-ego": 0.06886825276844537}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.069275892634483, "sim_physics": 0.12441899896212363, "survival_time": 10.95000000000002, "driven_lanedir": 1.0296449864938304, "sim_render-ego": 0.05900509825580196, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.2102548150711408, "deviation-heading": 1.4118660804700076, "set_robot_commands": 0.09043288992964514, "deviation-center-line": 0.4429283145054532, "driven_lanedir_consec": 1.0296449864938304, "sim_compute_sim_state": 0.03908756116753844, "sim_compute_performance-ego": 0.06603867604852268, "sim_compute_robot_state-ego": 0.0729329607802439}}
set_robot_commands_max	0.10573319171337373
set_robot_commands_mean	0.0930817363770236
set_robot_commands_median	0.09043288992964514
set_robot_commands_min	0.08609419729974535
sim_compute_performance-ego_max	0.07491802154703343
sim_compute_performance-ego_mean	0.06781454800078757
sim_compute_performance-ego_median	0.06603867604852268
sim_compute_performance-ego_min	0.06434318754408094
sim_compute_robot_state-ego_max	0.08164704606888142
sim_compute_robot_state-ego_mean	0.07269182752616213
sim_compute_robot_state-ego_median	0.0729329607802439
sim_compute_robot_state-ego_min	0.06678272700972027
sim_compute_sim_state_max	0.043656947764944526
sim_compute_sim_state_mean	0.03955372736410597
sim_compute_sim_state_median	0.038841335773468016
sim_compute_sim_state_min	0.037967471612824336
sim_physics_max	0.12441899896212363
sim_physics_mean	0.1139225489039916
sim_physics_median	0.1125878577536725
sim_physics_min	0.10157909244298936
sim_render-ego_max	0.06752636077556204
sim_render-ego_mean	0.060441276872247006
sim_render-ego_median	0.05907246485278381
sim_render-ego_min	0.057244140240881175
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.540000000000036
survival_time_min	2.3499999999999996

No reset possible

20180

2661

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-25 10:02:17+00:00

2019-04-25 10:18:12+00:00

0:15:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5103168574061394
survival_time_median	5.04999999999999
deviation-center-line_median	0.3878413148571266
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.08467745544886825
agent_compute-ego_mean	0.07976626890892184
agent_compute-ego_median	0.08018283234086147
agent_compute-ego_min	0.07658523983425564
deviation-center-line_max	0.7265368891817566
deviation-center-line_mean	0.39887178723147265
deviation-center-line_min	0.14418495551290345
deviation-heading_max	3.5566535461712796
deviation-heading_mean	2.3483070469164353
deviation-heading_median	2.57798350217816
deviation-heading_min	0.5703088460024097
driven_any_max	1.3282944020754783
driven_any_mean	0.8383104773839097
driven_any_median	0.7577407610059756
driven_any_min	0.235525304530103
driven_lanedir_consec_max	1.1513147268508137
driven_lanedir_consec_mean	0.6236125011051017
driven_lanedir_consec_min	0.20715615140836952
driven_lanedir_max	1.1513147268508137
driven_lanedir_mean	0.6304733422322991
driven_lanedir_median	0.5103168574061394
driven_lanedir_min	0.20715615140836952
in-drivable-lane_max	1.2499999999999956
in-drivable-lane_mean	0.4699999999999983
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1685538467989365, "sim_physics": 0.18730845853879857, "survival_time": 7.699999999999981, "driven_lanedir": 0.834756679357481, "sim_render-ego": 0.06049884758986436, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.07714095363369236, "deviation-heading": 2.57798350217816, "set_robot_commands": 0.09301373710880032, "deviation-center-line": 0.4665372473374601, "driven_lanedir_consec": 0.800452473721494, "sim_compute_sim_state": 0.037882088066695574, "sim_compute_performance-ego": 0.06684406237168745, "sim_compute_robot_state-ego": 0.07032402614494423, "sim_compute_robot_state-npc0": 0.06830700032122723, "sim_compute_robot_state-npc1": 0.06669751080599698, "sim_compute_robot_state-npc2": 0.06910992442787468, "sim_compute_robot_state-npc3": 0.06903964977759819}, "udem1-1-0": {"driven_any": 0.7577407610059756, "sim_physics": 0.19604522402923885, "survival_time": 5.04999999999999, "driven_lanedir": 0.5103168574061394, "sim_render-ego": 0.06834357799869953, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08467745544886825, "deviation-heading": 2.639934799607412, "set_robot_commands": 0.1047584349566167, "deviation-center-line": 0.2692585292681164, "driven_lanedir_consec": 0.5103168574061394, "sim_compute_sim_state": 0.05175283875795874, "sim_compute_performance-ego": 0.07953123526998085, "sim_compute_robot_state-ego": 0.08182555850189512, "sim_compute_robot_state-npc0": 0.07673243720932763, "sim_compute_robot_state-npc1": 0.07465155998078904, "sim_compute_robot_state-npc2": 0.07558693508110424, "sim_compute_robot_state-npc3": 0.07420862783299814}, "udem1-2-0": {"driven_any": 0.7014380725090558, "sim_physics": 0.18993920721906296, "survival_time": 4.699999999999991, "driven_lanedir": 0.4488222961386925, "sim_render-ego": 0.06415379808304157, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08024486328693146, "deviation-heading": 2.3966545406229147, "set_robot_commands": 0.09623814897334322, "deviation-center-line": 0.3878413148571266, "driven_lanedir_consec": 0.4488222961386925, "sim_compute_sim_state": 0.03952875796784746, "sim_compute_performance-ego": 0.06899650553439526, "sim_compute_robot_state-ego": 0.07249049176561072, "sim_compute_robot_state-npc0": 0.07043600843307819, "sim_compute_robot_state-npc1": 0.06888833451778331, "sim_compute_robot_state-npc2": 0.06925797716100165, "sim_compute_robot_state-npc3": 0.0703623649921823}, "udem1-3-0": {"driven_any": 0.235525304530103, "sim_physics": 0.19001075956556532, "survival_time": 1.800000000000001, "driven_lanedir": 0.20715615140836952, "sim_render-ego": 0.062390651967790395, "in-drivable-lane": 0, "agent_compute-ego": 0.07658523983425564, "deviation-heading": 0.5703088460024097, "set_robot_commands": 0.0970503952768114, "deviation-center-line": 0.14418495551290345, "driven_lanedir_consec": 0.20715615140836952, "sim_compute_sim_state": 0.04005522198147244, "sim_compute_performance-ego": 0.07070461246702406, "sim_compute_robot_state-ego": 0.07128705581029256, "sim_compute_robot_state-npc0": 0.07522649897469415, "sim_compute_robot_state-npc1": 0.07133557399113973, "sim_compute_robot_state-npc2": 0.07443883683946398, "sim_compute_robot_state-npc3": 0.06955815023846096}, "udem1-4-0": {"driven_any": 1.3282944020754783, "sim_physics": 0.21935116413027744, "survival_time": 8.599999999999987, "driven_lanedir": 1.1513147268508137, "sim_render-ego": 0.06410356455071028, "in-drivable-lane": 0, "agent_compute-ego": 0.08018283234086147, "deviation-heading": 3.5566535461712796, "set_robot_commands": 0.10112677895745566, "deviation-center-line": 0.7265368891817566, "driven_lanedir_consec": 1.1513147268508137, "sim_compute_sim_state": 0.04086143748704777, "sim_compute_performance-ego": 0.07212061937465224, "sim_compute_robot_state-ego": 0.0785200554271077, "sim_compute_robot_state-npc0": 0.0728560256403546, "sim_compute_robot_state-npc1": 0.0737022785253303, "sim_compute_robot_state-npc2": 0.07411719893300256, "sim_compute_robot_state-npc3": 0.07344910294510597}}
set_robot_commands_max	0.1047584349566167
set_robot_commands_mean	0.09843749905460544
set_robot_commands_median	0.0970503952768114
set_robot_commands_min	0.09301373710880032
sim_compute_performance-ego_max	0.07953123526998085
sim_compute_performance-ego_mean	0.07163940700354797
sim_compute_performance-ego_median	0.07070461246702406
sim_compute_performance-ego_min	0.06684406237168745
sim_compute_robot_state-ego_max	0.08182555850189512
sim_compute_robot_state-ego_mean	0.07488943752997007
sim_compute_robot_state-ego_median	0.07249049176561072
sim_compute_robot_state-ego_min	0.07032402614494423
sim_compute_robot_state-npc0_max	0.07673243720932763
sim_compute_robot_state-npc0_mean	0.07271159411573636
sim_compute_robot_state-npc0_median	0.0728560256403546
sim_compute_robot_state-npc0_min	0.06830700032122723
sim_compute_robot_state-npc1_max	0.07465155998078904
sim_compute_robot_state-npc1_mean	0.07105505156420787
sim_compute_robot_state-npc1_median	0.07133557399113973
sim_compute_robot_state-npc1_min	0.06669751080599698
sim_compute_robot_state-npc2_max	0.07558693508110424
sim_compute_robot_state-npc2_mean	0.07250217448848942
sim_compute_robot_state-npc2_median	0.07411719893300256
sim_compute_robot_state-npc2_min	0.06910992442787468
sim_compute_robot_state-npc3_max	0.07420862783299814
sim_compute_robot_state-npc3_mean	0.07132357915726911
sim_compute_robot_state-npc3_median	0.0703623649921823
sim_compute_robot_state-npc3_min	0.06903964977759819
sim_compute_sim_state_max	0.05175283875795874
sim_compute_sim_state_mean	0.042016068852204394
sim_compute_sim_state_median	0.04005522198147244
sim_compute_sim_state_min	0.037882088066695574
sim_physics_max	0.21935116413027744
sim_physics_mean	0.19653096269658865
sim_physics_median	0.19001075956556532
sim_physics_min	0.18730845853879857
sim_render-ego_max	0.06834357799869953
sim_render-ego_mean	0.06389808803802124
sim_render-ego_median	0.06410356455071028
sim_render-ego_min	0.06049884758986436
simulation-passed	1
survival_time_max	8.599999999999987
survival_time_mean	5.5699999999999905
survival_time_min	1.800000000000001

No reset possible

20168

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-25 09:59:12+00:00

2019-04-25 10:02:03+00:00

0:02:51

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20168-336803', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20168-336803', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20168-336803', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20162

2828

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-25 09:53:33+00:00

2019-04-25 09:59:04+00:00

0:05:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.576224177547854
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14883191153694192
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.1672521987051334
agent_compute-ego_mean	0.14695585850626589
agent_compute-ego_median	0.14521566262611976
agent_compute-ego_min	0.12861354827880858
deviation-center-line_max	0.2616907164891491
deviation-center-line_mean	0.14783547886832604
deviation-center-line_min	0.082953742710957
deviation-heading_max	0.5845520464047074
deviation-heading_mean	0.33155245513961573
deviation-heading_median	0.2409964306091145
deviation-heading_min	0.19231746951364015
driven_any_max	1.6077077287168993
driven_any_mean	0.8622724108020788
driven_any_median	1.006879208370262
driven_any_min	0.25817502165929507
driven_lanedir_consec_max	1.104102494174326
driven_lanedir_consec_mean	0.6287232488539246
driven_lanedir_consec_min	0.2479316890295844
driven_lanedir_max	1.104102494174326
driven_lanedir_mean	0.6287232488539246
driven_lanedir_median	0.576224177547854
driven_lanedir_min	0.2479316890295844
in-drivable-lane_max	1.099999999999996
in-drivable-lane_mean	0.4699999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006879208370262, "sim_physics": 0.11210031329460864, "survival_time": 2.6499999999999986, "driven_lanedir": 0.576224177547854, "sim_render-ego": 0.06669320700303563, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.1672521987051334, "deviation-heading": 0.19231746951364015, "set_robot_commands": 0.1014364350516841, "deviation-center-line": 0.1591461472514269, "driven_lanedir_consec": 0.576224177547854, "sim_compute_sim_state": 0.04228389488076264, "sim_compute_performance-ego": 0.07463821375145102, "sim_compute_robot_state-ego": 0.08719973294240124}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.012120091757381, "sim_physics": 0.09952075664813702, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8136951506166006, "sim_render-ego": 0.0555493189738347, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14521566262611976, "deviation-heading": 0.5845520464047074, "set_robot_commands": 0.0900894678556002, "deviation-center-line": 0.14883191153694192, "driven_lanedir_consec": 0.8136951506166006, "sim_compute_sim_state": 0.038638995243952826, "sim_compute_performance-ego": 0.06536337045522836, "sim_compute_robot_state-ego": 0.0683407187461853}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25817502165929507, "sim_physics": 0.10266971588134766, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2479316890295844, "sim_render-ego": 0.06304792563120525, "in-drivable-lane": 0, "agent_compute-ego": 0.1594374179840088, "deviation-heading": 0.2409964306091145, "set_robot_commands": 0.098629183239407, "deviation-center-line": 0.08655487635315534, "driven_lanedir_consec": 0.2479316890295844, "sim_compute_sim_state": 0.042620195282830134, "sim_compute_performance-ego": 0.06912204954359266, "sim_compute_robot_state-ego": 0.08199628194173177}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.426480003506557, "sim_physics": 0.08117076873779297, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4016627329012578, "sim_render-ego": 0.05229770660400391, "in-drivable-lane": 0, "agent_compute-ego": 0.12861354827880858, "deviation-heading": 0.4164332504677331, "set_robot_commands": 0.08156483650207519, "deviation-center-line": 0.082953742710957, "driven_lanedir_consec": 0.4016627329012578, "sim_compute_sim_state": 0.033853187561035156, "sim_compute_performance-ego": 0.06091555595397949, "sim_compute_robot_state-ego": 0.07322423934936523}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6077077287168993, "sim_physics": 0.0811238136046972, "survival_time": 3.899999999999994, "driven_lanedir": 1.104102494174326, "sim_render-ego": 0.05537915535462208, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.134260464937259, "deviation-heading": 0.2234630787028836, "set_robot_commands": 0.08846182089585525, "deviation-center-line": 0.2616907164891491, "driven_lanedir_consec": 1.104102494174326, "sim_compute_sim_state": 0.03585728620871519, "sim_compute_performance-ego": 0.06147347963773287, "sim_compute_robot_state-ego": 0.06346701658689059}}
set_robot_commands_max	0.1014364350516841
set_robot_commands_mean	0.09203634870892435
set_robot_commands_median	0.0900894678556002
set_robot_commands_min	0.08156483650207519
sim_compute_performance-ego_max	0.07463821375145102
sim_compute_performance-ego_mean	0.06630253386839688
sim_compute_performance-ego_median	0.06536337045522836
sim_compute_performance-ego_min	0.06091555595397949
sim_compute_robot_state-ego_max	0.08719973294240124
sim_compute_robot_state-ego_mean	0.07484559791331483
sim_compute_robot_state-ego_median	0.07322423934936523
sim_compute_robot_state-ego_min	0.06346701658689059
sim_compute_sim_state_max	0.042620195282830134
sim_compute_sim_state_mean	0.03865071183545919
sim_compute_sim_state_median	0.038638995243952826
sim_compute_sim_state_min	0.033853187561035156
sim_physics_max	0.11210031329460864
sim_physics_mean	0.09531707363331668
sim_physics_median	0.09952075664813702
sim_physics_min	0.0811238136046972
sim_render-ego_max	0.06669320700303563
sim_render-ego_mean	0.0585934627133403
sim_render-ego_median	0.0555493189738347
sim_render-ego_min	0.05229770660400391
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	2.259999999999999
survival_time_min	0.9000000000000002

No reset possible

20157

2516

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 09:50:21+00:00

2019-04-25 09:53:17+00:00

0:02:56

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20092

3062

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-25 09:22:58+00:00

2019-04-25 09:50:01+00:00

0:27:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.00030327325308765474
survival_time_median	14.950000000000076
deviation-center-line_median	0.4782429075334328
in-drivable-lane_median	7.650000000000043

other stats

agent_compute-ego_max	0.14447980721791584
agent_compute-ego_mean	0.13175144894917806
agent_compute-ego_median	0.13079040129979452
agent_compute-ego_min	0.11746873140335085
deviation-center-line_max	0.6209554143640683
deviation-center-line_mean	0.41722590967444423
deviation-center-line_min	0.025329293139968057
deviation-heading_max	5.820018247123898
deviation-heading_mean	5.664655239940049
deviation-heading_median	5.766106818286449
deviation-heading_min	5.484319536528106
driven_any_max	0.028934981635122085
driven_any_mean	0.026549538326380497
driven_any_median	0.02595836365425521
driven_any_min	0.024158897917015212
driven_lanedir_consec_max	0.002757206308041882
driven_lanedir_consec_mean	-0.0001911202930098277
driven_lanedir_consec_min	-0.004297677691446733
driven_lanedir_max	0.002757206308041882
driven_lanedir_mean	-0.0001911202930098277
driven_lanedir_median	0.00030327325308765474
driven_lanedir_min	-0.004297677691446733
in-drivable-lane_max	7.650000000000044
in-drivable-lane_mean	7.630000000000043
in-drivable-lane_min	7.550000000000042
per-episodes	details {"udem1-0-0": {"driven_any": 0.028934981635122085, "sim_physics": 0.06909845511118572, "survival_time": 14.950000000000076, "driven_lanedir": 0.002757206308041882, "sim_render-ego": 0.058928941090901694, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.14447980721791584, "deviation-heading": 5.767844541062103, "set_robot_commands": 0.09123621543248496, "deviation-center-line": 0.5560677639275999, "driven_lanedir_consec": 0.002757206308041882, "sim_compute_sim_state": 0.03635127305984497, "sim_compute_performance-ego": 0.06354430754979451, "sim_compute_robot_state-ego": 0.06773256858189901, "sim_compute_robot_state-npc0": 0.06517114798227946, "sim_compute_robot_state-npc1": 0.06554095824559529, "sim_compute_robot_state-npc2": 0.06550049463907878, "sim_compute_robot_state-npc3": 0.06557834625244141}, "udem1-1-0": {"driven_any": 0.02595836365425521, "sim_physics": 0.06395464022954304, "survival_time": 14.950000000000076, "driven_lanedir": -0.004297677691446733, "sim_render-ego": 0.05804637749989827, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.1373865803082784, "deviation-heading": 5.820018247123898, "set_robot_commands": 0.09963823397954304, "deviation-center-line": 0.6209554143640683, "driven_lanedir_consec": -0.004297677691446733, "sim_compute_sim_state": 0.03293710231781006, "sim_compute_performance-ego": 0.06152043342590332, "sim_compute_robot_state-ego": 0.061008760134379066, "sim_compute_robot_state-npc0": 0.06054830074310303, "sim_compute_robot_state-npc1": 0.059715065956115726, "sim_compute_robot_state-npc2": 0.06020377318064372, "sim_compute_robot_state-npc3": 0.05916471560796102}, "udem1-2-0": {"driven_any": 0.025754651142354812, "sim_physics": 0.0586093020439148, "survival_time": 14.950000000000076, "driven_lanedir": 0.0025028109383136155, "sim_render-ego": 0.05224877198537191, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.13079040129979452, "deviation-heading": 5.4849870566996906, "set_robot_commands": 0.07972285270690918, "deviation-center-line": 0.4782429075334328, "driven_lanedir_consec": 0.0025028109383136155, "sim_compute_sim_state": 0.03211690982182821, "sim_compute_performance-ego": 0.05490031480789184, "sim_compute_robot_state-ego": 0.058490370909372966, "sim_compute_robot_state-npc0": 0.06164598782857259, "sim_compute_robot_state-npc1": 0.05687286933263143, "sim_compute_robot_state-npc2": 0.05534925142923991, "sim_compute_robot_state-npc3": 0.0561303162574768}, "udem1-3-0": {"driven_any": 0.024158897917015212, "sim_physics": 0.05872981866200765, "survival_time": 14.950000000000076, "driven_lanedir": -0.0022212142730455575, "sim_render-ego": 0.04893547773361206, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.11746873140335085, "deviation-heading": 5.484319536528106, "set_robot_commands": 0.0759913182258606, "deviation-center-line": 0.40553416940715226, "driven_lanedir_consec": -0.0022212142730455575, "sim_compute_sim_state": 0.02978681723276774, "sim_compute_performance-ego": 0.05127435286839803, "sim_compute_robot_state-ego": 0.056844263076782225, "sim_compute_robot_state-npc0": 0.05532518068949382, "sim_compute_robot_state-npc1": 0.0541141668955485, "sim_compute_robot_state-npc2": 0.051650959650675454, "sim_compute_robot_state-npc3": 0.05155390501022339}, "udem1-4-0": {"driven_any": 0.027940797283155145, "sim_physics": 0.05858226617177328, "survival_time": 14.950000000000076, "driven_lanedir": 0.00030327325308765474, "sim_render-ego": 0.04964618285497029, "in-drivable-lane": 7.650000000000042, "agent_compute-ego": 0.1286317245165507, "deviation-heading": 5.766106818286449, "set_robot_commands": 0.07642287651697795, "deviation-center-line": 0.025329293139968057, "driven_lanedir_consec": 0.00030327325308765474, "sim_compute_sim_state": 0.03655681610107422, "sim_compute_performance-ego": 0.0512359348932902, "sim_compute_robot_state-ego": 0.07437355200449626, "sim_compute_robot_state-npc0": 0.054724233945210775, "sim_compute_robot_state-npc1": 0.05833744764328003, "sim_compute_robot_state-npc2": 0.05316697438557943, "sim_compute_robot_state-npc3": 0.05333433707555135}}
set_robot_commands_max	0.09963823397954304
set_robot_commands_mean	0.08460229937235514
set_robot_commands_median	0.07972285270690918
set_robot_commands_min	0.0759913182258606
sim_compute_performance-ego_max	0.06354430754979451
sim_compute_performance-ego_mean	0.05649506870905559
sim_compute_performance-ego_median	0.05490031480789184
sim_compute_performance-ego_min	0.0512359348932902
sim_compute_robot_state-ego_max	0.07437355200449626
sim_compute_robot_state-ego_mean	0.0636899029413859
sim_compute_robot_state-ego_median	0.061008760134379066
sim_compute_robot_state-ego_min	0.056844263076782225
sim_compute_robot_state-npc0_max	0.06517114798227946
sim_compute_robot_state-npc0_mean	0.059482970237731934
sim_compute_robot_state-npc0_median	0.06054830074310303
sim_compute_robot_state-npc0_min	0.054724233945210775
sim_compute_robot_state-npc1_max	0.06554095824559529
sim_compute_robot_state-npc1_mean	0.05891610161463419
sim_compute_robot_state-npc1_median	0.05833744764328003
sim_compute_robot_state-npc1_min	0.0541141668955485
sim_compute_robot_state-npc2_max	0.06550049463907878
sim_compute_robot_state-npc2_mean	0.05717429065704346
sim_compute_robot_state-npc2_median	0.05534925142923991
sim_compute_robot_state-npc2_min	0.051650959650675454
sim_compute_robot_state-npc3_max	0.06557834625244141
sim_compute_robot_state-npc3_mean	0.0571523240407308
sim_compute_robot_state-npc3_median	0.0561303162574768
sim_compute_robot_state-npc3_min	0.05155390501022339
sim_compute_sim_state_max	0.03655681610107422
sim_compute_sim_state_mean	0.033549783706665046
sim_compute_sim_state_median	0.03293710231781006
sim_compute_sim_state_min	0.02978681723276774
sim_physics_max	0.06909845511118572
sim_physics_mean	0.06179489644368489
sim_physics_median	0.05872981866200765
sim_physics_min	0.05858226617177328
sim_render-ego_max	0.058928941090901694
sim_render-ego_mean	0.05356115023295085
sim_render-ego_median	0.05224877198537191
sim_render-ego_min	0.04893547773361206
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20048

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-25 09:00:19+00:00

2019-04-25 09:22:32+00:00

0:22:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7406162049123841
survival_time_median	9.950000000000006
deviation-center-line_median	0.3302177143601141
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.23363769426941872
agent_compute-ego_mean	0.1622209528637371
agent_compute-ego_median	0.14661732615341783
agent_compute-ego_min	0.14114497774210408
deviation-center-line_max	0.6904628736300545
deviation-center-line_mean	0.3874259749000404
deviation-center-line_min	0.2530034862371619
deviation-heading_max	1.0778162767766089
deviation-heading_mean	0.8215479365254513
deviation-heading_median	0.9150868055674838
deviation-heading_min	0.3781055846447399
driven_any_max	2.20273818289615
driven_any_mean	1.2469484705963905
driven_any_median	1.4279632190835694
driven_any_min	0.4328289963250949
driven_lanedir_consec_max	2.201596053570166
driven_lanedir_consec_mean	1.1015078923939634
driven_lanedir_consec_min	0.4219705604336601
driven_lanedir_max	2.201596053570166
driven_lanedir_mean	1.1015543630441058
driven_lanedir_median	0.7406162049123841
driven_lanedir_min	0.4219705604336601
in-drivable-lane_max	4.550000000000018
in-drivable-lane_mean	0.9100000000000036
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.6645051945479123, "sim_physics": 0.17942340717565544, "survival_time": 11.450000000000028, "driven_lanedir": 1.6584103880801533, "sim_render-ego": 0.05771594901272303, "in-drivable-lane": 0, "agent_compute-ego": 0.14661732615341783, "deviation-heading": 0.9150868055674838, "set_robot_commands": 0.09268553496448234, "deviation-center-line": 0.6904628736300545, "driven_lanedir_consec": 1.6581780348294406, "sim_compute_sim_state": 0.03638429933239799, "sim_compute_performance-ego": 0.06554410447199792, "sim_compute_robot_state-ego": 0.06961002724660016, "sim_compute_robot_state-npc0": 0.06817572189730849, "sim_compute_robot_state-npc1": 0.06499614049253505, "sim_compute_robot_state-npc2": 0.06366755139879784, "sim_compute_robot_state-npc3": 0.06566993117853023}, "udem1-1-0": {"driven_any": 0.5067067601292259, "sim_physics": 0.1586687891450647, "survival_time": 3.649999999999995, "driven_lanedir": 0.4851786082241656, "sim_render-ego": 0.05941894609634191, "in-drivable-lane": 0, "agent_compute-ego": 0.1469334021006545, "deviation-heading": 1.0778162767766089, "set_robot_commands": 0.08986077896536213, "deviation-center-line": 0.25585703994298503, "driven_lanedir_consec": 0.4851786082241656, "sim_compute_sim_state": 0.035127228253508266, "sim_compute_performance-ego": 0.06366227097707251, "sim_compute_robot_state-ego": 0.06840415196876003, "sim_compute_robot_state-npc0": 0.06503681287373582, "sim_compute_robot_state-npc1": 0.07221322843473252, "sim_compute_robot_state-npc2": 0.06369963084181694, "sim_compute_robot_state-npc3": 0.06661029711161574}, "udem1-2-0": {"driven_any": 1.4279632190835694, "sim_physics": 0.16558114607729504, "survival_time": 9.950000000000006, "driven_lanedir": 0.7406162049123841, "sim_render-ego": 0.057543762964219904, "in-drivable-lane": 4.550000000000018, "agent_compute-ego": 0.14114497774210408, "deviation-heading": 1.0112025852481552, "set_robot_commands": 0.08792808427283512, "deviation-center-line": 0.3302177143601141, "driven_lanedir_consec": 0.7406162049123841, "sim_compute_sim_state": 0.03594986038591395, "sim_compute_performance-ego": 0.060667281174779535, "sim_compute_robot_state-ego": 0.06861685508459657, "sim_compute_robot_state-npc0": 0.06405465327315595, "sim_compute_robot_state-npc1": 0.06340365793237734, "sim_compute_robot_state-npc2": 0.06251235703128068, "sim_compute_robot_state-npc3": 0.06337785001975207}, "udem1-3-0": {"driven_any": 2.20273818289615, "sim_physics": 0.1903776931762695, "survival_time": 14.950000000000076, "driven_lanedir": 2.201596053570166, "sim_render-ego": 0.05716086626052856, "in-drivable-lane": 0, "agent_compute-ego": 0.1427713640530904, "deviation-heading": 0.3781055846447399, "set_robot_commands": 0.08853756030400595, "deviation-center-line": 0.4075887603298862, "driven_lanedir_consec": 2.201596053570166, "sim_compute_sim_state": 0.03720680316289266, "sim_compute_performance-ego": 0.06466033140818278, "sim_compute_robot_state-ego": 0.06749629020690918, "sim_compute_robot_state-npc0": 0.06632691144943237, "sim_compute_robot_state-npc1": 0.06593314011891684, "sim_compute_robot_state-npc2": 0.0642449402809143, "sim_compute_robot_state-npc3": 0.06353774944941203}, "udem1-4-0": {"driven_any": 0.4328289963250949, "sim_physics": 0.1267976462841034, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4219705604336601, "sim_render-ego": 0.054573237895965576, "in-drivable-lane": 0, "agent_compute-ego": 0.23363769426941872, "deviation-heading": 0.7255284303902685, "set_robot_commands": 0.15470247343182564, "deviation-center-line": 0.2530034862371619, "driven_lanedir_consec": 0.4219705604336601, "sim_compute_sim_state": 0.03427066653966904, "sim_compute_performance-ego": 0.058978158980607986, "sim_compute_robot_state-ego": 0.0588432140648365, "sim_compute_robot_state-npc0": 0.07099807262420654, "sim_compute_robot_state-npc1": 0.05834737420082092, "sim_compute_robot_state-npc2": 0.05891544371843338, "sim_compute_robot_state-npc3": 0.06133582815527916}}
set_robot_commands_max	0.15470247343182564
set_robot_commands_mean	0.10274288638770224
set_robot_commands_median	0.08986077896536213
set_robot_commands_min	0.08792808427283512
sim_compute_performance-ego_max	0.06554410447199792
sim_compute_performance-ego_mean	0.06270242940252815
sim_compute_performance-ego_median	0.06366227097707251
sim_compute_performance-ego_min	0.058978158980607986
sim_compute_robot_state-ego_max	0.06961002724660016
sim_compute_robot_state-ego_mean	0.06659410771434049
sim_compute_robot_state-ego_median	0.06840415196876003
sim_compute_robot_state-ego_min	0.0588432140648365
sim_compute_robot_state-npc0_max	0.07099807262420654
sim_compute_robot_state-npc0_mean	0.06691843442356783
sim_compute_robot_state-npc0_median	0.06632691144943237
sim_compute_robot_state-npc0_min	0.06405465327315595
sim_compute_robot_state-npc1_max	0.07221322843473252
sim_compute_robot_state-npc1_mean	0.06497870823587654
sim_compute_robot_state-npc1_median	0.06499614049253505
sim_compute_robot_state-npc1_min	0.05834737420082092
sim_compute_robot_state-npc2_max	0.0642449402809143
sim_compute_robot_state-npc2_mean	0.06260798465424863
sim_compute_robot_state-npc2_median	0.06366755139879784
sim_compute_robot_state-npc2_min	0.05891544371843338
sim_compute_robot_state-npc3_max	0.06661029711161574
sim_compute_robot_state-npc3_mean	0.06410633118291784
sim_compute_robot_state-npc3_median	0.06353774944941203
sim_compute_robot_state-npc3_min	0.06133582815527916
sim_compute_sim_state_max	0.03720680316289266
sim_compute_sim_state_mean	0.035787771534876375
sim_compute_sim_state_median	0.03594986038591395
sim_compute_sim_state_min	0.03427066653966904
sim_physics_max	0.1903776931762695
sim_physics_mean	0.16416973637167762
sim_physics_median	0.16558114607729504
sim_physics_min	0.1267976462841034
sim_render-ego_max	0.05941894609634191
sim_render-ego_mean	0.057282552445955794
sim_render-ego_median	0.057543762964219904
sim_render-ego_min	0.054573237895965576
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.64000000000002
survival_time_min	3.1999999999999966

No reset possible

20029

2376

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

error

2019-04-25 08:48:57+00:00

2019-04-25 08:50:00+00:00

0:01:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20021

2405

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-25 08:46:45+00:00

2019-04-25 08:48:24+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20008

2440

Jacopo Tani

random_agent

step1-simulation

error

2019-04-25 08:45:07+00:00

2019-04-25 08:46:27+00:00

0:01:20

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19978

2509

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-25 08:42:43+00:00

2019-04-25 08:44:51+00:00

0:02:08

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19919

2995

Manfred Diaz

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-25 08:38:06+00:00

2019-04-25 08:42:30+00:00

0:04:24

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19907

2731

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-25 08:36:56+00:00

2019-04-25 08:38:00+00:00

0:01:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19888

2767

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-25 08:35:29+00:00

2019-04-25 08:36:37+00:00

0:01:08

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19869

2925

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 08:33:11+00:00

2019-04-25 08:35:15+00:00

0:02:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19853

2974

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-25 08:31:26+00:00

2019-04-25 08:32:35+00:00

0:01:09

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19778

2981

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-25 08:00:19+00:00

2019-04-25 08:31:11+00:00

0:30:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8126363489069939
survival_time_median	14.950000000000076
deviation-center-line_median	0.5252677166838308
in-drivable-lane_median	0.4500000000000064

other stats

agent_compute-ego_max	0.22556527455647787
agent_compute-ego_mean	0.21182524363011396
agent_compute-ego_median	0.21600083588611468
agent_compute-ego_min	0.19023183504740396
deviation-center-line_max	1.5296409764293135
deviation-center-line_mean	0.7016076899232601
deviation-center-line_min	0.3878308931676791
deviation-heading_max	3.596222519795628
deviation-heading_mean	1.8747746163930068
deviation-heading_median	1.0175503412649762
deviation-heading_min	0.816168139623652
driven_any_max	1.384196631739137
driven_any_mean	1.1465174284286852
driven_any_median	1.3161857918562458
driven_any_min	0.5174767807047103
driven_lanedir_consec_max	1.3105790879527532
driven_lanedir_consec_mean	0.855527921932023
driven_lanedir_consec_min	0.510378742658181
driven_lanedir_max	1.310620211919384
driven_lanedir_mean	0.91233059229271
driven_lanedir_median	0.8126363489069939
driven_lanedir_min	0.510378742658181
in-drivable-lane_max	6.750000000000096
in-drivable-lane_mean	2.3200000000000323
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3161857918562458, "sim_physics": 0.04084150870641073, "survival_time": 14.950000000000076, "driven_lanedir": 1.310620211919384, "sim_render-ego": 0.06153920412063599, "in-drivable-lane": 0, "agent_compute-ego": 0.21917887290318808, "deviation-heading": 0.9922934023526048, "set_robot_commands": 0.0957490317026774, "deviation-center-line": 0.3878308931676791, "driven_lanedir_consec": 1.3105790879527532, "sim_compute_sim_state": 0.0383993649482727, "sim_compute_performance-ego": 0.06926737626393636, "sim_compute_robot_state-ego": 0.0722132913271586, "sim_compute_robot_state-npc0": 0.06822187503178914, "sim_compute_robot_state-npc1": 0.06859721342722574, "sim_compute_robot_state-npc2": 0.06832248051961264, "sim_compute_robot_state-npc3": 0.06717509826024373}, "udem1-1-0": {"driven_any": 1.3334811075300093, "sim_physics": 0.03993955532709757, "survival_time": 14.950000000000076, "driven_lanedir": 0.6811531961636719, "sim_render-ego": 0.060810866355896, "in-drivable-lane": 6.750000000000096, "agent_compute-ego": 0.20814939975738525, "deviation-heading": 3.596222519795628, "set_robot_commands": 0.0920602337519328, "deviation-center-line": 0.5575628698325596, "driven_lanedir_consec": 0.6811531961636719, "sim_compute_sim_state": 0.03668917735417684, "sim_compute_performance-ego": 0.06492350101470948, "sim_compute_robot_state-ego": 0.06859696785608928, "sim_compute_robot_state-npc0": 0.06713533957799275, "sim_compute_robot_state-npc1": 0.06538723866144816, "sim_compute_robot_state-npc2": 0.06508848826090495, "sim_compute_robot_state-npc3": 0.06556556860605876}, "udem1-2-0": {"driven_any": 0.5174767807047103, "sim_physics": 0.046610165011975194, "survival_time": 6.449999999999985, "driven_lanedir": 0.510378742658181, "sim_render-ego": 0.0627611478169759, "in-drivable-lane": 0, "agent_compute-ego": 0.22556527455647787, "deviation-heading": 0.816168139623652, "set_robot_commands": 0.09720623770425486, "deviation-center-line": 0.5252677166838308, "driven_lanedir_consec": 0.510378742658181, "sim_compute_sim_state": 0.03847558184187542, "sim_compute_performance-ego": 0.0691750123519306, "sim_compute_robot_state-ego": 0.0763493305028871, "sim_compute_robot_state-npc0": 0.0679756670959236, "sim_compute_robot_state-npc1": 0.06691996626151625, "sim_compute_robot_state-npc2": 0.067952364914177, "sim_compute_robot_state-npc3": 0.06691916414009508}, "udem1-3-0": {"driven_any": 1.384196631739137, "sim_physics": 0.036923776467641195, "survival_time": 14.950000000000076, "driven_lanedir": 1.2468644618153188, "sim_render-ego": 0.054330660502115886, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.19023183504740396, "deviation-heading": 2.951638678928174, "set_robot_commands": 0.08026098092397053, "deviation-center-line": 1.5296409764293135, "driven_lanedir_consec": 0.962892233978516, "sim_compute_sim_state": 0.03342987140019735, "sim_compute_performance-ego": 0.056824873288472494, "sim_compute_robot_state-ego": 0.06089366753896078, "sim_compute_robot_state-npc0": 0.05992483059565226, "sim_compute_robot_state-npc1": 0.05970819552739461, "sim_compute_robot_state-npc2": 0.0607969601949056, "sim_compute_robot_state-npc3": 0.05856328248977661}, "udem1-4-0": {"driven_any": 1.1812468303133243, "sim_physics": 0.04251927632116989, "survival_time": 12.650000000000045, "driven_lanedir": 0.8126363489069939, "sim_render-ego": 0.060596191835968864, "in-drivable-lane": 4.40000000000006, "agent_compute-ego": 0.21600083588611468, "deviation-heading": 1.0175503412649762, "set_robot_commands": 0.09477466462629117, "deviation-center-line": 0.507735993502917, "driven_lanedir_consec": 0.8126363489069939, "sim_compute_sim_state": 0.03745308789339932, "sim_compute_performance-ego": 0.06533640175468837, "sim_compute_robot_state-ego": 0.06949692564048315, "sim_compute_robot_state-npc0": 0.0669484562553436, "sim_compute_robot_state-npc1": 0.06631494981969298, "sim_compute_robot_state-npc2": 0.0658379241883048, "sim_compute_robot_state-npc3": 0.06387883683909541}}
set_robot_commands_max	0.09720623770425486
set_robot_commands_mean	0.09201022974182536
set_robot_commands_median	0.09477466462629117
set_robot_commands_min	0.08026098092397053
sim_compute_performance-ego_max	0.06926737626393636
sim_compute_performance-ego_mean	0.06510543293474746
sim_compute_performance-ego_median	0.06533640175468837
sim_compute_performance-ego_min	0.056824873288472494
sim_compute_robot_state-ego_max	0.0763493305028871
sim_compute_robot_state-ego_mean	0.06951003657311579
sim_compute_robot_state-ego_median	0.06949692564048315
sim_compute_robot_state-ego_min	0.06089366753896078
sim_compute_robot_state-npc0_max	0.06822187503178914
sim_compute_robot_state-npc0_mean	0.06604123371134027
sim_compute_robot_state-npc0_median	0.06713533957799275
sim_compute_robot_state-npc0_min	0.05992483059565226
sim_compute_robot_state-npc1_max	0.06859721342722574
sim_compute_robot_state-npc1_mean	0.06538551273945556
sim_compute_robot_state-npc1_median	0.06631494981969298
sim_compute_robot_state-npc1_min	0.05970819552739461
sim_compute_robot_state-npc2_max	0.06832248051961264
sim_compute_robot_state-npc2_mean	0.06559964361558099
sim_compute_robot_state-npc2_median	0.0658379241883048
sim_compute_robot_state-npc2_min	0.0607969601949056
sim_compute_robot_state-npc3_max	0.06717509826024373
sim_compute_robot_state-npc3_mean	0.06442039006705391
sim_compute_robot_state-npc3_median	0.06556556860605876
sim_compute_robot_state-npc3_min	0.05856328248977661
sim_compute_sim_state_max	0.03847558184187542
sim_compute_sim_state_mean	0.03688941668758432
sim_compute_sim_state_median	0.03745308789339932
sim_compute_sim_state_min	0.03342987140019735
sim_physics_max	0.046610165011975194
sim_physics_mean	0.04136685636685892
sim_physics_median	0.04084150870641073
sim_physics_min	0.036923776467641195
sim_render-ego_max	0.0627611478169759
sim_render-ego_mean	0.06000761412631853
sim_render-ego_median	0.060810866355896
sim_render-ego_min	0.054330660502115886
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.790000000000052
survival_time_min	6.449999999999985

No reset possible

19769

2648

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-25 07:54:10+00:00

2019-04-25 08:00:06+00:00

0:05:56

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19769-817479', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19769-817479', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19769-817479', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19754

3038

Manfred Diaz

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-25 07:46:21+00:00

2019-04-25 07:53:35+00:00

0:07:14

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19725

3030

Manfred Diaz

challenge-aido_LF-template-pytorch

step1-simulation

error