Evaluator 783

step1-simulation

error

2019-04-24 20:17:51+00:00

2019-04-24 20:20:33+00:00

0:02:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19684

2989

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-24 18:03:23+00:00

2019-04-24 18:05:50+00:00

0:02:27

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19650

2653

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

aido2-LFV-sim-validation

2019-04-24 16:24:49+00:00

2019-04-24 16:41:26+00:00

0:16:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1013326841134212
survival_time_median	8.199999999999982
deviation-center-line_median	0.6389280345832644
in-drivable-lane_median	0.45000000000000107

other stats

agent_compute-ego_max	0.09057499090830486
agent_compute-ego_mean	0.08399250737779877
agent_compute-ego_median	0.08616652829306466
agent_compute-ego_min	0.07136170457049114
deviation-center-line_max	1.0831127638008753
deviation-center-line_mean	0.7004074440287961
deviation-center-line_min	0.22456247883614383
deviation-heading_max	5.24099365375906
deviation-heading_mean	3.018194622915637
deviation-heading_median	2.2370098991997587
deviation-heading_min	0.7416043621181825
driven_any_max	2.355648929737495
driven_any_mean	1.504885178314337
driven_any_median	1.270798865799122
driven_any_min	0.504717166707913
driven_lanedir_consec_max	1.7782901263039046
driven_lanedir_consec_mean	1.0569809888591006
driven_lanedir_consec_min	0.46517271088505785
driven_lanedir_max	2.0935906196156377
driven_lanedir_mean	1.30898688962836
driven_lanedir_median	1.1013326841134212
driven_lanedir_min	0.46517271088505785
in-drivable-lane_max	0.5500000000000078
in-drivable-lane_mean	0.3700000000000024
in-drivable-lane_min	0.09999999999999964
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.504717166707913, "sim_physics": 0.029833095414297923, "survival_time": 3.4999999999999956, "driven_lanedir": 0.46517271088505785, "sim_render-ego": 0.07055204936436245, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.08616652829306466, "deviation-heading": 0.7416043621181825, "set_robot_commands": 0.1048971482685634, "deviation-center-line": 0.22456247883614383, "driven_lanedir_consec": 0.46517271088505785, "sim_compute_sim_state": 0.04098383017948696, "sim_compute_performance-ego": 0.076191588810512, "sim_compute_robot_state-ego": 0.0791053295135498}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0377074276760458, "sim_physics": 0.029012503447356047, "survival_time": 6.749999999999984, "driven_lanedir": 0.8395660044112874, "sim_render-ego": 0.06931729140105071, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.08639970885382758, "deviation-heading": 2.1289002283672716, "set_robot_commands": 0.10925893606962982, "deviation-center-line": 0.6389280345832644, "driven_lanedir_consec": 0.6913514965067847, "sim_compute_sim_state": 0.0431871944003635, "sim_compute_performance-ego": 0.07691793441772461, "sim_compute_robot_state-ego": 0.07903869416978625}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3555535016511104, "sim_physics": 0.028231587409973145, "survival_time": 14.950000000000076, "driven_lanedir": 2.0452724291163955, "sim_render-ego": 0.0701192299524943, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.09057499090830486, "deviation-heading": 4.742464971133913, "set_robot_commands": 0.1084890373547872, "deviation-center-line": 1.0831127638008753, "driven_lanedir_consec": 1.7782901263039046, "sim_compute_sim_state": 0.04332159519195557, "sim_compute_performance-ego": 0.07706377585728963, "sim_compute_robot_state-ego": 0.08202559471130372}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.355648929737495, "sim_physics": 0.027046362559000652, "survival_time": 14.950000000000076, "driven_lanedir": 2.0935906196156377, "sim_render-ego": 0.07006168921788533, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.08545960426330566, "deviation-heading": 5.24099365375906, "set_robot_commands": 0.11126402537027996, "deviation-center-line": 0.9783763624808416, "driven_lanedir_consec": 1.2487579264863349, "sim_compute_sim_state": 0.0437843918800354, "sim_compute_performance-ego": 0.07738041559855144, "sim_compute_robot_state-ego": 0.08057844241460164}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.270798865799122, "sim_physics": 0.024261237644567724, "survival_time": 8.199999999999982, "driven_lanedir": 1.1013326841134212, "sim_render-ego": 0.05958553349099508, "in-drivable-lane": 0.45000000000000107, "agent_compute-ego": 0.07136170457049114, "deviation-heading": 2.2370098991997587, "set_robot_commands": 0.08931376294391911, "deviation-center-line": 0.5770575804428554, "driven_lanedir_consec": 1.1013326841134212, "sim_compute_sim_state": 0.0371127419355439, "sim_compute_performance-ego": 0.06558377568314715, "sim_compute_robot_state-ego": 0.06701940298080444}}
set_robot_commands_max	0.11126402537027996
set_robot_commands_mean	0.10464458200143588
set_robot_commands_median	0.1084890373547872
set_robot_commands_min	0.08931376294391911
sim_compute_performance-ego_max	0.07738041559855144
sim_compute_performance-ego_mean	0.07462749807344496
sim_compute_performance-ego_median	0.07691793441772461
sim_compute_performance-ego_min	0.06558377568314715
sim_compute_robot_state-ego_max	0.08202559471130372
sim_compute_robot_state-ego_mean	0.07755349275800917
sim_compute_robot_state-ego_median	0.0791053295135498
sim_compute_robot_state-ego_min	0.06701940298080444
sim_compute_sim_state_max	0.0437843918800354
sim_compute_sim_state_mean	0.04167795071747707
sim_compute_sim_state_median	0.0431871944003635
sim_compute_sim_state_min	0.0371127419355439
sim_physics_max	0.029833095414297923
sim_physics_mean	0.027676957295039096
sim_physics_median	0.028231587409973145
sim_physics_min	0.024261237644567724
sim_render-ego_max	0.07055204936436245
sim_render-ego_mean	0.06792715868535758
sim_render-ego_median	0.07006168921788533
sim_render-ego_min	0.05958553349099508
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.670000000000025
survival_time_min	3.4999999999999956

No reset possible

19639

2405

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 16:09:24+00:00

2019-04-24 16:22:08+00:00

0:12:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0779263008306339
survival_time_median	1.7000000000000008
deviation-center-line_median	0.036893343838697794
in-drivable-lane_median	0.5000000000000004

other stats

agent_compute-ego_max	0.1994077003363407
agent_compute-ego_mean	0.18134296013485057
agent_compute-ego_median	0.17726887146631876
agent_compute-ego_min	0.1751222678593227
deviation-center-line_max	0.5310257316036597
deviation-center-line_mean	0.1332770181151703
deviation-center-line_min	0.02978935495367712
deviation-heading_max	4.8097672411175765
deviation-heading_mean	1.4892327634490403
deviation-heading_median	0.6775477987698325
deviation-heading_min	0.6300644933485855
driven_any_max	1.5781865335727252
driven_any_mean	0.4494078640038214
driven_any_median	0.16981014678869444
driven_any_min	0.16081430417734174
driven_lanedir_consec_max	0.3124925741674165
driven_lanedir_consec_mean	0.12153003262593064
driven_lanedir_consec_min	0.0656124726925289
driven_lanedir_max	0.3124925741674165
driven_lanedir_mean	0.12153003262593064
driven_lanedir_median	0.0779263008306339
driven_lanedir_min	0.0656124726925289
in-drivable-lane_max	9.400000000000064
in-drivable-lane_mean	2.2900000000000125
in-drivable-lane_min	0.5000000000000004
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16481289907095614, "sim_physics": 0.04772647221883138, "survival_time": 1.6500000000000008, "driven_lanedir": 0.0656124726925289, "sim_render-ego": 0.06779261068864302, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1994077003363407, "deviation-heading": 0.6506822835816807, "set_robot_commands": 0.10908914334846263, "deviation-center-line": 0.02978935495367712, "driven_lanedir_consec": 0.0656124726925289, "sim_compute_sim_state": 0.04485373063520952, "sim_compute_performance-ego": 0.07530616268967137, "sim_compute_robot_state-ego": 0.08089579235423695, "sim_compute_robot_state-npc0": 0.07880496256279224, "sim_compute_robot_state-npc1": 0.07959501671068596, "sim_compute_robot_state-npc2": 0.07701149131312515, "sim_compute_robot_state-npc3": 0.0797797188614354}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5781865335727252, "sim_physics": 0.03822120348612468, "survival_time": 14.950000000000076, "driven_lanedir": 0.3124925741674165, "sim_render-ego": 0.06421005805333456, "in-drivable-lane": 9.400000000000064, "agent_compute-ego": 0.17726887146631876, "deviation-heading": 4.8097672411175765, "set_robot_commands": 0.09907516956329346, "deviation-center-line": 0.5310257316036597, "driven_lanedir_consec": 0.3124925741674165, "sim_compute_sim_state": 0.04061566352844238, "sim_compute_performance-ego": 0.06976898113886515, "sim_compute_robot_state-ego": 0.0740832010904948, "sim_compute_robot_state-npc0": 0.07087156693140666, "sim_compute_robot_state-npc1": 0.07128990729649862, "sim_compute_robot_state-npc2": 0.07062880674997965, "sim_compute_robot_state-npc3": 0.07312626282374064}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17341543640938922, "sim_physics": 0.039548635482788086, "survival_time": 1.7000000000000008, "driven_lanedir": 0.0779263008306339, "sim_render-ego": 0.06395464083727669, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17533198524923885, "deviation-heading": 0.6775477987698325, "set_robot_commands": 0.10090583212235396, "deviation-center-line": 0.03757105339144235, "driven_lanedir_consec": 0.0779263008306339, "sim_compute_sim_state": 0.04120952241560992, "sim_compute_performance-ego": 0.06527497487909653, "sim_compute_robot_state-ego": 0.0720281951567706, "sim_compute_robot_state-npc0": 0.0684507594389074, "sim_compute_robot_state-npc1": 0.07133459343629725, "sim_compute_robot_state-npc2": 0.07453691959381104, "sim_compute_robot_state-npc3": 0.07285226793850169}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16981014678869444, "sim_physics": 0.037643114725748696, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07310291786965939, "sim_render-ego": 0.06557104081818552, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17958397576303192, "deviation-heading": 0.6300644933485855, "set_robot_commands": 0.09684606031938033, "deviation-center-line": 0.031105606788374415, "driven_lanedir_consec": 0.07310291786965939, "sim_compute_sim_state": 0.03840025988492099, "sim_compute_performance-ego": 0.0735967376015403, "sim_compute_robot_state-ego": 0.07178734288071141, "sim_compute_robot_state-npc0": 0.0718368472474994, "sim_compute_robot_state-npc1": 0.07037923552773216, "sim_compute_robot_state-npc2": 0.07289728251370517, "sim_compute_robot_state-npc3": 0.07294341289635861}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16081430417734174, "sim_physics": 0.03783297538757324, "survival_time": 1.7500000000000009, "driven_lanedir": 0.07851589756941457, "sim_render-ego": 0.06476503099714007, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1751222678593227, "deviation-heading": 0.6781020004275276, "set_robot_commands": 0.09965737887791223, "deviation-center-line": 0.036893343838697794, "driven_lanedir_consec": 0.07851589756941457, "sim_compute_sim_state": 0.041316066469464986, "sim_compute_performance-ego": 0.06977487972804479, "sim_compute_robot_state-ego": 0.07477672440665109, "sim_compute_robot_state-npc0": 0.07106845038277762, "sim_compute_robot_state-npc1": 0.06861907414027622, "sim_compute_robot_state-npc2": 0.06916030475071498, "sim_compute_robot_state-npc3": 0.07129800660269602}}
set_robot_commands_max	0.10908914334846263
set_robot_commands_mean	0.10111471684628053
set_robot_commands_median	0.09965737887791223
set_robot_commands_min	0.09684606031938033
sim_compute_performance-ego_max	0.07530616268967137
sim_compute_performance-ego_mean	0.07074434720744363
sim_compute_performance-ego_median	0.06977487972804479
sim_compute_performance-ego_min	0.06527497487909653
sim_compute_robot_state-ego_max	0.08089579235423695
sim_compute_robot_state-ego_mean	0.07471425117777297
sim_compute_robot_state-ego_median	0.0740832010904948
sim_compute_robot_state-ego_min	0.07178734288071141
sim_compute_robot_state-npc0_max	0.07880496256279224
sim_compute_robot_state-npc0_mean	0.07220651731267666
sim_compute_robot_state-npc0_median	0.07106845038277762
sim_compute_robot_state-npc0_min	0.0684507594389074
sim_compute_robot_state-npc1_max	0.07959501671068596
sim_compute_robot_state-npc1_mean	0.07224356542229804
sim_compute_robot_state-npc1_median	0.07128990729649862
sim_compute_robot_state-npc1_min	0.06861907414027622
sim_compute_robot_state-npc2_max	0.07701149131312515
sim_compute_robot_state-npc2_mean	0.0728469609842672
sim_compute_robot_state-npc2_median	0.07289728251370517
sim_compute_robot_state-npc2_min	0.06916030475071498
sim_compute_robot_state-npc3_max	0.0797797188614354
sim_compute_robot_state-npc3_mean	0.07399993382454648
sim_compute_robot_state-npc3_median	0.07294341289635861
sim_compute_robot_state-npc3_min	0.07129800660269602
sim_compute_sim_state_max	0.04485373063520952
sim_compute_sim_state_mean	0.04127904858672956
sim_compute_sim_state_median	0.04120952241560992
sim_compute_sim_state_min	0.03840025988492099
sim_physics_max	0.04772647221883138
sim_physics_mean	0.04019448026021322
sim_physics_median	0.03822120348612468
sim_physics_min	0.037643114725748696
sim_render-ego_max	0.06779261068864302
sim_render-ego_mean	0.06525867627891598
sim_render-ego_median	0.06476503099714007
sim_render-ego_min	0.06395464083727669
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.340000000000016
survival_time_min	1.6500000000000008

No reset possible

19622

2420

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-24 16:00:24+00:00

2019-04-24 16:09:17+00:00

0:08:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14161916308932834
agent_compute-ego_mean	0.13958298432172006
agent_compute-ego_median	0.1399387319882711
agent_compute-ego_min	0.1373687223954634
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03908636435022894, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0626177652826849, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13897925502849076, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09965801239013672, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03663343303608445, "sim_compute_performance-ego": 0.06865191909502137, "sim_compute_robot_state-ego": 0.07263699567542886, "sim_compute_robot_state-npc0": 0.06992427807933879, "sim_compute_robot_state-npc1": 0.06864486100538722, "sim_compute_robot_state-npc2": 0.06682646049643462, "sim_compute_robot_state-npc3": 0.06837865991412469}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.037937689911235466, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.05949551950801502, "in-drivable-lane": 0, "agent_compute-ego": 0.1373687223954634, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.09810624339363792, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.039900476282293144, "sim_compute_performance-ego": 0.06509832360527733, "sim_compute_robot_state-ego": 0.07013968987898393, "sim_compute_robot_state-npc0": 0.06567240845073354, "sim_compute_robot_state-npc1": 0.06893658638000488, "sim_compute_robot_state-npc2": 0.0715034929188815, "sim_compute_robot_state-npc3": 0.06895340030843561}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.042414352628919814, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06371334923638237, "in-drivable-lane": 0, "agent_compute-ego": 0.14161916308932834, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09880663024054634, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03738504515753852, "sim_compute_performance-ego": 0.0705406559838189, "sim_compute_robot_state-ego": 0.07432022094726562, "sim_compute_robot_state-npc0": 0.07072607146369086, "sim_compute_robot_state-npc1": 0.0728124565548367, "sim_compute_robot_state-npc2": 0.07110615836249458, "sim_compute_robot_state-npc3": 0.0725646866692437}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.039265776673952736, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06615846852461497, "in-drivable-lane": 0, "agent_compute-ego": 0.1399387319882711, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09951002399126688, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04149617254734039, "sim_compute_performance-ego": 0.0717368870973587, "sim_compute_robot_state-ego": 0.07182086010773976, "sim_compute_robot_state-npc0": 0.07024949292341869, "sim_compute_robot_state-npc1": 0.07168268660704295, "sim_compute_robot_state-npc2": 0.07130060096581776, "sim_compute_robot_state-npc3": 0.0715608149766922}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.04033196323058184, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06578792894587797, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1400090491070467, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09870939395006964, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03994776571498198, "sim_compute_performance-ego": 0.06984203002032112, "sim_compute_robot_state-ego": 0.07242426100899191, "sim_compute_robot_state-npc0": 0.06919381898992202, "sim_compute_robot_state-npc1": 0.06943516170277315, "sim_compute_robot_state-npc2": 0.07023440038456637, "sim_compute_robot_state-npc3": 0.0696138809708988}}
set_robot_commands_max	0.09965801239013672
set_robot_commands_mean	0.09895806079313152
set_robot_commands_median	0.09880663024054634
set_robot_commands_min	0.09810624339363792
sim_compute_performance-ego_max	0.0717368870973587
sim_compute_performance-ego_mean	0.06917396316035948
sim_compute_performance-ego_median	0.06984203002032112
sim_compute_performance-ego_min	0.06509832360527733
sim_compute_robot_state-ego_max	0.07432022094726562
sim_compute_robot_state-ego_mean	0.07226840552368202
sim_compute_robot_state-ego_median	0.07242426100899191
sim_compute_robot_state-ego_min	0.07013968987898393
sim_compute_robot_state-npc0_max	0.07072607146369086
sim_compute_robot_state-npc0_mean	0.06915321398142078
sim_compute_robot_state-npc0_median	0.06992427807933879
sim_compute_robot_state-npc0_min	0.06567240845073354
sim_compute_robot_state-npc1_max	0.0728124565548367
sim_compute_robot_state-npc1_mean	0.07030235045000897
sim_compute_robot_state-npc1_median	0.06943516170277315
sim_compute_robot_state-npc1_min	0.06864486100538722
sim_compute_robot_state-npc2_max	0.0715034929188815
sim_compute_robot_state-npc2_mean	0.07019422262563896
sim_compute_robot_state-npc2_median	0.07110615836249458
sim_compute_robot_state-npc2_min	0.06682646049643462
sim_compute_robot_state-npc3_max	0.0725646866692437
sim_compute_robot_state-npc3_mean	0.070214288567879
sim_compute_robot_state-npc3_median	0.0696138809708988
sim_compute_robot_state-npc3_min	0.06837865991412469
sim_compute_sim_state_max	0.04149617254734039
sim_compute_sim_state_mean	0.039072578547647695
sim_compute_sim_state_median	0.039900476282293144
sim_compute_sim_state_min	0.03663343303608445
sim_physics_max	0.042414352628919814
sim_physics_mean	0.039807229358983766
sim_physics_median	0.039265776673952736
sim_physics_min	0.037937689911235466
sim_render-ego_max	0.06615846852461497
sim_render-ego_mean	0.06355460629951505
sim_render-ego_median	0.06371334923638237
sim_render-ego_min	0.05949551950801502
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

19603

2441

Jacopo Tani

random_agent

step1-simulation

host-error

2019-04-24 15:54:24+00:00

2019-04-24 16:00:08+00:00

0:05:44

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19603-88292', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19603-88292', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19603-88292', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19582

2467

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-24 15:48:08+00:00

2019-04-24 15:53:54+00:00

0:05:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.15231637043111465
agent_compute-ego_mean	0.14133439176786838
agent_compute-ego_median	0.14616414176093206
agent_compute-ego_min	0.1202715387884176
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.018196245409407705, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04983276241230515, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1202715387884176, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07389473015407347, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03132311353143656, "sim_compute_performance-ego": 0.052432735011262714, "sim_compute_robot_state-ego": 0.05753400190821234}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.019012592055580833, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.054028890349648216, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13578896630894055, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08353374762968584, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.035899563269181686, "sim_compute_performance-ego": 0.05751012672077526, "sim_compute_robot_state-ego": 0.06045512177727439}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.02151582505967882, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.05862866507636176, "in-drivable-lane": 0, "agent_compute-ego": 0.14616414176093206, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.09683433108859592, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.036715957853529185, "sim_compute_performance-ego": 0.06336745156182183, "sim_compute_robot_state-ego": 0.07206095059712728}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02764819065729777, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06443081796169281, "in-drivable-lane": 0, "agent_compute-ego": 0.15213094154993692, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.104096457362175, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.040834516286849976, "sim_compute_performance-ego": 0.07055650651454926, "sim_compute_robot_state-ego": 0.0771624247233073}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.027177130474763757, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06167363769867841, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.15231637043111465, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09663362362805536, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.036615073680877686, "sim_compute_performance-ego": 0.07021134390550501, "sim_compute_robot_state-ego": 0.07438127082936904}}
set_robot_commands_max	0.104096457362175
set_robot_commands_mean	0.0909985779725171
set_robot_commands_median	0.09663362362805536
set_robot_commands_min	0.07389473015407347
sim_compute_performance-ego_max	0.07055650651454926
sim_compute_performance-ego_mean	0.06281563274278282
sim_compute_performance-ego_median	0.06336745156182183
sim_compute_performance-ego_min	0.052432735011262714
sim_compute_robot_state-ego_max	0.0771624247233073
sim_compute_robot_state-ego_mean	0.06831875396705807
sim_compute_robot_state-ego_median	0.07206095059712728
sim_compute_robot_state-ego_min	0.05753400190821234
sim_compute_sim_state_max	0.040834516286849976
sim_compute_sim_state_mean	0.03627764492437502
sim_compute_sim_state_median	0.036615073680877686
sim_compute_sim_state_min	0.03132311353143656
sim_physics_max	0.02764819065729777
sim_physics_mean	0.02270999673134578
sim_physics_median	0.02151582505967882
sim_physics_min	0.018196245409407705
sim_render-ego_max	0.06443081796169281
sim_render-ego_mean	0.05771895469973727
sim_render-ego_median	0.05862866507636176
sim_render-ego_min	0.04983276241230515
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

19572

2488

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 15:46:40+00:00

2019-04-24 15:47:32+00:00

0:00:52

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19552

2520

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 15:44:48+00:00

2019-04-24 15:46:33+00:00

0:01:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19531

2537

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-24 15:40:36+00:00

2019-04-24 15:44:04+00:00

0:03:28

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19502

2586

Julian Zilly

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-24 15:26:10+00:00

2019-04-24 15:40:29+00:00

0:14:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.269683285181189
survival_time_median	5.599999999999988
deviation-center-line_median	0.3016761971508237
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.26855220380036726
agent_compute-ego_mean	0.26169817665374
agent_compute-ego_median	0.2644669987330927
agent_compute-ego_min	0.25433819140157393
deviation-center-line_max	0.32778074505147636
deviation-center-line_mean	0.3023269395112115
deviation-center-line_min	0.2792790893052446
deviation-heading_max	2.1893168522879836
deviation-heading_mean	2.077526723186395
deviation-heading_median	2.10507017691675
deviation-heading_min	1.9190761486946952
driven_any_max	0.34017669745215806
driven_any_mean	0.3057561942144015
driven_any_median	0.30489247487630156
driven_any_min	0.2723053543175985
driven_lanedir_consec_max	0.3027975815729169
driven_lanedir_consec_mean	0.26908544780526994
driven_lanedir_consec_min	0.23439708455921823
driven_lanedir_max	0.3027975815729169
driven_lanedir_mean	0.26908544780526994
driven_lanedir_median	0.269683285181189
driven_lanedir_min	0.23439708455921823
in-drivable-lane_max	0.09999999999999964
in-drivable-lane_mean	0.039999999999999855
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2723053543175985, "sim_physics": 0.031930662118471585, "survival_time": 5.1999999999999895, "driven_lanedir": 0.23439708455921823, "sim_render-ego": 0.07525396805543166, "in-drivable-lane": 0, "agent_compute-ego": 0.26652658673433155, "deviation-heading": 2.1893168522879836, "set_robot_commands": 0.12219432454842788, "deviation-center-line": 0.2792790893052446, "driven_lanedir_consec": 0.23439708455921823, "sim_compute_sim_state": 0.05244662440740145, "sim_compute_performance-ego": 0.08925297856330872, "sim_compute_robot_state-ego": 0.0871969209267543}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.30843860778789317, "sim_physics": 0.02917045510333517, "survival_time": 5.749999999999988, "driven_lanedir": 0.269683285181189, "sim_render-ego": 0.0698964844579282, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.26855220380036726, "deviation-heading": 2.1165402074051634, "set_robot_commands": 0.11602447758550229, "deviation-center-line": 0.31864725995426474, "driven_lanedir_consec": 0.269683285181189, "sim_compute_sim_state": 0.04816640356312627, "sim_compute_performance-ego": 0.07645381015280019, "sim_compute_robot_state-ego": 0.08411007549451745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30489247487630156, "sim_physics": 0.027316046652392807, "survival_time": 5.349999999999989, "driven_lanedir": 0.2711311446006377, "sim_render-ego": 0.06714992211243817, "in-drivable-lane": 0, "agent_compute-ego": 0.2644669987330927, "deviation-heading": 1.9190761486946952, "set_robot_commands": 0.10857154498590488, "deviation-center-line": 0.28425140609424804, "driven_lanedir_consec": 0.2711311446006377, "sim_compute_sim_state": 0.04216365947901646, "sim_compute_performance-ego": 0.0732351418967559, "sim_compute_robot_state-ego": 0.08206434116185268}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.34017669745215806, "sim_physics": 0.027786316410187754, "survival_time": 6.199999999999986, "driven_lanedir": 0.3027975815729169, "sim_render-ego": 0.06601668173266996, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.25433819140157393, "deviation-heading": 2.0576302306273826, "set_robot_commands": 0.10548079398370558, "deviation-center-line": 0.32778074505147636, "driven_lanedir_consec": 0.3027975815729169, "sim_compute_sim_state": 0.04085708625854984, "sim_compute_performance-ego": 0.07174136754005186, "sim_compute_robot_state-ego": 0.07725211112729964}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.30296783663805615, "sim_physics": 0.02965419845921653, "survival_time": 5.599999999999988, "driven_lanedir": 0.2674181431123879, "sim_render-ego": 0.0665455311536789, "in-drivable-lane": 0, "agent_compute-ego": 0.2546069025993347, "deviation-heading": 2.10507017691675, "set_robot_commands": 0.10218694806098938, "deviation-center-line": 0.3016761971508237, "driven_lanedir_consec": 0.2674181431123879, "sim_compute_sim_state": 0.040728060262543817, "sim_compute_performance-ego": 0.07434394104140145, "sim_compute_robot_state-ego": 0.07691035739013127}}
set_robot_commands_max	0.12219432454842788
set_robot_commands_mean	0.110891617832906
set_robot_commands_median	0.10857154498590488
set_robot_commands_min	0.10218694806098938
sim_compute_performance-ego_max	0.08925297856330872
sim_compute_performance-ego_mean	0.07700544783886362
sim_compute_performance-ego_median	0.07434394104140145
sim_compute_performance-ego_min	0.07174136754005186
sim_compute_robot_state-ego_max	0.0871969209267543
sim_compute_robot_state-ego_mean	0.08150676122011107
sim_compute_robot_state-ego_median	0.08206434116185268
sim_compute_robot_state-ego_min	0.07691035739013127
sim_compute_sim_state_max	0.05244662440740145
sim_compute_sim_state_mean	0.04487236679412757
sim_compute_sim_state_median	0.04216365947901646
sim_compute_sim_state_min	0.040728060262543817
sim_physics_max	0.031930662118471585
sim_physics_mean	0.029171535748720768
sim_physics_median	0.02917045510333517
sim_physics_min	0.027316046652392807
sim_render-ego_max	0.07525396805543166
sim_render-ego_mean	0.06897251750242937
sim_render-ego_median	0.06714992211243817
sim_render-ego_min	0.06601668173266996
simulation-passed	1
survival_time_max	6.199999999999986
survival_time_mean	5.619999999999989
survival_time_min	5.1999999999999895

No reset possible

19483

2605

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

aido2-LFV-sim-validation

2019-04-24 15:18:13+00:00

2019-04-24 15:24:54+00:00

0:06:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08032578103085782
agent_compute-ego_mean	0.07739916142917097
agent_compute-ego_median	0.07737929570047479
agent_compute-ego_min	0.07471565099862906
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.029692193356955925, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06741247235274897, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07596904766268847, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.11060976691362334, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.04233976689780631, "sim_compute_performance-ego": 0.07431173906093691, "sim_compute_robot_state-ego": 0.07643329224935393}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.025635150762704704, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.06645661133986253, "in-drivable-lane": 0, "agent_compute-ego": 0.07471565099862906, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.11054039918459378, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.04225784081679125, "sim_compute_performance-ego": 0.07291998313023494, "sim_compute_robot_state-ego": 0.0808012393804697}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.029859867501766123, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06806967106271297, "in-drivable-lane": 0, "agent_compute-ego": 0.08032578103085782, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.11138306272790786, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.04400539905466932, "sim_compute_performance-ego": 0.07406934271467493, "sim_compute_robot_state-ego": 0.08217383445577418}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.02948378468607808, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.0668794558598445, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07860603175320469, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.10616558986705736, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.040259982203389263, "sim_compute_performance-ego": 0.07245387349809919, "sim_compute_robot_state-ego": 0.076672090278877}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.02658169520528693, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06782710552215576, "in-drivable-lane": 0, "agent_compute-ego": 0.07737929570047479, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.10353214489786249, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.04092131790361906, "sim_compute_performance-ego": 0.07263319115889699, "sim_compute_robot_state-ego": 0.07458638517480147}}
set_robot_commands_max	0.11138306272790786
set_robot_commands_mean	0.10844619271820896
set_robot_commands_median	0.11054039918459378
set_robot_commands_min	0.10353214489786249
sim_compute_performance-ego_max	0.07431173906093691
sim_compute_performance-ego_mean	0.07327762591256859
sim_compute_performance-ego_median	0.07291998313023494
sim_compute_performance-ego_min	0.07245387349809919
sim_compute_robot_state-ego_max	0.08217383445577418
sim_compute_robot_state-ego_mean	0.07813336830785525
sim_compute_robot_state-ego_median	0.076672090278877
sim_compute_robot_state-ego_min	0.07458638517480147
sim_compute_sim_state_max	0.04400539905466932
sim_compute_sim_state_mean	0.04195686137525503
sim_compute_sim_state_median	0.04225784081679125
sim_compute_sim_state_min	0.040259982203389263
sim_physics_max	0.029859867501766123
sim_physics_mean	0.028250538302558352
sim_physics_median	0.02948378468607808
sim_physics_min	0.025635150762704704
sim_render-ego_max	0.06806967106271297
sim_render-ego_mean	0.06732906322746494
sim_render-ego_median	0.06741247235274897
sim_render-ego_min	0.06645661133986253
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

19471

2645

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-24 15:08:27+00:00

2019-04-24 15:17:59+00:00

0:09:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487132829419987
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041400208354252
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08815993760761462
agent_compute-ego_mean	0.08343567975845814
agent_compute-ego_median	0.0826031690115457
agent_compute-ego_min	0.08030260526216947
deviation-center-line_max	0.1279102488429998
deviation-center-line_mean	0.10518151035257096
deviation-center-line_min	0.06917270915638028
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550057
deviation-heading_median	0.36368201628851926
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903464
driven_any_median	0.6642785413159032
driven_any_min	0.3059207793076613
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.588039443394122
driven_lanedir_consec_min	0.28022225990343186
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.588039443394122
driven_lanedir_median	0.5487132829419987
driven_lanedir_min	0.28022225990343186
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.049132309308866175, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.07046042419061428, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.08229857828558945, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.11401943753405316, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.04370214880966559, "sim_compute_performance-ego": 0.07854094156404821, "sim_compute_robot_state-ego": 0.08452540199931075, "sim_compute_robot_state-npc0": 0.07887913831850378, "sim_compute_robot_state-npc1": 0.07980649064226848, "sim_compute_robot_state-npc2": 0.07985721855628782, "sim_compute_robot_state-npc3": 0.07720721058729219}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.048845502046438366, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.07197816555316632, "in-drivable-lane": 0, "agent_compute-ego": 0.08030260526216947, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.11786124339470495, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.04444486361283522, "sim_compute_performance-ego": 0.08118014152233417, "sim_compute_robot_state-ego": 0.08324651534740742, "sim_compute_robot_state-npc0": 0.07930105466109055, "sim_compute_robot_state-npc1": 0.07876042219308707, "sim_compute_robot_state-npc2": 0.0825892503444965, "sim_compute_robot_state-npc3": 0.08329733518453744}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.04678405599391207, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.07138433354966184, "in-drivable-lane": 0, "agent_compute-ego": 0.0838141086253714, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.11592232927362968, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.04431405980536278, "sim_compute_performance-ego": 0.07942750098857473, "sim_compute_robot_state-ego": 0.09040670699261603, "sim_compute_robot_state-npc0": 0.07610453950597885, "sim_compute_robot_state-npc1": 0.07661520166600004, "sim_compute_robot_state-npc2": 0.08062009101218366, "sim_compute_robot_state-npc3": 0.08065441821483856}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.05116551524990207, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.07067212953672304, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0826031690115457, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.1157357483119755, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.04439900471613957, "sim_compute_performance-ego": 0.0786603073497395, "sim_compute_robot_state-ego": 0.08451570259345757, "sim_compute_robot_state-npc0": 0.07758322914878091, "sim_compute_robot_state-npc1": 0.0780565450479696, "sim_compute_robot_state-npc2": 0.07808809751992697, "sim_compute_robot_state-npc3": 0.07892209094959302}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.042977910292776006, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.07032751409631026, "in-drivable-lane": 0, "agent_compute-ego": 0.08815993760761462, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.114354271637766, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.04428673417944657, "sim_compute_performance-ego": 0.08004360449941535, "sim_compute_robot_state-ego": 0.08939123153686523, "sim_compute_robot_state-npc0": 0.07991446946796618, "sim_compute_robot_state-npc1": 0.077457258575841, "sim_compute_robot_state-npc2": 0.07786694953316137, "sim_compute_robot_state-npc3": 0.07647929693523206}}
set_robot_commands_max	0.11786124339470495
set_robot_commands_mean	0.11557860603042588
set_robot_commands_median	0.1157357483119755
set_robot_commands_min	0.11401943753405316
sim_compute_performance-ego_max	0.08118014152233417
sim_compute_performance-ego_mean	0.07957049918482238
sim_compute_performance-ego_median	0.07942750098857473
sim_compute_performance-ego_min	0.07854094156404821
sim_compute_robot_state-ego_max	0.09040670699261603
sim_compute_robot_state-ego_mean	0.0864171116939314
sim_compute_robot_state-ego_median	0.08452540199931075
sim_compute_robot_state-ego_min	0.08324651534740742
sim_compute_robot_state-npc0_max	0.07991446946796618
sim_compute_robot_state-npc0_mean	0.07835648622046405
sim_compute_robot_state-npc0_median	0.07887913831850378
sim_compute_robot_state-npc0_min	0.07610453950597885
sim_compute_robot_state-npc1_max	0.07980649064226848
sim_compute_robot_state-npc1_mean	0.07813918362503325
sim_compute_robot_state-npc1_median	0.0780565450479696
sim_compute_robot_state-npc1_min	0.07661520166600004
sim_compute_robot_state-npc2_max	0.0825892503444965
sim_compute_robot_state-npc2_mean	0.07980432139321127
sim_compute_robot_state-npc2_median	0.07985721855628782
sim_compute_robot_state-npc2_min	0.07786694953316137
sim_compute_robot_state-npc3_max	0.08329733518453744
sim_compute_robot_state-npc3_mean	0.07931207037429866
sim_compute_robot_state-npc3_median	0.07892209094959302
sim_compute_robot_state-npc3_min	0.07647929693523206
sim_compute_sim_state_max	0.04444486361283522
sim_compute_sim_state_mean	0.04422936222468994
sim_compute_sim_state_median	0.04431405980536278
sim_compute_sim_state_min	0.04370214880966559
sim_physics_max	0.05116551524990207
sim_physics_mean	0.04778105857837893
sim_physics_median	0.048845502046438366
sim_physics_min	0.042977910292776006
sim_render-ego_max	0.07197816555316632
sim_render-ego_mean	0.07096451338529515
sim_render-ego_median	0.07067212953672304
sim_render-ego_min	0.07032751409631026
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

19448

2632

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-24 15:00:12+00:00

2019-04-24 15:08:14+00:00

0:08:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16161808437771266
agent_compute-ego_mean	0.15146771158474062
agent_compute-ego_median	0.15750962495803833
agent_compute-ego_min	0.12147604016696706
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.038343605005516194, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.062178085435111566, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.15967809929037993, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09905444900944547, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.039780783203412905, "sim_compute_performance-ego": 0.06761584191952112, "sim_compute_robot_state-ego": 0.07182749262395895, "sim_compute_robot_state-npc0": 0.07283984040314297, "sim_compute_robot_state-npc1": 0.07131424040164587, "sim_compute_robot_state-npc2": 0.07025409644504763, "sim_compute_robot_state-npc3": 0.07306002221017513}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.037776291370391846, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06010949069803411, "in-drivable-lane": 0, "agent_compute-ego": 0.15750962495803833, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.10140084678476508, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03916095603596081, "sim_compute_performance-ego": 0.06731435385617343, "sim_compute_robot_state-ego": 0.06811700625853105, "sim_compute_robot_state-npc0": 0.0674515583298423, "sim_compute_robot_state-npc1": 0.06700656088915738, "sim_compute_robot_state-npc2": 0.07386991110715, "sim_compute_robot_state-npc3": 0.0698412223295732}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.04027061462402344, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06199928389655219, "in-drivable-lane": 0, "agent_compute-ego": 0.16161808437771266, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.10114402770996092, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.039861472447713216, "sim_compute_performance-ego": 0.06804237365722657, "sim_compute_robot_state-ego": 0.07393299208747016, "sim_compute_robot_state-npc0": 0.07167090839809842, "sim_compute_robot_state-npc1": 0.07017112837897407, "sim_compute_robot_state-npc2": 0.07240398195054797, "sim_compute_robot_state-npc3": 0.07075530158148871}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03992331027984619, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06444391111532848, "in-drivable-lane": 0, "agent_compute-ego": 0.15705670913060507, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0977218747138977, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03908593952655792, "sim_compute_performance-ego": 0.06828573842843373, "sim_compute_robot_state-ego": 0.07251143455505371, "sim_compute_robot_state-npc0": 0.06763254602750142, "sim_compute_robot_state-npc1": 0.06886363526185353, "sim_compute_robot_state-npc2": 0.06845693290233612, "sim_compute_robot_state-npc3": 0.07027360796928406}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03120729151894065, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.04726226540172801, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.12147604016696706, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07725317688549266, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.031313117812661564, "sim_compute_performance-ego": 0.052026450634002686, "sim_compute_robot_state-ego": 0.05428636775297277, "sim_compute_robot_state-npc0": 0.05512843412511489, "sim_compute_robot_state-npc1": 0.052263470257029813, "sim_compute_robot_state-npc2": 0.05425955968744615, "sim_compute_robot_state-npc3": 0.05332818452049704}}
set_robot_commands_max	0.10140084678476508
set_robot_commands_mean	0.09531487502071236
set_robot_commands_median	0.09905444900944547
set_robot_commands_min	0.07725317688549266
sim_compute_performance-ego_max	0.06828573842843373
sim_compute_performance-ego_mean	0.06465695169907151
sim_compute_performance-ego_median	0.06761584191952112
sim_compute_performance-ego_min	0.052026450634002686
sim_compute_robot_state-ego_max	0.07393299208747016
sim_compute_robot_state-ego_mean	0.06813505865559732
sim_compute_robot_state-ego_median	0.07182749262395895
sim_compute_robot_state-ego_min	0.05428636775297277
sim_compute_robot_state-npc0_max	0.07283984040314297
sim_compute_robot_state-npc0_mean	0.06694465745674
sim_compute_robot_state-npc0_median	0.06763254602750142
sim_compute_robot_state-npc0_min	0.05512843412511489
sim_compute_robot_state-npc1_max	0.07131424040164587
sim_compute_robot_state-npc1_mean	0.06592380703773214
sim_compute_robot_state-npc1_median	0.06886363526185353
sim_compute_robot_state-npc1_min	0.052263470257029813
sim_compute_robot_state-npc2_max	0.07386991110715
sim_compute_robot_state-npc2_mean	0.06784889641850558
sim_compute_robot_state-npc2_median	0.07025409644504763
sim_compute_robot_state-npc2_min	0.05425955968744615
sim_compute_robot_state-npc3_max	0.07306002221017513
sim_compute_robot_state-npc3_mean	0.06745166772220364
sim_compute_robot_state-npc3_median	0.07027360796928406
sim_compute_robot_state-npc3_min	0.05332818452049704
sim_compute_sim_state_max	0.039861472447713216
sim_compute_sim_state_mean	0.03784045380526128
sim_compute_sim_state_median	0.03916095603596081
sim_compute_sim_state_min	0.031313117812661564
sim_physics_max	0.04027061462402344
sim_physics_mean	0.03750422255974366
sim_physics_median	0.038343605005516194
sim_physics_min	0.03120729151894065
sim_render-ego_max	0.06444391111532848
sim_render-ego_mean	0.05919860730935087
sim_render-ego_median	0.06199928389655219
sim_render-ego_min	0.04726226540172801
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

19445

2648

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFVI-sim-testing

step1-simulation

host-error

2019-04-24 14:56:32+00:00

2019-04-24 15:00:05+00:00

0:03:33

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19445-465850', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19445-465850', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19445-465850', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19411

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

aido2-LFVI-sim-testing

step1-simulation

success

2019-04-24 14:30:51+00:00

2019-04-24 14:56:16+00:00

0:25:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.48167024965285254
survival_time_median	8.999999999999993
deviation-center-line_median	0.5715166911228277
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.10192205111185708
agent_compute-ego_mean	0.09834526995824412
agent_compute-ego_median	0.1014428234869434
agent_compute-ego_min	0.08760370810826619
deviation-center-line_max	1.1604163553310656
deviation-center-line_mean	0.5752455976023899
deviation-center-line_min	0.07925615207888295
deviation-heading_max	5.07765016395297
deviation-heading_mean	2.609698248118849
deviation-heading_median	3.136009607349262
deviation-heading_min	0.7344741687723938
driven_any_max	2.2510830346725648
driven_any_mean	1.2107447426435267
driven_any_median	1.3885456141412982
driven_any_min	0.22615521940554537
driven_lanedir_consec_max	1.3400662913985528
driven_lanedir_consec_mean	0.6518899353349388
driven_lanedir_consec_min	0.18069530534391953
driven_lanedir_max	1.8947880860307853
driven_lanedir_mean	0.9340802992933972
driven_lanedir_median	1.0478834148972591
driven_lanedir_min	0.18069530534391953
in-drivable-lane_max	2.9000000000000377
in-drivable-lane_mean	0.9000000000000083
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3885456141412982, "sim_physics": 0.06014684306250678, "survival_time": 8.999999999999993, "driven_lanedir": 1.0478834148972591, "sim_render-ego": 0.07836300664477878, "in-drivable-lane": 0.8000000000000069, "agent_compute-ego": 0.10192205111185708, "deviation-heading": 3.363100899867679, "set_robot_commands": 0.1325057586034139, "deviation-center-line": 0.5715166911228277, "driven_lanedir_consec": 0.48167024965285254, "sim_compute_sim_state": 0.04810683064990574, "sim_compute_performance-ego": 0.08597342703077528, "sim_compute_robot_state-ego": 0.0940994660059611, "sim_compute_robot_state-npc0": 0.08740673065185547, "sim_compute_robot_state-npc1": 0.08557639651828342, "sim_compute_robot_state-npc2": 0.08547247780693902, "sim_compute_robot_state-npc3": 0.08704563776652018}, "udem1-1-0": {"driven_any": 0.22615521940554537, "sim_physics": 0.05526475345387178, "survival_time": 1.7000000000000008, "driven_lanedir": 0.18069530534391953, "sim_render-ego": 0.07802426113801844, "in-drivable-lane": 0, "agent_compute-ego": 0.09900640038882984, "deviation-heading": 0.73725640065194, "set_robot_commands": 0.13440842488232782, "deviation-center-line": 0.07925615207888295, "driven_lanedir_consec": 0.18069530534391953, "sim_compute_sim_state": 0.04670077912947711, "sim_compute_performance-ego": 0.08297869738410502, "sim_compute_robot_state-ego": 0.1027597188949585, "sim_compute_robot_state-npc0": 0.08538605185116038, "sim_compute_robot_state-npc1": 0.08083876441506778, "sim_compute_robot_state-npc2": 0.08232437161838307, "sim_compute_robot_state-npc3": 0.08420827809502096}, "udem1-2-0": {"driven_any": 2.2510830346725648, "sim_physics": 0.054101808921440495, "survival_time": 14.300000000000068, "driven_lanedir": 1.8947880860307853, "sim_render-ego": 0.07630899569371363, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.10175136669532404, "deviation-heading": 5.07765016395297, "set_robot_commands": 0.12801593917233128, "deviation-center-line": 1.1604163553310656, "driven_lanedir_consec": 1.051783798281825, "sim_compute_sim_state": 0.04640866409648548, "sim_compute_performance-ego": 0.08350136646857628, "sim_compute_robot_state-ego": 0.0930166778030929, "sim_compute_robot_state-npc0": 0.08251694949356826, "sim_compute_robot_state-npc1": 0.08325990930303827, "sim_compute_robot_state-npc2": 0.08316792641486322, "sim_compute_robot_state-npc3": 0.08319064537128368}, "udem1-3-0": {"driven_any": 0.2422398150462939, "sim_physics": 0.0371150705549452, "survival_time": 1.800000000000001, "driven_lanedir": 0.2052340319975441, "sim_render-ego": 0.061589029100206166, "in-drivable-lane": 0, "agent_compute-ego": 0.08760370810826619, "deviation-heading": 0.7344741687723938, "set_robot_commands": 0.09239388836754692, "deviation-center-line": 0.09684690249679152, "driven_lanedir_consec": 0.2052340319975441, "sim_compute_sim_state": 0.036071558793385826, "sim_compute_performance-ego": 0.06298038694593641, "sim_compute_robot_state-ego": 0.06841690672768487, "sim_compute_robot_state-npc0": 0.06385752889845106, "sim_compute_robot_state-npc1": 0.06438816918267144, "sim_compute_robot_state-npc2": 0.06514157189263238, "sim_compute_robot_state-npc3": 0.06306534343295628}, "udem1-4-0": {"driven_any": 1.9457000299519311, "sim_physics": 0.05517466029813213, "survival_time": 12.40000000000004, "driven_lanedir": 1.3418006581974773, "sim_render-ego": 0.0772141275867339, "in-drivable-lane": 2.9000000000000377, "agent_compute-ego": 0.1014428234869434, "deviation-heading": 3.136009607349262, "set_robot_commands": 0.13473974889324558, "deviation-center-line": 0.968191886982382, "driven_lanedir_consec": 1.3400662913985528, "sim_compute_sim_state": 0.04763917000063004, "sim_compute_performance-ego": 0.08413035446597684, "sim_compute_robot_state-ego": 0.0915760003751324, "sim_compute_robot_state-npc0": 0.0864271963796308, "sim_compute_robot_state-npc1": 0.08523377872282459, "sim_compute_robot_state-npc2": 0.08585704526593609, "sim_compute_robot_state-npc3": 0.0855534028622412}}
set_robot_commands_max	0.13473974889324558
set_robot_commands_mean	0.12441275198377308
set_robot_commands_median	0.1325057586034139
set_robot_commands_min	0.09239388836754692
sim_compute_performance-ego_max	0.08597342703077528
sim_compute_performance-ego_mean	0.07991284645907397
sim_compute_performance-ego_median	0.08350136646857628
sim_compute_performance-ego_min	0.06298038694593641
sim_compute_robot_state-ego_max	0.1027597188949585
sim_compute_robot_state-ego_mean	0.08997375396136595
sim_compute_robot_state-ego_median	0.0930166778030929
sim_compute_robot_state-ego_min	0.06841690672768487
sim_compute_robot_state-npc0_max	0.08740673065185547
sim_compute_robot_state-npc0_mean	0.0811188914549332
sim_compute_robot_state-npc0_median	0.08538605185116038
sim_compute_robot_state-npc0_min	0.06385752889845106
sim_compute_robot_state-npc1_max	0.08557639651828342
sim_compute_robot_state-npc1_mean	0.0798594036283771
sim_compute_robot_state-npc1_median	0.08325990930303827
sim_compute_robot_state-npc1_min	0.06438816918267144
sim_compute_robot_state-npc2_max	0.08585704526593609
sim_compute_robot_state-npc2_mean	0.08039267859975074
sim_compute_robot_state-npc2_median	0.08316792641486322
sim_compute_robot_state-npc2_min	0.06514157189263238
sim_compute_robot_state-npc3_max	0.08704563776652018
sim_compute_robot_state-npc3_mean	0.08061266150560446
sim_compute_robot_state-npc3_median	0.08420827809502096
sim_compute_robot_state-npc3_min	0.06306534343295628
sim_compute_sim_state_max	0.04810683064990574
sim_compute_sim_state_mean	0.04498540053397684
sim_compute_sim_state_median	0.04670077912947711
sim_compute_sim_state_min	0.036071558793385826
sim_physics_max	0.06014684306250678
sim_physics_mean	0.05236062725817928
sim_physics_median	0.05517466029813213
sim_physics_min	0.0371150705549452
sim_render-ego_max	0.07836300664477878
sim_render-ego_mean	0.07429988403269018
sim_render-ego_median	0.0772141275867339
sim_render-ego_min	0.061589029100206166
simulation-passed	1
survival_time_max	14.300000000000068
survival_time_mean	7.84000000000002
survival_time_min	1.7000000000000008

No reset possible

19402

2719

jiang peng

test for ppo

step1-simulation

error

2019-04-24 14:28:29+00:00

2019-04-24 14:30:20+00:00

0:01:51

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19396

2731

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-24 14:26:40+00:00

2019-04-24 14:28:22+00:00

0:01:42

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19388

2739

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-24 14:24:37+00:00

2019-04-24 14:26:18+00:00

0:01:41

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19380

2755

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-24 14:18:22+00:00

2019-04-24 14:24:24+00:00

0:06:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07795756037642317
agent_compute-ego_mean	0.07545640575902779
agent_compute-ego_median	0.07512889009840945
agent_compute-ego_min	0.0719759647662823
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.03100819413254901, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06613338575130556, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.07795756037642317, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.1089210248574978, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.04091057835555658, "sim_compute_performance-ego": 0.0726141755173846, "sim_compute_robot_state-ego": 0.07837860758711652}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.02644332555624155, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.06640305885901818, "in-drivable-lane": 0, "agent_compute-ego": 0.0778276461821336, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.1059174812757052, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.038988773639385514, "sim_compute_performance-ego": 0.0780869172169612, "sim_compute_robot_state-ego": 0.08121147522559533}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.02438852127562178, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.0617754560835818, "in-drivable-lane": 0, "agent_compute-ego": 0.07512889009840945, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.10007636090542409, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03764411743651045, "sim_compute_performance-ego": 0.0680086409791987, "sim_compute_robot_state-ego": 0.07372378795704942}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.027437055503929053, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06406255606766585, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0719759647662823, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.09518963950020928, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03852717169038542, "sim_compute_performance-ego": 0.0691554022359324, "sim_compute_robot_state-ego": 0.07226989819453312}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.026559421890660337, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06701331389577765, "in-drivable-lane": 0, "agent_compute-ego": 0.07439196737189042, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.09789629986411648, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03985653425517835, "sim_compute_performance-ego": 0.07234875779402883, "sim_compute_robot_state-ego": 0.07613652003438849}}
set_robot_commands_max	0.1089210248574978
set_robot_commands_mean	0.10160016128059056
set_robot_commands_median	0.10007636090542409
set_robot_commands_min	0.09518963950020928
sim_compute_performance-ego_max	0.0780869172169612
sim_compute_performance-ego_mean	0.07204277874870114
sim_compute_performance-ego_median	0.07234875779402883
sim_compute_performance-ego_min	0.0680086409791987
sim_compute_robot_state-ego_max	0.08121147522559533
sim_compute_robot_state-ego_mean	0.07634405779973658
sim_compute_robot_state-ego_median	0.07613652003438849
sim_compute_robot_state-ego_min	0.07226989819453312
sim_compute_sim_state_max	0.04091057835555658
sim_compute_sim_state_mean	0.039185435075403265
sim_compute_sim_state_median	0.038988773639385514
sim_compute_sim_state_min	0.03764411743651045
sim_physics_max	0.03100819413254901
sim_physics_mean	0.02716730367180035
sim_physics_median	0.026559421890660337
sim_physics_min	0.02438852127562178
sim_render-ego_max	0.06701331389577765
sim_render-ego_mean	0.0650775541314698
sim_render-ego_median	0.06613338575130556
sim_render-ego_min	0.0617754560835818
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

19336

2866

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 14:00:31+00:00

2019-04-24 14:17:48+00:00

0:17:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.667081383922986
survival_time_median	10.450000000000014
deviation-center-line_median	0.17700535816071697
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.11631578121459084
agent_compute-ego_mean	0.111583195658534
agent_compute-ego_median	0.11098536447037098
agent_compute-ego_min	0.10855753749024634
deviation-center-line_max	0.6866953615027076
deviation-center-line_mean	0.2747629829496173
deviation-center-line_min	0.12554620328513189
deviation-heading_max	3.544331194850137
deviation-heading_mean	2.302728791908451
deviation-heading_median	2.2939837970698873
deviation-heading_min	1.6410640605314362
driven_any_max	1.1778834418433053
driven_any_mean	0.8023519419460268
driven_any_median	0.8162458856627909
driven_any_min	0.5860607774901445
driven_lanedir_consec_max	1.069419014274816
driven_lanedir_consec_mean	0.7021729810344041
driven_lanedir_consec_min	0.5084516140771878
driven_lanedir_max	1.069419014274816
driven_lanedir_mean	0.7021729810344041
driven_lanedir_median	0.667081383922986
driven_lanedir_min	0.5084516140771878
in-drivable-lane_max	1.500000000000021
in-drivable-lane_mean	0.5200000000000046
in-drivable-lane_min	0.10000000000000142
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5860607774901445, "sim_physics": 0.03112497298341048, "survival_time": 7.599999999999981, "driven_lanedir": 0.5084516140771878, "sim_render-ego": 0.06901320501377708, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.1125735436615191, "deviation-heading": 1.7121540921029272, "set_robot_commands": 0.10982517819655568, "deviation-center-line": 0.21571700313393863, "driven_lanedir_consec": 0.5084516140771878, "sim_compute_sim_state": 0.04235541506817466, "sim_compute_performance-ego": 0.07484836954819529, "sim_compute_robot_state-ego": 0.08100924836961847}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8403411849037064, "sim_physics": 0.028227741773738418, "survival_time": 10.750000000000018, "driven_lanedir": 0.667081383922986, "sim_render-ego": 0.06837634929390841, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.11098536447037098, "deviation-heading": 2.2939837970698873, "set_robot_commands": 0.11003645963447038, "deviation-center-line": 0.16885098866559145, "driven_lanedir_consec": 0.667081383922986, "sim_compute_sim_state": 0.04283663949301077, "sim_compute_performance-ego": 0.07655592962752941, "sim_compute_robot_state-ego": 0.08035866493402526}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8162458856627909, "sim_physics": 0.02888878680872575, "survival_time": 10.450000000000014, "driven_lanedir": 0.749287343394764, "sim_render-ego": 0.06852259362143193, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.11631578121459084, "deviation-heading": 2.3221108149878686, "set_robot_commands": 0.11571009307386772, "deviation-center-line": 0.17700535816071697, "driven_lanedir_consec": 0.749287343394764, "sim_compute_sim_state": 0.041990979436481966, "sim_compute_performance-ego": 0.0761410505577708, "sim_compute_robot_state-ego": 0.08339385210612174}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5912284198301871, "sim_physics": 0.026222129273258784, "survival_time": 7.649999999999981, "driven_lanedir": 0.5166255495022667, "sim_render-ego": 0.06468580750858083, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.10855753749024634, "deviation-heading": 1.6410640605314362, "set_robot_commands": 0.105412419325386, "deviation-center-line": 0.12554620328513189, "driven_lanedir_consec": 0.5166255495022667, "sim_compute_sim_state": 0.04093981879988527, "sim_compute_performance-ego": 0.07337191369798449, "sim_compute_robot_state-ego": 0.0763502572876176}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1778834418433053, "sim_physics": 0.027344648043314615, "survival_time": 14.950000000000076, "driven_lanedir": 1.069419014274816, "sim_render-ego": 0.06725005785624186, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.1094837514559428, "deviation-heading": 3.544331194850137, "set_robot_commands": 0.10701905012130736, "deviation-center-line": 0.6866953615027076, "driven_lanedir_consec": 1.069419014274816, "sim_compute_sim_state": 0.04151596228281657, "sim_compute_performance-ego": 0.07347165425618489, "sim_compute_robot_state-ego": 0.07736374298731485}}
set_robot_commands_max	0.11571009307386772
set_robot_commands_mean	0.10960064007031745
set_robot_commands_median	0.10982517819655568
set_robot_commands_min	0.105412419325386
sim_compute_performance-ego_max	0.07655592962752941
sim_compute_performance-ego_mean	0.07487778353753297
sim_compute_performance-ego_median	0.07484836954819529
sim_compute_performance-ego_min	0.07337191369798449
sim_compute_robot_state-ego_max	0.08339385210612174
sim_compute_robot_state-ego_mean	0.07969515313693958
sim_compute_robot_state-ego_median	0.08035866493402526
sim_compute_robot_state-ego_min	0.0763502572876176
sim_compute_sim_state_max	0.04283663949301077
sim_compute_sim_state_mean	0.04192776301607385
sim_compute_sim_state_median	0.041990979436481966
sim_compute_sim_state_min	0.04093981879988527
sim_physics_max	0.03112497298341048
sim_physics_mean	0.028361655776489615
sim_physics_median	0.028227741773738418
sim_physics_min	0.026222129273258784
sim_render-ego_max	0.06901320501377708
sim_render-ego_mean	0.06756960265878802
sim_render-ego_median	0.06837634929390841
sim_render-ego_min	0.06468580750858083
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.280000000000012
survival_time_min	7.599999999999981

No reset possible

19329

2822

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-24 13:59:50+00:00

2019-04-24 14:00:06+00:00

0:00:16

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19329-401234', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19329-401234', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19329-401234', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19322

2832

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 13:58:53+00:00

2019-04-24 13:59:25+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19313

2844

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 13:56:45+00:00

2019-04-24 13:57:26+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19272

2894

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 13:33:58+00:00

2019-04-24 13:56:22+00:00

0:22:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3081842040099012
survival_time_median	14.950000000000076
deviation-center-line_median	0.4363342478175898
in-drivable-lane_median	5.200000000000038

other stats

agent_compute-ego_max	0.19598124276346235
agent_compute-ego_mean	0.18932201525386097
agent_compute-ego_median	0.19088424258761935
agent_compute-ego_min	0.1786239290237427
deviation-center-line_max	0.6499992142355294
deviation-center-line_mean	0.4407149446788714
deviation-center-line_min	0.2862230612729656
deviation-heading_max	6.437798306163132
deviation-heading_mean	3.1622463613107095
deviation-heading_median	2.5565278011715886
deviation-heading_min	2.117545655773307
driven_any_max	0.8249623507922793
driven_any_mean	0.6825067393791302
driven_any_median	0.6553835036694241
driven_any_min	0.53949621852553
driven_lanedir_consec_max	0.5357859429478742
driven_lanedir_consec_mean	0.3353919846772388
driven_lanedir_consec_min	0.22601999591145017
driven_lanedir_max	0.5357859429478742
driven_lanedir_mean	0.3816946229864801
driven_lanedir_median	0.3760982175288763
driven_lanedir_min	0.2308715629880922
in-drivable-lane_max	7.250000000000097
in-drivable-lane_mean	5.030000000000053
in-drivable-lane_min	1.8999999999999932
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8249623507922793, "sim_physics": 0.024796911080678306, "survival_time": 14.950000000000076, "driven_lanedir": 0.5357859429478742, "sim_render-ego": 0.06473171869913737, "in-drivable-lane": 4.550000000000065, "agent_compute-ego": 0.18716261784235635, "deviation-heading": 2.1324027259961396, "set_robot_commands": 0.10000771125157674, "deviation-center-line": 0.4363342478175898, "driven_lanedir_consec": 0.5357859429478742, "sim_compute_sim_state": 0.04051216681798299, "sim_compute_performance-ego": 0.07195054848988851, "sim_compute_robot_state-ego": 0.07677215496699015}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7821502153865345, "sim_physics": 0.02436367114384969, "survival_time": 14.950000000000076, "driven_lanedir": 0.3760982175288763, "sim_render-ego": 0.06519414107004802, "in-drivable-lane": 7.250000000000097, "agent_compute-ego": 0.1786239290237427, "deviation-heading": 2.117545655773307, "set_robot_commands": 0.09887252648671468, "deviation-center-line": 0.4863774862744554, "driven_lanedir_consec": 0.3760982175288763, "sim_compute_sim_state": 0.03996824900309245, "sim_compute_performance-ego": 0.07177234888076782, "sim_compute_robot_state-ego": 0.07387757778167725}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.610541408521883, "sim_physics": 0.02482753912607829, "survival_time": 14.950000000000076, "driven_lanedir": 0.4575331874576567, "sim_render-ego": 0.06672340552012125, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.193958044052124, "deviation-heading": 6.437798306163132, "set_robot_commands": 0.10254777431488037, "deviation-center-line": 0.6499992142355294, "driven_lanedir_consec": 0.22601999591145017, "sim_compute_sim_state": 0.040810128847757976, "sim_compute_performance-ego": 0.0730164384841919, "sim_compute_robot_state-ego": 0.07744217157363892}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.53949621852553, "sim_physics": 0.02615835507710775, "survival_time": 11.250000000000025, "driven_lanedir": 0.2308715629880922, "sim_render-ego": 0.06502277056376139, "in-drivable-lane": 5.200000000000038, "agent_compute-ego": 0.19088424258761935, "deviation-heading": 2.5565278011715886, "set_robot_commands": 0.1033765591515435, "deviation-center-line": 0.2862230612729656, "driven_lanedir_consec": 0.2308715629880922, "sim_compute_sim_state": 0.04096590571933322, "sim_compute_performance-ego": 0.07199113316006131, "sim_compute_robot_state-ego": 0.07549073113335504}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6553835036694241, "sim_physics": 0.026800900252897348, "survival_time": 13.400000000000055, "driven_lanedir": 0.3081842040099012, "sim_render-ego": 0.06650823977456163, "in-drivable-lane": 6.25000000000007, "agent_compute-ego": 0.19598124276346235, "deviation-heading": 2.5669573174493787, "set_robot_commands": 0.10898836335139488, "deviation-center-line": 0.34464071379381706, "driven_lanedir_consec": 0.3081842040099012, "sim_compute_sim_state": 0.04272983056395801, "sim_compute_performance-ego": 0.07552701234817505, "sim_compute_robot_state-ego": 0.08032038051690628}}
set_robot_commands_max	0.10898836335139488
set_robot_commands_mean	0.10275858691122204
set_robot_commands_median	0.10254777431488037
set_robot_commands_min	0.09887252648671468
sim_compute_performance-ego_max	0.07552701234817505
sim_compute_performance-ego_mean	0.07285149627261692
sim_compute_performance-ego_median	0.07199113316006131
sim_compute_performance-ego_min	0.07177234888076782
sim_compute_robot_state-ego_max	0.08032038051690628
sim_compute_robot_state-ego_mean	0.07678060319451352
sim_compute_robot_state-ego_median	0.07677215496699015
sim_compute_robot_state-ego_min	0.07387757778167725
sim_compute_sim_state_max	0.04272983056395801
sim_compute_sim_state_mean	0.04099725619042493
sim_compute_sim_state_median	0.040810128847757976
sim_compute_sim_state_min	0.03996824900309245
sim_physics_max	0.026800900252897348
sim_physics_mean	0.02538947533612227
sim_physics_median	0.02482753912607829
sim_physics_min	0.02436367114384969
sim_render-ego_max	0.06672340552012125
sim_render-ego_mean	0.06563605512552592
sim_render-ego_median	0.06519414107004802
sim_render-ego_min	0.06473171869913737
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.900000000000064
survival_time_min	11.250000000000025

No reset possible

19264

2945

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 13:28:59+00:00

2019-04-24 13:33:34+00:00

0:04:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1638437348781614
survival_time_median	1.3000000000000005
deviation-center-line_median	0.05956849405926235
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1904272666344276
agent_compute-ego_mean	0.18012628007197118
agent_compute-ego_median	0.1819968223571777
agent_compute-ego_min	0.16921660533318153
deviation-center-line_max	0.06641466593740662
deviation-center-line_mean	0.05936545253277163
deviation-center-line_min	0.053679517361061344
deviation-heading_max	0.6685402703628732
deviation-heading_mean	0.603212566744131
deviation-heading_median	0.6037412728709416
deviation-heading_min	0.528471392959079
driven_any_max	0.2227002806123836
driven_any_mean	0.2064818168875681
driven_any_median	0.2080751228654782
driven_any_min	0.17768324533202023
driven_lanedir_consec_max	0.18263973191068897
driven_lanedir_consec_mean	0.15902278825655072
driven_lanedir_consec_min	0.1246653660796384
driven_lanedir_max	0.18263973191068897
driven_lanedir_mean	0.15902278825655072
driven_lanedir_median	0.1638437348781614
driven_lanedir_min	0.1246653660796384
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2074363481669612, "sim_physics": 0.027077179688673753, "survival_time": 1.3000000000000005, "driven_lanedir": 0.15733737637407108, "sim_render-ego": 0.06750026116004357, "in-drivable-lane": 0, "agent_compute-ego": 0.1819968223571777, "deviation-heading": 0.6037412728709416, "set_robot_commands": 0.09921069328601544, "deviation-center-line": 0.05956849405926235, "driven_lanedir_consec": 0.15733737637407108, "sim_compute_sim_state": 0.04381136710827167, "sim_compute_performance-ego": 0.07630547193380502, "sim_compute_robot_state-ego": 0.076576278759883}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21651408746099696, "sim_physics": 0.027851717812674388, "survival_time": 1.4000000000000006, "driven_lanedir": 0.16662773204019377, "sim_render-ego": 0.06353070054735456, "in-drivable-lane": 0, "agent_compute-ego": 0.17696397645132883, "deviation-heading": 0.6685402703628732, "set_robot_commands": 0.1030558432851519, "deviation-center-line": 0.06641466593740662, "driven_lanedir_consec": 0.16662773204019377, "sim_compute_sim_state": 0.04181345871516636, "sim_compute_performance-ego": 0.07211723497935704, "sim_compute_robot_state-ego": 0.07481445584978376}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2080751228654782, "sim_physics": 0.023458398305452783, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1638437348781614, "sim_render-ego": 0.060605571820185736, "in-drivable-lane": 0, "agent_compute-ego": 0.16921660533318153, "deviation-heading": 0.5649501454360524, "set_robot_commands": 0.09884376709277812, "deviation-center-line": 0.05694296723738583, "driven_lanedir_consec": 0.1638437348781614, "sim_compute_sim_state": 0.04128086566925049, "sim_compute_performance-ego": 0.06741604438194862, "sim_compute_robot_state-ego": 0.07270239866696872}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17768324533202023, "sim_physics": 0.02478147506713867, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1246653660796384, "sim_render-ego": 0.06891436576843261, "in-drivable-lane": 0, "agent_compute-ego": 0.18202672958374025, "deviation-heading": 0.6503597520917085, "set_robot_commands": 0.09717413902282716, "deviation-center-line": 0.053679517361061344, "driven_lanedir_consec": 0.1246653660796384, "sim_compute_sim_state": 0.040768890380859374, "sim_compute_performance-ego": 0.07210786819458008, "sim_compute_robot_state-ego": 0.07831009864807129}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2227002806123836, "sim_physics": 0.02635926466721755, "survival_time": 1.3000000000000005, "driven_lanedir": 0.18263973191068897, "sim_render-ego": 0.07071958138392521, "in-drivable-lane": 0, "agent_compute-ego": 0.1904272666344276, "deviation-heading": 0.528471392959079, "set_robot_commands": 0.10362955240102914, "deviation-center-line": 0.06022161806874202, "driven_lanedir_consec": 0.18263973191068897, "sim_compute_sim_state": 0.04389650088090163, "sim_compute_performance-ego": 0.07629671463599572, "sim_compute_robot_state-ego": 0.08215575034801777}}
set_robot_commands_max	0.10362955240102914
set_robot_commands_mean	0.10038279901756036
set_robot_commands_median	0.09921069328601544
set_robot_commands_min	0.09717413902282716
sim_compute_performance-ego_max	0.07630547193380502
sim_compute_performance-ego_mean	0.07284866682513728
sim_compute_performance-ego_median	0.07211723497935704
sim_compute_performance-ego_min	0.06741604438194862
sim_compute_robot_state-ego_max	0.08215575034801777
sim_compute_robot_state-ego_mean	0.0769117964545449
sim_compute_robot_state-ego_median	0.076576278759883
sim_compute_robot_state-ego_min	0.07270239866696872
sim_compute_sim_state_max	0.04389650088090163
sim_compute_sim_state_mean	0.042314216550889905
sim_compute_sim_state_median	0.04181345871516636
sim_compute_sim_state_min	0.040768890380859374
sim_physics_max	0.027851717812674388
sim_physics_mean	0.025905607108231428
sim_physics_median	0.02635926466721755
sim_physics_min	0.023458398305452783
sim_render-ego_max	0.07071958138392521
sim_render-ego_mean	0.06625409613598834
sim_render-ego_median	0.06750026116004357
sim_render-ego_min	0.060605571820185736
simulation-passed	1
survival_time_max	1.4000000000000006
survival_time_mean	1.3100000000000005
survival_time_min	1.2500000000000004

No reset possible

19239

2953

Baseline solution using reinforcement learning

step1-simulation

error