Evaluator 790

step1-simulation

error

2019-04-24 20:18:18+00:00

2019-04-24 20:20:23+00:00

0:02:05

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19682

2987

Artem Ioselevskii

challenge-aido_LF-template-tensorflow

step1-simulation

success

2019-04-24 17:44:41+00:00

2019-04-24 17:49:53+00:00

0:05:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3921347073368131
survival_time_median	2.1500000000000004
deviation-center-line_median	0.13353641050600168
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08440030452816985
agent_compute-ego_mean	0.0830685574072286
agent_compute-ego_median	0.08301969264682971
agent_compute-ego_min	0.08186509976020226
deviation-center-line_max	0.30550652062020567
deviation-center-line_mean	0.15060192015332574
deviation-center-line_min	0.05872838186513099
deviation-heading_max	2.214070210690381
deviation-heading_mean	0.9224913480494528
deviation-heading_median	0.7505268950369384
deviation-heading_min	0.3014861249014058
driven_any_max	1.4655987007090017
driven_any_mean	0.7356825430608365
driven_any_median	0.4349090364358085
driven_any_min	0.37469271793383346
driven_lanedir_consec_max	1.3378377139909523
driven_lanedir_consec_mean	0.6061934197870762
driven_lanedir_consec_min	0.34025205462605657
driven_lanedir_max	1.3378377139909523
driven_lanedir_mean	0.606533546811571
driven_lanedir_median	0.3921347073368131
driven_lanedir_min	0.34025205462605657
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.2399999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4349090364358085, "sim_physics": 0.012916947520056435, "survival_time": 2.1500000000000004, "driven_lanedir": 0.3921347073368131, "sim_render-ego": 0.03651087783103765, "in-drivable-lane": 0, "agent_compute-ego": 0.08440030452816985, "deviation-heading": 0.7505268950369384, "set_robot_commands": 0.05498816246210143, "deviation-center-line": 0.13353641050600168, "driven_lanedir_consec": 0.3921347073368131, "sim_compute_sim_state": 0.022357530372087344, "sim_compute_performance-ego": 0.07000753491423851, "sim_compute_robot_state-ego": 0.04049572279286939}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4655987007090017, "sim_physics": 0.01352792057564588, "survival_time": 6.149999999999986, "driven_lanedir": 1.3378377139909523, "sim_render-ego": 0.03528626953683248, "in-drivable-lane": 0, "agent_compute-ego": 0.08318999143150764, "deviation-heading": 2.214070210690381, "set_robot_commands": 0.05458737776531437, "deviation-center-line": 0.30550652062020567, "driven_lanedir_consec": 1.3378377139909523, "sim_compute_sim_state": 0.02248808620421867, "sim_compute_performance-ego": 0.03828251846437532, "sim_compute_robot_state-ego": 0.0397810625836132}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.42972877587631614, "sim_physics": 0.012526833094083346, "survival_time": 1.3000000000000005, "driven_lanedir": 0.3867793735454441, "sim_render-ego": 0.03469325028933012, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08186509976020226, "deviation-heading": 0.3014861249014058, "set_robot_commands": 0.05393582123976488, "deviation-center-line": 0.06448354278601003, "driven_lanedir_consec": 0.3867793735454441, "sim_compute_sim_state": 0.022339940071105957, "sim_compute_performance-ego": 0.03881516823401818, "sim_compute_robot_state-ego": 0.03905067994044377}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.37469271793383346, "sim_physics": 0.012397279739379884, "survival_time": 1.2500000000000004, "driven_lanedir": 0.34025205462605657, "sim_render-ego": 0.036057357788085935, "in-drivable-lane": 0, "agent_compute-ego": 0.0828676986694336, "deviation-heading": 0.35654114092445044, "set_robot_commands": 0.054361724853515626, "deviation-center-line": 0.05872838186513099, "driven_lanedir_consec": 0.34025205462605657, "sim_compute_sim_state": 0.022713994979858397, "sim_compute_performance-ego": 0.03791340827941894, "sim_compute_robot_state-ego": 0.03889307022094726}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9734834843492228, "sim_physics": 0.01407340639515927, "survival_time": 3.7999999999999945, "driven_lanedir": 0.5756638845585886, "sim_render-ego": 0.03561267099882427, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.08301969264682971, "deviation-heading": 0.9898323686940884, "set_robot_commands": 0.054400271491000525, "deviation-center-line": 0.19075474498928033, "driven_lanedir_consec": 0.5739632494361149, "sim_compute_sim_state": 0.022471584771808824, "sim_compute_performance-ego": 0.03948901515257986, "sim_compute_robot_state-ego": 0.03914009269915129}}
set_robot_commands_max	0.05498816246210143
set_robot_commands_mean	0.054454671562339366
set_robot_commands_median	0.054400271491000525
set_robot_commands_min	0.05393582123976488
sim_compute_performance-ego_max	0.07000753491423851
sim_compute_performance-ego_mean	0.04490152900892616
sim_compute_performance-ego_median	0.03881516823401818
sim_compute_performance-ego_min	0.03791340827941894
sim_compute_robot_state-ego_max	0.04049572279286939
sim_compute_robot_state-ego_mean	0.03947212564740498
sim_compute_robot_state-ego_median	0.03914009269915129
sim_compute_robot_state-ego_min	0.03889307022094726
sim_compute_sim_state_max	0.022713994979858397
sim_compute_sim_state_mean	0.02247422727981584
sim_compute_sim_state_median	0.022471584771808824
sim_compute_sim_state_min	0.022339940071105957
sim_physics_max	0.01407340639515927
sim_physics_mean	0.013088477464864962
sim_physics_median	0.012916947520056435
sim_physics_min	0.012397279739379884
sim_render-ego_max	0.03651087783103765
sim_render-ego_mean	0.03563208528882209
sim_render-ego_median	0.03561267099882427
sim_render-ego_min	0.03469325028933012
simulation-passed	1
survival_time_max	6.149999999999986
survival_time_mean	2.929999999999996
survival_time_min	1.2500000000000004

No reset possible

19668

2372

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-24 16:33:34+00:00

2019-04-24 16:52:20+00:00

0:18:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2271628965464352
survival_time_median	10.800000000000018
deviation-center-line_median	0.4302836987803837
in-drivable-lane_median	2.0499999999999927

other stats

agent_compute-ego_max	0.13896511269987916
agent_compute-ego_mean	0.12596033533286655
agent_compute-ego_median	0.13362815380096435
agent_compute-ego_min	0.10990994364716286
deviation-center-line_max	0.5576039074284667
deviation-center-line_mean	0.3744391706010032
deviation-center-line_min	0.1475671628461062
deviation-heading_max	1.826624936691222
deviation-heading_mean	1.1745965471911113
deviation-heading_median	0.9779276407610488
deviation-heading_min	0.7451786321286323
driven_any_max	2.1956524856063173
driven_any_mean	1.585349600382327
driven_any_median	1.5771367475578253
driven_any_min	0.993745776226499
driven_lanedir_consec_max	1.659262210665728
driven_lanedir_consec_mean	1.1960969538526285
driven_lanedir_consec_min	0.6474115509746436
driven_lanedir_max	1.659262210665728
driven_lanedir_mean	1.1960969538526285
driven_lanedir_median	1.2271628965464352
driven_lanedir_min	0.6474115509746436
in-drivable-lane_max	3.5000000000000497
in-drivable-lane_mean	2.280000000000025
in-drivable-lane_min	1.7000000000000242
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.034867626299961006, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.05470494572207225, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.13896511269987916, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.08837027172390506, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.03450675490948794, "sim_compute_performance-ego": 0.060265316380013666, "sim_compute_robot_state-ego": 0.06380988539551659, "sim_compute_robot_state-npc0": 0.06228627232338885, "sim_compute_robot_state-npc1": 0.06430146677030933, "sim_compute_robot_state-npc2": 0.06276845417434362, "sim_compute_robot_state-npc3": 0.06304601113573252}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1956524856063173, "sim_physics": 0.03372884670893351, "survival_time": 14.950000000000076, "driven_lanedir": 1.659262210665728, "sim_render-ego": 0.05360354820887248, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.13362815380096435, "deviation-heading": 0.9779276407610488, "set_robot_commands": 0.08498845100402833, "deviation-center-line": 0.5576039074284667, "driven_lanedir_consec": 1.659262210665728, "sim_compute_sim_state": 0.03457234859466553, "sim_compute_performance-ego": 0.05821736256281535, "sim_compute_robot_state-ego": 0.061251664956410726, "sim_compute_robot_state-npc0": 0.059230306148529054, "sim_compute_robot_state-npc1": 0.05966777563095093, "sim_compute_robot_state-npc2": 0.0601466695467631, "sim_compute_robot_state-npc3": 0.06024725596110026}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.583473805081668, "sim_physics": 0.030597186857654203, "survival_time": 10.85000000000002, "driven_lanedir": 1.243796514016382, "sim_render-ego": 0.05318121097054899, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.13450893938266736, "deviation-heading": 1.4958981170639498, "set_robot_commands": 0.08445445073914418, "deviation-center-line": 0.28274302907821136, "driven_lanedir_consec": 1.243796514016382, "sim_compute_sim_state": 0.03283398931476927, "sim_compute_performance-ego": 0.05823704833808582, "sim_compute_robot_state-ego": 0.0609457339009931, "sim_compute_robot_state-npc0": 0.05946121567405314, "sim_compute_robot_state-npc1": 0.059549659078571654, "sim_compute_robot_state-npc2": 0.05878066796860937, "sim_compute_robot_state-npc3": 0.05776625844190747}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5767391874393253, "sim_physics": 0.02629301283094618, "survival_time": 10.800000000000018, "driven_lanedir": 1.2271628965464352, "sim_render-ego": 0.04480961737809358, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.11278952713365908, "deviation-heading": 1.826624936691222, "set_robot_commands": 0.06946110504644888, "deviation-center-line": 0.4302836987803837, "driven_lanedir_consec": 1.2271628965464352, "sim_compute_sim_state": 0.028924986168190284, "sim_compute_performance-ego": 0.04916230837504069, "sim_compute_robot_state-ego": 0.05066841619986075, "sim_compute_robot_state-npc0": 0.05063682794570923, "sim_compute_robot_state-npc1": 0.05092296004295349, "sim_compute_robot_state-npc2": 0.049883862336476646, "sim_compute_robot_state-npc3": 0.04970804077607614}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771367475578253, "sim_physics": 0.02432169803353243, "survival_time": 10.750000000000018, "driven_lanedir": 1.2028515970599525, "sim_render-ego": 0.04399194939191951, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.10990994364716286, "deviation-heading": 0.7451786321286323, "set_robot_commands": 0.07058621561804483, "deviation-center-line": 0.4539980548718481, "driven_lanedir_consec": 1.2028515970599525, "sim_compute_sim_state": 0.026712424256080804, "sim_compute_performance-ego": 0.04774207070816395, "sim_compute_robot_state-ego": 0.04865553988966831, "sim_compute_robot_state-npc0": 0.04804095334784929, "sim_compute_robot_state-npc1": 0.047803146894588026, "sim_compute_robot_state-npc2": 0.047882566895595814, "sim_compute_robot_state-npc3": 0.04760948890863463}}
set_robot_commands_max	0.08837027172390506
set_robot_commands_mean	0.07957209882631425
set_robot_commands_median	0.08445445073914418
set_robot_commands_min	0.06946110504644888
sim_compute_performance-ego_max	0.060265316380013666
sim_compute_performance-ego_mean	0.054724821272823895
sim_compute_performance-ego_median	0.05821736256281535
sim_compute_performance-ego_min	0.04774207070816395
sim_compute_robot_state-ego_max	0.06380988539551659
sim_compute_robot_state-ego_mean	0.05706624806848989
sim_compute_robot_state-ego_median	0.0609457339009931
sim_compute_robot_state-ego_min	0.04865553988966831
sim_compute_robot_state-npc0_max	0.06228627232338885
sim_compute_robot_state-npc0_mean	0.055931115087905915
sim_compute_robot_state-npc0_median	0.059230306148529054
sim_compute_robot_state-npc0_min	0.04804095334784929
sim_compute_robot_state-npc1_max	0.06430146677030933
sim_compute_robot_state-npc1_mean	0.056449001683474685
sim_compute_robot_state-npc1_median	0.059549659078571654
sim_compute_robot_state-npc1_min	0.047803146894588026
sim_compute_robot_state-npc2_max	0.06276845417434362
sim_compute_robot_state-npc2_mean	0.05589244418435771
sim_compute_robot_state-npc2_median	0.05878066796860937
sim_compute_robot_state-npc2_min	0.047882566895595814
sim_compute_robot_state-npc3_max	0.06304601113573252
sim_compute_robot_state-npc3_mean	0.05567541104469021
sim_compute_robot_state-npc3_median	0.05776625844190747
sim_compute_robot_state-npc3_min	0.04760948890863463
sim_compute_sim_state_max	0.03457234859466553
sim_compute_sim_state_mean	0.03151010064863877
sim_compute_sim_state_median	0.03283398931476927
sim_compute_sim_state_min	0.026712424256080804
sim_physics_max	0.034867626299961006
sim_physics_mean	0.029961674146205465
sim_physics_median	0.030597186857654203
sim_physics_min	0.02432169803353243
sim_render-ego_max	0.05470494572207225
sim_render-ego_mean	0.050058254334301354
sim_render-ego_median	0.05318121097054899
sim_render-ego_min	0.04399194939191951
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.860000000000024
survival_time_min	6.949999999999983

No reset possible

19655

2387

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 16:28:02+00:00

2019-04-24 16:33:06+00:00

0:05:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09171513367065232
survival_time_median	1.2500000000000004
deviation-center-line_median	0.042272442715241
in-drivable-lane_median	0.10000000000000007

other stats

agent_compute-ego_max	0.1847957801818848
agent_compute-ego_mean	0.16556176734686695
agent_compute-ego_median	0.1673306083679199
agent_compute-ego_min	0.14427384014787345
deviation-center-line_max	0.05777830952022746
deviation-center-line_mean	0.040407079887674655
deviation-center-line_min	0.017710701068031673
deviation-heading_max	0.7330559459017305
deviation-heading_mean	0.6343166258018466
deviation-heading_median	0.654120697984972
deviation-heading_min	0.4988079507717663
driven_any_max	0.17515555211208
driven_any_mean	0.1637796597606125
driven_any_median	0.1636875747124374
driven_any_min	0.1522800448766264
driven_lanedir_consec_max	0.11753613812123342
driven_lanedir_consec_mean	0.08836593849688308
driven_lanedir_consec_min	0.04994425825974358
driven_lanedir_max	0.11753613812123342
driven_lanedir_mean	0.08836593849688308
driven_lanedir_median	0.09171513367065232
driven_lanedir_min	0.04994425825974358
in-drivable-lane_max	0.5000000000000003
in-drivable-lane_mean	0.21000000000000013
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.17515555211208, "sim_physics": 0.038666181564331055, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11753613812123342, "sim_render-ego": 0.05756955146789551, "in-drivable-lane": 0, "agent_compute-ego": 0.1673306083679199, "deviation-heading": 0.7035843039082754, "set_robot_commands": 0.08059247970581054, "deviation-center-line": 0.05777830952022746, "driven_lanedir_consec": 0.11753613812123342, "sim_compute_sim_state": 0.03416468620300293, "sim_compute_performance-ego": 0.06872369766235352, "sim_compute_robot_state-ego": 0.06872771263122558, "sim_compute_robot_state-npc0": 0.05871463775634766, "sim_compute_robot_state-npc1": 0.05672039031982422, "sim_compute_robot_state-npc2": 0.05731882095336914, "sim_compute_robot_state-npc3": 0.05802345275878906}, "udem1-1-0": {"driven_any": 0.1696601365270265, "sim_physics": 0.039642868041992185, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1050469181099043, "sim_render-ego": 0.06129412651062012, "in-drivable-lane": 0, "agent_compute-ego": 0.1847957801818848, "deviation-heading": 0.7330559459017305, "set_robot_commands": 0.08834820747375488, "deviation-center-line": 0.0542241310580767, "driven_lanedir_consec": 0.1050469181099043, "sim_compute_sim_state": 0.037690343856811526, "sim_compute_performance-ego": 0.06549559593200684, "sim_compute_robot_state-ego": 0.06947648048400878, "sim_compute_robot_state-npc0": 0.06150925636291504, "sim_compute_robot_state-npc1": 0.06261818885803222, "sim_compute_robot_state-npc2": 0.06321731567382813, "sim_compute_robot_state-npc3": 0.06453443527221679}, "udem1-2-0": {"driven_any": 0.1636875747124374, "sim_physics": 0.03793118076939737, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07758724432288178, "sim_render-ego": 0.058804881188177296, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.1538775659376575, "deviation-heading": 0.5820142304424883, "set_robot_commands": 0.08576585400489069, "deviation-center-line": 0.03004981507679643, "driven_lanedir_consec": 0.07758724432288178, "sim_compute_sim_state": 0.03521781582986155, "sim_compute_performance-ego": 0.060463305442563946, "sim_compute_robot_state-ego": 0.061773107897850774, "sim_compute_robot_state-npc0": 0.06131719773815524, "sim_compute_robot_state-npc1": 0.06448228128494755, "sim_compute_robot_state-npc2": 0.06531867673320155, "sim_compute_robot_state-npc3": 0.06221625881810342}, "udem1-3-0": {"driven_any": 0.1522800448766264, "sim_physics": 0.03419160842895508, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04994425825974358, "sim_render-ego": 0.05394130739672431, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.14427384014787345, "deviation-heading": 0.4988079507717663, "set_robot_commands": 0.07690618778097219, "deviation-center-line": 0.017710701068031673, "driven_lanedir_consec": 0.04994425825974358, "sim_compute_sim_state": 0.02971103273589035, "sim_compute_performance-ego": 0.05523999806108146, "sim_compute_robot_state-ego": 0.05762530195301976, "sim_compute_robot_state-npc0": 0.05541341058139143, "sim_compute_robot_state-npc1": 0.05409524358552078, "sim_compute_robot_state-npc2": 0.05291151178294215, "sim_compute_robot_state-npc3": 0.05625212603601916}, "udem1-4-0": {"driven_any": 0.15811499057489234, "sim_physics": 0.038490676879882814, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09171513367065232, "sim_render-ego": 0.05879673957824707, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17753104209899903, "deviation-heading": 0.654120697984972, "set_robot_commands": 0.08975781440734863, "deviation-center-line": 0.042272442715241, "driven_lanedir_consec": 0.09171513367065232, "sim_compute_sim_state": 0.041358718872070314, "sim_compute_performance-ego": 0.06554094314575196, "sim_compute_robot_state-ego": 0.06130595207214355, "sim_compute_robot_state-npc0": 0.056313915252685545, "sim_compute_robot_state-npc1": 0.0584321403503418, "sim_compute_robot_state-npc2": 0.07823272705078126, "sim_compute_robot_state-npc3": 0.057409687042236326}}
set_robot_commands_max	0.08975781440734863
set_robot_commands_mean	0.0842741086745554
set_robot_commands_median	0.08576585400489069
set_robot_commands_min	0.07690618778097219
sim_compute_performance-ego_max	0.06872369766235352
sim_compute_performance-ego_mean	0.06309270804875154
sim_compute_performance-ego_median	0.06549559593200684
sim_compute_performance-ego_min	0.05523999806108146
sim_compute_robot_state-ego_max	0.06947648048400878
sim_compute_robot_state-ego_mean	0.0637817110076497
sim_compute_robot_state-ego_median	0.061773107897850774
sim_compute_robot_state-ego_min	0.05762530195301976
sim_compute_robot_state-npc0_max	0.06150925636291504
sim_compute_robot_state-npc0_mean	0.05865368353829899
sim_compute_robot_state-npc0_median	0.05871463775634766
sim_compute_robot_state-npc0_min	0.05541341058139143
sim_compute_robot_state-npc1_max	0.06448228128494755
sim_compute_robot_state-npc1_mean	0.059269648879733315
sim_compute_robot_state-npc1_median	0.0584321403503418
sim_compute_robot_state-npc1_min	0.05409524358552078
sim_compute_robot_state-npc2_max	0.07823272705078126
sim_compute_robot_state-npc2_mean	0.06339981043882445
sim_compute_robot_state-npc2_median	0.06321731567382813
sim_compute_robot_state-npc2_min	0.05291151178294215
sim_compute_robot_state-npc3_max	0.06453443527221679
sim_compute_robot_state-npc3_mean	0.059687191985472954
sim_compute_robot_state-npc3_median	0.05802345275878906
sim_compute_robot_state-npc3_min	0.05625212603601916
sim_compute_sim_state_max	0.041358718872070314
sim_compute_sim_state_mean	0.035628519499527334
sim_compute_sim_state_median	0.03521781582986155
sim_compute_sim_state_min	0.02971103273589035
sim_physics_max	0.039642868041992185
sim_physics_mean	0.037784503136911694
sim_physics_median	0.038490676879882814
sim_physics_min	0.03419160842895508
sim_render-ego_max	0.06129412651062012
sim_render-ego_mean	0.05808132122833286
sim_render-ego_median	0.05879673957824707
sim_render-ego_min	0.05394130739672431
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.3500000000000003
survival_time_min	1.2500000000000004

No reset possible

19648

2396

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-24 16:20:01+00:00

2019-04-24 16:27:04+00:00

0:07:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14306644418022849
agent_compute-ego_mean	0.13136509075791747
agent_compute-ego_median	0.13359081745147705
agent_compute-ego_min	0.11384590996636285
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03674843176355902, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06299966686176804, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14053225067426572, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09893179389665711, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03962481246804291, "sim_compute_performance-ego": 0.06982679187126879, "sim_compute_robot_state-ego": 0.07424966344293558, "sim_compute_robot_state-npc0": 0.06931086756148429, "sim_compute_robot_state-npc1": 0.06911182853410829, "sim_compute_robot_state-npc2": 0.06992453449177292, "sim_compute_robot_state-npc3": 0.06986438553288297}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03927256844260476, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06300564245744185, "in-drivable-lane": 0, "agent_compute-ego": 0.14306644418022849, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.10127013379877264, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03846266052939675, "sim_compute_performance-ego": 0.06925657120617953, "sim_compute_robot_state-ego": 0.07265120202844794, "sim_compute_robot_state-npc0": 0.0662277720191262, "sim_compute_robot_state-npc1": 0.06877989118749445, "sim_compute_robot_state-npc2": 0.06740934198552911, "sim_compute_robot_state-npc3": 0.06940401684154164}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.034834935930040146, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.052011293835110134, "in-drivable-lane": 0, "agent_compute-ego": 0.11384590996636285, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07446012496948243, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03442177242702908, "sim_compute_performance-ego": 0.05899817678663466, "sim_compute_robot_state-ego": 0.05986049440171984, "sim_compute_robot_state-npc0": 0.05677183469136556, "sim_compute_robot_state-npc1": 0.05539836353725857, "sim_compute_robot_state-npc2": 0.06183187696668837, "sim_compute_robot_state-npc3": 0.058574644724527995}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03669999539852142, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06047139565149943, "in-drivable-lane": 0, "agent_compute-ego": 0.13359081745147705, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09450302024682362, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03587323923905691, "sim_compute_performance-ego": 0.0661494384209315, "sim_compute_robot_state-ego": 0.06999600927035014, "sim_compute_robot_state-npc0": 0.06694420675436656, "sim_compute_robot_state-npc1": 0.06550660232702891, "sim_compute_robot_state-npc2": 0.06617230176925659, "sim_compute_robot_state-npc3": 0.0639414091904958}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.0359688681714675, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05769088338403141, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1257900315172532, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08402392092873068, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03569121571148143, "sim_compute_performance-ego": 0.06438614691005033, "sim_compute_robot_state-ego": 0.06591010093688965, "sim_compute_robot_state-npc0": 0.0615302184048821, "sim_compute_robot_state-npc1": 0.06342420858495376, "sim_compute_robot_state-npc2": 0.06511848113116096, "sim_compute_robot_state-npc3": 0.06311486749088063}}
set_robot_commands_max	0.10127013379877264
set_robot_commands_mean	0.09063779876809328
set_robot_commands_median	0.09450302024682362
set_robot_commands_min	0.07446012496948243
sim_compute_performance-ego_max	0.06982679187126879
sim_compute_performance-ego_mean	0.06572342503901298
sim_compute_performance-ego_median	0.0661494384209315
sim_compute_performance-ego_min	0.05899817678663466
sim_compute_robot_state-ego_max	0.07424966344293558
sim_compute_robot_state-ego_mean	0.06853349401606863
sim_compute_robot_state-ego_median	0.06999600927035014
sim_compute_robot_state-ego_min	0.05986049440171984
sim_compute_robot_state-npc0_max	0.06931086756148429
sim_compute_robot_state-npc0_mean	0.06415697988624494
sim_compute_robot_state-npc0_median	0.0662277720191262
sim_compute_robot_state-npc0_min	0.05677183469136556
sim_compute_robot_state-npc1_max	0.06911182853410829
sim_compute_robot_state-npc1_mean	0.0644441788341688
sim_compute_robot_state-npc1_median	0.06550660232702891
sim_compute_robot_state-npc1_min	0.05539836353725857
sim_compute_robot_state-npc2_max	0.06992453449177292
sim_compute_robot_state-npc2_mean	0.0660913072688816
sim_compute_robot_state-npc2_median	0.06617230176925659
sim_compute_robot_state-npc2_min	0.06183187696668837
sim_compute_robot_state-npc3_max	0.06986438553288297
sim_compute_robot_state-npc3_mean	0.0649798647560658
sim_compute_robot_state-npc3_median	0.0639414091904958
sim_compute_robot_state-npc3_min	0.058574644724527995
sim_compute_sim_state_max	0.03962481246804291
sim_compute_sim_state_mean	0.03681474007500142
sim_compute_sim_state_median	0.03587323923905691
sim_compute_sim_state_min	0.03442177242702908
sim_physics_max	0.03927256844260476
sim_physics_mean	0.03670495994123857
sim_physics_median	0.03669999539852142
sim_physics_min	0.034834935930040146
sim_render-ego_max	0.06300564245744185
sim_render-ego_mean	0.05923577643797016
sim_render-ego_median	0.06047139565149943
sim_render-ego_min	0.052011293835110134
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

19643

2402

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 16:15:34+00:00

2019-04-24 16:19:29+00:00

0:03:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08492193121757197
survival_time_median	1.6000000000000008
deviation-center-line_median	0.04047131326855923
in-drivable-lane_median	0.4500000000000004

other stats

agent_compute-ego_max	0.1532876193523407
agent_compute-ego_mean	0.144197402161596
agent_compute-ego_median	0.15041863918304443
agent_compute-ego_min	0.12983831763267517
deviation-center-line_max	0.06323798023688433
deviation-center-line_mean	0.0411624676192234
deviation-center-line_min	0.02761926099697487
deviation-heading_max	0.7658443133567573
deviation-heading_mean	0.6634207916627506
deviation-heading_median	0.6778769415970717
deviation-heading_min	0.5717939884405085
driven_any_max	0.1731768692365331
driven_any_mean	0.16356190856677807
driven_any_median	0.16816192489901793
driven_any_min	0.14034267280127663
driven_lanedir_consec_max	0.11082361771286696
driven_lanedir_consec_mean	0.08243654375507274
driven_lanedir_consec_min	0.06419128603762214
driven_lanedir_max	0.11082361771286696
driven_lanedir_mean	0.08243654375507274
driven_lanedir_median	0.08492193121757197
driven_lanedir_min	0.06419128603762214
in-drivable-lane_max	0.5500000000000005
in-drivable-lane_mean	0.3300000000000003
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1641730791400888, "sim_physics": 0.021698199212551117, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06419128603762214, "sim_render-ego": 0.05543065071105957, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1532876193523407, "deviation-heading": 0.5717939884405085, "set_robot_commands": 0.08599427342414856, "deviation-center-line": 0.02761926099697487, "driven_lanedir_consec": 0.06419128603762214, "sim_compute_sim_state": 0.033538468182086945, "sim_compute_performance-ego": 0.05995906889438629, "sim_compute_robot_state-ego": 0.06365696340799332}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.14034267280127663, "sim_physics": 0.019423714050879844, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0648393400853875, "sim_render-ego": 0.04821530672220083, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.15041863918304443, "deviation-heading": 0.6847051978882199, "set_robot_commands": 0.08037227850693923, "deviation-center-line": 0.04047131326855923, "driven_lanedir_consec": 0.0648393400853875, "sim_compute_sim_state": 0.032190222006577715, "sim_compute_performance-ego": 0.053807707933279186, "sim_compute_robot_state-ego": 0.05404918010418232}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16816192489901793, "sim_physics": 0.019287824630737305, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11082361771286696, "sim_render-ego": 0.05303016992715689, "in-drivable-lane": 0, "agent_compute-ego": 0.13591454579279974, "deviation-heading": 0.7658443133567573, "set_robot_commands": 0.07834081466381367, "deviation-center-line": 0.06323798023688433, "driven_lanedir_consec": 0.11082361771286696, "sim_compute_sim_state": 0.03210087922903208, "sim_compute_performance-ego": 0.05599871048560509, "sim_compute_robot_state-ego": 0.05688757162827712}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.171954996756974, "sim_physics": 0.016935959458351135, "survival_time": 1.6000000000000008, "driven_lanedir": 0.08492193121757197, "sim_render-ego": 0.049571216106414795, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.12983831763267517, "deviation-heading": 0.6168835170311953, "set_robot_commands": 0.07366987317800522, "deviation-center-line": 0.033820220888341884, "driven_lanedir_consec": 0.08492193121757197, "sim_compute_sim_state": 0.03187718987464905, "sim_compute_performance-ego": 0.053866975009441376, "sim_compute_robot_state-ego": 0.05505920201539993}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1731768692365331, "sim_physics": 0.020201365152994793, "survival_time": 1.6500000000000008, "driven_lanedir": 0.08740654372191514, "sim_render-ego": 0.0567175547281901, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.15152788884711987, "deviation-heading": 0.6778769415970717, "set_robot_commands": 0.08216637553590717, "deviation-center-line": 0.04066356270535671, "driven_lanedir_consec": 0.08740654372191514, "sim_compute_sim_state": 0.03233018065943862, "sim_compute_performance-ego": 0.06476619026877663, "sim_compute_robot_state-ego": 0.06509987513224284}}
set_robot_commands_max	0.08599427342414856
set_robot_commands_mean	0.08010872306176277
set_robot_commands_median	0.08037227850693923
set_robot_commands_min	0.07366987317800522
sim_compute_performance-ego_max	0.06476619026877663
sim_compute_performance-ego_mean	0.05767973051829771
sim_compute_performance-ego_median	0.05599871048560509
sim_compute_performance-ego_min	0.053807707933279186
sim_compute_robot_state-ego_max	0.06509987513224284
sim_compute_robot_state-ego_mean	0.05895055845761911
sim_compute_robot_state-ego_median	0.05688757162827712
sim_compute_robot_state-ego_min	0.05404918010418232
sim_compute_sim_state_max	0.033538468182086945
sim_compute_sim_state_mean	0.03240738799035688
sim_compute_sim_state_median	0.032190222006577715
sim_compute_sim_state_min	0.03187718987464905
sim_physics_max	0.021698199212551117
sim_physics_mean	0.019509412501102837
sim_physics_median	0.019423714050879844
sim_physics_min	0.016935959458351135
sim_render-ego_max	0.0567175547281901
sim_render-ego_mean	0.052592979639004445
sim_render-ego_median	0.05303016992715689
sim_render-ego_min	0.04821530672220083
simulation-passed	1
survival_time_max	1.6500000000000008
survival_time_mean	1.4900000000000009
survival_time_min	1.3000000000000005

No reset possible

19638

2407

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 16:08:16+00:00

2019-04-24 16:14:52+00:00

0:06:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07352595937458739
survival_time_median	1.4000000000000006
deviation-center-line_median	0.036565127133427806
in-drivable-lane_median	0.2500000000000002

other stats

agent_compute-ego_max	0.17285490036010742
agent_compute-ego_mean	0.16273224723407936
agent_compute-ego_median	0.16565311366114124
agent_compute-ego_min	0.15246103749130713
deviation-center-line_max	0.06075655371320272
deviation-center-line_mean	0.04406530117770814
deviation-center-line_min	0.03163391460687781
deviation-heading_max	0.7821920502764297
deviation-heading_mean	0.6837295398858825
deviation-heading_median	0.6614317553901323
deviation-heading_min	0.6459642807636419
driven_any_max	0.17299020554112382
driven_any_mean	0.15739649805037229
driven_any_median	0.15188955081281677
driven_any_min	0.14639805745024265
driven_lanedir_consec_max	0.12316341925549644
driven_lanedir_consec_mean	0.08427649195387751
driven_lanedir_consec_min	0.059086678450648744
driven_lanedir_max	0.12316341925549644
driven_lanedir_mean	0.08427649195387751
driven_lanedir_median	0.07352595937458739
driven_lanedir_min	0.059086678450648744
in-drivable-lane_max	0.5000000000000004
in-drivable-lane_mean	0.2100000000000002
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.14639805745024265, "sim_physics": 0.03566133124487741, "survival_time": 1.4000000000000006, "driven_lanedir": 0.07105923378072876, "sim_render-ego": 0.057178190776279995, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.15443525995526994, "deviation-heading": 0.6459642807636419, "set_robot_commands": 0.07956764527729579, "deviation-center-line": 0.03308414859671183, "driven_lanedir_consec": 0.07105923378072876, "sim_compute_sim_state": 0.0329518233026777, "sim_compute_performance-ego": 0.06102927242006574, "sim_compute_robot_state-ego": 0.06159701517650059, "sim_compute_robot_state-npc0": 0.05648376260484968, "sim_compute_robot_state-npc1": 0.05801723684583392, "sim_compute_robot_state-npc2": 0.05931401252746582, "sim_compute_robot_state-npc3": 0.06028121709823608}, "udem1-1-0": {"driven_any": 0.15188955081281677, "sim_physics": 0.044916519751915567, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09454716890792624, "sim_render-ego": 0.06644565325516921, "in-drivable-lane": 0, "agent_compute-ego": 0.17285490036010742, "deviation-heading": 0.7821920502764297, "set_robot_commands": 0.09412860870361328, "deviation-center-line": 0.05828676183832053, "driven_lanedir_consec": 0.09454716890792624, "sim_compute_sim_state": 0.038356441717881426, "sim_compute_performance-ego": 0.06836111728961651, "sim_compute_robot_state-ego": 0.07498682462252103, "sim_compute_robot_state-npc0": 0.06473258825448844, "sim_compute_robot_state-npc1": 0.06651090658628024, "sim_compute_robot_state-npc2": 0.06394125865055965, "sim_compute_robot_state-npc3": 0.06672311746157132}, "udem1-2-0": {"driven_any": 0.16883063527038575, "sim_physics": 0.04873623297764705, "survival_time": 1.3000000000000005, "driven_lanedir": 0.12316341925549644, "sim_render-ego": 0.06204793086418739, "in-drivable-lane": 0, "agent_compute-ego": 0.16825692470257098, "deviation-heading": 0.6614317553901323, "set_robot_commands": 0.09199010408841649, "deviation-center-line": 0.06075655371320272, "driven_lanedir_consec": 0.12316341925549644, "sim_compute_sim_state": 0.038558134665856, "sim_compute_performance-ego": 0.0666960386129526, "sim_compute_robot_state-ego": 0.07468640804290771, "sim_compute_robot_state-npc0": 0.06521843946897067, "sim_compute_robot_state-npc1": 0.06694896404559796, "sim_compute_robot_state-npc2": 0.06711346369523269, "sim_compute_robot_state-npc3": 0.0659259741122906}, "udem1-3-0": {"driven_any": 0.17299020554112382, "sim_physics": 0.04111141147035541, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07352595937458739, "sim_render-ego": 0.06071868087306167, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15246103749130713, "deviation-heading": 0.6473288481615646, "set_robot_commands": 0.08112966653072473, "deviation-center-line": 0.036565127133427806, "driven_lanedir_consec": 0.07352595937458739, "sim_compute_sim_state": 0.033598227934403854, "sim_compute_performance-ego": 0.06526172522342566, "sim_compute_robot_state-ego": 0.0703668449864243, "sim_compute_robot_state-npc0": 0.05730098666566791, "sim_compute_robot_state-npc1": 0.058237798286206795, "sim_compute_robot_state-npc2": 0.062255303064982094, "sim_compute_robot_state-npc3": 0.0590965242096872}, "udem1-4-0": {"driven_any": 0.1468740411772924, "sim_physics": 0.035894985856681036, "survival_time": 1.4500000000000006, "driven_lanedir": 0.059086678450648744, "sim_render-ego": 0.05946111679077149, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.16565311366114124, "deviation-heading": 0.6817307648376438, "set_robot_commands": 0.08674279574690194, "deviation-center-line": 0.03163391460687781, "driven_lanedir_consec": 0.059086678450648744, "sim_compute_sim_state": 0.037848151963332605, "sim_compute_performance-ego": 0.06417946979917329, "sim_compute_robot_state-ego": 0.06867230349573596, "sim_compute_robot_state-npc0": 0.06036926137989965, "sim_compute_robot_state-npc1": 0.05967262695575583, "sim_compute_robot_state-npc2": 0.06051054494134311, "sim_compute_robot_state-npc3": 0.0644403572740226}}
set_robot_commands_max	0.09412860870361328
set_robot_commands_mean	0.08671176406939045
set_robot_commands_median	0.08674279574690194
set_robot_commands_min	0.07956764527729579
sim_compute_performance-ego_max	0.06836111728961651
sim_compute_performance-ego_mean	0.06510552466904676
sim_compute_performance-ego_median	0.06526172522342566
sim_compute_performance-ego_min	0.06102927242006574
sim_compute_robot_state-ego_max	0.07498682462252103
sim_compute_robot_state-ego_mean	0.07006187926481791
sim_compute_robot_state-ego_median	0.0703668449864243
sim_compute_robot_state-ego_min	0.06159701517650059
sim_compute_robot_state-npc0_max	0.06521843946897067
sim_compute_robot_state-npc0_mean	0.060821007674775274
sim_compute_robot_state-npc0_median	0.06036926137989965
sim_compute_robot_state-npc0_min	0.05648376260484968
sim_compute_robot_state-npc1_max	0.06694896404559796
sim_compute_robot_state-npc1_mean	0.061877506543934944
sim_compute_robot_state-npc1_median	0.05967262695575583
sim_compute_robot_state-npc1_min	0.05801723684583392
sim_compute_robot_state-npc2_max	0.06711346369523269
sim_compute_robot_state-npc2_mean	0.06262691657591668
sim_compute_robot_state-npc2_median	0.062255303064982094
sim_compute_robot_state-npc2_min	0.05931401252746582
sim_compute_robot_state-npc3_max	0.06672311746157132
sim_compute_robot_state-npc3_mean	0.06329343803116157
sim_compute_robot_state-npc3_median	0.0644403572740226
sim_compute_robot_state-npc3_min	0.0590965242096872
sim_compute_sim_state_max	0.038558134665856
sim_compute_sim_state_mean	0.036262555916830315
sim_compute_sim_state_median	0.037848151963332605
sim_compute_sim_state_min	0.0329518233026777
sim_physics_max	0.04873623297764705
sim_physics_mean	0.04126409626029529
sim_physics_median	0.04111141147035541
sim_physics_min	0.03566133124487741
sim_render-ego_max	0.06644565325516921
sim_render-ego_mean	0.061170314511893954
sim_render-ego_median	0.06071868087306167
sim_render-ego_min	0.057178190776279995
simulation-passed	1
survival_time_max	1.6500000000000008
survival_time_mean	1.4200000000000006
survival_time_min	1.3000000000000005

No reset possible

19619

2442

Jacopo Tani

random_agent

step1-simulation

success

2019-04-24 16:00:18+00:00

2019-04-24 16:07:27+00:00

0:07:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14925693968931833
agent_compute-ego_mean	0.14235806172991344
agent_compute-ego_median	0.1442988077799479
agent_compute-ego_min	0.13156908750534058
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03271878890271457, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05795336669346072, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14222883728315244, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08896573084705281, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03449097669349527, "sim_compute_performance-ego": 0.06236466821634545, "sim_compute_robot_state-ego": 0.0646133062974462, "sim_compute_robot_state-npc0": 0.0626468928355091, "sim_compute_robot_state-npc1": 0.06363448556864036, "sim_compute_robot_state-npc2": 0.06186302203052449, "sim_compute_robot_state-npc3": 0.06028572568353617}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03358070416883989, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.05092114210128784, "in-drivable-lane": 0, "agent_compute-ego": 0.13156908750534058, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07805815610018643, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.031237699768759987, "sim_compute_performance-ego": 0.056217816742983734, "sim_compute_robot_state-ego": 0.06114784695885398, "sim_compute_robot_state-npc0": 0.0580905404957858, "sim_compute_robot_state-npc1": 0.05913235924460671, "sim_compute_robot_state-npc2": 0.05482957579872825, "sim_compute_robot_state-npc3": 0.05641187321056019}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03411298857794868, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.05841662089029948, "in-drivable-lane": 0, "agent_compute-ego": 0.1442988077799479, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.08601077927483453, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03454842567443848, "sim_compute_performance-ego": 0.06377130614386664, "sim_compute_robot_state-ego": 0.0656983216603597, "sim_compute_robot_state-npc0": 0.06165323257446289, "sim_compute_robot_state-npc1": 0.06196651988559299, "sim_compute_robot_state-npc2": 0.05998071034749349, "sim_compute_robot_state-npc3": 0.060717036989000106}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03642664353052775, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05858939389387766, "in-drivable-lane": 0, "agent_compute-ego": 0.14925693968931833, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09240009387334187, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.036046514908472695, "sim_compute_performance-ego": 0.06446382900079091, "sim_compute_robot_state-ego": 0.06685233116149902, "sim_compute_robot_state-npc0": 0.06401041646798451, "sim_compute_robot_state-npc1": 0.06565227111180623, "sim_compute_robot_state-npc2": 0.06337878108024597, "sim_compute_robot_state-npc3": 0.062003945310910545}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03491694085738238, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05990275915931253, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.144436636391808, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.090208979213939, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03586452848771039, "sim_compute_performance-ego": 0.06501562455121208, "sim_compute_robot_state-ego": 0.07087748541551478, "sim_compute_robot_state-npc0": 0.06448646152720731, "sim_compute_robot_state-npc1": 0.06441779697642606, "sim_compute_robot_state-npc2": 0.06283769537420834, "sim_compute_robot_state-npc3": 0.06399126964456894}}
set_robot_commands_max	0.09240009387334187
set_robot_commands_mean	0.08712874786187093
set_robot_commands_median	0.08896573084705281
set_robot_commands_min	0.07805815610018643
sim_compute_performance-ego_max	0.06501562455121208
sim_compute_performance-ego_mean	0.06236664893103976
sim_compute_performance-ego_median	0.06377130614386664
sim_compute_performance-ego_min	0.056217816742983734
sim_compute_robot_state-ego_max	0.07087748541551478
sim_compute_robot_state-ego_mean	0.06583785829873474
sim_compute_robot_state-ego_median	0.0656983216603597
sim_compute_robot_state-ego_min	0.06114784695885398
sim_compute_robot_state-npc0_max	0.06448646152720731
sim_compute_robot_state-npc0_mean	0.062177508780189926
sim_compute_robot_state-npc0_median	0.0626468928355091
sim_compute_robot_state-npc0_min	0.0580905404957858
sim_compute_robot_state-npc1_max	0.06565227111180623
sim_compute_robot_state-npc1_mean	0.06296068655741446
sim_compute_robot_state-npc1_median	0.06363448556864036
sim_compute_robot_state-npc1_min	0.05913235924460671
sim_compute_robot_state-npc2_max	0.06337878108024597
sim_compute_robot_state-npc2_mean	0.06057795692624011
sim_compute_robot_state-npc2_median	0.06186302203052449
sim_compute_robot_state-npc2_min	0.05482957579872825
sim_compute_robot_state-npc3_max	0.06399126964456894
sim_compute_robot_state-npc3_mean	0.06068197016771519
sim_compute_robot_state-npc3_median	0.060717036989000106
sim_compute_robot_state-npc3_min	0.05641187321056019
sim_compute_sim_state_max	0.036046514908472695
sim_compute_sim_state_mean	0.034437629106575364
sim_compute_sim_state_median	0.03454842567443848
sim_compute_sim_state_min	0.031237699768759987
sim_physics_max	0.03642664353052775
sim_physics_mean	0.034351213207482655
sim_physics_median	0.03411298857794868
sim_physics_min	0.03271878890271457
sim_render-ego_max	0.05990275915931253
sim_render-ego_mean	0.05715665654764764
sim_render-ego_median	0.05841662089029948
sim_render-ego_min	0.05092114210128784
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

19596

2443

Jacopo Tani

random_agent

step1-simulation

host-error

2019-04-24 15:52:50+00:00

2019-04-24 16:00:04+00:00

0:07:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19596-828770', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19596-828770', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19596-828770', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19565

2496

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-24 15:46:18+00:00

2019-04-24 15:52:22+00:00

0:06:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.04662267338446835
survival_time_median	1.5500000000000007
deviation-center-line_median	0.018961752439404744
in-drivable-lane_median	0.5000000000000004

other stats

agent_compute-ego_max	0.1829051449894905
agent_compute-ego_mean	0.1696026774798641
agent_compute-ego_median	0.16712457338968914
agent_compute-ego_min	0.1521736313314999
deviation-center-line_max	0.038252581229664864
deviation-center-line_mean	0.023088778308531503
deviation-center-line_min	0.015256595769235704
deviation-heading_max	0.7001010249688102
deviation-heading_mean	0.6068980514077829
deviation-heading_median	0.5833748326687554
deviation-heading_min	0.5634437112992522
driven_any_max	0.16557716051361648
driven_any_mean	0.14961490836187422
driven_any_median	0.1487951674120721
driven_any_min	0.13789796068545396
driven_lanedir_consec_max	0.06449099336014896
driven_lanedir_consec_mean	0.04822203091473014
driven_lanedir_consec_min	0.03317686069661452
driven_lanedir_max	0.06449099336014896
driven_lanedir_mean	0.04822203091473014
driven_lanedir_median	0.04662267338446835
driven_lanedir_min	0.03317686069661452
in-drivable-lane_max	0.7000000000000006
in-drivable-lane_mean	0.4800000000000004
in-drivable-lane_min	0.15000000000000013
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16557716051361648, "sim_physics": 0.036881439147457, "survival_time": 1.5500000000000007, "driven_lanedir": 0.061099079193532635, "sim_render-ego": 0.05789721396661574, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.17884640539846114, "deviation-heading": 0.620090188024345, "set_robot_commands": 0.09551590488803002, "deviation-center-line": 0.02705293772111151, "driven_lanedir_consec": 0.061099079193532635, "sim_compute_sim_state": 0.0362260187825849, "sim_compute_performance-ego": 0.06060024230710922, "sim_compute_robot_state-ego": 0.06927836325860792, "sim_compute_robot_state-npc0": 0.06516356622019122, "sim_compute_robot_state-npc1": 0.061854247123964375, "sim_compute_robot_state-npc2": 0.0628644420254615, "sim_compute_robot_state-npc3": 0.06180284869286322}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15273028866645574, "sim_physics": 0.03516733646392822, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04662267338446835, "sim_render-ego": 0.05611596902211507, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16712457338968914, "deviation-heading": 0.5634437112992522, "set_robot_commands": 0.09081899325052896, "deviation-center-line": 0.018961752439404744, "driven_lanedir_consec": 0.04662267338446835, "sim_compute_sim_state": 0.03596353530883789, "sim_compute_performance-ego": 0.06452573935190836, "sim_compute_robot_state-ego": 0.07698424657185872, "sim_compute_robot_state-npc0": 0.0654444138209025, "sim_compute_robot_state-npc1": 0.06468587716420492, "sim_compute_robot_state-npc2": 0.060731395085652666, "sim_compute_robot_state-npc3": 0.06087950865427653}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13789796068545396, "sim_physics": 0.03401758120610164, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06449099336014896, "sim_render-ego": 0.05988155878507174, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1669636322901799, "deviation-heading": 0.7001010249688102, "set_robot_commands": 0.0940476105763362, "deviation-center-line": 0.038252581229664864, "driven_lanedir_consec": 0.06449099336014896, "sim_compute_sim_state": 0.035723044322087213, "sim_compute_performance-ego": 0.06512146729689378, "sim_compute_robot_state-ego": 0.07006544333237869, "sim_compute_robot_state-npc0": 0.06202271351447472, "sim_compute_robot_state-npc1": 0.0617368221282959, "sim_compute_robot_state-npc2": 0.06471527539766751, "sim_compute_robot_state-npc3": 0.06520672027881329}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1487951674120721, "sim_physics": 0.042608387768268585, "survival_time": 1.6000000000000008, "driven_lanedir": 0.03572054793888624, "sim_render-ego": 0.06343346834182739, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1829051449894905, "deviation-heading": 0.5674805000777516, "set_robot_commands": 0.09271355718374252, "deviation-center-line": 0.015256595769235704, "driven_lanedir_consec": 0.03572054793888624, "sim_compute_sim_state": 0.03931199759244919, "sim_compute_performance-ego": 0.06787806749343872, "sim_compute_robot_state-ego": 0.06928366422653198, "sim_compute_robot_state-npc0": 0.06765881925821304, "sim_compute_robot_state-npc1": 0.06568948179483414, "sim_compute_robot_state-npc2": 0.06636974960565567, "sim_compute_robot_state-npc3": 0.0672554075717926}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14307396453177262, "sim_physics": 0.0277175973443424, "survival_time": 1.7000000000000008, "driven_lanedir": 0.03317686069661452, "sim_render-ego": 0.04664815173429601, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1521736313314999, "deviation-heading": 0.5833748326687554, "set_robot_commands": 0.23693689879249125, "deviation-center-line": 0.015920024383240697, "driven_lanedir_consec": 0.03317686069661452, "sim_compute_sim_state": 0.033724308013916016, "sim_compute_performance-ego": 0.05328230998095344, "sim_compute_robot_state-ego": 0.15543721703922048, "sim_compute_robot_state-npc0": 0.05939350408666274, "sim_compute_robot_state-npc1": 0.10398699255550609, "sim_compute_robot_state-npc2": 0.05360160855685964, "sim_compute_robot_state-npc3": 0.0525134240879732}}
set_robot_commands_max	0.23693689879249125
set_robot_commands_mean	0.1220065929382258
set_robot_commands_median	0.0940476105763362
set_robot_commands_min	0.09081899325052896
sim_compute_performance-ego_max	0.06787806749343872
sim_compute_performance-ego_mean	0.062281565286060714
sim_compute_performance-ego_median	0.06452573935190836
sim_compute_performance-ego_min	0.05328230998095344
sim_compute_robot_state-ego_max	0.15543721703922048
sim_compute_robot_state-ego_mean	0.08820978688571955
sim_compute_robot_state-ego_median	0.07006544333237869
sim_compute_robot_state-ego_min	0.06927836325860792
sim_compute_robot_state-npc0_max	0.06765881925821304
sim_compute_robot_state-npc0_mean	0.06393660338008884
sim_compute_robot_state-npc0_median	0.06516356622019122
sim_compute_robot_state-npc0_min	0.05939350408666274
sim_compute_robot_state-npc1_max	0.10398699255550609
sim_compute_robot_state-npc1_mean	0.07159068415336109
sim_compute_robot_state-npc1_median	0.06468587716420492
sim_compute_robot_state-npc1_min	0.0617368221282959
sim_compute_robot_state-npc2_max	0.06636974960565567
sim_compute_robot_state-npc2_mean	0.0616564941342594
sim_compute_robot_state-npc2_median	0.0628644420254615
sim_compute_robot_state-npc2_min	0.05360160855685964
sim_compute_robot_state-npc3_max	0.0672554075717926
sim_compute_robot_state-npc3_mean	0.06153158185714377
sim_compute_robot_state-npc3_median	0.06180284869286322
sim_compute_robot_state-npc3_min	0.0525134240879732
sim_compute_sim_state_max	0.03931199759244919
sim_compute_sim_state_mean	0.03618978080397504
sim_compute_sim_state_median	0.03596353530883789
sim_compute_sim_state_min	0.033724308013916016
sim_physics_max	0.042608387768268585
sim_physics_mean	0.03527846838601957
sim_physics_median	0.03516733646392822
sim_physics_min	0.0277175973443424
sim_render-ego_max	0.06343346834182739
sim_render-ego_mean	0.05679527236998518
sim_render-ego_median	0.05789721396661574
sim_render-ego_min	0.04664815173429601
simulation-passed	1
survival_time_max	1.7000000000000008
survival_time_mean	1.5300000000000007
survival_time_min	1.3000000000000005

No reset possible

19562

2502

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

aido2-LF-sim-validation

2019-04-24 15:45:38+00:00

2019-04-24 15:46:11+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19549

2517

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 15:44:23+00:00

2019-04-24 15:45:21+00:00

0:00:58

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19536

2525

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 15:42:56+00:00

2019-04-24 15:44:16+00:00

0:01:20

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19530

2541

jiang peng

test for ppo

step1-simulation

error

2019-04-24 15:40:10+00:00

2019-04-24 15:42:49+00:00

0:02:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19500

2594

Julian Zilly

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-24 15:25:47+00:00

2019-04-24 15:39:40+00:00

0:13:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24073764025639344
survival_time_median	5.1999999999999895
deviation-center-line_median	0.27670607193598756
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2485482020811601
agent_compute-ego_mean	0.2349812493199208
agent_compute-ego_median	0.2364305487045875
agent_compute-ego_min	0.22087283929189047
deviation-center-line_max	0.28643037021296436
deviation-center-line_mean	0.26520112902884185
deviation-center-line_min	0.2384963861546218
deviation-heading_max	2.148985386562897
deviation-heading_mean	2.0187194965647075
deviation-heading_median	2.011142358203198
deviation-heading_min	1.9326428004671232
driven_any_max	0.3109462482407973
driven_any_mean	0.2838833819216867
driven_any_median	0.2787580190109273
driven_any_min	0.27010606949992355
driven_lanedir_consec_max	0.27423395408196116
driven_lanedir_consec_mean	0.2463457415303408
driven_lanedir_consec_min	0.23164364280397495
driven_lanedir_max	0.27423395408196116
driven_lanedir_mean	0.2463457415303408
driven_lanedir_median	0.24073764025639344
driven_lanedir_min	0.23164364280397495
in-drivable-lane_max	0.04999999999999982
in-drivable-lane_mean	0.009999999999999964
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.3109462482407973, "sim_physics": 0.04679970741271973, "survival_time": 5.4999999999999885, "driven_lanedir": 0.27423395408196116, "sim_render-ego": 0.06301378987052224, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2485482020811601, "deviation-heading": 1.9326428004671232, "set_robot_commands": 0.10183928663080388, "deviation-center-line": 0.2851367749245611, "driven_lanedir_consec": 0.27423395408196116, "sim_compute_sim_state": 0.04049378308382901, "sim_compute_performance-ego": 0.06965294317765669, "sim_compute_robot_state-ego": 0.07379932403564453, "sim_compute_robot_state-npc0": 0.07208735075863924, "sim_compute_robot_state-npc1": 0.07193434888666327, "sim_compute_robot_state-npc2": 0.07226578972556374, "sim_compute_robot_state-npc3": 0.07112856994975697}, "udem1-1-0": {"driven_any": 0.2787580190109273, "sim_physics": 0.04530667570921091, "survival_time": 5.1999999999999895, "driven_lanedir": 0.24073764025639344, "sim_render-ego": 0.06477254399886498, "in-drivable-lane": 0, "agent_compute-ego": 0.2364305487045875, "deviation-heading": 1.9590539193263243, "set_robot_commands": 0.10079190593499404, "deviation-center-line": 0.2384963861546218, "driven_lanedir_consec": 0.24073764025639344, "sim_compute_sim_state": 0.04128448321269109, "sim_compute_performance-ego": 0.06883759681995098, "sim_compute_robot_state-ego": 0.07355885093028729, "sim_compute_robot_state-npc0": 0.06987036649997418, "sim_compute_robot_state-npc1": 0.06997039226385263, "sim_compute_robot_state-npc2": 0.07123855902598454, "sim_compute_robot_state-npc3": 0.07082184002949642}, "udem1-2-0": {"driven_any": 0.27701957426965185, "sim_physics": 0.04892596226294064, "survival_time": 5.14999999999999, "driven_lanedir": 0.23856564102972877, "sim_render-ego": 0.06036360518446247, "in-drivable-lane": 0, "agent_compute-ego": 0.23056709650650764, "deviation-heading": 2.148985386562897, "set_robot_commands": 0.09642027882696357, "deviation-center-line": 0.28643037021296436, "driven_lanedir_consec": 0.23856564102972877, "sim_compute_sim_state": 0.03814240798209478, "sim_compute_performance-ego": 0.06458881526317412, "sim_compute_robot_state-ego": 0.06928028180761245, "sim_compute_robot_state-npc0": 0.06596740704138303, "sim_compute_robot_state-npc1": 0.06819986834109408, "sim_compute_robot_state-npc2": 0.06666897801519597, "sim_compute_robot_state-npc3": 0.0675647073579066}, "udem1-3-0": {"driven_any": 0.27010606949992355, "sim_physics": 0.04767480263343224, "survival_time": 5.1999999999999895, "driven_lanedir": 0.23164364280397495, "sim_render-ego": 0.0651985383950747, "in-drivable-lane": 0, "agent_compute-ego": 0.23848756001545832, "deviation-heading": 2.041773018263995, "set_robot_commands": 0.09755855340224046, "deviation-center-line": 0.2392360419160746, "driven_lanedir_consec": 0.23164364280397495, "sim_compute_sim_state": 0.03879937758812538, "sim_compute_performance-ego": 0.06804634745304401, "sim_compute_robot_state-ego": 0.07347269241626446, "sim_compute_robot_state-npc0": 0.06987527012825012, "sim_compute_robot_state-npc1": 0.07170376181602478, "sim_compute_robot_state-npc2": 0.07047148163502033, "sim_compute_robot_state-npc3": 0.06890856990447411}, "udem1-4-0": {"driven_any": 0.2825869985871336, "sim_physics": 0.04445051679424211, "survival_time": 5.09999999999999, "driven_lanedir": 0.24654782947964549, "sim_render-ego": 0.059383324548309926, "in-drivable-lane": 0, "agent_compute-ego": 0.22087283929189047, "deviation-heading": 2.011142358203198, "set_robot_commands": 0.09387368314406452, "deviation-center-line": 0.27670607193598756, "driven_lanedir_consec": 0.24654782947964549, "sim_compute_sim_state": 0.03734233332615273, "sim_compute_performance-ego": 0.06587809674880084, "sim_compute_robot_state-ego": 0.06974436488806032, "sim_compute_robot_state-npc0": 0.06764475738300997, "sim_compute_robot_state-npc1": 0.06875436446245979, "sim_compute_robot_state-npc2": 0.06686292208877265, "sim_compute_robot_state-npc3": 0.06779172140009262}}
set_robot_commands_max	0.10183928663080388
set_robot_commands_mean	0.09809674158781329
set_robot_commands_median	0.09755855340224046
set_robot_commands_min	0.09387368314406452
sim_compute_performance-ego_max	0.06965294317765669
sim_compute_performance-ego_mean	0.06740075989252534
sim_compute_performance-ego_median	0.06804634745304401
sim_compute_performance-ego_min	0.06458881526317412
sim_compute_robot_state-ego_max	0.07379932403564453
sim_compute_robot_state-ego_mean	0.07197110281557381
sim_compute_robot_state-ego_median	0.07347269241626446
sim_compute_robot_state-ego_min	0.06928028180761245
sim_compute_robot_state-npc0_max	0.07208735075863924
sim_compute_robot_state-npc0_mean	0.06908903036225131
sim_compute_robot_state-npc0_median	0.06987036649997418
sim_compute_robot_state-npc0_min	0.06596740704138303
sim_compute_robot_state-npc1_max	0.07193434888666327
sim_compute_robot_state-npc1_mean	0.0701125471540189
sim_compute_robot_state-npc1_median	0.06997039226385263
sim_compute_robot_state-npc1_min	0.06819986834109408
sim_compute_robot_state-npc2_max	0.07226578972556374
sim_compute_robot_state-npc2_mean	0.06950154609810745
sim_compute_robot_state-npc2_median	0.07047148163502033
sim_compute_robot_state-npc2_min	0.06666897801519597
sim_compute_robot_state-npc3_max	0.07112856994975697
sim_compute_robot_state-npc3_mean	0.06924308172834534
sim_compute_robot_state-npc3_median	0.06890856990447411
sim_compute_robot_state-npc3_min	0.0675647073579066
sim_compute_sim_state_max	0.04128448321269109
sim_compute_sim_state_mean	0.039212477038578594
sim_compute_sim_state_median	0.03879937758812538
sim_compute_sim_state_min	0.03734233332615273
sim_physics_max	0.04892596226294064
sim_physics_mean	0.04663153296250912
sim_physics_median	0.04679970741271973
sim_physics_min	0.04445051679424211
sim_render-ego_max	0.0651985383950747
sim_render-ego_mean	0.06254636039944686
sim_render-ego_median	0.06301378987052224
sim_render-ego_min	0.059383324548309926
simulation-passed	1
survival_time_max	5.4999999999999885
survival_time_mean	5.22999999999999
survival_time_min	5.09999999999999

No reset possible

19489

2600

Liam Paull 🇨🇦

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-24 15:22:34+00:00

2019-04-24 15:25:23+00:00

0:02:49

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 136, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 301, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19477

2649

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-24 15:14:59+00:00

2019-04-24 15:22:07+00:00

0:07:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.07111828143780048
agent_compute-ego_mean	0.061446786210574866
agent_compute-ego_median	0.062137788450214226
agent_compute-ego_min	0.05245095177700645
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.03807343934711657, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.050729247143394066, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.058585146853798314, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.0798930519505551, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.031097763463070516, "sim_compute_performance-ego": 0.056433745434409696, "sim_compute_robot_state-ego": 0.05748737234818308, "sim_compute_robot_state-npc0": 0.055841737044484994, "sim_compute_robot_state-npc1": 0.05479042655543277, "sim_compute_robot_state-npc2": 0.05342408481397127, "sim_compute_robot_state-npc3": 0.054724542718184624}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.026576167658755655, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.04543822062642951, "in-drivable-lane": 0, "agent_compute-ego": 0.05245095177700645, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07308949294843171, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.028150363972312527, "sim_compute_performance-ego": 0.04860012782247443, "sim_compute_robot_state-ego": 0.04956570424531635, "sim_compute_robot_state-npc0": 0.049775857674448115, "sim_compute_robot_state-npc1": 0.05000313332206324, "sim_compute_robot_state-npc2": 0.05415757706290797, "sim_compute_robot_state-npc3": 0.048669670757494475}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.045890526893811345, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06359059994037335, "in-drivable-lane": 0, "agent_compute-ego": 0.07111828143780048, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.09910866541740222, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03913574341015938, "sim_compute_performance-ego": 0.09775225321451823, "sim_compute_robot_state-ego": 0.07415111859639485, "sim_compute_robot_state-npc0": 0.07403385944855519, "sim_compute_robot_state-npc1": 0.06927094092735878, "sim_compute_robot_state-npc2": 0.06853990065745819, "sim_compute_robot_state-npc3": 0.07201463136917506}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.04155300368725414, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.05537576070973571, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.062137788450214226, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.08234437754456427, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03194721315948056, "sim_compute_performance-ego": 0.0584890775277581, "sim_compute_robot_state-ego": 0.06223555349967849, "sim_compute_robot_state-npc0": 0.06193326560544296, "sim_compute_robot_state-npc1": 0.060315091845015406, "sim_compute_robot_state-npc2": 0.06075515209789008, "sim_compute_robot_state-npc3": 0.05695692922028018}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.03757200999693437, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.055562463673678314, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06294176253405484, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.08576742085543546, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.035347277467901055, "sim_compute_performance-ego": 0.059992161664095794, "sim_compute_robot_state-ego": 0.06612234223972667, "sim_compute_robot_state-npc0": 0.06025657328692349, "sim_compute_robot_state-npc1": 0.060803521763194694, "sim_compute_robot_state-npc2": 0.061997950077056885, "sim_compute_robot_state-npc3": 0.0637633583762429}}
set_robot_commands_max	0.09910866541740222
set_robot_commands_mean	0.08404060174327774
set_robot_commands_median	0.08234437754456427
set_robot_commands_min	0.07308949294843171
sim_compute_performance-ego_max	0.09775225321451823
sim_compute_performance-ego_mean	0.06425347313265126
sim_compute_performance-ego_median	0.0584890775277581
sim_compute_performance-ego_min	0.04860012782247443
sim_compute_robot_state-ego_max	0.07415111859639485
sim_compute_robot_state-ego_mean	0.06191241818585989
sim_compute_robot_state-ego_median	0.06223555349967849
sim_compute_robot_state-ego_min	0.04956570424531635
sim_compute_robot_state-npc0_max	0.07403385944855519
sim_compute_robot_state-npc0_mean	0.06036825861197095
sim_compute_robot_state-npc0_median	0.06025657328692349
sim_compute_robot_state-npc0_min	0.049775857674448115
sim_compute_robot_state-npc1_max	0.06927094092735878
sim_compute_robot_state-npc1_mean	0.05903662288261298
sim_compute_robot_state-npc1_median	0.060315091845015406
sim_compute_robot_state-npc1_min	0.05000313332206324
sim_compute_robot_state-npc2_max	0.06853990065745819
sim_compute_robot_state-npc2_mean	0.05977493294185687
sim_compute_robot_state-npc2_median	0.06075515209789008
sim_compute_robot_state-npc2_min	0.05342408481397127
sim_compute_robot_state-npc3_max	0.07201463136917506
sim_compute_robot_state-npc3_mean	0.05922582648827544
sim_compute_robot_state-npc3_median	0.05695692922028018
sim_compute_robot_state-npc3_min	0.048669670757494475
sim_compute_sim_state_max	0.03913574341015938
sim_compute_sim_state_mean	0.03313567229458481
sim_compute_sim_state_median	0.03194721315948056
sim_compute_sim_state_min	0.028150363972312527
sim_physics_max	0.045890526893811345
sim_physics_mean	0.03793302951677442
sim_physics_median	0.03807343934711657
sim_physics_min	0.026576167658755655
sim_render-ego_max	0.06359059994037335
sim_render-ego_mean	0.05413925841872218
sim_render-ego_median	0.05537576070973571
sim_render-ego_min	0.04543822062642951
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

19472

2628

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-24 15:09:20+00:00

2019-04-24 15:14:40+00:00

0:05:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.15122582631952622
agent_compute-ego_mean	0.14153668860340507
agent_compute-ego_median	0.14660192595587837
agent_compute-ego_min	0.12809337675571442
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.020907433527820516, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05713720591563099, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1329919437192521, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08767244950780329, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.034559218388683394, "sim_compute_performance-ego": 0.06047667647307774, "sim_compute_robot_state-ego": 0.06431520659968538}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.020026819272474808, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05577848174355247, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14877037026665427, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.0930988138372248, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03730996630408547, "sim_compute_performance-ego": 0.06288006630810825, "sim_compute_robot_state-ego": 0.067742797461423}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.021353493796454535, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.05399269527859158, "in-drivable-lane": 0, "agent_compute-ego": 0.14660192595587837, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.0893270386589898, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.035767014821370444, "sim_compute_performance-ego": 0.06165500217013889, "sim_compute_robot_state-ego": 0.06371274524264865}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02062543233235677, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05131204426288605, "in-drivable-lane": 0, "agent_compute-ego": 0.12809337675571442, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08256856600443523, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03295361498991648, "sim_compute_performance-ego": 0.05891708036263784, "sim_compute_robot_state-ego": 0.06358984112739563}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.024567365646362305, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06081941197900211, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.15122582631952622, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09629067603279562, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.037278284044826734, "sim_compute_performance-ego": 0.0656135362737319, "sim_compute_robot_state-ego": 0.07170957677504596}}
set_robot_commands_max	0.09629067603279562
set_robot_commands_mean	0.08979150880824974
set_robot_commands_median	0.0893270386589898
set_robot_commands_min	0.08256856600443523
sim_compute_performance-ego_max	0.0656135362737319
sim_compute_performance-ego_mean	0.06190847231753893
sim_compute_performance-ego_median	0.06165500217013889
sim_compute_performance-ego_min	0.05891708036263784
sim_compute_robot_state-ego_max	0.07170957677504596
sim_compute_robot_state-ego_mean	0.06621403344123973
sim_compute_robot_state-ego_median	0.06431520659968538
sim_compute_robot_state-ego_min	0.06358984112739563
sim_compute_sim_state_max	0.03730996630408547
sim_compute_sim_state_mean	0.0355736197097765
sim_compute_sim_state_median	0.035767014821370444
sim_compute_sim_state_min	0.03295361498991648
sim_physics_max	0.024567365646362305
sim_physics_mean	0.021496108915093785
sim_physics_median	0.020907433527820516
sim_physics_min	0.020026819272474808
sim_render-ego_max	0.06081941197900211
sim_render-ego_mean	0.05580796783593264
sim_render-ego_median	0.05577848174355247
sim_render-ego_min	0.05131204426288605
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

19452

2637

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-24 15:00:24+00:00

2019-04-24 15:09:07+00:00

0:08:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.14262464689829993
agent_compute-ego_mean	0.13500164474231652
agent_compute-ego_median	0.13911202374626608
agent_compute-ego_min	0.1141842374434838
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.04089914049421038, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06606874768696135, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14262464689829993, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08937555646139478, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.0340102854229155, "sim_compute_performance-ego": 0.059223761634221155, "sim_compute_robot_state-ego": 0.06375255660405235, "sim_compute_robot_state-npc0": 0.05957172787378705, "sim_compute_robot_state-npc1": 0.05881410174899631, "sim_compute_robot_state-npc2": 0.05946220291985406, "sim_compute_robot_state-npc3": 0.05989232895866273}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03966255281485763, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05408346419240914, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13911202374626608, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.08864813224942077, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03418060377532361, "sim_compute_performance-ego": 0.062385152367984545, "sim_compute_robot_state-ego": 0.06734059371200263, "sim_compute_robot_state-npc0": 0.06412888508217007, "sim_compute_robot_state-npc1": 0.06334077610689051, "sim_compute_robot_state-npc2": 0.0641475378298292, "sim_compute_robot_state-npc3": 0.0636597334169874}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.0415615112550797, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05622549979917465, "in-drivable-lane": 0, "agent_compute-ego": 0.13734213382967056, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.08909353133170836, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03275375212392499, "sim_compute_performance-ego": 0.05824117891250118, "sim_compute_robot_state-ego": 0.05956239854135821, "sim_compute_robot_state-npc0": 0.06034120821183728, "sim_compute_robot_state-npc1": 0.05779895090287731, "sim_compute_robot_state-npc2": 0.05996960209261987, "sim_compute_robot_state-npc3": 0.059765692680112774}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.04084622099044475, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.0577516200694632, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1417451817938622, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.08722584805590042, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03490348572426654, "sim_compute_performance-ego": 0.06372328007474859, "sim_compute_robot_state-ego": 0.06293910868624424, "sim_compute_robot_state-npc0": 0.059374898038011915, "sim_compute_robot_state-npc1": 0.05862714381928139, "sim_compute_robot_state-npc2": 0.06108001698838904, "sim_compute_robot_state-npc3": 0.06026640090536564}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02832505336174598, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.04702224639745859, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1141842374434838, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07042334629939152, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02773007979759803, "sim_compute_performance-ego": 0.04753942214525663, "sim_compute_robot_state-ego": 0.049333352309006914, "sim_compute_robot_state-npc0": 0.048137939893282376, "sim_compute_robot_state-npc1": 0.0470695082957928, "sim_compute_robot_state-npc2": 0.047885459202986494, "sim_compute_robot_state-npc3": 0.048415880936842695}}
set_robot_commands_max	0.08937555646139478
set_robot_commands_mean	0.08495328287956316
set_robot_commands_median	0.08864813224942077
set_robot_commands_min	0.07042334629939152
sim_compute_performance-ego_max	0.06372328007474859
sim_compute_performance-ego_mean	0.05822255902694242
sim_compute_performance-ego_median	0.059223761634221155
sim_compute_performance-ego_min	0.04753942214525663
sim_compute_robot_state-ego_max	0.06734059371200263
sim_compute_robot_state-ego_mean	0.06058560197053288
sim_compute_robot_state-ego_median	0.06293910868624424
sim_compute_robot_state-ego_min	0.049333352309006914
sim_compute_robot_state-npc0_max	0.06412888508217007
sim_compute_robot_state-npc0_mean	0.05831093181981774
sim_compute_robot_state-npc0_median	0.05957172787378705
sim_compute_robot_state-npc0_min	0.048137939893282376
sim_compute_robot_state-npc1_max	0.06334077610689051
sim_compute_robot_state-npc1_mean	0.057130096174767664
sim_compute_robot_state-npc1_median	0.05862714381928139
sim_compute_robot_state-npc1_min	0.0470695082957928
sim_compute_robot_state-npc2_max	0.0641475378298292
sim_compute_robot_state-npc2_mean	0.05850896380673573
sim_compute_robot_state-npc2_median	0.05996960209261987
sim_compute_robot_state-npc2_min	0.047885459202986494
sim_compute_robot_state-npc3_max	0.0636597334169874
sim_compute_robot_state-npc3_mean	0.05840000737959424
sim_compute_robot_state-npc3_median	0.05989232895866273
sim_compute_robot_state-npc3_min	0.048415880936842695
sim_compute_sim_state_max	0.03490348572426654
sim_compute_sim_state_mean	0.03271564136880574
sim_compute_sim_state_median	0.0340102854229155
sim_compute_sim_state_min	0.02773007979759803
sim_physics_max	0.0415615112550797
sim_physics_mean	0.03825889578326769
sim_physics_median	0.04084622099044475
sim_physics_min	0.02832505336174598
sim_render-ego_max	0.06606874768696135
sim_render-ego_mean	0.056230315629093384
sim_render-ego_median	0.05622549979917465
sim_render-ego_min	0.04702224639745859
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

19447

2644

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-24 14:57:53+00:00

2019-04-24 15:00:06+00:00

0:02:13

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19447-995485', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19447-995485', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19447-995485', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19423

2684

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 14:45:23+00:00

2019-04-24 14:57:46+00:00

0:12:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.30619764774352887
survival_time_median	4.099999999999993
deviation-center-line_median	0.19142675995685557
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.09100533934200512
agent_compute-ego_mean	0.08747764164454166
agent_compute-ego_median	0.08837670346964961
agent_compute-ego_min	0.08343971929242534
deviation-center-line_max	0.8531636127602534
deviation-center-line_mean	0.2895594578144681
deviation-center-line_min	0.0760898032225869
deviation-heading_max	1.892742468142873
deviation-heading_mean	1.3284255498688675
deviation-heading_median	1.5175317927505607
deviation-heading_min	0.6916899594116734
driven_any_max	1.380623180344586
driven_any_mean	0.6482855690094372
driven_any_median	0.611840937658311
driven_any_min	0.2261621661408698
driven_lanedir_consec_max	0.9620264739458062
driven_lanedir_consec_mean	0.4463612723841333
driven_lanedir_consec_min	0.18656921732520293
driven_lanedir_max	1.3519658877413805
driven_lanedir_mean	0.5251382374617862
driven_lanedir_median	0.31014305933622
driven_lanedir_min	0.18656921732520293
in-drivable-lane_max	1.5999999999999943
in-drivable-lane_mean	0.34999999999999876
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.380623180344586, "sim_physics": 0.04707864942497381, "survival_time": 8.949999999999992, "driven_lanedir": 1.3519658877413805, "sim_render-ego": 0.06902426314753526, "in-drivable-lane": 0, "agent_compute-ego": 0.08614071387818406, "deviation-heading": 1.5175317927505607, "set_robot_commands": 0.10967688320735314, "deviation-center-line": 0.8531636127602534, "driven_lanedir_consec": 0.9620264739458062, "sim_compute_sim_state": 0.04198101379351909, "sim_compute_performance-ego": 0.07495828846979408, "sim_compute_robot_state-ego": 0.08169420471404518, "sim_compute_robot_state-npc0": 0.07390788680348316, "sim_compute_robot_state-npc1": 0.07480145033511369, "sim_compute_robot_state-npc2": 0.07550364233262045, "sim_compute_robot_state-npc3": 0.07669650908954982}, "udem1-1-0": {"driven_any": 0.32258210171411517, "sim_physics": 0.04714139129804528, "survival_time": 2.3, "driven_lanedir": 0.2915870695033673, "sim_render-ego": 0.06479156017303467, "in-drivable-lane": 0, "agent_compute-ego": 0.08837670346964961, "deviation-heading": 0.7203763880372106, "set_robot_commands": 0.11118186038473378, "deviation-center-line": 0.1356602992390459, "driven_lanedir_consec": 0.2915870695033673, "sim_compute_sim_state": 0.040814871373383896, "sim_compute_performance-ego": 0.0726396311884341, "sim_compute_robot_state-ego": 0.07645708063374394, "sim_compute_robot_state-npc0": 0.0770014472629713, "sim_compute_robot_state-npc1": 0.07749835822893225, "sim_compute_robot_state-npc2": 0.0823837311371513, "sim_compute_robot_state-npc3": 0.0778272877568784}, "udem1-2-0": {"driven_any": 0.611840937658311, "sim_physics": 0.05950602089486471, "survival_time": 4.099999999999993, "driven_lanedir": 0.48542595340276096, "sim_render-ego": 0.07009445748678068, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.08842573224044428, "deviation-heading": 1.8197871410020192, "set_robot_commands": 0.115391582977481, "deviation-center-line": 0.19142675995685557, "driven_lanedir_consec": 0.48542595340276096, "sim_compute_sim_state": 0.042506386594074526, "sim_compute_performance-ego": 0.07834931117732351, "sim_compute_robot_state-ego": 0.0828903012159394, "sim_compute_robot_state-npc0": 0.07786550754454077, "sim_compute_robot_state-npc1": 0.07737984017627995, "sim_compute_robot_state-npc2": 0.07552204190230952, "sim_compute_robot_state-npc3": 0.07792877860185576}, "udem1-3-0": {"driven_any": 0.2261621661408698, "sim_physics": 0.0489273842643289, "survival_time": 1.7000000000000008, "driven_lanedir": 0.18656921732520293, "sim_render-ego": 0.07161086447098676, "in-drivable-lane": 0, "agent_compute-ego": 0.09100533934200512, "deviation-heading": 0.6916899594116734, "set_robot_commands": 0.10734134561875289, "deviation-center-line": 0.0760898032225869, "driven_lanedir_consec": 0.18656921732520293, "sim_compute_sim_state": 0.04210668451645795, "sim_compute_performance-ego": 0.07289652964648079, "sim_compute_robot_state-ego": 0.08066783231847427, "sim_compute_robot_state-npc0": 0.07648505884058335, "sim_compute_robot_state-npc1": 0.07536917574265424, "sim_compute_robot_state-npc2": 0.0732954600278069, "sim_compute_robot_state-npc3": 0.07543997203602511}, "udem1-4-0": {"driven_any": 0.700219459189304, "sim_physics": 0.05353942994148501, "survival_time": 4.6499999999999915, "driven_lanedir": 0.31014305933622, "sim_render-ego": 0.06544165713812715, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.08343971929242534, "deviation-heading": 1.892742468142873, "set_robot_commands": 0.10422381534371324, "deviation-center-line": 0.1914568138935989, "driven_lanedir_consec": 0.30619764774352887, "sim_compute_sim_state": 0.03953991397734611, "sim_compute_performance-ego": 0.07184447011639995, "sim_compute_robot_state-ego": 0.07738832504518571, "sim_compute_robot_state-npc0": 0.06912006614028766, "sim_compute_robot_state-npc1": 0.07139008019560127, "sim_compute_robot_state-npc2": 0.07076178058501213, "sim_compute_robot_state-npc3": 0.0709685561477497}}
set_robot_commands_max	0.115391582977481
set_robot_commands_mean	0.1095630975064068
set_robot_commands_median	0.10967688320735314
set_robot_commands_min	0.10422381534371324
sim_compute_performance-ego_max	0.07834931117732351
sim_compute_performance-ego_mean	0.07413764611968648
sim_compute_performance-ego_median	0.07289652964648079
sim_compute_performance-ego_min	0.07184447011639995
sim_compute_robot_state-ego_max	0.0828903012159394
sim_compute_robot_state-ego_mean	0.0798195487854777
sim_compute_robot_state-ego_median	0.08066783231847427
sim_compute_robot_state-ego_min	0.07645708063374394
sim_compute_robot_state-npc0_max	0.07786550754454077
sim_compute_robot_state-npc0_mean	0.07487599331837325
sim_compute_robot_state-npc0_median	0.07648505884058335
sim_compute_robot_state-npc0_min	0.06912006614028766
sim_compute_robot_state-npc1_max	0.07749835822893225
sim_compute_robot_state-npc1_mean	0.07528778093571628
sim_compute_robot_state-npc1_median	0.07536917574265424
sim_compute_robot_state-npc1_min	0.07139008019560127
sim_compute_robot_state-npc2_max	0.0823837311371513
sim_compute_robot_state-npc2_mean	0.07549333119698007
sim_compute_robot_state-npc2_median	0.07550364233262045
sim_compute_robot_state-npc2_min	0.07076178058501213
sim_compute_robot_state-npc3_max	0.07792877860185576
sim_compute_robot_state-npc3_mean	0.07577222072641177
sim_compute_robot_state-npc3_median	0.07669650908954982
sim_compute_robot_state-npc3_min	0.0709685561477497
sim_compute_sim_state_max	0.042506386594074526
sim_compute_sim_state_mean	0.04138977405095631
sim_compute_sim_state_median	0.04198101379351909
sim_compute_sim_state_min	0.03953991397734611
sim_physics_max	0.05950602089486471
sim_physics_mean	0.05123857516473954
sim_physics_median	0.0489273842643289
sim_physics_min	0.04707864942497381
sim_render-ego_max	0.07161086447098676
sim_render-ego_mean	0.0681925604832929
sim_render-ego_median	0.06902426314753526
sim_render-ego_min	0.06479156017303467
simulation-passed	1
survival_time_max	8.949999999999992
survival_time_mean	4.339999999999995
survival_time_min	1.7000000000000008

No reset possible

19407

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 14:29:09+00:00

2019-04-24 14:45:17+00:00

0:16:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6346064321305424
survival_time_median	6.999999999999983
deviation-center-line_median	0.3709542001157699
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.0935644805431366
agent_compute-ego_mean	0.09076221217455664
agent_compute-ego_median	0.09113235473632812
agent_compute-ego_min	0.08645809057987097
deviation-center-line_max	0.612357543850466
deviation-center-line_mean	0.3436924033208497
deviation-center-line_min	0.07121071427485294
deviation-heading_max	2.5190332821738797
deviation-heading_mean	1.2498127094821263
deviation-heading_median	0.8796333893905425
deviation-heading_min	0.6947399713975012
driven_any_max	1.5681869870769551
driven_any_mean	0.8604341253800136
driven_any_median	1.0779737455159433
driven_any_min	0.2100692575892354
driven_lanedir_consec_max	1.0622162322435975
driven_lanedir_consec_mean	0.5638690287094712
driven_lanedir_consec_min	0.1561321243090852
driven_lanedir_max	1.0634950330433588
driven_lanedir_mean	0.6235907250453671
driven_lanedir_median	0.7904486673218103
driven_lanedir_min	0.1561321243090852
in-drivable-lane_max	4.600000000000019
in-drivable-lane_mean	1.130000000000003
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2278223508292931, "sim_physics": 0.04983329921960831, "survival_time": 7.99999999999998, "driven_lanedir": 0.93193611301026, "sim_render-ego": 0.07023949027061463, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.09113235473632812, "deviation-heading": 2.5190332821738797, "set_robot_commands": 0.11538991928100586, "deviation-center-line": 0.612357543850466, "driven_lanedir_consec": 0.6346064321305424, "sim_compute_sim_state": 0.04229353666305542, "sim_compute_performance-ego": 0.07554932087659835, "sim_compute_robot_state-ego": 0.08080236613750458, "sim_compute_robot_state-npc0": 0.07542105317115784, "sim_compute_robot_state-npc1": 0.07615731656551361, "sim_compute_robot_state-npc2": 0.07525833249092102, "sim_compute_robot_state-npc3": 0.07716984748840332}, "udem1-1-0": {"driven_any": 0.2100692575892354, "sim_physics": 0.053271517157554626, "survival_time": 1.6000000000000008, "driven_lanedir": 0.1561321243090852, "sim_render-ego": 0.07085736840963364, "in-drivable-lane": 0, "agent_compute-ego": 0.0935644805431366, "deviation-heading": 0.763440906578395, "set_robot_commands": 0.13034703582525253, "deviation-center-line": 0.07121071427485294, "driven_lanedir_consec": 0.1561321243090852, "sim_compute_sim_state": 0.04414845257997513, "sim_compute_performance-ego": 0.07525301724672318, "sim_compute_robot_state-ego": 0.08898250013589859, "sim_compute_robot_state-npc0": 0.08370187133550644, "sim_compute_robot_state-npc1": 0.07915277034044266, "sim_compute_robot_state-npc2": 0.08260607719421387, "sim_compute_robot_state-npc3": 0.0815265104174614}, "udem1-2-0": {"driven_any": 1.0779737455159433, "sim_physics": 0.05497845241001674, "survival_time": 6.999999999999983, "driven_lanedir": 1.0634950330433588, "sim_render-ego": 0.06964001655578614, "in-drivable-lane": 0, "agent_compute-ego": 0.09199187755584716, "deviation-heading": 0.8796333893905425, "set_robot_commands": 0.11124367713928222, "deviation-center-line": 0.5913938046350357, "driven_lanedir_consec": 1.0622162322435975, "sim_compute_sim_state": 0.04276019675391061, "sim_compute_performance-ego": 0.07653112752096994, "sim_compute_robot_state-ego": 0.07868872199739729, "sim_compute_robot_state-npc0": 0.07493976354599, "sim_compute_robot_state-npc1": 0.07734707934515817, "sim_compute_robot_state-npc2": 0.07547332048416137, "sim_compute_robot_state-npc3": 0.07646685668400356}, "udem1-3-0": {"driven_any": 0.2181182858886412, "sim_physics": 0.04895460244381067, "survival_time": 1.6500000000000008, "driven_lanedir": 0.17594168754232076, "sim_render-ego": 0.06963087573195949, "in-drivable-lane": 0, "agent_compute-ego": 0.08645809057987097, "deviation-heading": 0.6947399713975012, "set_robot_commands": 0.1125151605317087, "deviation-center-line": 0.07254575372812395, "driven_lanedir_consec": 0.17594168754232076, "sim_compute_sim_state": 0.0428262623873624, "sim_compute_performance-ego": 0.08063699982383034, "sim_compute_robot_state-ego": 0.07727995063319351, "sim_compute_robot_state-npc0": 0.07600838487798517, "sim_compute_robot_state-npc1": 0.07577914902658174, "sim_compute_robot_state-npc2": 0.07327794306205981, "sim_compute_robot_state-npc3": 0.07386505242550012}, "udem1-4-0": {"driven_any": 1.5681869870769551, "sim_physics": 0.04934927954602597, "survival_time": 10.050000000000008, "driven_lanedir": 0.7904486673218103, "sim_render-ego": 0.0715245287216718, "in-drivable-lane": 4.600000000000019, "agent_compute-ego": 0.0906642574576003, "deviation-heading": 1.3922159978703144, "set_robot_commands": 0.11468737635446426, "deviation-center-line": 0.3709542001157699, "driven_lanedir_consec": 0.7904486673218103, "sim_compute_sim_state": 0.04265911424931009, "sim_compute_performance-ego": 0.07536316985514627, "sim_compute_robot_state-ego": 0.07965333070327986, "sim_compute_robot_state-npc0": 0.07725898068935717, "sim_compute_robot_state-npc1": 0.077279890354593, "sim_compute_robot_state-npc2": 0.0751407810704625, "sim_compute_robot_state-npc3": 0.07559266730920593}}
set_robot_commands_max	0.13034703582525253
set_robot_commands_mean	0.11683663382634273
set_robot_commands_median	0.11468737635446426
set_robot_commands_min	0.11124367713928222
sim_compute_performance-ego_max	0.08063699982383034
sim_compute_performance-ego_mean	0.0766667270646536
sim_compute_performance-ego_median	0.07554932087659835
sim_compute_performance-ego_min	0.07525301724672318
sim_compute_robot_state-ego_max	0.08898250013589859
sim_compute_robot_state-ego_mean	0.08108137392145476
sim_compute_robot_state-ego_median	0.07965333070327986
sim_compute_robot_state-ego_min	0.07727995063319351
sim_compute_robot_state-npc0_max	0.08370187133550644
sim_compute_robot_state-npc0_mean	0.0774660107239993
sim_compute_robot_state-npc0_median	0.07600838487798517
sim_compute_robot_state-npc0_min	0.07493976354599
sim_compute_robot_state-npc1_max	0.07915277034044266
sim_compute_robot_state-npc1_mean	0.07714324112645783
sim_compute_robot_state-npc1_median	0.077279890354593
sim_compute_robot_state-npc1_min	0.07577914902658174
sim_compute_robot_state-npc2_max	0.08260607719421387
sim_compute_robot_state-npc2_mean	0.07635129086036371
sim_compute_robot_state-npc2_median	0.07525833249092102
sim_compute_robot_state-npc2_min	0.07327794306205981
sim_compute_robot_state-npc3_max	0.0815265104174614
sim_compute_robot_state-npc3_mean	0.07692418686491487
sim_compute_robot_state-npc3_median	0.07646685668400356
sim_compute_robot_state-npc3_min	0.07386505242550012
sim_compute_sim_state_max	0.04414845257997513
sim_compute_sim_state_mean	0.04293751252672273
sim_compute_sim_state_median	0.04276019675391061
sim_compute_sim_state_min	0.04229353666305542
sim_physics_max	0.05497845241001674
sim_physics_mean	0.05127743015540326
sim_physics_median	0.04983329921960831
sim_physics_min	0.04895460244381067
sim_render-ego_max	0.0715245287216718
sim_render-ego_mean	0.07037845593793314
sim_render-ego_median	0.07023949027061463
sim_render-ego_min	0.06963087573195949
simulation-passed	1
survival_time_max	10.050000000000008
survival_time_mean	5.659999999999995
survival_time_min	1.6000000000000008

No reset possible

19399

2724

jiang peng

test for ppo

step1-simulation

error

2019-04-24 14:27:15+00:00

2019-04-24 14:28:55+00:00

0:01:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19392

2735

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-24 14:25:30+00:00

2019-04-24 14:27:01+00:00

0:01:31

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19384

2747

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-24 14:23:40+00:00

2019-04-24 14:25:24+00:00

0:01:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19374

2762

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-24 14:14:02+00:00

2019-04-24 14:23:12+00:00

0:09:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.07286135146492406
agent_compute-ego_mean	0.06954295601505708
agent_compute-ego_median	0.07105846807990275
agent_compute-ego_min	0.06385276534340599
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.044504868356805095, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06114466064854672, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06795116725720857, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.0920962082712274, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.036137440330103826, "sim_compute_performance-ego": 0.06572775840759278, "sim_compute_robot_state-ego": 0.07043664580897281, "sim_compute_robot_state-npc0": 0.0660162373592979, "sim_compute_robot_state-npc1": 0.06360095425655968, "sim_compute_robot_state-npc2": 0.06659648543909977, "sim_compute_robot_state-npc3": 0.06704485039961966}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.039713577220314426, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.06113431328221371, "in-drivable-lane": 0, "agent_compute-ego": 0.07286135146492406, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.09893268660495157, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03925162867495888, "sim_compute_performance-ego": 0.06544501530496698, "sim_compute_robot_state-ego": 0.06940911318126478, "sim_compute_robot_state-npc0": 0.07107432265030711, "sim_compute_robot_state-npc1": 0.06858861446380615, "sim_compute_robot_state-npc2": 0.06869314846239592, "sim_compute_robot_state-npc3": 0.06814281564009816}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.043582219343919024, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06490293527260804, "in-drivable-lane": 0, "agent_compute-ego": 0.071991027929844, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.09602080858670747, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03856677275437575, "sim_compute_performance-ego": 0.06581336412674342, "sim_compute_robot_state-ego": 0.06875945360232623, "sim_compute_robot_state-npc0": 0.06907859215369591, "sim_compute_robot_state-npc1": 0.06784636546403934, "sim_compute_robot_state-npc2": 0.06696493809039776, "sim_compute_robot_state-npc3": 0.06617343731415577}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.04942755967798367, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.05859300116418113, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07105846807990275, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.0901452554783351, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03652749934666593, "sim_compute_performance-ego": 0.06438303665376045, "sim_compute_robot_state-ego": 0.06727669944225902, "sim_compute_robot_state-npc0": 0.06361202119101941, "sim_compute_robot_state-npc1": 0.06318571869756134, "sim_compute_robot_state-npc2": 0.06549215316772461, "sim_compute_robot_state-npc3": 0.06539105025815292}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.037211846221577034, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06339775432239879, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06385276534340599, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.08743003823540428, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.0370711630040949, "sim_compute_performance-ego": 0.06025338172912598, "sim_compute_robot_state-ego": 0.06283870610323819, "sim_compute_robot_state-npc0": 0.06338957764885643, "sim_compute_robot_state-npc1": 0.06257129799235951, "sim_compute_robot_state-npc2": 0.06582337617874146, "sim_compute_robot_state-npc3": 0.0625992634079673}}
set_robot_commands_max	0.09893268660495157
set_robot_commands_mean	0.09292499943532516
set_robot_commands_median	0.0920962082712274
set_robot_commands_min	0.08743003823540428
sim_compute_performance-ego_max	0.06581336412674342
sim_compute_performance-ego_mean	0.06432451124443792
sim_compute_performance-ego_median	0.06544501530496698
sim_compute_performance-ego_min	0.06025338172912598
sim_compute_robot_state-ego_max	0.07043664580897281
sim_compute_robot_state-ego_mean	0.0677441236276122
sim_compute_robot_state-ego_median	0.06875945360232623
sim_compute_robot_state-ego_min	0.06283870610323819
sim_compute_robot_state-npc0_max	0.07107432265030711
sim_compute_robot_state-npc0_mean	0.06663415020063536
sim_compute_robot_state-npc0_median	0.0660162373592979
sim_compute_robot_state-npc0_min	0.06338957764885643
sim_compute_robot_state-npc1_max	0.06858861446380615
sim_compute_robot_state-npc1_mean	0.06515859017486521
sim_compute_robot_state-npc1_median	0.06360095425655968
sim_compute_robot_state-npc1_min	0.06257129799235951
sim_compute_robot_state-npc2_max	0.06869314846239592
sim_compute_robot_state-npc2_mean	0.0667140202676719
sim_compute_robot_state-npc2_median	0.06659648543909977
sim_compute_robot_state-npc2_min	0.06549215316772461
sim_compute_robot_state-npc3_max	0.06814281564009816
sim_compute_robot_state-npc3_mean	0.06587028340399877
sim_compute_robot_state-npc3_median	0.06617343731415577
sim_compute_robot_state-npc3_min	0.0625992634079673
sim_compute_sim_state_max	0.03925162867495888
sim_compute_sim_state_mean	0.03751090082203986
sim_compute_sim_state_median	0.0370711630040949
sim_compute_sim_state_min	0.036137440330103826
sim_physics_max	0.04942755967798367
sim_physics_mean	0.042888014164119845
sim_physics_median	0.043582219343919024
sim_physics_min	0.037211846221577034
sim_render-ego_max	0.06490293527260804
sim_render-ego_mean	0.06183453293798968
sim_render-ego_median	0.06114466064854672
sim_render-ego_min	0.05859300116418113
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

19364

2783

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

aido2-LF-sim-validation

2019-04-24 14:11:41+00:00

2019-04-24 14:13:20+00:00

0:01:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19360

2792

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-24 14:09:29+00:00

2019-04-24 14:11:06+00:00

0:01:37

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19356

2796

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-24 14:07:25+00:00

2019-04-24 14:09:07+00:00

0:01:42

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19332

2822

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-24 14:00:25+00:00

2019-04-24 14:07:17+00:00

0:06:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14635205268859863
agent_compute-ego_mean	0.13134283178000228
agent_compute-ego_median	0.1325427641471227
agent_compute-ego_min	0.10296587032430311
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03542028733019559, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05760036324555019, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14615646848138772, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09052948681813366, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03667742801162432, "sim_compute_performance-ego": 0.06477988890881808, "sim_compute_robot_state-ego": 0.06437410048718722, "sim_compute_robot_state-npc0": 0.06553146974095758, "sim_compute_robot_state-npc1": 0.0644958514087605, "sim_compute_robot_state-npc2": 0.06344504176445727, "sim_compute_robot_state-npc3": 0.06868988612912735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03963228247382424, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.0583207986571572, "in-drivable-lane": 0, "agent_compute-ego": 0.14635205268859863, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.08831984888423573, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.036163525147871536, "sim_compute_performance-ego": 0.06286955421621149, "sim_compute_robot_state-ego": 0.06503678451884877, "sim_compute_robot_state-npc0": 0.06703182783993808, "sim_compute_robot_state-npc1": 0.0696605227210305, "sim_compute_robot_state-npc2": 0.06697616793892601, "sim_compute_robot_state-npc3": 0.06614042954011397}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03471091588338216, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.052948247061835395, "in-drivable-lane": 0, "agent_compute-ego": 0.12869700325859915, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.08331293000115289, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03413883845011393, "sim_compute_performance-ego": 0.05873427391052246, "sim_compute_robot_state-ego": 0.06361845334370932, "sim_compute_robot_state-npc0": 0.05863192876180013, "sim_compute_robot_state-npc1": 0.05963772137959798, "sim_compute_robot_state-npc2": 0.057736370298597545, "sim_compute_robot_state-npc3": 0.05756712489657932}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03164613743623098, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.054351414243380226, "in-drivable-lane": 0, "agent_compute-ego": 0.1325427641471227, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08558500806490581, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.032795488834381104, "sim_compute_performance-ego": 0.06029306352138519, "sim_compute_robot_state-ego": 0.06120206912358602, "sim_compute_robot_state-npc0": 0.05875821908315023, "sim_compute_robot_state-npc1": 0.05836378534634908, "sim_compute_robot_state-npc2": 0.05594119926293691, "sim_compute_robot_state-npc3": 0.056352650125821434}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.023791954797856948, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.04154358541264253, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.10296587032430311, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.06348425149917603, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.025474513278288, "sim_compute_performance-ego": 0.04538767828660853, "sim_compute_robot_state-ego": 0.04592130114050472, "sim_compute_robot_state-npc0": 0.04611112089718089, "sim_compute_robot_state-npc1": 0.045194587286780864, "sim_compute_robot_state-npc2": 0.0456278920173645, "sim_compute_robot_state-npc3": 0.04538104814641616}}
set_robot_commands_max	0.09052948681813366
set_robot_commands_mean	0.08224630505352083
set_robot_commands_median	0.08558500806490581
set_robot_commands_min	0.06348425149917603
sim_compute_performance-ego_max	0.06477988890881808
sim_compute_performance-ego_mean	0.05841289176870915
sim_compute_performance-ego_median	0.06029306352138519
sim_compute_performance-ego_min	0.04538767828660853
sim_compute_robot_state-ego_max	0.06503678451884877
sim_compute_robot_state-ego_mean	0.06003054172276721
sim_compute_robot_state-ego_median	0.06361845334370932
sim_compute_robot_state-ego_min	0.04592130114050472
sim_compute_robot_state-npc0_max	0.06703182783993808
sim_compute_robot_state-npc0_mean	0.059212913264605385
sim_compute_robot_state-npc0_median	0.05875821908315023
sim_compute_robot_state-npc0_min	0.04611112089718089
sim_compute_robot_state-npc1_max	0.0696605227210305
sim_compute_robot_state-npc1_mean	0.05947049362850378
sim_compute_robot_state-npc1_median	0.05963772137959798
sim_compute_robot_state-npc1_min	0.045194587286780864
sim_compute_robot_state-npc2_max	0.06697616793892601
sim_compute_robot_state-npc2_mean	0.05794533425645645
sim_compute_robot_state-npc2_median	0.057736370298597545
sim_compute_robot_state-npc2_min	0.0456278920173645
sim_compute_robot_state-npc3_max	0.06868988612912735
sim_compute_robot_state-npc3_mean	0.05882622776761165
sim_compute_robot_state-npc3_median	0.05756712489657932
sim_compute_robot_state-npc3_min	0.04538104814641616
sim_compute_sim_state_max	0.03667742801162432
sim_compute_sim_state_mean	0.03304995874445578
sim_compute_sim_state_median	0.03413883845011393
sim_compute_sim_state_min	0.025474513278288
sim_physics_max	0.03963228247382424
sim_physics_mean	0.033040315584297986
sim_physics_median	0.03471091588338216
sim_physics_min	0.023791954797856948
sim_render-ego_max	0.0583207986571572
sim_render-ego_mean	0.05295288172411311
sim_render-ego_median	0.054351414243380226
sim_render-ego_min	0.04154358541264253
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

19319

2827

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-24 13:58:12+00:00

2019-04-24 14:00:12+00:00

0:02:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19319-610663', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19319-610663', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19319-610663', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19314

2840

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

aido2-LF-sim-validation

2019-04-24 13:57:07+00:00

2019-04-24 13:57:43+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19271

2900

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-24 13:32:57+00:00

2019-04-24 13:56:53+00:00

0:23:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2418847845993328
survival_time_median	9.299999999999995
deviation-center-line_median	0.1072072651386038
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.3490385067563097
agent_compute-ego_mean	0.23221367563003129
agent_compute-ego_median	0.2104664502605315
agent_compute-ego_min	0.1824508443955452
deviation-center-line_max	0.14872812326735368
deviation-center-line_mean	0.11410175837317307
deviation-center-line_min	0.09234054355317162
deviation-heading_max	0.780844133286368
deviation-heading_mean	0.7010099880529663
deviation-heading_median	0.7342804543244918
deviation-heading_min	0.6093625366847872
driven_any_max	1.5735900983242412
driven_any_mean	1.3394880716297308
driven_any_median	1.573590097544532
driven_any_min	0.9883350315379033
driven_lanedir_consec_max	1.3336725649834928
driven_lanedir_consec_mean	1.04636102267902
driven_lanedir_consec_min	0.6581365515107476
driven_lanedir_max	1.3336725649834928
driven_lanedir_mean	1.04636102267902
driven_lanedir_median	1.2418847845993328
driven_lanedir_min	0.6581365515107476
in-drivable-lane_max	1.6500000000000163
in-drivable-lane_mean	1.480000000000008
in-drivable-lane_min	1.1999999999999955
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9883350315379033, "sim_physics": 0.03790639228179675, "survival_time": 5.949999999999987, "driven_lanedir": 0.6581365515107476, "sim_render-ego": 0.09223231748372566, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.3490385067563097, "deviation-heading": 0.7342804543244918, "set_robot_commands": 0.1492273727384936, "deviation-center-line": 0.09234054355317162, "driven_lanedir_consec": 0.6581365515107476, "sim_compute_sim_state": 0.05349223553633489, "sim_compute_performance-ego": 0.09732025210596934, "sim_compute_robot_state-ego": 0.11362148533348276}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9883350327072176, "sim_physics": 0.02193644267170369, "survival_time": 5.949999999999987, "driven_lanedir": 0.7557789229905139, "sim_render-ego": 0.05556695401167669, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.2029406583609701, "deviation-heading": 0.6093625366847872, "set_robot_commands": 0.09188428245672658, "deviation-center-line": 0.12001331987258802, "driven_lanedir_consec": 0.7557789229905139, "sim_compute_sim_state": 0.03630175310022691, "sim_compute_performance-ego": 0.06173668789262531, "sim_compute_robot_state-ego": 0.06377156842656496}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5735900983242412, "sim_physics": 0.018802887649946316, "survival_time": 9.299999999999995, "driven_lanedir": 1.3336725649834928, "sim_render-ego": 0.04928094853637039, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.1824508443955452, "deviation-heading": 0.6161085761786831, "set_robot_commands": 0.07587016397906889, "deviation-center-line": 0.14872812326735368, "driven_lanedir_consec": 1.3336725649834928, "sim_compute_sim_state": 0.03170984406625071, "sim_compute_performance-ego": 0.05437915171346357, "sim_compute_robot_state-ego": 0.05660277540965747}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.57359009803476, "sim_physics": 0.02193244811027281, "survival_time": 9.299999999999995, "driven_lanedir": 1.2423322893110136, "sim_render-ego": 0.05618183843551144, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.21617191837679955, "deviation-heading": 0.7644542397905019, "set_robot_commands": 0.0889018286940872, "deviation-center-line": 0.10221954003414818, "driven_lanedir_consec": 1.2423322893110136, "sim_compute_sim_state": 0.03482228068895237, "sim_compute_performance-ego": 0.06485717142781904, "sim_compute_robot_state-ego": 0.06800816136021767}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.573590097544532, "sim_physics": 0.02180606190876294, "survival_time": 9.299999999999995, "driven_lanedir": 1.2418847845993328, "sim_render-ego": 0.05694780939368792, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.2104664502605315, "deviation-heading": 0.780844133286368, "set_robot_commands": 0.08792194756128455, "deviation-center-line": 0.1072072651386038, "driven_lanedir_consec": 1.2418847845993328, "sim_compute_sim_state": 0.035699232932059996, "sim_compute_performance-ego": 0.06174653319902317, "sim_compute_robot_state-ego": 0.06477139585761614}}
set_robot_commands_max	0.1492273727384936
set_robot_commands_mean	0.09876111908593216
set_robot_commands_median	0.0889018286940872
set_robot_commands_min	0.07587016397906889
sim_compute_performance-ego_max	0.09732025210596934
sim_compute_performance-ego_mean	0.0680079592677801
sim_compute_performance-ego_median	0.06174653319902317
sim_compute_performance-ego_min	0.05437915171346357
sim_compute_robot_state-ego_max	0.11362148533348276
sim_compute_robot_state-ego_mean	0.07335507727750781
sim_compute_robot_state-ego_median	0.06477139585761614
sim_compute_robot_state-ego_min	0.05660277540965747
sim_compute_sim_state_max	0.05349223553633489
sim_compute_sim_state_mean	0.03840506926476498
sim_compute_sim_state_median	0.035699232932059996
sim_compute_sim_state_min	0.03170984406625071
sim_physics_max	0.03790639228179675
sim_physics_mean	0.024476846524496505
sim_physics_median	0.02193244811027281
sim_physics_min	0.018802887649946316
sim_render-ego_max	0.09223231748372566
sim_render-ego_mean	0.06204197357219442
sim_render-ego_median	0.05618183843551144
sim_render-ego_min	0.04928094853637039
simulation-passed	1
survival_time_max	9.299999999999995
survival_time_mean	7.959999999999994
survival_time_min	5.949999999999987

No reset possible

19247

2936

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

host-error