Evaluator 845

step1-simulation

success

2019-05-06 12:07:55+00:00

2019-05-06 12:25:52+00:00

0:17:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.11889606217543285
agent_compute-ego_mean	0.09569274116425076
agent_compute-ego_median	0.08783868686881607
agent_compute-ego_min	0.0868136057486901
deviation-center-line_max	0.5141120095458062
deviation-center-line_mean	0.1769000227005324
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.9929437250081896
deviation-heading_mean	0.692977823395608
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.5343244022418343
driven_any_mean	1.3470385992234175
driven_any_median	1.001633421251194
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.494308053441959
driven_lanedir_consec_mean	0.881391085527715
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.494308053441959
driven_lanedir_mean	0.8962528018383226
driven_lanedir_median	0.7206363324756615
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1376649186580996, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.046490445921692665, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11137564574615864, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0716216352921498, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.02805747865121576, "sim_compute_performance-ego": 0.04907510552225234, "sim_compute_robot_state-ego": 0.051408284827123715, "sim_compute_robot_state-npc0": 0.051249709310410896, "sim_compute_robot_state-npc1": 0.05182195011573502, "sim_compute_robot_state-npc2": 0.05150762992569163, "sim_compute_robot_state-npc3": 0.0510152985778036}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.13530401672635758, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.04592233044760568, "in-drivable-lane": 0, "agent_compute-ego": 0.107248774596623, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.06794045652662005, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.0265069774218968, "sim_compute_performance-ego": 0.04905926329748971, "sim_compute_robot_state-ego": 0.05196744203567505, "sim_compute_robot_state-npc0": 0.05144391741071429, "sim_compute_robot_state-npc1": 0.057449936866760254, "sim_compute_robot_state-npc2": 0.04774745873042515, "sim_compute_robot_state-npc3": 0.046428024768829346}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1342087879921626, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.04701360915471049, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1181353527365379, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07394248305015194, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.029090251737427943, "sim_compute_performance-ego": 0.053631062646514, "sim_compute_robot_state-ego": 0.0510743381907639, "sim_compute_robot_state-npc0": 0.05572871328557579, "sim_compute_robot_state-npc1": 0.05360590601430356, "sim_compute_robot_state-npc2": 0.05031938460266706, "sim_compute_robot_state-npc3": 0.05138029635531231}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1448084612687429, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.043710788091023765, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.11889606217543285, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07274247705936432, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.027300457159678142, "sim_compute_performance-ego": 0.04700277745723725, "sim_compute_robot_state-ego": 0.047461628913879395, "sim_compute_robot_state-npc0": 0.05205709238847097, "sim_compute_robot_state-npc1": 0.05002166827519735, "sim_compute_robot_state-npc2": 0.048275391260782875, "sim_compute_robot_state-npc3": 0.048860410849253334}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.13150192442394437, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04178074428013393, "in-drivable-lane": 0, "agent_compute-ego": 0.10217055820283436, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.05969617480323428, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.02708269300914946, "sim_compute_performance-ego": 0.04631932576497396, "sim_compute_robot_state-ego": 0.04687632833208357, "sim_compute_robot_state-npc0": 0.04739763623192197, "sim_compute_robot_state-npc1": 0.046098368508475165, "sim_compute_robot_state-npc2": 0.05282719930013021, "sim_compute_robot_state-npc3": 0.04644722030276344}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.10388206007951747, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.03592484297152765, "in-drivable-lane": 2, "agent_compute-ego": 0.08783868686881607, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.05478526732164943, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.023762518774249595, "sim_compute_performance-ego": 0.03868859542344145, "sim_compute_robot_state-ego": 0.04114995031299705, "sim_compute_robot_state-npc0": 0.040367374877015985, "sim_compute_robot_state-npc1": 0.039742842405856016, "sim_compute_robot_state-npc2": 0.03958014956491436, "sim_compute_robot_state-npc3": 0.03971273742036191}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.11132204879834814, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.04215276588514013, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.0875901550922579, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.054743880207098805, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.02236592885359977, "sim_compute_performance-ego": 0.04072859680768356, "sim_compute_robot_state-ego": 0.04030356129396309, "sim_compute_robot_state-npc0": 0.04002613697237181, "sim_compute_robot_state-npc1": 0.039002418518066406, "sim_compute_robot_state-npc2": 0.03885218009208013, "sim_compute_robot_state-npc3": 0.03880670001205889}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.11398381233215332, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.03642405986785888, "in-drivable-lane": 0, "agent_compute-ego": 0.09191505908966063, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.05392534255981445, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.022822132110595705, "sim_compute_performance-ego": 0.03824660301208496, "sim_compute_robot_state-ego": 0.04036633968353272, "sim_compute_robot_state-npc0": 0.03990102767944336, "sim_compute_robot_state-npc1": 0.03974318504333496, "sim_compute_robot_state-npc2": 0.03917370796203613, "sim_compute_robot_state-npc3": 0.039241485595703125}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.10321545142393844, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.03579159424855159, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08724980629407443, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.054338615674238935, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.022460804535792425, "sim_compute_performance-ego": 0.04138764968285194, "sim_compute_robot_state-ego": 0.04020752815099863, "sim_compute_robot_state-npc0": 0.04000105766149667, "sim_compute_robot_state-npc1": 0.03894506050990178, "sim_compute_robot_state-npc2": 0.038894364467033975, "sim_compute_robot_state-npc3": 0.03920409771112295}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.11915843303386982, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.03616258731255165, "in-drivable-lane": 0, "agent_compute-ego": 0.08810020410097562, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.05430450806250939, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.02221673268538255, "sim_compute_performance-ego": 0.03860158186692458, "sim_compute_robot_state-ego": 0.04107754047100361, "sim_compute_robot_state-npc0": 0.03975388636955848, "sim_compute_robot_state-npc1": 0.03899177221151499, "sim_compute_robot_state-npc2": 0.03894628928257869, "sim_compute_robot_state-npc3": 0.03884713466350849}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.1080343398180875, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.03618157993663441, "in-drivable-lane": 0, "agent_compute-ego": 0.0869559266350486, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.05382627790624445, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.022132450884038753, "sim_compute_performance-ego": 0.039835485545071686, "sim_compute_robot_state-ego": 0.04047378626736728, "sim_compute_robot_state-npc0": 0.03993794051083652, "sim_compute_robot_state-npc1": 0.038779833100058815, "sim_compute_robot_state-npc2": 0.03846245462244207, "sim_compute_robot_state-npc3": 0.03857508572665128}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.09894132614135742, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.03547544479370117, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08710754871368408, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.05374613761901856, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.022300586700439457, "sim_compute_performance-ego": 0.038331708908081054, "sim_compute_robot_state-ego": 0.040228967666625974, "sim_compute_robot_state-npc0": 0.04044147968292236, "sim_compute_robot_state-npc1": 0.0392544412612915, "sim_compute_robot_state-npc2": 0.03890676975250244, "sim_compute_robot_state-npc3": 0.0387905216217041}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.10438625863257876, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.03546393171269843, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.08696058455933915, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.054314897415485786, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.022295959452365306, "sim_compute_performance-ego": 0.0379666343648383, "sim_compute_robot_state-ego": 0.040279824683006775, "sim_compute_robot_state-npc0": 0.03964665849158104, "sim_compute_robot_state-npc1": 0.03895927743708834, "sim_compute_robot_state-npc2": 0.03885722413976142, "sim_compute_robot_state-npc3": 0.03924124545239387}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.10048696169486412, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.035392545736753024, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.0868136057486901, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.05384903687697191, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.022197530819819525, "sim_compute_performance-ego": 0.038967325137211725, "sim_compute_robot_state-ego": 0.040309594227717474, "sim_compute_robot_state-npc0": 0.0405206955396212, "sim_compute_robot_state-npc1": 0.03914334223820613, "sim_compute_robot_state-npc2": 0.03875061181875376, "sim_compute_robot_state-npc3": 0.03891458878150353}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.10115135510762532, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.035282614117576966, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.0870331469036284, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.05382852327255976, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.02224156970069522, "sim_compute_performance-ego": 0.03798954827444894, "sim_compute_robot_state-ego": 0.040123573939005536, "sim_compute_robot_state-npc0": 0.03958408037821451, "sim_compute_robot_state-npc1": 0.038920749936785015, "sim_compute_robot_state-npc2": 0.03914700689769927, "sim_compute_robot_state-npc3": 0.039073971339634486}}
set_robot_commands_max	0.07394248305015194
set_robot_commands_mean	0.059173714243140794
set_robot_commands_median	0.054338615674238935
set_robot_commands_min	0.05374613761901856
sim_compute_performance-ego_max	0.053631062646514
sim_compute_performance-ego_mean	0.04238875091407369
sim_compute_performance-ego_median	0.039835485545071686
sim_compute_performance-ego_min	0.0379666343648383
sim_compute_robot_state-ego_max	0.05196744203567505
sim_compute_robot_state-ego_mean	0.043553912599716256
sim_compute_robot_state-ego_median	0.04047378626736728
sim_compute_robot_state-ego_min	0.040123573939005536
sim_compute_robot_state-npc0_max	0.05572871328557579
sim_compute_robot_state-npc0_mean	0.04387049378601039
sim_compute_robot_state-npc0_median	0.040367374877015985
sim_compute_robot_state-npc0_min	0.03958408037821451
sim_compute_robot_state-npc1_max	0.057449936866760254
sim_compute_robot_state-npc1_mean	0.04336538349617169
sim_compute_robot_state-npc1_median	0.0392544412612915
sim_compute_robot_state-npc1_min	0.038779833100058815
sim_compute_robot_state-npc2_max	0.05282719930013021
sim_compute_robot_state-npc2_mean	0.04268318816129994
sim_compute_robot_state-npc2_median	0.03914700689769927
sim_compute_robot_state-npc2_min	0.03846245462244207
sim_compute_robot_state-npc3_max	0.05138029635531231
sim_compute_robot_state-npc3_mean	0.042302587945240305
sim_compute_robot_state-npc3_median	0.03924124545239387
sim_compute_robot_state-npc3_min	0.03857508572665128
sim_compute_sim_state_max	0.029090251737427943
sim_compute_sim_state_mean	0.02418893816642309
sim_compute_sim_state_median	0.022460804535792425
sim_compute_sim_state_min	0.022132450884038753
sim_physics_max	0.1448084612687429
sim_physics_mean	0.11653667707544316
sim_physics_median	0.11132204879834814
sim_physics_min	0.09894132614135742
sim_render-ego_max	0.04701360915471049
sim_render-ego_mean	0.03927799229854402
sim_render-ego_median	0.03618157993663441
sim_render-ego_min	0.035282614117576966
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

21468

3164

Angel Woo 🇭🇰

Roasted duck

step1-simulation

success

aido2-AMOD-service_quality

2019-05-01 19:41:28+00:00

2019-05-01 19:51:32+00:00

0:10:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3469843068996177
survival_time_median	5.249999999999989
deviation-center-line_median	0.3073183948696125
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.1273355029878162
agent_compute-ego_mean	0.12503875004991652
agent_compute-ego_median	0.12459038654963175
agent_compute-ego_min	0.12394006628739208
deviation-center-line_max	0.8508939147056557
deviation-center-line_mean	0.41815376444419866
deviation-center-line_min	0.28047991410230216
deviation-heading_max	2.0789451327606305
deviation-heading_mean	1.7677784742023193
deviation-heading_median	1.8787843619783744
deviation-heading_min	1.0799516136348926
driven_any_max	1.092829462872696
driven_any_mean	0.5611117310162739
driven_any_median	0.3912360782722368
driven_any_min	0.19319242538978615
driven_lanedir_consec_max	1.0747418735491343
driven_lanedir_consec_mean	0.5020634950065043
driven_lanedir_consec_min	0.1771457454437826
driven_lanedir_max	1.0747418735491343
driven_lanedir_mean	0.5020634950065043
driven_lanedir_median	0.3469843068996177
driven_lanedir_min	0.1771457454437826
in-drivable-lane_max	1.550000000000022
in-drivable-lane_mean	0.3700000000000042
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.092829462872696, "sim_physics": 0.05941671848297119, "survival_time": 14.950000000000076, "driven_lanedir": 1.0747418735491343, "sim_render-ego": 0.037487085660298666, "in-drivable-lane": 0, "agent_compute-ego": 0.12459038654963175, "deviation-heading": 2.0789451327606305, "set_robot_commands": 0.0555642302831014, "deviation-center-line": 0.8508939147056557, "driven_lanedir_consec": 1.0747418735491343, "sim_compute_sim_state": 0.0243882950146993, "sim_compute_performance-ego": 0.03978006521860759, "sim_compute_robot_state-ego": 0.04103028217951456}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8257154880953131, "sim_physics": 0.05661429933539019, "survival_time": 10.650000000000016, "driven_lanedir": 0.6669629561151792, "sim_render-ego": 0.04042156649307466, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.12433633334200148, "deviation-heading": 1.8787843619783744, "set_robot_commands": 0.05549490507779547, "deviation-center-line": 0.361621453791084, "driven_lanedir_consec": 0.6669629561151792, "sim_compute_sim_state": 0.02356605910359414, "sim_compute_performance-ego": 0.04027161575818845, "sim_compute_robot_state-ego": 0.04232074621137879}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19319242538978615, "sim_physics": 0.05769525076213636, "survival_time": 2.849999999999998, "driven_lanedir": 0.1771457454437826, "sim_render-ego": 0.035763648518344814, "in-drivable-lane": 0, "agent_compute-ego": 0.12394006628739208, "deviation-heading": 1.0799516136348926, "set_robot_commands": 0.055745743868643775, "deviation-center-line": 0.3073183948696125, "driven_lanedir_consec": 0.1771457454437826, "sim_compute_sim_state": 0.02383069406475937, "sim_compute_performance-ego": 0.04034789821557831, "sim_compute_robot_state-ego": 0.040463991332472415}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.30258520045133747, "sim_physics": 0.060721653479116934, "survival_time": 4.049999999999994, "driven_lanedir": 0.24448259302480757, "sim_render-ego": 0.036864392551375025, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.12499146108274106, "deviation-heading": 1.995238934450004, "set_robot_commands": 0.055282551565288024, "deviation-center-line": 0.28047991410230216, "driven_lanedir_consec": 0.24448259302480757, "sim_compute_sim_state": 0.02360075785789961, "sim_compute_performance-ego": 0.04094513551688489, "sim_compute_robot_state-ego": 0.041194771542961216}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3912360782722368, "sim_physics": 0.05727074032738095, "survival_time": 5.249999999999989, "driven_lanedir": 0.3469843068996177, "sim_render-ego": 0.03698038827805292, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.1273355029878162, "deviation-heading": 1.8059723281876945, "set_robot_commands": 0.05782610575358073, "deviation-center-line": 0.29045514475233897, "driven_lanedir_consec": 0.3469843068996177, "sim_compute_sim_state": 0.02385658763703846, "sim_compute_performance-ego": 0.040279293060302736, "sim_compute_robot_state-ego": 0.04362854957580566}}
set_robot_commands_max	0.05782610575358073
set_robot_commands_mean	0.05598270730968188
set_robot_commands_median	0.0555642302831014
set_robot_commands_min	0.055282551565288024
sim_compute_performance-ego_max	0.04094513551688489
sim_compute_performance-ego_mean	0.0403248015539124
sim_compute_performance-ego_median	0.040279293060302736
sim_compute_performance-ego_min	0.03978006521860759
sim_compute_robot_state-ego_max	0.04362854957580566
sim_compute_robot_state-ego_mean	0.04172766816842653
sim_compute_robot_state-ego_median	0.041194771542961216
sim_compute_robot_state-ego_min	0.040463991332472415
sim_compute_sim_state_max	0.0243882950146993
sim_compute_sim_state_mean	0.02384847873559818
sim_compute_sim_state_median	0.02383069406475937
sim_compute_sim_state_min	0.02356605910359414
sim_physics_max	0.060721653479116934
sim_physics_mean	0.05834373247739912
sim_physics_median	0.05769525076213636
sim_physics_min	0.05661429933539019
sim_render-ego_max	0.04042156649307466
sim_render-ego_mean	0.037503416300229214
sim_render-ego_median	0.03698038827805292
sim_render-ego_min	0.035763648518344814
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.550000000000014
survival_time_min	2.849999999999998

No reset possible

21462

3160

Alexander Kleban

Python template

step1-simulation

success

yes

2019-05-01 17:48:33+00:00

2019-05-01 17:51:39+00:00

0:03:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

21445

3148

Anastasiya Nikolskaya 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-30 18:12:22+00:00

2019-04-30 18:34:52+00:00

0:22:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9914518035561424
survival_time_median	7.199999999999982
deviation-center-line_median	0.5482174238357636
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.06154879279758619
agent_compute-ego_mean	0.05866214724490917
agent_compute-ego_median	0.058969167868296306
agent_compute-ego_min	0.05473165273666382
deviation-center-line_max	1.1549293248363104
deviation-center-line_mean	0.6560872343499965
deviation-center-line_min	0.27566649158998696
deviation-heading_max	5.22185776945057
deviation-heading_mean	2.3124316949010417
deviation-heading_median	1.621570465411234
deviation-heading_min	0.4978438120666323
driven_any_max	2.3489924079737317
driven_any_mean	1.2679604101163109
driven_any_median	1.1035277340316625
driven_any_min	0.3642178234482664
driven_lanedir_consec_max	1.9639129987932065
driven_lanedir_consec_mean	0.9569362144302236
driven_lanedir_consec_min	0.2938457271940503
driven_lanedir_max	2.1132242040932425
driven_lanedir_mean	1.0820033214890112
driven_lanedir_median	1.043575427009693
driven_lanedir_min	0.35626751354370434
in-drivable-lane_max	2.8500000000000405
in-drivable-lane_mean	0.5633333333333372
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.341401142888106, "sim_physics": 0.06445955673853557, "survival_time": 14.950000000000076, "driven_lanedir": 1.910409896713289, "sim_render-ego": 0.03793974955876668, "in-drivable-lane": 1.100000000000005, "agent_compute-ego": 0.058969167868296306, "deviation-heading": 5.22185776945057, "set_robot_commands": 0.05665533542633057, "deviation-center-line": 1.1549293248363104, "driven_lanedir_consec": 0.9914518035561424, "sim_compute_sim_state": 0.02473978996276855, "sim_compute_performance-ego": 0.04130259116490682, "sim_compute_robot_state-ego": 0.04279916365941366}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6614334363496972, "sim_physics": 0.06691499506489615, "survival_time": 4.449999999999992, "driven_lanedir": 0.4640934824743561, "sim_render-ego": 0.03850770532415154, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.0595972484417176, "deviation-heading": 2.1621026545427737, "set_robot_commands": 0.055251266179459815, "deviation-center-line": 0.3875508947793393, "driven_lanedir_consec": 0.2938457271940503, "sim_compute_sim_state": 0.024468660354614254, "sim_compute_performance-ego": 0.04134774475954891, "sim_compute_robot_state-ego": 0.04301087775926912}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3642178234482664, "sim_physics": 0.06487685441970825, "survival_time": 2.5999999999999988, "driven_lanedir": 0.35626751354370434, "sim_render-ego": 0.037158007805164046, "in-drivable-lane": 0, "agent_compute-ego": 0.05843996543150682, "deviation-heading": 0.4978438120666323, "set_robot_commands": 0.05569258561501136, "deviation-center-line": 0.27566649158998696, "driven_lanedir_consec": 0.35626751354370434, "sim_compute_sim_state": 0.024899941224318285, "sim_compute_performance-ego": 0.0424469388448275, "sim_compute_robot_state-ego": 0.04224674976789034}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1035277340316625, "sim_physics": 0.06722839507791731, "survival_time": 7.199999999999982, "driven_lanedir": 1.043575427009693, "sim_render-ego": 0.037779261668523155, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.05660428603490194, "deviation-heading": 1.5274060299708705, "set_robot_commands": 0.05580153730180529, "deviation-center-line": 0.634358446664162, "driven_lanedir_consec": 1.043575427009693, "sim_compute_sim_state": 0.02463195224603017, "sim_compute_performance-ego": 0.041647871335347496, "sim_compute_robot_state-ego": 0.043010744783613414}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2963448385328344, "sim_physics": 0.06186861509368533, "survival_time": 8.399999999999984, "driven_lanedir": 1.1268758095828502, "sim_render-ego": 0.03802173478262765, "in-drivable-lane": 0.4000000000000048, "agent_compute-ego": 0.060507457880746754, "deviation-heading": 2.4791529897198132, "set_robot_commands": 0.05557915852183387, "deviation-center-line": 0.46184479555842567, "driven_lanedir_consec": 1.1268758095828502, "sim_compute_sim_state": 0.025056095350356328, "sim_compute_performance-ego": 0.041422506173451744, "sim_compute_robot_state-ego": 0.04387692326591128}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.348852620013533, "sim_physics": 0.0639325992266337, "survival_time": 14.950000000000076, "driven_lanedir": 1.7431548850278498, "sim_render-ego": 0.03774898131688436, "in-drivable-lane": 2.4000000000000075, "agent_compute-ego": 0.058240938981374106, "deviation-heading": 4.788984007078123, "set_robot_commands": 0.05512742837270101, "deviation-center-line": 1.033990625937084, "driven_lanedir_consec": 1.2058766617957308, "sim_compute_sim_state": 0.024862957795461015, "sim_compute_performance-ego": 0.04153526782989502, "sim_compute_robot_state-ego": 0.043649100462595625}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7579564038770219, "sim_physics": 0.060833765728638904, "survival_time": 5.04999999999999, "driven_lanedir": 0.6949633516763912, "sim_render-ego": 0.03755519177654002, "in-drivable-lane": 0, "agent_compute-ego": 0.05965355599280631, "deviation-heading": 1.5306961654978168, "set_robot_commands": 0.05488526230991477, "deviation-center-line": 0.3096478467765337, "driven_lanedir_consec": 0.6949633516763912, "sim_compute_sim_state": 0.02439521326877103, "sim_compute_performance-ego": 0.04096208232464177, "sim_compute_robot_state-ego": 0.04255768096092904}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.5374374128862014, "sim_physics": 0.06334417757361827, "survival_time": 9.900000000000006, "driven_lanedir": 1.359438187508489, "sim_render-ego": 0.037913763161861534, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.0603054328398271, "deviation-heading": 2.5980013889217637, "set_robot_commands": 0.05467716371170198, "deviation-center-line": 0.9298986577524728, "driven_lanedir_consec": 1.359438187508489, "sim_compute_sim_state": 0.025032558826485064, "sim_compute_performance-ego": 0.04248077821249914, "sim_compute_robot_state-ego": 0.04282891148268574}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.4249683891755474, "sim_physics": 0.060494465672451515, "survival_time": 9.199999999999996, "driven_lanedir": 1.3956472004325238, "sim_render-ego": 0.037342764761136925, "in-drivable-lane": 0, "agent_compute-ego": 0.05576889022536899, "deviation-heading": 1.621570465411234, "set_robot_commands": 0.05504650136698847, "deviation-center-line": 0.9126230182500316, "driven_lanedir_consec": 1.3956472004325238, "sim_compute_sim_state": 0.02457206145576809, "sim_compute_performance-ego": 0.0410524308681488, "sim_compute_robot_state-ego": 0.04270218377527983}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5008166923158887, "sim_physics": 0.0618967284326968, "survival_time": 3.4499999999999957, "driven_lanedir": 0.4458441241922335, "sim_render-ego": 0.03788173025932865, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06154879279758619, "deviation-heading": 0.7591340945096213, "set_robot_commands": 0.05439400327378425, "deviation-center-line": 0.29795337218661855, "driven_lanedir_consec": 0.4458441241922335, "sim_compute_sim_state": 0.02485956316408904, "sim_compute_performance-ego": 0.040931411411451256, "sim_compute_robot_state-ego": 0.042496774507605514}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7338793017752316, "sim_physics": 0.06467451611343696, "survival_time": 4.899999999999991, "driven_lanedir": 0.7261903220114927, "sim_render-ego": 0.03753080416698845, "in-drivable-lane": 0, "agent_compute-ego": 0.06019243415521116, "deviation-heading": 0.5849673074380232, "set_robot_commands": 0.061560689186563294, "deviation-center-line": 0.5482174238357636, "driven_lanedir_consec": 0.7261903220114927, "sim_compute_sim_state": 0.024547095201453383, "sim_compute_performance-ego": 0.04084647188381273, "sim_compute_robot_state-ego": 0.04291250267807318}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5008191431794814, "sim_physics": 0.06412624967271004, "survival_time": 3.4499999999999957, "driven_lanedir": 0.44722153824804034, "sim_render-ego": 0.03775756946508435, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06090278556381447, "deviation-heading": 0.7920243769762986, "set_robot_commands": 0.055588632390119026, "deviation-center-line": 0.29627888798551183, "driven_lanedir_consec": 0.44722153824804034, "sim_compute_sim_state": 0.02430491516555565, "sim_compute_performance-ego": 0.040826966797096145, "sim_compute_robot_state-ego": 0.04262080399886421}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.3489924079737317, "sim_physics": 0.0606184728940328, "survival_time": 14.950000000000076, "driven_lanedir": 2.1132242040932425, "sim_render-ego": 0.037612547079722086, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.05731197198232015, "deviation-heading": 4.796992706882113, "set_robot_commands": 0.054840238094329835, "deviation-center-line": 1.106000759837224, "driven_lanedir_consec": 1.9639129987932065, "sim_compute_sim_state": 0.024397624333699543, "sim_compute_performance-ego": 0.04205873727798462, "sim_compute_robot_state-ego": 0.04268139123916626}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.7499498946440516, "sim_physics": 0.061876151561737064, "survival_time": 4.99999999999999, "driven_lanedir": 0.736007772718966, "sim_render-ego": 0.037626523971557614, "in-drivable-lane": 0, "agent_compute-ego": 0.05473165273666382, "deviation-heading": 0.8542178431466543, "set_robot_commands": 0.05538791179656982, "deviation-center-line": 0.4484620184176361, "driven_lanedir_consec": 0.736007772718966, "sim_compute_sim_state": 0.024517600536346437, "sim_compute_performance-ego": 0.04120627641677856, "sim_compute_robot_state-ego": 0.042646360397338864}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.348808910653408, "sim_physics": 0.06421884934107462, "survival_time": 14.950000000000076, "driven_lanedir": 1.6671361071020454, "sim_render-ego": 0.03776227871576945, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.05715762774149577, "deviation-heading": 4.471523811903315, "set_robot_commands": 0.0556183115641276, "deviation-center-line": 1.043885950842846, "driven_lanedir_consec": 1.566924778189836, "sim_compute_sim_state": 0.024765522480010987, "sim_compute_performance-ego": 0.04098934014638265, "sim_compute_robot_state-ego": 0.04246569474538167}}
set_robot_commands_max	0.061560689186563294
set_robot_commands_mean	0.05574040167408272
set_robot_commands_median	0.05538791179656982
set_robot_commands_min	0.05439400327378425
sim_compute_performance-ego_max	0.04248077821249914
sim_compute_performance-ego_mean	0.041403827696451546
sim_compute_performance-ego_median	0.04130259116490682
sim_compute_performance-ego_min	0.040826966797096145
sim_compute_robot_state-ego_max	0.04387692326591128
sim_compute_robot_state-ego_mean	0.04283372423226785
sim_compute_robot_state-ego_median	0.04270218377527983
sim_compute_robot_state-ego_min	0.04224674976789034
sim_compute_sim_state_max	0.025056095350356328
sim_compute_sim_state_mean	0.02467010342438186
sim_compute_sim_state_median	0.02463195224603017
sim_compute_sim_state_min	0.02430491516555565
sim_physics_max	0.06722839507791731
sim_physics_mean	0.0634242928407849
sim_physics_median	0.0639325992266337
sim_physics_min	0.060494465672451515
sim_render-ego_max	0.03850770532415154
sim_render-ego_mean	0.03774257425427377
sim_render-ego_median	0.03775756946508435
sim_render-ego_min	0.037158007805164046
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.22666666666668
survival_time_min	2.5999999999999988

No reset possible

21435

3145

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-30 15:14:36+00:00

2019-04-30 15:33:10+00:00

0:18:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.11971490822949456
agent_compute-ego_mean	0.09815898108472054
agent_compute-ego_median	0.09195340156555176
agent_compute-ego_min	0.08757725587257972
deviation-center-line_max	0.5141120095458062
deviation-center-line_mean	0.1769000227005324
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.9929437250081896
deviation-heading_mean	0.692977823395608
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.5343244022418343
driven_any_mean	1.3470385992234175
driven_any_median	1.001633421251194
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.494308053441959
driven_lanedir_consec_mean	0.881391085527715
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.494308053441959
driven_lanedir_mean	0.8962528018383226
driven_lanedir_median	0.7206363324756615
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.13716640653489512, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.049434037148198, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11042831215677382, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.06784438181527053, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.0282882346382624, "sim_compute_performance-ego": 0.04825026174134846, "sim_compute_robot_state-ego": 0.05489301983314224, "sim_compute_robot_state-npc0": 0.050183389760270904, "sim_compute_robot_state-npc1": 0.05031887790824793, "sim_compute_robot_state-npc2": 0.04935928839671461, "sim_compute_robot_state-npc3": 0.04906127724466445}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.1385188102722168, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.042606311185019355, "in-drivable-lane": 0, "agent_compute-ego": 0.10849771329334804, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.06800764799118042, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.028542748519352505, "sim_compute_performance-ego": 0.044943502971104214, "sim_compute_robot_state-ego": 0.04970212493624006, "sim_compute_robot_state-npc0": 0.04953763314655849, "sim_compute_robot_state-npc1": 0.04815731729779925, "sim_compute_robot_state-npc2": 0.04793615000588553, "sim_compute_robot_state-npc3": 0.048108109406062534}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.14176954112006623, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.04769153270906615, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.11971490822949456, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07282648966150376, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.031014572069482896, "sim_compute_performance-ego": 0.05034355052466531, "sim_compute_robot_state-ego": 0.052476429244846974, "sim_compute_robot_state-npc0": 0.05616254482454466, "sim_compute_robot_state-npc1": 0.054611449102753576, "sim_compute_robot_state-npc2": 0.05428511425129418, "sim_compute_robot_state-npc3": 0.053967739771870735}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.14928274850050607, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.047462448477745056, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.11722981929779051, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07265906035900116, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03250265618165334, "sim_compute_performance-ego": 0.05518214901288351, "sim_compute_robot_state-ego": 0.05518616239229838, "sim_compute_robot_state-npc0": 0.053940470019976296, "sim_compute_robot_state-npc1": 0.054489120841026306, "sim_compute_robot_state-npc2": 0.05384333928426107, "sim_compute_robot_state-npc3": 0.05585878590742747}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1471715995243617, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04498370488484701, "in-drivable-lane": 0, "agent_compute-ego": 0.11081417401631671, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.06951508067903064, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03211193992978051, "sim_compute_performance-ego": 0.048916532879783994, "sim_compute_robot_state-ego": 0.05034615879967099, "sim_compute_robot_state-npc0": 0.048187914348783945, "sim_compute_robot_state-npc1": 0.050111884162539526, "sim_compute_robot_state-npc2": 0.056607019333612354, "sim_compute_robot_state-npc3": 0.053315741675240655}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.11579566944145156, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.03919615145928845, "in-drivable-lane": 2, "agent_compute-ego": 0.09662273544037414, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.05854253283517803, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.025399495027736276, "sim_compute_performance-ego": 0.04209602949861995, "sim_compute_robot_state-ego": 0.04317239373030063, "sim_compute_robot_state-npc0": 0.044149483035424514, "sim_compute_robot_state-npc1": 0.043637858179514995, "sim_compute_robot_state-npc2": 0.043894092479865705, "sim_compute_robot_state-npc3": 0.0430588907824305}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.11358720122031796, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.0373881765939657, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08918102505137619, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.05960192958128105, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.02383641594821967, "sim_compute_performance-ego": 0.04021765884843845, "sim_compute_robot_state-ego": 0.04148388371884244, "sim_compute_robot_state-npc0": 0.04156775613432949, "sim_compute_robot_state-npc1": 0.04079631925786583, "sim_compute_robot_state-npc2": 0.04060621863429986, "sim_compute_robot_state-npc3": 0.041048360102384995}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.12102121829986572, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.03718843460083008, "in-drivable-lane": 0, "agent_compute-ego": 0.08922771453857421, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.055349264144897464, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.02369203567504883, "sim_compute_performance-ego": 0.03977834701538086, "sim_compute_robot_state-ego": 0.0471280574798584, "sim_compute_robot_state-npc0": 0.04121835708618164, "sim_compute_robot_state-npc1": 0.040769615173339845, "sim_compute_robot_state-npc2": 0.04189007759094238, "sim_compute_robot_state-npc3": 0.04087158203125}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.10525366893181434, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.03752008768228384, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.0897532793191763, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.05545299328290499, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.02386924853691688, "sim_compute_performance-ego": 0.040302203251765326, "sim_compute_robot_state-ego": 0.04553395968217116, "sim_compute_robot_state-npc0": 0.0411489330805265, "sim_compute_robot_state-npc1": 0.040959408650031455, "sim_compute_robot_state-npc2": 0.04083969501348642, "sim_compute_robot_state-npc3": 0.04099723008962778}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.12932024552271917, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.03963512640732985, "in-drivable-lane": 0, "agent_compute-ego": 0.09599724182715784, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.0557262714092548, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.024259172953092135, "sim_compute_performance-ego": 0.03999800865466778, "sim_compute_robot_state-ego": 0.04136202885554387, "sim_compute_robot_state-npc0": 0.04116739676548885, "sim_compute_robot_state-npc1": 0.04088598031264085, "sim_compute_robot_state-npc2": 0.04072228761819693, "sim_compute_robot_state-npc3": 0.04085811284872202}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.11604588682001288, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.03785796598954634, "in-drivable-lane": 0, "agent_compute-ego": 0.08914517272602428, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.05484531142494895, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.02391176873987371, "sim_compute_performance-ego": 0.04005954482338645, "sim_compute_robot_state-ego": 0.04129953817887739, "sim_compute_robot_state-npc0": 0.0410001819783991, "sim_compute_robot_state-npc1": 0.04079794883728027, "sim_compute_robot_state-npc2": 0.04049401933496648, "sim_compute_robot_state-npc3": 0.041112661361694336}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.10475720882415772, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.037283315658569335, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.09195340156555176, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.05580208778381348, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.024075517654418944, "sim_compute_performance-ego": 0.03999893188476562, "sim_compute_robot_state-ego": 0.0414771318435669, "sim_compute_robot_state-npc0": 0.04137904167175293, "sim_compute_robot_state-npc1": 0.041015911102294925, "sim_compute_robot_state-npc2": 0.04076975822448731, "sim_compute_robot_state-npc3": 0.05052807807922363}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.1098555123552363, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.03742308819547613, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.08825405861469025, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.05569633270831818, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.024011010819293084, "sim_compute_performance-ego": 0.0407095361263194, "sim_compute_robot_state-ego": 0.04143683200186871, "sim_compute_robot_state-npc0": 0.04115035432450315, "sim_compute_robot_state-npc1": 0.04096870219453852, "sim_compute_robot_state-npc2": 0.04064765382320323, "sim_compute_robot_state-npc3": 0.0409841740385015}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.10726426197932316, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.03704586854347816, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.08757725587257972, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.05510913408719576, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.02370785749875582, "sim_compute_performance-ego": 0.039516875377068154, "sim_compute_robot_state-ego": 0.04114452233681312, "sim_compute_robot_state-npc0": 0.04122254481682411, "sim_compute_robot_state-npc1": 0.04182015932523287, "sim_compute_robot_state-npc2": 0.04019270951931293, "sim_compute_robot_state-npc3": 0.040635342781360335}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.10714112463451568, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.03743889899480911, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.08798790432157971, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.054805814652215866, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.02387214842296782, "sim_compute_performance-ego": 0.039737126940772645, "sim_compute_robot_state-ego": 0.04123052869524275, "sim_compute_robot_state-npc0": 0.04150993937537784, "sim_compute_robot_state-npc1": 0.041583801451183504, "sim_compute_robot_state-npc2": 0.040452371324811665, "sim_compute_robot_state-npc3": 0.0406380744207473}}
set_robot_commands_max	0.07282648966150376
set_robot_commands_mean	0.06078562216106634
set_robot_commands_median	0.05580208778381348
set_robot_commands_min	0.054805814652215866
sim_compute_performance-ego_max	0.05518214901288351
sim_compute_performance-ego_mean	0.04333668397006469
sim_compute_performance-ego_median	0.040302203251765326
sim_compute_performance-ego_min	0.039516875377068154
sim_compute_robot_state-ego_max	0.05518616239229838
sim_compute_robot_state-ego_mean	0.04585818478195228
sim_compute_robot_state-ego_median	0.04317239373030063
sim_compute_robot_state-ego_min	0.04114452233681312
sim_compute_robot_state-npc0_max	0.05616254482454466
sim_compute_robot_state-npc0_mean	0.04490172935792948
sim_compute_robot_state-npc0_median	0.04150993937537784
sim_compute_robot_state-npc0_min	0.0410001819783991
sim_compute_robot_state-npc1_max	0.054611449102753576
sim_compute_robot_state-npc1_mean	0.04472829025308597
sim_compute_robot_state-npc1_median	0.041583801451183504
sim_compute_robot_state-npc1_min	0.040769615173339845
sim_compute_robot_state-npc2_max	0.056607019333612354
sim_compute_robot_state-npc2_mean	0.044835986322356046
sim_compute_robot_state-npc2_median	0.04083969501348642
sim_compute_robot_state-npc2_min	0.04019270951931293
sim_compute_robot_state-npc3_max	0.05585878590742747
sim_compute_robot_state-npc3_mean	0.04540294403608056
sim_compute_robot_state-npc3_median	0.041112661361694336
sim_compute_robot_state-npc3_min	0.040635342781360335
sim_compute_sim_state_max	0.03250265618165334
sim_compute_sim_state_mean	0.026206321507656987
sim_compute_sim_state_median	0.024075517654418944
sim_compute_sim_state_min	0.02369203567504883
sim_physics_max	0.14928274850050607
sim_physics_mean	0.12293007359876404
sim_physics_median	0.11604588682001288
sim_physics_min	0.10475720882415772
sim_render-ego_max	0.049434037148198
sim_render-ego_mean	0.040677009902030166
sim_render-ego_median	0.03785796598954634
sim_render-ego_min	0.03704586854347816
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

21433

3134

Amaury Camus 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

2019-04-30 14:54:11+00:00

2019-04-30 14:54:43+00:00

0:00:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.1053066938706594
error_L2	0.017717307653598375

No reset possible

21423

3125

Rami Al-Naim 🇷🇺

[0.35;0.75]

step1-simulation

success

2019-04-29 14:07:41+00:00

2019-04-29 14:16:02+00:00

0:08:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6382908517619432
survival_time_median	8.449999999999985
deviation-center-line_median	0.7020216560985275
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.08101122796872241
agent_compute-ego_mean	0.0790298765949238
agent_compute-ego_median	0.08066507345120583
agent_compute-ego_min	0.07583670117961827
deviation-center-line_max	1.2921377241268523
deviation-center-line_mean	0.692052188588834
deviation-center-line_min	0.29412523591806844
deviation-heading_max	4.313266459456157
deviation-heading_mean	1.757179783008871
deviation-heading_median	1.3658461538318751
deviation-heading_min	0.30887069722993316
driven_any_max	3.5746669592804254
driven_any_mean	1.884824617175888
driven_any_median	1.984995159214791
driven_any_min	0.7376871652879832
driven_lanedir_consec_max	2.8135482799771823
driven_lanedir_consec_mean	1.587722210748803
driven_lanedir_consec_min	0.734468095924476
driven_lanedir_max	2.8135482799771823
driven_lanedir_mean	1.587722210748803
driven_lanedir_median	1.6382908517619432
driven_lanedir_min	0.734468095924476
in-drivable-lane_max	2.10000000000003
in-drivable-lane_mean	0.8500000000000073
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0711695681860216, "sim_physics": 0.0645474579374669, "survival_time": 8.84999999999999, "driven_lanedir": 1.6382908517619432, "sim_render-ego": 0.03832734506682488, "in-drivable-lane": 1.3500000000000094, "agent_compute-ego": 0.08101122796872241, "deviation-heading": 1.740696182229741, "set_robot_commands": 0.056248713347871425, "deviation-center-line": 0.7020216560985275, "driven_lanedir_consec": 1.6382908517619432, "sim_compute_sim_state": 0.02506750316943153, "sim_compute_performance-ego": 0.04151254993374065, "sim_compute_robot_state-ego": 0.042759919570664225}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.055604233910218, "sim_physics": 0.059761129399781586, "survival_time": 4.6499999999999915, "driven_lanedir": 0.8124942431886749, "sim_render-ego": 0.039442508451400266, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07695396997595347, "deviation-heading": 1.057219422296649, "set_robot_commands": 0.056086832477200414, "deviation-center-line": 0.29412523591806844, "driven_lanedir_consec": 0.8124942431886749, "sim_compute_sim_state": 0.024654583264422672, "sim_compute_performance-ego": 0.04113680316555885, "sim_compute_robot_state-ego": 0.04341783062104256}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7376871652879832, "sim_physics": 0.061543325879680574, "survival_time": 3.349999999999996, "driven_lanedir": 0.734468095924476, "sim_render-ego": 0.03810662653908801, "in-drivable-lane": 0, "agent_compute-ego": 0.07583670117961827, "deviation-heading": 0.30887069722993316, "set_robot_commands": 0.056801361824149514, "deviation-center-line": 0.3781987713890312, "driven_lanedir_consec": 0.734468095924476, "sim_compute_sim_state": 0.025115347620266588, "sim_compute_performance-ego": 0.04177557888315685, "sim_compute_robot_state-ego": 0.0432794841367807}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.5746669592804254, "sim_physics": 0.0647878352801005, "survival_time": 14.950000000000076, "driven_lanedir": 2.8135482799771823, "sim_render-ego": 0.0379798690478007, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.08068241039911905, "deviation-heading": 4.313266459456157, "set_robot_commands": 0.05626055717468262, "deviation-center-line": 1.2921377241268523, "driven_lanedir_consec": 2.8135482799771823, "sim_compute_sim_state": 0.02481385707855225, "sim_compute_performance-ego": 0.04135525465011597, "sim_compute_robot_state-ego": 0.0425331711769104}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.984995159214791, "sim_physics": 0.06149942917231272, "survival_time": 8.449999999999985, "driven_lanedir": 1.939809582891738, "sim_render-ego": 0.03816461845262517, "in-drivable-lane": 0, "agent_compute-ego": 0.08066507345120583, "deviation-heading": 1.3658461538318751, "set_robot_commands": 0.055588699656830734, "deviation-center-line": 0.7937775554116906, "driven_lanedir_consec": 1.939809582891738, "sim_compute_sim_state": 0.025090757911727272, "sim_compute_performance-ego": 0.04139789462794919, "sim_compute_robot_state-ego": 0.04296076227221968}}
set_robot_commands_max	0.056801361824149514
set_robot_commands_mean	0.05619723289614694
set_robot_commands_median	0.056248713347871425
set_robot_commands_min	0.055588699656830734
sim_compute_performance-ego_max	0.04177557888315685
sim_compute_performance-ego_mean	0.041435616252104304
sim_compute_performance-ego_median	0.04139789462794919
sim_compute_performance-ego_min	0.04113680316555885
sim_compute_robot_state-ego_max	0.04341783062104256
sim_compute_robot_state-ego_mean	0.04299023355552352
sim_compute_robot_state-ego_median	0.04296076227221968
sim_compute_robot_state-ego_min	0.0425331711769104
sim_compute_sim_state_max	0.025115347620266588
sim_compute_sim_state_mean	0.024948409808880054
sim_compute_sim_state_median	0.02506750316943153
sim_compute_sim_state_min	0.024654583264422672
sim_physics_max	0.0647878352801005
sim_physics_mean	0.06242783553386846
sim_physics_median	0.061543325879680574
sim_physics_min	0.059761129399781586
sim_render-ego_max	0.039442508451400266
sim_render-ego_mean	0.03840419351154781
sim_render-ego_median	0.03816461845262517
sim_render-ego_min	0.0379798690478007
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.050000000000008
survival_time_min	3.349999999999996

No reset possible

21421

3123

Rami Al-Naim 🇷🇺

[1;0.6]

step1-simulation

success

2019-04-29 13:19:36+00:00

2019-04-29 13:31:03+00:00

0:11:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.2971398688438205
survival_time_median	14.950000000000076
deviation-center-line_median	1.1289689758008865
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08119676828384399
agent_compute-ego_mean	0.07893367324645388
agent_compute-ego_median	0.07868190134985972
agent_compute-ego_min	0.07632166862487794
deviation-center-line_max	1.2949626659874092
deviation-center-line_mean	0.9900846509881448
deviation-center-line_min	0.20106101588658865
deviation-heading_max	2.2295920528984157
deviation-heading_mean	1.733705473844407
deviation-heading_median	1.712046308821216
deviation-heading_min	0.980636829679724
driven_any_max	2.349162072670132
driven_any_mean	1.879913989190915
driven_any_median	2.3414919915972088
driven_any_min	0.4204689020510484
driven_lanedir_consec_max	2.32206871678619
driven_lanedir_consec_mean	1.7969747825970674
driven_lanedir_consec_min	0.3958672443061859
driven_lanedir_max	2.32206871678619
driven_lanedir_mean	1.7969747825970674
driven_lanedir_median	2.2971398688438205
driven_lanedir_min	0.3958672443061859
in-drivable-lane_max	1.450000000000018
in-drivable-lane_mean	0.2900000000000036
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3414919915972088, "sim_physics": 0.05834760983784994, "survival_time": 14.950000000000076, "driven_lanedir": 2.2997161357760287, "sim_render-ego": 0.037949021657307944, "in-drivable-lane": 0, "agent_compute-ego": 0.08031742970148723, "deviation-heading": 2.2295920528984157, "set_robot_commands": 0.05686974684397379, "deviation-center-line": 1.2638245341358152, "driven_lanedir_consec": 2.2997161357760287, "sim_compute_sim_state": 0.024550413290659587, "sim_compute_performance-ego": 0.040843342940012614, "sim_compute_robot_state-ego": 0.04269713719685873}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.349162072670132, "sim_physics": 0.059401676654815674, "survival_time": 14.950000000000076, "driven_lanedir": 2.2971398688438205, "sim_render-ego": 0.03730950673421224, "in-drivable-lane": 0, "agent_compute-ego": 0.07632166862487794, "deviation-heading": 2.1528379003660305, "set_robot_commands": 0.057263902028401696, "deviation-center-line": 1.2949626659874092, "driven_lanedir_consec": 2.2971398688438205, "sim_compute_sim_state": 0.02466272036234538, "sim_compute_performance-ego": 0.04097137451171875, "sim_compute_robot_state-ego": 0.04277988354365031}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9393124185136716, "sim_physics": 0.06160917109058749, "survival_time": 12.40000000000004, "driven_lanedir": 1.6700819472731117, "sim_render-ego": 0.03704632770630621, "in-drivable-lane": 1.450000000000018, "agent_compute-ego": 0.07815059827220056, "deviation-heading": 1.712046308821216, "set_robot_commands": 0.05981907921452676, "deviation-center-line": 1.1289689758008865, "driven_lanedir_consec": 1.6700819472731117, "sim_compute_sim_state": 0.024828074439879385, "sim_compute_performance-ego": 0.040704193615144296, "sim_compute_robot_state-ego": 0.04289096017037669}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4204689020510484, "sim_physics": 0.0642391786736957, "survival_time": 2.9499999999999975, "driven_lanedir": 0.3958672443061859, "sim_render-ego": 0.03792144080339852, "in-drivable-lane": 0, "agent_compute-ego": 0.07868190134985972, "deviation-heading": 0.980636829679724, "set_robot_commands": 0.05740311186192399, "deviation-center-line": 0.20106101588658865, "driven_lanedir_consec": 0.3958672443061859, "sim_compute_sim_state": 0.02496391231730833, "sim_compute_performance-ego": 0.04098071486262952, "sim_compute_robot_state-ego": 0.042814234555777854}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491345611225145, "sim_physics": 0.06322062174479166, "survival_time": 14.950000000000076, "driven_lanedir": 2.32206871678619, "sim_render-ego": 0.03741543134053548, "in-drivable-lane": 0, "agent_compute-ego": 0.08119676828384399, "deviation-heading": 1.593414277456649, "set_robot_commands": 0.056598188877105715, "deviation-center-line": 1.0616060631300237, "driven_lanedir_consec": 2.32206871678619, "sim_compute_sim_state": 0.02468753735224406, "sim_compute_performance-ego": 0.041606345971425374, "sim_compute_robot_state-ego": 0.04342292467753092}}
set_robot_commands_max	0.05981907921452676
set_robot_commands_mean	0.05759080576518638
set_robot_commands_median	0.057263902028401696
set_robot_commands_min	0.056598188877105715
sim_compute_performance-ego_max	0.041606345971425374
sim_compute_performance-ego_mean	0.04102119438018611
sim_compute_performance-ego_median	0.04097137451171875
sim_compute_performance-ego_min	0.040704193615144296
sim_compute_robot_state-ego_max	0.04342292467753092
sim_compute_robot_state-ego_mean	0.042921028028838897
sim_compute_robot_state-ego_median	0.042814234555777854
sim_compute_robot_state-ego_min	0.04269713719685873
sim_compute_sim_state_max	0.02496391231730833
sim_compute_sim_state_mean	0.02473853155248735
sim_compute_sim_state_median	0.02468753735224406
sim_compute_sim_state_min	0.024550413290659587
sim_physics_max	0.0642391786736957
sim_physics_mean	0.06136365160034809
sim_physics_median	0.06160917109058749
sim_physics_min	0.05834760983784994
sim_render-ego_max	0.037949021657307944
sim_render-ego_mean	0.03752834564835208
sim_render-ego_median	0.03741543134053548
sim_render-ego_min	0.03704632770630621
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.040000000000054
survival_time_min	2.9499999999999975

No reset possible

21387

2377

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-28 02:02:39+00:00

2019-04-28 02:28:33+00:00

0:25:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4295977528045558
survival_time_median	3.7499999999999942
deviation-center-line_median	0.16525966154163726
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.0770364387615307
agent_compute-ego_mean	0.057509734431385746
agent_compute-ego_median	0.06015277562076098
agent_compute-ego_min	0.038903943953975555
deviation-center-line_max	0.44830395948846297
deviation-center-line_mean	0.17891237550140934
deviation-center-line_min	0.10012774388669717
deviation-heading_max	1.272726254754917
deviation-heading_mean	0.5883512828498624
deviation-heading_median	0.5156622477370731
deviation-heading_min	0.2495279988048577
driven_any_max	2.0298273185719493
driven_any_mean	1.0098349503422042
driven_any_median	1.0248273191286312
driven_any_min	0.3648701917101209
driven_lanedir_consec_max	1.211071354427033
driven_lanedir_consec_mean	0.6125599618319294
driven_lanedir_consec_min	0.32721267753615213
driven_lanedir_max	1.211071354427033
driven_lanedir_mean	0.6125599618319294
driven_lanedir_median	0.4295977528045558
driven_lanedir_min	0.32721267753615213
in-drivable-lane_max	4.249999999999985
in-drivable-lane_mean	1.2033333333333296
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.16649406576809817, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.05887701086802025, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06015277562076098, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.08578889990506107, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.04021970213276066, "sim_compute_performance-ego": 0.06489077006300835, "sim_compute_robot_state-ego": 0.06835901573912738, "sim_compute_robot_state-npc0": 0.06363469933810299, "sim_compute_robot_state-npc1": 0.06378420411723934, "sim_compute_robot_state-npc2": 0.06696074302882364, "sim_compute_robot_state-npc3": 0.06793180230545671}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.23679212621740392, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.06895084638853331, "in-drivable-lane": 0, "agent_compute-ego": 0.0770364387615307, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.1064649723671578, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.04126825848141232, "sim_compute_performance-ego": 0.07771018389109019, "sim_compute_robot_state-ego": 0.08650564503025364, "sim_compute_robot_state-npc0": 0.07694942886764938, "sim_compute_robot_state-npc1": 0.07480725082191261, "sim_compute_robot_state-npc2": 0.07218692753766034, "sim_compute_robot_state-npc3": 0.07242778185251597}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.16807234500135695, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.060538098216056824, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06337783166340419, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.09137873351573944, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.0391198992729187, "sim_compute_performance-ego": 0.06647387359823499, "sim_compute_robot_state-ego": 0.07062806614807673, "sim_compute_robot_state-npc0": 0.06840919171060834, "sim_compute_robot_state-npc1": 0.06996676751545497, "sim_compute_robot_state-npc2": 0.06781424794878278, "sim_compute_robot_state-npc3": 0.06890262024743217}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.17962517482893808, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.06221624783107212, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06374616282326835, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.09468493929931096, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03873231794152941, "sim_compute_performance-ego": 0.06920555446829114, "sim_compute_robot_state-ego": 0.07623445349080223, "sim_compute_robot_state-npc0": 0.0739156688962664, "sim_compute_robot_state-npc1": 0.06972860012735639, "sim_compute_robot_state-npc2": 0.06869923642703465, "sim_compute_robot_state-npc3": 0.06818052700587682}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.1689397320151329, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.060450479388237, "in-drivable-lane": 0, "agent_compute-ego": 0.062499985098838806, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.08713975548744202, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.042455583810806274, "sim_compute_performance-ego": 0.06498999148607254, "sim_compute_robot_state-ego": 0.062368281185626984, "sim_compute_robot_state-npc0": 0.06633366644382477, "sim_compute_robot_state-npc1": 0.06776758283376694, "sim_compute_robot_state-npc2": 0.07079368829727173, "sim_compute_robot_state-npc3": 0.06837848573923111}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0548273189057833, "sim_physics": 0.15785466231308976, "survival_time": 3.8499999999999943, "driven_lanedir": 0.3963714216744775, "sim_render-ego": 0.06120649251070889, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.059113326010765965, "deviation-heading": 1.272726254754917, "set_robot_commands": 0.08587037742911995, "deviation-center-line": 0.20372147663934215, "driven_lanedir_consec": 0.3963714216744775, "sim_compute_sim_state": 0.03646212119560737, "sim_compute_performance-ego": 0.06724703157102907, "sim_compute_robot_state-ego": 0.07246013740440468, "sim_compute_robot_state-npc0": 0.06561597601159827, "sim_compute_robot_state-npc1": 0.06377976900571353, "sim_compute_robot_state-npc2": 0.06519649864791276, "sim_compute_robot_state-npc3": 0.06624502949900442}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9948273195001682, "sim_physics": 0.1759440245693677, "survival_time": 3.649999999999995, "driven_lanedir": 0.6530046235032079, "sim_render-ego": 0.06675443910572627, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06760218045482896, "deviation-heading": 0.8187446392859457, "set_robot_commands": 0.10006716479993846, "deviation-center-line": 0.19436286934102945, "driven_lanedir_consec": 0.6530046235032079, "sim_compute_sim_state": 0.03984018547894203, "sim_compute_performance-ego": 0.07263155506081777, "sim_compute_robot_state-ego": 0.07814266910291698, "sim_compute_robot_state-npc0": 0.07245215977707954, "sim_compute_robot_state-npc1": 0.06997476538566694, "sim_compute_robot_state-npc2": 0.07173074108280547, "sim_compute_robot_state-npc3": 0.07201003048517933}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.0298273185719493, "sim_physics": 0.1697346996253645, "survival_time": 7.099999999999983, "driven_lanedir": 0.741234184731216, "sim_render-ego": 0.0614470125923694, "in-drivable-lane": 4.249999999999985, "agent_compute-ego": 0.06256751779099586, "deviation-heading": 0.5416787058937298, "set_robot_commands": 0.08989927970187765, "deviation-center-line": 0.21649269357451997, "driven_lanedir_consec": 0.741234184731216, "sim_compute_sim_state": 0.03759887688596484, "sim_compute_performance-ego": 0.0697653226449456, "sim_compute_robot_state-ego": 0.07168232890921579, "sim_compute_robot_state-npc0": 0.06804483709201006, "sim_compute_robot_state-npc1": 0.06828062299271705, "sim_compute_robot_state-npc2": 0.06685630536415207, "sim_compute_robot_state-npc3": 0.06936427405182745}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0248273191286528, "sim_physics": 0.15509300549825034, "survival_time": 3.7499999999999942, "driven_lanedir": 0.38223306402252977, "sim_render-ego": 0.059717384974161784, "in-drivable-lane": 2.099999999999994, "agent_compute-ego": 0.060655765533447266, "deviation-heading": 0.41826512024881946, "set_robot_commands": 0.08871235847473144, "deviation-center-line": 0.14440586530294292, "driven_lanedir_consec": 0.38223306402252977, "sim_compute_sim_state": 0.03715688705444336, "sim_compute_performance-ego": 0.06764202117919922, "sim_compute_robot_state-ego": 0.07043839772542318, "sim_compute_robot_state-npc0": 0.06637500445048014, "sim_compute_robot_state-npc1": 0.06592111905415853, "sim_compute_robot_state-npc2": 0.06395225842793782, "sim_compute_robot_state-npc3": 0.06513011614481608}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4548365617710395, "sim_physics": 0.15775196616714066, "survival_time": 1.850000000000001, "driven_lanedir": 0.43889108545437505, "sim_render-ego": 0.05418775532696698, "in-drivable-lane": 0, "agent_compute-ego": 0.05582450531624459, "deviation-heading": 0.491310634741224, "set_robot_commands": 0.08836135348758183, "deviation-center-line": 0.11665316537398888, "driven_lanedir_consec": 0.43889108545437505, "sim_compute_sim_state": 0.03641741340224807, "sim_compute_performance-ego": 0.060322787310626055, "sim_compute_robot_state-ego": 0.06488250397347115, "sim_compute_robot_state-npc0": 0.06132100723885201, "sim_compute_robot_state-npc1": 0.05859699764767209, "sim_compute_robot_state-npc2": 0.060778559865178286, "sim_compute_robot_state-npc3": 0.06698071634447253}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3648701917101209, "sim_physics": 0.1362826362732918, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552145550754965, "sim_render-ego": 0.04010696564951251, "in-drivable-lane": 0, "agent_compute-ego": 0.038903943953975555, "deviation-heading": 0.5070424162880827, "set_robot_commands": 0.05669767625870243, "deviation-center-line": 0.10012774388669717, "driven_lanedir_consec": 0.34552145550754965, "sim_compute_sim_state": 0.023669865823561145, "sim_compute_performance-ego": 0.04327195690524194, "sim_compute_robot_state-ego": 0.04535386639256631, "sim_compute_robot_state-npc0": 0.04452142407817225, "sim_compute_robot_state-npc1": 0.043201161969092586, "sim_compute_robot_state-npc2": 0.04280662536621094, "sim_compute_robot_state-npc3": 0.042487082942839594}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4098472254790875, "sim_physics": 0.11677187330582564, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054410153244894, "sim_render-ego": 0.04550180014441995, "in-drivable-lane": 0, "agent_compute-ego": 0.0450287706711713, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.06455503491794362, "deviation-center-line": 0.16731811540993266, "driven_lanedir_consec": 0.4054410153244894, "sim_compute_sim_state": 0.028836762203889733, "sim_compute_performance-ego": 0.05008278874789968, "sim_compute_robot_state-ego": 0.051323343725765455, "sim_compute_robot_state-npc0": 0.05475797372705797, "sim_compute_robot_state-npc1": 0.050678463543162626, "sim_compute_robot_state-npc2": 0.05079302367042093, "sim_compute_robot_state-npc3": 0.048697710037231445}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0248273191286312, "sim_physics": 0.10872913678487142, "survival_time": 3.7499999999999942, "driven_lanedir": 0.32721267753615213, "sim_render-ego": 0.04585237185160319, "in-drivable-lane": 2.299999999999994, "agent_compute-ego": 0.04779837290445964, "deviation-heading": 0.3112188917063982, "set_robot_commands": 0.07089273452758789, "deviation-center-line": 0.16525966154163726, "driven_lanedir_consec": 0.32721267753615213, "sim_compute_sim_state": 0.028102874755859375, "sim_compute_performance-ego": 0.05056543986002604, "sim_compute_robot_state-ego": 0.052594785690307615, "sim_compute_robot_state-npc0": 0.05062897364298503, "sim_compute_robot_state-npc1": 0.04972068468729655, "sim_compute_robot_state-npc2": 0.04938918431599935, "sim_compute_robot_state-npc3": 0.04939777374267578}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.1272956963096346, "survival_time": 5.599999999999988, "driven_lanedir": 1.211071354427033, "sim_render-ego": 0.047364620225770135, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.04930051735469273, "deviation-heading": 1.0143384205991224, "set_robot_commands": 0.07179833522864751, "deviation-center-line": 0.44830395948846297, "driven_lanedir_consec": 1.211071354427033, "sim_compute_sim_state": 0.031587722046034675, "sim_compute_performance-ego": 0.05250939513955798, "sim_compute_robot_state-ego": 0.05553274069513593, "sim_compute_robot_state-npc0": 0.05424720474651882, "sim_compute_robot_state-npc1": 0.055529924375670295, "sim_compute_robot_state-npc2": 0.05436215230396816, "sim_compute_robot_state-npc3": 0.055834985205105374}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2198273185919868, "sim_physics": 0.13473643768917432, "survival_time": 4.399999999999992, "driven_lanedir": 0.41711373203649504, "sim_render-ego": 0.0487761145288294, "in-drivable-lane": 2.5999999999999917, "agent_compute-ego": 0.04903792251240124, "deviation-heading": 0.5811284097850438, "set_robot_commands": 0.0743157836523923, "deviation-center-line": 0.13226882250813252, "driven_lanedir_consec": 0.41711373203649504, "sim_compute_sim_state": 0.03076248819177801, "sim_compute_performance-ego": 0.05375073172829368, "sim_compute_robot_state-ego": 0.054853246970610184, "sim_compute_robot_state-npc0": 0.05443701689893549, "sim_compute_robot_state-npc1": 0.05450993234461004, "sim_compute_robot_state-npc2": 0.054886630990288475, "sim_compute_robot_state-npc3": 0.054612021554600106}}
set_robot_commands_max	0.1064649723671578
set_robot_commands_mean	0.08377515993688228
set_robot_commands_median	0.08713975548744202
set_robot_commands_min	0.05669767625870243
sim_compute_performance-ego_max	0.07771018389109019
sim_compute_performance-ego_mean	0.06207062691028895
sim_compute_performance-ego_median	0.06498999148607254
sim_compute_performance-ego_min	0.04327195690524194
sim_compute_robot_state-ego_max	0.08650564503025364
sim_compute_robot_state-ego_mean	0.06542396547891362
sim_compute_robot_state-ego_median	0.06835901573912738
sim_compute_robot_state-ego_min	0.04535386639256631
sim_compute_robot_state-npc0_max	0.07694942886764938
sim_compute_robot_state-npc0_mean	0.0627762821946761
sim_compute_robot_state-npc0_median	0.06561597601159827
sim_compute_robot_state-npc0_min	0.04452142407817225
sim_compute_robot_state-npc1_max	0.07480725082191261
sim_compute_robot_state-npc1_mean	0.06174985642809937
sim_compute_robot_state-npc1_median	0.06378420411723934
sim_compute_robot_state-npc1_min	0.043201161969092586
sim_compute_robot_state-npc2_max	0.07218692753766034
sim_compute_robot_state-npc2_mean	0.0618137882182965
sim_compute_robot_state-npc2_median	0.06519649864791276
sim_compute_robot_state-npc2_min	0.04280662536621094
sim_compute_robot_state-npc3_max	0.07242778185251597
sim_compute_robot_state-npc3_mean	0.062438730477217645
sim_compute_robot_state-npc3_median	0.06698071634447253
sim_compute_robot_state-npc3_min	0.042487082942839594
sim_compute_sim_state_max	0.042455583810806274
sim_compute_sim_state_mean	0.035482063911850395
sim_compute_sim_state_median	0.03715688705444336
sim_compute_sim_state_min	0.023669865823561145
sim_physics_max	0.23679212621740392
sim_physics_mean	0.15734117215779608
sim_physics_median	0.15785466231308976
sim_physics_min	0.10872913678487142
sim_render-ego_max	0.06895084638853331
sim_render-ego_mean	0.056129842640132536
sim_render-ego_median	0.059717384974161784
sim_render-ego_min	0.04010696564951251
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	3.6999999999999944
survival_time_min	1.5500000000000007

No reset possible

21370

2410

jiang peng

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 01:19:45+00:00

2019-04-28 02:00:07+00:00

0:40:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2410/step1-simulation-ip-172-31-42-167-7194-job21370/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21354

2372

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-28 01:00:34+00:00

2019-04-28 01:19:16+00:00

0:18:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6591401084474304
survival_time_median	6.949999999999983
deviation-center-line_median	0.33899838427143014
in-drivable-lane_median	1.999999999999993

other stats

agent_compute-ego_max	0.16334175074704782
agent_compute-ego_mean	0.1531661443859877
agent_compute-ego_median	0.15143044032747782
agent_compute-ego_min	0.14548684544033474
deviation-center-line_max	0.4843179558881834
deviation-center-line_mean	0.3389764450725529
deviation-center-line_min	0.22729035014002288
deviation-heading_max	1.1492236283129806
deviation-heading_mean	0.9399487053044556
deviation-heading_median	1.0007157377877205
deviation-heading_min	0.7390440083021812
driven_any_max	1.6381859911990262
driven_any_mean	1.0096556470575024
driven_any_median	0.9900915586687412
driven_any_min	0.4167848967141688
driven_lanedir_consec_max	1.2206700211390982
driven_lanedir_consec_mean	0.7159598687953472
driven_lanedir_consec_min	0.3888322247827789
driven_lanedir_max	1.2206700211390982
driven_lanedir_mean	0.7159598687953472
driven_lanedir_median	0.6591401084474304
driven_lanedir_min	0.3888322247827789
in-drivable-lane_max	4.85000000000004
in-drivable-lane_mean	1.8200000000000132
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.16879531462415517, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06284096429673888, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14985681780808263, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.09273525450727065, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03969837778763805, "sim_compute_performance-ego": 0.06883625332400095, "sim_compute_robot_state-ego": 0.07231411316411958, "sim_compute_robot_state-npc0": 0.06708491791924126, "sim_compute_robot_state-npc1": 0.06885383455015773, "sim_compute_robot_state-npc2": 0.06955294471850498, "sim_compute_robot_state-npc3": 0.06883644543105749}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.19120670878697957, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.06221492706783234, "in-drivable-lane": 0, "agent_compute-ego": 0.1557148676069956, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.1043312738812159, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.038951260702950616, "sim_compute_performance-ego": 0.06894722438993908, "sim_compute_robot_state-ego": 0.07711257631816561, "sim_compute_robot_state-npc0": 0.07211254513452924, "sim_compute_robot_state-npc1": 0.07108051057845827, "sim_compute_robot_state-npc2": 0.06835432279677618, "sim_compute_robot_state-npc3": 0.0688586878398108}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.16389915042453343, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.06016917016771105, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.14548684544033474, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.0897428396013048, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.039468620088365346, "sim_compute_performance-ego": 0.0663769170973036, "sim_compute_robot_state-ego": 0.07147844420539008, "sim_compute_robot_state-npc0": 0.06718135621812608, "sim_compute_robot_state-npc1": 0.06743768056233725, "sim_compute_robot_state-npc2": 0.06856954468621149, "sim_compute_robot_state-npc3": 0.06940330081515841}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.18594599539233791, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.07084216170596637, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.16334175074704782, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.10361051559448242, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.04625309117928079, "sim_compute_performance-ego": 0.07459154436665197, "sim_compute_robot_state-ego": 0.08002159342787782, "sim_compute_robot_state-npc0": 0.07440110725191881, "sim_compute_robot_state-npc1": 0.07625402283558648, "sim_compute_robot_state-npc2": 0.07309662361848189, "sim_compute_robot_state-npc3": 0.07347185930348761}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.17143021689520943, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.062442325410388765, "in-drivable-lane": 0, "agent_compute-ego": 0.15143044032747782, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.0964384192512149, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.04136535856458875, "sim_compute_performance-ego": 0.06929383580646818, "sim_compute_robot_state-ego": 0.07206692014421735, "sim_compute_robot_state-npc0": 0.06975732152424162, "sim_compute_robot_state-npc1": 0.07680866831824892, "sim_compute_robot_state-npc2": 0.07132001907106429, "sim_compute_robot_state-npc3": 0.07485889253162202}}
set_robot_commands_max	0.1043312738812159
set_robot_commands_mean	0.09737166056709771
set_robot_commands_median	0.0964384192512149
set_robot_commands_min	0.0897428396013048
sim_compute_performance-ego_max	0.07459154436665197
sim_compute_performance-ego_mean	0.06960915499687277
sim_compute_performance-ego_median	0.06894722438993908
sim_compute_performance-ego_min	0.0663769170973036
sim_compute_robot_state-ego_max	0.08002159342787782
sim_compute_robot_state-ego_mean	0.07459872945195409
sim_compute_robot_state-ego_median	0.07231411316411958
sim_compute_robot_state-ego_min	0.07147844420539008
sim_compute_robot_state-npc0_max	0.07440110725191881
sim_compute_robot_state-npc0_mean	0.07010744960961142
sim_compute_robot_state-npc0_median	0.06975732152424162
sim_compute_robot_state-npc0_min	0.06708491791924126
sim_compute_robot_state-npc1_max	0.07680866831824892
sim_compute_robot_state-npc1_mean	0.07208694336895774
sim_compute_robot_state-npc1_median	0.07108051057845827
sim_compute_robot_state-npc1_min	0.06743768056233725
sim_compute_robot_state-npc2_max	0.07309662361848189
sim_compute_robot_state-npc2_mean	0.07017869097820775
sim_compute_robot_state-npc2_median	0.06955294471850498
sim_compute_robot_state-npc2_min	0.06835432279677618
sim_compute_robot_state-npc3_max	0.07485889253162202
sim_compute_robot_state-npc3_mean	0.07108583718422727
sim_compute_robot_state-npc3_median	0.06940330081515841
sim_compute_robot_state-npc3_min	0.06883644543105749
sim_compute_sim_state_max	0.04625309117928079
sim_compute_sim_state_mean	0.04114734166456471
sim_compute_sim_state_median	0.03969837778763805
sim_compute_sim_state_min	0.038951260702950616
sim_physics_max	0.19120670878697957
sim_physics_mean	0.1762554772246431
sim_physics_median	0.17143021689520943
sim_physics_min	0.16389915042453343
sim_render-ego_max	0.07084216170596637
sim_render-ego_mean	0.06370190972972747
sim_render-ego_median	0.062442325410388765
sim_render-ego_min	0.06016917016771105
simulation-passed	1
survival_time_max	11.250000000000025
survival_time_mean	7.070000000000005
survival_time_min	3.149999999999997

No reset possible

21353

2376

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

host-error

2019-04-28 00:57:02+00:00

2019-04-28 01:00:05+00:00

0:03:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2376/step1-simulation-ip-172-31-42-167-7194-job21353/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21349

2380

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-28 00:43:04+00:00

2019-04-28 00:56:33+00:00

0:13:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5588337849539742
survival_time_median	5.549999999999988
deviation-center-line_median	0.3652019984091639
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.06471269839518778
agent_compute-ego_mean	0.06144619421436387
agent_compute-ego_median	0.06222010907078289
agent_compute-ego_min	0.0558452308177948
deviation-center-line_max	0.5183621890690367
deviation-center-line_mean	0.3091633025512927
deviation-center-line_min	0.10686438692139356
deviation-heading_max	0.6191860504142408
deviation-heading_mean	0.5051792851842161
deviation-heading_median	0.4989824923438323
deviation-heading_min	0.42218734391092383
driven_any_max	2.764827318571964
driven_any_mean	1.4658358085690737
driven_any_median	1.5648273185720385
driven_any_min	0.37986052535838966
driven_lanedir_consec_max	1.9044523873117627
driven_lanedir_consec_mean	1.19641611532087
driven_lanedir_consec_min	0.3667130323691865
driven_lanedir_max	1.9045033171069223
driven_lanedir_mean	1.1964799961413226
driven_lanedir_median	1.5590414710313567
driven_lanedir_min	0.3667130323691865
in-drivable-lane_max	2.8500000000000165
in-drivable-lane_mean	0.8600000000000023
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.18071518932376895, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.05921107369500238, "in-drivable-lane": 0, "agent_compute-ego": 0.06217160525622669, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.08618471214363167, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.03753895158166284, "sim_compute_performance-ego": 0.06536160288630305, "sim_compute_robot_state-ego": 0.06756667618278984, "sim_compute_robot_state-npc0": 0.0656323647713876, "sim_compute_robot_state-npc1": 0.06315599905477988, "sim_compute_robot_state-npc2": 0.06509226077311747, "sim_compute_robot_state-npc3": 0.06546846810761872}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.20963553480199865, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.06384692965327082, "in-drivable-lane": 0, "agent_compute-ego": 0.06471269839518778, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.0965916788255846, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.03890859114157187, "sim_compute_performance-ego": 0.07050439473744985, "sim_compute_robot_state-ego": 0.07407306336067818, "sim_compute_robot_state-npc0": 0.07136980907337086, "sim_compute_robot_state-npc1": 0.06676873645266972, "sim_compute_robot_state-npc2": 0.06941238609520164, "sim_compute_robot_state-npc3": 0.07007823119292388}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.18084095487531449, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.05853480850623933, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.062281327531827205, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.08714286538938813, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.03743465846737489, "sim_compute_performance-ego": 0.06431402907466256, "sim_compute_robot_state-ego": 0.06753133780119434, "sim_compute_robot_state-npc0": 0.0653064108842256, "sim_compute_robot_state-npc1": 0.06585549518762045, "sim_compute_robot_state-npc2": 0.06621513303541979, "sim_compute_robot_state-npc3": 0.0634803566711628}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.18674403585064472, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.061289877167546934, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.06222010907078289, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.09248244824833896, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.03905662441752968, "sim_compute_performance-ego": 0.07107392405964318, "sim_compute_robot_state-ego": 0.07169770320672639, "sim_compute_robot_state-npc0": 0.06804532405593633, "sim_compute_robot_state-npc1": 0.06878719904035797, "sim_compute_robot_state-npc2": 0.07083426845011287, "sim_compute_robot_state-npc3": 0.06799374076084316}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.16892769187688828, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.05516951531171799, "in-drivable-lane": 0, "agent_compute-ego": 0.0558452308177948, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.08487004786729813, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.03571736812591553, "sim_compute_performance-ego": 0.06588759273290634, "sim_compute_robot_state-ego": 0.06986677646636963, "sim_compute_robot_state-npc0": 0.06356775015592575, "sim_compute_robot_state-npc1": 0.05963244289159775, "sim_compute_robot_state-npc2": 0.05885729938745499, "sim_compute_robot_state-npc3": 0.06087023764848709}}
set_robot_commands_max	0.0965916788255846
set_robot_commands_mean	0.0894543504948483
set_robot_commands_median	0.08714286538938813
set_robot_commands_min	0.08487004786729813
sim_compute_performance-ego_max	0.07107392405964318
sim_compute_performance-ego_mean	0.067428308698193
sim_compute_performance-ego_median	0.06588759273290634
sim_compute_performance-ego_min	0.06431402907466256
sim_compute_robot_state-ego_max	0.07407306336067818
sim_compute_robot_state-ego_mean	0.07014711140355168
sim_compute_robot_state-ego_median	0.06986677646636963
sim_compute_robot_state-ego_min	0.06753133780119434
sim_compute_robot_state-npc0_max	0.07136980907337086
sim_compute_robot_state-npc0_mean	0.06678433178816923
sim_compute_robot_state-npc0_median	0.0656323647713876
sim_compute_robot_state-npc0_min	0.06356775015592575
sim_compute_robot_state-npc1_max	0.06878719904035797
sim_compute_robot_state-npc1_mean	0.06483997452540516
sim_compute_robot_state-npc1_median	0.06585549518762045
sim_compute_robot_state-npc1_min	0.05963244289159775
sim_compute_robot_state-npc2_max	0.07083426845011287
sim_compute_robot_state-npc2_mean	0.06608226954826135
sim_compute_robot_state-npc2_median	0.06621513303541979
sim_compute_robot_state-npc2_min	0.05885729938745499
sim_compute_robot_state-npc3_max	0.07007823119292388
sim_compute_robot_state-npc3_mean	0.06557820687620712
sim_compute_robot_state-npc3_median	0.06546846810761872
sim_compute_robot_state-npc3_min	0.06087023764848709
sim_compute_sim_state_max	0.03905662441752968
sim_compute_sim_state_mean	0.03773123874681096
sim_compute_sim_state_median	0.03753895158166284
sim_compute_sim_state_min	0.03571736812591553
sim_physics_max	0.20963553480199865
sim_physics_mean	0.185372681345723
sim_physics_median	0.18084095487531449
sim_physics_min	0.16892769187688828
sim_render-ego_max	0.06384692965327082
sim_render-ego_mean	0.05961044086675549
sim_render-ego_median	0.05921107369500238
sim_render-ego_min	0.05516951531171799
simulation-passed	1
survival_time_max	9.55
survival_time_mean	5.219999999999994
survival_time_min	1.6000000000000008

No reset possible

21347

2384

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-28 00:36:35+00:00

2019-04-28 00:42:51+00:00

0:06:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.10819530882768236
survival_time_median	1.6000000000000008
deviation-center-line_median	0.05922702809365912
in-drivable-lane_median	0.2500000000000002

other stats

agent_compute-ego_max	0.1807289645075798
agent_compute-ego_mean	0.15337581640203873
agent_compute-ego_median	0.1636189152212704
agent_compute-ego_min	0.10521822422742844
deviation-center-line_max	0.09403575193783437
deviation-center-line_mean	0.06714068704926472
deviation-center-line_min	0.04906170112640911
deviation-heading_max	0.8690968390119935
deviation-heading_mean	0.7463615728771433
deviation-heading_median	0.7929429632796323
deviation-heading_min	0.4907376685908688
driven_any_max	0.22874006228350552
driven_any_mean	0.19337465572922444
driven_any_median	0.19710829083883305
driven_any_min	0.1348177337597236
driven_lanedir_consec_max	0.13746937776659784
driven_lanedir_consec_mean	0.10720633411939776
driven_lanedir_consec_min	0.06721588230301867
driven_lanedir_max	0.13746937776659784
driven_lanedir_mean	0.10720633411939776
driven_lanedir_median	0.10819530882768236
driven_lanedir_min	0.06721588230301867
in-drivable-lane_max	0.5000000000000004
in-drivable-lane_mean	0.2100000000000002
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21388544608638288, "sim_physics": 0.07598353922367096, "survival_time": 1.6000000000000008, "driven_lanedir": 0.10455158890929804, "sim_render-ego": 0.04002079367637634, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.10521822422742844, "deviation-heading": 0.8690968390119935, "set_robot_commands": 0.05673227459192276, "deviation-center-line": 0.07847283630326592, "driven_lanedir_consec": 0.10455158890929804, "sim_compute_sim_state": 0.026819884777069092, "sim_compute_performance-ego": 0.04281674325466156, "sim_compute_robot_state-ego": 0.04464627802371979}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1923217456776772, "sim_physics": 0.10606812608653102, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11859951279039184, "sim_render-ego": 0.0548144373400458, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.14792246654115873, "deviation-heading": 0.7929429632796323, "set_robot_commands": 0.09893019446011247, "deviation-center-line": 0.0549061177851551, "driven_lanedir_consec": 0.11859951279039184, "sim_compute_sim_state": 0.03651993850181843, "sim_compute_performance-ego": 0.06385905989285173, "sim_compute_robot_state-ego": 0.06708922057316222}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1348177337597236, "sim_physics": 0.11491893529891968, "survival_time": 1.0000000000000002, "driven_lanedir": 0.10819530882768236, "sim_render-ego": 0.06287870407104493, "in-drivable-lane": 0, "agent_compute-ego": 0.16939051151275636, "deviation-heading": 0.4907376685908688, "set_robot_commands": 0.0959615468978882, "deviation-center-line": 0.09403575193783437, "driven_lanedir_consec": 0.10819530882768236, "sim_compute_sim_state": 0.038530361652374265, "sim_compute_performance-ego": 0.0722898006439209, "sim_compute_robot_state-ego": 0.08377233743667603}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19710829083883305, "sim_physics": 0.1378018856048584, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06721588230301867, "sim_render-ego": 0.06650807708501816, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1807289645075798, "deviation-heading": 0.815989813982461, "set_robot_commands": 0.09433075785636902, "deviation-center-line": 0.04906170112640911, "driven_lanedir_consec": 0.06721588230301867, "sim_compute_sim_state": 0.03669603168964386, "sim_compute_performance-ego": 0.06901966780424118, "sim_compute_robot_state-ego": 0.07231990993022919}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22874006228350552, "sim_physics": 0.1181779609006994, "survival_time": 1.7000000000000008, "driven_lanedir": 0.13746937776659784, "sim_render-ego": 0.0620187100242166, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1636189152212704, "deviation-heading": 0.763040579520761, "set_robot_commands": 0.09023671991684858, "deviation-center-line": 0.05922702809365912, "driven_lanedir_consec": 0.13746937776659784, "sim_compute_sim_state": 0.03716794182272518, "sim_compute_performance-ego": 0.07090971049140482, "sim_compute_robot_state-ego": 0.07354385712567497}}
set_robot_commands_max	0.09893019446011247
set_robot_commands_mean	0.08723829874462821
set_robot_commands_median	0.09433075785636902
set_robot_commands_min	0.05673227459192276
sim_compute_performance-ego_max	0.0722898006439209
sim_compute_performance-ego_mean	0.06377899641741605
sim_compute_performance-ego_median	0.06901966780424118
sim_compute_performance-ego_min	0.04281674325466156
sim_compute_robot_state-ego_max	0.08377233743667603
sim_compute_robot_state-ego_mean	0.06827432061789243
sim_compute_robot_state-ego_median	0.07231990993022919
sim_compute_robot_state-ego_min	0.04464627802371979
sim_compute_sim_state_max	0.038530361652374265
sim_compute_sim_state_mean	0.03514683168872616
sim_compute_sim_state_median	0.03669603168964386
sim_compute_sim_state_min	0.026819884777069092
sim_physics_max	0.1378018856048584
sim_physics_mean	0.11059008942293588
sim_physics_median	0.11491893529891968
sim_physics_min	0.07598353922367096
sim_render-ego_max	0.06650807708501816
sim_render-ego_mean	0.05724814443934037
sim_render-ego_median	0.0620187100242166
sim_render-ego_min	0.04002079367637634
simulation-passed	1
survival_time_max	1.7000000000000008
survival_time_mean	1.4700000000000006
survival_time_min	1.0000000000000002

No reset possible

21342

2411

jiang peng

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-28 00:00:58+00:00

2019-04-28 00:35:50+00:00

0:34:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.339793520141566
survival_time_median	14.950000000000076
deviation-center-line_median	1.002134440312669
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.16462040185928345
agent_compute-ego_mean	0.16129616260528565
agent_compute-ego_median	0.1621641254425049
agent_compute-ego_min	0.156118221282959
deviation-center-line_max	1.5296442653166566
deviation-center-line_mean	0.925371790854924
deviation-center-line_min	0.28261955257418875
deviation-heading_max	8.558153948461722
deviation-heading_mean	7.098260242116498
deviation-heading_median	7.090641611385013
deviation-heading_min	5.695926383403844
driven_any_max	4.378506444052824
driven_any_mean	4.378506444052815
driven_any_median	4.378506444052811
driven_any_min	4.378506444052806
driven_lanedir_consec_max	-1.2728379671211965
driven_lanedir_consec_mean	-1.3313530019797526
driven_lanedir_consec_min	-1.3670015115194478
driven_lanedir_max	-1.3662544443440128
driven_lanedir_mean	-2.078199826147362
driven_lanedir_median	-2.260637650975249
driven_lanedir_min	-2.7107548643537447
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.620000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.17342706600824992, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.059780759811401366, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16462040185928345, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.09255687157313028, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.03721405665079753, "sim_compute_performance-ego": 0.06655309279759725, "sim_compute_robot_state-ego": 0.07162491957346598, "sim_compute_robot_state-npc0": 0.06899194876352946, "sim_compute_robot_state-npc1": 0.06781177282333374, "sim_compute_robot_state-npc2": 0.06634271383285523, "sim_compute_robot_state-npc3": 0.0662276554107666}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.1611344281832377, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.06108293851216634, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15900124152501424, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.08820298353830973, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.037884811560312905, "sim_compute_performance-ego": 0.0654678726196289, "sim_compute_robot_state-ego": 0.06960159142812093, "sim_compute_robot_state-npc0": 0.06726158380508424, "sim_compute_robot_state-npc1": 0.06470503012339274, "sim_compute_robot_state-npc2": 0.06466460784276326, "sim_compute_robot_state-npc3": 0.0655835207303365}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.16026698430379233, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.06055567979812622, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.1621641254425049, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.09016114870707194, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.03794880469640096, "sim_compute_performance-ego": 0.0654520575205485, "sim_compute_robot_state-ego": 0.06834216197331747, "sim_compute_robot_state-npc0": 0.06698128779729208, "sim_compute_robot_state-npc1": 0.06732444683710734, "sim_compute_robot_state-npc2": 0.06641126235326131, "sim_compute_robot_state-npc3": 0.06525995333989461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.1630751919746399, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.05758194208145142, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.156118221282959, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.08977429072062175, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.037322386900583905, "sim_compute_performance-ego": 0.06344714164733886, "sim_compute_robot_state-ego": 0.06764498710632325, "sim_compute_robot_state-npc0": 0.06387508233388264, "sim_compute_robot_state-npc1": 0.0630655312538147, "sim_compute_robot_state-npc2": 0.06364034414291382, "sim_compute_robot_state-npc3": 0.06530395984649658}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.17417713403701782, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.06176662762959798, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.16457682291666667, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.090955118338267, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.038988606929779054, "sim_compute_performance-ego": 0.06730377991994221, "sim_compute_robot_state-ego": 0.07174989779790243, "sim_compute_robot_state-npc0": 0.0673455532391866, "sim_compute_robot_state-npc1": 0.0667368205388387, "sim_compute_robot_state-npc2": 0.06679120699564615, "sim_compute_robot_state-npc3": 0.06860694408416748}}
set_robot_commands_max	0.09255687157313028
set_robot_commands_mean	0.09033008257548016
set_robot_commands_median	0.09016114870707194
set_robot_commands_min	0.08820298353830973
sim_compute_performance-ego_max	0.06730377991994221
sim_compute_performance-ego_mean	0.06564478890101114
sim_compute_performance-ego_median	0.0654678726196289
sim_compute_performance-ego_min	0.06344714164733886
sim_compute_robot_state-ego_max	0.07174989779790243
sim_compute_robot_state-ego_mean	0.069792711575826
sim_compute_robot_state-ego_median	0.06960159142812093
sim_compute_robot_state-ego_min	0.06764498710632325
sim_compute_robot_state-npc0_max	0.06899194876352946
sim_compute_robot_state-npc0_mean	0.066891091187795
sim_compute_robot_state-npc0_median	0.06726158380508424
sim_compute_robot_state-npc0_min	0.06387508233388264
sim_compute_robot_state-npc1_max	0.06781177282333374
sim_compute_robot_state-npc1_mean	0.06592872031529744
sim_compute_robot_state-npc1_median	0.0667368205388387
sim_compute_robot_state-npc1_min	0.0630655312538147
sim_compute_robot_state-npc2_max	0.06679120699564615
sim_compute_robot_state-npc2_mean	0.06557002703348795
sim_compute_robot_state-npc2_median	0.06634271383285523
sim_compute_robot_state-npc2_min	0.06364034414291382
sim_compute_robot_state-npc3_max	0.06860694408416748
sim_compute_robot_state-npc3_mean	0.06619640668233236
sim_compute_robot_state-npc3_median	0.0655835207303365
sim_compute_robot_state-npc3_min	0.06525995333989461
sim_compute_sim_state_max	0.038988606929779054
sim_compute_sim_state_mean	0.03787173334757486
sim_compute_sim_state_median	0.037884811560312905
sim_compute_sim_state_min	0.03721405665079753
sim_physics_max	0.17417713403701782
sim_physics_mean	0.16641616090138753
sim_physics_median	0.1630751919746399
sim_physics_min	0.16026698430379233
sim_render-ego_max	0.06176662762959798
sim_render-ego_mean	0.06015358956654867
sim_render-ego_median	0.06055567979812622
sim_render-ego_min	0.05758194208145142
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21321

2446

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 23:09:19+00:00

2019-04-28 00:00:10+00:00

0:50:51

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-42-167-7194-job21321/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21313

2400

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-27 23:00:29+00:00

2019-04-27 23:08:50+00:00

0:08:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.1302542894789316
agent_compute-ego_mean	0.11660028831756612
agent_compute-ego_median	0.12021942380108412
agent_compute-ego_min	0.09487939732415336
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1588129785996449, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.049340079102335094, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.12021942380108412, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.07979129839547072, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.033801887608781646, "sim_compute_performance-ego": 0.0558710732037508, "sim_compute_robot_state-ego": 0.06128282788433606, "sim_compute_robot_state-npc0": 0.057296001458469824, "sim_compute_robot_state-npc1": 0.054948728295821175, "sim_compute_robot_state-npc2": 0.054698262033583245, "sim_compute_robot_state-npc3": 0.055357320399224}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.1464350734438215, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.046173308576856344, "in-drivable-lane": 0, "agent_compute-ego": 0.09487939732415336, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.06881364754268102, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.027605967862265452, "sim_compute_performance-ego": 0.048577376774379184, "sim_compute_robot_state-ego": 0.052081167697906494, "sim_compute_robot_state-npc0": 0.049755292279379706, "sim_compute_robot_state-npc1": 0.05076453515461513, "sim_compute_robot_state-npc2": 0.049133547714778354, "sim_compute_robot_state-npc3": 0.04772907495498657}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18615830523296467, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06056837202275841, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1302542894789316, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0901185470877342, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03912347265817587, "sim_compute_performance-ego": 0.06630023937780881, "sim_compute_robot_state-ego": 0.07068185204441108, "sim_compute_robot_state-npc0": 0.06817645934021589, "sim_compute_robot_state-npc1": 0.0666817438255236, "sim_compute_robot_state-npc2": 0.06497423857161143, "sim_compute_robot_state-npc3": 0.06797909736633301}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1943499594926834, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.059941500425338745, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1287700136502584, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08822759985923767, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03849738836288452, "sim_compute_performance-ego": 0.0719939370950063, "sim_compute_robot_state-ego": 0.07065819203853607, "sim_compute_robot_state-npc0": 0.06545456747214, "sim_compute_robot_state-npc1": 0.06438595056533813, "sim_compute_robot_state-npc2": 0.06582966446876526, "sim_compute_robot_state-npc3": 0.06218347450097402}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.13758291516985213, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.049181154796055386, "in-drivable-lane": 0, "agent_compute-ego": 0.10887831733340309, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07291969798860096, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03542275655837286, "sim_compute_performance-ego": 0.05255780901227679, "sim_compute_robot_state-ego": 0.055953411828903926, "sim_compute_robot_state-npc0": 0.05809270767938523, "sim_compute_robot_state-npc1": 0.05818368139721099, "sim_compute_robot_state-npc2": 0.05693150701976958, "sim_compute_robot_state-npc3": 0.055544433139619376}}
set_robot_commands_max	0.0901185470877342
set_robot_commands_mean	0.07997415817474492
set_robot_commands_median	0.07979129839547072
set_robot_commands_min	0.06881364754268102
sim_compute_performance-ego_max	0.0719939370950063
sim_compute_performance-ego_mean	0.059060087092644376
sim_compute_performance-ego_median	0.0558710732037508
sim_compute_performance-ego_min	0.048577376774379184
sim_compute_robot_state-ego_max	0.07068185204441108
sim_compute_robot_state-ego_mean	0.06213149029881872
sim_compute_robot_state-ego_median	0.06128282788433606
sim_compute_robot_state-ego_min	0.052081167697906494
sim_compute_robot_state-npc0_max	0.06817645934021589
sim_compute_robot_state-npc0_mean	0.05975500564591814
sim_compute_robot_state-npc0_median	0.05809270767938523
sim_compute_robot_state-npc0_min	0.049755292279379706
sim_compute_robot_state-npc1_max	0.0666817438255236
sim_compute_robot_state-npc1_mean	0.058992927847701805
sim_compute_robot_state-npc1_median	0.05818368139721099
sim_compute_robot_state-npc1_min	0.05076453515461513
sim_compute_robot_state-npc2_max	0.06582966446876526
sim_compute_robot_state-npc2_mean	0.05831344396170157
sim_compute_robot_state-npc2_median	0.05693150701976958
sim_compute_robot_state-npc2_min	0.049133547714778354
sim_compute_robot_state-npc3_max	0.06797909736633301
sim_compute_robot_state-npc3_mean	0.0577586800722274
sim_compute_robot_state-npc3_median	0.055544433139619376
sim_compute_robot_state-npc3_min	0.04772907495498657
sim_compute_sim_state_max	0.03912347265817587
sim_compute_sim_state_mean	0.03489029461009607
sim_compute_sim_state_median	0.03542275655837286
sim_compute_sim_state_min	0.027605967862265452
sim_physics_max	0.1943499594926834
sim_physics_mean	0.16466784638779333
sim_physics_median	0.1588129785996449
sim_physics_min	0.13758291516985213
sim_render-ego_max	0.06056837202275841
sim_render-ego_mean	0.05304088298466879
sim_render-ego_median	0.049340079102335094
sim_render-ego_min	0.046173308576856344
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

21289

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-27 22:05:33+00:00

2019-04-27 23:00:04+00:00

0:54:31

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-42-167-7194-job21289/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21272

2428

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-27 22:00:16+00:00

2019-04-27 22:01:34+00:00

0:01:18

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21263

2450

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 21:30:27+00:00

2019-04-27 22:00:09+00:00

0:29:42

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-42-167-7194-job21263/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21260

2455

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:29:43+00:00

2019-04-27 21:30:12+00:00

0:00:29

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21257

2460

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:28:58+00:00

2019-04-27 21:29:29+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21255

2463

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:27:58+00:00

2019-04-27 21:28:30+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21254

2464

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:26:58+00:00

2019-04-27 21:27:30+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21241

2491

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-27 21:15:50+00:00

2019-04-27 21:25:41+00:00

0:09:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09136919124345688
survival_time_median	1.2500000000000004
deviation-center-line_median	0.06545245854791194
in-drivable-lane_median	0.10000000000000007

other stats

agent_compute-ego_max	0.22332460880279545
agent_compute-ego_mean	0.15640031908619725
agent_compute-ego_median	0.15742312868436178
agent_compute-ego_min	0.1144687952818694
deviation-center-line_max	0.10840780468821248
deviation-center-line_mean	0.06809506728405552
deviation-center-line_min	0.034630630716341176
deviation-heading_max	0.8369208796118853
deviation-heading_mean	0.6832672849361467
deviation-heading_median	0.6925794912374205
deviation-heading_min	0.4381772110080602
driven_any_max	0.24892701166553136
driven_any_mean	0.15879097221389246
driven_any_median	0.15156440425209397
driven_any_min	0.09301240539794464
driven_lanedir_consec_max	0.13277221933000427
driven_lanedir_consec_mean	0.08477739407219821
driven_lanedir_consec_min	0.05302267162001428
driven_lanedir_max	0.13277221933000427
driven_lanedir_mean	0.08477739407219821
driven_lanedir_median	0.09136919124345688
driven_lanedir_min	0.05302267162001428
in-drivable-lane_max	0.5500000000000005
in-drivable-lane_mean	0.18000000000000016
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.24892701166553136, "sim_physics": 0.103815813322325, "survival_time": 1.850000000000001, "driven_lanedir": 0.1144742580975735, "sim_render-ego": 0.05708205377733385, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15285337293470228, "deviation-heading": 0.7855845518450804, "set_robot_commands": 0.08575407234398094, "deviation-center-line": 0.07107921395323845, "driven_lanedir_consec": 0.1144742580975735, "sim_compute_sim_state": 0.03487904007370408, "sim_compute_performance-ego": 0.062287027771408494, "sim_compute_robot_state-ego": 0.07148390202908902}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18152560806415943, "sim_physics": 0.08352940082550049, "survival_time": 1.5000000000000009, "driven_lanedir": 0.09478886083070726, "sim_render-ego": 0.04708913167317708, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.12549749215443928, "deviation-heading": 0.668212148489838, "set_robot_commands": 0.06753989060719807, "deviation-center-line": 0.03817153449876099, "driven_lanedir_consec": 0.09478886083070726, "sim_compute_sim_state": 0.03018719355265299, "sim_compute_performance-ego": 0.06622920036315919, "sim_compute_robot_state-ego": 0.051372687021891274}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09301240539794464, "sim_physics": 0.08738971948623657, "survival_time": 1.0000000000000002, "driven_lanedir": 0.05326494738046872, "sim_render-ego": 0.04955867528915405, "in-drivable-lane": 0, "agent_compute-ego": 0.14430102109909057, "deviation-heading": 0.6701689134963467, "set_robot_commands": 0.07950725555419921, "deviation-center-line": 0.08878660030357849, "driven_lanedir_consec": 0.05326494738046872, "sim_compute_sim_state": 0.03318552970886231, "sim_compute_performance-ego": 0.05744156837463379, "sim_compute_robot_state-ego": 0.06689628362655639}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21560270370100468, "sim_physics": 0.09924918232542096, "survival_time": 1.6500000000000008, "driven_lanedir": 0.09642939042336972, "sim_render-ego": 0.08094845396099669, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16076024373372397, "deviation-heading": 0.7904097084737016, "set_robot_commands": 0.08884352626222553, "deviation-center-line": 0.051737972112990874, "driven_lanedir_consec": 0.09642939042336972, "sim_compute_sim_state": 0.03658510699416652, "sim_compute_performance-ego": 0.06045202052954472, "sim_compute_robot_state-ego": 0.0638229124473803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1946663949293179, "sim_physics": 0.08311780542135239, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09136919124345688, "sim_render-ego": 0.04279047995805741, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.11974359303712843, "deviation-heading": 0.696886244298025, "set_robot_commands": 0.05816921591758728, "deviation-center-line": 0.04495795745114882, "driven_lanedir_consec": 0.09136919124345688, "sim_compute_sim_state": 0.027214713394641876, "sim_compute_performance-ego": 0.046264439821243286, "sim_compute_robot_state-ego": 0.047980427742004395}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.21799181148518368, "sim_physics": 0.13661358573219992, "survival_time": 1.6500000000000008, "driven_lanedir": 0.070485519012502, "sim_render-ego": 0.06861155683344061, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.18600028211420233, "deviation-heading": 0.8317106468127028, "set_robot_commands": 0.09746241569519044, "deviation-center-line": 0.0558300950975517, "driven_lanedir_consec": 0.070485519012502, "sim_compute_sim_state": 0.043385679071599785, "sim_compute_performance-ego": 0.08311214591517593, "sim_compute_robot_state-ego": 0.08884510126980869}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.13661907957528455, "sim_physics": 0.08704123497009278, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09720548927707372, "sim_render-ego": 0.04151127815246582, "in-drivable-lane": 0, "agent_compute-ego": 0.12238978385925292, "deviation-heading": 0.6352420878876517, "set_robot_commands": 0.06952095985412597, "deviation-center-line": 0.09285814098641049, "driven_lanedir_consec": 0.09720548927707372, "sim_compute_sim_state": 0.028201751708984375, "sim_compute_performance-ego": 0.04453848838806152, "sim_compute_robot_state-ego": 0.04689370155334473}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.09321625556208228, "sim_physics": 0.1407714605331421, "survival_time": 1.0000000000000002, "driven_lanedir": 0.053470402902319414, "sim_render-ego": 0.08261804580688477, "in-drivable-lane": 0, "agent_compute-ego": 0.22332460880279545, "deviation-heading": 0.6791305667933317, "set_robot_commands": 0.11154395341873168, "deviation-center-line": 0.08481681671320729, "driven_lanedir_consec": 0.053470402902319414, "sim_compute_sim_state": 0.0467875599861145, "sim_compute_performance-ego": 0.08200461864471435, "sim_compute_robot_state-ego": 0.0901975393295288}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.15156440425209397, "sim_physics": 0.07786479702702274, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06774544783969061, "sim_render-ego": 0.04201493439850984, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1144687952818694, "deviation-heading": 0.6942859901126176, "set_robot_commands": 0.06607227855258518, "deviation-center-line": 0.034630630716341176, "driven_lanedir_consec": 0.06774544783969061, "sim_compute_sim_state": 0.02740213606092665, "sim_compute_performance-ego": 0.04582560503924334, "sim_compute_robot_state-ego": 0.055143621232774526}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.12971680848651423, "sim_physics": 0.11495998772707852, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09311699692050812, "sim_render-ego": 0.05996069041165439, "in-drivable-lane": 0, "agent_compute-ego": 0.15760260278528387, "deviation-heading": 0.5476421158115766, "set_robot_commands": 0.08151183345101097, "deviation-center-line": 0.07648713935087165, "driven_lanedir_consec": 0.09311699692050812, "sim_compute_sim_state": 0.03509836847131902, "sim_compute_performance-ego": 0.060934012586420234, "sim_compute_robot_state-ego": 0.06227714365178889}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16308678819709677, "sim_physics": 0.11389999389648438, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13277221933000427, "sim_render-ego": 0.056048831939697265, "in-drivable-lane": 0, "agent_compute-ego": 0.15431689262390136, "deviation-heading": 0.4936257490245566, "set_robot_commands": 0.09097792625427246, "deviation-center-line": 0.10784342660356418, "driven_lanedir_consec": 0.13277221933000427, "sim_compute_sim_state": 0.034494390487670896, "sim_compute_performance-ego": 0.061201982498168946, "sim_compute_robot_state-ego": 0.06035331726074219}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.11601358192280134, "sim_physics": 0.12390124279519786, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05302267162001428, "sim_render-ego": 0.05895782553631326, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1690538033195164, "deviation-heading": 0.6925794912374205, "set_robot_commands": 0.09702671092489493, "deviation-center-line": 0.05623632930597032, "driven_lanedir_consec": 0.05302267162001428, "sim_compute_sim_state": 0.03808836314989173, "sim_compute_performance-ego": 0.06608535932457965, "sim_compute_robot_state-ego": 0.06551654442496922}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.17861121484688067, "sim_physics": 0.11518290213176184, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09075784695523326, "sim_render-ego": 0.06285200800214495, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1799895167350769, "deviation-heading": 0.8369208796118853, "set_robot_commands": 0.10091409512928554, "deviation-center-line": 0.06545245854791194, "driven_lanedir_consec": 0.09075784695523326, "sim_compute_sim_state": 0.03619083336421421, "sim_compute_performance-ego": 0.06886724063328334, "sim_compute_robot_state-ego": 0.07325811897005353}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.13680501498574038, "sim_physics": 0.1098530391852061, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0651397665087714, "sim_render-ego": 0.05454071362813314, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15742312868436178, "deviation-heading": 0.7884329691394065, "set_robot_commands": 0.08054398496945699, "deviation-center-line": 0.044129888931074, "driven_lanedir_consec": 0.0651397665087714, "sim_compute_sim_state": 0.03774347901344299, "sim_compute_performance-ego": 0.06704298655192058, "sim_compute_robot_state-ego": 0.06978394587834676}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12450550013675064, "sim_physics": 0.10203765739094128, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09761790274128002, "sim_render-ego": 0.06283571503379128, "in-drivable-lane": 0, "agent_compute-ego": 0.1782796491276134, "deviation-heading": 0.4381772110080602, "set_robot_commands": 0.0978942567651922, "deviation-center-line": 0.10840780468821248, "driven_lanedir_consec": 0.09761790274128002, "sim_compute_sim_state": 0.03940852121873335, "sim_compute_performance-ego": 0.06950465115633878, "sim_compute_robot_state-ego": 0.07257769324562767}}
set_robot_commands_max	0.11154395341873168
set_robot_commands_mean	0.08488549171332917
set_robot_commands_median	0.08575407234398094
set_robot_commands_min	0.05816921591758728
sim_compute_performance-ego_max	0.08311214591517593
sim_compute_performance-ego_mean	0.06278608983985975
sim_compute_performance-ego_median	0.062287027771408494
sim_compute_performance-ego_min	0.04453848838806152
sim_compute_robot_state-ego_max	0.0901975393295288
sim_compute_robot_state-ego_mean	0.0657601959789271
sim_compute_robot_state-ego_median	0.06551654442496922
sim_compute_robot_state-ego_min	0.04689370155334473
sim_compute_sim_state_max	0.0467875599861145
sim_compute_sim_state_mean	0.035256844417128355
sim_compute_sim_state_median	0.03509836847131902
sim_compute_sim_state_min	0.027214713394641876
sim_physics_max	0.1407714605331421
sim_physics_mean	0.10528185485133086
sim_physics_median	0.103815813322325
sim_physics_min	0.07786479702702274
sim_render-ego_max	0.08261804580688477
sim_render-ego_mean	0.05782802629345029
sim_render-ego_median	0.05708205377733385
sim_render-ego_min	0.04151127815246582
simulation-passed	1
survival_time_max	1.850000000000001
survival_time_mean	1.3366666666666671
survival_time_min	1.0000000000000002

No reset possible

21236

2492

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-27 21:10:30+00:00

2019-04-27 21:15:29+00:00

0:04:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08894063925673246
survival_time_median	1.5000000000000009
deviation-center-line_median	0.04991482380675351
in-drivable-lane_median	0.2500000000000002

other stats

agent_compute-ego_max	0.1806117296218872
agent_compute-ego_mean	0.1655048635403618
agent_compute-ego_median	0.16418138043633823
agent_compute-ego_min	0.15411489009857177
deviation-center-line_max	0.08815886202707515
deviation-center-line_mean	0.056926391433218225
deviation-center-line_min	0.04373275321710265
deviation-heading_max	0.7795006368093428
deviation-heading_mean	0.663002000280312
deviation-heading_median	0.6705768119375406
deviation-heading_min	0.5158413722372513
driven_any_max	0.2173731741292939
driven_any_mean	0.18665227752146593
driven_any_median	0.19390672638172804
driven_any_min	0.11916948924631889
driven_lanedir_consec_max	0.11778380419287338
driven_lanedir_consec_mean	0.09116302842752402
driven_lanedir_consec_min	0.05905850043264316
driven_lanedir_max	0.11778380419287338
driven_lanedir_mean	0.09116302842752402
driven_lanedir_median	0.08894063925673246
driven_lanedir_min	0.05905850043264316
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.29000000000000026
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2173731741292939, "sim_physics": 0.12315622498007382, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07613382933837265, "sim_render-ego": 0.06360792412477381, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1806117296218872, "deviation-heading": 0.6611856573234065, "set_robot_commands": 0.09807705177980312, "deviation-center-line": 0.057542085208123914, "driven_lanedir_consec": 0.07613382933837265, "sim_compute_sim_state": 0.04104178793290082, "sim_compute_performance-ego": 0.06924310151268454, "sim_compute_robot_state-ego": 0.0793308230007396}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19390672638172804, "sim_physics": 0.10502165761487238, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11389836891699844, "sim_render-ego": 0.05720635940288675, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.16418138043633823, "deviation-heading": 0.6879055230940186, "set_robot_commands": 0.0938858410407757, "deviation-center-line": 0.04373275321710265, "driven_lanedir_consec": 0.11389836891699844, "sim_compute_sim_state": 0.03837948832018622, "sim_compute_performance-ego": 0.06585763240682668, "sim_compute_robot_state-ego": 0.07017013122295511}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11916948924631889, "sim_physics": 0.10663676261901855, "survival_time": 0.9500000000000004, "driven_lanedir": 0.08894063925673246, "sim_render-ego": 0.05624607989662572, "in-drivable-lane": 0, "agent_compute-ego": 0.15416939635025828, "deviation-heading": 0.5158413722372513, "set_robot_commands": 0.0921387797907779, "deviation-center-line": 0.08815886202707515, "driven_lanedir_consec": 0.08894063925673246, "sim_compute_sim_state": 0.04125876175729852, "sim_compute_performance-ego": 0.06381748851976897, "sim_compute_robot_state-ego": 0.06991012472855418}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1929585123916514, "sim_physics": 0.1133077621459961, "survival_time": 1.5000000000000009, "driven_lanedir": 0.05905850043264316, "sim_render-ego": 0.058344459533691405, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.15411489009857177, "deviation-heading": 0.7795006368093428, "set_robot_commands": 0.08405192693074544, "deviation-center-line": 0.04528343290703592, "driven_lanedir_consec": 0.05905850043264316, "sim_compute_sim_state": 0.0362124760945638, "sim_compute_performance-ego": 0.060858265558878584, "sim_compute_robot_state-ego": 0.06752686500549317}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20985348545833743, "sim_physics": 0.1296504928219703, "survival_time": 1.5500000000000007, "driven_lanedir": 0.11778380419287338, "sim_render-ego": 0.06214711743016397, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17444692119475333, "deviation-heading": 0.6705768119375406, "set_robot_commands": 0.0908898691977224, "deviation-center-line": 0.04991482380675351, "driven_lanedir_consec": 0.11778380419287338, "sim_compute_sim_state": 0.03754217393936649, "sim_compute_performance-ego": 0.06786394888354887, "sim_compute_robot_state-ego": 0.07798829386311193}}
set_robot_commands_max	0.09807705177980312
set_robot_commands_mean	0.09180869374796492
set_robot_commands_median	0.0921387797907779
set_robot_commands_min	0.08405192693074544
sim_compute_performance-ego_max	0.06924310151268454
sim_compute_performance-ego_mean	0.06552808737634153
sim_compute_performance-ego_median	0.06585763240682668
sim_compute_performance-ego_min	0.060858265558878584
sim_compute_robot_state-ego_max	0.0793308230007396
sim_compute_robot_state-ego_mean	0.0729852475641708
sim_compute_robot_state-ego_median	0.07017013122295511
sim_compute_robot_state-ego_min	0.06752686500549317
sim_compute_sim_state_max	0.04125876175729852
sim_compute_sim_state_mean	0.03888693760886317
sim_compute_sim_state_median	0.03837948832018622
sim_compute_sim_state_min	0.0362124760945638
sim_physics_max	0.1296504928219703
sim_physics_mean	0.11555458003638625
sim_physics_median	0.1133077621459961
sim_physics_min	0.10502165761487238
sim_render-ego_max	0.06360792412477381
sim_render-ego_mean	0.05951038807762833
sim_render-ego_median	0.058344459533691405
sim_render-ego_min	0.05624607989662572
simulation-passed	1
survival_time_max	1.7000000000000008
survival_time_mean	1.4300000000000006
survival_time_min	0.9500000000000004

No reset possible

21233

2504

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:09:16+00:00

2019-04-27 21:09:56+00:00

0:00:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21229

2510

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:08:09+00:00

2019-04-27 21:08:48+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21223

2512

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:07:05+00:00

2019-04-27 21:07:48+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21220

2520

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-27 21:06:24+00:00

2019-04-27 21:06:58+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21205

2537

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-27 21:00:42+00:00

2019-04-27 21:06:02+00:00

0:05:20

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21169

2707

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 20:02:51+00:00

2019-04-27 21:00:13+00:00

0:57:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2707/step1-simulation-ip-172-31-42-167-7194-job21169/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21152

2574

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-27 20:00:24+00:00

2019-04-27 20:02:36+00:00

0:02:12

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21123

3074

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 19:06:12+00:00

2019-04-27 20:00:04+00:00

0:53:52

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3074/step1-simulation-ip-172-31-42-167-7194-job21123/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21114

2641

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 19:00:16+00:00

2019-04-27 19:05:53+00:00

0:05:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.3999999999999995
deviation-center-line_median	0.1166759393545397
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.07142785839412523
agent_compute-ego_mean	0.0674982227046008
agent_compute-ego_median	0.06605472347953102
agent_compute-ego_min	0.06496120989322662
deviation-center-line_max	0.16987818035809085
deviation-center-line_mean	0.13199870851217008
deviation-center-line_min	0.1011892720306074
deviation-heading_max	0.5809378480871981
deviation-heading_mean	0.4194004386292103
deviation-heading_median	0.34882560565471876
deviation-heading_min	0.2596285487829774
driven_any_max	0.922682252912863
driven_any_mean	0.6324710235085378
driven_any_median	0.609146202404747
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.6632135184572027
driven_lanedir_consec_mean	0.4245071231796042
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.6632135184572027
driven_lanedir_mean	0.4245071231796042
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.6299999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11283720043343558, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05973514033035493, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06927918716215752, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09211865948959136, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03973288267431125, "sim_compute_performance-ego": 0.0677986010699205, "sim_compute_robot_state-ego": 0.07260569048599458}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11089439392089843, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.061729522546132405, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06576813459396362, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09436575174331666, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.040313196182250974, "sim_compute_performance-ego": 0.07223219871520996, "sim_compute_robot_state-ego": 0.07747091054916382}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.11681672659787264, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.05665001002225009, "in-drivable-lane": 0, "agent_compute-ego": 0.06605472347953102, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.09548687934875488, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.039603677662936126, "sim_compute_performance-ego": 0.06536361304196445, "sim_compute_robot_state-ego": 0.07557025822726163}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.10565471152464548, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06278826793034871, "in-drivable-lane": 0, "agent_compute-ego": 0.06496120989322662, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.0856667309999466, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03641915321350098, "sim_compute_performance-ego": 0.06533794105052948, "sim_compute_robot_state-ego": 0.06791747609774272}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.11234492322672968, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06014040760371996, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07142785839412523, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09934082238570505, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.038412804188935654, "sim_compute_performance-ego": 0.07057675589685855, "sim_compute_robot_state-ego": 0.07528383317201034}}
set_robot_commands_max	0.09934082238570505
set_robot_commands_mean	0.09339576879346292
set_robot_commands_median	0.09436575174331666
set_robot_commands_min	0.0856667309999466
sim_compute_performance-ego_max	0.07223219871520996
sim_compute_performance-ego_mean	0.06826182195489658
sim_compute_performance-ego_median	0.0677986010699205
sim_compute_performance-ego_min	0.06533794105052948
sim_compute_robot_state-ego_max	0.07747091054916382
sim_compute_robot_state-ego_mean	0.0737696337064346
sim_compute_robot_state-ego_median	0.07528383317201034
sim_compute_robot_state-ego_min	0.06791747609774272
sim_compute_sim_state_max	0.040313196182250974
sim_compute_sim_state_mean	0.03889634278438699
sim_compute_sim_state_median	0.039603677662936126
sim_compute_sim_state_min	0.03641915321350098
sim_physics_max	0.11681672659787264
sim_physics_mean	0.11170959114071637
sim_physics_median	0.11234492322672968
sim_physics_min	0.10565471152464548
sim_render-ego_max	0.06278826793034871
sim_render-ego_mean	0.060208669686561224
sim_render-ego_median	0.06014040760371996
sim_render-ego_min	0.05665001002225009
simulation-passed	1
survival_time_max	3.5499999999999954
survival_time_mean	2.469999999999999
survival_time_min	1.1000000000000003

No reset possible

21087

2770

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 18:02:45+00:00

2019-04-27 19:00:09+00:00

0:57:24

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-42-167-7194-job21087/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21013

2864

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 17:00:27+00:00

2019-04-27 18:00:10+00:00

0:59:43

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-42-167-7194-job21013/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20993

2814

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-27 16:43:52+00:00

2019-04-27 17:00:03+00:00

0:16:11

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 486, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1024, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1181, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 39, in copy_to_cache
    msg = 'Copying %s to cache %s' % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2814/step1-simulation-ip-172-31-42-167-7194-job20993/tmp/tmpx3zywuo2/episodes/ETHZ_autolab_technical_track-6-0/drawing.html'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20988

2823

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 16:34:24+00:00

2019-04-27 16:43:20+00:00

0:08:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.1647277729851859
agent_compute-ego_mean	0.1581295410580818
agent_compute-ego_median	0.15800137873049136
agent_compute-ego_min	0.14852274894714357
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16276461989791305, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06159547523215965, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15800137873049136, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10077059268951416, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0401618171621252, "sim_compute_performance-ego": 0.07139444792712177, "sim_compute_robot_state-ego": 0.07510447060620343, "sim_compute_robot_state-npc0": 0.07020055364679408, "sim_compute_robot_state-npc1": 0.07108915293658222, "sim_compute_robot_state-npc2": 0.06862039919252749, "sim_compute_robot_state-npc3": 0.07214004022103769}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1988169860839844, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06441498756408691, "in-drivable-lane": 0, "agent_compute-ego": 0.14852274894714357, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09658520698547364, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03989990234375, "sim_compute_performance-ego": 0.07115654945373535, "sim_compute_robot_state-ego": 0.07548545837402344, "sim_compute_robot_state-npc0": 0.07108907699584961, "sim_compute_robot_state-npc1": 0.07199681282043457, "sim_compute_robot_state-npc2": 0.0678072452545166, "sim_compute_robot_state-npc3": 0.06878486633300782}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18645850608223363, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.0651839061787254, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15641108939522191, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09612292992441278, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.039554097150501455, "sim_compute_performance-ego": 0.07143299203169973, "sim_compute_robot_state-ego": 0.07369480634990491, "sim_compute_robot_state-npc0": 0.07104967142406263, "sim_compute_robot_state-npc1": 0.07142457522844013, "sim_compute_robot_state-npc2": 0.07008715366062365, "sim_compute_robot_state-npc3": 0.06798209955817774}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.21603376050538656, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06590033482901658, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.16298471523236624, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10003293013270896, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04109033753600302, "sim_compute_performance-ego": 0.07422502734993078, "sim_compute_robot_state-ego": 0.08359972434707835, "sim_compute_robot_state-npc0": 0.07467775405207767, "sim_compute_robot_state-npc1": 0.0726069619383993, "sim_compute_robot_state-npc2": 0.07091570805899705, "sim_compute_robot_state-npc3": 0.07112905345385588}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.2067180701664516, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06897997004645211, "in-drivable-lane": 0, "agent_compute-ego": 0.1647277729851859, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10631983620779854, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04329866170883179, "sim_compute_performance-ego": 0.08016084773199898, "sim_compute_robot_state-ego": 0.08978383030210223, "sim_compute_robot_state-npc0": 0.07944731201444354, "sim_compute_robot_state-npc1": 0.07865578787667411, "sim_compute_robot_state-npc2": 0.07867454630987984, "sim_compute_robot_state-npc3": 0.07827100583485194}}
set_robot_commands_max	0.10631983620779854
set_robot_commands_mean	0.09996629918798162
set_robot_commands_median	0.10003293013270896
set_robot_commands_min	0.09612292992441278
sim_compute_performance-ego_max	0.08016084773199898
sim_compute_performance-ego_mean	0.07367397289889734
sim_compute_performance-ego_median	0.07143299203169973
sim_compute_performance-ego_min	0.07115654945373535
sim_compute_robot_state-ego_max	0.08978383030210223
sim_compute_robot_state-ego_mean	0.07953365799586247
sim_compute_robot_state-ego_median	0.07548545837402344
sim_compute_robot_state-ego_min	0.07369480634990491
sim_compute_robot_state-npc0_max	0.07944731201444354
sim_compute_robot_state-npc0_mean	0.07329287362664551
sim_compute_robot_state-npc0_median	0.07108907699584961
sim_compute_robot_state-npc0_min	0.07020055364679408
sim_compute_robot_state-npc1_max	0.07865578787667411
sim_compute_robot_state-npc1_mean	0.07315465816010605
sim_compute_robot_state-npc1_median	0.07199681282043457
sim_compute_robot_state-npc1_min	0.07108915293658222
sim_compute_robot_state-npc2_max	0.07867454630987984
sim_compute_robot_state-npc2_mean	0.07122101049530892
sim_compute_robot_state-npc2_median	0.07008715366062365
sim_compute_robot_state-npc2_min	0.0678072452545166
sim_compute_robot_state-npc3_max	0.07827100583485194
sim_compute_robot_state-npc3_mean	0.07166141308018621
sim_compute_robot_state-npc3_median	0.07112905345385588
sim_compute_robot_state-npc3_min	0.06798209955817774
sim_compute_sim_state_max	0.04329866170883179
sim_compute_sim_state_mean	0.040800963180242296
sim_compute_sim_state_median	0.0401618171621252
sim_compute_sim_state_min	0.039554097150501455
sim_physics_max	0.21603376050538656
sim_physics_mean	0.19415838854719383
sim_physics_median	0.1988169860839844
sim_physics_min	0.16276461989791305
sim_render-ego_max	0.06897997004645211
sim_render-ego_mean	0.06521493477008813
sim_render-ego_median	0.0651839061787254
sim_render-ego_min	0.06159547523215965
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

20987

2832

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-27 16:33:15+00:00

2019-04-27 16:33:49+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20983

2835

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-27 16:32:06+00:00

2019-04-27 16:32:39+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20981

2840

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-27 16:31:26+00:00

2019-04-27 16:31:59+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20979

2844

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-27 16:30:08+00:00

2019-04-27 16:30:43+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20973

2857

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 16:18:54+00:00

2019-04-27 16:29:19+00:00

0:10:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4430532861735075
survival_time_median	7.049999999999983
deviation-center-line_median	0.20873036418961904
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.11424389122225714
agent_compute-ego_mean	0.1019383098907178
agent_compute-ego_median	0.09952219816354604
agent_compute-ego_min	0.09163950764855672
deviation-center-line_max	0.4406719765006902
deviation-center-line_mean	0.2389268041098079
deviation-center-line_min	0.1197182906674316
deviation-heading_max	2.0405002394588827
deviation-heading_mean	1.6794211129018712
deviation-heading_median	1.6898654544228242
deviation-heading_min	1.051443625514617
driven_any_max	0.5800977204512235
driven_any_mean	0.4095623290163637
driven_any_median	0.539700175382884
driven_any_min	0.145941590384182
driven_lanedir_consec_max	0.4807143964063374
driven_lanedir_consec_mean	0.336827421987887
driven_lanedir_consec_min	0.11998715093122447
driven_lanedir_max	0.4807143964063374
driven_lanedir_mean	0.336827421987887
driven_lanedir_median	0.4430532861735075
driven_lanedir_min	0.11998715093122447
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3899999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5800977204512235, "sim_physics": 0.12562400259469686, "survival_time": 7.599999999999981, "driven_lanedir": 0.471157144399132, "sim_render-ego": 0.06570419982859962, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.10857231366006952, "deviation-heading": 2.0405002394588827, "set_robot_commands": 0.10646736778711018, "deviation-center-line": 0.4406719765006902, "driven_lanedir_consec": 0.471157144399132, "sim_compute_sim_state": 0.04145510573136179, "sim_compute_performance-ego": 0.0740889404949389, "sim_compute_robot_state-ego": 0.08323616573685094}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23432920698788115, "sim_physics": 0.11734150373018704, "survival_time": 3.2499999999999964, "driven_lanedir": 0.16922513202923373, "sim_render-ego": 0.06126067821796124, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09952219816354604, "deviation-heading": 1.575960017562641, "set_robot_commands": 0.09768353608938364, "deviation-center-line": 0.1197182906674316, "driven_lanedir_consec": 0.16922513202923373, "sim_compute_sim_state": 0.04137854209313026, "sim_compute_performance-ego": 0.06573031132037822, "sim_compute_robot_state-ego": 0.07341010387127216}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.145941590384182, "sim_physics": 0.10797257756077966, "survival_time": 2.1500000000000004, "driven_lanedir": 0.11998715093122447, "sim_render-ego": 0.058402455130288765, "in-drivable-lane": 0, "agent_compute-ego": 0.09163950764855672, "deviation-heading": 1.051443625514617, "set_robot_commands": 0.09354704479838528, "deviation-center-line": 0.20873036418961904, "driven_lanedir_consec": 0.11998715093122447, "sim_compute_sim_state": 0.0376201119533805, "sim_compute_performance-ego": 0.06827331698218057, "sim_compute_robot_state-ego": 0.07088540875634482}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5477429518756478, "sim_physics": 0.10882659391923384, "survival_time": 7.149999999999983, "driven_lanedir": 0.4807143964063374, "sim_render-ego": 0.05581569838357139, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09571363875915954, "deviation-heading": 2.039336227550392, "set_robot_commands": 0.08734535337328077, "deviation-center-line": 0.22455249635290225, "driven_lanedir_consec": 0.4807143964063374, "sim_compute_sim_state": 0.035767678614262936, "sim_compute_performance-ego": 0.06328660291391652, "sim_compute_robot_state-ego": 0.06796782833712918}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.539700175382884, "sim_physics": 0.13188868549698635, "survival_time": 7.049999999999983, "driven_lanedir": 0.4430532861735075, "sim_render-ego": 0.06847099716781724, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.11424389122225714, "deviation-heading": 1.6898654544228242, "set_robot_commands": 0.10856026284238124, "deviation-center-line": 0.2009608928383967, "driven_lanedir_consec": 0.4430532861735075, "sim_compute_sim_state": 0.045470599587082015, "sim_compute_performance-ego": 0.080280657355667, "sim_compute_robot_state-ego": 0.08913160046787126}}
set_robot_commands_max	0.10856026284238124
set_robot_commands_mean	0.09872071297810822
set_robot_commands_median	0.09768353608938364
set_robot_commands_min	0.08734535337328077
sim_compute_performance-ego_max	0.080280657355667
sim_compute_performance-ego_mean	0.07033196581341625
sim_compute_performance-ego_median	0.06827331698218057
sim_compute_performance-ego_min	0.06328660291391652
sim_compute_robot_state-ego_max	0.08913160046787126
sim_compute_robot_state-ego_mean	0.07692622143389367
sim_compute_robot_state-ego_median	0.07341010387127216
sim_compute_robot_state-ego_min	0.06796782833712918
sim_compute_sim_state_max	0.045470599587082015
sim_compute_sim_state_mean	0.0403384075958435
sim_compute_sim_state_median	0.04137854209313026
sim_compute_sim_state_min	0.035767678614262936
sim_physics_max	0.13188868549698635
sim_physics_mean	0.11833067266037674
sim_physics_median	0.11734150373018704
sim_physics_min	0.10797257756077966
sim_render-ego_max	0.06847099716781724
sim_render-ego_mean	0.06193080574564765
sim_render-ego_median	0.06126067821796124
sim_render-ego_min	0.05581569838357139
simulation-passed	1
survival_time_max	7.599999999999981
survival_time_mean	5.439999999999989
survival_time_min	2.1500000000000004

No reset possible

20959

2861

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 16:00:27+00:00

2019-04-27 16:18:28+00:00

0:18:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4442836953793563
survival_time_median	6.5999999999999845
deviation-center-line_median	0.23011717945840268
in-drivable-lane_median	0.14999999999999947

other stats

agent_compute-ego_max	0.12275256315867106
agent_compute-ego_mean	0.10480534467338098
agent_compute-ego_median	0.10146036292567398
agent_compute-ego_min	0.09774773567914964
deviation-center-line_max	0.2677965905311012
deviation-center-line_mean	0.2240018824772453
deviation-center-line_min	0.1676578222570646
deviation-heading_max	1.9590729116640704
deviation-heading_mean	1.718855273685324
deviation-heading_median	1.759743530959963
deviation-heading_min	1.4542236037360072
driven_any_max	1.1707030898390385
driven_any_mean	0.5517917304513403
driven_any_median	0.5035446157600671
driven_any_min	0.21826570258829023
driven_lanedir_consec_max	0.49543157849784336
driven_lanedir_consec_mean	0.363214735545378
driven_lanedir_consec_min	0.18106093948028257
driven_lanedir_max	0.49543157849784336
driven_lanedir_mean	0.363214735545378
driven_lanedir_median	0.4442836953793563
driven_lanedir_min	0.18106093948028257
in-drivable-lane_max	7.9000000000000945
in-drivable-lane_mean	1.7800000000000178
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1707030898390385, "sim_physics": 0.15399993658065797, "survival_time": 14.950000000000076, "driven_lanedir": 0.49543157849784336, "sim_render-ego": 0.05325824419657389, "in-drivable-lane": 7.9000000000000945, "agent_compute-ego": 0.12275256315867106, "deviation-heading": 1.637814574719438, "set_robot_commands": 0.0816234024365743, "deviation-center-line": 0.2677965905311012, "driven_lanedir_consec": 0.49543157849784336, "sim_compute_sim_state": 0.03412662744522095, "sim_compute_performance-ego": 0.059219028949737545, "sim_compute_robot_state-ego": 0.06724810202916463, "sim_compute_robot_state-npc0": 0.06217306137084961, "sim_compute_robot_state-npc1": 0.0603417444229126, "sim_compute_robot_state-npc2": 0.06085826794306437, "sim_compute_robot_state-npc3": 0.06146678924560547}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.35888276677719, "sim_physics": 0.17299936215082803, "survival_time": 4.799999999999991, "driven_lanedir": 0.24748331544262123, "sim_render-ego": 0.0627503792444865, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.09774773567914964, "deviation-heading": 1.759743530959963, "set_robot_commands": 0.0982886254787445, "deviation-center-line": 0.2070233828025143, "driven_lanedir_consec": 0.24748331544262123, "sim_compute_sim_state": 0.03909137099981308, "sim_compute_performance-ego": 0.06644412875175476, "sim_compute_robot_state-ego": 0.07793417821327846, "sim_compute_robot_state-npc0": 0.0721106082201004, "sim_compute_robot_state-npc1": 0.07072754700978597, "sim_compute_robot_state-npc2": 0.0694346899787585, "sim_compute_robot_state-npc3": 0.06805821011463802}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5075624772921158, "sim_physics": 0.18783265307433625, "survival_time": 6.649999999999984, "driven_lanedir": 0.4478141489267866, "sim_render-ego": 0.062262959946367075, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10391545654239512, "deviation-heading": 1.7834217473471417, "set_robot_commands": 0.10066343967179608, "deviation-center-line": 0.24741443733714355, "driven_lanedir_consec": 0.4478141489267866, "sim_compute_sim_state": 0.03942739156852091, "sim_compute_performance-ego": 0.07062899797482598, "sim_compute_robot_state-ego": 0.07568726145235219, "sim_compute_robot_state-npc0": 0.0719773375002065, "sim_compute_robot_state-npc1": 0.07020208889380433, "sim_compute_robot_state-npc2": 0.07261384519419276, "sim_compute_robot_state-npc3": 0.07338236686878634}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5035446157600671, "sim_physics": 0.1844956116242842, "survival_time": 6.5999999999999845, "driven_lanedir": 0.4442836953793563, "sim_render-ego": 0.06146908528877027, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.10146036292567398, "deviation-heading": 1.9590729116640704, "set_robot_commands": 0.09928793979413582, "deviation-center-line": 0.23011717945840268, "driven_lanedir_consec": 0.4442836953793563, "sim_compute_sim_state": 0.04002102757945205, "sim_compute_performance-ego": 0.0695431087956284, "sim_compute_robot_state-ego": 0.07357061992992055, "sim_compute_robot_state-npc0": 0.06915734392223936, "sim_compute_robot_state-npc1": 0.07379083561174797, "sim_compute_robot_state-npc2": 0.0708716529788393, "sim_compute_robot_state-npc3": 0.07259641452269121}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21826570258829023, "sim_physics": 0.17394244084592725, "survival_time": 3.049999999999997, "driven_lanedir": 0.18106093948028257, "sim_render-ego": 0.06939181734303959, "in-drivable-lane": 0, "agent_compute-ego": 0.09815060506101514, "deviation-heading": 1.4542236037360072, "set_robot_commands": 0.0966396918062304, "deviation-center-line": 0.1676578222570646, "driven_lanedir_consec": 0.18106093948028257, "sim_compute_sim_state": 0.03979993648216373, "sim_compute_performance-ego": 0.0699092833722224, "sim_compute_robot_state-ego": 0.07434421289162557, "sim_compute_robot_state-npc0": 0.07001878003605076, "sim_compute_robot_state-npc1": 0.06707228598047475, "sim_compute_robot_state-npc2": 0.07076052368664351, "sim_compute_robot_state-npc3": 0.07029433328597272}}
set_robot_commands_max	0.10066343967179608
set_robot_commands_mean	0.0953006198374962
set_robot_commands_median	0.0982886254787445
set_robot_commands_min	0.0816234024365743
sim_compute_performance-ego_max	0.07062899797482598
sim_compute_performance-ego_mean	0.06714890956883382
sim_compute_performance-ego_median	0.0695431087956284
sim_compute_performance-ego_min	0.059219028949737545
sim_compute_robot_state-ego_max	0.07793417821327846
sim_compute_robot_state-ego_mean	0.07375687490326828
sim_compute_robot_state-ego_median	0.07434421289162557
sim_compute_robot_state-ego_min	0.06724810202916463
sim_compute_robot_state-npc0_max	0.0721106082201004
sim_compute_robot_state-npc0_mean	0.06908742620988934
sim_compute_robot_state-npc0_median	0.07001878003605076
sim_compute_robot_state-npc0_min	0.06217306137084961
sim_compute_robot_state-npc1_max	0.07379083561174797
sim_compute_robot_state-npc1_mean	0.06842690038374513
sim_compute_robot_state-npc1_median	0.07020208889380433
sim_compute_robot_state-npc1_min	0.0603417444229126
sim_compute_robot_state-npc2_max	0.07261384519419276
sim_compute_robot_state-npc2_mean	0.0689077959562997
sim_compute_robot_state-npc2_median	0.07076052368664351
sim_compute_robot_state-npc2_min	0.06085826794306437
sim_compute_robot_state-npc3_max	0.07338236686878634
sim_compute_robot_state-npc3_mean	0.06915962280753876
sim_compute_robot_state-npc3_median	0.07029433328597272
sim_compute_robot_state-npc3_min	0.06146678924560547
sim_compute_sim_state_max	0.04002102757945205
sim_compute_sim_state_mean	0.03849327081503415
sim_compute_sim_state_median	0.03942739156852091
sim_compute_sim_state_min	0.03412662744522095
sim_physics_max	0.18783265307433625
sim_physics_mean	0.17465400085520671
sim_physics_median	0.17394244084592725
sim_physics_min	0.15399993658065797
sim_render-ego_max	0.06939181734303959
sim_render-ego_mean	0.06182649720384746
sim_render-ego_median	0.062262959946367075
sim_render-ego_min	0.05325824419657389
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.210000000000006
survival_time_min	3.049999999999997

No reset possible

20951

2880

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-27 15:55:55+00:00

2019-04-27 16:00:10+00:00

0:04:15

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2880/step1-simulation-ip-172-31-42-167-7194-job20951/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20946

2893

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 15:43:44+00:00

2019-04-27 15:55:47+00:00

0:12:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3004612044380359
survival_time_median	4.899999999999991
deviation-center-line_median	0.24770995818777833
in-drivable-lane_median	1.20000000000001

other stats

agent_compute-ego_max	0.18701149929653516
agent_compute-ego_mean	0.17924790828734913
agent_compute-ego_median	0.17968229371674208
agent_compute-ego_min	0.1731323993812173
deviation-center-line_max	0.612632943547377
deviation-center-line_mean	0.3088841726088521
deviation-center-line_min	0.16005125397873246
deviation-heading_max	6.254828250705772
deviation-heading_mean	2.609587082899453
deviation-heading_median	2.1702556178769954
deviation-heading_min	0.7256424864991055
driven_any_max	1.4334994795858234
driven_any_mean	0.8240885074796152
driven_any_median	0.6288276408666593
driven_any_min	0.5249644395511194
driven_lanedir_consec_max	0.6665759722376454
driven_lanedir_consec_mean	0.3782246515968707
driven_lanedir_consec_min	0.16483096550581067
driven_lanedir_max	0.9172567432880294
driven_lanedir_mean	0.4821405191643383
driven_lanedir_median	0.368195617900545
driven_lanedir_min	0.20756098713738247
in-drivable-lane_max	1.8999999999999932
in-drivable-lane_mean	1.319999999999998
in-drivable-lane_min	0.6499999999999977
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9939066272326912, "sim_physics": 0.1148185871415219, "survival_time": 5.899999999999987, "driven_lanedir": 0.6665759722376454, "sim_render-ego": 0.062989111674034, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1731323993812173, "deviation-heading": 0.9018486313612406, "set_robot_commands": 0.0941966044700752, "deviation-center-line": 0.22111729086582177, "driven_lanedir_consec": 0.6665759722376454, "sim_compute_sim_state": 0.04150183322065967, "sim_compute_performance-ego": 0.06945890693341271, "sim_compute_robot_state-ego": 0.07632306672758975}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6288276408666593, "sim_physics": 0.13297929569166533, "survival_time": 4.899999999999991, "driven_lanedir": 0.368195617900545, "sim_render-ego": 0.06354881062799571, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.17968229371674208, "deviation-heading": 2.1702556178769954, "set_robot_commands": 0.09778579400510204, "deviation-center-line": 0.30290941646455094, "driven_lanedir_consec": 0.3004612044380359, "sim_compute_sim_state": 0.04110242882553412, "sim_compute_performance-ego": 0.07298643734990334, "sim_compute_robot_state-ego": 0.0815934672647593}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5392443501617825, "sim_physics": 0.12483399293639444, "survival_time": 4.399999999999992, "driven_lanedir": 0.25111327525808935, "sim_render-ego": 0.06701323119076816, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.18701149929653516, "deviation-heading": 2.9953604280541524, "set_robot_commands": 0.1016078618439761, "deviation-center-line": 0.24770995818777833, "driven_lanedir_consec": 0.16483096550581067, "sim_compute_sim_state": 0.04181681166995655, "sim_compute_performance-ego": 0.07316941835663536, "sim_compute_robot_state-ego": 0.08204723217270592}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4334994795858234, "sim_physics": 0.12172752949926588, "survival_time": 10.800000000000018, "driven_lanedir": 0.9172567432880294, "sim_render-ego": 0.06299183434910244, "in-drivable-lane": 1.20000000000001, "agent_compute-ego": 0.1830467504483682, "deviation-heading": 6.254828250705772, "set_robot_commands": 0.09845449416725724, "deviation-center-line": 0.612632943547377, "driven_lanedir_consec": 0.5516941286654791, "sim_compute_sim_state": 0.03969017885349415, "sim_compute_performance-ego": 0.06922387193750452, "sim_compute_robot_state-ego": 0.07590696767524437}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5249644395511194, "sim_physics": 0.11535192147279397, "survival_time": 3.899999999999994, "driven_lanedir": 0.20756098713738247, "sim_render-ego": 0.06417710964496319, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.17336659859388304, "deviation-heading": 0.7256424864991055, "set_robot_commands": 0.09479076128739578, "deviation-center-line": 0.16005125397873246, "driven_lanedir_consec": 0.20756098713738247, "sim_compute_sim_state": 0.039432381972288474, "sim_compute_performance-ego": 0.0711813890016996, "sim_compute_robot_state-ego": 0.07557138724204822}}
set_robot_commands_max	0.1016078618439761
set_robot_commands_mean	0.09736710315476128
set_robot_commands_median	0.09778579400510204
set_robot_commands_min	0.0941966044700752
sim_compute_performance-ego_max	0.07316941835663536
sim_compute_performance-ego_mean	0.0712040047158311
sim_compute_performance-ego_median	0.0711813890016996
sim_compute_performance-ego_min	0.06922387193750452
sim_compute_robot_state-ego_max	0.08204723217270592
sim_compute_robot_state-ego_mean	0.0782884242164695
sim_compute_robot_state-ego_median	0.07632306672758975
sim_compute_robot_state-ego_min	0.07557138724204822
sim_compute_sim_state_max	0.04181681166995655
sim_compute_sim_state_mean	0.04070872690838659
sim_compute_sim_state_median	0.04110242882553412
sim_compute_sim_state_min	0.039432381972288474
sim_physics_max	0.13297929569166533
sim_physics_mean	0.1219422653483283
sim_physics_median	0.12172752949926588
sim_physics_min	0.1148185871415219
sim_render-ego_max	0.06701323119076816
sim_render-ego_mean	0.06414401949737271
sim_render-ego_median	0.06354881062799571
sim_render-ego_min	0.062989111674034
simulation-passed	1
survival_time_max	10.800000000000018
survival_time_mean	5.979999999999997
survival_time_min	3.899999999999994

No reset possible

20942

2909

Ashwin Ram 🇸🇬

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 15:37:13+00:00

2019-04-27 15:42:58+00:00

0:05:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.431749818466148
survival_time_median	1.2500000000000004
deviation-center-line_median	0.07785372543404256
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2686178962389628
agent_compute-ego_mean	0.25173895889730435
agent_compute-ego_median	0.2489522661481585
agent_compute-ego_min	0.234267920255661
deviation-center-line_max	0.16850282219718765
deviation-center-line_mean	0.09510082986524487
deviation-center-line_min	0.05525180113567536
deviation-heading_max	0.345995052331256
deviation-heading_mean	0.24800759250466264
deviation-heading_median	0.20410713107808
deviation-heading_min	0.16290079358306278
driven_any_max	1.5833783776226673
driven_any_mean	0.7153951164384857
driven_any_median	0.4884229675397246
driven_any_min	0.28273013447102285
driven_lanedir_consec_max	1.2398695287041943
driven_lanedir_consec_mean	0.5567471842447391
driven_lanedir_consec_min	0.27491964178588946
driven_lanedir_max	1.2398695287041943
driven_lanedir_mean	0.5567471842447391
driven_lanedir_median	0.431749818466148
driven_lanedir_min	0.27491964178588946
in-drivable-lane_max	0.7000000000000006
in-drivable-lane_mean	0.24999999999999972
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7526511681720554, "sim_physics": 0.12815493856157575, "survival_time": 1.7500000000000009, "driven_lanedir": 0.37025785151428314, "sim_render-ego": 0.05968667439052037, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.2489522661481585, "deviation-heading": 0.16290079358306278, "set_robot_commands": 0.09025602340698242, "deviation-center-line": 0.09922109875527278, "driven_lanedir_consec": 0.37025785151428314, "sim_compute_sim_state": 0.035672875813075475, "sim_compute_performance-ego": 0.07260489463806152, "sim_compute_robot_state-ego": 0.09340846879141672}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4697929343869585, "sim_physics": 0.12004640579223631, "survival_time": 1.2500000000000004, "driven_lanedir": 0.431749818466148, "sim_render-ego": 0.058878307342529294, "in-drivable-lane": 0, "agent_compute-ego": 0.24309014320373537, "deviation-heading": 0.3370968471517856, "set_robot_commands": 0.09969481468200685, "deviation-center-line": 0.05525180113567536, "driven_lanedir_consec": 0.431749818466148, "sim_compute_sim_state": 0.03994657516479492, "sim_compute_performance-ego": 0.07289329528808594, "sim_compute_robot_state-ego": 0.07731306076049804}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28273013447102285, "sim_physics": 0.13035228848457336, "survival_time": 0.8000000000000002, "driven_lanedir": 0.27491964178588946, "sim_render-ego": 0.0670388787984848, "in-drivable-lane": 0, "agent_compute-ego": 0.234267920255661, "deviation-heading": 0.18993813837912865, "set_robot_commands": 0.09909453988075256, "deviation-center-line": 0.07467470180404599, "driven_lanedir_consec": 0.27491964178588946, "sim_compute_sim_state": 0.037192702293396, "sim_compute_performance-ego": 0.06462275981903076, "sim_compute_robot_state-ego": 0.07585141062736511}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4884229675397246, "sim_physics": 0.13997825332309888, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4669390807531806, "sim_render-ego": 0.06588930669038193, "in-drivable-lane": 0, "agent_compute-ego": 0.26376656864000403, "deviation-heading": 0.345995052331256, "set_robot_commands": 0.0955946445465088, "deviation-center-line": 0.07785372543404256, "driven_lanedir_consec": 0.4669390807531806, "sim_compute_sim_state": 0.039776149003402046, "sim_compute_performance-ego": 0.07078923349795134, "sim_compute_robot_state-ego": 0.0719056855077329}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5833783776226673, "sim_physics": 0.12276480197906496, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2398695287041943, "sim_render-ego": 0.07076876163482666, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.2686178962389628, "deviation-heading": 0.20410713107808, "set_robot_commands": 0.10283422072728476, "deviation-center-line": 0.16850282219718765, "driven_lanedir_consec": 1.2398695287041943, "sim_compute_sim_state": 0.041160384813944496, "sim_compute_performance-ego": 0.07681279579798381, "sim_compute_robot_state-ego": 0.08117243448893229}}
set_robot_commands_max	0.10283422072728476
set_robot_commands_mean	0.09749484864870708
set_robot_commands_median	0.09909453988075256
set_robot_commands_min	0.09025602340698242
sim_compute_performance-ego_max	0.07681279579798381
sim_compute_performance-ego_mean	0.07154459580822267
sim_compute_performance-ego_median	0.07260489463806152
sim_compute_performance-ego_min	0.06462275981903076
sim_compute_robot_state-ego_max	0.09340846879141672
sim_compute_robot_state-ego_mean	0.07993021203518902
sim_compute_robot_state-ego_median	0.07731306076049804
sim_compute_robot_state-ego_min	0.0719056855077329
sim_compute_sim_state_max	0.041160384813944496
sim_compute_sim_state_mean	0.038749737417722585
sim_compute_sim_state_median	0.039776149003402046
sim_compute_sim_state_min	0.035672875813075475
sim_physics_max	0.13997825332309888
sim_physics_mean	0.12825933762810984
sim_physics_median	0.12815493856157575
sim_physics_min	0.12004640579223631
sim_render-ego_max	0.07076876163482666
sim_render-ego_mean	0.06445238577134861
sim_render-ego_median	0.06588930669038193
sim_render-ego_min	0.058878307342529294
simulation-passed	1
survival_time_max	2.9999999999999973
survival_time_mean	1.59
survival_time_min	0.8000000000000002

No reset possible

20928

2970

Andrea Censi 🇨🇭

minimal_agent (Python 3)

step1-simulation

success

2019-04-27 15:06:42+00:00

2019-04-27 15:36:59+00:00

0:30:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6202968959903497
survival_time_median	6.8999999999999835
deviation-center-line_median	0.2968973039399582
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.15873932495391627
agent_compute-ego_mean	0.1448686276022345
agent_compute-ego_median	0.14483917016777204
agent_compute-ego_min	0.13346620287214006
deviation-center-line_max	1.2578907011919125
deviation-center-line_mean	0.392559795052945
deviation-center-line_min	0.20837582250812192
deviation-heading_max	1.7338651399303977
deviation-heading_mean	0.922434565822337
deviation-heading_median	0.801279189692507
deviation-heading_min	0.48740885281046914
driven_any_max	1.7560498171261352
driven_any_mean	0.8746411422725543
driven_any_median	0.9886852216355494
driven_any_min	0.278862430643389
driven_lanedir_consec_max	1.7523714592470048
driven_lanedir_consec_mean	0.6813457664348396
driven_lanedir_consec_min	0.2720172605900939
driven_lanedir_max	1.7523714592470048
driven_lanedir_mean	0.6813457664348396
driven_lanedir_median	0.6202968959903497
driven_lanedir_min	0.2720172605900939
in-drivable-lane_max	6.400000000000029
in-drivable-lane_mean	1.1100000000000017
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.11173401633612544, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06181628412479977, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15873932495391627, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.09974497856853676, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.04129604813006285, "sim_compute_performance-ego": 0.07140197170724114, "sim_compute_robot_state-ego": 0.08080625191009302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.10651785135269164, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.05837292841502598, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.150048679964883, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.090572646686009, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.038639567579541886, "sim_compute_performance-ego": 0.0688673973083496, "sim_compute_robot_state-ego": 0.0697739601135254}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.09838187959459092, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.0559720410241021, "in-drivable-lane": 0, "agent_compute-ego": 0.14572413232591416, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.08185766537984213, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.03583669662475586, "sim_compute_performance-ego": 0.059658114115397134, "sim_compute_robot_state-ego": 0.06459732055664062}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.10888435788776564, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.05766843971998795, "in-drivable-lane": 0, "agent_compute-ego": 0.13847725806028946, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.08727742018906967, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.03633668889170107, "sim_compute_performance-ego": 0.06200290762859842, "sim_compute_robot_state-ego": 0.07061457374821538}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.10694984322813549, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.06334422494722827, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.15603620276603525, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.09432532798209692, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.03956755111206612, "sim_compute_performance-ego": 0.0688102288877583, "sim_compute_robot_state-ego": 0.07352558009700688}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4747777342207285, "sim_physics": 0.0983344486781529, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45069691160064007, "sim_render-ego": 0.054153823852539064, "in-drivable-lane": 0, "agent_compute-ego": 0.13346620287214006, "deviation-heading": 1.1234646030837343, "set_robot_commands": 0.08179356711251395, "deviation-center-line": 0.24614915791869676, "driven_lanedir_consec": 0.45069691160064007, "sim_compute_sim_state": 0.03285309246608189, "sim_compute_performance-ego": 0.05896806035723005, "sim_compute_robot_state-ego": 0.06582615034920829}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.019681949804902, "sim_physics": 0.09930631980090074, "survival_time": 7.099999999999983, "driven_lanedir": 0.5497294169147833, "sim_render-ego": 0.059958815574646, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.14188892908499273, "deviation-heading": 1.017147490050159, "set_robot_commands": 0.08638854933456636, "deviation-center-line": 0.2968973039399582, "driven_lanedir_consec": 0.5497294169147833, "sim_compute_sim_state": 0.03598076860669633, "sim_compute_performance-ego": 0.06443359986157485, "sim_compute_robot_state-ego": 0.06781120367453132}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.292561402657028, "sim_physics": 0.1024059990177984, "survival_time": 2.3, "driven_lanedir": 0.28556003912644146, "sim_render-ego": 0.06018480528955874, "in-drivable-lane": 0, "agent_compute-ego": 0.14056881614353345, "deviation-heading": 0.5055513317884642, "set_robot_commands": 0.08882991127345873, "deviation-center-line": 0.2291230953178777, "driven_lanedir_consec": 0.28556003912644146, "sim_compute_sim_state": 0.03707107771997866, "sim_compute_performance-ego": 0.0683067622392074, "sim_compute_robot_state-ego": 0.06788087927776834}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6284115088436346, "sim_physics": 0.1062121073404948, "survival_time": 4.499999999999992, "driven_lanedir": 0.6202968959903497, "sim_render-ego": 0.06237002743615045, "in-drivable-lane": 0, "agent_compute-ego": 0.15121848318311903, "deviation-heading": 0.6992938214416804, "set_robot_commands": 0.0911769496070014, "deviation-center-line": 0.292496185158671, "driven_lanedir_consec": 0.6202968959903497, "sim_compute_sim_state": 0.0379530323876275, "sim_compute_performance-ego": 0.06815758281283908, "sim_compute_robot_state-ego": 0.07455334663391114}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9886852216355494, "sim_physics": 0.11499807281770567, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6459976804857221, "sim_render-ego": 0.06062967017077017, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.14610944969066675, "deviation-heading": 1.4412214371425691, "set_robot_commands": 0.09217523319133814, "deviation-center-line": 0.3337191779486854, "driven_lanedir_consec": 0.6459976804857221, "sim_compute_sim_state": 0.03842308210289997, "sim_compute_performance-ego": 0.07006973287333614, "sim_compute_robot_state-ego": 0.07656210229016733}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5766678237160747, "sim_physics": 0.1135181658858553, "survival_time": 10.90000000000002, "driven_lanedir": 1.2238020245203944, "sim_render-ego": 0.06402451401456781, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.14988496762896897, "deviation-heading": 1.6250699730411842, "set_robot_commands": 0.0947333246196082, "deviation-center-line": 0.5732131458770182, "driven_lanedir_consec": 1.2238020245203944, "sim_compute_sim_state": 0.03919841062038317, "sim_compute_performance-ego": 0.06972121098719605, "sim_compute_robot_state-ego": 0.07781501100697649}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4896825830686729, "sim_physics": 0.10873079962200588, "survival_time": 3.599999999999995, "driven_lanedir": 0.4827572868140654, "sim_render-ego": 0.0578373306327396, "in-drivable-lane": 0, "agent_compute-ego": 0.13952911231252882, "deviation-heading": 0.5911477230687963, "set_robot_commands": 0.0928849180539449, "deviation-center-line": 0.29144378866191073, "driven_lanedir_consec": 0.4827572868140654, "sim_compute_sim_state": 0.03930274976624383, "sim_compute_performance-ego": 0.06151497032907274, "sim_compute_robot_state-ego": 0.06860702567630345}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9934601655841236, "sim_physics": 0.10468586228734296, "survival_time": 6.949999999999983, "driven_lanedir": 0.7638704215325345, "sim_render-ego": 0.059098653656115635, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14483917016777204, "deviation-heading": 0.9502563901618318, "set_robot_commands": 0.08887031610063512, "deviation-center-line": 0.26272373511713126, "driven_lanedir_consec": 0.7638704215325345, "sim_compute_sim_state": 0.03899135864038262, "sim_compute_performance-ego": 0.06889933476345145, "sim_compute_robot_state-ego": 0.07015658111023389}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3913630260270548, "sim_physics": 0.10568788900213728, "survival_time": 2.9499999999999975, "driven_lanedir": 0.378544695109488, "sim_render-ego": 0.06263823428396452, "in-drivable-lane": 0, "agent_compute-ego": 0.13623109510389425, "deviation-heading": 0.7397104816563612, "set_robot_commands": 0.08846613512200824, "deviation-center-line": 0.20837582250812192, "driven_lanedir_consec": 0.378544695109488, "sim_compute_sim_state": 0.03688748004072803, "sim_compute_performance-ego": 0.06604809680227507, "sim_compute_robot_state-ego": 0.07165522898657847}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.7560498171261352, "sim_physics": 0.09943748212948876, "survival_time": 12.050000000000036, "driven_lanedir": 1.7523714592470048, "sim_render-ego": 0.05654285854323771, "in-drivable-lane": 0, "agent_compute-ego": 0.14026758977486384, "deviation-heading": 0.48740885281046914, "set_robot_commands": 0.08776818865067731, "deviation-center-line": 1.2578907011919125, "driven_lanedir_consec": 1.7523714592470048, "sim_compute_sim_state": 0.03782419446098359, "sim_compute_performance-ego": 0.06230487368413522, "sim_compute_robot_state-ego": 0.06686846349249242}}
set_robot_commands_max	0.09974497856853676
set_robot_commands_mean	0.08979100879142046
set_robot_commands_median	0.08887031610063512
set_robot_commands_min	0.08179356711251395
sim_compute_performance-ego_max	0.07140197170724114
sim_compute_performance-ego_mean	0.06594432295717752
sim_compute_performance-ego_median	0.06815758281283908
sim_compute_performance-ego_min	0.05896806035723005
sim_compute_robot_state-ego_max	0.08080625191009302
sim_compute_robot_state-ego_mean	0.0711369119282435
sim_compute_robot_state-ego_median	0.07015658111023389
sim_compute_robot_state-ego_min	0.06459732055664062
sim_compute_sim_state_max	0.04129604813006285
sim_compute_sim_state_mean	0.03774411994334222
sim_compute_sim_state_median	0.0379530323876275
sim_compute_sim_state_min	0.03285309246608189
sim_physics_max	0.11499807281770567
sim_physics_mean	0.10571900633207948
sim_physics_median	0.1062121073404948
sim_physics_min	0.0983344486781529
sim_render-ego_max	0.06402451401456781
sim_render-ego_mean	0.05964084344569558
sim_render-ego_median	0.059958815574646
sim_render-ego_min	0.054153823852539064
simulation-passed	1
survival_time_max	12.050000000000036
survival_time_mean	6.166666666666666
survival_time_min	2.25

No reset possible

20915

2945

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 15:00:34+00:00

2019-04-27 15:06:18+00:00

0:05:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1568374577975864
survival_time_median	1.4500000000000006
deviation-center-line_median	0.08558524082765089
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1968095795861606
agent_compute-ego_mean	0.16987049497076925
agent_compute-ego_median	0.16732014142549956
agent_compute-ego_min	0.1511807782309396
deviation-center-line_max	0.09823906711300212
deviation-center-line_mean	0.08681529750080486
deviation-center-line_min	0.07658966369559472
deviation-heading_max	0.9807205033097725
deviation-heading_mean	0.7860944636478493
deviation-heading_median	0.8224660060493492
deviation-heading_min	0.5024406494371064
driven_any_max	0.2561698941949565
driven_any_mean	0.2112350654459715
driven_any_median	0.228471898122942
driven_any_min	0.13826860568403024
driven_lanedir_consec_max	0.1979733230134985
driven_lanedir_consec_mean	0.1529847092446626
driven_lanedir_consec_min	0.1037789626077168
driven_lanedir_max	0.1979733230134985
driven_lanedir_mean	0.1529847092446626
driven_lanedir_median	0.1568374577975864
driven_lanedir_min	0.1037789626077168
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.228471898122942, "sim_physics": 0.13147514441917682, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1568374577975864, "sim_render-ego": 0.06333202329175226, "in-drivable-lane": 0, "agent_compute-ego": 0.1968095795861606, "deviation-heading": 0.8459436857816607, "set_robot_commands": 0.09812531800105652, "deviation-center-line": 0.09440674887044148, "driven_lanedir_consec": 0.1568374577975864, "sim_compute_sim_state": 0.03997543762470114, "sim_compute_performance-ego": 0.07634730996756718, "sim_compute_robot_state-ego": 0.08105384070297768}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2561698941949565, "sim_physics": 0.11552744753220502, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1979733230134985, "sim_render-ego": 0.06003417688257554, "in-drivable-lane": 0, "agent_compute-ego": 0.17031702574561625, "deviation-heading": 0.8224660060493492, "set_robot_commands": 0.09417544392978444, "deviation-center-line": 0.07658966369559472, "driven_lanedir_consec": 0.1979733230134985, "sim_compute_sim_state": 0.03755183079663445, "sim_compute_performance-ego": 0.06819572168238022, "sim_compute_robot_state-ego": 0.07336576545939726}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13826860568403024, "sim_physics": 0.10499227614629836, "survival_time": 1.0500000000000005, "driven_lanedir": 0.11261823394668058, "sim_render-ego": 0.05904652958824521, "in-drivable-lane": 0, "agent_compute-ego": 0.1511807782309396, "deviation-heading": 0.5024406494371064, "set_robot_commands": 0.08856593994867235, "deviation-center-line": 0.09823906711300212, "driven_lanedir_consec": 0.11261823394668058, "sim_compute_sim_state": 0.038728895641508554, "sim_compute_performance-ego": 0.06578042393638975, "sim_compute_robot_state-ego": 0.07233078139168876}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18578676657777116, "sim_physics": 0.11793248470012958, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1037789626077168, "sim_render-ego": 0.05852668101970966, "in-drivable-lane": 0, "agent_compute-ego": 0.16732014142549956, "deviation-heading": 0.9807205033097725, "set_robot_commands": 0.09092037494365986, "deviation-center-line": 0.07925576699733504, "driven_lanedir_consec": 0.1037789626077168, "sim_compute_sim_state": 0.034681421059828535, "sim_compute_performance-ego": 0.06463636801793025, "sim_compute_robot_state-ego": 0.07465190153855544}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.24747816265015793, "sim_physics": 0.1170531113942464, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1937155688578307, "sim_render-ego": 0.06766109033064409, "in-drivable-lane": 0, "agent_compute-ego": 0.1637249498656302, "deviation-heading": 0.7789014736613579, "set_robot_commands": 0.08953428268432617, "deviation-center-line": 0.08558524082765089, "driven_lanedir_consec": 0.1937155688578307, "sim_compute_sim_state": 0.03740788951064601, "sim_compute_performance-ego": 0.0686804959268281, "sim_compute_robot_state-ego": 0.0737451712290446}}
set_robot_commands_max	0.09812531800105652
set_robot_commands_mean	0.09226427190149988
set_robot_commands_median	0.09092037494365986
set_robot_commands_min	0.08856593994867235
sim_compute_performance-ego_max	0.07634730996756718
sim_compute_performance-ego_mean	0.0687280639062191
sim_compute_performance-ego_median	0.06819572168238022
sim_compute_performance-ego_min	0.06463636801793025
sim_compute_robot_state-ego_max	0.08105384070297768
sim_compute_robot_state-ego_mean	0.07502949206433275
sim_compute_robot_state-ego_median	0.0737451712290446
sim_compute_robot_state-ego_min	0.07233078139168876
sim_compute_sim_state_max	0.03997543762470114
sim_compute_sim_state_mean	0.03766909492666374
sim_compute_sim_state_median	0.03755183079663445
sim_compute_sim_state_min	0.034681421059828535
sim_physics_max	0.13147514441917682
sim_physics_mean	0.11739609283841124
sim_physics_median	0.1170531113942464
sim_physics_min	0.10499227614629836
sim_render-ego_max	0.06766109033064409
sim_render-ego_mean	0.06172010022258536
sim_render-ego_median	0.06003417688257554
sim_render-ego_min	0.05852668101970966
simulation-passed	1
survival_time_max	1.7000000000000008
survival_time_mean	1.4300000000000004
survival_time_min	1.0500000000000005

No reset possible

20897

2981

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 14:37:05+00:00

2019-04-27 15:00:09+00:00

0:23:04

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2981/step1-simulation-ip-172-31-42-167-7194-job20897/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20864

3063

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-04-27 14:00:32+00:00

2019-04-27 14:36:25+00:00

0:35:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.000305044676884636
survival_time_median	14.950000000000076
deviation-center-line_median	0.4891046565937845
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.1717841100692749
agent_compute-ego_mean	0.15415737930933637
agent_compute-ego_median	0.15004813035329184
agent_compute-ego_min	0.14874239285786947
deviation-center-line_max	0.6113246250082045
deviation-center-line_mean	0.4225460275157091
deviation-center-line_min	0.020737627062439232
deviation-heading_max	5.830135897709594
deviation-heading_mean	5.684570550707688
deviation-heading_median	5.657649106857694
deviation-heading_min	5.536662996854866
driven_any_max	0.02647867283405392
driven_any_mean	0.024864239592253624
driven_any_median	0.02593019554120814
driven_any_min	0.02216545266138003
driven_lanedir_consec_max	0.002162616049345756
driven_lanedir_consec_mean	-0.0004886462276792348
driven_lanedir_consec_min	-0.0036402347654349576
driven_lanedir_max	0.002162616049345756
driven_lanedir_mean	-0.0004886462276792348
driven_lanedir_median	0.000305044676884636
driven_lanedir_min	-0.0036402347654349576
in-drivable-lane_max	7.650000000000043
in-drivable-lane_mean	7.600000000000042
in-drivable-lane_min	7.550000000000044
per-episodes	details {"udem1-0-0": {"driven_any": 0.02647867283405392, "sim_physics": 0.2233387756347656, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.06811828772226969, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.1717841100692749, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.10776522000630696, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.042684784730275475, "sim_compute_performance-ego": 0.07542207797368368, "sim_compute_robot_state-ego": 0.08368022044499715, "sim_compute_robot_state-npc0": 0.07519597848256429, "sim_compute_robot_state-npc1": 0.07617562929789225, "sim_compute_robot_state-npc2": 0.0742625610033671, "sim_compute_robot_state-npc3": 0.07410948673884074}, "udem1-1-0": {"driven_any": 0.02593019554120814, "sim_physics": 0.20114351987838744, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.060717660586039224, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15023762543996175, "deviation-heading": 5.795316370396738, "set_robot_commands": 0.09531437794367471, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.03684365272521973, "sim_compute_performance-ego": 0.06562578280766805, "sim_compute_robot_state-ego": 0.0711145011583964, "sim_compute_robot_state-npc0": 0.06884404102961222, "sim_compute_robot_state-npc1": 0.06714802424112956, "sim_compute_robot_state-npc2": 0.06642589648564656, "sim_compute_robot_state-npc3": 0.06716026385625204}, "udem1-2-0": {"driven_any": 0.02380440467243486, "sim_physics": 0.19314073165257772, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.06023574670155843, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.1499746378262838, "deviation-heading": 5.6030883817195525, "set_robot_commands": 0.09583009322484334, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.03940537691116333, "sim_compute_performance-ego": 0.067316259543101, "sim_compute_robot_state-ego": 0.07176966667175293, "sim_compute_robot_state-npc0": 0.06819501797358195, "sim_compute_robot_state-npc1": 0.06805540402730306, "sim_compute_robot_state-npc2": 0.06815248012542724, "sim_compute_robot_state-npc3": 0.0671971861521403}, "udem1-3-0": {"driven_any": 0.02216545266138003, "sim_physics": 0.20058897813161217, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202353105, "sim_render-ego": 0.0620106585820516, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.14874239285786947, "deviation-heading": 5.536662996854866, "set_robot_commands": 0.09354412317276, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202353105, "sim_compute_sim_state": 0.03781956116358439, "sim_compute_performance-ego": 0.06792743841807047, "sim_compute_robot_state-ego": 0.07166570027669271, "sim_compute_robot_state-npc0": 0.06552098115285238, "sim_compute_robot_state-npc1": 0.06488717317581177, "sim_compute_robot_state-npc2": 0.06418054024378458, "sim_compute_robot_state-npc3": 0.06554256836573283}, "udem1-4-0": {"driven_any": 0.02594247225219117, "sim_physics": 0.2011483057339986, "survival_time": 14.950000000000076, "driven_lanedir": 0.000305044676884636, "sim_render-ego": 0.06259693225224813, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.15004813035329184, "deviation-heading": 5.830135897709594, "set_robot_commands": 0.09202473322550456, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.000305044676884636, "sim_compute_sim_state": 0.03984922170639038, "sim_compute_performance-ego": 0.06701574405034383, "sim_compute_robot_state-ego": 0.07142412821451823, "sim_compute_robot_state-npc0": 0.0662182092666626, "sim_compute_robot_state-npc1": 0.06662629763285319, "sim_compute_robot_state-npc2": 0.06842709302902222, "sim_compute_robot_state-npc3": 0.06810958782831827}}
set_robot_commands_max	0.10776522000630696
set_robot_commands_mean	0.09689570951461791
set_robot_commands_median	0.09531437794367471
set_robot_commands_min	0.09202473322550456
sim_compute_performance-ego_max	0.07542207797368368
sim_compute_performance-ego_mean	0.0686614605585734
sim_compute_performance-ego_median	0.067316259543101
sim_compute_performance-ego_min	0.06562578280766805
sim_compute_robot_state-ego_max	0.08368022044499715
sim_compute_robot_state-ego_mean	0.07393084335327148
sim_compute_robot_state-ego_median	0.07166570027669271
sim_compute_robot_state-ego_min	0.0711145011583964
sim_compute_robot_state-npc0_max	0.07519597848256429
sim_compute_robot_state-npc0_mean	0.06879484558105468
sim_compute_robot_state-npc0_median	0.06819501797358195
sim_compute_robot_state-npc0_min	0.06552098115285238
sim_compute_robot_state-npc1_max	0.07617562929789225
sim_compute_robot_state-npc1_mean	0.06857850567499797
sim_compute_robot_state-npc1_median	0.06714802424112956
sim_compute_robot_state-npc1_min	0.06488717317581177
sim_compute_robot_state-npc2_max	0.0742625610033671
sim_compute_robot_state-npc2_mean	0.06828971417744954
sim_compute_robot_state-npc2_median	0.06815248012542724
sim_compute_robot_state-npc2_min	0.06418054024378458
sim_compute_robot_state-npc3_max	0.07410948673884074
sim_compute_robot_state-npc3_mean	0.06842381858825684
sim_compute_robot_state-npc3_median	0.0671971861521403
sim_compute_robot_state-npc3_min	0.06554256836573283
sim_compute_sim_state_max	0.042684784730275475
sim_compute_sim_state_mean	0.03932051944732666
sim_compute_sim_state_median	0.03940537691116333
sim_compute_sim_state_min	0.03684365272521973
sim_physics_max	0.2233387756347656
sim_physics_mean	0.20387206220626833
sim_physics_median	0.20114351987838744
sim_physics_min	0.19314073165257772
sim_render-ego_max	0.06811828772226969
sim_render-ego_mean	0.06273585716883341
sim_render-ego_median	0.0620106585820516
sim_render-ego_min	0.06023574670155843
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

20836

3064

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 13:38:35+00:00

2019-04-27 14:00:09+00:00

0:21:34

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3064/step1-simulation-ip-172-31-42-167-7194-job20836/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20818

2865

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 13:09:25+00:00

2019-04-27 13:38:08+00:00

0:28:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4906378651204748
survival_time_median	14.950000000000076
deviation-center-line_median	0.23916579592115045
in-drivable-lane_median	3.4000000000000483

other stats

agent_compute-ego_max	0.11445613543192544
agent_compute-ego_mean	0.10948192346225652
agent_compute-ego_median	0.10965794801712037
agent_compute-ego_min	0.1025368468514804
deviation-center-line_max	0.8598179747822606
deviation-center-line_mean	0.4164109816235886
deviation-center-line_min	0.1524104407527288
deviation-heading_max	5.536030364590776
deviation-heading_mean	3.1885992625542134
deviation-heading_median	1.9089265344806616
deviation-heading_min	1.448341673463684
driven_any_max	1.1745667911136657
driven_any_mean	0.7993065462620965
driven_any_median	1.1745375875148232
driven_any_min	0.20621070958903517
driven_lanedir_consec_max	0.64427541241931
driven_lanedir_consec_mean	0.4197719404475316
driven_lanedir_consec_min	0.1532115720161615
driven_lanedir_max	0.7380366950743553
driven_lanedir_mean	0.4433955772366987
driven_lanedir_median	0.4906378651204748
driven_lanedir_min	0.1532115720161615
in-drivable-lane_max	7.950000000000094
in-drivable-lane_mean	3.260000000000036
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2666651060745704, "sim_physics": 0.22426826567263217, "survival_time": 3.699999999999995, "driven_lanedir": 0.1532115720161615, "sim_render-ego": 0.06775473581778037, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.11164505417282516, "deviation-heading": 1.5314631276581263, "set_robot_commands": 0.1118812335504068, "deviation-center-line": 0.1524104407527288, "driven_lanedir_consec": 0.1532115720161615, "sim_compute_sim_state": 0.04338183274140229, "sim_compute_performance-ego": 0.07434112961227829, "sim_compute_robot_state-ego": 0.08290572746379955, "sim_compute_robot_state-npc0": 0.07458131377761429, "sim_compute_robot_state-npc1": 0.07648387148573592, "sim_compute_robot_state-npc2": 0.0750597264315631, "sim_compute_robot_state-npc3": 0.07875589744464771}, "udem1-1-0": {"driven_any": 1.1745375875148232, "sim_physics": 0.2307570195198059, "survival_time": 14.950000000000076, "driven_lanedir": 0.4906378651204748, "sim_render-ego": 0.06981953859329224, "in-drivable-lane": 7.950000000000094, "agent_compute-ego": 0.11445613543192544, "deviation-heading": 1.9089265344806616, "set_robot_commands": 0.10993390719095866, "deviation-center-line": 0.23916579592115045, "driven_lanedir_consec": 0.4906378651204748, "sim_compute_sim_state": 0.04418567816416422, "sim_compute_performance-ego": 0.08068432966868083, "sim_compute_robot_state-ego": 0.08500124375025431, "sim_compute_robot_state-npc0": 0.0760547129313151, "sim_compute_robot_state-npc1": 0.07591456254323324, "sim_compute_robot_state-npc2": 0.07792675813039143, "sim_compute_robot_state-npc3": 0.07701671044031778}, "udem1-2-0": {"driven_any": 1.174552537018389, "sim_physics": 0.21528377056121825, "survival_time": 14.950000000000076, "driven_lanedir": 0.6669058075208681, "sim_render-ego": 0.06567161401112874, "in-drivable-lane": 4.1500000000000385, "agent_compute-ego": 0.10911363283793132, "deviation-heading": 5.536030364590776, "set_robot_commands": 0.1030753747622172, "deviation-center-line": 0.6709099403033454, "driven_lanedir_consec": 0.642548906230078, "sim_compute_sim_state": 0.04081465562184652, "sim_compute_performance-ego": 0.07333365122477213, "sim_compute_robot_state-ego": 0.07943152507146199, "sim_compute_robot_state-npc0": 0.07270699580510458, "sim_compute_robot_state-npc1": 0.0711501677831014, "sim_compute_robot_state-npc2": 0.07263823350270589, "sim_compute_robot_state-npc3": 0.07194299538930257}, "udem1-3-0": {"driven_any": 1.1745667911136657, "sim_physics": 0.20135415156682332, "survival_time": 14.950000000000076, "driven_lanedir": 0.7380366950743553, "sim_render-ego": 0.06528722763061523, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.10965794801712037, "deviation-heading": 5.518234612577819, "set_robot_commands": 0.10125334898630778, "deviation-center-line": 0.8598179747822606, "driven_lanedir_consec": 0.64427541241931, "sim_compute_sim_state": 0.039270044167836506, "sim_compute_performance-ego": 0.07115239938100179, "sim_compute_robot_state-ego": 0.07627529621124268, "sim_compute_robot_state-npc0": 0.07111894845962524, "sim_compute_robot_state-npc1": 0.06980561176935832, "sim_compute_robot_state-npc2": 0.07071214437484741, "sim_compute_robot_state-npc3": 0.07056262095769246}, "udem1-4-0": {"driven_any": 0.20621070958903517, "sim_physics": 0.20105756562331628, "survival_time": 2.8999999999999977, "driven_lanedir": 0.16818594645163398, "sim_render-ego": 0.06471192425694959, "in-drivable-lane": 0, "agent_compute-ego": 0.1025368468514804, "deviation-heading": 1.448341673463684, "set_robot_commands": 0.0960175949951698, "deviation-center-line": 0.15975075635845737, "driven_lanedir_consec": 0.16818594645163398, "sim_compute_sim_state": 0.03916913065417059, "sim_compute_performance-ego": 0.06909774911814723, "sim_compute_robot_state-ego": 0.07507125262556405, "sim_compute_robot_state-npc0": 0.07022135422147553, "sim_compute_robot_state-npc1": 0.07067679536753688, "sim_compute_robot_state-npc2": 0.06912464520026898, "sim_compute_robot_state-npc3": 0.07039469686047785}}
set_robot_commands_max	0.1118812335504068
set_robot_commands_mean	0.10443229189701204
set_robot_commands_median	0.1030753747622172
set_robot_commands_min	0.0960175949951698
sim_compute_performance-ego_max	0.08068432966868083
sim_compute_performance-ego_mean	0.07372185180097605
sim_compute_performance-ego_median	0.07333365122477213
sim_compute_performance-ego_min	0.06909774911814723
sim_compute_robot_state-ego_max	0.08500124375025431
sim_compute_robot_state-ego_mean	0.07973700902446453
sim_compute_robot_state-ego_median	0.07943152507146199
sim_compute_robot_state-ego_min	0.07507125262556405
sim_compute_robot_state-npc0_max	0.0760547129313151
sim_compute_robot_state-npc0_mean	0.07293666503902695
sim_compute_robot_state-npc0_median	0.07270699580510458
sim_compute_robot_state-npc0_min	0.07022135422147553
sim_compute_robot_state-npc1_max	0.07648387148573592
sim_compute_robot_state-npc1_mean	0.07280620178979316
sim_compute_robot_state-npc1_median	0.0711501677831014
sim_compute_robot_state-npc1_min	0.06980561176935832
sim_compute_robot_state-npc2_max	0.07792675813039143
sim_compute_robot_state-npc2_mean	0.07309230152795536
sim_compute_robot_state-npc2_median	0.07263823350270589
sim_compute_robot_state-npc2_min	0.06912464520026898
sim_compute_robot_state-npc3_max	0.07875589744464771
sim_compute_robot_state-npc3_mean	0.07373458421848768
sim_compute_robot_state-npc3_median	0.07194299538930257
sim_compute_robot_state-npc3_min	0.07039469686047785
sim_compute_sim_state_max	0.04418567816416422
sim_compute_sim_state_mean	0.04136426826988403
sim_compute_sim_state_median	0.04081465562184652
sim_compute_sim_state_min	0.03916913065417059
sim_physics_max	0.2307570195198059
sim_physics_mean	0.2145441545887592
sim_physics_median	0.21528377056121825
sim_physics_min	0.20105756562331628
sim_render-ego_max	0.06981953859329224
sim_render-ego_mean	0.06664900806195324
sim_render-ego_median	0.06567161401112874
sim_render-ego_min	0.06471192425694959
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.290000000000044
survival_time_min	2.8999999999999977

No reset possible

20807

2873

Peter Almasi 🇭🇺

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-27 13:00:26+00:00

2019-04-27 13:09:10+00:00

0:08:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.11232790009754055
survival_time_median	1.5000000000000009
deviation-center-line_median	0.07838303453570936
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.19429659843444824
agent_compute-ego_mean	0.17382752404408405
agent_compute-ego_median	0.16509840362950376
agent_compute-ego_min	0.15595928315193422
deviation-center-line_max	0.08650564116402884
deviation-center-line_mean	0.07608369656432938
deviation-center-line_min	0.06604145144995589
deviation-heading_max	0.9725952198143292
deviation-heading_mean	0.7486526918205163
deviation-heading_median	0.6897462599920539
deviation-heading_min	0.5182286178054573
driven_any_max	0.26454035332833237
driven_any_mean	0.20450552871852776
driven_any_median	0.20825691494001267
driven_any_min	0.11277820422045504
driven_lanedir_consec_max	0.20792598476999255
driven_lanedir_consec_mean	0.139210412112779
driven_lanedir_consec_min	0.08394096623178449
driven_lanedir_max	0.20792598476999255
driven_lanedir_mean	0.139210412112779
driven_lanedir_median	0.11232790009754055
driven_lanedir_min	0.08394096623178449
in-drivable-lane_max	0.10000000000000007
in-drivable-lane_mean	0.04000000000000003
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20825691494001267, "sim_physics": 0.15037620862325032, "survival_time": 1.5000000000000009, "driven_lanedir": 0.11232790009754055, "sim_render-ego": 0.054889520009358726, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16500699520111084, "deviation-heading": 0.8935033888401123, "set_robot_commands": 0.07610936959584554, "deviation-center-line": 0.08323591183901975, "driven_lanedir_consec": 0.11232790009754055, "sim_compute_sim_state": 0.03364555835723877, "sim_compute_performance-ego": 0.074196990331014, "sim_compute_robot_state-ego": 0.06325127283732096}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.24864061379585428, "sim_physics": 0.143891203788019, "survival_time": 1.5500000000000007, "driven_lanedir": 0.19818262323518, "sim_render-ego": 0.0672253870194958, "in-drivable-lane": 0, "agent_compute-ego": 0.15595928315193422, "deviation-heading": 0.6897462599920539, "set_robot_commands": 0.08290771515138688, "deviation-center-line": 0.06604145144995589, "driven_lanedir_consec": 0.19818262323518, "sim_compute_sim_state": 0.03657367152552451, "sim_compute_performance-ego": 0.09756228231614636, "sim_compute_robot_state-ego": 0.06272515173881285}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11277820422045504, "sim_physics": 0.11794707649632503, "survival_time": 0.9500000000000004, "driven_lanedir": 0.08394096623178449, "sim_render-ego": 0.06278817277205617, "in-drivable-lane": 0, "agent_compute-ego": 0.16509840362950376, "deviation-heading": 0.5182286178054573, "set_robot_commands": 0.09059693938807438, "deviation-center-line": 0.08650564116402884, "driven_lanedir_consec": 0.08394096623178449, "sim_compute_sim_state": 0.0394954430429559, "sim_compute_performance-ego": 0.06896419274179559, "sim_compute_robot_state-ego": 0.07608866691589355}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1883115573079846, "sim_physics": 0.15280526876449585, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0936745862293975, "sim_render-ego": 0.06792808430535453, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1887763398034232, "deviation-heading": 0.9725952198143292, "set_robot_commands": 0.09853384324482509, "deviation-center-line": 0.06625244383293308, "driven_lanedir_consec": 0.0936745862293975, "sim_compute_sim_state": 0.04459267854690552, "sim_compute_performance-ego": 0.07375419991356987, "sim_compute_robot_state-ego": 0.08201061827795846}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26454035332833237, "sim_physics": 0.1430761045025241, "survival_time": 1.5500000000000007, "driven_lanedir": 0.20792598476999255, "sim_render-ego": 0.06906350197330598, "in-drivable-lane": 0, "agent_compute-ego": 0.19429659843444824, "deviation-heading": 0.6691899726506286, "set_robot_commands": 0.10264792749958654, "deviation-center-line": 0.07838303453570936, "driven_lanedir_consec": 0.20792598476999255, "sim_compute_sim_state": 0.04413562436257639, "sim_compute_performance-ego": 0.07692993071771437, "sim_compute_robot_state-ego": 0.08626484101818453}}
set_robot_commands_max	0.10264792749958654
set_robot_commands_mean	0.09015915897594368
set_robot_commands_median	0.09059693938807438
set_robot_commands_min	0.07610936959584554
sim_compute_performance-ego_max	0.09756228231614636
sim_compute_performance-ego_mean	0.07828151920404804
sim_compute_performance-ego_median	0.074196990331014
sim_compute_performance-ego_min	0.06896419274179559
sim_compute_robot_state-ego_max	0.08626484101818453
sim_compute_robot_state-ego_mean	0.07406811015763407
sim_compute_robot_state-ego_median	0.07608866691589355
sim_compute_robot_state-ego_min	0.06272515173881285
sim_compute_sim_state_max	0.04459267854690552
sim_compute_sim_state_mean	0.03968859516704022
sim_compute_sim_state_median	0.0394954430429559
sim_compute_sim_state_min	0.03364555835723877
sim_physics_max	0.15280526876449585
sim_physics_mean	0.14161917243492284
sim_physics_median	0.143891203788019
sim_physics_min	0.11794707649632503
sim_render-ego_max	0.06906350197330598
sim_render-ego_mean	0.06437893321591423
sim_render-ego_median	0.0672253870194958
sim_render-ego_min	0.054889520009358726
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.3900000000000006
survival_time_min	0.9500000000000004

No reset possible

20799

3058

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-27 12:41:13+00:00

2019-04-27 13:00:08+00:00

0:18:55

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-42-167-7194-job20799/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20784

2956

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 12:02:40+00:00

2019-04-27 12:40:35+00:00

0:37:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.30402283162098764
survival_time_median	6.999999999999983
deviation-center-line_median	0.2460750057446518
in-drivable-lane_median	1.949999999999993

other stats

agent_compute-ego_max	0.23441464602947237
agent_compute-ego_mean	0.20829734870772967
agent_compute-ego_median	0.2076818655568657
agent_compute-ego_min	0.19237179043649255
deviation-center-line_max	0.7276746440916119
deviation-center-line_mean	0.29752640344376247
deviation-center-line_min	0.12691729211332822
deviation-heading_max	2.033670554184505
deviation-heading_mean	1.415551082763028
deviation-heading_median	1.4269978730797008
deviation-heading_min	0.7957972465670914
driven_any_max	1.7284100283310049
driven_any_mean	0.9079655994745708
driven_any_median	0.7959534300907974
driven_any_min	0.5303303310165024
driven_lanedir_consec_max	1.7159325966482974
driven_lanedir_consec_mean	0.5122063347338529
driven_lanedir_consec_min	0.2202216963066923
driven_lanedir_max	1.7159325966482974
driven_lanedir_mean	0.5152442527542744
driven_lanedir_median	0.30402283162098764
driven_lanedir_min	0.2202216963066923
in-drivable-lane_max	6.600000000000024
in-drivable-lane_mean	2.323333333333332
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1494503910875793, "sim_physics": 0.10358374118804932, "survival_time": 8.499999999999986, "driven_lanedir": 0.6565509836861607, "sim_render-ego": 0.06177226655623492, "in-drivable-lane": 2.6499999999999986, "agent_compute-ego": 0.19914377156425925, "deviation-heading": 1.6736725762328135, "set_robot_commands": 0.08967792006099926, "deviation-center-line": 0.3786418892512445, "driven_lanedir_consec": 0.6352922929876805, "sim_compute_sim_state": 0.03708499880398021, "sim_compute_performance-ego": 0.06584353166468003, "sim_compute_robot_state-ego": 0.06757954288931455}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.64066476452445, "sim_physics": 0.12368420759836832, "survival_time": 12.900000000000048, "driven_lanedir": 1.2723441540213836, "sim_render-ego": 0.06175023271131885, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.21751454634259837, "deviation-heading": 1.9087482414971244, "set_robot_commands": 0.09301152432611746, "deviation-center-line": 0.5179779264485237, "driven_lanedir_consec": 1.2723441540213836, "sim_compute_sim_state": 0.03941157437110132, "sim_compute_performance-ego": 0.07095158192538475, "sim_compute_robot_state-ego": 0.07426281862480696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8021142110614062, "sim_physics": 0.09794357482423172, "survival_time": 7.049999999999983, "driven_lanedir": 0.46780157266671374, "sim_render-ego": 0.05730730591090859, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.2076818655568657, "deviation-heading": 2.033670554184505, "set_robot_commands": 0.0916481204066716, "deviation-center-line": 0.4215563095900135, "driven_lanedir_consec": 0.46780157266671374, "sim_compute_sim_state": 0.03700806401300092, "sim_compute_performance-ego": 0.06446443720066801, "sim_compute_robot_state-ego": 0.06815715884485989}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5512651802958055, "sim_physics": 0.09372630773806104, "survival_time": 5.09999999999999, "driven_lanedir": 0.22677891307172837, "sim_render-ego": 0.05881020368314257, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.19310953570347208, "deviation-heading": 1.5818208745999327, "set_robot_commands": 0.08289515037162631, "deviation-center-line": 0.2997506836173763, "driven_lanedir_consec": 0.22184697737859205, "sim_compute_sim_state": 0.033966875543781354, "sim_compute_performance-ego": 0.06091374743218515, "sim_compute_robot_state-ego": 0.06451690898222082}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0634130167105256, "sim_physics": 0.10544547130321634, "survival_time": 8.699999999999989, "driven_lanedir": 0.6541658237462022, "sim_render-ego": 0.05891160444281567, "in-drivable-lane": 2.650000000000002, "agent_compute-ego": 0.19237179043649255, "deviation-heading": 0.9540508865563524, "set_robot_commands": 0.08669582591659722, "deviation-center-line": 0.35676444793000617, "driven_lanedir_consec": 0.6541658237462022, "sim_compute_sim_state": 0.03608707860968579, "sim_compute_performance-ego": 0.06474670459484232, "sim_compute_robot_state-ego": 0.06664853945545766}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.7042481730826933, "sim_physics": 0.12448220120535956, "survival_time": 7.199999999999982, "driven_lanedir": 0.25514999353857526, "sim_render-ego": 0.06157862312263913, "in-drivable-lane": 4.449999999999984, "agent_compute-ego": 0.225916079348988, "deviation-heading": 0.7957972465670914, "set_robot_commands": 0.09481671783659192, "deviation-center-line": 0.27395586048876214, "driven_lanedir_consec": 0.25514999353857526, "sim_compute_sim_state": 0.03956356313493517, "sim_compute_performance-ego": 0.06844651699066162, "sim_compute_robot_state-ego": 0.07483147415849897}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0136036231438654, "sim_physics": 0.1108462793486459, "survival_time": 6.999999999999983, "driven_lanedir": 0.6092043454658032, "sim_render-ego": 0.05986277716500418, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.21020264966147287, "deviation-heading": 1.741266057419484, "set_robot_commands": 0.0906983426639012, "deviation-center-line": 0.19237107114977212, "driven_lanedir_consec": 0.5919683111143703, "sim_compute_sim_state": 0.03851289238248553, "sim_compute_performance-ego": 0.0662750448499407, "sim_compute_robot_state-ego": 0.07184634549277169}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.3307611195584497, "sim_physics": 0.10967475008741716, "survival_time": 10.700000000000015, "driven_lanedir": 0.30402283162098764, "sim_render-ego": 0.05794673545338283, "in-drivable-lane": 6.600000000000024, "agent_compute-ego": 0.199751783754224, "deviation-heading": 1.6065697426440213, "set_robot_commands": 0.08748891420453508, "deviation-center-line": 0.2460750057446518, "driven_lanedir_consec": 0.30402283162098764, "sim_compute_sim_state": 0.03716301583798133, "sim_compute_performance-ego": 0.06528315811513741, "sim_compute_robot_state-ego": 0.06813076389170139}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.5303303310165024, "sim_physics": 0.10015204728367816, "survival_time": 4.149999999999993, "driven_lanedir": 0.2202216963066923, "sim_render-ego": 0.0645747270928808, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.21722290314823747, "deviation-heading": 0.9501460811598054, "set_robot_commands": 0.09833818458649048, "deviation-center-line": 0.13117151539853594, "driven_lanedir_consec": 0.2202216963066923, "sim_compute_sim_state": 0.039517813418284954, "sim_compute_performance-ego": 0.07281372346073749, "sim_compute_robot_state-ego": 0.0782841803079628}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.6312090336283087, "sim_physics": 0.09560308736913344, "survival_time": 5.09999999999999, "driven_lanedir": 0.28091082436924575, "sim_render-ego": 0.05984800235897887, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.19919786266252107, "deviation-heading": 1.1855227834021296, "set_robot_commands": 0.09189016445010316, "deviation-center-line": 0.18065348398282724, "driven_lanedir_consec": 0.28091082436924575, "sim_compute_sim_state": 0.038241243829914166, "sim_compute_performance-ego": 0.06703333527434106, "sim_compute_robot_state-ego": 0.06952424610362333}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7959534300907974, "sim_physics": 0.10360501348510268, "survival_time": 6.449999999999985, "driven_lanedir": 0.34931199935935375, "sim_render-ego": 0.05934026259784551, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.19432659666667612, "deviation-heading": 1.4269978730797008, "set_robot_commands": 0.08871792822845223, "deviation-center-line": 0.24509150777387015, "driven_lanedir_consec": 0.34931199935935375, "sim_compute_sim_state": 0.03625230826148691, "sim_compute_performance-ego": 0.0660285986671152, "sim_compute_robot_state-ego": 0.06841622951418855}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5486956659233059, "sim_physics": 0.1025622098342232, "survival_time": 4.599999999999992, "driven_lanedir": 0.22153895356933065, "sim_render-ego": 0.05992983735125998, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.21682943727659143, "deviation-heading": 1.3985596257139206, "set_robot_commands": 0.09222576151723448, "deviation-center-line": 0.16783628245582605, "driven_lanedir_consec": 0.22078361786334844, "sim_compute_sim_state": 0.038692868274191154, "sim_compute_performance-ego": 0.06700444221496582, "sim_compute_robot_state-ego": 0.07055514791737431}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.7284100283310049, "sim_physics": 0.12432448705037435, "survival_time": 14.950000000000076, "driven_lanedir": 1.7159325966482974, "sim_render-ego": 0.05848109324773153, "in-drivable-lane": 0, "agent_compute-ego": 0.20579790353775024, "deviation-heading": 1.4201224110565658, "set_robot_commands": 0.0917504644393921, "deviation-center-line": 0.7276746440916119, "driven_lanedir_consec": 1.7159325966482974, "sim_compute_sim_state": 0.03881040255228679, "sim_compute_performance-ego": 0.06556683619817098, "sim_compute_robot_state-ego": 0.07000837961832683}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.5448248586707799, "sim_physics": 0.11109061539173126, "survival_time": 3.999999999999994, "driven_lanedir": 0.24217527130851255, "sim_render-ego": 0.06471999883651733, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.23441464602947237, "deviation-heading": 1.1211181535825985, "set_robot_commands": 0.0992065817117691, "deviation-center-line": 0.12691729211332822, "driven_lanedir_consec": 0.24101371777598943, "sim_compute_sim_state": 0.041731682419776914, "sim_compute_performance-ego": 0.07146121561527252, "sim_compute_robot_state-ego": 0.07996865510940551}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.584540164993086, "sim_physics": 0.09933919853039004, "survival_time": 4.449999999999992, "driven_lanedir": 0.25255383193513037, "sim_render-ego": 0.061054034179516055, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.210978858926323, "deviation-heading": 1.4352031337493742, "set_robot_commands": 0.0946579006280792, "deviation-center-line": 0.196458131620088, "driven_lanedir_consec": 0.252328611610364, "sim_compute_sim_state": 0.03870952263307035, "sim_compute_performance-ego": 0.06781182932050041, "sim_compute_robot_state-ego": 0.07085774989610308}}
set_robot_commands_max	0.0992065817117691
set_robot_commands_mean	0.09158130008990405
set_robot_commands_median	0.0917504644393921
set_robot_commands_min	0.08289515037162631
sim_compute_performance-ego_max	0.07281372346073749
sim_compute_performance-ego_mean	0.0669763135683069
sim_compute_performance-ego_median	0.0662750448499407
sim_compute_performance-ego_min	0.06091374743218515
sim_compute_robot_state-ego_max	0.07996865510940551
sim_compute_robot_state-ego_mean	0.07090587605377442
sim_compute_robot_state-ego_median	0.07000837961832683
sim_compute_robot_state-ego_min	0.06451690898222082
sim_compute_sim_state_max	0.041731682419776914
sim_compute_sim_state_mean	0.03805026027239753
sim_compute_sim_state_median	0.03851289238248553
sim_compute_sim_state_min	0.033966875543781354
sim_physics_max	0.12448220120535956
sim_physics_mean	0.10707087948253216
sim_physics_median	0.10360501348510268
sim_physics_min	0.09372630773806104
sim_render-ego_max	0.06471999883651733
sim_render-ego_mean	0.06039251364734512
sim_render-ego_median	0.05986277716500418
sim_render-ego_min	0.05730730591090859
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.390000000000001
survival_time_min	3.999999999999994

No reset possible

20774

2932

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 12:00:17+00:00

2019-04-27 12:02:14+00:00

0:01:57

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20760

2964

Baseline-IL-logs-tensorflow

step1-simulation

host-error