Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 24569
4293
Liam Paull 🇨🇦challenge-aido_LF-template-random aido3-LF-sim-testing
step1-simulation timeout no idsc-rudolf-8778
2019-10-31 13:52:35+00:00 2019-10-31 14:58:35+00:00 1:06:00 I can see how the jo [...] I can see how the job 24569 is timeout because passed 3960 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24556
4101
Harleen Hanspal 🇨🇭PredictorLast aido2-PRED
step1-simulation success yes idsc-rudolf-8778
2019-10-31 13:52:02+00:00 2019-10-31 13:52:28+00:00 0:00:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.10912764819785031 error_L2 0.019064588588770033
No reset possible 24535
4121
Tanli Chou 🇹🇼PredictorLast aido2-PRED
step1-simulation success yes idsc-rudolf-8778
2019-10-31 13:50:14+00:00 2019-10-31 13:51:29+00:00 0:01:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.11959943590378574 error_L2 0.021301753874458644
No reset possible 24520
4285
Liam Paull 🇨🇦challenge-aido_LF-template-random aido3-LFV-sim-validation
step1-simulation success no idsc-rudolf-8778
2019-10-31 12:29:46+00:00 2019-10-31 12:34:35+00:00 0:04:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.6999999999999984 deviation-center-line_median 0.11519544839797546 in-drivable-lane_median 0.5999999999999979
other stats agent_compute-ego_max 0.026326166956048263 agent_compute-ego_mean 0.025183032963818647 agent_compute-ego_median 0.02506486007145473 agent_compute-ego_min 0.024336501404091163 deviation-center-line_max 0.17439134565029044 deviation-center-line_mean 0.1265175655253199 deviation-center-line_min 0.09047885846140293 deviation-heading_max 0.5020407942599271 deviation-heading_mean 0.3641979127291371 deviation-heading_median 0.34764983431811225 deviation-heading_min 0.19401296908406307 driven_any_max 1.6169932854589055 driven_any_mean 1.0272530755098268 driven_any_median 1.0243289631429704 driven_any_min 0.4119037580118985 driven_lanedir_consec_max 1.2433038249708372 driven_lanedir_consec_mean 0.7800316850006626 driven_lanedir_consec_min 0.3792793194470208 driven_lanedir_max 1.2433038249708372 driven_lanedir_mean 0.7800316850006626 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.3792793194470208 in-drivable-lane_max 0.9999999999999976 in-drivable-lane_mean 0.4899999999999984 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.098156765655235, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.011869668960571287, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.024336501404091163, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.007931316340411151, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0046111566049081305, "sim_compute_performance-ego": 0.006876252315662525, "sim_compute_robot_state-ego": 0.008441938294304742, "sim_compute_robot_state-npc0": 0.00790440594708478, "sim_compute_robot_state-npc1": 0.007532137411612051, "sim_compute_robot_state-npc2": 0.0074497196409437395, "sim_compute_robot_state-npc3": 0.007354895273844401}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.1187501049041748, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.012234439849853515, "in-drivable-lane": 0, "agent_compute-ego": 0.024790592193603515, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.008116836547851563, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.00495035171508789, "sim_compute_performance-ego": 0.007058429718017578, "sim_compute_robot_state-ego": 0.008411865234375, "sim_compute_robot_state-npc0": 0.00831329345703125, "sim_compute_robot_state-npc1": 0.008165197372436523, "sim_compute_robot_state-npc2": 0.00813532829284668, "sim_compute_robot_state-npc3": 0.007908868789672851}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.11481585314399316, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.0124277158787376, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.026326166956048263, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.008403947478846499, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.005015674390290913, "sim_compute_performance-ego": 0.007314951796280711, "sim_compute_robot_state-ego": 0.00901947209709569, "sim_compute_robot_state-npc0": 0.008615308686306602, "sim_compute_robot_state-npc1": 0.008517588439740632, "sim_compute_robot_state-npc2": 0.008341309271360698, "sim_compute_robot_state-npc3": 0.008051122489728425}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.10893003246452236, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.011939323401149317, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.025397044193895556, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.008107094825068606, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.004892131950281844, "sim_compute_performance-ego": 0.006935463675969764, "sim_compute_robot_state-ego": 0.008550453789626496, "sim_compute_robot_state-npc0": 0.008083651337442519, "sim_compute_robot_state-npc1": 0.00802466839174681, "sim_compute_robot_state-npc2": 0.007985881612270693, "sim_compute_robot_state-npc3": 0.007843331445621538}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.10576155355998448, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.012372306415012904, "in-drivable-lane": 0, "agent_compute-ego": 0.02506486007145473, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.008312063557761056, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.004841608660561698, "sim_compute_performance-ego": 0.007210944380078997, "sim_compute_robot_state-ego": 0.008943378925323486, "sim_compute_robot_state-npc0": 0.007788947650364467, "sim_compute_robot_state-npc1": 0.007959740502493722, "sim_compute_robot_state-npc2": 0.007895784718649728, "sim_compute_robot_state-npc3": 0.0078534654208592}}set_robot_commands_max 0.008403947478846499 set_robot_commands_mean 0.008174251749987775 set_robot_commands_median 0.008116836547851563 set_robot_commands_min 0.007931316340411151 sim_compute_performance-ego_max 0.007314951796280711 sim_compute_performance-ego_mean 0.007079208377201916 sim_compute_performance-ego_median 0.007058429718017578 sim_compute_performance-ego_min 0.006876252315662525 sim_compute_robot_state-ego_max 0.00901947209709569 sim_compute_robot_state-ego_mean 0.008673421668145082 sim_compute_robot_state-ego_median 0.008550453789626496 sim_compute_robot_state-ego_min 0.008411865234375 sim_compute_robot_state-npc0_max 0.008615308686306602 sim_compute_robot_state-npc0_mean 0.008141121415645923 sim_compute_robot_state-npc0_median 0.008083651337442519 sim_compute_robot_state-npc0_min 0.007788947650364467 sim_compute_robot_state-npc1_max 0.008517588439740632 sim_compute_robot_state-npc1_mean 0.008039866423605949 sim_compute_robot_state-npc1_median 0.00802466839174681 sim_compute_robot_state-npc1_min 0.007532137411612051 sim_compute_robot_state-npc2_max 0.008341309271360698 sim_compute_robot_state-npc2_mean 0.007961604707214307 sim_compute_robot_state-npc2_median 0.007985881612270693 sim_compute_robot_state-npc2_min 0.0074497196409437395 sim_compute_robot_state-npc3_max 0.008051122489728425 sim_compute_robot_state-npc3_mean 0.007802336683945284 sim_compute_robot_state-npc3_median 0.0078534654208592 sim_compute_robot_state-npc3_min 0.007354895273844401 sim_compute_sim_state_max 0.005015674390290913 sim_compute_sim_state_mean 0.0048621846642260946 sim_compute_sim_state_median 0.004892131950281844 sim_compute_sim_state_min 0.0046111566049081305 sim_physics_max 0.1187501049041748 sim_physics_mean 0.10928286194558195 sim_physics_median 0.10893003246452236 sim_physics_min 0.098156765655235 sim_render-ego_max 0.0124277158787376 sim_render-ego_mean 0.012168690901064923 sim_render-ego_median 0.012234439849853515 sim_render-ego_min 0.011869668960571287 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.6199999999999974 survival_time_min 1.2500000000000004
No reset possible 24509
4278
Gianmarco Bernasconi Baseline-IL-logs-tensorflow aido3-LF-sim-validation
step1-simulation success no idsc-rudolf-8778
2019-10-30 09:17:34+00:00 2019-10-30 09:28:56+00:00 0:11:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.07366924946130649 survival_time_median 14.950000000000076 deviation-center-line_median 0.4003855377220901 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.10067662795384726 agent_compute-ego_mean 0.09925991948445638 agent_compute-ego_median 0.09905867020289104 agent_compute-ego_min 0.09822026491165162 deviation-center-line_max 1.240504923385635 deviation-center-line_mean 0.5940244372761347 deviation-center-line_min 0.37546107917489585 deviation-heading_max 12.593056185859286 deviation-heading_mean 6.740534651739471 deviation-heading_median 4.166961046131749 deviation-heading_min 2.48020466142352 driven_any_max 0.22468034151548505 driven_any_mean 0.1194806387858994 driven_any_median 0.09100702451803852 driven_any_min 0.045873761050629465 driven_lanedir_consec_max 0.21763456961662783 driven_lanedir_consec_mean 0.10275142012079984 driven_lanedir_consec_min 0.017307472134365565 driven_lanedir_max 0.21763456961662783 driven_lanedir_mean 0.10275142012079984 driven_lanedir_median 0.07366924946130649 driven_lanedir_min 0.017307472134365565 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.09100702451803852, "sim_physics": 0.06754703839619955, "survival_time": 14.950000000000076, "driven_lanedir": 0.07366924946130649, "sim_render-ego": 0.013374795913696289, "in-drivable-lane": 0, "agent_compute-ego": 0.10067662795384726, "deviation-heading": 11.339398299292323, "set_robot_commands": 0.009662901560465497, "deviation-center-line": 0.4003855377220901, "driven_lanedir_consec": 0.07366924946130649, "sim_compute_sim_state": 0.0057343037923177085, "sim_compute_performance-ego": 0.007967638174692789, "sim_compute_robot_state-ego": 0.009672886530558268}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22468034151548505, "sim_physics": 0.06616878747940064, "survival_time": 14.950000000000076, "driven_lanedir": 0.21763456961662783, "sim_render-ego": 0.01360222339630127, "in-drivable-lane": 0, "agent_compute-ego": 0.09957505623499552, "deviation-heading": 3.123053065990475, "set_robot_commands": 0.00985452651977539, "deviation-center-line": 0.3901475948348758, "driven_lanedir_consec": 0.21763456961662783, "sim_compute_sim_state": 0.0058135588963826495, "sim_compute_performance-ego": 0.007825826009114583, "sim_compute_robot_state-ego": 0.009573318958282472}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.045873761050629465, "sim_physics": 0.06240641196568807, "survival_time": 14.950000000000076, "driven_lanedir": 0.03611457270420049, "sim_render-ego": 0.013287754853566487, "in-drivable-lane": 0, "agent_compute-ego": 0.09822026491165162, "deviation-heading": 12.593056185859286, "set_robot_commands": 0.00978104829788208, "deviation-center-line": 1.240504923385635, "driven_lanedir_consec": 0.03611457270420049, "sim_compute_sim_state": 0.005781356493631999, "sim_compute_performance-ego": 0.007692492008209229, "sim_compute_robot_state-ego": 0.009304668108622231}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17580717030883516, "sim_physics": 0.0662078619003296, "survival_time": 14.950000000000076, "driven_lanedir": 0.16903123668749886, "sim_render-ego": 0.013475972016652423, "in-drivable-lane": 0, "agent_compute-ego": 0.09905867020289104, "deviation-heading": 4.166961046131749, "set_robot_commands": 0.009776372114817302, "deviation-center-line": 0.37546107917489585, "driven_lanedir_consec": 0.16903123668749886, "sim_compute_sim_state": 0.00579203208287557, "sim_compute_performance-ego": 0.007705333232879638, "sim_compute_robot_state-ego": 0.0094668443997701}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.0600348965365089, "sim_physics": 0.06528230349222819, "survival_time": 14.950000000000076, "driven_lanedir": 0.017307472134365565, "sim_render-ego": 0.013409272829691569, "in-drivable-lane": 0, "agent_compute-ego": 0.09876897811889648, "deviation-heading": 2.48020466142352, "set_robot_commands": 0.009884385267893474, "deviation-center-line": 0.5636230512631765, "driven_lanedir_consec": 0.017307472134365565, "sim_compute_sim_state": 0.005777871608734131, "sim_compute_performance-ego": 0.007672590414683024, "sim_compute_robot_state-ego": 0.009416050910949708}}set_robot_commands_max 0.009884385267893474 set_robot_commands_mean 0.009791846752166747 set_robot_commands_median 0.00978104829788208 set_robot_commands_min 0.009662901560465497 sim_compute_performance-ego_max 0.007967638174692789 sim_compute_performance-ego_mean 0.007772775967915852 sim_compute_performance-ego_median 0.007705333232879638 sim_compute_performance-ego_min 0.007672590414683024 sim_compute_robot_state-ego_max 0.009672886530558268 sim_compute_robot_state-ego_mean 0.009486753781636556 sim_compute_robot_state-ego_median 0.0094668443997701 sim_compute_robot_state-ego_min 0.009304668108622231 sim_compute_sim_state_max 0.0058135588963826495 sim_compute_sim_state_mean 0.0057798245747884116 sim_compute_sim_state_median 0.005781356493631999 sim_compute_sim_state_min 0.0057343037923177085 sim_physics_max 0.06754703839619955 sim_physics_mean 0.06552248064676922 sim_physics_median 0.06616878747940064 sim_physics_min 0.06240641196568807 sim_render-ego_max 0.01360222339630127 sim_render-ego_mean 0.013430003801981607 sim_render-ego_median 0.013409272829691569 sim_render-ego_min 0.013287754853566487 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 24496
4266
Gianmarco Bernasconi challenge-aido_LF-baseline-duckietown aido3-LFVI-sim-testing
step1-simulation success no idsc-rudolf-8778
2019-10-29 17:54:29+00:00 2019-10-29 18:19:30+00:00 0:25:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4397650957019148 survival_time_median 7.099999999999983 deviation-center-line_median 0.26315364514422895 in-drivable-lane_median 2.3500000000000334
other stats agent_compute-ego_max 0.033743051382211536 agent_compute-ego_mean 0.029700163170903866 agent_compute-ego_median 0.031105067693825924 agent_compute-ego_min 0.0252266946960898 deviation-center-line_max 0.8318084663936395 deviation-center-line_mean 0.33854701679290167 deviation-center-line_min 0.07071866768395428 deviation-heading_max 5.263540545009478 deviation-heading_mean 2.2521940579155784 deviation-heading_median 1.7032325681216511 deviation-heading_min 0.458040948562512 driven_any_max 2.0677177611328563 driven_any_mean 1.0851870767012346 driven_any_median 1.0872639722921038 driven_any_min 0.15533262902817865 driven_lanedir_consec_max 1.3352926462891797 driven_lanedir_consec_mean 0.5196646317975869 driven_lanedir_consec_min 0.0862347351611743 driven_lanedir_max 1.4867677415986016 driven_lanedir_mean 0.6163229204507289 driven_lanedir_median 0.4685354536072453 driven_lanedir_min 0.0862347351611743 in-drivable-lane_max 4.750000000000035 in-drivable-lane_mean 2.0800000000000045 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.0956376889327206, "sim_physics": 0.12169749869240656, "survival_time": 7.199999999999982, "driven_lanedir": 0.5640100522189546, "sim_render-ego": 0.011860463354322646, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.02683420479297638, "deviation-heading": 2.6918402849226397, "set_robot_commands": 0.007881646354993185, "deviation-center-line": 0.3080259834598338, "driven_lanedir_consec": 0.3544193459971956, "sim_compute_sim_state": 0.0047755324178271824, "sim_compute_performance-ego": 0.006799490915404426, "sim_compute_robot_state-ego": 0.00843083361784617, "sim_compute_robot_state-npc0": 0.008180396424399482, "sim_compute_robot_state-npc1": 0.007863698734177483, "sim_compute_robot_state-npc2": 0.007818894253836738, "sim_compute_robot_state-npc3": 0.007638499140739441}, "udem1-1-0": {"driven_any": 0.4927682544515245, "sim_physics": 0.11326940971262314, "survival_time": 3.399999999999996, "driven_lanedir": 0.41444217608799416, "sim_render-ego": 0.011455045026891372, "in-drivable-lane": 0, "agent_compute-ego": 0.0252266946960898, "deviation-heading": 1.3635044948986894, "set_robot_commands": 0.007110781529370476, "deviation-center-line": 0.23610666281129705, "driven_lanedir_consec": 0.41444217608799416, "sim_compute_sim_state": 0.0042082772535436295, "sim_compute_performance-ego": 0.006315560901866239, "sim_compute_robot_state-ego": 0.007961497587316176, "sim_compute_robot_state-npc0": 0.007466575678657083, "sim_compute_robot_state-npc1": 0.007152473225313074, "sim_compute_robot_state-npc2": 0.00692984987707699, "sim_compute_robot_state-npc3": 0.006876223227557014}, "udem1-2-0": {"driven_any": 0.5811014575728148, "sim_physics": 0.1393247465544109, "survival_time": 3.949999999999994, "driven_lanedir": 0.4397650957019148, "sim_render-ego": 0.012510580352590056, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.028840967371493956, "deviation-heading": 1.2816947758315709, "set_robot_commands": 0.008728600755522523, "deviation-center-line": 0.2044347204601788, "driven_lanedir_consec": 0.4397650957019148, "sim_compute_sim_state": 0.004971766773658463, "sim_compute_performance-ego": 0.007037672815443595, "sim_compute_robot_state-ego": 0.00869108151785935, "sim_compute_robot_state-npc0": 0.008485522451280038, "sim_compute_robot_state-npc1": 0.008223089990736563, "sim_compute_robot_state-npc2": 0.008256163778184335, "sim_compute_robot_state-npc3": 0.008051651942579053}, "udem1-3-0": {"driven_any": 1.0872639722921038, "sim_physics": 0.11656821949381224, "survival_time": 7.099999999999983, "driven_lanedir": 0.4685354536072453, "sim_render-ego": 0.011373995055615062, "in-drivable-lane": 3.399999999999988, "agent_compute-ego": 0.02579454636909592, "deviation-heading": 1.3934898588597016, "set_robot_commands": 0.007573722114025707, "deviation-center-line": 0.16596034208291424, "driven_lanedir_consec": 0.4685354536072453, "sim_compute_sim_state": 0.004463613872796717, "sim_compute_performance-ego": 0.0064770369462563955, "sim_compute_robot_state-ego": 0.008136787884671924, "sim_compute_robot_state-npc0": 0.007643516634551572, "sim_compute_robot_state-npc1": 0.007414770797944404, "sim_compute_robot_state-npc2": 0.007370680150851397, "sim_compute_robot_state-npc3": 0.007186968561629175}, "udem1-4-0": {"driven_any": 1.8025323158558677, "sim_physics": 0.11727171749263617, "survival_time": 11.55000000000003, "driven_lanedir": 0.9087936398165222, "sim_render-ego": 0.012882510304967046, "in-drivable-lane": 4.750000000000035, "agent_compute-ego": 0.026767616148118848, "deviation-heading": 2.5190367919599677, "set_robot_commands": 0.007733631959725252, "deviation-center-line": 0.40510348666732054, "driven_lanedir_consec": 0.8656112862274754, "sim_compute_sim_state": 0.004597917779699549, "sim_compute_performance-ego": 0.006597410548817028, "sim_compute_robot_state-ego": 0.008213626357900116, "sim_compute_robot_state-npc0": 0.007866224685272613, "sim_compute_robot_state-npc1": 0.007703325965187766, "sim_compute_robot_state-npc2": 0.007518401909700204, "sim_compute_robot_state-npc3": 0.007427516953769701}, "udem1-5-0": {"driven_any": 1.2959144281679733, "sim_physics": 0.1231628159681956, "survival_time": 8.399999999999984, "driven_lanedir": 0.4831124862252154, "sim_render-ego": 0.012306190672374907, "in-drivable-lane": 3.599999999999998, "agent_compute-ego": 0.02812047799428304, "deviation-heading": 3.511539887850032, "set_robot_commands": 0.008358035768781389, "deviation-center-line": 0.4757185638861089, "driven_lanedir_consec": 0.3477763719136733, "sim_compute_sim_state": 0.004909945385796683, "sim_compute_performance-ego": 0.0070541174638838995, "sim_compute_robot_state-ego": 0.0086960650625683, "sim_compute_robot_state-npc0": 0.008356409413473946, "sim_compute_robot_state-npc1": 0.008200425477254959, "sim_compute_robot_state-npc2": 0.008012087572188605, "sim_compute_robot_state-npc3": 0.007907430330912272}, "udem1-6-0": {"driven_any": 2.0677177611328563, "sim_physics": 0.13154978463144013, "survival_time": 13.200000000000053, "driven_lanedir": 1.4867677415986016, "sim_render-ego": 0.012854242866689508, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.031105067693825924, "deviation-heading": 3.522888932654731, "set_robot_commands": 0.009111509178624008, "deviation-center-line": 0.8318084663936395, "driven_lanedir_consec": 1.3352926462891797, "sim_compute_sim_state": 0.00531295303142432, "sim_compute_performance-ego": 0.00735003568909385, "sim_compute_robot_state-ego": 0.009007941592823376, "sim_compute_robot_state-npc0": 0.00884358539725795, "sim_compute_robot_state-npc1": 0.008818595698385528, "sim_compute_robot_state-npc2": 0.00870983438058333, "sim_compute_robot_state-npc3": 0.008618550770210497}, "udem1-7-0": {"driven_any": 1.906880595626944, "sim_physics": 0.13208132884541496, "survival_time": 12.200000000000038, "driven_lanedir": 1.1738478116076407, "sim_render-ego": 0.0128816620248263, "in-drivable-lane": 2.950000000000027, "agent_compute-ego": 0.03196050593110382, "deviation-heading": 4.52056321536142, "set_robot_commands": 0.009374809069711654, "deviation-center-line": 0.7059816791826158, "driven_lanedir_consec": 0.8074238689558373, "sim_compute_sim_state": 0.005340833155835261, "sim_compute_performance-ego": 0.007478866420808385, "sim_compute_robot_state-ego": 0.009025647014868065, "sim_compute_robot_state-npc0": 0.009046639575332893, "sim_compute_robot_state-npc1": 0.008907343520492803, "sim_compute_robot_state-npc2": 0.008857387011168434, "sim_compute_robot_state-npc3": 0.008679940075170799}, "udem1-8-0": {"driven_any": 1.4489589767041795, "sim_physics": 0.12319221216089583, "survival_time": 9.349999999999998, "driven_lanedir": 0.7957456854745655, "sim_render-ego": 0.012332617917800333, "in-drivable-lane": 3.2500000000000036, "agent_compute-ego": 0.02823322979524174, "deviation-heading": 2.5167056736583806, "set_robot_commands": 0.008298018399406882, "deviation-center-line": 0.4533701206257117, "driven_lanedir_consec": 0.7957456854745655, "sim_compute_sim_state": 0.004873413453127611, "sim_compute_performance-ego": 0.0068364933850293495, "sim_compute_robot_state-ego": 0.010279439987345812, "sim_compute_robot_state-npc0": 0.008291235582076293, "sim_compute_robot_state-npc1": 0.008128027227473132, "sim_compute_robot_state-npc2": 0.007961733455963951, "sim_compute_robot_state-npc3": 0.0079583088981914}, "udem1-9-0": {"driven_any": 0.5007418731894605, "sim_physics": 0.14206609864165817, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3617197206476177, "sim_render-ego": 0.013212411299995754, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.03156365518984587, "deviation-heading": 1.035624169830078, "set_robot_commands": 0.008818339610445326, "deviation-center-line": 0.12937309538346117, "driven_lanedir_consec": 0.3617197206476177, "sim_compute_sim_state": 0.005230958910955899, "sim_compute_performance-ego": 0.00750595590342646, "sim_compute_robot_state-ego": 0.00928918175075365, "sim_compute_robot_state-npc0": 0.008594889571701271, "sim_compute_robot_state-npc1": 0.008589893147565317, "sim_compute_robot_state-npc2": 0.00850904851719953, "sim_compute_robot_state-npc3": 0.008425902629244154}, "udem1-10-0": {"driven_any": 0.15533262902817865, "sim_physics": 0.1238646598962637, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0862347351611743, "sim_render-ego": 0.013372045296889084, "in-drivable-lane": 0, "agent_compute-ego": 0.033743051382211536, "deviation-heading": 1.0214556759706228, "set_robot_commands": 0.008728091533367451, "deviation-center-line": 0.07071866768395428, "driven_lanedir_consec": 0.0862347351611743, "sim_compute_sim_state": 0.005048146614661584, "sim_compute_performance-ego": 0.007574209800133338, "sim_compute_robot_state-ego": 0.009065077855036808, "sim_compute_robot_state-npc0": 0.008958147122309757, "sim_compute_robot_state-npc1": 0.008449747012211727, "sim_compute_robot_state-npc2": 0.008414534422067495, "sim_compute_robot_state-npc3": 0.01047357229086069}, "udem1-11-0": {"driven_any": 1.023029195989719, "sim_physics": 0.125321110682701, "survival_time": 6.699999999999984, "driven_lanedir": 0.45976571292344426, "sim_render-ego": 0.013321598963950998, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.03192008253353745, "deviation-heading": 0.9797530452421974, "set_robot_commands": 0.009560727361422864, "deviation-center-line": 0.26315364514422895, "driven_lanedir_consec": 0.45976571292344426, "sim_compute_sim_state": 0.005425896217573935, "sim_compute_performance-ego": 0.007564229751700785, "sim_compute_robot_state-ego": 0.00910650972110122, "sim_compute_robot_state-npc0": 0.009230837893130174, "sim_compute_robot_state-npc1": 0.00907352077427195, "sim_compute_robot_state-npc2": 0.0089738297818312, "sim_compute_robot_state-npc3": 0.008814126697938834}, "udem1-12-0": {"driven_any": 1.6818602135427074, "sim_physics": 0.1325723926226298, "survival_time": 10.800000000000018, "driven_lanedir": 1.0638129364101503, "sim_render-ego": 0.01302034545827795, "in-drivable-lane": 1.7000000000000162, "agent_compute-ego": 0.0314230532557876, "deviation-heading": 5.263540545009478, "set_robot_commands": 0.009216526040324458, "deviation-center-line": 0.5069688416818203, "driven_lanedir_consec": 0.5681665348698839, "sim_compute_sim_state": 0.005368019695635195, "sim_compute_performance-ego": 0.0074569097271672, "sim_compute_robot_state-ego": 0.008991462213021738, "sim_compute_robot_state-npc0": 0.0090858174694909, "sim_compute_robot_state-npc1": 0.008965254933745772, "sim_compute_robot_state-npc2": 0.008789048150733666, "sim_compute_robot_state-npc3": 0.008675895355365894}, "udem1-13-0": {"driven_any": 0.3561798949235581, "sim_physics": 0.12289577839421292, "survival_time": 2.549999999999999, "driven_lanedir": 0.3456783562826482, "sim_render-ego": 0.01321256861967199, "in-drivable-lane": 0, "agent_compute-ego": 0.031471659155452955, "deviation-heading": 0.458040948562512, "set_robot_commands": 0.009345049951590745, "deviation-center-line": 0.2019242186038276, "driven_lanedir_consec": 0.3456783562826482, "sim_compute_sim_state": 0.005329188178567325, "sim_compute_performance-ego": 0.007518927256266276, "sim_compute_robot_state-ego": 0.008804929022695505, "sim_compute_robot_state-npc0": 0.009150542464910767, "sim_compute_robot_state-npc1": 0.008839649312636432, "sim_compute_robot_state-npc2": 0.008681568444943895, "sim_compute_robot_state-npc3": 0.008549746345071232}, "udem1-14-0": {"driven_any": 0.7818868931079096, "sim_physics": 0.13543784159880418, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19261220299724613, "sim_render-ego": 0.013240094368274394, "in-drivable-lane": 2.8999999999999915, "agent_compute-ego": 0.032497635254493125, "deviation-heading": 1.7032325681216511, "set_robot_commands": 0.009210295402086698, "deviation-center-line": 0.11955675782661242, "driven_lanedir_consec": 0.1443924868239559, "sim_compute_sim_state": 0.00543906596990732, "sim_compute_performance-ego": 0.007449991427935087, "sim_compute_robot_state-ego": 0.008990333630488468, "sim_compute_robot_state-npc0": 0.009060075649848351, "sim_compute_robot_state-npc1": 0.008870544341894297, "sim_compute_robot_state-npc2": 0.008840040518687321, "sim_compute_robot_state-npc3": 0.008589061406942515}}set_robot_commands_max 0.009560727361422864 set_robot_commands_mean 0.008603319001959908 set_robot_commands_median 0.008728600755522523 set_robot_commands_min 0.007110781529370476 sim_compute_performance-ego_max 0.007574209800133338 sim_compute_performance-ego_mean 0.007134460596882154 sim_compute_performance-ego_median 0.00735003568909385 sim_compute_performance-ego_min 0.006315560901866239 sim_compute_robot_state-ego_max 0.010279439987345812 sim_compute_robot_state-ego_mean 0.008846027654419778 sim_compute_robot_state-ego_median 0.008990333630488468 sim_compute_robot_state-ego_min 0.007961497587316176 sim_compute_robot_state-npc0_max 0.009230837893130174 sim_compute_robot_state-npc0_mean 0.008550694400912875 sim_compute_robot_state-npc0_median 0.008594889571701271 sim_compute_robot_state-npc0_min 0.007466575678657083 sim_compute_robot_state-npc1_max 0.00907352077427195 sim_compute_robot_state-npc1_mean 0.00834669067728608 sim_compute_robot_state-npc1_median 0.008449747012211727 sim_compute_robot_state-npc1_min 0.007152473225313074 sim_compute_robot_state-npc2_max 0.0089738297818312 sim_compute_robot_state-npc2_mean 0.008242873481667806 sim_compute_robot_state-npc2_median 0.008414534422067495 sim_compute_robot_state-npc2_min 0.00692984987707699 sim_compute_robot_state-npc3_max 0.01047357229086069 sim_compute_robot_state-npc3_mean 0.00825822630841218 sim_compute_robot_state-npc3_median 0.008425902629244154 sim_compute_robot_state-npc3_min 0.006876223227557014 sim_compute_sim_state_max 0.00543906596990732 sim_compute_sim_state_mean 0.005019701914067378 sim_compute_sim_state_median 0.005048146614661584 sim_compute_sim_state_min 0.0042082772535436295 sim_physics_max 0.14206609864165817 sim_physics_mean 0.1266850410258737 sim_physics_median 0.1238646598962637 sim_physics_min 0.11326940971262314 sim_render-ego_max 0.013372045296889084 sim_render-ego_mean 0.012655758105542493 sim_render-ego_median 0.0128816620248263 sim_render-ego_min 0.011373995055615062 simulation-passed 1 survival_time_max 13.200000000000053 survival_time_mean 7.0900000000000025 survival_time_min 1.3000000000000005
No reset possible 24435
4236
Andrea Censi 🇨🇭challenge-aido_LF-template-pytorch aido3-LFVI-sim-validation
step1-simulation error no idsc-rudolf-8778
2019-10-24 17:14:10+00:00 2019-10-24 17:15:44+00:00 0:01:34 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24425
4227
Manfred Diaz Baseline-IL-logs-tensorflow aido3-LFVI-sim-testing
step1-simulation error no idsc-rudolf-8778
2019-10-24 06:36:59+00:00 2019-10-24 06:37:52+00:00 0:00:53 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24408
4214
Manfred Diaz Baseline-IL-logs-tensorflow aido3-LF-sim-testing
step1-simulation error no idsc-rudolf-8778
2019-10-24 06:26:50+00:00 2019-10-24 06:29:24+00:00 0:02:34 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24390
4195
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido3-LF-sim-testing
step1-simulation error no idsc-rudolf-8778
2019-10-23 21:15:50+00:00 2019-10-23 21:16:39+00:00 0:00:49 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24377
4186
Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROS aido3-LF-sim-testing
step1-simulation error no idsc-rudolf-8778
2019-10-23 19:50:39+00:00 2019-10-23 19:58:05+00:00 0:07:26 The result file is n [...] The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-testing/submission4186/step1-simulation-idsc-rudolf-8778-job24377:
File '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-testing/submission4186/step1-simulation-idsc-rudolf-8778-job24377/challenge-results/challenge_results.yaml' does not exist.
This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24362
4183
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido3-LFVI-sim-testing
step1-simulation error no idsc-rudolf-8778
2019-10-23 16:53:08+00:00 2019-10-23 16:57:10+00:00 0:04:02 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible