Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 171032252Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4step1-simulation error no nutonomy-P50-58492019-04-08 10:11:59+00:00 2019-04-08 10:51:13+00:00 0:39:14 Timeout:
Waited 180 [...] Timeout:
Waited 1800.8248019218445 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 171022259Bhairav Mehta PyTorch template aido2_LF_r2-v4step1-simulation error no nutonomy-P50-58492019-04-08 10:11:00+00:00 2019-04-08 10:11:51+00:00 0:00:51 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170992261Bhairav Mehta PyTorch template aido2_LF_r2-v4step1-simulation failed no nutonomy-P50-58492019-04-08 10:09:51+00:00 2019-04-08 10:10:52+00:00 0:01:01 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 277, in run_episode
r: MsgReceived = agent.read_one(expect_topic='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 165, in read_one
raise RemoteNodeAborted(m) # XXX
zuper_nodes_wrapper.wrapper_outside.RemoteNodeAborted: I was waiting for a message from component "agent" but it aborted with the following error.
agent error |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 426, in loop
|| handle_message_node(parsed, protocol, pc, node, context_data)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 500, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 583, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 48, in on_received_get_commands
|| pwm_left, pwm_right = compute_action(self.config.current_image)
|| NameError: name 'compute_action' is not defined
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 404, in <module>
wrap(cie)
File "experiment_manager.py", line 393, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 127, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 280, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170912268Andrea Censi Solution template aido2_LF_r2-v4step1-simulation success no nutonomy-P50-58492019-04-08 10:01:55+00:00 2019-04-08 10:09:30+00:00 0:07:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07795403284185073 agent_compute-ego_mean 0.07734976617455751 agent_compute-ego_median 0.07741309642791748 agent_compute-ego_min 0.07653101285298665 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014867537161883189, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03225272543290082, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07795403284185073, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.047764143523047954, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.01932301240808823, "sim_compute_performance-ego": 0.033912153805003446, "sim_compute_robot_state-ego": 0.17720492797739365}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0015331714872329951, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.03275136342124334, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07653101285298665, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.0466977111876957, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.01882647332691011, "sim_compute_performance-ego": 0.03479263517591688, "sim_compute_robot_state-ego": 0.04060679011874729}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0015364793630746694, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.03284783363342285, "in-drivable-lane": 0, "agent_compute-ego": 0.07728863862844614, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04746162707989032, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.019275646943312425, "sim_compute_performance-ego": 0.03455417339618389, "sim_compute_robot_state-ego": 0.04308030421917255}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.001515263464392685, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03284223486737507, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.0775620501215865, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.0476225643623166, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.018978880672920043, "sim_compute_performance-ego": 0.03400137075563756, "sim_compute_robot_state-ego": 0.040673055299898474}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.001528754234313965, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.033034489154815674, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07741309642791748, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.04815428972244263, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.019309687614440917, "sim_compute_performance-ego": 0.03376673698425293, "sim_compute_robot_state-ego": 0.04042539834976197}}set_robot_commands_max 0.04815428972244263 set_robot_commands_mean 0.04754006717507864 set_robot_commands_median 0.0476225643623166 set_robot_commands_min 0.0466977111876957 sim_compute_performance-ego_max 0.03479263517591688 sim_compute_performance-ego_mean 0.03420541402339894 sim_compute_performance-ego_median 0.03400137075563756 sim_compute_performance-ego_min 0.03376673698425293 sim_compute_robot_state-ego_max 0.17720492797739365 sim_compute_robot_state-ego_mean 0.06839809519299478 sim_compute_robot_state-ego_median 0.040673055299898474 sim_compute_robot_state-ego_min 0.04042539834976197 sim_compute_sim_state_max 0.01932301240808823 sim_compute_sim_state_mean 0.019142740193134347 sim_compute_sim_state_median 0.019275646943312425 sim_compute_sim_state_min 0.01882647332691011 sim_physics_max 0.0015364793630746694 sim_physics_mean 0.0015200844530405269 sim_physics_median 0.001528754234313965 sim_physics_min 0.0014867537161883189 sim_render-ego_max 0.033034489154815674 sim_render-ego_mean 0.032745729301951555 sim_render-ego_median 0.03284223486737507 sim_render-ego_min 0.03225272543290082 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 170852275Andrea Censi Solution template aido2_LFV_r1-v4step1-simulation success no nutonomy-P50-58492019-04-08 09:50:33+00:00 2019-04-08 10:01:47+00:00 0:11:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07722188934447273 agent_compute-ego_mean 0.07693129201613169 agent_compute-ego_median 0.07698966817158025 agent_compute-ego_min 0.07648606861338896 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014952596496133244, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03273618922514074, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07648606861338896, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.046656598063076246, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.01887747470070334, "sim_compute_performance-ego": 0.03365397102692548, "sim_compute_robot_state-ego": 0.1726423747399274, "sim_compute_robot_state-npc0": 0.034178881084217745, "sim_compute_robot_state-npc1": 0.03366549576030058, "sim_compute_robot_state-npc2": 0.03349938462762272, "sim_compute_robot_state-npc3": 0.03356508998309865}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.001511895467364599, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.032037973403930664, "in-drivable-lane": 0, "agent_compute-ego": 0.07722188934447273, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.047170177338615296, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.019010820086040194, "sim_compute_performance-ego": 0.03308090331062438, "sim_compute_robot_state-ego": 0.04675322865682935, "sim_compute_robot_state-npc0": 0.0341178159865122, "sim_compute_robot_state-npc1": 0.03352084613981701, "sim_compute_robot_state-npc2": 0.03380137776571607, "sim_compute_robot_state-npc3": 0.03439943752591572}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.001528615217942458, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.03259289814875676, "in-drivable-lane": 0, "agent_compute-ego": 0.0767768199627216, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04777985352736253, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.018750443825354943, "sim_compute_performance-ego": 0.03352726056025578, "sim_compute_robot_state-ego": 0.0455268749823937, "sim_compute_robot_state-npc0": 0.034078172536996694, "sim_compute_robot_state-npc1": 0.034111811564518854, "sim_compute_robot_state-npc2": 0.03371269152714656, "sim_compute_robot_state-npc3": 0.033913781092717095}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0015035606012111756, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.032490326137077516, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07698966817158025, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04722669357206763, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.01928005858165462, "sim_compute_performance-ego": 0.03356058713866443, "sim_compute_robot_state-ego": 0.04542288547608911, "sim_compute_robot_state-npc0": 0.0342262459964287, "sim_compute_robot_state-npc1": 0.03386395442776564, "sim_compute_robot_state-npc2": 0.03356978369922173, "sim_compute_robot_state-npc3": 0.033809879931007945}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0014841771125793455, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.032842724323272704, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07718201398849488, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.048531653881073, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.018877184391021727, "sim_compute_performance-ego": 0.03347330093383789, "sim_compute_robot_state-ego": 0.04533389806747437, "sim_compute_robot_state-npc0": 0.03422435998916626, "sim_compute_robot_state-npc1": 0.03384650707244873, "sim_compute_robot_state-npc2": 0.033567631244659425, "sim_compute_robot_state-npc3": 0.0339547324180603}}set_robot_commands_max 0.048531653881073 set_robot_commands_mean 0.04747299527643894 set_robot_commands_median 0.04722669357206763 set_robot_commands_min 0.046656598063076246 sim_compute_performance-ego_max 0.03365397102692548 sim_compute_performance-ego_mean 0.033459204594061584 sim_compute_performance-ego_median 0.03352726056025578 sim_compute_performance-ego_min 0.03308090331062438 sim_compute_robot_state-ego_max 0.1726423747399274 sim_compute_robot_state-ego_mean 0.07113585238454279 sim_compute_robot_state-ego_median 0.0455268749823937 sim_compute_robot_state-ego_min 0.04533389806747437 sim_compute_robot_state-npc0_max 0.0342262459964287 sim_compute_robot_state-npc0_mean 0.03416509511866432 sim_compute_robot_state-npc0_median 0.034178881084217745 sim_compute_robot_state-npc0_min 0.034078172536996694 sim_compute_robot_state-npc1_max 0.034111811564518854 sim_compute_robot_state-npc1_mean 0.03380172299297017 sim_compute_robot_state-npc1_median 0.03384650707244873 sim_compute_robot_state-npc1_min 0.03352084613981701 sim_compute_robot_state-npc2_max 0.03380137776571607 sim_compute_robot_state-npc2_mean 0.0336301737728733 sim_compute_robot_state-npc2_median 0.03356978369922173 sim_compute_robot_state-npc2_min 0.03349938462762272 sim_compute_robot_state-npc3_max 0.03439943752591572 sim_compute_robot_state-npc3_mean 0.03392858419015994 sim_compute_robot_state-npc3_median 0.033913781092717095 sim_compute_robot_state-npc3_min 0.03356508998309865 sim_compute_sim_state_max 0.01928005858165462 sim_compute_sim_state_mean 0.018959196316954963 sim_compute_sim_state_median 0.01887747470070334 sim_compute_sim_state_min 0.018750443825354943 sim_physics_max 0.001528615217942458 sim_physics_mean 0.0015047016097421806 sim_physics_median 0.0015035606012111756 sim_physics_min 0.0014841771125793455 sim_render-ego_max 0.032842724323272704 sim_render-ego_mean 0.03254002224763568 sim_render-ego_median 0.03259289814875676 sim_render-ego_min 0.032037973403930664 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 170832277FANG MEIYI Baseline solution using imitation learning from logs aido2_LF_r2-v4step1-simulation error no nutonomy-P50-58492019-04-08 09:49:23+00:00 2019-04-08 09:50:13+00:00 0:00:50 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170742286Andrea Censi Minimal agent aido2_LFVI_r1-v4step1-simulation success no nutonomy-P50-58492019-04-08 09:36:07+00:00 2019-04-08 09:49:16+00:00 0:13:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.72155331423772 survival_time_median 4.249999999999993 deviation-center-line_median 0.15741823007542524 in-drivable-lane_median 1.7499999999999938
other stats agent_compute-ego_max 0.077549129373887 agent_compute-ego_mean 0.07698333481758393 agent_compute-ego_median 0.07704688520992503 agent_compute-ego_min 0.0763137810158007 deviation-center-line_max 0.32861340027620084 deviation-center-line_mean 0.16720563088123774 deviation-center-line_min 0.08372346350452832 deviation-heading_max 1.6095487863912878 deviation-heading_mean 0.7416120746207572 deviation-heading_median 0.6111580236941071 deviation-heading_min 0.3663194255812494 driven_any_max 2.174849274549989 driven_any_mean 1.370290316170529 driven_any_median 1.2632550932005688 driven_any_min 0.9890108043245008 driven_lanedir_consec_max 1.0300199271670714 driven_lanedir_consec_mean 0.7679244191832472 driven_lanedir_consec_min 0.523101221541693 driven_lanedir_max 1.0586376106182156 driven_lanedir_mean 0.773647955873476 driven_lanedir_median 0.72155331423772 driven_lanedir_min 0.523101221541693 in-drivable-lane_max 3.149999999999989 in-drivable-lane_mean 1.7699999999999938 in-drivable-lane_min 0.1999999999999993 per-episodes details {"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0015234930761929217, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.032969622776426115, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.07709837124265473, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.047503165541024045, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.018940718420620624, "sim_compute_performance-ego": 0.03333499184970198, "sim_compute_robot_state-ego": 0.10723105463488349, "sim_compute_robot_state-npc0": 0.034273126207549, "sim_compute_robot_state-npc1": 0.033928442001342776, "sim_compute_robot_state-npc2": 0.03370776176452637, "sim_compute_robot_state-npc3": 0.033994816089498586}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.0015151753570094254, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.032619324597445404, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0763137810158007, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.0475862387454871, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.01877069834506873, "sim_compute_performance-ego": 0.03371013655807033, "sim_compute_robot_state-ego": 0.048257643526250664, "sim_compute_robot_state-npc0": 0.034449552044723976, "sim_compute_robot_state-npc1": 0.03425303372469815, "sim_compute_robot_state-npc2": 0.03358711257125392, "sim_compute_robot_state-npc3": 0.03378894473567153}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.001498394824088888, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.03266718539785832, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.07690850724565222, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.04810050446936424, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.01874150113856539, "sim_compute_performance-ego": 0.03369396798154141, "sim_compute_robot_state-ego": 0.049496003921995775, "sim_compute_robot_state-npc0": 0.03453460399140703, "sim_compute_robot_state-npc1": 0.03352024453751584, "sim_compute_robot_state-npc2": 0.03346402340746941, "sim_compute_robot_state-npc3": 0.033785814934588494}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.001522078233606675, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.03279658485861386, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.077549129373887, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.04775742923512178, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.01919492272769703, "sim_compute_performance-ego": 0.033607317419613106, "sim_compute_robot_state-ego": 0.04895424842834473, "sim_compute_robot_state-npc0": 0.03454382559832404, "sim_compute_robot_state-npc1": 0.03386260200949276, "sim_compute_robot_state-npc2": 0.03400860954733456, "sim_compute_robot_state-npc3": 0.03412192569059484}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.0014897830346051384, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.03276753776213702, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07704688520992503, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.04799842834472656, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.01909166223862592, "sim_compute_performance-ego": 0.03366592351128073, "sim_compute_robot_state-ego": 0.04801488974515129, "sim_compute_robot_state-npc0": 0.034275310880997605, "sim_compute_robot_state-npc1": 0.03379951154484468, "sim_compute_robot_state-npc2": 0.03343946092269, "sim_compute_robot_state-npc3": 0.0339127498514512}}set_robot_commands_max 0.04810050446936424 set_robot_commands_mean 0.047789153267144745 set_robot_commands_median 0.04775742923512178 set_robot_commands_min 0.047503165541024045 sim_compute_performance-ego_max 0.03371013655807033 sim_compute_performance-ego_mean 0.03360246746404151 sim_compute_performance-ego_median 0.03366592351128073 sim_compute_performance-ego_min 0.03333499184970198 sim_compute_robot_state-ego_max 0.10723105463488349 sim_compute_robot_state-ego_mean 0.060390768051325185 sim_compute_robot_state-ego_median 0.04895424842834473 sim_compute_robot_state-ego_min 0.04801488974515129 sim_compute_robot_state-npc0_max 0.03454382559832404 sim_compute_robot_state-npc0_mean 0.03441528374460033 sim_compute_robot_state-npc0_median 0.034449552044723976 sim_compute_robot_state-npc0_min 0.034273126207549 sim_compute_robot_state-npc1_max 0.03425303372469815 sim_compute_robot_state-npc1_mean 0.033872766763578845 sim_compute_robot_state-npc1_median 0.03386260200949276 sim_compute_robot_state-npc1_min 0.03352024453751584 sim_compute_robot_state-npc2_max 0.03400860954733456 sim_compute_robot_state-npc2_mean 0.03364139364265485 sim_compute_robot_state-npc2_median 0.03358711257125392 sim_compute_robot_state-npc2_min 0.03343946092269 sim_compute_robot_state-npc3_max 0.03412192569059484 sim_compute_robot_state-npc3_mean 0.03392085026036094 sim_compute_robot_state-npc3_median 0.0339127498514512 sim_compute_robot_state-npc3_min 0.033785814934588494 sim_compute_sim_state_max 0.01919492272769703 sim_compute_sim_state_mean 0.01894790057411554 sim_compute_sim_state_median 0.018940718420620624 sim_compute_sim_state_min 0.01874150113856539 sim_physics_max 0.0015234930761929217 sim_physics_mean 0.0015097849051006096 sim_physics_median 0.0015151753570094254 sim_physics_min 0.0014897830346051384 sim_render-ego_max 0.032969622776426115 sim_render-ego_mean 0.03276405107849615 sim_render-ego_median 0.03276753776213702 sim_render-ego_min 0.032619324597445404 simulation-passed 1 survival_time_max 7.249999999999982 survival_time_mean 4.579999999999992 survival_time_min 3.2999999999999963
No reset possible 170652294Andrea Censi Minimal agent aido2_LFV_r1-v4step1-simulation success no nutonomy-P50-58492019-04-08 09:24:34+00:00 2019-04-08 09:35:53+00:00 0:11:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07766627213534187 agent_compute-ego_mean 0.07706937255251813 agent_compute-ego_median 0.07704536731426533 agent_compute-ego_min 0.07656920902312749 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014808002640219295, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.032626832232755774, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07766627213534187, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04716190169839298, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.019291064318488624, "sim_compute_performance-ego": 0.03348188540514778, "sim_compute_robot_state-ego": 0.17516703114790075, "sim_compute_robot_state-npc0": 0.034198880195617676, "sim_compute_robot_state-npc1": 0.03383508149315329, "sim_compute_robot_state-npc2": 0.03361954057917876, "sim_compute_robot_state-npc3": 0.03391698528738583}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.001491395253983755, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.031902237543984066, "in-drivable-lane": 0, "agent_compute-ego": 0.07656920902312749, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04765357289995466, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.01884936907934764, "sim_compute_performance-ego": 0.03326721040029374, "sim_compute_robot_state-ego": 0.04688782162136502, "sim_compute_robot_state-npc0": 0.03488883896479531, "sim_compute_robot_state-npc1": 0.03443334216163272, "sim_compute_robot_state-npc2": 0.03350069787767199, "sim_compute_robot_state-npc3": 0.0337782965766059}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.001601861073420598, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.03307187007023738, "in-drivable-lane": 0, "agent_compute-ego": 0.07704536731426533, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04806847939124474, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.019022450080284702, "sim_compute_performance-ego": 0.033463151638324445, "sim_compute_robot_state-ego": 0.04604020852309007, "sim_compute_robot_state-npc0": 0.03454475769629845, "sim_compute_robot_state-npc1": 0.03397212395301232, "sim_compute_robot_state-npc2": 0.03377568538372333, "sim_compute_robot_state-npc3": 0.03406263864957369}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0014835101802174635, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03271903642793981, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07662427425384521, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04725309406838766, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.018939971923828125, "sim_compute_performance-ego": 0.034121112125675854, "sim_compute_robot_state-ego": 0.04570640296470828, "sim_compute_robot_state-npc0": 0.034248008960630835, "sim_compute_robot_state-npc1": 0.0339187238274551, "sim_compute_robot_state-npc2": 0.033847433764760085, "sim_compute_robot_state-npc3": 0.03403446150989067}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0015158486366271971, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.032758915424346925, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07744174003601074, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.04856918334960938, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.01889631986618042, "sim_compute_performance-ego": 0.033206074237823485, "sim_compute_robot_state-ego": 0.0452537727355957, "sim_compute_robot_state-npc0": 0.034409482479095456, "sim_compute_robot_state-npc1": 0.03405719757080078, "sim_compute_robot_state-npc2": 0.03379538297653198, "sim_compute_robot_state-npc3": 0.03380688190460205}}set_robot_commands_max 0.04856918334960938 set_robot_commands_mean 0.04774124628151788 set_robot_commands_median 0.04765357289995466 set_robot_commands_min 0.04716190169839298 sim_compute_performance-ego_max 0.034121112125675854 sim_compute_performance-ego_mean 0.03350788676145306 sim_compute_performance-ego_median 0.033463151638324445 sim_compute_performance-ego_min 0.033206074237823485 sim_compute_robot_state-ego_max 0.17516703114790075 sim_compute_robot_state-ego_mean 0.07181104739853197 sim_compute_robot_state-ego_median 0.04604020852309007 sim_compute_robot_state-ego_min 0.0452537727355957 sim_compute_robot_state-npc0_max 0.03488883896479531 sim_compute_robot_state-npc0_mean 0.03445799365928754 sim_compute_robot_state-npc0_median 0.034409482479095456 sim_compute_robot_state-npc0_min 0.034198880195617676 sim_compute_robot_state-npc1_max 0.03443334216163272 sim_compute_robot_state-npc1_mean 0.034043293801210836 sim_compute_robot_state-npc1_median 0.03397212395301232 sim_compute_robot_state-npc1_min 0.03383508149315329 sim_compute_robot_state-npc2_max 0.033847433764760085 sim_compute_robot_state-npc2_mean 0.03370774811637323 sim_compute_robot_state-npc2_median 0.03377568538372333 sim_compute_robot_state-npc2_min 0.03350069787767199 sim_compute_robot_state-npc3_max 0.03406263864957369 sim_compute_robot_state-npc3_mean 0.03391985278561163 sim_compute_robot_state-npc3_median 0.03391698528738583 sim_compute_robot_state-npc3_min 0.0337782965766059 sim_compute_sim_state_max 0.019291064318488624 sim_compute_sim_state_mean 0.018999835053625905 sim_compute_sim_state_median 0.018939971923828125 sim_compute_sim_state_min 0.01884936907934764 sim_physics_max 0.001601861073420598 sim_physics_mean 0.0015146830816541888 sim_physics_median 0.001491395253983755 sim_physics_min 0.0014808002640219295 sim_render-ego_max 0.03307187007023738 sim_render-ego_mean 0.03261577833985278 sim_render-ego_median 0.03271903642793981 sim_render-ego_min 0.031902237543984066 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 170542305Andrea Censi Minimal agent aido2_LFV_r1-v4step1-simulation success no nutonomy-P50-58492019-04-08 09:10:58+00:00 2019-04-08 09:24:18+00:00 0:13:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.077125403881073 agent_compute-ego_mean 0.07659980765571069 agent_compute-ego_median 0.07653773412471865 agent_compute-ego_min 0.07616792356266695 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014791313339682186, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03224596907110775, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07616792356266695, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04733549847322352, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.019339550943935618, "sim_compute_performance-ego": 0.033439366256489474, "sim_compute_robot_state-ego": 0.1791775472023908, "sim_compute_robot_state-npc0": 0.034483664176043344, "sim_compute_robot_state-npc1": 0.033867906121646654, "sim_compute_robot_state-npc2": 0.03379605798160329, "sim_compute_robot_state-npc3": 0.03379888394299675}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0014957927522205171, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.03241527269756983, "in-drivable-lane": 0, "agent_compute-ego": 0.07624253394111755, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04666032109941755, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.018950946747310574, "sim_compute_performance-ego": 0.033235133640349857, "sim_compute_robot_state-ego": 0.047029873681446864, "sim_compute_robot_state-npc0": 0.03416449304610964, "sim_compute_robot_state-npc1": 0.03424667555188376, "sim_compute_robot_state-npc2": 0.033770670966496545, "sim_compute_robot_state-npc3": 0.03388079007466634}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0014952402848463792, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.03296613693237305, "in-drivable-lane": 0, "agent_compute-ego": 0.07692544276897724, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04687545482928936, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.018781126462496245, "sim_compute_performance-ego": 0.033874016541701094, "sim_compute_robot_state-ego": 0.04591892315791203, "sim_compute_robot_state-npc0": 0.03517111631540152, "sim_compute_robot_state-npc1": 0.0339876835162823, "sim_compute_robot_state-npc2": 0.034153666863074666, "sim_compute_robot_state-npc3": 0.03409373210026668}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0014890083452550377, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.032656227670064784, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07653773412471865, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04817660261945027, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.01897524624336057, "sim_compute_performance-ego": 0.03367848221848651, "sim_compute_robot_state-ego": 0.045845252711598464, "sim_compute_robot_state-npc0": 0.034213999422585094, "sim_compute_robot_state-npc1": 0.03444246257223734, "sim_compute_robot_state-npc2": 0.033722287271080946, "sim_compute_robot_state-npc3": 0.0337388689925031}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0016536235809326172, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.03306528329849243, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.077125403881073, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.04678067445755005, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.019002153873443603, "sim_compute_performance-ego": 0.033646390438079835, "sim_compute_robot_state-ego": 0.04563989877700805, "sim_compute_robot_state-npc0": 0.03525928020477295, "sim_compute_robot_state-npc1": 0.0340636682510376, "sim_compute_robot_state-npc2": 0.03372774124145508, "sim_compute_robot_state-npc3": 0.03428297758102417}}set_robot_commands_max 0.04817660261945027 set_robot_commands_mean 0.04716571029578615 set_robot_commands_median 0.04687545482928936 set_robot_commands_min 0.04666032109941755 sim_compute_performance-ego_max 0.033874016541701094 sim_compute_performance-ego_mean 0.03357467781902135 sim_compute_performance-ego_median 0.033646390438079835 sim_compute_performance-ego_min 0.033235133640349857 sim_compute_robot_state-ego_max 0.1791775472023908 sim_compute_robot_state-ego_mean 0.07272229910607124 sim_compute_robot_state-ego_median 0.04591892315791203 sim_compute_robot_state-ego_min 0.04563989877700805 sim_compute_robot_state-npc0_max 0.03525928020477295 sim_compute_robot_state-npc0_mean 0.03465851063298251 sim_compute_robot_state-npc0_median 0.034483664176043344 sim_compute_robot_state-npc0_min 0.03416449304610964 sim_compute_robot_state-npc1_max 0.03444246257223734 sim_compute_robot_state-npc1_mean 0.03412167920261753 sim_compute_robot_state-npc1_median 0.0340636682510376 sim_compute_robot_state-npc1_min 0.033867906121646654 sim_compute_robot_state-npc2_max 0.034153666863074666 sim_compute_robot_state-npc2_mean 0.03383408486474211 sim_compute_robot_state-npc2_median 0.033770670966496545 sim_compute_robot_state-npc2_min 0.033722287271080946 sim_compute_robot_state-npc3_max 0.03428297758102417 sim_compute_robot_state-npc3_mean 0.0339590505382914 sim_compute_robot_state-npc3_median 0.03388079007466634 sim_compute_robot_state-npc3_min 0.0337388689925031 sim_compute_sim_state_max 0.019339550943935618 sim_compute_sim_state_mean 0.019009804854109323 sim_compute_sim_state_median 0.01897524624336057 sim_compute_sim_state_min 0.018781126462496245 sim_physics_max 0.0016536235809326172 sim_physics_mean 0.001522559259444554 sim_physics_median 0.0014952402848463792 sim_physics_min 0.0014791313339682186 sim_render-ego_max 0.03306528329849243 sim_render-ego_mean 0.03266977793392157 sim_render-ego_median 0.032656227670064784 sim_render-ego_min 0.03224596907110775 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 170532307Andrea Censi Java template aido2-AMOD-efficiencystep1-simulation error no nutonomy-P50-58492019-04-08 09:10:14+00:00 2019-04-08 09:10:51+00:00 0:00:37 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170512309Andrea Censi Java template aido2-AMOD-service_qualitystep1-simulation error no nutonomy-P50-58492019-04-08 09:09:08+00:00 2019-04-08 09:09:59+00:00 0:00:51 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170502310Andrea Censi Python template aido2-AMOD-efficiencystep2-scoring success no nutonomy-P50-58492019-04-08 09:08:36+00:00 2019-04-08 09:08:56+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency -71.37114423151696
other stats fleet_size -1000000000 service_quality -34.2219260578793
No reset possible 170492310Andrea Censi Python template aido2-AMOD-efficiencystep1-simulation success no nutonomy-P50-58492019-04-08 09:05:47+00:00 2019-04-08 09:08:22+00:00 0:02:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170482312Andrea Censi Python template aido2-AMOD-service_qualitystep2-scoring success no nutonomy-P50-58492019-04-08 09:05:00+00:00 2019-04-08 09:05:27+00:00 0:00:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.33177410304521
other stats efficiency -63.29221641217838 fleet_size -1000000000
No reset possible 170432312Andrea Censi Python template aido2-AMOD-service_qualitystep1-simulation success no nutonomy-P50-58492019-04-08 09:01:58+00:00 2019-04-08 09:04:46+00:00 0:02:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170392249Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4step1-simulation error no nutonomy-P50-58492019-04-06 23:29:09+00:00 2019-04-07 00:02:27+00:00 0:33:18 Timeout:
Waited 180 [...] Timeout:
Waited 1803.350516796112 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170342253Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4step1-simulation success no nutonomy-P50-58492019-04-06 23:22:19+00:00 2019-04-06 23:29:02+00:00 0:06:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2469090841086827 survival_time_median 4.549999999999992 deviation-center-line_median 0.04672944427789085 in-drivable-lane_median 0.849999999999997
other stats agent_compute-ego_max 0.1059151197734632 agent_compute-ego_mean 0.10357048596539709 agent_compute-ego_median 0.10341324649014316 agent_compute-ego_min 0.10216836343731796 deviation-center-line_max 0.06145799020109726 deviation-center-line_mean 0.05093550644162159 deviation-center-line_min 0.04243204750551762 deviation-heading_max 0.3651747916333489 deviation-heading_mean 0.337228205889442 deviation-heading_median 0.3437882236045882 deviation-heading_min 0.2988624457873002 driven_any_max 1.585358302811824 driven_any_mean 1.3478307989115732 driven_any_median 1.5847022765798542 driven_any_min 0.991788585368166 driven_lanedir_consec_max 1.352592230137792 driven_lanedir_consec_mean 1.0530035252790146 driven_lanedir_consec_min 0.6572386067501972 driven_lanedir_max 1.352592230137792 driven_lanedir_mean 1.0530035252790146 driven_lanedir_median 1.2469090841086827 driven_lanedir_min 0.6572386067501972 in-drivable-lane_max 0.849999999999997 in-drivable-lane_mean 0.7499999999999973 in-drivable-lane_min 0.5999999999999979 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.991788585368166, "sim_physics": 0.0016626182355378805, "survival_time": 2.849999999999998, "driven_lanedir": 0.6572386067501972, "sim_render-ego": 0.03263144325791744, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1059151197734632, "deviation-heading": 0.3437882236045882, "set_robot_commands": 0.047275865287111515, "deviation-center-line": 0.04243204750551762, "driven_lanedir_consec": 0.6572386067501972, "sim_compute_sim_state": 0.01919031143188477, "sim_compute_performance-ego": 0.034120693541409675, "sim_compute_robot_state-ego": 0.20699728999221537}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9925960804400604, "sim_physics": 0.0017340308741519326, "survival_time": 2.849999999999998, "driven_lanedir": 0.7613614943510975, "sim_render-ego": 0.03237296823869672, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.10216836343731796, "deviation-heading": 0.2988624457873002, "set_robot_commands": 0.04891503484625565, "deviation-center-line": 0.057331107694399905, "driven_lanedir_consec": 0.7613614943510975, "sim_compute_sim_state": 0.01917801405254163, "sim_compute_performance-ego": 0.03395356630024157, "sim_compute_robot_state-ego": 0.044584441603275765}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.585358302811824, "sim_physics": 0.0016882917383214929, "survival_time": 4.549999999999992, "driven_lanedir": 1.352592230137792, "sim_render-ego": 0.0337386891082093, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.10358702481447996, "deviation-heading": 0.31315847556769366, "set_robot_commands": 0.04757155690874372, "deviation-center-line": 0.06145799020109726, "driven_lanedir_consec": 1.352592230137792, "sim_compute_sim_state": 0.01899411652114365, "sim_compute_performance-ego": 0.03456877352117182, "sim_compute_robot_state-ego": 0.04481490889748374}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5847022765798542, "sim_physics": 0.0016718827761136568, "survival_time": 4.549999999999992, "driven_lanedir": 1.2469090841086827, "sim_render-ego": 0.032487020387754334, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.10276867531158113, "deviation-heading": 0.36515709285427905, "set_robot_commands": 0.04730882487454257, "deviation-center-line": 0.04672694252920234, "driven_lanedir_consec": 1.2469090841086827, "sim_compute_sim_state": 0.01904830041822496, "sim_compute_performance-ego": 0.034073151074923, "sim_compute_robot_state-ego": 0.04489485510102995}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5847087493579624, "sim_physics": 0.0016411713191441127, "survival_time": 4.549999999999992, "driven_lanedir": 1.246916211047303, "sim_render-ego": 0.032680425015124644, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.10341324649014316, "deviation-heading": 0.3651747916333489, "set_robot_commands": 0.047782043834309, "deviation-center-line": 0.04672944427789085, "driven_lanedir_consec": 1.246916211047303, "sim_compute_sim_state": 0.019097993662069133, "sim_compute_performance-ego": 0.03410226434141725, "sim_compute_robot_state-ego": 0.04486791904156025}}set_robot_commands_max 0.04891503484625565 set_robot_commands_mean 0.047770665150192494 set_robot_commands_median 0.04757155690874372 set_robot_commands_min 0.047275865287111515 sim_compute_performance-ego_max 0.03456877352117182 sim_compute_performance-ego_mean 0.034163689755832664 sim_compute_performance-ego_median 0.03410226434141725 sim_compute_performance-ego_min 0.03395356630024157 sim_compute_robot_state-ego_max 0.20699728999221537 sim_compute_robot_state-ego_mean 0.07723188292711301 sim_compute_robot_state-ego_median 0.04486791904156025 sim_compute_robot_state-ego_min 0.044584441603275765 sim_compute_sim_state_max 0.01919031143188477 sim_compute_sim_state_mean 0.019101747217172827 sim_compute_sim_state_median 0.019097993662069133 sim_compute_sim_state_min 0.01899411652114365 sim_physics_max 0.0017340308741519326 sim_physics_mean 0.0016795989886538149 sim_physics_median 0.0016718827761136568 sim_physics_min 0.0016411713191441127 sim_render-ego_max 0.0337386891082093 sim_render-ego_mean 0.03278210920154048 sim_render-ego_median 0.03263144325791744 sim_render-ego_min 0.03237296823869672 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 3.869999999999995 survival_time_min 2.849999999999998
No reset possible 170322261Bhairav Mehta PyTorch template aido2_LF_r2-v4step1-simulation failed no nutonomy-P50-58492019-04-06 23:20:47+00:00 2019-04-06 23:21:50+00:00 0:01:03 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 272, in run_episode
r: MsgReceived = agent.read_one(expect_topic='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 164, in read_one
raise RemoteNodeAborted(m) # XXX
zuper_nodes_wrapper.wrapper_outside.RemoteNodeAborted: I was waiting for a message from component "agent" but it aborted with the following error.
agent error |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 426, in loop
|| handle_message_node(parsed, protocol, pc, node, context_data)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 500, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 583, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 48, in on_received_get_commands
|| pwm_left, pwm_right = compute_action(self.config.current_image)
|| NameError: name 'compute_action' is not defined
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 399, in <module>
wrap(cie)
File "experiment_manager.py", line 388, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 122, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 275, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170312262Bhairav Mehta PyTorch template aido2_LF_r2-v4step1-simulation error no nutonomy-P50-58492019-04-06 23:19:07+00:00 2019-04-06 23:19:57+00:00 0:00:50 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170282264Bhairav Mehta PyTorch template aido2_LF_r2-v4step1-simulation failed no nutonomy-P50-58492019-04-06 23:17:38+00:00 2019-04-06 23:18:37+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 272, in run_episode
r: MsgReceived = agent.read_one(expect_topic='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 164, in read_one
raise RemoteNodeAborted(m) # XXX
zuper_nodes_wrapper.wrapper_outside.RemoteNodeAborted: I was waiting for a message from component "agent" but it aborted with the following error.
agent error |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 633, in type_to_schema
|| schema = type_to_schema_(T, globals_, processing)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 838, in type_to_schema_
|| raise ValueError(msg)
|| ValueError: Cannot interpret this type. (not a dataclass): <class 'numpy.float32'>
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 132, in serialize_dataclass
|| res[k] = object_to_ipce(v, globals_, suggest_type=ann, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 35, in object_to_ipce
|| res = object_to_ipce_(ob, globals_, suggest_type=suggest_type, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 97, in object_to_ipce_
|| return serialize_dataclass(ob, globals_, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 107, in serialize_dataclass
|| the_schema = type_to_schema(T, globals_)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 641, in type_to_schema
|| raise type(e)(msg) from e
|| ValueError: Cannot get schema for <class 'numpy.float32'>:
|| │ processing: (empty dict)
|| Traceback (most recent call last):
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 633, in type_to_schema
|| schema = type_to_schema_(T, globals_, processing)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 838, in type_to_schema_
|| raise ValueError(msg)
|| ValueError: Cannot interpret this type. (not a dataclass): <class 'numpy.float32'>
||
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 132, in serialize_dataclass
|| res[k] = object_to_ipce(v, globals_, suggest_type=ann, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 35, in object_to_ipce
|| res = object_to_ipce_(ob, globals_, suggest_type=suggest_type, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 97, in object_to_ipce_
|| return serialize_dataclass(ob, globals_, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 136, in serialize_dataclass
|| raise Exception(msg) from e
|| Exception: Cannot serialize attribute motor_left = 0.457182914018631
|| Type <class 'aido_schemas.schemas.PWMCommands'> has annotated it as <class 'float'>
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 426, in loop
|| handle_message_node(parsed, protocol, pc, node, context_data)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 500, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 583, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 50, in on_received_get_commands
|| context.write('commands', commands)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 136, in write
|| m[FIELD_DATA] = object_to_ipce(data, {}, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 35, in object_to_ipce
|| res = object_to_ipce_(ob, globals_, suggest_type=suggest_type, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 97, in object_to_ipce_
|| return serialize_dataclass(ob, globals_, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 136, in serialize_dataclass
|| raise Exception(msg) from e
|| Exception: Cannot serialize attribute wheels = PWMCommands(motor_left=0.4571829, motor_right=-0.12220679)
|| Type <class 'aido_schemas.schemas.Duckiebot1Commands'> has annotated it as <class 'aido_schemas.schemas.PWMCommands'>
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 399, in <module>
wrap(cie)
File "experiment_manager.py", line 388, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 122, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 275, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170252268Andrea Censi Solution template aido2_LF_r2-v4step1-simulation success no nutonomy-P50-58492019-04-06 23:10:49+00:00 2019-04-06 23:17:18+00:00 0:06:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07721450879023625 agent_compute-ego_mean 0.076759531368732 agent_compute-ego_median 0.07669839917159663 agent_compute-ego_min 0.07642674067663768 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0016665213248308968, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.032653345781214094, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07645979348350973, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04672524858923519, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.01872959908317117, "sim_compute_performance-ego": 0.03459195880328908, "sim_compute_robot_state-ego": 0.18664685067008524}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0016671930040631977, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.03253778578743102, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07642674067663768, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.047186991525074794, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.019033484988742404, "sim_compute_performance-ego": 0.03442573547363281, "sim_compute_robot_state-ego": 0.04485692296709333}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0016998657813439002, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.0330016723045936, "in-drivable-lane": 0, "agent_compute-ego": 0.07721450879023625, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.0478399240053617, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.01931166648864746, "sim_compute_performance-ego": 0.03459291458129883, "sim_compute_robot_state-ego": 0.04502957050616924}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.001714543598454173, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03320777416229248, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07669839917159663, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04739162689302026, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.018905738504921516, "sim_compute_performance-ego": 0.034286920617266396, "sim_compute_robot_state-ego": 0.04503422248654249}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.0016667985916137696, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.033004050254821775, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07699821472167968, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.04730636835098267, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.019015214443206783, "sim_compute_performance-ego": 0.03470555067062378, "sim_compute_robot_state-ego": 0.0458077883720398}}set_robot_commands_max 0.0478399240053617 set_robot_commands_mean 0.04729003187273492 set_robot_commands_median 0.04730636835098267 set_robot_commands_min 0.04672524858923519 sim_compute_performance-ego_max 0.03470555067062378 sim_compute_performance-ego_mean 0.03452061602922218 sim_compute_performance-ego_median 0.03459195880328908 sim_compute_performance-ego_min 0.034286920617266396 sim_compute_robot_state-ego_max 0.18664685067008524 sim_compute_robot_state-ego_mean 0.07347507100038601 sim_compute_robot_state-ego_median 0.04503422248654249 sim_compute_robot_state-ego_min 0.04485692296709333 sim_compute_sim_state_max 0.01931166648864746 sim_compute_sim_state_mean 0.018999140701737867 sim_compute_sim_state_median 0.019015214443206783 sim_compute_sim_state_min 0.01872959908317117 sim_physics_max 0.001714543598454173 sim_physics_mean 0.0016829844600611873 sim_physics_median 0.0016671930040631977 sim_physics_min 0.0016665213248308968 sim_render-ego_max 0.03320777416229248 sim_render-ego_mean 0.032880925658070596 sim_render-ego_median 0.0330016723045936 sim_render-ego_min 0.03253778578743102 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 170232270Andrea Censi PredictorLast aido2-PREDstep1-simulation success no nutonomy-P50-58492019-04-06 23:09:21+00:00 2019-04-06 23:09:53+00:00 0:00:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.09437377239320648 error_L2 0.013800432220001477
No reset possible 170222271Andrea Censi PredictorLast aido2-PREDstep1-simulation success no nutonomy-P50-58492019-04-06 23:07:57+00:00 2019-04-06 23:08:31+00:00 0:00:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.11288109908182337 error_L2 0.019904275329040415
No reset possible 170212272Andrea Censi PredictorMean aido2-PREDstep1-simulation success no nutonomy-P50-58492019-04-06 23:06:30+00:00 2019-04-06 23:07:04+00:00 0:00:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.2746570059892871 error_L2 0.09060165917734982
No reset possible 170202273Andrea Censi PredictorRandom aido2-PREDstep1-simulation success no nutonomy-P50-58492019-04-06 23:05:00+00:00 2019-04-06 23:05:33+00:00 0:00:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.30786446250611815 error_L2 0.13674997021730825
No reset possible 170162277FANG MEIYI Baseline solution using imitation learning from logs aido2_LF_r2-v4step1-simulation error no nutonomy-P50-58492019-04-06 22:59:24+00:00 2019-04-06 23:02:57+00:00 0:03:33 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 170152279Nikhil Khedekar PredictorLast aido2-PREDstep1-simulation success no nutonomy-P50-58492019-04-06 22:57:45+00:00 2019-04-06 22:58:19+00:00 0:00:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.10360972525874064 error_L2 0.017287744359737265
No reset possible 170132281Andrea Censi PredictorMean aido2-PREDstep1-simulation success no nutonomy-P50-58492019-04-06 22:56:15+00:00 2019-04-06 22:56:44+00:00 0:00:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.27902796518138784 error_L2 0.09147193825789536
No reset possible 170062285Andrea Censi Minimal agent aido2_LFV_r1-v4step1-simulation success no nutonomy-P50-58492019-04-06 22:46:02+00:00 2019-04-06 22:56:00+00:00 0:09:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07684073448181153 agent_compute-ego_mean 0.07645676388361229 agent_compute-ego_median 0.0763578647520484 agent_compute-ego_min 0.07589671346876356 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0017322617418625776, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.0325744257253759, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07635663186802584, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04778503319796394, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.018986996482400337, "sim_compute_performance-ego": 0.03393387794494629, "sim_compute_robot_state-ego": 0.17807239644667683, "sim_compute_robot_state-npc0": 0.03713992763968075, "sim_compute_robot_state-npc1": 0.036985786522136015, "sim_compute_robot_state-npc2": 0.03692024244981654, "sim_compute_robot_state-npc3": 0.03694930847953347}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.001705374036516462, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.03194273842705621, "in-drivable-lane": 0, "agent_compute-ego": 0.07589671346876356, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04741693299914163, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.018965183742462643, "sim_compute_performance-ego": 0.03406015653458853, "sim_compute_robot_state-ego": 0.050846694007752435, "sim_compute_robot_state-npc0": 0.03720396284073118, "sim_compute_robot_state-npc1": 0.03696274000500876, "sim_compute_robot_state-npc2": 0.03692413890172565, "sim_compute_robot_state-npc3": 0.03664007262578086}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0016659406515268178, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.032813072204589844, "in-drivable-lane": 0, "agent_compute-ego": 0.07684073448181153, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04778026067293607, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.01895710871769832, "sim_compute_performance-ego": 0.03588370543259841, "sim_compute_robot_state-ego": 0.04914112824660081, "sim_compute_robot_state-npc0": 0.0371987562913161, "sim_compute_robot_state-npc1": 0.03700696138235239, "sim_compute_robot_state-npc2": 0.03701592958890475, "sim_compute_robot_state-npc3": 0.03657978864816519}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.001778375811693145, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.032560383401265956, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.0763578647520484, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04761442324010337, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.0190684998907694, "sim_compute_performance-ego": 0.03402866096031375, "sim_compute_robot_state-ego": 0.04992959557510004, "sim_compute_robot_state-npc0": 0.036963861163069565, "sim_compute_robot_state-npc1": 0.036856910077536977, "sim_compute_robot_state-npc2": 0.03685223474735167, "sim_compute_robot_state-npc3": 0.03695404820325898}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.001732356548309326, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.03300744771957397, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07683187484741211, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.04866371154785156, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.0189151930809021, "sim_compute_performance-ego": 0.033702425956726074, "sim_compute_robot_state-ego": 0.049317286014556885, "sim_compute_robot_state-npc0": 0.03715354442596436, "sim_compute_robot_state-npc1": 0.03694380283355713, "sim_compute_robot_state-npc2": 0.03720529317855835, "sim_compute_robot_state-npc3": 0.03687067031860351}}set_robot_commands_max 0.04866371154785156 set_robot_commands_mean 0.04785207233159931 set_robot_commands_median 0.04778026067293607 set_robot_commands_min 0.04741693299914163 sim_compute_performance-ego_max 0.03588370543259841 sim_compute_performance-ego_mean 0.03432176536583461 sim_compute_performance-ego_median 0.03402866096031375 sim_compute_performance-ego_min 0.033702425956726074 sim_compute_robot_state-ego_max 0.17807239644667683 sim_compute_robot_state-ego_mean 0.0754614200581374 sim_compute_robot_state-ego_median 0.04992959557510004 sim_compute_robot_state-ego_min 0.04914112824660081 sim_compute_robot_state-npc0_max 0.03720396284073118 sim_compute_robot_state-npc0_mean 0.037132010472152394 sim_compute_robot_state-npc0_median 0.03715354442596436 sim_compute_robot_state-npc0_min 0.036963861163069565 sim_compute_robot_state-npc1_max 0.03700696138235239 sim_compute_robot_state-npc1_mean 0.03695124016411826 sim_compute_robot_state-npc1_median 0.03696274000500876 sim_compute_robot_state-npc1_min 0.036856910077536977 sim_compute_robot_state-npc2_max 0.03720529317855835 sim_compute_robot_state-npc2_mean 0.036983567773271386 sim_compute_robot_state-npc2_median 0.03692413890172565 sim_compute_robot_state-npc2_min 0.03685223474735167 sim_compute_robot_state-npc3_max 0.03695404820325898 sim_compute_robot_state-npc3_mean 0.03679877765506841 sim_compute_robot_state-npc3_median 0.03687067031860351 sim_compute_robot_state-npc3_min 0.03657978864816519 sim_compute_sim_state_max 0.0190684998907694 sim_compute_sim_state_mean 0.01897859638284656 sim_compute_sim_state_median 0.018965183742462643 sim_compute_sim_state_min 0.0189151930809021 sim_physics_max 0.001778375811693145 sim_physics_mean 0.0017228617579816655 sim_physics_median 0.0017322617418625776 sim_physics_min 0.0016659406515268178 sim_render-ego_max 0.03300744771957397 sim_render-ego_mean 0.03257961349557238 sim_render-ego_median 0.0325744257253759 sim_render-ego_min 0.03194273842705621 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 170032288Andrea Censi PredictorMean aido2-PREDstep1-simulation success no nutonomy-P50-58492019-04-06 22:45:11+00:00 2019-04-06 22:45:42+00:00 0:00:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.27970779579068294 error_L2 0.09462071886849906
No reset possible 169962293Andrea Censi Minimal agent aido2_LFVI_r1-v4step1-simulation success no nutonomy-P50-58492019-04-06 22:32:09+00:00 2019-04-06 22:44:57+00:00 0:12:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.72155331423772 survival_time_median 4.249999999999993 deviation-center-line_median 0.15741823007542524 in-drivable-lane_median 1.7499999999999938
other stats agent_compute-ego_max 0.07754823248437111 agent_compute-ego_mean 0.07723079866143966 agent_compute-ego_median 0.07736622382854594 agent_compute-ego_min 0.07661853818332448 deviation-center-line_max 0.32861340027620084 deviation-center-line_mean 0.16720563088123774 deviation-center-line_min 0.08372346350452832 deviation-heading_max 1.6095487863912878 deviation-heading_mean 0.7416120746207572 deviation-heading_median 0.6111580236941071 deviation-heading_min 0.3663194255812494 driven_any_max 2.174849274549989 driven_any_mean 1.370290316170529 driven_any_median 1.2632550932005688 driven_any_min 0.9890108043245008 driven_lanedir_consec_max 1.0300199271670714 driven_lanedir_consec_mean 0.7679244191832472 driven_lanedir_consec_min 0.523101221541693 driven_lanedir_max 1.0586376106182156 driven_lanedir_mean 0.773647955873476 driven_lanedir_median 0.72155331423772 driven_lanedir_min 0.523101221541693 in-drivable-lane_max 3.149999999999989 in-drivable-lane_mean 1.7699999999999938 in-drivable-lane_min 0.1999999999999993 per-episodes details {"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0017232829126818429, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.03243390280624916, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.07736622382854594, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.04746741919681944, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.018748092651367187, "sim_compute_performance-ego": 0.03350896013194117, "sim_compute_robot_state-ego": 0.11328770374429636, "sim_compute_robot_state-npc0": 0.037018692082372205, "sim_compute_robot_state-npc1": 0.03644650557945515, "sim_compute_robot_state-npc2": 0.03644036095717858, "sim_compute_robot_state-npc3": 0.03638201582020727}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.0016817902073715672, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.03256880875789758, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.07745669104836204, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.04745516632542466, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.018901723803895893, "sim_compute_performance-ego": 0.03382558533639619, "sim_compute_robot_state-ego": 0.05090847159876968, "sim_compute_robot_state-npc0": 0.036759781114982834, "sim_compute_robot_state-npc1": 0.0365340095577818, "sim_compute_robot_state-npc2": 0.03658443869966449, "sim_compute_robot_state-npc3": 0.03715818578546697}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.0017277966154382585, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.032989968644811754, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.07754823248437111, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.04885280132293701, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.019059937051002018, "sim_compute_performance-ego": 0.0334263913174893, "sim_compute_robot_state-ego": 0.052095222980418104, "sim_compute_robot_state-npc0": 0.03748291604062344, "sim_compute_robot_state-npc1": 0.03699341479768144, "sim_compute_robot_state-npc2": 0.03708907898436201, "sim_compute_robot_state-npc3": 0.03729834455124875}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.0017249640296487247, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.03250991877387552, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07716430776259478, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.047446399576523725, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.01869358735926011, "sim_compute_performance-ego": 0.03347581695107853, "sim_compute_robot_state-ego": 0.051805608412798715, "sim_compute_robot_state-npc0": 0.036806246813605815, "sim_compute_robot_state-npc1": 0.03645336768206428, "sim_compute_robot_state-npc2": 0.036679705451516546, "sim_compute_robot_state-npc3": 0.036453381706686584}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.0017199446173275215, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.032394805375267476, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07661853818332448, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.047256813329808856, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.018774951205534095, "sim_compute_performance-ego": 0.03384590850156896, "sim_compute_robot_state-ego": 0.051341389908510095, "sim_compute_robot_state-npc0": 0.03736755427192239, "sim_compute_robot_state-npc1": 0.03663270964342005, "sim_compute_robot_state-npc2": 0.036673009395599365, "sim_compute_robot_state-npc3": 0.03655479234807631}}set_robot_commands_max 0.04885280132293701 set_robot_commands_mean 0.04769571995030274 set_robot_commands_median 0.04745516632542466 set_robot_commands_min 0.047256813329808856 sim_compute_performance-ego_max 0.03384590850156896 sim_compute_performance-ego_mean 0.03361653244769483 sim_compute_performance-ego_median 0.03350896013194117 sim_compute_performance-ego_min 0.0334263913174893 sim_compute_robot_state-ego_max 0.11328770374429636 sim_compute_robot_state-ego_mean 0.0638876793289586 sim_compute_robot_state-ego_median 0.051805608412798715 sim_compute_robot_state-ego_min 0.05090847159876968 sim_compute_robot_state-npc0_max 0.03748291604062344 sim_compute_robot_state-npc0_mean 0.03708703806470134 sim_compute_robot_state-npc0_median 0.037018692082372205 sim_compute_robot_state-npc0_min 0.036759781114982834 sim_compute_robot_state-npc1_max 0.03699341479768144 sim_compute_robot_state-npc1_mean 0.036612001452080545 sim_compute_robot_state-npc1_median 0.0365340095577818 sim_compute_robot_state-npc1_min 0.03644650557945515 sim_compute_robot_state-npc2_max 0.03708907898436201 sim_compute_robot_state-npc2_mean 0.0366933186976642 sim_compute_robot_state-npc2_median 0.036673009395599365 sim_compute_robot_state-npc2_min 0.03644036095717858 sim_compute_robot_state-npc3_max 0.03729834455124875 sim_compute_robot_state-npc3_mean 0.03676934404233718 sim_compute_robot_state-npc3_median 0.03655479234807631 sim_compute_robot_state-npc3_min 0.03638201582020727 sim_compute_sim_state_max 0.019059937051002018 sim_compute_sim_state_mean 0.018835658414211857 sim_compute_sim_state_median 0.018774951205534095 sim_compute_sim_state_min 0.01869358735926011 sim_physics_max 0.0017277966154382585 sim_physics_mean 0.0017155556764935828 sim_physics_median 0.0017232829126818429 sim_physics_min 0.0016817902073715672 sim_render-ego_max 0.032989968644811754 sim_render-ego_mean 0.0325794808716203 sim_render-ego_median 0.03250991877387552 sim_render-ego_min 0.032394805375267476 simulation-passed 1 survival_time_max 7.249999999999982 survival_time_mean 4.579999999999992 survival_time_min 3.2999999999999963
No reset possible 169882298Andrea Censi Python template aido2-AMOD-efficiencystep1-simulation success no nutonomy-P50-58492019-04-06 22:27:56+00:00 2019-04-06 22:31:48+00:00 0:03:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 169852280FANG MEIYI Baseline solution using imitation learning from logs aido2_LF_r2-v4step1-simulation host-error no nutonomy-P50-58492019-04-05 08:34:27+00:00 2019-04-05 08:40:20+00:00 0:05:53 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 973, in download_artefacts
get_file_from_cache(fn, sha256hex)
File "/project/src/duckietown_challenges_runner/runner_cache.py", line 27, in get_file_from_cache
raise KeyError(msg)
KeyError: 'Hash not in cache'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 418, in go_
challenge_step_name, project, do_pull, debug_volumes=debug_volumes)
File "/project/src/duckietown_challenges_runner/runner.py", line 479, in run_single
prepare_dir(wd, aws_config, steps2artefacts)
File "/project/src/duckietown_challenges_runner/runner.py", line 721, in prepare_dir
download_artefacts(aws_config, steps2artefacts, previous_steps_dir)
File "/project/src/duckietown_challenges_runner/runner.py", line 988, in download_artefacts
get_object(aws_config, bucket_name, object_key, fn)
File "/project/src/duckietown_challenges_runner/runner.py", line 1026, in get_object
aws_object.download_file(fn)
File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 314, in object_download_file
ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 172, in download_file
extra_args=ExtraArgs, callback=Callback)
File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 307, in download_file
future.result()
File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
return self._coordinator.result()
File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
raise self._exception
File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 255, in _main
self._submit(transfer_future=transfer_future, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/s3transfer/download.py", line 353, in _submit
**transfer_future.meta.call_args.extra_args
File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 648, in _make_api_call
operation_model, request_dict, request_context)
File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 667, in _make_request
return self._endpoint.make_request(operation_model, request_dict)
File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 102, in make_request
return self._send_request(request_dict, operation_model)
File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 137, in _send_request
success_response, exception):
File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 231, in _needs_retry
caught_exception=caught_exception, request_dict=request_dict)
File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 356, in emit
return self._emitter.emit(aliased_event_name, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 228, in emit
return self._emit(event_name, kwargs)
File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 211, in _emit
response = handler(**kwargs)
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 183, in __call__
if self._checker(attempts, response, caught_exception):
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 251, in __call__
caught_exception)
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
return self._checker(attempt_number, response, caught_exception)
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 317, in __call__
caught_exception)
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 223, in __call__
attempt_number, caught_exception)
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
raise caught_exception
File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 200, in _do_get_response
http_response = self._send(request)
File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 244, in _send
return self.http_session.send(request)
File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 278, in send
raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/frankfurt/by-value/sha256/333415f43bfc9c380e722ee6d4e01c28c1b17126a9c430962eb9d7fdf727b84b"
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 421, in go_
uploaded = upload_files(wd, aws_config)
File "/project/src/duckietown_challenges_runner/runner.py", line 948, in upload_files
uploaded = upload(aws_config, toupload)
File "/project/src/duckietown_challenges_runner/runner.py", line 1112, in upload
aws_object.load()
File "/usr/local/lib/python3.6/dist-packages/boto3/resources/factory.py", line 505, in do_action
response = action(self, *args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/boto3/resources/action.py", line 83, in __call__
response = getattr(parent.meta.client, operation_name)(**params)
File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 648, in _make_api_call
operation_model, request_dict, request_context)
File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 667, in _make_request
return self._endpoint.make_request(operation_model, request_dict)
File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 102, in make_request
return self._send_request(request_dict, operation_model)
File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 137, in _send_request
success_response, exception):
File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 231, in _needs_retry
caught_exception=caught_exception, request_dict=request_dict)
File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 356, in emit
return self._emitter.emit(aliased_event_name, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 228, in emit
return self._emit(event_name, kwargs)
File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 211, in _emit
response = handler(**kwargs)
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 183, in __call__
if self._checker(attempts, response, caught_exception):
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 251, in __call__
caught_exception)
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
return self._checker(attempt_number, response, caught_exception)
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 317, in __call__
caught_exception)
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 223, in __call__
attempt_number, caught_exception)
File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
raise caught_exception
File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 200, in _do_get_response
http_response = self._send(request)
File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 244, in _send
return self.http_session.send(request)
File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 278, in send
raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/frankfurt/by-value/sha256/635bb4e87ebe1d16342ae567baad9f70b4f33d2c12d39b754d1eb11fa62709c5"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 169832270Andrea Censi PredictorLast aido2-PREDstep1-simulation error no nutonomy-P50-58492019-04-05 08:04:00+00:00 2019-04-05 08:04:40+00:00 0:00:40 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 169762271Andrea Censi PredictorLast aido2-PREDstep1-simulation error no nutonomy-P50-58492019-04-05 08:02:13+00:00 2019-04-05 08:03:24+00:00 0:01:11 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
