Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 219313356Anastasiya Nikolskaya JetBrains Research aido2-LF-sim-validationstep1-simulation host-error no ip-172-31-25-98-20622019-05-13 12:49:02+00:00 2019-05-13 13:00:50+00:00 0:11:48 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3356/step1-simulation-ip-172-31-25-98-2062-job21931/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 219053341Anastasiya Nikolskaya JetBrains Research aido2-LF-sim-testingstep1-simulation success no ip-172-31-25-98-20622019-05-12 18:01:19+00:00 2019-05-12 18:41:09+00:00 0:39:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.4184493791460033 survival_time_median 14.950000000000076 deviation-center-line_median 1.0885634500836905 in-drivable-lane_median 1.399999999999995
other stats agent_compute-ego_max 0.05925849676132202 agent_compute-ego_mean 0.057431989972976806 agent_compute-ego_median 0.057378512223561606 agent_compute-ego_min 0.056222860966253715 deviation-center-line_max 1.258056651968496 deviation-center-line_mean 1.060594147194918 deviation-center-line_min 0.7603724917132071 deviation-heading_max 3.3937657806659938 deviation-heading_mean 2.195568980757138 deviation-heading_median 2.246010604647032 deviation-heading_min 0.9250753493114474 driven_any_max 2.8204323526121393 driven_any_mean 2.5119827627382616 driven_any_median 2.5762647718963128 driven_any_min 1.5293119443429843 driven_lanedir_consec_max 2.677259817183217 driven_lanedir_consec_mean 2.315795919314287 driven_lanedir_consec_min 1.5160686092999205 driven_lanedir_max 2.677259817183217 driven_lanedir_mean 2.315795919314287 driven_lanedir_median 2.4184493791460033 driven_lanedir_min 1.5160686092999205 in-drivable-lane_max 3.6000000000000227 in-drivable-lane_mean 1.1966666666666734 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5311207423112205, "sim_physics": 0.06405565102895101, "survival_time": 14.950000000000076, "driven_lanedir": 2.4184493791460033, "sim_render-ego": 0.03913875977198283, "in-drivable-lane": 0, "agent_compute-ego": 0.05925849676132202, "deviation-heading": 3.3937657806659938, "set_robot_commands": 0.07694664637247721, "deviation-center-line": 0.8874718715795886, "driven_lanedir_consec": 2.4184493791460033, "sim_compute_sim_state": 0.027534218629201253, "sim_compute_performance-ego": 0.042686654726664226, "sim_compute_robot_state-ego": 0.044949015776316326}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.750388671053299, "sim_physics": 0.06161526123682658, "survival_time": 14.950000000000076, "driven_lanedir": 2.5145705318390714, "sim_render-ego": 0.03855772574742635, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.05697928905487061, "deviation-heading": 2.7415380381811096, "set_robot_commands": 0.07674668073654174, "deviation-center-line": 1.2483455804254455, "driven_lanedir_consec": 2.5145705318390714, "sim_compute_sim_state": 0.027057904402414956, "sim_compute_performance-ego": 0.042969160079956055, "sim_compute_robot_state-ego": 0.044852394262949624}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.8204323526121393, "sim_physics": 0.06420472860336304, "survival_time": 14.950000000000076, "driven_lanedir": 2.478337264307139, "sim_render-ego": 0.0387724224726359, "in-drivable-lane": 2.200000000000002, "agent_compute-ego": 0.05782966216405232, "deviation-heading": 1.911548959229024, "set_robot_commands": 0.07602493762969971, "deviation-center-line": 1.2074729369336985, "driven_lanedir_consec": 2.478337264307139, "sim_compute_sim_state": 0.02670629898707072, "sim_compute_performance-ego": 0.042853660583496093, "sim_compute_robot_state-ego": 0.04488591194152832}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.7168279268905144, "sim_physics": 0.06423843383789063, "survival_time": 14.950000000000076, "driven_lanedir": 2.677259817183217, "sim_render-ego": 0.03899505376815795, "in-drivable-lane": 0, "agent_compute-ego": 0.0568373425801595, "deviation-heading": 2.246010604647032, "set_robot_commands": 0.07706479549407959, "deviation-center-line": 1.048547607009955, "driven_lanedir_consec": 2.677259817183217, "sim_compute_sim_state": 0.02698676188786825, "sim_compute_performance-ego": 0.04242449363072713, "sim_compute_robot_state-ego": 0.045926675001780194}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.64247901934343, "sim_physics": 0.06348868767420451, "survival_time": 14.950000000000076, "driven_lanedir": 2.5877777668146145, "sim_render-ego": 0.038665521144866946, "in-drivable-lane": 0, "agent_compute-ego": 0.057996073563893635, "deviation-heading": 2.476878363960583, "set_robot_commands": 0.07649519284566243, "deviation-center-line": 0.8641893794914015, "driven_lanedir_consec": 2.5877777668146145, "sim_compute_sim_state": 0.027272592385609945, "sim_compute_performance-ego": 0.042389075756073, "sim_compute_robot_state-ego": 0.044899866580963135}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.5608215914592733, "sim_physics": 0.06388584454854329, "survival_time": 14.950000000000076, "driven_lanedir": 2.107387775601186, "sim_render-ego": 0.03843916893005371, "in-drivable-lane": 3.0500000000000176, "agent_compute-ego": 0.05815852244695028, "deviation-heading": 2.064333083863953, "set_robot_commands": 0.07619952996571859, "deviation-center-line": 1.230832400616888, "driven_lanedir_consec": 2.107387775601186, "sim_compute_sim_state": 0.026922159989674885, "sim_compute_performance-ego": 0.0426509698232015, "sim_compute_robot_state-ego": 0.04469046592712402}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.5304846119634883, "sim_physics": 0.0626510246594747, "survival_time": 14.950000000000076, "driven_lanedir": 2.277817079549874, "sim_render-ego": 0.038988157113393145, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.057378512223561606, "deviation-heading": 2.347109605663902, "set_robot_commands": 0.07678000529607137, "deviation-center-line": 0.9017522368093984, "driven_lanedir_consec": 2.277817079549874, "sim_compute_sim_state": 0.02730545202891032, "sim_compute_performance-ego": 0.042010350227355955, "sim_compute_robot_state-ego": 0.04473313252131144}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.4150775429969835, "sim_physics": 0.06683398644129435, "survival_time": 14.950000000000076, "driven_lanedir": 1.9266443761931071, "sim_render-ego": 0.03840953906377157, "in-drivable-lane": 3.6000000000000227, "agent_compute-ego": 0.057627716064453126, "deviation-heading": 2.685355603791812, "set_robot_commands": 0.07572506030400594, "deviation-center-line": 0.988132601934918, "driven_lanedir_consec": 1.9266443761931071, "sim_compute_sim_state": 0.026829315026601155, "sim_compute_performance-ego": 0.042267560958862305, "sim_compute_robot_state-ego": 0.04478601694107056}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.112649623491631, "sim_physics": 0.05853880873513878, "survival_time": 10.90000000000002, "driven_lanedir": 2.086479421746815, "sim_render-ego": 0.03825513047909518, "in-drivable-lane": 0, "agent_compute-ego": 0.056222860966253715, "deviation-heading": 1.467795602025786, "set_robot_commands": 0.07563149710313989, "deviation-center-line": 1.017506725303344, "driven_lanedir_consec": 2.086479421746815, "sim_compute_sim_state": 0.02732265104941272, "sim_compute_performance-ego": 0.04170981787760323, "sim_compute_robot_state-ego": 0.0446304181300172}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.661020053223105, "sim_physics": 0.06034913301467895, "survival_time": 14.950000000000076, "driven_lanedir": 2.455232754137843, "sim_render-ego": 0.03867393096288045, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.05778789202372233, "deviation-heading": 2.0987234177631993, "set_robot_commands": 0.07494889974594116, "deviation-center-line": 1.1833134461295325, "driven_lanedir_consec": 2.455232754137843, "sim_compute_sim_state": 0.02705936988194783, "sim_compute_performance-ego": 0.04205065488815308, "sim_compute_robot_state-ego": 0.04476017316182455}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.691611787307272, "sim_physics": 0.05869333028793335, "survival_time": 14.950000000000076, "driven_lanedir": 2.4988977580617124, "sim_render-ego": 0.038131832281748455, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.05705501635869344, "deviation-heading": 1.905000180624984, "set_robot_commands": 0.07565058946609497, "deviation-center-line": 1.0885634500836905, "driven_lanedir_consec": 2.4988977580617124, "sim_compute_sim_state": 0.026887242794036863, "sim_compute_performance-ego": 0.042001758416493735, "sim_compute_robot_state-ego": 0.04468725045522054}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.5762647718963128, "sim_physics": 0.06412772337595622, "survival_time": 14.950000000000076, "driven_lanedir": 2.26172104269037, "sim_render-ego": 0.03855889240900675, "in-drivable-lane": 1.9000000000000243, "agent_compute-ego": 0.05851278305053711, "deviation-heading": 2.4597914185892633, "set_robot_commands": 0.07591785192489624, "deviation-center-line": 1.1203431064520537, "driven_lanedir_consec": 2.26172104269037, "sim_compute_sim_state": 0.027255301475524903, "sim_compute_performance-ego": 0.04213455597559611, "sim_compute_robot_state-ego": 0.04467230161031088}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.77892219505102, "sim_physics": 0.05963308334350586, "survival_time": 14.950000000000076, "driven_lanedir": 2.601735958236963, "sim_render-ego": 0.03832751353581747, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.05666497945785522, "deviation-heading": 2.6346160490733075, "set_robot_commands": 0.07537641127904256, "deviation-center-line": 1.258056651968496, "driven_lanedir_consec": 2.601735958236963, "sim_compute_sim_state": 0.02668064594268799, "sim_compute_performance-ego": 0.04224706490834554, "sim_compute_robot_state-ego": 0.04446322043736776}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.362328607131257, "sim_physics": 0.06142310816872569, "survival_time": 11.950000000000037, "driven_lanedir": 2.3285592549064695, "sim_render-ego": 0.038284714750665, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.05623427594555971, "deviation-heading": 1.5759926539656763, "set_robot_commands": 0.07713684876094802, "deviation-center-line": 1.1040117214721523, "driven_lanedir_consec": 2.3285592549064695, "sim_compute_sim_state": 0.026803503475428623, "sim_compute_performance-ego": 0.04200462816150617, "sim_compute_robot_state-ego": 0.04421513250183361}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.5293119443429843, "sim_physics": 0.06371324402945382, "survival_time": 8.04999999999998, "driven_lanedir": 1.5160686092999205, "sim_render-ego": 0.038487817930138626, "in-drivable-lane": 0, "agent_compute-ego": 0.05693642693276731, "deviation-heading": 0.9250753493114474, "set_robot_commands": 0.07446333488322193, "deviation-center-line": 0.7603724917132071, "driven_lanedir_consec": 1.5160686092999205, "sim_compute_sim_state": 0.027418027012984944, "sim_compute_performance-ego": 0.04212120601109096, "sim_compute_robot_state-ego": 0.044875713609020165}}set_robot_commands_max 0.07713684876094802 set_robot_commands_mean 0.07607388545383609 set_robot_commands_median 0.07602493762969971 set_robot_commands_min 0.07446333488322193 sim_compute_performance-ego_max 0.042969160079956055 sim_compute_performance-ego_mean 0.042301440801675 sim_compute_performance-ego_median 0.04224706490834554 sim_compute_performance-ego_min 0.04170981787760323 sim_compute_robot_state-ego_max 0.045926675001780194 sim_compute_robot_state-ego_mean 0.04480184592390923 sim_compute_robot_state-ego_median 0.04476017316182455 sim_compute_robot_state-ego_min 0.04421513250183361 sim_compute_sim_state_max 0.027534218629201253 sim_compute_sim_state_mean 0.027069429664625024 sim_compute_sim_state_median 0.027057904402414956 sim_compute_sim_state_min 0.02668064594268799 sim_physics_max 0.06683398644129435 sim_physics_mean 0.06249680326572938 sim_physics_median 0.06348868767420451 sim_physics_min 0.05853880873513878 sim_render-ego_max 0.03913875977198283 sim_render-ego_mean 0.03857907869077602 sim_render-ego_median 0.03855772574742635 sim_render-ego_min 0.038131832281748455 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.020000000000064 survival_time_min 8.04999999999998
No reset possible 218993342Anastasiya Nikolskaya JetBrains Research aido2-LF-sim-validationstep1-simulation success no ip-172-31-25-98-20622019-05-12 17:35:00+00:00 2019-05-12 17:50:49+00:00 0:15:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.5904177726870414 survival_time_median 14.950000000000076 deviation-center-line_median 0.9598279900815052 in-drivable-lane_median 0.7999999999999972
other stats agent_compute-ego_max 0.05864317019780477 agent_compute-ego_mean 0.05741784985860189 agent_compute-ego_median 0.05719944397608439 agent_compute-ego_min 0.05658427715301514 deviation-center-line_max 1.25665146486598 deviation-center-line_mean 1.020439929940885 deviation-center-line_min 0.8405036566263417 deviation-heading_max 2.91939955261839 deviation-heading_mean 2.4565805545580703 deviation-heading_median 2.516985603474602 deviation-heading_min 2.07164407751621 driven_any_max 2.8728962331979986 driven_any_mean 2.712983828417254 driven_any_median 2.695150877968261 driven_any_min 2.5681853380402258 driven_lanedir_consec_max 2.649735791051815 driven_lanedir_consec_mean 2.528092902848954 driven_lanedir_consec_min 2.2258610730257415 driven_lanedir_max 2.649735791051815 driven_lanedir_mean 2.528092902848954 driven_lanedir_median 2.5904177726870414 driven_lanedir_min 2.2258610730257415 in-drivable-lane_max 2.05 in-drivable-lane_mean 0.9300000000000044 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5681853380402258, "sim_physics": 0.06312215805053711, "survival_time": 14.950000000000076, "driven_lanedir": 2.2258610730257415, "sim_render-ego": 0.039488210678100585, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.05864317019780477, "deviation-heading": 2.91939955261839, "set_robot_commands": 0.07609338442484538, "deviation-center-line": 0.8405036566263417, "driven_lanedir_consec": 2.2258610730257415, "sim_compute_sim_state": 0.027352038224538168, "sim_compute_performance-ego": 0.04337710301081339, "sim_compute_robot_state-ego": 0.0456618070602417}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7897444297519547, "sim_physics": 0.06231427669525146, "survival_time": 14.950000000000076, "driven_lanedir": 2.642023982826482, "sim_render-ego": 0.038668870131174725, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.05658427715301514, "deviation-heading": 2.6656775041906005, "set_robot_commands": 0.07591223398844402, "deviation-center-line": 1.25665146486598, "driven_lanedir_consec": 2.642023982826482, "sim_compute_sim_state": 0.027146731217702228, "sim_compute_performance-ego": 0.043126122156778975, "sim_compute_robot_state-ego": 0.045628286997477216}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.8728962331979986, "sim_physics": 0.06337115526199341, "survival_time": 14.950000000000076, "driven_lanedir": 2.5324258946536906, "sim_render-ego": 0.03930384874343872, "in-drivable-lane": 2.05, "agent_compute-ego": 0.05786890029907227, "deviation-heading": 2.1091960349905485, "set_robot_commands": 0.07558017174402873, "deviation-center-line": 1.1774235855961184, "driven_lanedir_consec": 2.5324258946536906, "sim_compute_sim_state": 0.026950047810872395, "sim_compute_performance-ego": 0.043392256895701094, "sim_compute_robot_state-ego": 0.04543720881144206}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.6389422631278294, "sim_physics": 0.06340885957082112, "survival_time": 14.950000000000076, "driven_lanedir": 2.5904177726870414, "sim_render-ego": 0.03913957595825195, "in-drivable-lane": 0, "agent_compute-ego": 0.05679345766703288, "deviation-heading": 2.516985603474602, "set_robot_commands": 0.07748787641525269, "deviation-center-line": 0.9598279900815052, "driven_lanedir_consec": 2.5904177726870414, "sim_compute_sim_state": 0.0271937894821167, "sim_compute_performance-ego": 0.043114014466603595, "sim_compute_robot_state-ego": 0.04553077379862468}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.695150877968261, "sim_physics": 0.06120834668477376, "survival_time": 14.950000000000076, "driven_lanedir": 2.649735791051815, "sim_render-ego": 0.03938365777333577, "in-drivable-lane": 0, "agent_compute-ego": 0.05719944397608439, "deviation-heading": 2.07164407751621, "set_robot_commands": 0.07580571571985881, "deviation-center-line": 0.8677929525344791, "driven_lanedir_consec": 2.649735791051815, "sim_compute_sim_state": 0.027814029852549237, "sim_compute_performance-ego": 0.04345343351364136, "sim_compute_robot_state-ego": 0.04590293010075887}}set_robot_commands_max 0.07748787641525269 set_robot_commands_mean 0.07617587645848593 set_robot_commands_median 0.07591223398844402 set_robot_commands_min 0.07558017174402873 sim_compute_performance-ego_max 0.04345343351364136 sim_compute_performance-ego_mean 0.04329258600870768 sim_compute_performance-ego_median 0.04337710301081339 sim_compute_performance-ego_min 0.043114014466603595 sim_compute_robot_state-ego_max 0.04590293010075887 sim_compute_robot_state-ego_mean 0.0456322013537089 sim_compute_robot_state-ego_median 0.045628286997477216 sim_compute_robot_state-ego_min 0.04543720881144206 sim_compute_sim_state_max 0.027814029852549237 sim_compute_sim_state_mean 0.027291327317555743 sim_compute_sim_state_median 0.0271937894821167 sim_compute_sim_state_min 0.026950047810872395 sim_physics_max 0.06340885957082112 sim_physics_mean 0.06268495925267538 sim_physics_median 0.06312215805053711 sim_physics_min 0.06120834668477376 sim_render-ego_max 0.039488210678100585 sim_render-ego_mean 0.03919683265686035 sim_render-ego_median 0.03930384874343872 sim_render-ego_min 0.038668870131174725 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 218873335FANG MEIYI test aido2-LFVI-sim-validationstep1-simulation success no ip-172-31-25-98-20622019-05-12 05:07:55+00:00 2019-05-12 05:27:38+00:00 0:19:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.9663281235442462 survival_time_median 14.950000000000076 deviation-center-line_median 0.577004968446948 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.09728449157306128 agent_compute-ego_mean 0.09585583813157748 agent_compute-ego_median 0.09560858273910264 agent_compute-ego_min 0.09510302623112996 deviation-center-line_max 0.6550116156319536 deviation-center-line_mean 0.5197352271802369 deviation-center-line_min 0.273645470871864 deviation-heading_max 2.1064812103812827 deviation-heading_mean 1.5833769109178726 deviation-heading_median 1.84044215459469 deviation-heading_min 0.3175286990248927 driven_any_max 3.1997084289589384 driven_any_mean 2.599624283341586 driven_any_median 3.111825832831373 driven_any_min 0.497926143634328 driven_lanedir_consec_max 3.167503458864505 driven_lanedir_consec_mean 2.511512031781106 driven_lanedir_consec_min 0.4938652964415699 driven_lanedir_max 3.167503458864505 driven_lanedir_mean 2.568887806015235 driven_lanedir_median 3.071829894300735 driven_lanedir_min 0.49388276088962657 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 2.9995631378596967, "sim_physics": 0.10582164367039998, "survival_time": 14.950000000000076, "driven_lanedir": 2.9663281235442462, "sim_render-ego": 0.03810035149256388, "in-drivable-lane": 0, "agent_compute-ego": 0.09511979897816976, "deviation-heading": 1.84044215459469, "set_robot_commands": 0.058348503112792965, "deviation-center-line": 0.6550116156319536, "driven_lanedir_consec": 2.9663281235442462, "sim_compute_sim_state": 0.023751972516377767, "sim_compute_performance-ego": 0.0428254230817159, "sim_compute_robot_state-ego": 0.04337860584259033, "sim_compute_robot_state-npc0": 0.04256333907445272, "sim_compute_robot_state-npc1": 0.04168317715326945, "sim_compute_robot_state-npc2": 0.04148910840352376, "sim_compute_robot_state-npc3": 0.0415783437093099}, "udem1-1-0": {"driven_any": 3.111825832831373, "sim_physics": 0.10473116211971994, "survival_time": 14.750000000000076, "driven_lanedir": 3.071829894300735, "sim_render-ego": 0.03824914107888432, "in-drivable-lane": 0, "agent_compute-ego": 0.09560858273910264, "deviation-heading": 2.1064812103812827, "set_robot_commands": 0.05804220215748932, "deviation-center-line": 0.607142788543613, "driven_lanedir_consec": 3.071829894300735, "sim_compute_sim_state": 0.02351799496149613, "sim_compute_performance-ego": 0.04104933253789352, "sim_compute_robot_state-ego": 0.04369234473018323, "sim_compute_robot_state-npc0": 0.04279399483890857, "sim_compute_robot_state-npc1": 0.04158661890838106, "sim_compute_robot_state-npc2": 0.04165272470247947, "sim_compute_robot_state-npc3": 0.041455571126129666}, "udem1-2-0": {"driven_any": 0.497926143634328, "sim_physics": 0.12036579847335815, "survival_time": 2.799999999999998, "driven_lanedir": 0.49388276088962657, "sim_render-ego": 0.03914271507944379, "in-drivable-lane": 0, "agent_compute-ego": 0.09728449157306128, "deviation-heading": 0.3175286990248927, "set_robot_commands": 0.05785209366253445, "deviation-center-line": 0.273645470871864, "driven_lanedir_consec": 0.4938652964415699, "sim_compute_sim_state": 0.02379863602774484, "sim_compute_performance-ego": 0.04174538595335824, "sim_compute_robot_state-ego": 0.04352922098977225, "sim_compute_robot_state-npc0": 0.044275441340037754, "sim_compute_robot_state-npc1": 0.041349858045578, "sim_compute_robot_state-npc2": 0.042458921670913696, "sim_compute_robot_state-npc3": 0.041284718683787754}, "udem1-3-0": {"driven_any": 3.1997084289589384, "sim_physics": 0.10974175453186036, "survival_time": 14.950000000000076, "driven_lanedir": 3.167503458864505, "sim_render-ego": 0.038094565868377686, "in-drivable-lane": 0, "agent_compute-ego": 0.09510302623112996, "deviation-heading": 1.7450085930000083, "set_robot_commands": 0.05806198040644328, "deviation-center-line": 0.4858712924068058, "driven_lanedir_consec": 3.167503458864505, "sim_compute_sim_state": 0.023662617206573488, "sim_compute_performance-ego": 0.04142019987106323, "sim_compute_robot_state-ego": 0.04317802349726359, "sim_compute_robot_state-npc0": 0.04357483784357707, "sim_compute_robot_state-npc1": 0.041709442933400474, "sim_compute_robot_state-npc2": 0.04218292474746704, "sim_compute_robot_state-npc3": 0.04141570568084717}, "udem1-4-0": {"driven_any": 3.189097873423596, "sim_physics": 0.10930086374282837, "survival_time": 14.950000000000076, "driven_lanedir": 3.1448947924770625, "sim_render-ego": 0.03832198619842529, "in-drivable-lane": 0, "agent_compute-ego": 0.09616329113642376, "deviation-heading": 1.9074238975884883, "set_robot_commands": 0.0596071982383728, "deviation-center-line": 0.577004968446948, "driven_lanedir_consec": 2.8580333857544726, "sim_compute_sim_state": 0.023855759302775063, "sim_compute_performance-ego": 0.041576627095540365, "sim_compute_robot_state-ego": 0.04350931882858276, "sim_compute_robot_state-npc0": 0.04300378640492757, "sim_compute_robot_state-npc1": 0.041840935548146566, "sim_compute_robot_state-npc2": 0.04200015862782796, "sim_compute_robot_state-npc3": 0.0413789439201355}}set_robot_commands_max 0.0596071982383728 set_robot_commands_mean 0.05838239551552656 set_robot_commands_median 0.05806198040644328 set_robot_commands_min 0.05785209366253445 sim_compute_performance-ego_max 0.0428254230817159 sim_compute_performance-ego_mean 0.04172339370791425 sim_compute_performance-ego_median 0.041576627095540365 sim_compute_performance-ego_min 0.04104933253789352 sim_compute_robot_state-ego_max 0.04369234473018323 sim_compute_robot_state-ego_mean 0.04345750277767844 sim_compute_robot_state-ego_median 0.04350931882858276 sim_compute_robot_state-ego_min 0.04317802349726359 sim_compute_robot_state-npc0_max 0.044275441340037754 sim_compute_robot_state-npc0_mean 0.04324227990038074 sim_compute_robot_state-npc0_median 0.04300378640492757 sim_compute_robot_state-npc0_min 0.04256333907445272 sim_compute_robot_state-npc1_max 0.041840935548146566 sim_compute_robot_state-npc1_mean 0.041634006517755104 sim_compute_robot_state-npc1_median 0.04168317715326945 sim_compute_robot_state-npc1_min 0.041349858045578 sim_compute_robot_state-npc2_max 0.042458921670913696 sim_compute_robot_state-npc2_mean 0.041956767630442385 sim_compute_robot_state-npc2_median 0.04200015862782796 sim_compute_robot_state-npc2_min 0.04148910840352376 sim_compute_robot_state-npc3_max 0.0415783437093099 sim_compute_robot_state-npc3_mean 0.041422656624041994 sim_compute_robot_state-npc3_median 0.04141570568084717 sim_compute_robot_state-npc3_min 0.041284718683787754 sim_compute_sim_state_max 0.023855759302775063 sim_compute_sim_state_mean 0.023717396002993454 sim_compute_sim_state_median 0.023751972516377767 sim_compute_sim_state_min 0.02351799496149613 sim_physics_max 0.12036579847335815 sim_physics_mean 0.10999224450763335 sim_physics_median 0.10930086374282837 sim_physics_min 0.10473116211971994 sim_render-ego_max 0.03914271507944379 sim_render-ego_mean 0.038381751943539 sim_render-ego_median 0.03824914107888432 sim_render-ego_min 0.038094565868377686 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.48000000000006 survival_time_min 2.799999999999998
No reset possible 218663327jiang peng RL - TH -xyz aido2-LFV-sim-validationstep1-simulation success no ip-172-31-25-98-20622019-05-10 09:35:44+00:00 2019-05-10 09:43:45+00:00 0:08:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2034459983602903 survival_time_median 4.149999999999993 deviation-center-line_median 0.1669855358500796 in-drivable-lane_median 0.9999999999999964
other stats agent_compute-ego_max 0.11306980940011832 agent_compute-ego_mean 0.10443817211108526 agent_compute-ego_median 0.10208100295928588 agent_compute-ego_min 0.10141862113520785 deviation-center-line_max 0.3522563724245253 deviation-center-line_mean 0.2158316150872442 deviation-center-line_min 0.13009707342581733 deviation-heading_max 1.6626863723845684 deviation-heading_mean 0.8874847965799916 deviation-heading_median 0.8845721124160403 deviation-heading_min 0.35573407566087445 driven_any_max 2.4220097298248255 driven_any_mean 1.41611248442283 driven_any_median 1.5958959348544497 driven_any_min 0.4121781461681715 driven_lanedir_consec_max 1.5628740999049069 driven_lanedir_consec_mean 1.0115418245837444 driven_lanedir_consec_min 0.3794658003807676 driven_lanedir_max 1.5628740999049069 driven_lanedir_mean 1.0115418245837444 driven_lanedir_median 1.2034459983602903 driven_lanedir_min 0.3794658003807676 in-drivable-lane_max 1.649999999999994 in-drivable-lane_mean 0.9299999999999968 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996027496494454, "sim_physics": 0.09114277362823486, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6592109688315073, "sim_render-ego": 0.03781631359687218, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.11306980940011832, "deviation-heading": 0.35573407566087445, "set_robot_commands": 0.05763886525080754, "deviation-center-line": 0.138275341989072, "driven_lanedir_consec": 0.6592109688315073, "sim_compute_sim_state": 0.023655157822829027, "sim_compute_performance-ego": 0.04172434715124277, "sim_compute_robot_state-ego": 0.04337947185222919, "sim_compute_robot_state-npc0": 0.04211309781441322, "sim_compute_robot_state-npc1": 0.0414194052035992, "sim_compute_robot_state-npc2": 0.041565968440129206, "sim_compute_robot_state-npc3": 0.04200222400518564}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4121781461681715, "sim_physics": 0.10283514209415602, "survival_time": 2.3, "driven_lanedir": 0.3794658003807676, "sim_render-ego": 0.03864543334297512, "in-drivable-lane": 0, "agent_compute-ego": 0.10202207254326862, "deviation-heading": 0.8845721124160403, "set_robot_commands": 0.057303122852159584, "deviation-center-line": 0.1669855358500796, "driven_lanedir_consec": 0.3794658003807676, "sim_compute_sim_state": 0.02405424221702244, "sim_compute_performance-ego": 0.04105900163235872, "sim_compute_robot_state-ego": 0.04409929980402407, "sim_compute_robot_state-npc0": 0.0458721751752107, "sim_compute_robot_state-npc1": 0.04218767000281293, "sim_compute_robot_state-npc2": 0.04159169093422268, "sim_compute_robot_state-npc3": 0.042039187058158546}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5958959348544497, "sim_physics": 0.10573703122426228, "survival_time": 4.149999999999993, "driven_lanedir": 1.2034459983602903, "sim_render-ego": 0.03789669921599239, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.10208100295928588, "deviation-heading": 0.5509106153652875, "set_robot_commands": 0.05751572459577078, "deviation-center-line": 0.13009707342581733, "driven_lanedir_consec": 1.2034459983602903, "sim_compute_sim_state": 0.02353363439261195, "sim_compute_performance-ego": 0.04079152302569654, "sim_compute_robot_state-ego": 0.04335525524185365, "sim_compute_robot_state-npc0": 0.04365239373172622, "sim_compute_robot_state-npc1": 0.041366226701851354, "sim_compute_robot_state-npc2": 0.042352894702589655, "sim_compute_robot_state-npc3": 0.04130129354545869}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6508758616172574, "sim_physics": 0.09416819293543978, "survival_time": 5.299999999999989, "driven_lanedir": 1.2527122554412504, "sim_render-ego": 0.03798163387010682, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.10141862113520785, "deviation-heading": 0.9835208070731868, "set_robot_commands": 0.05717122554779053, "deviation-center-line": 0.3522563724245253, "driven_lanedir_consec": 1.2527122554412504, "sim_compute_sim_state": 0.023492293537787673, "sim_compute_performance-ego": 0.04119426124500779, "sim_compute_robot_state-ego": 0.043343883640361285, "sim_compute_robot_state-npc0": 0.04211876752241602, "sim_compute_robot_state-npc1": 0.041665956659137075, "sim_compute_robot_state-npc2": 0.04144694220344975, "sim_compute_robot_state-npc3": 0.04147663431347541}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.4220097298248255, "sim_physics": 0.09313236895225031, "survival_time": 6.949999999999983, "driven_lanedir": 1.5628740999049069, "sim_render-ego": 0.03806969930799745, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.10359935451754564, "deviation-heading": 1.6626863723845684, "set_robot_commands": 0.05714320107329664, "deviation-center-line": 0.2915437517467268, "driven_lanedir_consec": 1.5628740999049069, "sim_compute_sim_state": 0.023852902350665853, "sim_compute_performance-ego": 0.040907072506362586, "sim_compute_robot_state-ego": 0.043385848724584786, "sim_compute_robot_state-npc0": 0.04306096824810659, "sim_compute_robot_state-npc1": 0.04185081214355907, "sim_compute_robot_state-npc2": 0.04156431362783308, "sim_compute_robot_state-npc3": 0.04167143732523747}}set_robot_commands_max 0.05763886525080754 set_robot_commands_mean 0.05735442786396502 set_robot_commands_median 0.057303122852159584 set_robot_commands_min 0.05714320107329664 sim_compute_performance-ego_max 0.04172434715124277 sim_compute_performance-ego_mean 0.04113524111213368 sim_compute_performance-ego_median 0.04105900163235872 sim_compute_performance-ego_min 0.04079152302569654 sim_compute_robot_state-ego_max 0.04409929980402407 sim_compute_robot_state-ego_mean 0.04351275185261059 sim_compute_robot_state-ego_median 0.04337947185222919 sim_compute_robot_state-ego_min 0.043343883640361285 sim_compute_robot_state-npc0_max 0.0458721751752107 sim_compute_robot_state-npc0_mean 0.04336348049837455 sim_compute_robot_state-npc0_median 0.04306096824810659 sim_compute_robot_state-npc0_min 0.04211309781441322 sim_compute_robot_state-npc1_max 0.04218767000281293 sim_compute_robot_state-npc1_mean 0.04169801414219192 sim_compute_robot_state-npc1_median 0.041665956659137075 sim_compute_robot_state-npc1_min 0.041366226701851354 sim_compute_robot_state-npc2_max 0.042352894702589655 sim_compute_robot_state-npc2_mean 0.04170436198164487 sim_compute_robot_state-npc2_median 0.041565968440129206 sim_compute_robot_state-npc2_min 0.04144694220344975 sim_compute_robot_state-npc3_max 0.042039187058158546 sim_compute_robot_state-npc3_mean 0.041698155249503155 sim_compute_robot_state-npc3_median 0.04167143732523747 sim_compute_robot_state-npc3_min 0.04130129354545869 sim_compute_sim_state_max 0.02405424221702244 sim_compute_sim_state_mean 0.02371764606418339 sim_compute_sim_state_median 0.023655157822829027 sim_compute_sim_state_min 0.023492293537787673 sim_physics_max 0.10573703122426228 sim_physics_mean 0.09740310176686864 sim_physics_median 0.09416819293543978 sim_physics_min 0.09114277362823486 sim_render-ego_max 0.03864543334297512 sim_render-ego_mean 0.038081955866788794 sim_render-ego_median 0.03798163387010682 sim_render-ego_min 0.03781631359687218 simulation-passed 1 survival_time_max 6.949999999999983 survival_time_mean 4.259999999999993 survival_time_min 2.3
No reset possible 218373307Artem Ioselevskii SSegm aido2-LF-sim-validationstep1-simulation success no ip-172-31-25-98-20622019-05-08 17:30:05+00:00 2019-05-08 17:40:02+00:00 0:09:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7805432829802932 survival_time_median 4.6499999999999915 deviation-center-line_median 0.3342210273755456 in-drivable-lane_median 0.849999999999997
other stats agent_compute-ego_max 0.06561062892278036 agent_compute-ego_mean 0.06212012342033213 agent_compute-ego_median 0.06100318508763467 agent_compute-ego_min 0.05958088054213413 deviation-center-line_max 1.319573689618315 deviation-center-line_mean 0.680137738291656 deviation-center-line_min 0.23701677930208 deviation-heading_max 3.741264030231616 deviation-heading_mean 1.7077046776834528 deviation-heading_median 1.2211994646725657 deviation-heading_min 0.31984358422325665 driven_any_max 3.5747463922343186 driven_any_mean 1.882400612092831 driven_any_median 1.055616269008401 driven_any_min 0.44418805003269846 driven_lanedir_consec_max 2.9489354110097836 driven_lanedir_consec_mean 1.5201888437485196 driven_lanedir_consec_min 0.4395796661878779 driven_lanedir_max 2.9489354110097836 driven_lanedir_mean 1.5201888437485196 driven_lanedir_median 0.7805432829802932 driven_lanedir_min 0.4395796661878779 in-drivable-lane_max 2.8000000000000353 in-drivable-lane_mean 1.1600000000000126 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.5630787092439244, "sim_physics": 0.06064529895782471, "survival_time": 14.950000000000076, "driven_lanedir": 2.673911097659306, "sim_render-ego": 0.03989142656326294, "in-drivable-lane": 2.8000000000000353, "agent_compute-ego": 0.06561062892278036, "deviation-heading": 3.741264030231616, "set_robot_commands": 0.06049663782119751, "deviation-center-line": 1.1902079598942097, "driven_lanedir_consec": 2.673911097659306, "sim_compute_sim_state": 0.02604145129521688, "sim_compute_performance-ego": 0.04321078300476074, "sim_compute_robot_state-ego": 0.04595970869064331}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.055616269008401, "sim_physics": 0.06432020279668993, "survival_time": 4.6499999999999915, "driven_lanedir": 0.7805432829802932, "sim_render-ego": 0.03902654237644647, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06100318508763467, "deviation-heading": 1.2211994646725657, "set_robot_commands": 0.06030099622664913, "deviation-center-line": 0.3342210273755456, "driven_lanedir_consec": 0.7805432829802932, "sim_compute_sim_state": 0.026353069531020297, "sim_compute_performance-ego": 0.04352915927927981, "sim_compute_robot_state-ego": 0.046419410295383906}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.44418805003269846, "sim_physics": 0.06552476661149846, "survival_time": 2.1500000000000004, "driven_lanedir": 0.4395796661878779, "sim_render-ego": 0.03884773476179256, "in-drivable-lane": 0, "agent_compute-ego": 0.05958088054213413, "deviation-heading": 0.31984358422325665, "set_robot_commands": 0.0607616291489712, "deviation-center-line": 0.23701677930208, "driven_lanedir_consec": 0.4395796661878779, "sim_compute_sim_state": 0.025409376898477245, "sim_compute_performance-ego": 0.044578374818313955, "sim_compute_robot_state-ego": 0.04553168873454249}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7743736399448127, "sim_physics": 0.06765007291521345, "survival_time": 3.4999999999999956, "driven_lanedir": 0.7579747609053373, "sim_render-ego": 0.0393472501209804, "in-drivable-lane": 0, "agent_compute-ego": 0.05997825350080218, "deviation-heading": 0.644721758371069, "set_robot_commands": 0.061805524144853866, "deviation-center-line": 0.31966923526812996, "driven_lanedir_consec": 0.7579747609053373, "sim_compute_sim_state": 0.02566570213862828, "sim_compute_performance-ego": 0.043502402305603025, "sim_compute_robot_state-ego": 0.04496071338653564}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5747463922343186, "sim_physics": 0.06101120789845785, "survival_time": 14.950000000000076, "driven_lanedir": 2.9489354110097836, "sim_render-ego": 0.03956197102864583, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.06442766904830932, "deviation-heading": 2.6114945509187573, "set_robot_commands": 0.06070207198460897, "deviation-center-line": 1.319573689618315, "driven_lanedir_consec": 2.9489354110097836, "sim_compute_sim_state": 0.026213467121124268, "sim_compute_performance-ego": 0.043592080275217694, "sim_compute_robot_state-ego": 0.04608122189839681}}set_robot_commands_max 0.061805524144853866 set_robot_commands_mean 0.060813371865256136 set_robot_commands_median 0.06070207198460897 set_robot_commands_min 0.06030099622664913 sim_compute_performance-ego_max 0.044578374818313955 sim_compute_performance-ego_mean 0.04368255993663504 sim_compute_performance-ego_median 0.04352915927927981 sim_compute_performance-ego_min 0.04321078300476074 sim_compute_robot_state-ego_max 0.046419410295383906 sim_compute_robot_state-ego_mean 0.045790548601100434 sim_compute_robot_state-ego_median 0.04595970869064331 sim_compute_robot_state-ego_min 0.04496071338653564 sim_compute_sim_state_max 0.026353069531020297 sim_compute_sim_state_mean 0.02593661339689339 sim_compute_sim_state_median 0.02604145129521688 sim_compute_sim_state_min 0.025409376898477245 sim_physics_max 0.06765007291521345 sim_physics_mean 0.06383030983593688 sim_physics_median 0.06432020279668993 sim_physics_min 0.06064529895782471 sim_render-ego_max 0.03989142656326294 sim_render-ego_mean 0.03933498497022564 sim_render-ego_median 0.0393472501209804 sim_render-ego_min 0.03884773476179256 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.04000000000003 survival_time_min 2.1500000000000004
No reset possible 217662412jiang peng Baseline solution using reinforcement learning aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-25-98-20622019-05-07 21:33:16+00:00 2019-05-07 22:03:00+00:00 0:29:44 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2412/step1-simulation-ip-172-31-25-98-2062-job21766/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 217492443Jacopo Tani random_agent aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-25-98-20622019-05-07 21:00:26+00:00 2019-05-07 21:32:38+00:00 0:32:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6537162971975778 survival_time_median 2.5999999999999988 deviation-center-line_median 0.14884708769804722 in-drivable-lane_median 0.549999999999998
other stats agent_compute-ego_max 0.1783005457658034 agent_compute-ego_mean 0.16261081009688796 agent_compute-ego_median 0.1626794593674796 agent_compute-ego_min 0.1460905597323463 deviation-center-line_max 0.5141120095458062 deviation-center-line_mean 0.1769000227005324 deviation-center-line_min 0.06216029860587694 deviation-heading_max 1.9929437250081896 deviation-heading_mean 0.692977823395608 deviation-heading_median 0.4928440244444201 deviation-heading_min 0.24234723632033853 driven_any_max 3.5343244022418343 driven_any_mean 1.3470385992234175 driven_any_median 1.001633421251194 driven_any_min 0.3412551960104244 driven_lanedir_consec_max 2.494308053441959 driven_lanedir_consec_mean 0.881391085527715 driven_lanedir_consec_min 0.3199180625488627 driven_lanedir_max 2.494308053441959 driven_lanedir_mean 0.8962528018383226 driven_lanedir_median 0.7206363324756615 driven_lanedir_min 0.3199180625488627 in-drivable-lane_max 3.549999999999991 in-drivable-lane_mean 0.839999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.21688831908793388, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06374714042566999, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1642218179340604, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10497932796236836, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04007340081130402, "sim_compute_performance-ego": 0.07235157640674446, "sim_compute_robot_state-ego": 0.07577251482613478, "sim_compute_robot_state-npc0": 0.07102872450140459, "sim_compute_robot_state-npc1": 0.07094767425633684, "sim_compute_robot_state-npc2": 0.07719560816318174, "sim_compute_robot_state-npc3": 0.07181321216534965}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.22604916776929584, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06746373857770648, "in-drivable-lane": 0, "agent_compute-ego": 0.1626794593674796, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10110435315540858, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.040030556065695624, "sim_compute_performance-ego": 0.07302141189575195, "sim_compute_robot_state-ego": 0.07940068415233068, "sim_compute_robot_state-npc0": 0.07052844762802124, "sim_compute_robot_state-npc1": 0.0693618995802743, "sim_compute_robot_state-npc2": 0.07105978046144758, "sim_compute_robot_state-npc3": 0.06915497779846191}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.19339814232391064, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06353568799287371, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1619358363660794, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.1026610656849389, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.045740805783318086, "sim_compute_performance-ego": 0.07011419129603118, "sim_compute_robot_state-ego": 0.07386593216831244, "sim_compute_robot_state-npc0": 0.07279129861627967, "sim_compute_robot_state-npc1": 0.07025339071033071, "sim_compute_robot_state-npc2": 0.07013046394274072, "sim_compute_robot_state-npc3": 0.07081077862711786}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.22616026302178704, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.0664864977200826, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.16611949602762857, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10588018596172331, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.0418635755777359, "sim_compute_performance-ego": 0.07448413968086243, "sim_compute_robot_state-ego": 0.0762837181488673, "sim_compute_robot_state-npc0": 0.07314462959766388, "sim_compute_robot_state-npc1": 0.07480384906133015, "sim_compute_robot_state-npc2": 0.07316925625006358, "sim_compute_robot_state-npc3": 0.07534810900688171}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.25707504862830755, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06490181741260347, "in-drivable-lane": 0, "agent_compute-ego": 0.16849162465050108, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.11001751536414736, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04422042483375186, "sim_compute_performance-ego": 0.07765100115821474, "sim_compute_robot_state-ego": 0.09578415325709752, "sim_compute_robot_state-npc0": 0.07470574833097912, "sim_compute_robot_state-npc1": 0.07341723215012323, "sim_compute_robot_state-npc2": 0.07557862145560128, "sim_compute_robot_state-npc3": 0.07449992497762044}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.2084916394627737, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.0656481560118898, "in-drivable-lane": 2, "agent_compute-ego": 0.15994159047475118, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.10816261011683298, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03990200037013985, "sim_compute_performance-ego": 0.07182895780323509, "sim_compute_robot_state-ego": 0.07656330120063827, "sim_compute_robot_state-npc0": 0.07074155636176378, "sim_compute_robot_state-npc1": 0.07266990867203581, "sim_compute_robot_state-npc2": 0.07213950299931143, "sim_compute_robot_state-npc3": 0.07272896652450105}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.212204747987025, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06504894228814875, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16755893623944626, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.10537207705303304, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.04092672496166044, "sim_compute_performance-ego": 0.0744012258585217, "sim_compute_robot_state-ego": 0.07931439853408961, "sim_compute_robot_state-npc0": 0.07257124058251242, "sim_compute_robot_state-npc1": 0.07231979925655624, "sim_compute_robot_state-npc2": 0.07221277709146148, "sim_compute_robot_state-npc3": 0.07242140723663626}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.23509083747863768, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06327353477478027, "in-drivable-lane": 0, "agent_compute-ego": 0.16534206867218018, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.10604101657867432, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.049806156158447266, "sim_compute_performance-ego": 0.06952260494232178, "sim_compute_robot_state-ego": 0.08429139137268066, "sim_compute_robot_state-npc0": 0.07247295379638671, "sim_compute_robot_state-npc1": 0.07428298473358154, "sim_compute_robot_state-npc2": 0.07642702579498291, "sim_compute_robot_state-npc3": 0.07383137702941894}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.2327827581992516, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06889206629533035, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16836220026016235, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.10627867625309873, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04328537904299223, "sim_compute_performance-ego": 0.07756567001342773, "sim_compute_robot_state-ego": 0.08816137222143319, "sim_compute_robot_state-npc0": 0.07603585720062256, "sim_compute_robot_state-npc1": 0.07484065569364108, "sim_compute_robot_state-npc2": 0.0775244740339426, "sim_compute_robot_state-npc3": 0.07591802340287429}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2300620170739981, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06245333414811354, "in-drivable-lane": 0, "agent_compute-ego": 0.15232611619509184, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09402397045722374, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.03963956466087928, "sim_compute_performance-ego": 0.06725154473231389, "sim_compute_robot_state-ego": 0.07676340066469632, "sim_compute_robot_state-npc0": 0.06865690304682805, "sim_compute_robot_state-npc1": 0.06974718203911415, "sim_compute_robot_state-npc2": 0.06858374522282527, "sim_compute_robot_state-npc3": 0.07048583030700684}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.19647578759626907, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.062144561247392135, "in-drivable-lane": 0, "agent_compute-ego": 0.1545893278988925, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.0985971364107999, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.038511124524203216, "sim_compute_performance-ego": 0.06691752780567516, "sim_compute_robot_state-ego": 0.0722238150509921, "sim_compute_robot_state-npc0": 0.06823595003648238, "sim_compute_robot_state-npc1": 0.07284418019381436, "sim_compute_robot_state-npc2": 0.07201201265508478, "sim_compute_robot_state-npc3": 0.07340022650631992}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.19271177768707276, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06550714492797852, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16187222957611083, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.09949153423309326, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03849381923675537, "sim_compute_performance-ego": 0.06912216186523437, "sim_compute_robot_state-ego": 0.07739900588989258, "sim_compute_robot_state-npc0": 0.06967182636260986, "sim_compute_robot_state-npc1": 0.0689483642578125, "sim_compute_robot_state-npc2": 0.06861365795135498, "sim_compute_robot_state-npc3": 0.0686657953262329}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.20981981399211477, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.0609715923349908, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.16133034229278564, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.10587280100964486, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.041130687328095134, "sim_compute_performance-ego": 0.07063209249618206, "sim_compute_robot_state-ego": 0.07493764796155564, "sim_compute_robot_state-npc0": 0.07203661127293363, "sim_compute_robot_state-npc1": 0.07143402860519733, "sim_compute_robot_state-npc2": 0.07357875083355193, "sim_compute_robot_state-npc3": 0.06978017725843064}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.21586522230735192, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06829525874211238, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1783005457658034, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.10974522278859064, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.04114990050976093, "sim_compute_performance-ego": 0.07685244083404541, "sim_compute_robot_state-ego": 0.08714470955041739, "sim_compute_robot_state-npc0": 0.07672485021444467, "sim_compute_robot_state-npc1": 0.07364759536889884, "sim_compute_robot_state-npc2": 0.07374711678578304, "sim_compute_robot_state-npc3": 0.0740687892987178}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1827041398911249, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06063724018278576, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.1460905597323463, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.0927943751925514, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03680300712585449, "sim_compute_performance-ego": 0.06857289359683082, "sim_compute_robot_state-ego": 0.07154517627897716, "sim_compute_robot_state-npc0": 0.06676584652491978, "sim_compute_robot_state-npc1": 0.06429363886515299, "sim_compute_robot_state-npc2": 0.06575143223717099, "sim_compute_robot_state-npc3": 0.06471789223807199}}set_robot_commands_max 0.11001751536414736 set_robot_commands_mean 0.10340145788147528 set_robot_commands_median 0.10537207705303304 set_robot_commands_min 0.0927943751925514 sim_compute_performance-ego_max 0.07765100115821474 sim_compute_performance-ego_mean 0.07201929602569285 sim_compute_performance-ego_median 0.07182895780323509 sim_compute_performance-ego_min 0.06691752780567516 sim_compute_robot_state-ego_max 0.09578415325709752 sim_compute_robot_state-ego_mean 0.07929674808520772 sim_compute_robot_state-ego_median 0.07676340066469632 sim_compute_robot_state-ego_min 0.07154517627897716 sim_compute_robot_state-npc0_max 0.07672485021444467 sim_compute_robot_state-npc0_mean 0.07174082960492349 sim_compute_robot_state-npc0_median 0.07203661127293363 sim_compute_robot_state-npc0_min 0.06676584652491978 sim_compute_robot_state-npc1_max 0.07484065569364108 sim_compute_robot_state-npc1_mean 0.07158749222961333 sim_compute_robot_state-npc1_median 0.07231979925655624 sim_compute_robot_state-npc1_min 0.06429363886515299 sim_compute_robot_state-npc2_max 0.0775244740339426 sim_compute_robot_state-npc2_mean 0.0725149483919003 sim_compute_robot_state-npc2_median 0.07221277709146148 sim_compute_robot_state-npc2_min 0.06575143223717099 sim_compute_robot_state-npc3_max 0.07591802340287429 sim_compute_robot_state-npc3_mean 0.07184303251357615 sim_compute_robot_state-npc3_median 0.07242140723663626 sim_compute_robot_state-npc3_min 0.06471789223807199 sim_compute_sim_state_max 0.049806156158447266 sim_compute_sim_state_mean 0.04143847513270625 sim_compute_sim_state_median 0.04092672496166044 sim_compute_sim_state_min 0.03680300712585449 sim_physics_max 0.25707504862830755 sim_physics_mean 0.21571864550045697 sim_physics_median 0.21586522230735192 sim_physics_min 0.1827041398911249 sim_render-ego_max 0.06889206629533035 sim_render-ego_mean 0.06460044753883055 sim_render-ego_median 0.06490181741260347 sim_render-ego_min 0.06063724018278576 simulation-passed 1 survival_time_max 8.349999999999984 survival_time_mean 3.3333333333333286 survival_time_min 1.0500000000000005
No reset possible 217372907Julian Zilly Baseline-IL-logs-tensorflow aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-25-98-20622019-05-07 20:29:41+00:00 2019-05-07 21:00:12+00:00 0:30:31 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2907/step1-simulation-ip-172-31-25-98-2062-job21737/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 217192612Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-25-98-20622019-05-07 20:00:34+00:00 2019-05-07 20:29:32+00:00 0:28:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2875407694053156 survival_time_median 2.849999999999998 deviation-center-line_median 0.11031194850197353 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.07945816413215968 agent_compute-ego_mean 0.07527897336299309 agent_compute-ego_median 0.07608391109265779 agent_compute-ego_min 0.06800552776881627 deviation-center-line_max 0.2701922695523504 deviation-center-line_mean 0.13746050030700233 deviation-center-line_min 0.07113819587235681 deviation-heading_max 1.4854398920276677 deviation-heading_mean 0.7236995121312619 deviation-heading_median 0.6953408166028192 deviation-heading_min 0.3118646573709166 driven_any_max 1.934434121703833 driven_any_mean 0.806757806634148 driven_any_median 0.8072381933001392 driven_any_min 0.20912585880423715 driven_lanedir_consec_max 0.7222251056746308 driven_lanedir_consec_mean 0.3962831867516217 driven_lanedir_consec_min 0.1917983424483971 driven_lanedir_max 0.7287863177121016 driven_lanedir_mean 0.3975640776898326 driven_lanedir_median 0.2875407694053156 driven_lanedir_min 0.1917983424483971 in-drivable-lane_max 4.04999999999999 in-drivable-lane_mean 1.2133333333333305 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.20519852063742028, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06533134988991611, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07591890139752124, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.10392300479383354, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.040285366127289925, "sim_compute_performance-ego": 0.07085927997726992, "sim_compute_robot_state-ego": 0.07789485713085496, "sim_compute_robot_state-npc0": 0.07219857767403844, "sim_compute_robot_state-npc1": 0.07054089063621428, "sim_compute_robot_state-npc2": 0.07305823176740164, "sim_compute_robot_state-npc3": 0.07345758001488376}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.21168314086066353, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06728850470648871, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07648865381876628, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.10074105969181768, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.03930970474525734, "sim_compute_performance-ego": 0.06791018556665492, "sim_compute_robot_state-ego": 0.0783998171488444, "sim_compute_robot_state-npc0": 0.06829388936360677, "sim_compute_robot_state-npc1": 0.06936575748302319, "sim_compute_robot_state-npc2": 0.06663034580371997, "sim_compute_robot_state-npc3": 0.068370227460508}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.21578480647160456, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06391118734310834, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.0742884446413089, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.10003893803327513, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.040734544778481506, "sim_compute_performance-ego": 0.07015246305710231, "sim_compute_robot_state-ego": 0.07642423495268211, "sim_compute_robot_state-npc0": 0.07075052994948167, "sim_compute_robot_state-npc1": 0.07161099788470146, "sim_compute_robot_state-npc2": 0.07186274650769356, "sim_compute_robot_state-npc3": 0.06884910815801376}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.23080200479741683, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06843576933208265, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.07608391109265779, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.10799403776202283, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.04143244760078296, "sim_compute_performance-ego": 0.07408243313170317, "sim_compute_robot_state-ego": 0.08428722097162615, "sim_compute_robot_state-npc0": 0.0738579181202671, "sim_compute_robot_state-npc1": 0.07276125539813125, "sim_compute_robot_state-npc2": 0.07351173434341163, "sim_compute_robot_state-npc3": 0.07150290305154365}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.23160783104274585, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.0659245200779127, "in-drivable-lane": 0, "agent_compute-ego": 0.07945816413215968, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.10549341077389925, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.04024945134701936, "sim_compute_performance-ego": 0.07079901902571968, "sim_compute_robot_state-ego": 0.08347423180289891, "sim_compute_robot_state-npc0": 0.07750609646672788, "sim_compute_robot_state-npc1": 0.07496753982875658, "sim_compute_robot_state-npc2": 0.0734111329783564, "sim_compute_robot_state-npc3": 0.07353362829788872}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.2133178617440018, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06462622390073888, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07477049266590792, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.10171183417825136, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.03922875254761939, "sim_compute_performance-ego": 0.07303237915039062, "sim_compute_robot_state-ego": 0.07676691401238535, "sim_compute_robot_state-npc0": 0.07129920931423411, "sim_compute_robot_state-npc1": 0.07127153172212489, "sim_compute_robot_state-npc2": 0.06921068126080084, "sim_compute_robot_state-npc3": 0.07051966938317991}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.21528409889766148, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.06681782688413347, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07703856059483119, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.1078222155570984, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.04199171236583165, "sim_compute_performance-ego": 0.074808326789311, "sim_compute_robot_state-ego": 0.08217637198311942, "sim_compute_robot_state-npc0": 0.0762410044670105, "sim_compute_robot_state-npc1": 0.07497768912996565, "sim_compute_robot_state-npc2": 0.07407067503247942, "sim_compute_robot_state-npc3": 0.07371423074177333}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.22997767631321736, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06660658039458811, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07610059111085657, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10593370542134324, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.040306039052466824, "sim_compute_performance-ego": 0.07633386572746381, "sim_compute_robot_state-ego": 0.08692009481665207, "sim_compute_robot_state-npc0": 0.07203767397632338, "sim_compute_robot_state-npc1": 0.07234629539594259, "sim_compute_robot_state-npc2": 0.07158627575390959, "sim_compute_robot_state-npc3": 0.07403771518027946}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.2134892136551613, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06825166524842728, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07702485350675362, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.104050547577614, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.04012365951094517, "sim_compute_performance-ego": 0.07459385173265325, "sim_compute_robot_state-ego": 0.08597932028215985, "sim_compute_robot_state-npc0": 0.07269585409829783, "sim_compute_robot_state-npc1": 0.07126215446827024, "sim_compute_robot_state-npc2": 0.0722717379414758, "sim_compute_robot_state-npc3": 0.07303723623586256}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.2577809187082144, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.07020643124213585, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07855400672325721, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.10569881475888766, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.04492671673114483, "sim_compute_performance-ego": 0.07469531205984262, "sim_compute_robot_state-ego": 0.08383348354926476, "sim_compute_robot_state-npc0": 0.0754100909599891, "sim_compute_robot_state-npc1": 0.07395718647883488, "sim_compute_robot_state-npc2": 0.07400764868809627, "sim_compute_robot_state-npc3": 0.0731947788825402}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.20205605506896973, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.0648522694905599, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07488123893737793, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.10094797452290852, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.04137636502583822, "sim_compute_performance-ego": 0.07509254455566407, "sim_compute_robot_state-ego": 0.07914625803629557, "sim_compute_robot_state-npc0": 0.07306246757507324, "sim_compute_robot_state-npc1": 0.07069111824035644, "sim_compute_robot_state-npc2": 0.07343637784322103, "sim_compute_robot_state-npc3": 0.07205180803934733}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.20477397101266043, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06498102914719354, "in-drivable-lane": 0, "agent_compute-ego": 0.0776544866107759, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.10977544103349958, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.03743933496021089, "sim_compute_performance-ego": 0.06915372893923805, "sim_compute_robot_state-ego": 0.07664062863304502, "sim_compute_robot_state-npc0": 0.07385970297313872, "sim_compute_robot_state-npc1": 0.07124716894967216, "sim_compute_robot_state-npc2": 0.0694264570871989, "sim_compute_robot_state-npc3": 0.0704491479056222}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.2075565582097963, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.06429391683534134, "in-drivable-lane": 1.15, "agent_compute-ego": 0.06974592319754667, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.09837854185769725, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.03889488064965536, "sim_compute_performance-ego": 0.07015536552251772, "sim_compute_robot_state-ego": 0.07412112036416697, "sim_compute_robot_state-npc0": 0.06901303557462471, "sim_compute_robot_state-npc1": 0.06911205690960552, "sim_compute_robot_state-npc2": 0.0674696633982104, "sim_compute_robot_state-npc3": 0.0723917706068172}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.22670223883220128, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06503346136638097, "in-drivable-lane": 0, "agent_compute-ego": 0.06800552776881627, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.09771777050835746, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.03996403728212629, "sim_compute_performance-ego": 0.07073358978543963, "sim_compute_robot_state-ego": 0.07813531160354614, "sim_compute_robot_state-npc0": 0.06919372933251518, "sim_compute_robot_state-npc1": 0.07011022738048009, "sim_compute_robot_state-npc2": 0.07184598275593349, "sim_compute_robot_state-npc3": 0.07328050477164132}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.25087707650427726, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.0651855655744964, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.07317084424635943, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.10260363653594372, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.04062701674068675, "sim_compute_performance-ego": 0.08196453019684437, "sim_compute_robot_state-ego": 0.07686803855148017, "sim_compute_robot_state-npc0": 0.07321942553800695, "sim_compute_robot_state-npc1": 0.07319327429229137, "sim_compute_robot_state-npc2": 0.07331597571279488, "sim_compute_robot_state-npc3": 0.07141200701395671}}set_robot_commands_max 0.10977544103349958 set_robot_commands_mean 0.10352206220042998 set_robot_commands_median 0.10392300479383354 set_robot_commands_min 0.09771777050835746 sim_compute_performance-ego_max 0.08196453019684437 sim_compute_performance-ego_mean 0.07295779168118767 sim_compute_performance-ego_median 0.07303237915039062 sim_compute_performance-ego_min 0.06791018556665492 sim_compute_robot_state-ego_max 0.08692009481665207 sim_compute_robot_state-ego_mean 0.08007119358926812 sim_compute_robot_state-ego_median 0.0783998171488444 sim_compute_robot_state-ego_min 0.07412112036416697 sim_compute_robot_state-npc0_max 0.07750609646672788 sim_compute_robot_state-npc0_mean 0.07257594702555571 sim_compute_robot_state-npc0_median 0.07269585409829783 sim_compute_robot_state-npc0_min 0.06829388936360677 sim_compute_robot_state-npc1_max 0.07497768912996565 sim_compute_robot_state-npc1_mean 0.07182767627989137 sim_compute_robot_state-npc1_median 0.07127153172212489 sim_compute_robot_state-npc1_min 0.06911205690960552 sim_compute_robot_state-npc2_max 0.07407067503247942 sim_compute_robot_state-npc2_mean 0.07167437779164691 sim_compute_robot_state-npc2_median 0.0722717379414758 sim_compute_robot_state-npc2_min 0.06663034580371997 sim_compute_robot_state-npc3_max 0.07403771518027946 sim_compute_robot_state-npc3_mean 0.07198682104959056 sim_compute_robot_state-npc3_median 0.0723917706068172 sim_compute_robot_state-npc3_min 0.068370227460508 sim_compute_sim_state_max 0.04492671673114483 sim_compute_sim_state_mean 0.040459335297690434 sim_compute_sim_state_median 0.040285366127289925 sim_compute_sim_state_min 0.03743933496021089 sim_physics_max 0.2577809187082144 sim_physics_mean 0.22112613151706748 sim_physics_median 0.21528409889766148 sim_physics_min 0.20205605506896973 sim_render-ego_max 0.07020643124213585 sim_render-ego_mean 0.06611642009556695 sim_render-ego_median 0.06533134988991611 sim_render-ego_min 0.06391118734310834 simulation-passed 1 survival_time_max 6.999999999999983 survival_time_mean 3.043333333333329 survival_time_min 1.0500000000000005
No reset possible 217112636Andrea Censi challenge-aido_LF-template-random aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-25-98-20622019-05-07 19:35:21+00:00 2019-05-07 20:00:19+00:00 0:24:58 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2636/step1-simulation-ip-172-31-25-98-2062-job21711/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 217052648Egor Zamotaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testingstep1-simulation error no ip-172-31-25-98-20622019-05-07 19:29:48+00:00 2019-05-07 19:31:27+00:00 0:01:39 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 87, in main
sim_ci.write_topic_and_expect_zero('seed', config.seed)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
wait_for_data(f, timeout, waiting_for)
File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 87, in main
> sim_ci.write_topic_and_expect_zero('seed', config.seed)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
> wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
> File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
> wait_for_data(f, timeout, waiting_for)
> File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
> raise TimeoutError(msg)
> TimeoutError: Timeout after 30.0 s.
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Anastasiya Nikolskaya 🇷🇺
FANG MEIYI 🇸🇬
jiang peng
Artem Ioselevskii
Jacopo Tani
Julian Zilly
Konstantin Chaika
Andrea Censi 🇨ðŸ‡
Egor Zamotaev