Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 10658149Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-202332018-11-18 03:49:14+00:00 2018-11-18 03:49:24+00:00 0:00:10 Error while running [...]
Pulling solution ... error
stderr | ERROR: for solution manifest for julian121266/aido1_lf1_r3-v3-submission:2018_10_18_13_49_00 not found
stderr | manifest for julian121266/aido1_lf1_r3-v3-submission:2018_10_18_13_49_00 not found
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10609280Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-202332018-11-18 03:38:07+00:00 2018-11-18 03:49:07+00:00 0:11:00 Timeout:
Waited 602 [...] Timeout:
Waited 602.168995142 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10590324Manfred Diaz Tensorflow template aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 03:34:57+00:00 2018-11-18 03:38:00+00:00 0:03:03 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 64, in run
solve(params, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 40, in solve
observation, reward, done, info = env.step(action)
File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10589346Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 03:33:18+00:00 2018-11-18 03:34:50+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.34441275874318267 deviation-center-line_median 0.15045304122802677 in-drivable-lane_median 1.2666666666666626
other stats deviation-center-line_max 0.1827846686864784 deviation-center-line_mean 0.159141829414186 deviation-center-line_min 0.13015611244553738 deviation-heading_max 1.2062241324987284 deviation-heading_mean 0.9832142538735258 deviation-heading_median 0.9603177697718543 deviation-heading_min 0.7879275133374897 driven_any_max 1.1497449402153628 driven_any_mean 0.7676359984570185 driven_any_median 0.6636274267188609 driven_any_min 0.6523766532498182 driven_lanedir_max 0.6027341398733572 driven_lanedir_mean 0.39960831001362573 driven_lanedir_min 0.327551753229508 in-drivable-lane_max 2.3333333333333286 in-drivable-lane_mean 1.4799999999999958 in-drivable-lane_min 1.233333333333329 per-episodes details {"ep000": {"driven_any": 1.1497449402153628, "driven_lanedir": 0.6027341398733572, "in-drivable-lane": 2.3333333333333286, "deviation-heading": 1.2062241324987284, "deviation-center-line": 0.1827846686864784}, "ep001": {"driven_any": 0.7161865028611255, "driven_lanedir": 0.3879794314986038, "in-drivable-lane": 1.233333333333329, "deviation-heading": 1.0254752217593015, "deviation-center-line": 0.18210021517772695}, "ep002": {"driven_any": 0.6636274267188609, "driven_lanedir": 0.34441275874318267, "in-drivable-lane": 1.233333333333329, "deviation-heading": 0.9361266320002553, "deviation-center-line": 0.15045304122802677}, "ep003": {"driven_any": 0.6562444692399254, "driven_lanedir": 0.33536346672347683, "in-drivable-lane": 1.3333333333333297, "deviation-heading": 0.7879275133374897, "deviation-center-line": 0.13015611244553738}, "ep004": {"driven_any": 0.6523766532498182, "driven_lanedir": 0.327551753229508, "in-drivable-lane": 1.2666666666666626, "deviation-heading": 0.9603177697718543, "deviation-center-line": 0.15021510953316056}}
No reset possible 10579346Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 03:31:38+00:00 2018-11-18 03:33:11+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10573346Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 03:31:09+00:00 2018-11-18 03:31:31+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.1999999999999984
other stats episodes details {"ep000": {"nsteps": 167, "reward": -6.515347850733454, "good_angle": 2.532258188954429, "survival_time": 5.566666666666657, "traveled_tiles": 2, "valid_direction": 3.199999999999992}, "ep001": {"nsteps": 103, "reward": -10.640297905523871, "good_angle": 2.650111377593275, "survival_time": 3.433333333333331, "traveled_tiles": 1, "valid_direction": 2.599999999999998}, "ep002": {"nsteps": 96, "reward": -11.343306209426371, "good_angle": 2.520034595090713, "survival_time": 3.1999999999999984, "traveled_tiles": 2, "valid_direction": 2.533333333333331}, "ep003": {"nsteps": 95, "reward": -11.461269298437248, "good_angle": 2.2344889091875815, "survival_time": 3.166666666666665, "traveled_tiles": 2, "valid_direction": 2.466666666666665}, "ep004": {"nsteps": 95, "reward": -11.476688610899606, "good_angle": 2.4523413910134386, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.5999999999999988}}good_angle_max 2.650111377593275 good_angle_mean 2.4778468923678876 good_angle_median 2.520034595090713 good_angle_min 2.2344889091875815 reward_max -6.515347850733454 reward_mean -10.287381975004111 reward_median -11.343306209426371 reward_min -11.476688610899606 survival_time_max 5.566666666666657 survival_time_mean 3.7066666666666626 survival_time_min 3.166666666666665 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 3.199999999999992 valid_direction_mean 2.679999999999997 valid_direction_median 2.599999999999998 valid_direction_min 2.466666666666665
No reset possible 10541352Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-202332018-11-18 03:20:28+00:00 2018-11-18 03:31:02+00:00 0:10:34 Timeout:
Waited 600 [...] Timeout:
Waited 600.142426968 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10522372Samuel Lavoie Tensorflow template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 03:15:48+00:00 2018-11-18 03:20:17+00:00 0:04:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.90146014334538 deviation-center-line_median 0.7051719247045396 in-drivable-lane_median 0.5666666666666647
other stats deviation-center-line_max 0.73525265652992 deviation-center-line_mean 0.4934778291428813 deviation-center-line_min 0.154475459914071 deviation-heading_max 2.5808584629362796 deviation-heading_mean 1.7025688076349863 deviation-heading_median 2.280715200941565 deviation-heading_min 0.4298536718342264 driven_any_max 5.567882768422871 driven_any_mean 3.640816551748074 driven_any_median 5.501103322955828 driven_any_min 0.5194813241888642 driven_lanedir_max 5.140171956805595 driven_lanedir_mean 3.335695621153274 driven_lanedir_min 0.4894174580961612 in-drivable-lane_max 1.2333333333333307 in-drivable-lane_mean 0.4733333333333327 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 5.567882768422871, "driven_lanedir": 4.90146014334538, "in-drivable-lane": 1.2333333333333307, "deviation-heading": 2.543258458850417, "deviation-center-line": 0.73525265652992}, "ep001": {"driven_any": 0.5194813241888642, "driven_lanedir": 0.4894174580961612, "in-drivable-lane": 0, "deviation-heading": 0.4298536718342264, "deviation-center-line": 0.154475459914071}, "ep002": {"driven_any": 5.527212308344548, "driven_lanedir": 5.140171956805595, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 2.5808584629362796, "deviation-center-line": 0.7051719247045396}, "ep003": {"driven_any": 5.501103322955828, "driven_lanedir": 5.109747883104452, "in-drivable-lane": 0.5666666666666682, "deviation-heading": 2.280715200941565, "deviation-center-line": 0.705362902111649}, "ep004": {"driven_any": 1.0884030348282592, "driven_lanedir": 1.0376806644147825, "in-drivable-lane": 0, "deviation-heading": 0.678158243612445, "deviation-center-line": 0.1671262024542268}}
No reset possible 10509372Samuel Lavoie Tensorflow template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 03:13:17+00:00 2018-11-18 03:15:41+00:00 0:02:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10505376Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 03:11:27+00:00 2018-11-18 03:13:10+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.4280543950478011 deviation-center-line_median 0.1540556524964621 in-drivable-lane_median 0.93333333333333
other stats deviation-center-line_max 0.18787225674002467 deviation-center-line_mean 0.1593739723647617 deviation-center-line_min 0.12192669787272951 deviation-heading_max 1.1119128980320738 deviation-heading_mean 0.8838610412414404 deviation-heading_median 0.8056820534023785 deviation-heading_min 0.7958656317041712 driven_any_max 0.8562207404651575 driven_any_mean 0.7248873456766521 driven_any_median 0.7750602751110851 driven_any_min 0.4098238763864952 driven_lanedir_max 0.5174726183134941 driven_lanedir_mean 0.410910456137211 driven_lanedir_min 0.21130617128761087 in-drivable-lane_max 1.1333333333333293 in-drivable-lane_mean 0.946666666666664 in-drivable-lane_min 0.7333333333333333 per-episodes details {"ep000": {"driven_any": 0.4098238763864952, "driven_lanedir": 0.21130617128761087, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 1.1119128980320738, "deviation-center-line": 0.12192669787272951}, "ep001": {"driven_any": 0.8562207404651575, "driven_lanedir": 0.5174726183134941, "in-drivable-lane": 0.93333333333333, "deviation-heading": 0.9002104327050835, "deviation-center-line": 0.17984865906993192}, "ep002": {"driven_any": 0.7750602751110851, "driven_lanedir": 0.4280543950478011, "in-drivable-lane": 1.1333333333333293, "deviation-heading": 0.8056341903634954, "deviation-center-line": 0.1540556524964621}, "ep003": {"driven_any": 0.8395066905636707, "driven_lanedir": 0.4893647295295982, "in-drivable-lane": 1.099999999999996, "deviation-heading": 0.7958656317041712, "deviation-center-line": 0.18787225674002467}, "ep004": {"driven_any": 0.7438251458568514, "driven_lanedir": 0.4083543665075504, "in-drivable-lane": 0.8333333333333308, "deviation-heading": 0.8056820534023785, "deviation-center-line": 0.15316659564466026}}
No reset possible 10495376Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 03:10:10+00:00 2018-11-18 03:11:20+00:00 0:01:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10491376Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 03:09:35+00:00 2018-11-18 03:10:04+00:00 0:00:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.133333333333332
other stats episodes details {"ep000": {"nsteps": 62, "reward": -16.37156642666988, "good_angle": 0.5573693535327017, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 1.6000000000000023}, "ep001": {"nsteps": 101, "reward": -10.236005120855378, "good_angle": 4.515142145522232, "survival_time": 3.3666666666666645, "traveled_tiles": 2, "valid_direction": 2.599999999999998}, "ep002": {"nsteps": 94, "reward": -11.342633471011798, "good_angle": 1.408967971115984, "survival_time": 3.133333333333332, "traveled_tiles": 2, "valid_direction": 2.3999999999999986}, "ep003": {"nsteps": 108, "reward": -9.876721069377338, "good_angle": 1.2605949204596965, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 2.499999999999997}, "ep004": {"nsteps": 82, "reward": -12.908720246574376, "good_angle": 1.3840875730702031, "survival_time": 2.7333333333333334, "traveled_tiles": 2, "valid_direction": 2.166666666666667}}good_angle_max 4.515142145522232 good_angle_mean 1.8252323927401632 good_angle_median 1.3840875730702031 good_angle_min 0.5573693535327017 reward_max -9.876721069377338 reward_mean -12.147129266897752 reward_median -11.342633471011798 reward_min -16.37156642666988 survival_time_max 3.599999999999997 survival_time_mean 2.9799999999999995 survival_time_min 2.066666666666669 traveled_tiles_max 2 traveled_tiles_mean 1.8 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 2.599999999999998 valid_direction_mean 2.2533333333333325 valid_direction_median 2.3999999999999986 valid_direction_min 1.6000000000000023
No reset possible 10476392Liam Paull PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 03:05:22+00:00 2018-11-18 03:09:29+00:00 0:04:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5710878225860856 deviation-center-line_median 0.247384429109263 in-drivable-lane_median 2.8333333333333233
other stats deviation-center-line_max 0.5035553322993236 deviation-center-line_mean 0.28248656738463157 deviation-center-line_min 0.14910829526168953 deviation-heading_max 3.347989546936417 deviation-heading_mean 1.461698882593587 deviation-heading_median 0.9516191374409037 deviation-heading_min 0.1658724944785747 driven_any_max 1.275524314857489 driven_any_mean 0.8380464569105286 driven_any_median 1.1030957281125682 driven_any_min 0.1913053757833091 driven_lanedir_max 0.6293731629942543 driven_lanedir_mean 0.4235395088966246 driven_lanedir_min 0.13222156212750225 in-drivable-lane_max 3.966666666666653 in-drivable-lane_mean 2.206666666666659 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3538945413067501, "driven_lanedir": 0.13222156212750225, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 1.8958033720502327, "deviation-center-line": 0.1984014722048932}, "ep001": {"driven_any": 0.1913053757833091, "driven_lanedir": 0.1889002600497922, "in-drivable-lane": 0, "deviation-heading": 0.1658724944785747, "deviation-center-line": 0.14910829526168953}, "ep002": {"driven_any": 1.275524314857489, "driven_lanedir": 0.6293731629942543, "in-drivable-lane": 2.8333333333333233, "deviation-heading": 3.347989546936417, "deviation-center-line": 0.5035553322993236}, "ep003": {"driven_any": 1.266412324492526, "driven_lanedir": 0.5961147367254891, "in-drivable-lane": 3.966666666666653, "deviation-heading": 0.9516191374409037, "deviation-center-line": 0.31398330804798846}, "ep004": {"driven_any": 1.1030957281125682, "driven_lanedir": 0.5710878225860856, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 0.947209862061806, "deviation-center-line": 0.247384429109263}}
No reset possible 10441397Vadim Volodin Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 02:58:40+00:00 2018-11-18 03:05:12+00:00 0:06:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.7199114328934264 deviation-center-line_median 0.725651349029092 in-drivable-lane_median 0
other stats deviation-center-line_max 1.610356179034906 deviation-center-line_mean 0.8544819430793693 deviation-center-line_min 0.4922185378333373 deviation-heading_max 3.692636015945935 deviation-heading_mean 1.2578294674226416 deviation-heading_median 1.1240165941114446 deviation-heading_min 0.07942104943374231 driven_any_max 6.640000000000106 driven_any_mean 6.640000000000073 driven_any_median 6.640000000000084 driven_any_min 6.640000000000005 driven_lanedir_max 1.4933261824878092 driven_lanedir_mean 0.6621694232890135 driven_lanedir_min 0.1132059337288176 in-drivable-lane_max 10 in-drivable-lane_mean 2 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 6.640000000000106, "driven_lanedir": 0.1132059337288176, "in-drivable-lane": 10, "deviation-heading": 3.692636015945935, "deviation-center-line": 0.8035249675594128}, "ep001": {"driven_any": 6.640000000000089, "driven_lanedir": 0.15960164900917606, "in-drivable-lane": 0, "deviation-heading": 1.1259174092607342, "deviation-center-line": 1.610356179034906}, "ep002": {"driven_any": 6.640000000000005, "driven_lanedir": 0.7199114328934264, "in-drivable-lane": 0, "deviation-heading": 0.2671562683613517, "deviation-center-line": 0.725651349029092}, "ep003": {"driven_any": 6.640000000000079, "driven_lanedir": 1.4933261824878092, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374231, "deviation-center-line": 0.6406586819400985}, "ep004": {"driven_any": 6.640000000000084, "driven_lanedir": 0.8248019183258386, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4922185378333373}}
No reset possible 10434397Vadim Volodin Random execution aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 02:56:46+00:00 2018-11-18 02:58:32+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10431397Vadim Volodin Random execution aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 02:56:16+00:00 2018-11-18 02:56:39+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.23719835294783115, "good_angle": 1.6343590961931995, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 6.666666666666655}, "ep001": {"nsteps": 500, "reward": -0.49661089354753496, "good_angle": 0.07621382840539564, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.182835554510355, "good_angle": 0.03030352864283182, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.14843576791882515, "good_angle": 0.03284738421522274, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.2250587911726907, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}good_angle_max 1.6343590961931995 good_angle_mean 0.3699361098220464 good_angle_median 0.07595671165358207 good_angle_min 0.03030352864283182 reward_max 0.2250587911726907 reward_mean -0.1680043555503711 reward_median -0.182835554510355 reward_min -0.49661089354753496 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 6.666666666666655 valid_direction_mean 1.333333333333331 valid_direction_median 0 valid_direction_min 0
No reset possible 10416397Vadim Volodin Random execution aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 02:52:26+00:00 2018-11-18 02:56:09+00:00 0:03:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10410405Liam Paull ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 02:51:25+00:00 2018-11-18 02:52:19+00:00 0:00:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "./solution.py", line 89, in run
raise InvalidSubmission(str(e))
InvalidSubmission: error loading <rosparam> tag:
'param' attribute must be set for non-dictionary values
XML is <rosparam command="load" file="$(find duckietown)/config/$(arg config)/line_detector/$(arg node_name)/$(arg param_file_name).yaml"/>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10406407Bhairav Mehta Template for ROS Submission aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-202332018-11-18 02:50:27+00:00 2018-11-18 02:51:18+00:00 0:00:51 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10398414Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 02:48:54+00:00 2018-11-18 02:50:19+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.2205529708004259 deviation-center-line_median 0.20924855428525296 in-drivable-lane_median 0
other stats deviation-center-line_max 0.34487799786562473 deviation-center-line_mean 0.22083174855656443 deviation-center-line_min 0.0800814722844281 deviation-heading_max 1.7837179077180825 deviation-heading_mean 0.8372043824642704 deviation-heading_median 0.6197318346864207 deviation-heading_min 0.42335790067193135 driven_any_max 0.7857491550405021 driven_any_mean 0.34786611003372553 driven_any_median 0.23929003915606892 driven_any_min 0.07499169560682972 driven_lanedir_max 0.5415140831679119 driven_lanedir_mean 0.28533931934984386 driven_lanedir_min 0.05759304641594776 in-drivable-lane_max 1.9000000000000024 in-drivable-lane_mean 0.3800000000000005 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.7857491550405021, "driven_lanedir": 0.5415140831679119, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7837179077180825, "deviation-center-line": 0.3332007209831216}, "ep001": {"driven_any": 0.07499169560682972, "driven_lanedir": 0.05759304641594776, "in-drivable-lane": 0, "deviation-heading": 0.42335790067193135, "deviation-center-line": 0.0800814722844281}, "ep002": {"driven_any": 0.16785351760841608, "driven_lanedir": 0.14937728494313807, "in-drivable-lane": 0, "deviation-heading": 0.5777431771900488, "deviation-center-line": 0.1367499973643948}, "ep003": {"driven_any": 0.4714461427568109, "driven_lanedir": 0.45765921142179566, "in-drivable-lane": 0, "deviation-heading": 0.7814710920548688, "deviation-center-line": 0.34487799786562473}, "ep004": {"driven_any": 0.23929003915606892, "driven_lanedir": 0.2205529708004259, "in-drivable-lane": 0, "deviation-heading": 0.6197318346864207, "deviation-center-line": 0.20924855428525296}}
No reset possible 10396414Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 02:47:40+00:00 2018-11-18 02:48:44+00:00 0:01:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10394414Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 02:47:09+00:00 2018-11-18 02:47:31+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.3000000000000016
other stats episodes details {"ep000": {"nsteps": 222, "reward": -4.660133127033971, "good_angle": 0.8502285392942842, "survival_time": 7.399999999999984, "traveled_tiles": 2, "valid_direction": 1.2999999999999965}, "ep001": {"nsteps": 23, "reward": -44.114540605441384, "good_angle": 0.4212393664178693, "survival_time": 0.7666666666666666, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 49, "reward": -20.87050449483249, "good_angle": 0.4357927760550582, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.5666666666666682}, "ep003": {"nsteps": 134, "reward": -7.851599520711757, "good_angle": 0.31771628225877674, "survival_time": 4.466666666666661, "traveled_tiles": 2, "valid_direction": 0.466666666666665}, "ep004": {"nsteps": 69, "reward": -14.985627248235373, "good_angle": 0.4107376008939868, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.5999999999999996}}good_angle_max 0.8502285392942842 good_angle_mean 0.48714291298399504 good_angle_median 0.4212393664178693 good_angle_min 0.31771628225877674 reward_max -4.660133127033971 reward_mean -18.496480999250995 reward_median -14.985627248235373 reward_min -44.114540605441384 survival_time_max 7.399999999999984 survival_time_mean 3.313333333333329 survival_time_min 0.7666666666666666 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 1.2999999999999965 valid_direction_mean 0.6799999999999992 valid_direction_median 0.5666666666666682 valid_direction_min 0.466666666666665
No reset possible 10384414Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 02:43:36+00:00 2018-11-18 02:47:01+00:00 0:03:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10379419Siyan Zheng PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 02:41:24+00:00 2018-11-18 02:43:29+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5816486177399032 deviation-center-line_median 0.3184216672526012 in-drivable-lane_median 1.86666666666666
other stats deviation-center-line_max 0.47761847798217905 deviation-center-line_mean 0.30618737544008756 deviation-center-line_min 0.18684597507788617 deviation-heading_max 2.4264405133259226 deviation-heading_mean 1.3131713476272011 deviation-heading_median 1.027451556154058 deviation-heading_min 0.2724521010002521 driven_any_max 1.2754770704971945 driven_any_mean 0.8672986718351987 driven_any_median 1.2561296570685936 driven_any_min 0.1957523662720948 driven_lanedir_max 0.8256650154325984 driven_lanedir_mean 0.4959350461139266 driven_lanedir_min 0.12382544299362296 in-drivable-lane_max 4.433333333333318 in-drivable-lane_mean 2.0333333333333266 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3500541326086607, "driven_lanedir": 0.12382544299362296, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 1.9094170211760753, "deviation-center-line": 0.18684597507788617}, "ep001": {"driven_any": 0.1957523662720948, "driven_lanedir": 0.191368389925922, "in-drivable-lane": 0, "deviation-heading": 0.2724521010002521, "deviation-center-line": 0.1998065872653904}, "ep002": {"driven_any": 1.2590801327294503, "driven_lanedir": 0.8256650154325984, "in-drivable-lane": 1.86666666666666, "deviation-heading": 2.4264405133259226, "deviation-center-line": 0.47761847798217905}, "ep003": {"driven_any": 1.2561296570685936, "driven_lanedir": 0.5816486177399032, "in-drivable-lane": 4.433333333333318, "deviation-heading": 0.9300955464796988, "deviation-center-line": 0.3184216672526012}, "ep004": {"driven_any": 1.2754770704971945, "driven_lanedir": 0.7571677644775863, "in-drivable-lane": 3.2999999999999883, "deviation-heading": 1.027451556154058, "deviation-center-line": 0.3482441696223807}}
No reset possible 10374419Siyan Zheng PyTorch template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 02:39:40+00:00 2018-11-18 02:41:17+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10371419Siyan Zheng PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 02:39:10+00:00 2018-11-18 02:39:33+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.433333333333317
other stats episodes details {"ep000": {"nsteps": 71, "reward": -14.315059584368704, "good_angle": 1.1689835307883991, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 1.966666666666668}, "ep001": {"nsteps": 55, "reward": -18.75841950882565, "good_angle": 0.04824705360600227, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 223, "reward": -4.7677169235677965, "good_angle": 1.7555159599032089, "survival_time": 7.433333333333317, "traveled_tiles": 3, "valid_direction": 3.2999999999999883}, "ep003": {"nsteps": 231, "reward": -5.555430619418017, "good_angle": 1.008658239334986, "survival_time": 7.699999999999982, "traveled_tiles": 3, "valid_direction": 4.533333333333318}, "ep004": {"nsteps": 233, "reward": -5.332217089034409, "good_angle": 8.268024005827437, "survival_time": 7.766666666666649, "traveled_tiles": 3, "valid_direction": 3.566666666666654}}good_angle_max 8.268024005827437 good_angle_mean 2.4498857578920066 good_angle_median 1.1689835307883991 good_angle_min 0.04824705360600227 reward_max -4.7677169235677965 reward_mean -9.745768745042914 reward_median -5.555430619418017 reward_min -18.75841950882565 survival_time_max 7.766666666666649 survival_time_mean 5.41999999999999 survival_time_min 1.8333333333333357 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 4.533333333333318 valid_direction_mean 2.673333333333326 valid_direction_median 3.2999999999999883 valid_direction_min 0
No reset possible 10360419Siyan Zheng PyTorch template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 02:35:31+00:00 2018-11-18 02:39:04+00:00 0:03:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10348432Bhairav Mehta Template for ROS Submission aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 02:33:43+00:00 2018-11-18 02:35:23+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.4334346750848357 deviation-center-line_median 0.15400500238694542 in-drivable-lane_median 0
other stats deviation-center-line_max 0.7452118341971528 deviation-center-line_mean 0.25567461802464164 deviation-center-line_min 0.09676536162184486 deviation-heading_max 2.2000358913393825 deviation-heading_mean 0.8538138404684702 deviation-heading_median 0.6702098796313044 deviation-heading_min 0.18327976402595925 driven_any_max 1.621523584402733 driven_any_mean 0.6925191466148384 driven_any_median 0.6225263633471203 driven_any_min 0.2108633079572579 driven_lanedir_max 1.2169290174669167 driven_lanedir_mean 0.5572604687192677 driven_lanedir_min 0.2069970948132238 in-drivable-lane_max 1.1333333333333293 in-drivable-lane_mean 0.4333333333333325 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.6661260913294822, "driven_lanedir": 0.4334346750848357, "in-drivable-lane": 1.0333333333333332, "deviation-heading": 0.8789137892635092, "deviation-center-line": 0.15400500238694542}, "ep001": {"driven_any": 0.2108633079572579, "driven_lanedir": 0.2069970948132238, "in-drivable-lane": 0, "deviation-heading": 0.18327976402595925, "deviation-center-line": 0.11404483681850458}, "ep002": {"driven_any": 0.34155638603759836, "driven_lanedir": 0.3343055905683525, "in-drivable-lane": 0, "deviation-heading": 0.33662987808219585, "deviation-center-line": 0.1683460550987606}, "ep003": {"driven_any": 0.6225263633471203, "driven_lanedir": 0.5946359656630098, "in-drivable-lane": 0, "deviation-heading": 0.6702098796313044, "deviation-center-line": 0.09676536162184486}, "ep004": {"driven_any": 1.621523584402733, "driven_lanedir": 1.2169290174669167, "in-drivable-lane": 1.1333333333333293, "deviation-heading": 2.2000358913393825, "deviation-center-line": 0.7452118341971528}}
No reset possible 10338424Mandana Samiei PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 02:30:13+00:00 2018-11-18 02:33:34+00:00 0:03:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10319438Benjamin Ramtoula ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 02:23:45+00:00 2018-11-18 02:30:06+00:00 0:06:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10305464Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 02:17:07+00:00 2018-11-18 02:23:38+00:00 0:06:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 3.100249689175728 deviation-center-line_median 1.3449474516272864 in-drivable-lane_median 1.6999999999999946
other stats deviation-center-line_max 1.3768982623538213 deviation-center-line_mean 1.1562875543915694 deviation-center-line_min 0.3685860053560791 deviation-heading_max 11.68388141943642 deviation-heading_mean 9.352449839692795 deviation-heading_median 10.618271797823088 deviation-heading_min 3.660740042655455 driven_any_max 4.979113636122271 driven_any_mean 4.852610389758444 driven_any_median 4.979031772314665 driven_any_min 4.346832205322924 driven_lanedir_max 3.167659217109948 driven_lanedir_mean 2.624352949811872 driven_lanedir_min 0.676559070177116 in-drivable-lane_max 10.433333333333302 in-drivable-lane_mean 3.339999999999989 in-drivable-lane_min 0.8666666666666638 per-episodes details {"ep000": {"driven_any": 4.346832205322924, "driven_lanedir": 0.676559070177116, "in-drivable-lane": 10.433333333333302, "deviation-heading": 3.660740042655455, "deviation-center-line": 0.3685860053560791}, "ep001": {"driven_any": 4.979113636122251, "driven_lanedir": 3.05494506528675, "in-drivable-lane": 2.199999999999993, "deviation-heading": 9.953043798180028, "deviation-center-line": 1.3768982623538213}, "ep002": {"driven_any": 4.979031772314665, "driven_lanedir": 3.1223517073098175, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 10.846312140368983, "deviation-center-line": 1.3449474516272864}, "ep003": {"driven_any": 4.978960698910106, "driven_lanedir": 3.167659217109948, "in-drivable-lane": 0.8666666666666638, "deviation-heading": 11.68388141943642, "deviation-center-line": 1.342293455826984}, "ep004": {"driven_any": 4.979113636122271, "driven_lanedir": 3.100249689175728, "in-drivable-lane": 1.6999999999999946, "deviation-heading": 10.618271797823088, "deviation-center-line": 1.3487125967936766}}
No reset possible 10298454Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 02:16:33+00:00 2018-11-18 02:16:54+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.6358119174102321, "good_angle": 26.119034103876217, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.699999999999974}, "ep001": {"nsteps": 500, "reward": -0.3779372270097956, "good_angle": 13.49085374796333, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.96666666666665}, "ep002": {"nsteps": 500, "reward": -0.25285773413255813, "good_angle": 13.562961716495696, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.83333333333332}, "ep003": {"nsteps": 500, "reward": -0.17246611558226868, "good_angle": 13.541110901270132, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666653}, "ep004": {"nsteps": 500, "reward": -0.3079843127221684, "good_angle": 13.764277431711864, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333324}}good_angle_max 26.119034103876217 good_angle_mean 16.095647580263446 good_angle_median 13.562961716495696 good_angle_min 13.49085374796333 reward_max -0.17246611558226868 reward_mean -0.3494114613714046 reward_median -0.3079843127221684 reward_min -0.6358119174102321 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 13.033333333333324 valid_direction_mean 12.699999999999983 valid_direction_median 12.96666666666665 valid_direction_min 11.699999999999974
No reset possible 10291455Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 02:15:59+00:00 2018-11-18 02:16:19+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 341, "reward": -3.5732938650779733, "good_angle": 18.779461385468952, "survival_time": 11.366666666666635, "traveled_tiles": 1, "valid_direction": 8.133333333333313}, "ep001": {"nsteps": 500, "reward": -0.3809802600943949, "good_angle": 13.488598718146529, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.999999999999986}, "ep002": {"nsteps": 500, "reward": -0.2547652696329169, "good_angle": 13.563933314027404, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.899999999999988}, "ep003": {"nsteps": 500, "reward": -0.17246611558226868, "good_angle": 13.541110901270132, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666653}, "ep004": {"nsteps": 500, "reward": -0.3079843127221684, "good_angle": 13.764277431711864, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333324}}good_angle_max 18.779461385468952 good_angle_mean 14.627476350124976 good_angle_median 13.563933314027404 good_angle_min 13.488598718146529 reward_max -0.17246611558226868 reward_mean -0.9378979646219444 reward_median -0.3079843127221684 reward_min -3.5732938650779733 survival_time_max 16.666666666666654 survival_time_mean 15.606666666666651 survival_time_min 11.366666666666635 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 13.033333333333324 valid_direction_mean 12.006666666666652 valid_direction_median 12.966666666666653 valid_direction_min 8.133333333333313
No reset possible 10287446Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 02:15:16+00:00 2018-11-18 02:15:50+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 58, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10283460Mandana Samiei ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 02:13:14+00:00 2018-11-18 02:15:09+00:00 0:01:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.3119950188815803 deviation-center-line_median 0.3300132240775818 in-drivable-lane_median 0
other stats deviation-center-line_max 0.3432471241979291 deviation-center-line_mean 0.2677448377662665 deviation-center-line_min 0.12486760834311848 deviation-heading_max 1.734075718802636 deviation-heading_mean 0.8300754086436053 deviation-heading_median 0.6173583989729339 deviation-heading_min 0.458853256807837 driven_any_max 0.7893182213611447 driven_any_mean 0.3885846212997114 driven_any_median 0.3214386532637113 driven_any_min 0.14999831032722014 driven_lanedir_max 0.54929205655216 driven_lanedir_mean 0.3283903185291771 driven_lanedir_min 0.1280771919991086 in-drivable-lane_max 1.9000000000000024 in-drivable-lane_mean 0.3800000000000005 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.7893182213611447, "driven_lanedir": 0.54929205655216, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.734075718802636, "deviation-center-line": 0.3432471241979291}, "ep001": {"driven_any": 0.3214386532637113, "driven_lanedir": 0.3119950188815803, "in-drivable-lane": 0, "deviation-heading": 0.458853256807837, "deviation-center-line": 0.3300132240775818}, "ep002": {"driven_any": 0.14999831032722014, "driven_lanedir": 0.1280771919991086, "in-drivable-lane": 0, "deviation-heading": 0.6173583989729339, "deviation-center-line": 0.12486760834311848}, "ep003": {"driven_any": 0.4428776496337229, "driven_lanedir": 0.42873952989092423, "in-drivable-lane": 0, "deviation-heading": 0.7889366049435718, "deviation-center-line": 0.3378729306975115}, "ep004": {"driven_any": 0.23929027191275784, "driven_lanedir": 0.2238477953221123, "in-drivable-lane": 0, "deviation-heading": 0.5511530636910479, "deviation-center-line": 0.20272330151519177}}
No reset possible 10278449Jonathan Plante Random execution aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 02:12:38+00:00 2018-11-18 02:13:06+00:00 0:00:28 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 59, in run
raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10273451Jonathan Plante Random execution aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 02:12:05+00:00 2018-11-18 02:12:31+00:00 0:00:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 59, in run
raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10261456Hristo Vrigazov ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 02:06:38+00:00 2018-11-18 02:11:55+00:00 0:05:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10246478Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 02:02:13+00:00 2018-11-18 02:06:30+00:00 0:04:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.3143855010633223 deviation-center-line_median 0.14709453095890548 in-drivable-lane_median 14.33333333333332
other stats deviation-center-line_max 0.21200845034771065 deviation-center-line_mean 0.14287523433661112 deviation-center-line_min 0.037119627124831064 deviation-heading_max 1.0526965326634388 deviation-heading_mean 0.7874230748765412 deviation-heading_median 0.9433568496091662 deviation-heading_min 0.11465716995287176 driven_any_max 1.3664762914028157 driven_any_mean 0.8333661767803033 driven_any_median 0.7981214917420629 driven_any_min 0.4433155765510844 driven_lanedir_max 0.39903204712881934 driven_lanedir_mean 0.2775516380863926 driven_lanedir_min 0.018326597632442265 in-drivable-lane_max 16.46666666666665 in-drivable-lane_mean 14.45999999999997 in-drivable-lane_min 13.233333333333288 per-episodes details {"ep000": {"driven_any": 0.4433155765510844, "driven_lanedir": 0.018326597632442265, "in-drivable-lane": 16.46666666666665, "deviation-heading": 0.11465716995287176, "deviation-center-line": 0.037119627124831064}, "ep001": {"driven_any": 1.3664762914028157, "driven_lanedir": 0.39903204712881934, "in-drivable-lane": 14.33333333333332, "deviation-heading": 1.0526965326634388, "deviation-center-line": 0.21200845034771065}, "ep002": {"driven_any": 0.7082173885402527, "driven_lanedir": 0.3576641860676455, "in-drivable-lane": 13.36666666666662, "deviation-heading": 0.9433568496091662, "deviation-center-line": 0.1720680310518174}, "ep003": {"driven_any": 0.7981214917420629, "driven_lanedir": 0.2983498585397335, "in-drivable-lane": 14.899999999999984, "deviation-heading": 0.8518391764407385, "deviation-center-line": 0.14608553219979098}, "ep004": {"driven_any": 0.8507001356653012, "driven_lanedir": 0.3143855010633223, "in-drivable-lane": 13.233333333333288, "deviation-heading": 0.9745656457164904, "deviation-center-line": 0.14709453095890548}}
No reset possible 10238478Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 01:58:30+00:00 2018-11-18 02:02:06+00:00 0:03:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10237478Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 01:57:59+00:00 2018-11-18 01:58:23+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -3.4878504584431647, "good_angle": 69.34492930125838, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.53333333333332}, "ep001": {"nsteps": 500, "reward": -2.989203604423441, "good_angle": 86.77084118690016, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.099999999999987}, "ep002": {"nsteps": 463, "reward": -4.7653772363159606, "good_angle": 19.282750215433236, "survival_time": 15.43333333333329, "traveled_tiles": 2, "valid_direction": 14.966666666666622}, "ep003": {"nsteps": 500, "reward": -2.7780723442053423, "good_angle": 12.031034218647056, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.199999999999985}, "ep004": {"nsteps": 454, "reward": -4.3911374833482, "good_angle": 6.754166297777159, "survival_time": 15.13333333333329, "traveled_tiles": 2, "valid_direction": 14.666666666666623}}good_angle_max 86.77084118690016 good_angle_mean 38.83674424400319 good_angle_median 19.282750215433236 good_angle_min 6.754166297777159 reward_max -2.7780723442053423 reward_mean -3.682328225347222 reward_median -3.4878504584431647 reward_min -4.7653772363159606 survival_time_max 16.666666666666654 survival_time_mean 16.11333333333331 survival_time_min 15.13333333333329 traveled_tiles_max 2 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 2 valid_direction_max 16.53333333333332 valid_direction_mean 15.69333333333331 valid_direction_median 16.099999999999987 valid_direction_min 14.666666666666623
No reset possible 10229469Benjamin Ramtoula PyTorch DDPG template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-202332018-11-18 01:57:17+00:00 2018-11-18 01:57:52+00:00 0:00:35 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10210479Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 01:46:56+00:00 2018-11-18 01:57:09+00:00 0:10:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10208481Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 01:46:09+00:00 2018-11-18 01:46:47+00:00 0:00:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: 'NoneType' object has no attribute 'action_space'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10199493Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 01:44:31+00:00 2018-11-18 01:46:02+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1244940250770317 deviation-center-line_median 0.1702985030340966 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 0.2291035934160819 deviation-center-line_mean 0.15104091265992872 deviation-center-line_min 0.07084844041760953 deviation-heading_max 1.2760765640740437 deviation-heading_mean 0.5466497354728592 deviation-heading_median 0.35171107009370006 deviation-heading_min 0.06092138286581164 driven_any_max 2.1066666666666567 driven_any_mean 1.1093333333333295 driven_any_median 1.1599999999999824 driven_any_min 0.3466666666666718 driven_lanedir_max 2.066698089009994 driven_lanedir_mean 0.9871748479623343 driven_lanedir_min 0.14089729353622693 in-drivable-lane_max 0.2666666666666657 in-drivable-lane_mean 0.09999999999999978 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 1.1599999999999824, "driven_lanedir": 1.1244940250770317, "in-drivable-lane": 0, "deviation-heading": 0.35171107009370006, "deviation-center-line": 0.1702985030340966}, "ep003": {"driven_any": 2.1066666666666567, "driven_lanedir": 2.066698089009994, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.33465738903594666, "deviation-center-line": 0.2291035934160819}, "ep004": {"driven_any": 1.5866666666666656, "driven_lanedir": 1.2579129547459444, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.2760765640740437, "deviation-center-line": 0.1859811348549165}}
No reset possible 10197493Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 01:43:36+00:00 2018-11-18 01:44:24+00:00 0:00:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10193493Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 01:43:08+00:00 2018-11-18 01:43:30+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.966666666666666
other stats episodes details {"ep000": {"nsteps": 28, "reward": -35.95936848815264, "good_angle": 0.4523226398291993, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 89, "reward": -11.722060765275794, "good_angle": 0.3368368393753734, "survival_time": 2.966666666666666, "traveled_tiles": 3, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 160, "reward": -6.5603199020959435, "good_angle": 0.375168348060673, "survival_time": 5.333333333333324, "traveled_tiles": 4, "valid_direction": 0.7999999999999972}, "ep004": {"nsteps": 121, "reward": -8.859963449884267, "good_angle": 7.247168345248417, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 1.399999999999995}}good_angle_max 7.247168345248417 good_angle_mean 1.68312399336724 good_angle_median 0.375168348060673 good_angle_min 0.004123794322536422 reward_max -6.5603199020959435 reward_mean -19.874426403141097 reward_median -11.722060765275794 reward_min -36.270419410296846 survival_time_max 5.333333333333324 survival_time_mean 2.839999999999997 survival_time_min 0.9333333333333332 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 1.399999999999995 valid_direction_mean 0.7466666666666646 valid_direction_median 0.7999999999999972 valid_direction_min 0
No reset possible 10178493Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 01:41:08+00:00 2018-11-18 01:43:02+00:00 0:01:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10164513Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 01:37:29+00:00 2018-11-18 01:41:01+00:00 0:03:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.36515912995221256 deviation-center-line_median 0.27711992167464045 in-drivable-lane_median 0
other stats deviation-center-line_max 0.3117033235146992 deviation-center-line_mean 0.2623622272834181 deviation-center-line_min 0.1665246338038381 deviation-heading_max 2.574347252804103 deviation-heading_mean 0.8892329512459147 deviation-heading_median 0.4770064183773758 deviation-heading_min 0.24848767262080632 driven_any_max 0.6483408761308959 driven_any_mean 0.40453323349081344 driven_any_median 0.38822633693573416 driven_any_min 0.1747027989975962 driven_lanedir_max 0.6375019301596847 driven_lanedir_mean 0.3542640235155541 driven_lanedir_min 0.16513136021295438 in-drivable-lane_max 0.7333333333333333 in-drivable-lane_mean 0.14666666666666667 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.38822633693573416, "driven_lanedir": 0.16513136021295438, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 2.574347252804103, "deviation-center-line": 0.27711992167464045}, "ep001": {"driven_any": 0.1747027989975962, "driven_lanedir": 0.17209583435129394, "in-drivable-lane": 0, "deviation-heading": 0.24848767262080632, "deviation-center-line": 0.1665246338038381}, "ep002": {"driven_any": 0.37269882609342025, "driven_lanedir": 0.36515912995221256, "in-drivable-lane": 0, "deviation-heading": 0.4770064183773758, "deviation-center-line": 0.26623431759254207}, "ep003": {"driven_any": 0.6483408761308959, "driven_lanedir": 0.6375019301596847, "in-drivable-lane": 0, "deviation-heading": 0.6865299431479928, "deviation-center-line": 0.2902289398313708}, "ep004": {"driven_any": 0.43869732929642086, "driven_lanedir": 0.4314318629016247, "in-drivable-lane": 0, "deviation-heading": 0.4597934692792956, "deviation-center-line": 0.3117033235146992}}
No reset possible 10154504Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 01:35:36+00:00 2018-11-18 01:37:22+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10152504Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 01:35:08+00:00 2018-11-18 01:35:29+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.7117629176639021, "good_angle": 19.369427704683815, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 16.499999999999986}, "ep001": {"nsteps": 500, "reward": -2.633624941200018, "good_angle": 20.6320508259992, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 16.43333333333332}, "ep002": {"nsteps": 500, "reward": -1.9364463105853649, "good_angle": 31.10136844690375, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.46666666666665}, "ep003": {"nsteps": 500, "reward": -2.776590650307946, "good_angle": 21.276815444106457, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 16.46666666666665}, "ep004": {"nsteps": 500, "reward": -2.750040865260176, "good_angle": 18.58442290786312, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 16.499999999999986}}good_angle_max 31.10136844690375 good_angle_mean 22.192817065911264 good_angle_median 20.6320508259992 good_angle_min 18.58442290786312 reward_max -0.7117629176639021 reward_mean -2.1616931370034815 reward_median -2.633624941200018 reward_min -2.776590650307946 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 2 traveled_tiles_mean 1.2 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 16.499999999999986 valid_direction_mean 16.473333333333322 valid_direction_median 16.46666666666665 valid_direction_min 16.43333333333332
No reset possible 10133504Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 01:27:44+00:00 2018-11-18 01:35:01+00:00 0:07:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10132505Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 01:27:01+00:00 2018-11-18 01:27:38+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 88, in run
raise InvalidSubmission(str(e))
InvalidSubmission: index 1 is out of bounds for axis 1 with size 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10098517Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 01:20:00+00:00 2018-11-18 01:26:55+00:00 0:06:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10085523Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 01:18:26+00:00 2018-11-18 01:19:46+00:00 0:01:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.04411107874427467 deviation-center-line_median 0.03382312812944439 in-drivable-lane_median 0
other stats deviation-center-line_max 0.036932541750262865 deviation-center-line_mean 0.025155405677972437 deviation-center-line_min 0 deviation-heading_max 0.33344468140579925 deviation-heading_mean 0.22039329655951928 deviation-heading_median 0.26280377843412867 deviation-heading_min 0 driven_any_max 3.3176367416071093 driven_any_mean 0.7248170230659711 driven_any_median 0.07328113284674392 driven_any_min 0.05329536934308598 driven_lanedir_max 0.04675978410254445 driven_lanedir_mean 0.034855625077198346 driven_lanedir_min 0 in-drivable-lane_max 16.63333333333332 in-drivable-lane_mean 3.3733333333333304 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 3.3176367416071093, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.05329536934308598, "driven_lanedir": 0.03825011064919037, "in-drivable-lane": 0, "deviation-heading": 0.21638555899448664, "deviation-center-line": 0.034025485829071465}, "ep002": {"driven_any": 0.07328113284674392, "driven_lanedir": 0.04515715188998226, "in-drivable-lane": 0, "deviation-heading": 0.33344468140579925, "deviation-center-line": 0.036932541750262865}, "ep003": {"driven_any": 0.11325265985405814, "driven_lanedir": 0.04411107874427467, "in-drivable-lane": 0.23333333333333336, "deviation-heading": 0.28933246396318174, "deviation-center-line": 0.020995872681083456}, "ep004": {"driven_any": 0.0666192116788584, "driven_lanedir": 0.04675978410254445, "in-drivable-lane": 0, "deviation-heading": 0.26280377843412867, "deviation-center-line": 0.03382312812944439}}
No reset possible 10078523Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 01:16:59+00:00 2018-11-18 01:18:17+00:00 0:01:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10076523Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 01:16:29+00:00 2018-11-18 01:16:53+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.4333333333333333
other stats episodes details {"ep000": {"nsteps": 500, "reward": -1.68614059394598, "good_angle": 59.948933459239534, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.13333333333332}, "ep001": {"nsteps": 10, "reward": -100.64196230173113, "good_angle": 0.2519482119431119, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666666}, "ep002": {"nsteps": 13, "reward": -77.50082855499707, "good_angle": 0.42986404853629945, "survival_time": 0.4333333333333333, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep003": {"nsteps": 19, "reward": -54.13723141543175, "good_angle": 0.6432325258251529, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.5666666666666665}, "ep004": {"nsteps": 12, "reward": -83.87529777487119, "good_angle": 0.3259875752032355, "survival_time": 0.4, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}}good_angle_max 59.948933459239534 good_angle_mean 12.319993164149468 good_angle_median 0.42986404853629945 good_angle_min 0.2519482119431119 reward_max -1.68614059394598 reward_mean -63.568292128195424 reward_median -77.50082855499707 reward_min -100.64196230173113 survival_time_max 16.666666666666654 survival_time_mean 3.6933333333333302 survival_time_min 0.3333333333333333 traveled_tiles_max 2 traveled_tiles_mean 1.2 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 15.13333333333332 valid_direction_mean 3.3266666666666644 valid_direction_median 0.3666666666666666 valid_direction_min 0.2666666666666666
No reset possible 10065523Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 01:13:50+00:00 2018-11-18 01:16:22+00:00 0:02:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10059534Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 01:11:49+00:00 2018-11-18 01:13:44+00:00 0:01:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.28977579066348724 deviation-center-line_median 0.2596306626838413 in-drivable-lane_median 0.8999999999999968
other stats deviation-center-line_max 0.3495269439274484 deviation-center-line_mean 0.2816719556808085 deviation-center-line_min 0.23084578070496203 deviation-heading_max 3.140638799446339 deviation-heading_mean 2.412886947725279 deviation-heading_median 2.769138296409296 deviation-heading_min 0.834297520530139 driven_any_max 0.7873202975740567 driven_any_mean 0.6419688580219205 driven_any_median 0.6009722981482444 driven_any_min 0.5823374982056604 driven_lanedir_max 0.34105884308565093 driven_lanedir_mean 0.3003442252313668 driven_lanedir_min 0.28535129762116584 in-drivable-lane_max 3.3333333333333277 in-drivable-lane_mean 1.3666666666666631 in-drivable-lane_min 0.7333333333333307 per-episodes details {"ep000": {"driven_any": 0.7873202975740567, "driven_lanedir": 0.28977579066348724, "in-drivable-lane": 3.3333333333333277, "deviation-heading": 0.834297520530139, "deviation-center-line": 0.3495269439274484}, "ep001": {"driven_any": 0.647559298004693, "driven_lanedir": 0.34105884308565093, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.140638799446339, "deviation-center-line": 0.3138973423502348}, "ep002": {"driven_any": 0.6009722981482444, "driven_lanedir": 0.2978870322519669, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 2.769138296409296, "deviation-center-line": 0.254459048737556}, "ep003": {"driven_any": 0.5823374982056604, "driven_lanedir": 0.28535129762116584, "in-drivable-lane": 1.0333333333333297, "deviation-heading": 2.4218935945541102, "deviation-center-line": 0.23084578070496203}, "ep004": {"driven_any": 0.5916548981769478, "driven_lanedir": 0.28764816253456305, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 2.89846652768651, "deviation-center-line": 0.2596306626838413}}
No reset possible 10056534Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 01:08:53+00:00 2018-11-18 01:11:42+00:00 0:02:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10055534Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 01:08:24+00:00 2018-11-18 01:08:47+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.366666666666661
other stats episodes details {"ep000": {"nsteps": 171, "reward": -6.709294177134309, "good_angle": 3.212081557270962, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.79999999999999}, "ep001": {"nsteps": 141, "reward": -7.600244003372822, "good_angle": 4.804851725848225, "survival_time": 4.699999999999993, "traveled_tiles": 1, "valid_direction": 3.833333333333327}, "ep002": {"nsteps": 131, "reward": -8.178489692882414, "good_angle": 4.636373361798506, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 3.6666666666666607}, "ep003": {"nsteps": 127, "reward": -8.459673733430305, "good_angle": 4.4107527352806075, "survival_time": 4.233333333333328, "traveled_tiles": 1, "valid_direction": 3.4999999999999947}, "ep004": {"nsteps": 129, "reward": -8.281368599211898, "good_angle": 4.686365787635289, "survival_time": 4.2999999999999945, "traveled_tiles": 1, "valid_direction": 3.699999999999995}}good_angle_max 4.804851725848225 good_angle_mean 4.350085033566717 good_angle_median 4.636373361798506 good_angle_min 3.212081557270962 reward_max -6.709294177134309 reward_mean -7.84581404120635 reward_median -8.178489692882414 reward_min -8.459673733430305 survival_time_max 5.6999999999999895 survival_time_mean 4.659999999999993 survival_time_min 4.233333333333328 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 3.833333333333327 valid_direction_mean 3.499999999999994 valid_direction_median 3.6666666666666607 valid_direction_min 2.79999999999999
No reset possible 10035534Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 01:02:01+00:00 2018-11-18 01:08:18+00:00 0:06:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10022550Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:57:53+00:00 2018-11-18 01:01:51+00:00 0:03:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.3576978746005717 deviation-center-line_median 0.2233841557282331 in-drivable-lane_median 0
other stats deviation-center-line_max 0.3503940953154788 deviation-center-line_mean 0.19738717890852345 deviation-center-line_min 0 deviation-heading_max 12.77547708270898 deviation-heading_mean 5.865458865467552 deviation-heading_median 7.097049538801558 deviation-heading_min 0 driven_any_max 1.2739283137934605 driven_any_mean 0.6107395487412631 driven_any_median 0.5166434073868348 driven_any_min 0.01531878084989824 driven_lanedir_max 0.8619271176621262 driven_lanedir_mean 0.3497392406430405 driven_lanedir_min 0 in-drivable-lane_max 16.63333333333332 in-drivable-lane_mean 3.333333333333331 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.2739283137934605, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.3719349073541322, "driven_lanedir": 0.3576978746005717, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.2824915590704668, "deviation-center-line": 0.1192082148314856}, "ep002": {"driven_any": 0.5166434073868348, "driven_lanedir": 0.5149982021318316, "in-drivable-lane": 0, "deviation-heading": 12.77547708270898, "deviation-center-line": 0.3503940953154788}, "ep003": {"driven_any": 0.01531878084989824, "driven_lanedir": 0.014073008820673303, "in-drivable-lane": 0, "deviation-heading": 7.097049538801558, "deviation-center-line": 0.2939494286674196}, "ep004": {"driven_any": 0.8758723343219902, "driven_lanedir": 0.8619271176621262, "in-drivable-lane": 0, "deviation-heading": 9.17227614675676, "deviation-center-line": 0.2233841557282331}}
No reset possible 10008548Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:56:23+00:00 2018-11-18 00:57:45+00:00 0:01:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1548669389225423 deviation-center-line_median 0.1650364607508744 in-drivable-lane_median 0
other stats deviation-center-line_max 0.25183147339518264 deviation-center-line_mean 0.1642075635413615 deviation-center-line_min 0.09407833726675052 deviation-heading_max 1.0940673849836224 deviation-heading_mean 0.5146929477375416 deviation-heading_median 0.4185216049680371 deviation-heading_min 0.06092138286581164 driven_any_max 2.1193286295815987 driven_any_mean 1.1619952677882384 driven_any_median 1.175329151694669 driven_any_min 0.34666666666667245 driven_lanedir_max 2.0984538450368393 driven_lanedir_mean 1.0049105637124771 driven_lanedir_min 0.20771937084175296 in-drivable-lane_max 1.4333333333333282 in-drivable-lane_mean 0.3666666666666656 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.4266642174802099, "driven_lanedir": 0.20771937084175296, "in-drivable-lane": 0.4, "deviation-heading": 0.6819519686307797, "deviation-center-line": 0.09407833726675052}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 1.175329151694669, "driven_lanedir": 1.1548669389225423, "in-drivable-lane": 0, "deviation-heading": 0.3180023972394569, "deviation-center-line": 0.1650364607508744}, "ep003": {"driven_any": 2.1193286295815987, "driven_lanedir": 2.0984538450368393, "in-drivable-lane": 0, "deviation-heading": 0.4185216049680371, "deviation-center-line": 0.25183147339518264}, "ep004": {"driven_any": 1.7419876735180422, "driven_lanedir": 1.2176407863187766, "in-drivable-lane": 1.4333333333333282, "deviation-heading": 1.0940673849836224, "deviation-center-line": 0.21111865471706093}}
No reset possible 10005539Jonathan Plante Random execution aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 00:55:56+00:00 2018-11-18 00:56:15+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.599999999999983
other stats episodes details {"ep000": {"nsteps": 80, "reward": -12.748796821566064, "good_angle": 1.2356442287501, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 2.2666666666666666}, "ep001": {"nsteps": 228, "reward": -5.4700878389310414, "good_angle": 15.45084920539007, "survival_time": 7.599999999999983, "traveled_tiles": 2, "valid_direction": 3.866666666666653}, "ep002": {"nsteps": 148, "reward": -7.186203170869802, "good_angle": 0.02838870394028112, "survival_time": 4.933333333333326, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 463, "reward": -2.3667525905918643, "good_angle": 2.2419453367295, "survival_time": 15.43333333333329, "traveled_tiles": 4, "valid_direction": 2.5333333333333243}, "ep004": {"nsteps": 348, "reward": -3.5699637512639284, "good_angle": 20.172131049736933, "survival_time": 11.59999999999997, "traveled_tiles": 3, "valid_direction": 3.9999999999999862}}good_angle_max 20.172131049736933 good_angle_mean 7.825791704909376 good_angle_median 2.2419453367295 good_angle_min 0.02838870394028112 reward_max -2.3667525905918643 reward_mean -6.2683608346445405 reward_median -5.4700878389310414 reward_min -12.748796821566064 survival_time_max 15.43333333333329 survival_time_mean 8.446666666666648 survival_time_min 2.666666666666667 traveled_tiles_max 4 traveled_tiles_mean 2.6 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.9999999999999862 valid_direction_mean 2.5333333333333257 valid_direction_median 2.5333333333333243 valid_direction_min 0
No reset possible 9992539Jonathan Plante Random execution aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 00:53:48+00:00 2018-11-18 00:55:48+00:00 0:02:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9989540Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation aborted no idsc-rudolf-202332018-11-18 00:53:26+00:00 2018-11-18 00:53:40+00:00 0:00:14 Error while running [...]
Creating job9989-2434_evaluator_1 ... error
stderr | ERROR: for job9989-2434_evaluator_1 Cannot start service evaluator: network job9989-2434_evaluation not found
stderr |
stderr | ERROR: for solution Cannot start service solution: network job9989-2434_evaluation not found
stderr |
stderr | ERROR: for evaluator Cannot start service evaluator: network job9989-2434_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9983546Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 00:52:46+00:00 2018-11-18 00:53:19+00:00 0:00:33 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: unbound method step() must be called with step_JP instance as first argument (got ndarray instance instead)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9980549Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 00:52:05+00:00 2018-11-18 00:52:39+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: 'module' object has no attribute 'np'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9974554Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:49:48+00:00 2018-11-18 00:51:57+00:00 0:02:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5878679957129365 deviation-center-line_median 0.16567998386637017 in-drivable-lane_median 2.0666666666666593
other stats deviation-center-line_max 1.4210567377069998 deviation-center-line_mean 0.4279702013556904 deviation-center-line_min 0 deviation-heading_max 2.784458537029883 deviation-heading_mean 1.1041376789660051 deviation-heading_median 0.7725521154785226 deviation-heading_min 0 driven_any_max 4.448088618206476 driven_any_mean 1.7604481889666872 driven_any_median 1.4618339725933334 driven_any_min 0.42196142877572984 driven_lanedir_max 2.79668164581245 driven_lanedir_mean 0.9406646581886569 driven_lanedir_min 0 in-drivable-lane_max 5.133333333333325 in-drivable-lane_mean 2.56 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.4618339725933334, "driven_lanedir": 0, "in-drivable-lane": 5.133333333333325, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.42196142877572984, "driven_lanedir": 0.39955096995796713, "in-drivable-lane": 0, "deviation-heading": 0.4127001827026125, "deviation-center-line": 0.13506377935417027}, "ep002": {"driven_any": 0.8825718058068862, "driven_lanedir": 0.5878679957129365, "in-drivable-lane": 0.5333333333333314, "deviation-heading": 1.5509775596190072, "deviation-center-line": 0.16567998386637017}, "ep003": {"driven_any": 1.5877851194510109, "driven_lanedir": 0.91922267945993, "in-drivable-lane": 2.0666666666666593, "deviation-heading": 0.7725521154785226, "deviation-center-line": 0.418050505850912}, "ep004": {"driven_any": 4.448088618206476, "driven_lanedir": 2.79668164581245, "in-drivable-lane": 5.066666666666684, "deviation-heading": 2.784458537029883, "deviation-center-line": 1.4210567377069998}}
No reset possible 9965554Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 00:48:24+00:00 2018-11-18 00:49:42+00:00 0:01:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9962554Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 00:47:57+00:00 2018-11-18 00:48:17+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.166666666666658
other stats episodes details {"ep000": {"nsteps": 155, "reward": -8.332383265226118, "good_angle": 0.38833699708774594, "survival_time": 5.166666666666658, "traveled_tiles": 3, "valid_direction": 0.6999999999999988}, "ep001": {"nsteps": 53, "reward": -19.27001005692302, "good_angle": 0.3318057449210206, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 0.4666666666666681}, "ep002": {"nsteps": 103, "reward": -10.139492149302033, "good_angle": 2.6008715531091533, "survival_time": 3.433333333333331, "traveled_tiles": 2, "valid_direction": 1.8333333333333293}, "ep003": {"nsteps": 175, "reward": -6.350912593257547, "good_angle": 1.0076234742195198, "survival_time": 5.833333333333322, "traveled_tiles": 3, "valid_direction": 1.066666666666663}, "ep004": {"nsteps": 500, "reward": -0.6408135001054034, "good_angle": 25.077729236120124, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.8666666666666543}}good_angle_max 25.077729236120124 good_angle_mean 5.881273401091513 good_angle_median 1.0076234742195198 good_angle_min 0.3318057449210206 reward_max -0.6408135001054034 reward_mean -8.946722312962823 reward_median -8.332383265226118 reward_min -19.27001005692302 survival_time_max 16.666666666666654 survival_time_mean 6.573333333333326 survival_time_min 1.7666666666666688 traveled_tiles_max 9 traveled_tiles_mean 3.6 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.8666666666666543 valid_direction_mean 1.586666666666663 valid_direction_median 1.066666666666663 valid_direction_min 0.4666666666666681
No reset possible 9954554Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 00:43:54+00:00 2018-11-18 00:47:48+00:00 0:03:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9951557Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation aborted no idsc-rudolf-202332018-11-18 00:43:33+00:00 2018-11-18 00:43:47+00:00 0:00:14 Error while running [...]
Creating job9951-20_solution_1 ... error
stderr | ERROR: for job9951-20_solution_1 Cannot start service solution: network job9951-20_evaluation not found
stderr |
stderr | ERROR: for evaluator Cannot start service evaluator: network job9951-20_evaluation not found
stderr |
stderr | ERROR: for solution Cannot start service solution: network job9951-20_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9943565Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 00:41:21+00:00 2018-11-18 00:43:27+00:00 0:02:06 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9933574Tri Cao PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:39:21+00:00 2018-11-18 00:41:12+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.6188370420169667 deviation-center-line_median 0.29148022051280753 in-drivable-lane_median 2.2666666666666586
other stats deviation-center-line_max 0.5166066146708912 deviation-center-line_mean 0.3204480969330191 deviation-center-line_min 0.18211215601862168 deviation-heading_max 3.0240989127744937 deviation-heading_mean 1.6318985016146563 deviation-heading_median 1.1593496192447377 deviation-heading_min 0.9161646042922288 driven_any_max 1.32686445785009 driven_any_mean 1.044646633975423 driven_any_median 1.1590106610719335 driven_any_min 0.34459809595259455 driven_lanedir_max 0.7627713010920065 driven_lanedir_mean 0.5575417610022392 driven_lanedir_min 0.1257892345568936 in-drivable-lane_max 4.166666666666652 in-drivable-lane_mean 2.526666666666658 in-drivable-lane_min 0.6666666666666666 per-episodes details {"ep000": {"driven_any": 0.34459809595259455, "driven_lanedir": 0.1257892345568936, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 2.083336194694414, "deviation-center-line": 0.18211215601862168}, "ep001": {"driven_any": 1.1471469051953915, "driven_lanedir": 0.6188370420169667, "in-drivable-lane": 3.3333333333333215, "deviation-heading": 1.1593496192447377, "deviation-center-line": 0.27920093478994756}, "ep002": {"driven_any": 1.32686445785009, "driven_lanedir": 0.7627713010920065, "in-drivable-lane": 2.199999999999992, "deviation-heading": 3.0240989127744937, "deviation-center-line": 0.5166066146708912}, "ep003": {"driven_any": 1.245613049807105, "driven_lanedir": 0.5637192924605152, "in-drivable-lane": 4.166666666666652, "deviation-heading": 0.9161646042922288, "deviation-center-line": 0.33284055867282764}, "ep004": {"driven_any": 1.1590106610719335, "driven_lanedir": 0.7165919348848135, "in-drivable-lane": 2.2666666666666586, "deviation-heading": 0.9765431770674085, "deviation-center-line": 0.29148022051280753}}
No reset possible 9930574Tri Cao PyTorch template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 00:38:21+00:00 2018-11-18 00:39:12+00:00 0:00:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9917579Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:36:00+00:00 2018-11-18 00:38:14+00:00 0:02:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.7269360772684326 deviation-center-line_median 0.1516173576083181 in-drivable-lane_median 4.166666666666662
other stats deviation-center-line_max 0.9881219990698914 deviation-center-line_mean 0.3312545331594837 deviation-center-line_min 0 deviation-heading_max 2.068416631849293 deviation-heading_mean 0.7127590478890345 deviation-heading_median 0.5041212178199654 deviation-heading_min 0 driven_any_max 5.493661028781503 driven_any_mean 2.4421884894852224 driven_any_median 2.41771245363674 driven_any_min 0.4532403897677328 driven_lanedir_max 3.4900572754102406 driven_lanedir_mean 1.2732421827198832 driven_lanedir_min 0 in-drivable-lane_max 6.233333333333312 in-drivable-lane_mean 3.826666666666656 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.3512198939463251, "driven_lanedir": 0, "in-drivable-lane": 4.166666666666662, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.4532403897677328, "driven_lanedir": 0.4398509475923922, "in-drivable-lane": 0, "deviation-heading": 0.2902265382403343, "deviation-center-line": 0.14138744642802734}, "ep002": {"driven_any": 2.41771245363674, "driven_lanedir": 0.7269360772684326, "in-drivable-lane": 6.233333333333312, "deviation-heading": 0.7010308515355802, "deviation-center-line": 0.1516173576083181}, "ep003": {"driven_any": 2.495108681293811, "driven_lanedir": 1.7093666133283512, "in-drivable-lane": 2.8999999999999906, "deviation-heading": 0.5041212178199654, "deviation-center-line": 0.37514586269118166}, "ep004": {"driven_any": 5.493661028781503, "driven_lanedir": 3.4900572754102406, "in-drivable-lane": 5.8333333333333135, "deviation-heading": 2.068416631849293, "deviation-center-line": 0.9881219990698914}}
No reset possible 9915578Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 00:35:32+00:00 2018-11-18 00:35:50+00:00 0:00:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.133333333333318
other stats episodes details {"ep000": {"nsteps": 133, "reward": -9.295114409206503, "good_angle": 0.2683233133444956, "survival_time": 4.433333333333327, "traveled_tiles": 3, "valid_direction": 0.5333333333333321}, "ep001": {"nsteps": 214, "reward": -5.248618875987062, "good_angle": 13.911662783167214, "survival_time": 7.133333333333318, "traveled_tiles": 3, "valid_direction": 4.899999999999984}, "ep002": {"nsteps": 270, "reward": -5.490727392326247, "good_angle": 2.678304789673275, "survival_time": 8.999999999999979, "traveled_tiles": 5, "valid_direction": 3.499999999999991}, "ep003": {"nsteps": 205, "reward": -5.82651951649885, "good_angle": 1.689196953018172, "survival_time": 6.833333333333319, "traveled_tiles": 5, "valid_direction": 1.4333333333333282}, "ep004": {"nsteps": 500, "reward": -0.6237473046593368, "good_angle": 26.92640075400222, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.033333333333319}}good_angle_max 26.92640075400222 good_angle_mean 9.094777718641074 good_angle_median 2.678304789673275 good_angle_min 0.2683233133444956 reward_max -0.6237473046593368 reward_mean -5.2969454997356005 reward_median -5.490727392326247 reward_min -9.295114409206503 survival_time_max 16.666666666666654 survival_time_mean 8.813333333333318 survival_time_min 4.433333333333327 traveled_tiles_max 10 traveled_tiles_mean 5.2 traveled_tiles_median 5 traveled_tiles_min 3 valid_direction_max 4.899999999999984 valid_direction_mean 2.879999999999991 valid_direction_median 3.499999999999991 valid_direction_min 0.5333333333333321
No reset possible 9900589Allen Ou Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:32:12+00:00 2018-11-18 00:35:25+00:00 0:03:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1345792827291852 deviation-center-line_median 0.5295830920597379 in-drivable-lane_median 0.13333333333333286
other stats deviation-center-line_max 0.7378207006812516 deviation-center-line_mean 0.4900399484331072 deviation-center-line_min 0.20311558318368145 deviation-heading_max 3.808159527676094 deviation-heading_mean 1.6781475948542628 deviation-heading_median 1.4899546091755629 deviation-heading_min 0.17127441041787572 driven_any_max 2.1153121209904326 driven_any_mean 1.1386097563326252 driven_any_median 1.176546503372836 driven_any_min 0.35906447693458193 driven_lanedir_max 2.0492581688837292 driven_lanedir_mean 1.0021894977163797 driven_lanedir_min 0.14214400169969954 in-drivable-lane_max 0.9666666666666632 in-drivable-lane_mean 0.35999999999999915 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.35906447693458193, "driven_lanedir": 0.14214400169969954, "in-drivable-lane": 0.6, "deviation-heading": 2.0571874727373767, "deviation-center-line": 0.20311558318368145}, "ep001": {"driven_any": 0.426843205820173, "driven_lanedir": 0.4261321804702509, "in-drivable-lane": 0, "deviation-heading": 0.17127441041787572, "deviation-center-line": 0.33548596571987577}, "ep002": {"driven_any": 1.176546503372836, "driven_lanedir": 1.1345792827291852, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 0.8641619542644038, "deviation-center-line": 0.644194400520989}, "ep003": {"driven_any": 2.1153121209904326, "driven_lanedir": 2.0492581688837292, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.4899546091755629, "deviation-center-line": 0.5295830920597379}, "ep004": {"driven_any": 1.6152824745451018, "driven_lanedir": 1.2588338547990334, "in-drivable-lane": 0.9666666666666632, "deviation-heading": 3.808159527676094, "deviation-center-line": 0.7378207006812516}}
No reset possible 9887580Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 00:28:03+00:00 2018-11-18 00:32:03+00:00 0:04:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9879595Anton Mashikhin PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:26:01+00:00 2018-11-18 00:27:56+00:00 0:01:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.55051472122708 deviation-center-line_median 0.29477862850039127 in-drivable-lane_median 3.266666666666655
other stats deviation-center-line_max 0.49802291989440306 deviation-center-line_mean 0.30668333839910394 deviation-center-line_min 0.177238888402093 deviation-heading_max 2.6979462349680485 deviation-heading_mean 1.5455686771252173 deviation-heading_median 1.2045236421402643 deviation-heading_min 0.9497524785792189 driven_any_max 1.2625451582899918 driven_any_mean 1.022041299359235 driven_any_median 1.183412567333336 driven_any_min 0.34650700511837895 driven_lanedir_max 0.8808916705365143 driven_lanedir_mean 0.5432996048703389 driven_lanedir_min 0.12059746380215151 in-drivable-lane_max 4.433333333333318 in-drivable-lane_mean 2.6599999999999913 in-drivable-lane_min 0.8666666666666666 per-episodes details {"ep000": {"driven_any": 0.34650700511837895, "driven_lanedir": 0.12059746380215151, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 1.8972189002308293, "deviation-center-line": 0.177238888402093}, "ep001": {"driven_any": 1.183412567333336, "driven_lanedir": 0.6413769201476682, "in-drivable-lane": 3.266666666666655, "deviation-heading": 1.2045236421402643, "deviation-center-line": 0.29477862850039127}, "ep002": {"driven_any": 1.256240246954395, "driven_lanedir": 0.8808916705365143, "in-drivable-lane": 1.3666666666666618, "deviation-heading": 2.6979462349680485, "deviation-center-line": 0.49802291989440306}, "ep003": {"driven_any": 1.2625451582899918, "driven_lanedir": 0.55051472122708, "in-drivable-lane": 4.433333333333318, "deviation-heading": 0.9784021297077256, "deviation-center-line": 0.33306468964228786}, "ep004": {"driven_any": 1.0615015191000727, "driven_lanedir": 0.5231172486382809, "in-drivable-lane": 3.3666666666666547, "deviation-heading": 0.9497524785792189, "deviation-center-line": 0.23031156555634455}}
No reset possible 9871592Liu Sam PyTorch template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 00:24:59+00:00 2018-11-18 00:25:54+00:00 0:00:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9867595Anton Mashikhin PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 00:24:31+00:00 2018-11-18 00:24:52+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.999999999999985
other stats episodes details {"ep000": {"nsteps": 79, "reward": -12.984071361042464, "good_angle": 1.2828407866510771, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.166666666666667}, "ep001": {"nsteps": 210, "reward": -6.723517444024661, "good_angle": 16.869351898762137, "survival_time": 6.999999999999985, "traveled_tiles": 2, "valid_direction": 5.099999999999983}, "ep002": {"nsteps": 222, "reward": -4.736939344725895, "good_angle": 1.5408549217526342, "survival_time": 7.399999999999984, "traveled_tiles": 3, "valid_direction": 2.8999999999999897}, "ep003": {"nsteps": 232, "reward": -5.426160681374563, "good_angle": 1.0093185114923695, "survival_time": 7.733333333333316, "traveled_tiles": 3, "valid_direction": 3.866666666666656}, "ep004": {"nsteps": 184, "reward": -6.623945596992598, "good_angle": 1.389675505002036, "survival_time": 6.133333333333321, "traveled_tiles": 2, "valid_direction": 5.233333333333322}}good_angle_max 16.869351898762137 good_angle_mean 4.4184083247320505 good_angle_median 1.389675505002036 good_angle_min 1.0093185114923695 reward_max -4.736939344725895 reward_mean -7.298926885632037 reward_median -6.623945596992598 reward_min -12.984071361042464 survival_time_max 7.733333333333316 survival_time_mean 6.179999999999988 survival_time_min 2.6333333333333337 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.233333333333322 valid_direction_mean 3.8533333333333233 valid_direction_median 3.866666666666656 valid_direction_min 2.166666666666667
No reset possible 9855605David Abraham Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:21:21+00:00 2018-11-18 00:24:25+00:00 0:03:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1352556230621853 deviation-center-line_median 0.48911001461877424 in-drivable-lane_median 0.2666666666666657
other stats deviation-center-line_max 0.72391734934782 deviation-center-line_mean 0.4725632637836704 deviation-center-line_min 0.2085318226064515 deviation-heading_max 2.271353380184955 deviation-heading_mean 1.5638423034299307 deviation-heading_median 2.0902319231219013 deviation-heading_min 0.17672818388080888 driven_any_max 2.119127334712787 driven_any_mean 1.1111566496111949 driven_any_median 1.1781779500374598 driven_any_min 0.2996380369277862 driven_lanedir_max 1.985802885232145 driven_lanedir_mean 0.9567830387330376 driven_lanedir_min 0.14306399364399436 in-drivable-lane_max 1.8333333333333268 in-drivable-lane_mean 0.5466666666666652 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3610871686774857, "driven_lanedir": 0.14306399364399436, "in-drivable-lane": 0.6, "deviation-heading": 2.0902319231219013, "deviation-center-line": 0.2085318226064515}, "ep001": {"driven_any": 0.2996380369277862, "driven_lanedir": 0.2986099825809543, "in-drivable-lane": 0, "deviation-heading": 0.17672818388080888, "deviation-center-line": 0.23824868847489847}, "ep002": {"driven_any": 1.1781779500374598, "driven_lanedir": 1.1352556230621853, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.0360042587023095, "deviation-center-line": 0.48911001461877424}, "ep003": {"driven_any": 2.119127334712787, "driven_lanedir": 1.985802885232145, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 2.271353380184955, "deviation-center-line": 0.72391734934782}, "ep004": {"driven_any": 1.5977527577004562, "driven_lanedir": 1.2211827091459089, "in-drivable-lane": 1.8333333333333268, "deviation-heading": 2.2448937712596777, "deviation-center-line": 0.7030084438704075}}
No reset possible 9847605David Abraham Random execution aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 00:20:26+00:00 2018-11-18 00:21:11+00:00 0:00:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9843605David Abraham Random execution aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 00:19:53+00:00 2018-11-18 00:20:14+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.49999999999998
other stats episodes details {"ep000": {"nsteps": 80, "reward": -12.768093680747551, "good_angle": 1.2917761760154398, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 2.2666666666666666}, "ep001": {"nsteps": 66, "reward": -15.719897522619275, "good_angle": 0.014801623152083446, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 255, "reward": -4.4186695878996565, "good_angle": 1.014588087116045, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.16666666666666}, "ep003": {"nsteps": 457, "reward": -2.2448791653367857, "good_angle": 1.383826911711072, "survival_time": 15.23333333333329, "traveled_tiles": 4, "valid_direction": 2.166666666666659}, "ep004": {"nsteps": 345, "reward": -3.646470146852991, "good_angle": 16.57234840835776, "survival_time": 11.49999999999997, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}good_angle_max 16.57234840835776 good_angle_mean 4.05546824127048 good_angle_median 1.2917761760154398 good_angle_min 0.014801623152083446 reward_max -2.2448791653367857 reward_mean -7.7596020206912515 reward_median -4.4186695878996565 reward_min -15.719897522619275 survival_time_max 15.23333333333329 survival_time_mean 8.019999999999982 survival_time_min 2.200000000000002 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.9666666666666535 valid_direction_mean 2.1133333333333275 valid_direction_median 2.16666666666666 valid_direction_min 0
No reset possible 9833605David Abraham Random execution aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 00:17:53+00:00 2018-11-18 00:19:47+00:00 0:01:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9813606Samuel Lavoie PyTorch template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 00:15:11+00:00 2018-11-18 00:17:46+00:00 0:02:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9807615David Abraham PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:13:05+00:00 2018-11-18 00:15:05+00:00 0:02:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.593308333848992 deviation-center-line_median 0.30380927374491706 in-drivable-lane_median 2.8333333333333233
other stats deviation-center-line_max 0.5005566653396404 deviation-center-line_mean 0.3053522574107309 deviation-center-line_min 0.181174769823948 deviation-heading_max 2.9293433328930023 deviation-heading_mean 1.457342729714867 deviation-heading_median 1.0191622469513104 deviation-heading_min 0.29741946218783494 driven_any_max 1.330685152058223 driven_any_mean 0.8767437335378425 driven_any_median 1.2676507953462643 driven_any_min 0.1684313734608442 driven_lanedir_max 0.6849044002094429 driven_lanedir_mean 0.4405941138662066 driven_lanedir_min 0.10790974698505562 in-drivable-lane_max 4.399999999999984 in-drivable-lane_mean 2.293333333333326 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.34102001968280693, "driven_lanedir": 0.10790974698505562, "in-drivable-lane": 0.7666666666666666, "deviation-heading": 2.0726992476879587, "deviation-center-line": 0.2046144811208511}, "ep001": {"driven_any": 0.1684313734608442, "driven_lanedir": 0.16418197015373526, "in-drivable-lane": 0, "deviation-heading": 0.29741946218783494, "deviation-center-line": 0.181174769823948}, "ep002": {"driven_any": 1.2759313271410742, "driven_lanedir": 0.6526661181338074, "in-drivable-lane": 2.8333333333333233, "deviation-heading": 2.9293433328930023, "deviation-center-line": 0.5005566653396404}, "ep003": {"driven_any": 1.330685152058223, "driven_lanedir": 0.593308333848992, "in-drivable-lane": 4.399999999999984, "deviation-heading": 0.968089358854228, "deviation-center-line": 0.336606097024298}, "ep004": {"driven_any": 1.2676507953462643, "driven_lanedir": 0.6849044002094429, "in-drivable-lane": 3.4666666666666544, "deviation-heading": 1.0191622469513104, "deviation-center-line": 0.30380927374491706}}
No reset possible 9798615David Abraham PyTorch template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 00:11:57+00:00 2018-11-18 00:12:56+00:00 0:00:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9795615David Abraham PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 00:11:30+00:00 2018-11-18 00:11:51+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.433333333333317
other stats episodes details {"ep000": {"nsteps": 79, "reward": -12.964819115303646, "good_angle": 1.3887589327794136, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.2}, "ep001": {"nsteps": 51, "reward": -20.172274533440085, "good_angle": 0.06639180550117507, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 233, "reward": -4.806144984634873, "good_angle": 2.659793622525141, "survival_time": 7.766666666666649, "traveled_tiles": 3, "valid_direction": 4.73333333333332}, "ep003": {"nsteps": 235, "reward": -5.393563101096252, "good_angle": 0.9412856968364084, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 4.066666666666656}, "ep004": {"nsteps": 223, "reward": -5.552561751343394, "good_angle": 7.11694324077688, "survival_time": 7.433333333333317, "traveled_tiles": 3, "valid_direction": 4.533333333333317}}good_angle_max 7.11694324077688 good_angle_mean 2.434634659683804 good_angle_median 1.3887589327794136 good_angle_min 0.06639180550117507 reward_max -4.806144984634873 reward_mean -9.777872697163648 reward_median -5.552561751343394 reward_min -20.172274533440085 survival_time_max 7.833333333333315 survival_time_mean 5.473333333333323 survival_time_min 1.700000000000002 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 4.73333333333332 valid_direction_mean 3.1066666666666585 valid_direction_median 4.066666666666656 valid_direction_min 0
No reset possible 9786636Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:08:06+00:00 2018-11-18 00:11:23+00:00 0:03:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.9380054565078636 deviation-center-line_median 0.7126907630680461 in-drivable-lane_median 3.7999999999999865
other stats deviation-center-line_max 1.8349013072161051 deviation-center-line_mean 0.7606140342655762 deviation-center-line_min 0 deviation-heading_max 4.000095424782763 deviation-heading_mean 1.9140955172511205 deviation-heading_median 1.4637106130961894 deviation-heading_min 0 driven_any_max 2.143457414751776 driven_any_mean 1.6274561666558576 driven_any_median 1.674387223358706 driven_any_min 0.9118688115095994 driven_lanedir_max 2.0579906909896306 driven_lanedir_mean 0.9170277469547744 driven_lanedir_min 0 in-drivable-lane_max 11.39999999999997 in-drivable-lane_mean 4.799999999999985 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.6498457175258825, "driven_lanedir": 0, "in-drivable-lane": 11.39999999999997, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.674387223358706, "driven_lanedir": 1.115572352760403, "in-drivable-lane": 3.7999999999999865, "deviation-heading": 2.8712499206109667, "deviation-center-line": 0.7126907630680461}, "ep002": {"driven_any": 0.9118688115095994, "driven_lanedir": 0.4735702345159749, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 1.4637106130961894, "deviation-center-line": 0.33682364155623246}, "ep003": {"driven_any": 1.7577216661333237, "driven_lanedir": 0.9380054565078636, "in-drivable-lane": 5.89999999999998, "deviation-heading": 1.235421627765684, "deviation-center-line": 0.9186544594874968}, "ep004": {"driven_any": 2.143457414751776, "driven_lanedir": 2.0579906909896306, "in-drivable-lane": 0, "deviation-heading": 4.000095424782763, "deviation-center-line": 1.8349013072161051}}
No reset possible 9778636Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 00:04:58+00:00 2018-11-18 00:07:59+00:00 0:03:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9772619Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 00:04:12+00:00 2018-11-18 00:04:51+00:00 0:00:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 99, in run
solve(params, cis)
File "solution.py", line 39, in solve
env = make_env(config)
File "solution.py", line 20, in make_env
env = FrameStackWrappper(env=env, k=3)
File "/workspace/wrappers.py", line 77, in __init__
self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9762637Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 00:00:34+00:00 2018-11-18 00:04:05+00:00 0:03:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.923596377492214 deviation-center-line_median 0.598222072263049 in-drivable-lane_median 4.199999999999986
other stats deviation-center-line_max 1.8296004243788897 deviation-center-line_mean 0.7096570701453979 deviation-center-line_min 0 deviation-heading_max 3.3879538281528547 deviation-heading_mean 1.6694373172776165 deviation-heading_median 1.3166820421954897 deviation-heading_min 0 driven_any_max 2.560955350405715 driven_any_mean 1.7108638105992384 driven_any_median 1.6924691197374462 driven_any_min 0.8985776781788103 driven_lanedir_max 2.1597206855478968 driven_lanedir_mean 0.9213689605600937 driven_lanedir_min 0 in-drivable-lane_max 11.166666666666638 in-drivable-lane_mean 5.206666666666658 in-drivable-lane_min 1.8666666666666956 per-episodes details {"ep000": {"driven_any": 1.651185248502013, "driven_lanedir": 0, "in-drivable-lane": 11.166666666666638, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.6924691197374462, "driven_lanedir": 1.0657936461337636, "in-drivable-lane": 4.199999999999986, "deviation-heading": 2.4635652113902147, "deviation-center-line": 0.598222072263049}, "ep002": {"driven_any": 0.8985776781788103, "driven_lanedir": 0.45773409362659434, "in-drivable-lane": 3.0333333333333226, "deviation-heading": 1.3166820421954897, "deviation-center-line": 0.30870873186510744}, "ep003": {"driven_any": 1.751131656172208, "driven_lanedir": 0.923596377492214, "in-drivable-lane": 5.766666666666647, "deviation-heading": 1.1789855046495232, "deviation-center-line": 0.8117541222199431}, "ep004": {"driven_any": 2.560955350405715, "driven_lanedir": 2.1597206855478968, "in-drivable-lane": 1.8666666666666956, "deviation-heading": 3.3879538281528547, "deviation-center-line": 1.8296004243788897}}
No reset possible 9750637Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-17 23:57:34+00:00 2018-11-18 00:00:27+00:00 0:02:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9748637Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-17 23:57:04+00:00 2018-11-17 23:57:27+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.066666666666634
other stats episodes details {"ep000": {"nsteps": 336, "reward": -4.413160906040242, "good_angle": 1.5173529017513203, "survival_time": 11.19999999999997, "traveled_tiles": 4, "valid_direction": 3.4999999999999893}, "ep001": {"nsteps": 362, "reward": -3.6046373051249048, "good_angle": 19.823566931446702, "survival_time": 12.066666666666634, "traveled_tiles": 5, "valid_direction": 7.73333333333331}, "ep002": {"nsteps": 196, "reward": -6.0937425746078775, "good_angle": 2.518363782321786, "survival_time": 6.53333333333332, "traveled_tiles": 4, "valid_direction": 5.033333333333319}, "ep003": {"nsteps": 371, "reward": -3.604529348385145, "good_angle": 1.9216788976636057, "survival_time": 12.366666666666632, "traveled_tiles": 4, "valid_direction": 2.633333333333324}, "ep004": {"nsteps": 500, "reward": -0.3443732638384681, "good_angle": 15.921971512379884, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.133333333333325}}good_angle_max 19.823566931446702 good_angle_mean 8.340586805112661 good_angle_median 2.518363782321786 good_angle_min 1.5173529017513203 reward_max -0.3443732638384681 reward_mean -3.612088679599327 reward_median -3.6046373051249048 reward_min -6.0937425746078775 survival_time_max 16.666666666666654 survival_time_mean 11.766666666666644 survival_time_min 6.53333333333332 traveled_tiles_max 5 traveled_tiles_mean 4.4 traveled_tiles_median 4 traveled_tiles_min 4 valid_direction_max 7.73333333333331 valid_direction_mean 4.406666666666654 valid_direction_median 3.4999999999999893 valid_direction_min 2.633333333333324
No reset possible 9727637Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-17 23:50:54+00:00 2018-11-17 23:56:58+00:00 0:06:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9720642Mikita Sazanovich Random execution aido1_LF1_r3-v3step1-simulation aborted no idsc-rudolf-202332018-11-17 23:50:25+00:00 2018-11-17 23:50:48+00:00 0:00:23 Error while running [...]
Creating job9720-5271_solution_1 ... error
stderr | ERROR: for job9720-5271_solution_1 Cannot start service solution: network job9720-5271_evaluation not found
stderr |
stderr | ERROR: for evaluator Cannot start service evaluator: network job9720-5271_evaluation not found
stderr |
stderr | ERROR: for solution Cannot start service solution: network job9720-5271_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 97191266Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-17 20:31:28+00:00 2018-11-17 20:32:39+00:00 0:01:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.2881097449501233 deviation-center-line_median 0.2252570338089724 in-drivable-lane_median 0
other stats deviation-center-line_max 0.3815438572274681 deviation-center-line_mean 0.25531400379800256 deviation-center-line_min 0.16201360050402913 deviation-heading_max 1.7042310694224312 deviation-heading_mean 0.7941110676011967 deviation-heading_median 0.619253364674915 deviation-heading_min 0.23970163032805175 driven_any_max 0.5678906955632209 driven_any_mean 0.36502166023374794 driven_any_median 0.28930742353140204 driven_any_min 0.20000748118233996 driven_lanedir_max 0.48312143033335353 driven_lanedir_mean 0.30399834103041623 driven_lanedir_min 0.18210316571769392 in-drivable-lane_max 1.933333333333336 in-drivable-lane_mean 0.3866666666666672 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.5678906955632209, "driven_lanedir": 0.3093870688779057, "in-drivable-lane": 1.933333333333336, "deviation-heading": 1.7042310694224312, "deviation-center-line": 0.2001523435822155}, "ep001": {"driven_any": 0.28930742353140204, "driven_lanedir": 0.2881097449501233, "in-drivable-lane": 0, "deviation-heading": 0.23970163032805175, "deviation-center-line": 0.3076031838673277}, "ep002": {"driven_any": 0.20000748118233996, "driven_lanedir": 0.18210316571769392, "in-drivable-lane": 0, "deviation-heading": 0.619253364674915, "deviation-center-line": 0.16201360050402913}, "ep003": {"driven_any": 0.4964592432019931, "driven_lanedir": 0.48312143033335353, "in-drivable-lane": 0, "deviation-heading": 0.8495443610362731, "deviation-center-line": 0.3815438572274681}, "ep004": {"driven_any": 0.2714434576897837, "driven_lanedir": 0.2572702952730048, "in-drivable-lane": 0, "deviation-heading": 0.5578249125443124, "deviation-center-line": 0.2252570338089724}}
No reset possible 97151266Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-17 20:30:07+00:00 2018-11-17 20:30:28+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.7666666666666666
other stats episodes details {"ep000": {"nsteps": 161, "reward": -6.325921595770495, "good_angle": 1.106194077189904, "survival_time": 5.366666666666657, "traveled_tiles": 2, "valid_direction": 1.3666666666666618}, "ep001": {"nsteps": 83, "reward": -12.634180715644217, "good_angle": 0.02275923412416279, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 58, "reward": -17.695456125099085, "good_angle": 0.4049407144182582, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 0.8000000000000025}, "ep003": {"nsteps": 141, "reward": -7.504122117362547, "good_angle": 0.2899005567384819, "survival_time": 4.699999999999993, "traveled_tiles": 2, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 78, "reward": -13.276650816584246, "good_angle": 0.3234104863744799, "survival_time": 2.6000000000000005, "traveled_tiles": 1, "valid_direction": 0.6333333333333311}}good_angle_max 1.106194077189904 good_angle_mean 0.42944101376905736 good_angle_median 0.3234104863744799 good_angle_min 0.02275923412416279 reward_max -6.325921595770495 reward_mean -11.487266274092118 reward_median -12.634180715644217 reward_min -17.695456125099085 survival_time_max 5.366666666666657 survival_time_mean 3.4733333333333305 survival_time_min 1.933333333333336 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 1.3666666666666618 valid_direction_mean 0.6933333333333319 valid_direction_median 0.6666666666666643 valid_direction_min 0
No reset possible 97081265Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-17 19:30:47+00:00 2018-11-17 19:34:26+00:00 0:03:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 97041264Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-17 16:05:39+00:00 2018-11-17 16:06:31+00:00 0:00:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
