Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 114011308Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step1-simulation failed no nutonomy-P50-21102018-11-21 21:52:59+00:00 2018-11-21 21:53:48+00:00 0:00:49 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 135, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11392942Claudio Ruch Python template aido1_amod_service_quality_r1-v3step2-scoring success yes nutonomy-P50-21102018-11-21 20:58:54+00:00 2018-11-21 21:00:42+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.87038394834193
other stats efficiency -64.14325579336746 fleet_size -1000000000
No reset possible 11377948Claudio Ruch Java template aido1_amod_service_quality_r1-v3step2-scoring success yes nutonomy-P50-21102018-11-21 20:56:28+00:00 2018-11-21 20:58:14+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.29453579753742
other stats efficiency -63.03610319014746 fleet_size -1000000000
No reset possible 11337213Andrea Censi Java template aido1_amod_service_quality_r1-v3step1-simulation error yes nutonomy-P50-21102018-11-21 20:45:51+00:00 2018-11-21 20:56:21+00:00 0:10:30 Timeout:
Waited 601 [...] Timeout:
Waited 601.510907888 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113261072Claudio Ruch Algorithm of Webinar aido1_amod_service_quality_r1-v3step1-simulation error yes nutonomy-P50-21102018-11-21 20:35:00+00:00 2018-11-21 20:45:44+00:00 0:10:44 Timeout:
Waited 601 [...] Timeout:
Waited 601.741546154 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113191283Claudio Ruch Big Fleet Controller aido1_amod_fleet_size_r1-v3step1-simulation error yes nutonomy-P50-21102018-11-21 20:24:00+00:00 2018-11-21 20:34:45+00:00 0:10:45 Timeout:
Waited 601 [...] Timeout:
Waited 601.356534004 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113141307Tina Chu ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-21 10:21:42+00:00 2018-11-21 10:23:54+00:00 0:02:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.2272303180768307 deviation-center-line_median 0.20681915361280567 in-drivable-lane_median 0
other stats deviation-center-line_max 0.3568243903921427 deviation-center-line_mean 0.2339024184529846 deviation-center-line_min 0.12317304458368264 deviation-heading_max 1.7477521518583374 deviation-heading_mean 0.8385864351768578 deviation-heading_median 0.625932399356574 deviation-heading_min 0.4663073293798452 driven_any_max 0.7928832038719099 driven_any_mean 0.3442899087143174 driven_any_median 0.2464303825004456 driven_any_min 0.16427501307806475 driven_lanedir_max 0.5568157761076884 driven_lanedir_mean 0.28308198639260274 driven_lanedir_min 0.1488538314418193 in-drivable-lane_max 1.8666666666666691 in-drivable-lane_mean 0.37333333333333385 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.7928832038719099, "driven_lanedir": 0.5568157761076884, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7477521518583374, "deviation-center-line": 0.3451234776069457}, "ep001": {"driven_any": 0.3285759873680623, "driven_lanedir": 0.3206965291801671, "in-drivable-lane": 0, "deviation-heading": 0.4663073293798452, "deviation-center-line": 0.3568243903921427}, "ep002": {"driven_any": 0.16427501307806475, "driven_lanedir": 0.1488538314418193, "in-drivable-lane": 0, "deviation-heading": 0.5559356998062136, "deviation-center-line": 0.137572026069346}, "ep003": {"driven_any": 0.18928495675310453, "driven_lanedir": 0.16181347715650807, "in-drivable-lane": 0, "deviation-heading": 0.7970045954833189, "deviation-center-line": 0.12317304458368264}, "ep004": {"driven_any": 0.2464303825004456, "driven_lanedir": 0.2272303180768307, "in-drivable-lane": 0, "deviation-heading": 0.625932399356574, "deviation-center-line": 0.20681915361280567}}
No reset possible 112941307Tina Chu ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-21 10:19:58+00:00 2018-11-21 10:21:33+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.366666666666668
other stats episodes details {"ep000": {"nsteps": 224, "reward": -4.614468659430713, "good_angle": 0.736912173000433, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 1.099999999999996}, "ep001": {"nsteps": 94, "reward": -11.249216741703924, "good_angle": 0.19649234145495015, "survival_time": 3.133333333333332, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 48, "reward": -21.30313229933381, "good_angle": 0.36602712571830665, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.6666666666666681}, "ep003": {"nsteps": 55, "reward": -18.556428309191357, "good_angle": 0.6146218368799753, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0.6666666666666687}, "ep004": {"nsteps": 71, "reward": -14.55548485525897, "good_angle": 0.42671573150912695, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0.6333333333333326}}good_angle_max 0.736912173000433 good_angle_mean 0.4681538417125584 good_angle_median 0.42671573150912695 good_angle_min 0.19649234145495015 reward_max -4.614468659430713 reward_mean -14.055746172983756 reward_median -14.55548485525897 reward_min -21.30313229933381 survival_time_max 7.46666666666665 survival_time_mean 3.2799999999999976 survival_time_min 1.6000000000000016 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 1.099999999999996 valid_direction_mean 0.6733333333333329 valid_direction_median 0.6666666666666681 valid_direction_min 0.29999999999999893
No reset possible 112751306Tri Cao Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-21102018-11-20 18:38:01+00:00 2018-11-20 18:44:50+00:00 0:06:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112661305Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-20 14:36:32+00:00 2018-11-20 14:42:20+00:00 0:05:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 8.466416467829077 deviation-center-line_median 0.7491075821771831 in-drivable-lane_median 0.06666666666666643
other stats deviation-center-line_max 1.0852097769842697 deviation-center-line_mean 0.6828056697229344 deviation-center-line_min 0.110456458929874 deviation-heading_max 3.088169914104725 deviation-heading_mean 1.9361613489916736 deviation-heading_median 1.9716545225234337 deviation-heading_min 0.5532418461875583 driven_any_max 9.395397994412496 driven_any_mean 6.118783919231438 driven_any_median 8.673270359145661 driven_any_min 1.2271279931045092 driven_lanedir_max 9.106972393834644 driven_lanedir_mean 5.887907266761421 driven_lanedir_min 1.1523564491476126 in-drivable-lane_max 0.6999999999999994 in-drivable-lane_mean 0.19999999999999968 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 9.13343633823087, "driven_lanedir": 8.632442293612678, "in-drivable-lane": 0.6999999999999994, "deviation-heading": 2.9109849023974417, "deviation-center-line": 1.0852097769842697}, "ep001": {"driven_any": 2.164686911263656, "driven_lanedir": 2.0813487293830906, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.1567555597452082, "deviation-center-line": 0.3937472257413113}, "ep002": {"driven_any": 1.2271279931045092, "driven_lanedir": 1.1523564491476126, "in-drivable-lane": 0, "deviation-heading": 0.5532418461875583, "deviation-center-line": 0.110456458929874}, "ep003": {"driven_any": 9.395397994412496, "driven_lanedir": 9.106972393834644, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.088169914104725, "deviation-center-line": 1.0755073047820347}, "ep004": {"driven_any": 8.673270359145661, "driven_lanedir": 8.466416467829077, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.9716545225234337, "deviation-center-line": 0.7491075821771831}}
No reset possible 112551305Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-20 14:34:19+00:00 2018-11-20 14:36:00+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.999999999999956
other stats episodes details {"ep000": {"nsteps": 496, "reward": -2.0943019221591648, "good_angle": 0.7418744038601746, "survival_time": 16.533333333333314, "traveled_tiles": 15, "valid_direction": 2.0999999999999934}, "ep001": {"nsteps": 157, "reward": -6.806706450876608, "good_angle": 14.159941219201931, "survival_time": 5.2333333333333245, "traveled_tiles": 5, "valid_direction": 2.0999999999999996}, "ep002": {"nsteps": 59, "reward": -17.04080068322009, "good_angle": 0.15271570187640776, "survival_time": 1.9666666666666697, "traveled_tiles": 3, "valid_direction": 0.33333333333333437}, "ep003": {"nsteps": 500, "reward": 0.02414321799436584, "good_angle": 0.6871705559821161, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.1333333333333302}, "ep004": {"nsteps": 450, "reward": -2.2807499980605725, "good_angle": 35.64433197185651, "survival_time": 14.999999999999956, "traveled_tiles": 17, "valid_direction": 4.83333333333332}}good_angle_max 35.64433197185651 good_angle_mean 10.277206770555429 good_angle_median 0.7418744038601746 good_angle_min 0.15271570187640776 reward_max 0.02414321799436584 reward_mean -5.639683167264414 reward_median -2.2807499980605725 reward_min -17.04080068322009 survival_time_max 16.666666666666654 survival_time_mean 11.079999999999984 survival_time_min 1.9666666666666697 traveled_tiles_max 17 traveled_tiles_mean 11.2 traveled_tiles_median 15 traveled_tiles_min 3 valid_direction_max 4.83333333333332 valid_direction_mean 2.0999999999999956 valid_direction_median 2.0999999999999934 valid_direction_min 0.33333333333333437
No reset possible 112381304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-20 13:54:42+00:00 2018-11-20 14:00:57+00:00 0:06:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 8.562174484237758 deviation-center-line_median 0.7784140476070096 in-drivable-lane_median 0.29999999999999893
other stats deviation-center-line_max 0.8265762436927065 deviation-center-line_mean 0.7249512392397739 deviation-center-line_min 0.5702182166038914 deviation-heading_max 3.0638048935757873 deviation-heading_mean 2.527148965981655 deviation-heading_median 2.5224649823204026 deviation-heading_min 2.0232609899134695 driven_any_max 9.505485581933415 driven_any_mean 8.9320499466202 driven_any_median 9.184975142567506 driven_any_min 8.133230010945981 driven_lanedir_max 9.358315656087386 driven_lanedir_mean 8.602219035588002 driven_lanedir_min 7.828730971533036 in-drivable-lane_max 1.0000000000000044 in-drivable-lane_mean 0.4666666666666666 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 9.227693948046904, "driven_lanedir": 8.715607043574893, "in-drivable-lane": 1.0000000000000044, "deviation-heading": 3.0638048935757873, "deviation-center-line": 0.8216737935350183}, "ep001": {"driven_any": 8.133230010945981, "driven_lanedir": 7.828730971533036, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 2.813692563233782, "deviation-center-line": 0.6278738947602437}, "ep002": {"driven_any": 9.184975142567506, "driven_lanedir": 8.562174484237758, "in-drivable-lane": 0.9999999999999968, "deviation-heading": 2.2125214008648344, "deviation-center-line": 0.7784140476070096}, "ep003": {"driven_any": 9.505485581933415, "driven_lanedir": 9.358315656087386, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.5224649823204026, "deviation-center-line": 0.8265762436927065}, "ep004": {"driven_any": 8.608865049607198, "driven_lanedir": 8.546267022506928, "in-drivable-lane": 0, "deviation-heading": 2.0232609899134695, "deviation-center-line": 0.5702182166038914}}
No reset possible 112351304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-20 13:51:21+00:00 2018-11-20 13:54:28+00:00 0:03:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112251304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-20 13:49:28+00:00 2018-11-20 13:51:11+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.025241015423089267, "good_angle": 0.5660956539852379, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.3333333333333302}, "ep001": {"nsteps": 500, "reward": -0.3052277488233522, "good_angle": 41.3027307319338, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.600000000000018}, "ep002": {"nsteps": 500, "reward": -0.10230048004770652, "good_angle": 0.6659104569093917, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.9666666666666597}, "ep003": {"nsteps": 500, "reward": -0.06712517729547107, "good_angle": 0.4061192818354377, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 0.9333333333333308}, "ep004": {"nsteps": 500, "reward": -0.3235300897718407, "good_angle": 41.2754370289088, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.099999999999985}}good_angle_max 41.3027307319338 good_angle_mean 16.843258630714534 good_angle_median 0.6659104569093917 good_angle_min 0.4061192818354377 reward_max -0.025241015423089267 reward_mean -0.16468490227229196 reward_median -0.10230048004770652 reward_min -0.3235300897718407 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 17 traveled_tiles_mean 16.4 traveled_tiles_median 16 traveled_tiles_min 16 valid_direction_max 5.600000000000018 valid_direction_mean 2.986666666666665 valid_direction_median 1.9666666666666597 valid_direction_min 0.9333333333333308
No reset possible 112071303Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz timeout yes nutonomy-P50-21102018-11-20 13:29:46+00:00 2018-11-20 14:00:51+00:00 0:31:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111871303Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-21102018-11-20 13:18:47+00:00 2018-11-20 13:24:30+00:00 0:05:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111811302Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-20 12:15:36+00:00 2018-11-20 12:18:55+00:00 0:03:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5323895106250947 deviation-center-line_median 0.2069133082272764 in-drivable-lane_median 1.7666666666666604
other stats deviation-center-line_max 0.5467131081696794 deviation-center-line_mean 0.2602226065031052 deviation-center-line_min 0.109306961893104 deviation-heading_max 1.742323630223919 deviation-heading_mean 1.1567573530878712 deviation-heading_median 1.3282976503274275 deviation-heading_min 0.24355646859871627 driven_any_max 2.1899668958618665 driven_any_mean 0.991835190048022 driven_any_median 0.9696925230542558 driven_any_min 0.3178171092322331 driven_lanedir_max 0.7169311640978855 driven_lanedir_mean 0.45386049169510273 driven_lanedir_min 0.04178689899496413 in-drivable-lane_max 6.533333333333311 in-drivable-lane_mean 2.1733333333333262 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3178171092322331, "driven_lanedir": 0.04178689899496413, "in-drivable-lane": 0.633333333333334, "deviation-heading": 1.3282976503274275, "deviation-center-line": 0.109306961893104}, "ep001": {"driven_any": 1.1502565226532864, "driven_lanedir": 0.6512425203302821, "in-drivable-lane": 1.7666666666666604, "deviation-heading": 1.5861269978141073, "deviation-center-line": 0.30358180641808197}, "ep002": {"driven_any": 0.3314428994384689, "driven_lanedir": 0.32695236442728737, "in-drivable-lane": 0, "deviation-heading": 0.24355646859871627, "deviation-center-line": 0.1345978478073843}, "ep003": {"driven_any": 2.1899668958618665, "driven_lanedir": 0.7169311640978855, "in-drivable-lane": 6.533333333333311, "deviation-heading": 1.742323630223919, "deviation-center-line": 0.5467131081696794}, "ep004": {"driven_any": 0.9696925230542558, "driven_lanedir": 0.5323895106250947, "in-drivable-lane": 1.9333333333333265, "deviation-heading": 0.8834820184751857, "deviation-center-line": 0.2069133082272764}}
No reset possible 111671302Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-20 12:08:27+00:00 2018-11-20 12:10:05+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.66666666666666
other stats episodes details {"ep000": {"nsteps": 50, "reward": -20.329378296332433, "good_angle": 1.468160510939434, "survival_time": 1.6666666666666683, "traveled_tiles": 1, "valid_direction": 1.4000000000000017}, "ep001": {"nsteps": 171, "reward": -7.239350287157944, "good_angle": 12.220765922292202, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.066666666666656}, "ep002": {"nsteps": 49, "reward": -20.82356342794944, "good_angle": 0.0475471341694313, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.03333333333333344}, "ep003": {"nsteps": 328, "reward": -3.9637742684987263, "good_angle": 3.5554145744831076, "survival_time": 10.933333333333303, "traveled_tiles": 4, "valid_direction": 4.066666666666658}, "ep004": {"nsteps": 140, "reward": -8.124590363497763, "good_angle": 1.3339038883512928, "survival_time": 4.66666666666666, "traveled_tiles": 2, "valid_direction": 3.366666666666659}}good_angle_max 12.220765922292202 good_angle_mean 3.725158406047094 good_angle_median 1.468160510939434 good_angle_min 0.0475471341694313 reward_max -3.9637742684987263 reward_mean -12.09613132868726 reward_median -8.124590363497763 reward_min -20.82356342794944 survival_time_max 10.933333333333303 survival_time_mean 4.919999999999992 survival_time_min 1.633333333333335 traveled_tiles_max 4 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 4.066666666666658 valid_direction_mean 2.386666666666662 valid_direction_median 3.066666666666656 valid_direction_min 0.03333333333333344
No reset possible 111621301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-20 11:23:40+00:00 2018-11-20 11:25:58+00:00 0:02:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.582873169132569 deviation-center-line_median 0.20455370794384953 in-drivable-lane_median 0.4
other stats deviation-center-line_max 0.3031086082543192 deviation-center-line_mean 0.20462843504646455 deviation-center-line_min 0.09141731520959732 deviation-heading_max 1.598602787656444 deviation-heading_mean 0.8809383171317908 deviation-heading_median 0.8108670692103306 deviation-heading_min 0.3346950565726476 driven_any_max 1.1630734025839593 driven_any_mean 0.722831473699513 driven_any_median 0.8007200595473488 driven_any_min 0.17684912442880266 driven_lanedir_max 0.7920217491121495 driven_lanedir_mean 0.46927076582913585 driven_lanedir_min 0.14426882883085923 in-drivable-lane_max 2.8666666666666565 in-drivable-lane_mean 1.1133333333333295 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.35853304939487557, "driven_lanedir": 0.14426882883085923, "in-drivable-lane": 0.4, "deviation-heading": 1.598602787656444, "deviation-center-line": 0.1668569456648827}, "ep001": {"driven_any": 1.1149817325425786, "driven_lanedir": 0.665637016607145, "in-drivable-lane": 2.299999999999992, "deviation-heading": 1.1635678494620274, "deviation-center-line": 0.3031086082543192}, "ep002": {"driven_any": 0.8007200595473488, "driven_lanedir": 0.7920217491121495, "in-drivable-lane": 0, "deviation-heading": 0.496958822757504, "deviation-center-line": 0.25720559815967414}, "ep003": {"driven_any": 1.1630734025839593, "driven_lanedir": 0.582873169132569, "in-drivable-lane": 2.8666666666666565, "deviation-heading": 0.8108670692103306, "deviation-center-line": 0.20455370794384953}, "ep004": {"driven_any": 0.17684912442880266, "driven_lanedir": 0.16155306546295645, "in-drivable-lane": 0, "deviation-heading": 0.3346950565726476, "deviation-center-line": 0.09141731520959732}}
No reset possible 111581301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-20 11:22:22+00:00 2018-11-20 11:23:25+00:00 0:01:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111491301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-20 11:20:36+00:00 2018-11-20 11:22:11+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.033333333333329
other stats episodes details {"ep000": {"nsteps": 60, "reward": -16.986505389073862, "good_angle": 0.9061986341032228, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 1.7666666666666693}, "ep001": {"nsteps": 175, "reward": -7.165024964154831, "good_angle": 16.00891330525849, "survival_time": 5.833333333333322, "traveled_tiles": 2, "valid_direction": 3.9333333333333234}, "ep002": {"nsteps": 121, "reward": -8.572560073753957, "good_angle": 0.1181062316229642, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 0.13333333333333286}, "ep003": {"nsteps": 183, "reward": -6.431596156241515, "good_angle": 1.08940483738514, "survival_time": 6.099999999999988, "traveled_tiles": 3, "valid_direction": 3.099999999999989}, "ep004": {"nsteps": 28, "reward": -36.25624855714185, "good_angle": 0.18152285177428645, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}}good_angle_max 16.00891330525849 good_angle_mean 3.66082917202882 good_angle_median 0.9061986341032228 good_angle_min 0.1181062316229642 reward_max -6.431596156241515 reward_mean -15.082387028073205 reward_median -8.572560073753957 reward_min -36.25624855714185 survival_time_max 6.099999999999988 survival_time_mean 3.779999999999995 survival_time_min 0.9333333333333332 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 3.9333333333333234 valid_direction_mean 1.879999999999996 valid_direction_median 1.7666666666666693 valid_direction_min 0.13333333333333286
No reset possible 111301300Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-21102018-11-20 10:25:39+00:00 2018-11-20 10:26:20+00:00 0:00:41 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 127, in run
solve(params, cis)
File "solution.py", line 89, in solve
cis.info('Logging. %s %s %s ' % (str(env.unwrapped.robot_speed), str(env.unwrapped.cur_pos), str(env.unwrapped.cur_angle)))
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'robot_speed'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111201299Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-21102018-11-20 10:19:39+00:00 2018-11-20 10:20:19+00:00 0:00:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 127, in run
solve(params, cis)
File "solution.py", line 72, in solve
env = make_env(config, debug=debug)
File "solution.py", line 38, in make_env
env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
AttributeError: 'module' object has no attribute 'UndistortWrapper'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111191298Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-21102018-11-20 10:14:14+00:00 2018-11-20 10:14:51+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 128, in run
solve(params, cis)
File "solution.py", line 73, in solve
env = make_env(config, debug=debug)
File "solution.py", line 38, in make_env
env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
File "/workspace/wrappers.py", line 392, in __init__
assert env.unwrapped.distortion, "Distortion is false, no need for this wrapper"
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'distortion'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111081297Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-20 09:54:51+00:00 2018-11-20 10:03:27+00:00 0:08:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.051829096858754 deviation-center-line_median 0.92971426400998 in-drivable-lane_median 0.09999999999999964
other stats deviation-center-line_max 0.942361718872175 deviation-center-line_mean 0.8572808146222097 deviation-center-line_min 0.6352737923652181 deviation-heading_max 4.154968182851831 deviation-heading_mean 3.0043615237383805 deviation-heading_median 3.2100480227248354 deviation-heading_min 1.448995458537678 driven_any_max 4.685052912313802 driven_any_mean 4.268651858623994 driven_any_median 4.270000785139785 driven_any_min 3.6056512932929903 driven_lanedir_max 4.666314634594814 driven_lanedir_mean 4.092641922881887 driven_lanedir_min 3.3140298965753785 in-drivable-lane_max 1.2666666666666664 in-drivable-lane_mean 0.3999999999999994 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 4.270000785139785, "driven_lanedir": 3.9149195004453623, "in-drivable-lane": 1.2666666666666664, "deviation-heading": 3.4530617576225806, "deviation-center-line": 0.92971426400998}, "ep001": {"driven_any": 3.6056512932929903, "driven_lanedir": 3.3140298965753785, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 4.154968182851831, "deviation-center-line": 0.942361718872175}, "ep002": {"driven_any": 4.151214909073667, "driven_lanedir": 4.051829096858754, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 2.7547341969549755, "deviation-center-line": 0.8444769561548144}, "ep003": {"driven_any": 4.631339393299723, "driven_lanedir": 4.516116485935129, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.2100480227248354, "deviation-center-line": 0.9345773417088612}, "ep004": {"driven_any": 4.685052912313802, "driven_lanedir": 4.666314634594814, "in-drivable-lane": 0, "deviation-heading": 1.448995458537678, "deviation-center-line": 0.6352737923652181}}
No reset possible 110891296Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-19 19:11:39+00:00 2018-11-19 19:19:58+00:00 0:08:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.059602090256015 deviation-center-line_median 0.9233774452974473 in-drivable-lane_median 0.06666666666666643
other stats deviation-center-line_max 0.949820010509239 deviation-center-line_mean 0.8471167073284788 deviation-center-line_min 0.5946126139614508 deviation-heading_max 4.152007344027524 deviation-heading_mean 3.00191975331795 deviation-heading_median 3.225164541782035 deviation-heading_min 1.5002234411759428 driven_any_max 4.71754922294293 driven_any_mean 4.27810584519334 driven_any_median 4.257084832627703 driven_any_min 3.64324106737124 driven_lanedir_max 4.698600876684635 driven_lanedir_mean 4.1050019299967575 driven_lanedir_min 3.3439683783780128 in-drivable-lane_max 1.2666666666666666 in-drivable-lane_mean 0.39999999999999947 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 4.257084832627703, "driven_lanedir": 3.912478498972464, "in-drivable-lane": 1.2666666666666666, "deviation-heading": 3.4242468414709983, "deviation-center-line": 0.9234806487754208}, "ep001": {"driven_any": 3.64324106737124, "driven_lanedir": 3.3439683783780128, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 4.152007344027524, "deviation-center-line": 0.949820010509239}, "ep002": {"driven_any": 4.147042135683437, "driven_lanedir": 4.059602090256015, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 2.70795659813325, "deviation-center-line": 0.8442928180988358}, "ep003": {"driven_any": 4.625611967341394, "driven_lanedir": 4.510359805692658, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.225164541782035, "deviation-center-line": 0.9233774452974473}, "ep004": {"driven_any": 4.71754922294293, "driven_lanedir": 4.698600876684635, "in-drivable-lane": 0, "deviation-heading": 1.5002234411759428, "deviation-center-line": 0.5946126139614508}}
No reset possible 110791296Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-21102018-11-19 19:01:07+00:00 2018-11-19 19:09:09+00:00 0:08:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110621295Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-19 18:45:48+00:00 2018-11-19 18:52:17+00:00 0:06:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 3.910996529633443 deviation-center-line_median 0.804829668110413 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 1.039879518692922 deviation-center-line_mean 0.7667227890186241 deviation-center-line_min 0.3222291105867537 deviation-heading_max 3.2571936050662273 deviation-heading_mean 2.1809540644258907 deviation-heading_median 2.6458401641549094 deviation-heading_min 0.9822962818116744 driven_any_max 5.123266602593036 driven_any_mean 3.5595592135593237 driven_any_median 4.272131146626368 driven_any_min 1.5077016675170083 driven_lanedir_max 5.10905363944258 driven_lanedir_mean 3.432994515958099 driven_lanedir_min 1.4595445026629377 in-drivable-lane_max 1.0999999999999994 in-drivable-lane_mean 0.25999999999999973 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 4.272131146626368, "driven_lanedir": 3.910996529633443, "in-drivable-lane": 1.0999999999999994, "deviation-heading": 3.2571936050662273, "deviation-center-line": 1.039879518692922}, "ep001": {"driven_any": 2.1447119551227667, "driven_lanedir": 2.0224400944249012, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.6585454794779535, "deviation-center-line": 0.7527271103559265}, "ep002": {"driven_any": 1.5077016675170083, "driven_lanedir": 1.4595445026629377, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3608947916186889, "deviation-center-line": 0.3222291105867537}, "ep003": {"driven_any": 4.74998469593744, "driven_lanedir": 4.66293781362663, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.6458401641549094, "deviation-center-line": 0.804829668110413}, "ep004": {"driven_any": 5.123266602593036, "driven_lanedir": 5.10905363944258, "in-drivable-lane": 0, "deviation-heading": 0.9822962818116744, "deviation-center-line": 0.9139485373471052}}
No reset possible 110501295Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-19 18:42:48+00:00 2018-11-19 18:44:38+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.12137116433726625, "good_angle": 1.0419096888881556, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.633333333333326}, "ep001": {"nsteps": 303, "reward": -3.62843049893931, "good_angle": 15.400139654029603, "survival_time": 10.099999999999977, "traveled_tiles": 5, "valid_direction": 3.1666666666666554}, "ep002": {"nsteps": 186, "reward": -5.627489280993975, "good_angle": 0.27681601352758295, "survival_time": 6.199999999999988, "traveled_tiles": 4, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 500, "reward": -0.18406181560666304, "good_angle": 0.7270384677449752, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 1.6666666666666732}, "ep004": {"nsteps": 500, "reward": -0.04293484631704632, "good_angle": 40.92457506370659, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.633333333333317}}good_angle_max 40.92457506370659 good_angle_mean 11.674095777579382 good_angle_median 1.0419096888881556 good_angle_min 0.27681601352758295 reward_max -0.04293484631704632 reward_mean -1.920857521238852 reward_median -0.18406181560666304 reward_min -5.627489280993975 survival_time_max 16.666666666666654 survival_time_mean 13.259999999999986 survival_time_min 6.199999999999988 traveled_tiles_max 10 traveled_tiles_mean 7.2 traveled_tiles_median 8 traveled_tiles_min 4 valid_direction_max 4.633333333333317 valid_direction_mean 2.56666666666666 valid_direction_median 2.633333333333326 valid_direction_min 0.7333333333333307
No reset possible 110301293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step4-viz success no nutonomy-P50-21102018-11-19 13:55:32+00:00 2018-11-19 13:59:56+00:00 0:04:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median 0.44433964314315433 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 0.5512591199175949 deviation-center-line_mean 0.4645859205989189 deviation-center-line_min 0.39335855914159346 deviation-heading_max 3.5598471575751542 deviation-heading_mean 1.764030711792994 deviation-heading_median 1.381299485180658 deviation-heading_min 1.1199561623878598 driven_any_max 1.49079583364818 driven_any_mean 1.1297417190774648 driven_any_median 1.2306824401524008 driven_any_min 0.6871560381108496 driven_lanedir_max 1.450214316231856 driven_lanedir_mean 0.9909222089183176 driven_lanedir_median 1.1890923792085335 driven_lanedir_min 0.1581492283862641 in-drivable-lane_max 2.7333333333333316 in-drivable-lane_mean 0.5599999999999996 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.6871560381108496, "driven_lanedir": 0.1581492283862641, "in-drivable-lane": 2.7333333333333316, "deviation-heading": 3.5598471575751542, "deviation-center-line": 0.4027841572493933}, "ep001": {"driven_any": 0.8036306246797625, "driven_lanedir": 0.7607355319904787, "in-drivable-lane": 0, "deviation-heading": 1.1199561623878598, "deviation-center-line": 0.39335855914159346}, "ep002": {"driven_any": 1.2306824401524008, "driven_lanedir": 1.1890923792085335, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.381299485180658, "deviation-center-line": 0.5512591199175949}, "ep003": {"driven_any": 1.49079583364818, "driven_lanedir": 1.450214316231856, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3004450133719043, "deviation-center-line": 0.5311881235428586}, "ep004": {"driven_any": 1.4364436587961311, "driven_lanedir": 1.3964195887744555, "in-drivable-lane": 0, "deviation-heading": 1.458605740449393, "deviation-center-line": 0.44433964314315433}}
No reset possible 110241293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step2-scoring success yes nutonomy-P50-21102018-11-19 13:52:09+00:00 2018-11-19 13:53:48+00:00 0:01:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.633333333333306
other stats episodes details {"ep000": {"nsteps": 179, "reward": -7.248710109878269, "good_angle": 10.627331976833926, "survival_time": 5.966666666666655, "traveled_tiles": 1, "valid_direction": 5.266666666666655}, "ep001": {"nsteps": 209, "reward": -5.0600387267233655, "good_angle": 1.184123936080564, "survival_time": 6.966666666666652, "traveled_tiles": 3, "valid_direction": 1.2999999999999954}, "ep002": {"nsteps": 319, "reward": -3.38833040183521, "good_angle": 2.451607556109596, "survival_time": 10.633333333333306, "traveled_tiles": 3, "valid_direction": 1.3666666666666618}, "ep003": {"nsteps": 386, "reward": -2.7739159322207936, "good_angle": 2.434990919949518, "survival_time": 12.866666666666632, "traveled_tiles": 4, "valid_direction": 1.3666666666666618}, "ep004": {"nsteps": 372, "reward": -2.8408372522867222, "good_angle": 3.1134733827407173, "survival_time": 12.399999999999968, "traveled_tiles": 4, "valid_direction": 1.499999999999995}}good_angle_max 10.627331976833926 good_angle_mean 3.962305554342864 good_angle_median 2.451607556109596 good_angle_min 1.184123936080564 reward_max -2.7739159322207936 reward_mean -4.262366484588872 reward_median -3.38833040183521 reward_min -7.248710109878269 survival_time_max 12.866666666666632 survival_time_mean 9.766666666666644 survival_time_min 5.966666666666655 traveled_tiles_max 4 traveled_tiles_mean 3 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 5.266666666666655 valid_direction_mean 2.159999999999994 valid_direction_median 1.3666666666666618 valid_direction_min 1.2999999999999954
No reset possible 110121292Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-21102018-11-19 13:32:02+00:00 2018-11-19 13:32:38+00:00 0:00:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 124, in run
solve(params, cis)
File "solution.py", line 69, in solve
env = make_env(config, debug=debug)
File "solution.py", line 40, in make_env
env = BaseWrapper(env)
File "/workspace/wrappers.py", line 280, in __init__
self.cur_pos = self._env.cur_pos
AttributeError: 'TimeLimit' object has no attribute 'cur_pos'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110041290Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-19 12:51:55+00:00 2018-11-19 12:58:33+00:00 0:06:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.567528656397519 deviation-center-line_median 1.0314261754372154 in-drivable-lane_median 1.8000000000000025
other stats deviation-center-line_max 1.1495890962817945 deviation-center-line_mean 0.9690856088373276 deviation-center-line_min 0.6766247807849696 deviation-heading_max 3.941604068378368 deviation-heading_mean 2.2824951855297098 deviation-heading_median 2.29469239931807 deviation-heading_min 0.490186778431544 driven_any_max 1.77870780337893 driven_any_mean 1.7786930581721971 driven_any_median 1.7786958483229494 driven_any_min 1.778665937185382 driven_lanedir_max 1.7755630287738702 driven_lanedir_mean 1.5640709458206878 driven_lanedir_min 1.3262672930289792 in-drivable-lane_max 3.733333333333355 in-drivable-lane_mean 1.5133333333333367 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.7787039960005906, "driven_lanedir": 1.567528656397519, "in-drivable-lane": 1.8000000000000025, "deviation-heading": 1.5419265634410058, "deviation-center-line": 0.6766247807849696}, "ep001": {"driven_any": 1.778665937185382, "driven_lanedir": 1.3262672930289792, "in-drivable-lane": 3.733333333333355, "deviation-heading": 3.1440661180795613, "deviation-center-line": 1.1495890962817945}, "ep002": {"driven_any": 1.778691705973134, "driven_lanedir": 1.4091608907992712, "in-drivable-lane": 2.033333333333326, "deviation-heading": 3.941604068378368, "deviation-center-line": 1.0314261754372154}, "ep003": {"driven_any": 1.77870780337893, "driven_lanedir": 1.7755630287738702, "in-drivable-lane": 0, "deviation-heading": 0.490186778431544, "deviation-center-line": 0.8534399105921283}, "ep004": {"driven_any": 1.7786958483229494, "driven_lanedir": 1.741834860103799, "in-drivable-lane": 0, "deviation-heading": 2.29469239931807, "deviation-center-line": 1.1343480810905304}}
No reset possible 109971290Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-19 12:46:44+00:00 2018-11-19 12:47:07+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.0997283233529888, "good_angle": 0.2520961888276448, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep001": {"nsteps": 500, "reward": -0.5514429277753224, "good_angle": 14.373030369485033, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 6.800000000000011}, "ep002": {"nsteps": 500, "reward": -0.20782254621386528, "good_angle": 2.347591111222324, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 5.099999999999987}, "ep003": {"nsteps": 500, "reward": -0.22671328952908515, "good_angle": 0.00980639504192846, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.25195742256822995, "good_angle": 11.306899587623128, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.1999999999999886}}good_angle_max 14.373030369485033 good_angle_mean 5.657884730440012 good_angle_median 2.347591111222324 good_angle_min 0.00980639504192846 reward_max -0.0997283233529888 reward_mean -0.26753290188789836 reward_median -0.22671328952908515 reward_min -0.5514429277753224 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 5 traveled_tiles_mean 4.2 traveled_tiles_median 4 traveled_tiles_min 4 valid_direction_max 6.800000000000011 valid_direction_mean 3.019999999999998 valid_direction_median 3.1999999999999886 valid_direction_min 0
No reset possible 109921290Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-21102018-11-19 12:35:29+00:00 2018-11-19 12:45:04+00:00 0:09:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109891289Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-19 11:41:47+00:00 2018-11-19 11:43:22+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109851289Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-19 11:41:18+00:00 2018-11-19 11:41:40+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.5155811812859029, "good_angle": 3.628556763100416, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 6.0333333333333155}, "ep001": {"nsteps": 500, "reward": -1.782332134154145, "good_angle": 61.04875597771131, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 10.7}, "ep002": {"nsteps": 500, "reward": -0.5043799358881078, "good_angle": 3.598961650239402, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 5.999999999999988}, "ep003": {"nsteps": 500, "reward": -0.056422112440224735, "good_angle": 1.5037491973700476, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.1666666666666945}, "ep004": {"nsteps": 500, "reward": -1.9298303503713103, "good_angle": 52.81007762986282, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 7.099999999999975}}good_angle_max 61.04875597771131 good_angle_mean 24.5180202436568 good_angle_median 3.628556763100416 good_angle_min 1.5037491973700476 reward_max -0.056422112440224735 reward_mean -0.957709142827938 reward_median -0.5155811812859029 reward_min -1.9298303503713103 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 9 traveled_tiles_mean 8.6 traveled_tiles_median 9 traveled_tiles_min 8 valid_direction_max 10.7 valid_direction_mean 6.399999999999993 valid_direction_median 6.0333333333333155 valid_direction_min 2.1666666666666945
No reset possible 109841289Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-21102018-11-19 11:33:58+00:00 2018-11-19 11:41:10+00:00 0:07:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109771287Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-21102018-11-19 09:26:00+00:00 2018-11-19 09:33:04+00:00 0:07:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109731286Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-21102018-11-19 09:21:26+00:00 2018-11-19 09:23:53+00:00 0:02:27 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 120, in run
solve(params, cis)
File "solution.py", line 68, in solve
env = make_env(config, debug=debug)
File "solution.py", line 37, in make_env
env = FrameStackWrappper(env=env, k=3, config=config)
File "/workspace/wrappers.py", line 89, in __init__
self.seg_model.load_state_dict(torch.load(config['use_segmentation_weight'])['state_dict'],
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 358, in load
return _load(f, map_location, pickle_module)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 542, in _load
result = unpickler.load()
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 508, in persistent_load
data_type(size), location)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 104, in default_restore_location
result = fn(storage, location)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 75, in _cuda_deserialize
raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location='cpu' to map your storages to the CPU.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109501282Yun Chen PyTorch template aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-19 04:29:16+00:00 2018-11-19 04:31:53+00:00 0:02:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109431282Yun Chen PyTorch template aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-19 04:26:42+00:00 2018-11-19 04:28:34+00:00 0:01:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.966810409963131, "good_angle": 47.08330822850749, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.233333333333322}, "ep001": {"nsteps": 500, "reward": -1.300191262960434, "good_angle": 13.8317262841996, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}, "ep002": {"nsteps": 500, "reward": -1.117795492440462, "good_angle": 13.808909540839275, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.9294596527849426, "good_angle": 13.819737231108473, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}, "ep004": {"nsteps": 500, "reward": -1.163820459574461, "good_angle": 13.824014957850544, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}}good_angle_max 47.08330822850749 good_angle_mean 20.473539248501076 good_angle_median 13.824014957850544 good_angle_min 13.808909540839275 reward_max -0.9294596527849426 reward_mean -1.0956154555446862 reward_median -1.117795492440462 reward_min -1.300191262960434 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 2 traveled_tiles_mean 1.2 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 14.233333333333322 valid_direction_mean 13.266666666666657 valid_direction_median 13.09999999999999 valid_direction_min 12.933333333333326
No reset possible 109271281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-19 04:19:12+00:00 2018-11-19 04:20:54+00:00 0:01:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.566666666666643
other stats episodes details {"ep000": {"nsteps": 500, "reward": -1.1789177468200214, "good_angle": 52.8257833360501, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.466666666666653}, "ep001": {"nsteps": 113, "reward": -10.744224535152975, "good_angle": 3.067664796680797, "survival_time": 3.766666666666663, "traveled_tiles": 1, "valid_direction": 2.899999999999997}, "ep002": {"nsteps": 500, "reward": -1.1421123770271078, "good_angle": 13.471365841535407, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.83333333333332}, "ep003": {"nsteps": 287, "reward": -5.003585959356343, "good_angle": 7.97969443692576, "survival_time": 9.566666666666643, "traveled_tiles": 1, "valid_direction": 7.433333333333315}, "ep004": {"nsteps": 59, "reward": -18.741837305537725, "good_angle": 1.642058174013297, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 1.4666666666666688}}good_angle_max 52.8257833360501 good_angle_mean 15.79731331704107 good_angle_median 7.97969443692576 good_angle_min 1.642058174013297 reward_max -1.1421123770271078 reward_mean -7.3621355847788355 reward_median -5.003585959356343 reward_min -18.741837305537725 survival_time_max 16.666666666666654 survival_time_mean 9.726666666666656 survival_time_min 1.9666666666666697 traveled_tiles_max 1 traveled_tiles_mean 1 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 14.466666666666653 valid_direction_mean 7.8199999999999905 valid_direction_median 7.433333333333315 valid_direction_min 1.4666666666666688
No reset possible 109181281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-21102018-11-19 04:11:10+00:00 2018-11-19 04:17:51+00:00 0:06:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109041280Yun Chen Random execution aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-19 03:53:05+00:00 2018-11-19 03:56:42+00:00 0:03:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.0912619516892297 deviation-center-line_median 0.35434867307286394 in-drivable-lane_median 0.09999999999999964
other stats deviation-center-line_max 0.5503217644623789 deviation-center-line_mean 0.3430555191422603 deviation-center-line_min 0.19008849208663176 deviation-heading_max 3.5738141012812856 deviation-heading_mean 1.5780346998192003 deviation-heading_median 1.6281599088608705 deviation-heading_min 0.17673821454925606 driven_any_max 1.600431044772758 driven_any_mean 0.8967643246163399 driven_any_median 1.0949819717424556 driven_any_min 0.2573432846425337 driven_lanedir_max 1.2646710312972245 driven_lanedir_mean 0.7693333122921573 driven_lanedir_min 0.1261801357102449 in-drivable-lane_max 0.7999999999999972 in-drivable-lane_mean 0.2999999999999994 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3483184683821576, "driven_lanedir": 0.1261801357102449, "in-drivable-lane": 0.6, "deviation-heading": 2.035647668091897, "deviation-center-line": 0.19008849208663176}, "ep001": {"driven_any": 0.2573432846425337, "driven_lanedir": 0.2561200256083098, "in-drivable-lane": 0, "deviation-heading": 0.17673821454925606, "deviation-center-line": 0.20420172648538432}, "ep002": {"driven_any": 1.182746853541795, "driven_lanedir": 1.1084334171557773, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.6281599088608705, "deviation-center-line": 0.35434867307286394}, "ep003": {"driven_any": 1.0949819717424556, "driven_lanedir": 1.0912619516892297, "in-drivable-lane": 0, "deviation-heading": 0.4758136063126942, "deviation-center-line": 0.4163169396040424}, "ep004": {"driven_any": 1.600431044772758, "driven_lanedir": 1.2646710312972245, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 3.5738141012812856, "deviation-center-line": 0.5503217644623789}}
No reset possible 108971280Yun Chen Random execution aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-19 03:49:35+00:00 2018-11-19 03:51:41+00:00 0:02:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.899999999999982
other stats episodes details {"ep000": {"nsteps": 76, "reward": -13.42328537154428, "good_angle": 1.31855134729387, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.1666666666666674}, "ep001": {"nsteps": 57, "reward": -18.10796422968831, "good_angle": 0.017493659951504554, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 257, "reward": -4.158510393423213, "good_angle": 0.9762896932693614, "survival_time": 8.566666666666647, "traveled_tiles": 3, "valid_direction": 1.9999999999999936}, "ep003": {"nsteps": 237, "reward": -4.447631578342321, "good_angle": 0.05458096838191104, "survival_time": 7.899999999999982, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 344, "reward": -3.5090922378065357, "good_angle": 20.564117705134475, "survival_time": 11.466666666666637, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}good_angle_max 20.564117705134475 good_angle_mean 4.586206674806225 good_angle_median 0.9762896932693614 good_angle_min 0.017493659951504554 reward_max -3.5090922378065357 reward_mean -8.729296762160931 reward_median -4.447631578342321 reward_min -18.10796422968831 survival_time_max 11.466666666666637 survival_time_mean 6.47333333333332 survival_time_min 1.9000000000000024 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.93333333333332 valid_direction_mean 1.619999999999996 valid_direction_median 1.9999999999999936 valid_direction_min 0
No reset possible 108761279Yun Chen ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-19 03:29:02+00:00 2018-11-19 03:34:06+00:00 0:05:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.2332896871989636 deviation-center-line_median 0.2116792544883902 in-drivable-lane_median 0
other stats deviation-center-line_max 0.6323564732185519 deviation-center-line_mean 0.2912504656486582 deviation-center-line_min 0.12670548452775535 deviation-heading_max 1.728976789403258 deviation-heading_mean 0.8194124233994693 deviation-heading_median 0.582523377361064 deviation-heading_min 0.4668112744530743 driven_any_max 1.0714883694442423 driven_any_mean 0.39858127916586666 driven_any_median 0.25000443206491196 driven_any_min 0.14641855465317552 driven_lanedir_max 0.8388467814636376 driven_lanedir_mean 0.33922668007033285 driven_lanedir_min 0.129237910180789 in-drivable-lane_max 1.9000000000000024 in-drivable-lane_mean 0.3800000000000005 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.0714883694442423, "driven_lanedir": 0.8388467814636376, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.728976789403258, "deviation-center-line": 0.6323564732185519}, "ep001": {"driven_any": 0.3250077317230347, "driven_lanedir": 0.31702584203169426, "in-drivable-lane": 0, "deviation-heading": 0.4668112744530743, "deviation-center-line": 0.35258484316877714}, "ep002": {"driven_any": 0.14641855465317552, "driven_lanedir": 0.129237910180789, "in-drivable-lane": 0, "deviation-heading": 0.582523377361064, "deviation-center-line": 0.12670548452775535}, "ep003": {"driven_any": 0.1999873079439689, "driven_lanedir": 0.17773317947657974, "in-drivable-lane": 0, "deviation-heading": 0.742904646059641, "deviation-center-line": 0.13292627283981628}, "ep004": {"driven_any": 0.25000443206491196, "driven_lanedir": 0.2332896871989636, "in-drivable-lane": 0, "deviation-heading": 0.5758460297203092, "deviation-center-line": 0.2116792544883902}}
No reset possible 108651279Yun Chen ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-21102018-11-19 03:24:10+00:00 2018-11-19 03:27:59+00:00 0:03:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108561278Rob Venables Solution template aido1_luck-v3step1 success yes nutonomy-P50-21102018-11-19 03:20:59+00:00 2018-11-19 03:21:41+00:00 0:00:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108531277Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation error no nutonomy-P50-21102018-11-19 02:56:16+00:00 2018-11-19 03:07:00+00:00 0:10:44 Timeout:
Waited 600 [...] Timeout:
Waited 600.775145054 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108401276Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-21102018-11-19 02:17:02+00:00 2018-11-19 02:27:48+00:00 0:10:46 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108351275Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation error no nutonomy-P50-21102018-11-19 01:40:38+00:00 2018-11-19 01:51:26+00:00 0:10:48 Timeout:
Waited 607 [...] Timeout:
Waited 607.332171917 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108291274Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation error no nutonomy-P50-21102018-11-19 01:24:54+00:00 2018-11-19 01:35:31+00:00 0:10:37 Timeout:
Waited 600 [...] Timeout:
Waited 600.989454985 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108241273Guohao Li Solution template aido1_luck-v3step1 success yes nutonomy-P50-21102018-11-18 21:57:52+00:00 2018-11-18 21:58:29+00:00 0:00:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108051271Andrea Censi Random execution aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-18 13:50:53+00:00 2018-11-18 13:52:44+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.49999999999998
other stats episodes details {"ep000": {"nsteps": 81, "reward": -12.594963072856634, "good_angle": 1.179753153433826, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 230, "reward": -5.431255984695062, "good_angle": 16.109426524471456, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 255, "reward": -4.346870108328614, "good_angle": 1.0142558554378145, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.0999999999999934}, "ep003": {"nsteps": 361, "reward": -3.0704857812487516, "good_angle": 0.034109257356551625, "survival_time": 12.0333333333333, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.565080447820505, "good_angle": 21.142156874080055, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}good_angle_max 21.142156874080055 good_angle_mean 7.8959403329559406 good_angle_median 1.179753153433826 good_angle_min 0.034109257356551625 reward_max -3.0704857812487516 reward_mean -5.8017310789899135 reward_median -4.346870108328614 reward_min -12.594963072856634 survival_time_max 12.0333333333333 survival_time_mean 8.486666666666647 survival_time_min 2.7 traveled_tiles_max 4 traveled_tiles_mean 2.6 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.9666666666666535 valid_direction_mean 2.4466666666666597 valid_direction_median 2.2333333333333334 valid_direction_min 0
No reset possible
Andrea Censi 🇨🇭
