AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 351

evaluator351
ownerAndrea Censi
machineidsc-rudolf
processidsc-rudolf-18328
versionDC:3.1.57;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success57
# timeout
# failed12
# error3
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
113961308Dzenan LapandicLFV bd testaido1_LFV_r1-v3step1-simulationfailedno3510:02:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 135, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
11388942Claudio RuchPython templateaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3510:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-32.87038394834193


other stats
efficiency-64.14325579336746
fleet_size-1000000000
11382945Claudio RuchPython templateaido1_amod_fleet_size_r1-v3step2-scoringsuccessyes3510:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
fleet_size-1000000000


other stats
efficiency-63.45590163968151
service_quality-32.5813154099211
11366945Claudio RuchPython templateaido1_amod_fleet_size_r1-v3step1-simulationsuccessyes3510:04:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
11357950Claudio RuchFunky Controller 1aido1_amod_efficiency_r1-v3step2-scoringsuccessyes3510:01:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency-73.71543919268404


other stats
fleet_size-1000000000
service_quality-35.358429798170974
11347212Andrea CensiPython templateaido1_amod_efficiency_r1-v3step2-scoringsuccessyes3510:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency-64.05881123584692


other stats
fleet_size-1000000000
service_quality-32.88480280896185
11342210Andrea CensiPython templateaido1_amod_service_quality_r1-v3step1-simulationsuccessyes3510:04:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
113331067Claudio RuchWebinar Algorithmaido1_amod_service_quality_r1-v3step1-simulationerroryes3510:11:03
Timeout: Waited 601 [...]
Timeout:

Waited 601.927587032 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
113201078Claudio RuchBig Fleet Controlleraido1_amod_fleet_size_r1-v3step1-simulationerroryes3510:11:19
Timeout: Waited 601 [...]
Timeout:

Waited 601.661817074 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
113091307inat777ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3510:01:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2272303180768307
deviation-center-line_median0.20681915361280567
in-drivable-lane_median0


other stats
deviation-center-line_max0.3568243903921427
deviation-center-line_mean0.2339024184529846
deviation-center-line_min0.12317304458368264
deviation-heading_max1.7477521518583374
deviation-heading_mean0.8385864351768578
deviation-heading_median0.625932399356574
deviation-heading_min0.4663073293798452
driven_any_max0.7928832038719099
driven_any_mean0.3442899087143174
driven_any_median0.2464303825004456
driven_any_min0.16427501307806475
driven_lanedir_max0.5568157761076884
driven_lanedir_mean0.28308198639260274
driven_lanedir_min0.1488538314418193
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7928832038719099, "driven_lanedir": 0.5568157761076884, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7477521518583374, "deviation-center-line": 0.3451234776069457}, "ep001": {"driven_any": 0.3285759873680623, "driven_lanedir": 0.3206965291801671, "in-drivable-lane": 0, "deviation-heading": 0.4663073293798452, "deviation-center-line": 0.3568243903921427}, "ep002": {"driven_any": 0.16427501307806475, "driven_lanedir": 0.1488538314418193, "in-drivable-lane": 0, "deviation-heading": 0.5559356998062136, "deviation-center-line": 0.137572026069346}, "ep003": {"driven_any": 0.18928495675310453, "driven_lanedir": 0.16181347715650807, "in-drivable-lane": 0, "deviation-heading": 0.7970045954833189, "deviation-center-line": 0.12317304458368264}, "ep004": {"driven_any": 0.2464303825004456, "driven_lanedir": 0.2272303180768307, "in-drivable-lane": 0, "deviation-heading": 0.625932399356574, "deviation-center-line": 0.20681915361280567}}
113031307inat777ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3510:00:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
112951307inat777ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.366666666666668


other stats
episodes
details{"ep000": {"nsteps": 224, "reward": -4.614468659430713, "good_angle": 0.736912173000433, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 1.099999999999996}, "ep001": {"nsteps": 94, "reward": -11.249216741703924, "good_angle": 0.19649234145495015, "survival_time": 3.133333333333332, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 48, "reward": -21.30313229933381, "good_angle": 0.36602712571830665, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.6666666666666681}, "ep003": {"nsteps": 55, "reward": -18.556428309191357, "good_angle": 0.6146218368799753, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0.6666666666666687}, "ep004": {"nsteps": 71, "reward": -14.55548485525897, "good_angle": 0.42671573150912695, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0.6333333333333326}}
good_angle_max0.736912173000433
good_angle_mean0.4681538417125584
good_angle_median0.42671573150912695
good_angle_min0.19649234145495015
reward_max-4.614468659430713
reward_mean-14.055746172983756
reward_median-14.55548485525897
reward_min-21.30313229933381
survival_time_max7.46666666666665
survival_time_mean3.2799999999999976
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.099999999999996
valid_direction_mean0.6733333333333329
valid_direction_median0.6666666666666681
valid_direction_min0.29999999999999893
112851306trimcaoBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videossuccessyes3510:02:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
112631305heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyes3510:04:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median8.466416467829077
deviation-center-line_median0.7491075821771831
in-drivable-lane_median0.06666666666666643


other stats
deviation-center-line_max1.0852097769842697
deviation-center-line_mean0.6828056697229344
deviation-center-line_min0.110456458929874
deviation-heading_max3.088169914104725
deviation-heading_mean1.9361613489916736
deviation-heading_median1.9716545225234337
deviation-heading_min0.5532418461875583
driven_any_max9.395397994412496
driven_any_mean6.118783919231438
driven_any_median8.673270359145661
driven_any_min1.2271279931045092
driven_lanedir_max9.106972393834644
driven_lanedir_mean5.887907266761421
driven_lanedir_min1.1523564491476126
in-drivable-lane_max0.6999999999999994
in-drivable-lane_mean0.19999999999999968
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 9.13343633823087, "driven_lanedir": 8.632442293612678, "in-drivable-lane": 0.6999999999999994, "deviation-heading": 2.9109849023974417, "deviation-center-line": 1.0852097769842697}, "ep001": {"driven_any": 2.164686911263656, "driven_lanedir": 2.0813487293830906, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.1567555597452082, "deviation-center-line": 0.3937472257413113}, "ep002": {"driven_any": 1.2271279931045092, "driven_lanedir": 1.1523564491476126, "in-drivable-lane": 0, "deviation-heading": 0.5532418461875583, "deviation-center-line": 0.110456458929874}, "ep003": {"driven_any": 9.395397994412496, "driven_lanedir": 9.106972393834644, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.088169914104725, "deviation-center-line": 1.0755073047820347}, "ep004": {"driven_any": 8.673270359145661, "driven_lanedir": 8.466416467829077, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.9716545225234337, "deviation-center-line": 0.7491075821771831}}
112541305heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.999999999999956


other stats
episodes
details{"ep000": {"nsteps": 496, "reward": -2.0943019221591648, "good_angle": 0.7418744038601746, "survival_time": 16.533333333333314, "traveled_tiles": 15, "valid_direction": 2.0999999999999934}, "ep001": {"nsteps": 157, "reward": -6.806706450876608, "good_angle": 14.159941219201931, "survival_time": 5.2333333333333245, "traveled_tiles": 5, "valid_direction": 2.0999999999999996}, "ep002": {"nsteps": 59, "reward": -17.04080068322009, "good_angle": 0.15271570187640776, "survival_time": 1.9666666666666697, "traveled_tiles": 3, "valid_direction": 0.33333333333333437}, "ep003": {"nsteps": 500, "reward": 0.02414321799436584, "good_angle": 0.6871705559821161, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.1333333333333302}, "ep004": {"nsteps": 450, "reward": -2.2807499980605725, "good_angle": 35.64433197185651, "survival_time": 14.999999999999956, "traveled_tiles": 17, "valid_direction": 4.83333333333332}}
good_angle_max35.64433197185651
good_angle_mean10.277206770555429
good_angle_median0.7418744038601746
good_angle_min0.15271570187640776
reward_max0.02414321799436584
reward_mean-5.639683167264414
reward_median-2.2807499980605725
reward_min-17.04080068322009
survival_time_max16.666666666666654
survival_time_mean11.079999999999984
survival_time_min1.9666666666666697
traveled_tiles_max17
traveled_tiles_mean11.2
traveled_tiles_median15
traveled_tiles_min3
valid_direction_max4.83333333333332
valid_direction_mean2.0999999999999956
valid_direction_median2.0999999999999934
valid_direction_min0.33333333333333437
112481305heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessno3510:04:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
112421303heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyes3510:04:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.247947866530568
deviation-center-line_median0.4327948281734701
in-drivable-lane_median0.33333333333333215


other stats
deviation-center-line_max0.8951573984927605
deviation-center-line_mean0.5294639676056159
deviation-center-line_min0.2553864082264141
deviation-heading_max2.5086434238842648
deviation-heading_mean1.7176914721650511
deviation-heading_median1.3764712107670771
deviation-heading_min0.935815621123276
driven_any_max9.83643308694634
driven_any_mean5.49635327088284
driven_any_median4.3797351459243234
driven_any_min2.1044204655967538
driven_lanedir_max9.247955113262256
driven_lanedir_mean5.215254784547498
driven_lanedir_min1.8076115267915815
in-drivable-lane_max0.7999999999999972
in-drivable-lane_mean0.3466666666666658
in-drivable-lane_min0.033333333333333215
per-episodes
details{"ep000": {"driven_any": 2.4350440530543422, "driven_lanedir": 2.1641183480391843, "in-drivable-lane": 0.5, "deviation-heading": 0.935815621123276, "deviation-center-line": 0.2553864082264141}, "ep001": {"driven_any": 2.1044204655967538, "driven_lanedir": 1.8076115267915815, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 1.3764712107670771, "deviation-center-line": 0.3623346537121123}, "ep002": {"driven_any": 9.83643308694634, "driven_lanedir": 9.247955113262256, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 2.4644149719140565, "deviation-center-line": 0.8951573984927605}, "ep003": {"driven_any": 4.3797351459243234, "driven_lanedir": 4.247947866530568, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.3031121331365825, "deviation-center-line": 0.4327948281734701}, "ep004": {"driven_any": 8.726133602892439, "driven_lanedir": 8.608641068113897, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.5086434238842648, "deviation-center-line": 0.701646549423322}}
112271304heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyes3510:04:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
112211304heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.025241015423089267, "good_angle": 0.5660956539852379, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.3333333333333302}, "ep001": {"nsteps": 500, "reward": -0.3052277488233522, "good_angle": 41.3027307319338, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.600000000000018}, "ep002": {"nsteps": 500, "reward": -0.10230048004770652, "good_angle": 0.6659104569093917, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.9666666666666597}, "ep003": {"nsteps": 500, "reward": -0.06712517729547107, "good_angle": 0.4061192818354377, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 0.9333333333333308}, "ep004": {"nsteps": 500, "reward": -0.3235300897718407, "good_angle": 41.2754370289088, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.099999999999985}}
good_angle_max41.3027307319338
good_angle_mean16.843258630714534
good_angle_median0.6659104569093917
good_angle_min0.4061192818354377
reward_max-0.025241015423089267
reward_mean-0.16468490227229196
reward_median-0.10230048004770652
reward_min-0.3235300897718407
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max17
traveled_tiles_mean16.4
traveled_tiles_median16
traveled_tiles_min16
valid_direction_max5.600000000000018
valid_direction_mean2.986666666666665
valid_direction_median1.9666666666666597
valid_direction_min0.9333333333333308
112141304heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessno3510:08:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
111981303heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyes3510:02:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
111941303heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.333333333333317


other stats
episodes
details{"ep000": {"nsteps": 135, "reward": -7.617946757625624, "good_angle": 0.24914791547711929, "survival_time": 4.499999999999994, "traveled_tiles": 5, "valid_direction": 0.5999999999999985}, "ep001": {"nsteps": 149, "reward": -7.085851560353032, "good_angle": 10.035174620388348, "survival_time": 4.966666666666659, "traveled_tiles": 5, "valid_direction": 1.8999999999999992}, "ep002": {"nsteps": 500, "reward": -0.12116984189208596, "good_angle": 0.6114449517312698, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.6333333333333275}, "ep003": {"nsteps": 220, "reward": -4.690160607782045, "good_angle": 0.18338344049862731, "survival_time": 7.333333333333317, "traveled_tiles": 8, "valid_direction": 0.3999999999999986}, "ep004": {"nsteps": 500, "reward": -0.31342388660390863, "good_angle": 33.864049863006905, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.833333333333349}}
good_angle_max33.864049863006905
good_angle_mean8.988640158220454
good_angle_median0.6114449517312698
good_angle_min0.18338344049862731
reward_max-0.12116984189208596
reward_mean-3.9657105308513385
reward_median-4.690160607782045
reward_min-7.617946757625624
survival_time_max16.666666666666654
survival_time_mean10.026666666666651
survival_time_min4.499999999999994
traveled_tiles_max18
traveled_tiles_mean10.8
traveled_tiles_median8
traveled_tiles_min5
valid_direction_max4.833333333333349
valid_direction_mean1.8733333333333348
valid_direction_median1.6333333333333275
valid_direction_min0.3999999999999986
111791302heyt0nyTemplate for ROS Submissionaido1_LF1_r3-v3step4-vizsuccessyes3510:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5323895106250947
deviation-center-line_median0.2069133082272764
in-drivable-lane_median1.7666666666666604


other stats
deviation-center-line_max0.5467131081696794
deviation-center-line_mean0.2602226065031052
deviation-center-line_min0.109306961893104
deviation-heading_max1.742323630223919
deviation-heading_mean1.1567573530878712
deviation-heading_median1.3282976503274275
deviation-heading_min0.24355646859871627
driven_any_max2.1899668958618665
driven_any_mean0.991835190048022
driven_any_median0.9696925230542558
driven_any_min0.3178171092322331
driven_lanedir_max0.7169311640978855
driven_lanedir_mean0.45386049169510273
driven_lanedir_min0.04178689899496413
in-drivable-lane_max6.533333333333311
in-drivable-lane_mean2.1733333333333262
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3178171092322331, "driven_lanedir": 0.04178689899496413, "in-drivable-lane": 0.633333333333334, "deviation-heading": 1.3282976503274275, "deviation-center-line": 0.109306961893104}, "ep001": {"driven_any": 1.1502565226532864, "driven_lanedir": 0.6512425203302821, "in-drivable-lane": 1.7666666666666604, "deviation-heading": 1.5861269978141073, "deviation-center-line": 0.30358180641808197}, "ep002": {"driven_any": 0.3314428994384689, "driven_lanedir": 0.32695236442728737, "in-drivable-lane": 0, "deviation-heading": 0.24355646859871627, "deviation-center-line": 0.1345978478073843}, "ep003": {"driven_any": 2.1899668958618665, "driven_lanedir": 0.7169311640978855, "in-drivable-lane": 6.533333333333311, "deviation-heading": 1.742323630223919, "deviation-center-line": 0.5467131081696794}, "ep004": {"driven_any": 0.9696925230542558, "driven_lanedir": 0.5323895106250947, "in-drivable-lane": 1.9333333333333265, "deviation-heading": 0.8834820184751857, "deviation-center-line": 0.2069133082272764}}
111641302heyt0nyTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessno3510:03:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
111541301heyt0nyTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessyes3510:01:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
111481301heyt0nyTemplate for ROS Submissionaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.033333333333329


other stats
episodes
details{"ep000": {"nsteps": 60, "reward": -16.986505389073862, "good_angle": 0.9061986341032228, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 1.7666666666666693}, "ep001": {"nsteps": 175, "reward": -7.165024964154831, "good_angle": 16.00891330525849, "survival_time": 5.833333333333322, "traveled_tiles": 2, "valid_direction": 3.9333333333333234}, "ep002": {"nsteps": 121, "reward": -8.572560073753957, "good_angle": 0.1181062316229642, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 0.13333333333333286}, "ep003": {"nsteps": 183, "reward": -6.431596156241515, "good_angle": 1.08940483738514, "survival_time": 6.099999999999988, "traveled_tiles": 3, "valid_direction": 3.099999999999989}, "ep004": {"nsteps": 28, "reward": -36.25624855714185, "good_angle": 0.18152285177428645, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}}
good_angle_max16.00891330525849
good_angle_mean3.66082917202882
good_angle_median0.9061986341032228
good_angle_min0.1181062316229642
reward_max-6.431596156241515
reward_mean-15.082387028073205
reward_median-8.572560073753957
reward_min-36.25624855714185
survival_time_max6.099999999999988
survival_time_mean3.779999999999995
survival_time_min0.9333333333333332
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.9333333333333234
valid_direction_mean1.879999999999996
valid_direction_median1.7666666666666693
valid_direction_min0.13333333333333286
111371300heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3510:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 89, in solve
    cis.info('Logging. %s %s %s ' % (str(env.unwrapped.robot_speed), str(env.unwrapped.cur_pos), str(env.unwrapped.cur_angle)))
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'robot_speed'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
111281299heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3510:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 72, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 38, in make_env
    env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
AttributeError: 'module' object has no attribute 'UndistortWrapper'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
111151298heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3510:00:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 128, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 38, in make_env
    env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
  File "/workspace/wrappers.py", line 392, in __init__
    assert env.unwrapped.distortion, "Distortion is false, no need for this wrapper"
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'distortion'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
111061297heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyes3510:08:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.051829096858754
deviation-center-line_median0.92971426400998
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max0.942361718872175
deviation-center-line_mean0.8572808146222097
deviation-center-line_min0.6352737923652181
deviation-heading_max4.154968182851831
deviation-heading_mean3.0043615237383805
deviation-heading_median3.2100480227248354
deviation-heading_min1.448995458537678
driven_any_max4.685052912313802
driven_any_mean4.268651858623994
driven_any_median4.270000785139785
driven_any_min3.6056512932929903
driven_lanedir_max4.666314634594814
driven_lanedir_mean4.092641922881887
driven_lanedir_min3.3140298965753785
in-drivable-lane_max1.2666666666666664
in-drivable-lane_mean0.3999999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.270000785139785, "driven_lanedir": 3.9149195004453623, "in-drivable-lane": 1.2666666666666664, "deviation-heading": 3.4530617576225806, "deviation-center-line": 0.92971426400998}, "ep001": {"driven_any": 3.6056512932929903, "driven_lanedir": 3.3140298965753785, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 4.154968182851831, "deviation-center-line": 0.942361718872175}, "ep002": {"driven_any": 4.151214909073667, "driven_lanedir": 4.051829096858754, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 2.7547341969549755, "deviation-center-line": 0.8444769561548144}, "ep003": {"driven_any": 4.631339393299723, "driven_lanedir": 4.516116485935129, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.2100480227248354, "deviation-center-line": 0.9345773417088612}, "ep004": {"driven_any": 4.685052912313802, "driven_lanedir": 4.666314634594814, "in-drivable-lane": 0, "deviation-heading": 1.448995458537678, "deviation-center-line": 0.6352737923652181}}
110811296heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.13191250260279047, "good_angle": 0.9342887944446808, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.233333333333327}, "ep001": {"nsteps": 500, "reward": -0.3301688215431059, "good_angle": 31.76286504283027, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 5.76666666666666}, "ep002": {"nsteps": 500, "reward": -0.025698846134357155, "good_angle": 0.711488019133847, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 1.86666666666666}, "ep003": {"nsteps": 500, "reward": -0.13875287239276804, "good_angle": 0.7780243634004977, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 1.933333333333341}, "ep004": {"nsteps": 500, "reward": -0.3089834259635536, "good_angle": 37.28687603320567, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.599999999999984}}
good_angle_max37.28687603320567
good_angle_mean14.294708450602991
good_angle_median0.9342887944446808
good_angle_min0.711488019133847
reward_max-0.025698846134357155
reward_mean-0.18710329372731505
reward_median-0.13875287239276804
reward_min-0.3301688215431059
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max10
traveled_tiles_mean8.8
traveled_tiles_median9
traveled_tiles_min8
valid_direction_max5.76666666666666
valid_direction_mean3.279999999999994
valid_direction_median2.233333333333327
valid_direction_min1.86666666666666
110801296heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessno3510:07:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
110691295heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyes3510:05:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.910996529633443
deviation-center-line_median0.804829668110413
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max1.039879518692922
deviation-center-line_mean0.7667227890186241
deviation-center-line_min0.3222291105867537
deviation-heading_max3.2571936050662273
deviation-heading_mean2.1809540644258907
deviation-heading_median2.6458401641549094
deviation-heading_min0.9822962818116744
driven_any_max5.123266602593036
driven_any_mean3.5595592135593237
driven_any_median4.272131146626368
driven_any_min1.5077016675170083
driven_lanedir_max5.10905363944258
driven_lanedir_mean3.432994515958099
driven_lanedir_min1.4595445026629377
in-drivable-lane_max1.0999999999999994
in-drivable-lane_mean0.25999999999999973
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.272131146626368, "driven_lanedir": 3.910996529633443, "in-drivable-lane": 1.0999999999999994, "deviation-heading": 3.2571936050662273, "deviation-center-line": 1.039879518692922}, "ep001": {"driven_any": 2.1447119551227667, "driven_lanedir": 2.0224400944249012, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.6585454794779535, "deviation-center-line": 0.7527271103559265}, "ep002": {"driven_any": 1.5077016675170083, "driven_lanedir": 1.4595445026629377, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3608947916186889, "deviation-center-line": 0.3222291105867537}, "ep003": {"driven_any": 4.74998469593744, "driven_lanedir": 4.66293781362663, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.6458401641549094, "deviation-center-line": 0.804829668110413}, "ep004": {"driven_any": 5.123266602593036, "driven_lanedir": 5.10905363944258, "in-drivable-lane": 0, "deviation-heading": 0.9822962818116744, "deviation-center-line": 0.9139485373471052}}
110541295heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyes3510:01:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
110491295heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.12137116433726625, "good_angle": 1.0419096888881556, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.633333333333326}, "ep001": {"nsteps": 303, "reward": -3.62843049893931, "good_angle": 15.400139654029603, "survival_time": 10.099999999999977, "traveled_tiles": 5, "valid_direction": 3.1666666666666554}, "ep002": {"nsteps": 186, "reward": -5.627489280993975, "good_angle": 0.27681601352758295, "survival_time": 6.199999999999988, "traveled_tiles": 4, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 500, "reward": -0.18406181560666304, "good_angle": 0.7270384677449752, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 1.6666666666666732}, "ep004": {"nsteps": 500, "reward": -0.04293484631704632, "good_angle": 40.92457506370659, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.633333333333317}}
good_angle_max40.92457506370659
good_angle_mean11.674095777579382
good_angle_median1.0419096888881556
good_angle_min0.27681601352758295
reward_max-0.04293484631704632
reward_mean-1.920857521238852
reward_median-0.18406181560666304
reward_min-5.627489280993975
survival_time_max16.666666666666654
survival_time_mean13.259999999999986
survival_time_min6.199999999999988
traveled_tiles_max10
traveled_tiles_mean7.2
traveled_tiles_median8
traveled_tiles_min4
valid_direction_max4.633333333333317
valid_direction_mean2.56666666666666
valid_direction_median2.633333333333326
valid_direction_min0.7333333333333307
110411294heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3510:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 126, in run
    solve(params, cis)
  File "solution.py", line 72, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 38, in make_env
    env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
  File "/workspace/wrappers.py", line 392, in __init__
    assert env.unwrapped.distortion, "Distortion is false, no need for this wrapper"
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'distortion'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
110341293Dzenan LapandicLFV bd testaido1_LFV_r1-v3step4-vizsuccessno3510:03:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.44433964314315433
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.5512591199175949
deviation-center-line_mean0.4645859205989189
deviation-center-line_min0.39335855914159346
deviation-heading_max3.5598471575751542
deviation-heading_mean1.764030711792994
deviation-heading_median1.381299485180658
deviation-heading_min1.1199561623878598
driven_any_max1.49079583364818
driven_any_mean1.1297417190774648
driven_any_median1.2306824401524008
driven_any_min0.6871560381108496
driven_lanedir_max1.450214316231856
driven_lanedir_mean0.9909222089183176
driven_lanedir_median1.1890923792085335
driven_lanedir_min0.1581492283862641
in-drivable-lane_max2.7333333333333316
in-drivable-lane_mean0.5599999999999996
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6871560381108496, "driven_lanedir": 0.1581492283862641, "in-drivable-lane": 2.7333333333333316, "deviation-heading": 3.5598471575751542, "deviation-center-line": 0.4027841572493933}, "ep001": {"driven_any": 0.8036306246797625, "driven_lanedir": 0.7607355319904787, "in-drivable-lane": 0, "deviation-heading": 1.1199561623878598, "deviation-center-line": 0.39335855914159346}, "ep002": {"driven_any": 1.2306824401524008, "driven_lanedir": 1.1890923792085335, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.381299485180658, "deviation-center-line": 0.5512591199175949}, "ep003": {"driven_any": 1.49079583364818, "driven_lanedir": 1.450214316231856, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3004450133719043, "deviation-center-line": 0.5311881235428586}, "ep004": {"driven_any": 1.4364436587961311, "driven_lanedir": 1.3964195887744555, "in-drivable-lane": 0, "deviation-heading": 1.458605740449393, "deviation-center-line": 0.44433964314315433}}
110291293Dzenan LapandicLFV bd testaido1_LFV_r1-v3step3-videossuccessyes3510:01:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
110201293Dzenan LapandicLFV bd testaido1_LFV_r1-v3step1-simulationsuccessno3510:04:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
110111292heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3510:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 40, in make_env
    env = BaseWrapper(env)
  File "/workspace/wrappers.py", line 280, in __init__
    self.cur_pos = self._env.cur_pos
AttributeError: 'TimeLimit' object has no attribute 'cur_pos'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
110091291heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3510:00:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 40, in make_env
    env = BaseWrapper(env)
  File "/workspace/wrappers.py", line 278, in __init__
    super().__init__(env)
TypeError: super() takes at least 1 argument (0 given)


Hidden. If you are the author, please login using the top-right link or use the dashboard.
109791288heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessno3510:10:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
109751286heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3510:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    solve(params, cis)
  File "solution.py", line 68, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 37, in make_env
    env = FrameStackWrappper(env=env, k=3, config=config)
  File "/workspace/wrappers.py", line 89, in __init__
    self.seg_model.load_state_dict(torch.load(config['use_segmentation_weight'])['state_dict'],
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 508, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 104, in default_restore_location
    result = fn(storage, location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 75, in _cuda_deserialize
    raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location='cpu' to map your storages to the CPU.


Hidden. If you are the author, please login using the top-right link or use the dashboard.
109701285heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3510:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    solve(params, cis)
  File "solution.py", line 68, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 37, in make_env
    env = FrameStackWrappper(env=env, k=3, config=config)
  File "/workspace/wrappers.py", line 89, in __init__
    self.seg_model.load_state_dict(torch.load(config['use_segmentation_weight'])['state_dict'])
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 508, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 104, in default_restore_location
    result = fn(storage, location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 75, in _cuda_deserialize
    raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location='cpu' to map your storages to the CPU.


Hidden. If you are the author, please login using the top-right link or use the dashboard.
109571282yun chenPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3510:05:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-1.05985247177248
deviation-center-line_median0.32463013910329175
in-drivable-lane_median8.23333333333332


other stats
deviation-center-line_max1.2229848197846576
deviation-center-line_mean0.5013585011463242
deviation-center-line_min0.18421462158296809
deviation-heading_max6.639256027638261
deviation-heading_mean6.130316773672168
deviation-heading_median6.587348625790274
deviation-heading_min4.253182461720226
driven_any_max3.317636741607105
driven_any_mean3.31763674160709
driven_any_median3.317636741607098
driven_any_min3.3176367416070653
driven_lanedir_max-0.8727849850798894
driven_lanedir_mean-1.0237415377242507
driven_lanedir_min-1.0652501105207834
in-drivable-lane_max10.466666666666663
in-drivable-lane_mean8.686666666666657
in-drivable-lane_min8.233333333333318
per-episodes
details{"ep000": {"driven_any": 3.317636741607105, "driven_lanedir": -0.8727849850798894, "in-drivable-lane": 10.466666666666663, "deviation-heading": 4.253182461720226, "deviation-center-line": 1.2229848197846576}, "ep001": {"driven_any": 3.3176367416070653, "driven_lanedir": -1.0585760658647092, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.639256027638261, "deviation-center-line": 0.4939995088117161}, "ep002": {"driven_any": 3.317636741607098, "driven_lanedir": -1.0622440553833916, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.60795448532735, "deviation-center-line": 0.28096341644898776}, "ep003": {"driven_any": 3.317636741607083, "driven_lanedir": -1.05985247177248, "in-drivable-lane": 8.266666666666653, "deviation-heading": 6.563842267884727, "deviation-center-line": 0.18421462158296809}, "ep004": {"driven_any": 3.3176367416071, "driven_lanedir": -1.0652501105207834, "in-drivable-lane": 8.233333333333318, "deviation-heading": 6.587348625790274, "deviation-center-line": 0.32463013910329175}}
109461282yun chenPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3510:02:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.966810409963131, "good_angle": 47.08330822850749, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.233333333333322}, "ep001": {"nsteps": 500, "reward": -1.300191262960434, "good_angle": 13.8317262841996, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}, "ep002": {"nsteps": 500, "reward": -1.117795492440462, "good_angle": 13.808909540839275, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.9294596527849426, "good_angle": 13.819737231108473, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}, "ep004": {"nsteps": 500, "reward": -1.163820459574461, "good_angle": 13.824014957850544, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}}
good_angle_max47.08330822850749
good_angle_mean20.473539248501076
good_angle_median13.824014957850544
good_angle_min13.808909540839275
reward_max-0.9294596527849426
reward_mean-1.0956154555446862
reward_median-1.117795492440462
reward_min-1.300191262960434
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.233333333333322
valid_direction_mean13.266666666666657
valid_direction_median13.09999999999999
valid_direction_min12.933333333333326
109361281yun chenPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes3510:02:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.1277084947325524
deviation-center-line_median0.21813380591001513
in-drivable-lane_median4.899999999999988


other stats
deviation-center-line_max0.380914912819748
deviation-center-line_mean0.2305222638710954
deviation-center-line_min0.08042209529634169
deviation-heading_max6.695251918755404
deviation-heading_mean2.968397790615076
deviation-heading_median2.3803439804106667
deviation-heading_min0.7340334522927733
driven_any_max1.147514414161098
driven_any_mean0.6321277046803103
driven_any_median0.6292780798715786
driven_any_min0.1451745708877611
driven_lanedir_max-0.03062263736441606
driven_lanedir_mean-0.16399291768892374
driven_lanedir_min-0.38661333766655104
in-drivable-lane_max13.69999999999998
in-drivable-lane_mean5.933333333333326
in-drivable-lane_min1.0333333333333348
per-episodes
details{"ep000": {"driven_any": 1.147514414161098, "driven_lanedir": -0.1277084947325524, "in-drivable-lane": 13.69999999999998, "deviation-heading": 2.3803439804106667, "deviation-center-line": 0.380914912819748}, "ep001": {"driven_any": 0.24250416908067615, "driven_lanedir": -0.0847419274714194, "in-drivable-lane": 1.9333333333333311, "deviation-heading": 1.408962372196319, "deviation-center-line": 0.1930310368565834}, "ep002": {"driven_any": 0.9961672894004376, "driven_lanedir": -0.38661333766655104, "in-drivable-lane": 8.099999999999996, "deviation-heading": 6.695251918755404, "deviation-center-line": 0.2801094684727889}, "ep003": {"driven_any": 0.6292780798715786, "driven_lanedir": -0.1902781912096798, "in-drivable-lane": 4.899999999999988, "deviation-heading": 3.6233972294202177, "deviation-center-line": 0.21813380591001513}, "ep004": {"driven_any": 0.1451745708877611, "driven_lanedir": -0.03062263736441606, "in-drivable-lane": 1.0333333333333348, "deviation-heading": 0.7340334522927733, "deviation-center-line": 0.08042209529634169}}
109211281yun chenPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3510:09:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
108861280yun chenRandom executionaido1_LF1_r3-v3step1-simulationsuccessno3510:02:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
108771279yun chenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3510:01:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2332896871989636
deviation-center-line_median0.2116792544883902
in-drivable-lane_median0


other stats
deviation-center-line_max0.6323564732185519
deviation-center-line_mean0.2912504656486582
deviation-center-line_min0.12670548452775535
deviation-heading_max1.728976789403258
deviation-heading_mean0.8194124233994693
deviation-heading_median0.582523377361064
deviation-heading_min0.4668112744530743
driven_any_max1.0714883694442423
driven_any_mean0.39858127916586666
driven_any_median0.25000443206491196
driven_any_min0.14641855465317552
driven_lanedir_max0.8388467814636376
driven_lanedir_mean0.33922668007033285
driven_lanedir_min0.129237910180789
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0714883694442423, "driven_lanedir": 0.8388467814636376, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.728976789403258, "deviation-center-line": 0.6323564732185519}, "ep001": {"driven_any": 0.3250077317230347, "driven_lanedir": 0.31702584203169426, "in-drivable-lane": 0, "deviation-heading": 0.4668112744530743, "deviation-center-line": 0.35258484316877714}, "ep002": {"driven_any": 0.14641855465317552, "driven_lanedir": 0.129237910180789, "in-drivable-lane": 0, "deviation-heading": 0.582523377361064, "deviation-center-line": 0.12670548452775535}, "ep003": {"driven_any": 0.1999873079439689, "driven_lanedir": 0.17773317947657974, "in-drivable-lane": 0, "deviation-heading": 0.742904646059641, "deviation-center-line": 0.13292627283981628}, "ep004": {"driven_any": 0.25000443206491196, "driven_lanedir": 0.2332896871989636, "in-drivable-lane": 0, "deviation-heading": 0.5758460297203092, "deviation-center-line": 0.2116792544883902}}
108181271Andrea CensiRandom executionaido1_LF1_r3-v3step4-vizsuccessyes3510:02:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1317915302969372
deviation-center-line_median0.6743512715176876
in-drivable-lane_median0.1999999999999993


other stats
deviation-center-line_max0.7762408815258576
deviation-center-line_mean0.5626846477112066
deviation-center-line_min0.20970474862945557
deviation-heading_max4.509761849749127
deviation-heading_mean2.4032842730881687
deviation-heading_median1.9722356045778031
deviation-heading_min0.46119004706021777
driven_any_max1.6784777980539975
driven_any_mean1.1794130246561294
driven_any_median1.1774835000531658
driven_any_min0.3715917677008975
driven_lanedir_max1.6765159288409108
driven_lanedir_mean0.9841876945010644
driven_lanedir_min0.1602152995236219
in-drivable-lane_max0.7666666666666639
in-drivable-lane_mean0.3199999999999993
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3715917677008975, "driven_lanedir": 0.1602152995236219, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 1.9722356045778031, "deviation-center-line": 0.20970474862945557}, "ep001": {"driven_any": 1.0636571696641892, "driven_lanedir": 0.6917513213822795, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 4.509761849749127, "deviation-center-line": 0.7561787083427819}, "ep002": {"driven_any": 1.1774835000531658, "driven_lanedir": 1.1317915302969372, "in-drivable-lane": 0, "deviation-heading": 1.159371319469394, "deviation-center-line": 0.3969476285402502}, "ep003": {"driven_any": 1.6784777980539975, "driven_lanedir": 1.6765159288409108, "in-drivable-lane": 0, "deviation-heading": 0.46119004706021777, "deviation-center-line": 0.7762408815258576}, "ep004": {"driven_any": 1.6058548878083976, "driven_lanedir": 1.2606643924615717, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 3.913862544584301, "deviation-center-line": 0.6743512715176876}}
108121271Andrea CensiRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.49999999999998


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -12.594963072856634, "good_angle": 1.179753153433826, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 230, "reward": -5.431255984695062, "good_angle": 16.109426524471456, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 255, "reward": -4.346870108328614, "good_angle": 1.0142558554378145, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.0999999999999934}, "ep003": {"nsteps": 361, "reward": -3.0704857812487516, "good_angle": 0.034109257356551625, "survival_time": 12.0333333333333, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.565080447820505, "good_angle": 21.142156874080055, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}
good_angle_max21.142156874080055
good_angle_mean7.8959403329559406
good_angle_median1.179753153433826
good_angle_min0.034109257356551625
reward_max-3.0704857812487516
reward_mean-5.8017310789899135
reward_median-4.346870108328614
reward_min-12.594963072856634
survival_time_max12.0333333333333
survival_time_mean8.486666666666647
survival_time_min2.7
traveled_tiles_max4
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.9666666666666535
valid_direction_mean2.4466666666666597
valid_direction_median2.2333333333333334
valid_direction_min0
108021271Andrea CensiRandom executionaido1_LF1_r3-v3step1-simulationsuccessno3510:02:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
107981270Andrea CensiRandom executionaido1_LF1_r3-v3step4-vizsuccessyes3510:02:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9394202467524176
deviation-center-line_median0.5005461180613384
in-drivable-lane_median0


other stats
deviation-center-line_max0.8019762026714526
deviation-center-line_mean0.46453888385325126
deviation-center-line_min0.21054410665275972
deviation-heading_max3.827263075148643
deviation-heading_mean1.494999243689109
deviation-heading_median0.9923897161178532
deviation-heading_min0.17098922103056
driven_any_max1.6105203163952195
driven_any_mean0.8935799240412866
driven_any_median0.9415373933628172
driven_any_min0.3657972991350469
driven_lanedir_max1.2454280154214263
driven_lanedir_mean0.7705575447787474
driven_lanedir_min0.15506621419634292
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.3199999999999993
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3657972991350469, "driven_lanedir": 0.15506621419634292, "in-drivable-lane": 0.6, "deviation-heading": 2.0441369547682884, "deviation-center-line": 0.21054410665275972}, "ep001": {"driven_any": 0.37268928175592897, "driven_lanedir": 0.37189411852472865, "in-drivable-lane": 0, "deviation-heading": 0.17098922103056, "deviation-center-line": 0.2916484846388874}, "ep002": {"driven_any": 1.1773553295574206, "driven_lanedir": 1.1409791289988214, "in-drivable-lane": 0, "deviation-heading": 0.9923897161178532, "deviation-center-line": 0.5005461180613384}, "ep003": {"driven_any": 0.9415373933628172, "driven_lanedir": 0.9394202467524176, "in-drivable-lane": 0, "deviation-heading": 0.4402172513802, "deviation-center-line": 0.5179795072418177}, "ep004": {"driven_any": 1.6105203163952195, "driven_lanedir": 1.2454280154214263, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 3.827263075148643, "deviation-center-line": 0.8019762026714526}}
107931270Andrea CensiRandom executionaido1_LF1_r3-v3step3-videossuccessyes3510:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
107851270Andrea CensiRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.799999999999986


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -12.59392248302767, "good_angle": 1.2156126068944273, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 81, "reward": -12.911595400836733, "good_angle": 0.011156086737876828, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 254, "reward": -4.437077517995215, "good_angle": 0.8658368839697798, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 2.033333333333327}, "ep003": {"nsteps": 204, "reward": -5.272974844510649, "good_angle": 0.03033246554319256, "survival_time": 6.799999999999986, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.655747907953468, "good_angle": 21.771657353630022, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}
good_angle_max21.771657353630022
good_angle_mean4.77891907935506
good_angle_median0.8658368839697798
good_angle_min0.011156086737876828
reward_max-3.655747907953468
reward_mean-7.7742636308647475
reward_median-5.272974844510649
reward_min-12.911595400836733
survival_time_max11.533333333333305
survival_time_mean6.439999999999986
survival_time_min2.7
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.93333333333332
valid_direction_mean1.6399999999999963
valid_direction_median2.033333333333327
valid_direction_min0
10776356Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes3510:01:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.481042290524149
deviation-center-line_median0.2339370288761713
in-drivable-lane_median3.1666666666666554


other stats
deviation-center-line_max0.3887111922952009
deviation-center-line_mean0.2586161601601217
deviation-center-line_min0.18135154954873856
deviation-heading_max2.50309613217222
deviation-heading_mean1.2944517420712691
deviation-heading_median0.9876146032429244
deviation-heading_min0.22282122232957288
driven_any_max1.2789432717800575
driven_any_mean0.8078205932391744
driven_any_median1.0186256472933577
driven_any_min0.2568548411010332
driven_lanedir_max0.6886799360751179
driven_lanedir_mean0.4077758085758731
driven_lanedir_min0.12255962906563632
in-drivable-lane_max4.366666666666651
in-drivable-lane_mean2.3533333333333255
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3451086440022018, "driven_lanedir": 0.12255962906563632, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 1.845635471935517, "deviation-center-line": 0.18135154954873856}, "ep001": {"driven_any": 0.2568548411010332, "driven_lanedir": 0.25402061296093104, "in-drivable-lane": 0, "deviation-heading": 0.22282122232957288, "deviation-center-line": 0.2339370288761713}, "ep002": {"driven_any": 1.2789432717800575, "driven_lanedir": 0.6886799360751179, "in-drivable-lane": 3.1666666666666554, "deviation-heading": 2.50309613217222, "deviation-center-line": 0.3887111922952009}, "ep003": {"driven_any": 1.1395705620192222, "driven_lanedir": 0.4925765742535315, "in-drivable-lane": 4.366666666666651, "deviation-heading": 0.913091280676112, "deviation-center-line": 0.25652286886349257}, "ep004": {"driven_any": 1.0186256472933577, "driven_lanedir": 0.481042290524149, "in-drivable-lane": 3.566666666666654, "deviation-heading": 0.9876146032429244, "deviation-center-line": 0.232558161217005}}
10772356Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes3510:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10768356Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.1666666666666545


other stats
episodes
details{"ep000": {"nsteps": 73, "reward": -13.967838363830408, "good_angle": 1.1348289113064052, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 1.966666666666668}, "ep001": {"nsteps": 64, "reward": -16.202794682234526, "good_angle": 0.02641407510084338, "survival_time": 2.1333333333333355, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 236, "reward": -4.795201715855401, "good_angle": 2.6918874701801223, "survival_time": 7.866666666666648, "traveled_tiles": 3, "valid_direction": 4.799999999999985}, "ep003": {"nsteps": 211, "reward": -6.0455723037704345, "good_angle": 1.1701484093436572, "survival_time": 7.033333333333318, "traveled_tiles": 3, "valid_direction": 5.899999999999984}, "ep004": {"nsteps": 185, "reward": -6.662634145226833, "good_angle": 1.516460368667395, "survival_time": 6.1666666666666545, "traveled_tiles": 2, "valid_direction": 5.066666666666654}}
good_angle_max2.6918874701801223
good_angle_mean1.3079478469196846
good_angle_median1.1701484093436572
good_angle_min0.02641407510084338
reward_max-4.795201715855401
reward_mean-9.53480824218352
reward_median-6.662634145226833
reward_min-16.202794682234526
survival_time_max7.866666666666648
survival_time_mean5.126666666666658
survival_time_min2.1333333333333355
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.899999999999984
valid_direction_mean3.5466666666666584
valid_direction_median4.799999999999985
valid_direction_min0
10761356Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3510:03:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10758477JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3510:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: local variable 'a' referenced before assignment

Hidden. If you are the author, please login using the top-right link or use the dashboard.
107531146daredevilPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3510:01:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1244940250770317
deviation-center-line_median0.1702985030340966
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.2291035934160819
deviation-center-line_mean0.15104091265992872
deviation-center-line_min0.07084844041760953
deviation-heading_max1.2760765640740437
deviation-heading_mean0.5466497354728592
deviation-heading_median0.35171107009370006
deviation-heading_min0.06092138286581164
driven_any_max2.1066666666666567
driven_any_mean1.1093333333333295
driven_any_median1.1599999999999824
driven_any_min0.3466666666666718
driven_lanedir_max2.066698089009994
driven_lanedir_mean0.9871748479623343
driven_lanedir_min0.14089729353622693
in-drivable-lane_max0.2666666666666657
in-drivable-lane_mean0.09999999999999978
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 1.1599999999999824, "driven_lanedir": 1.1244940250770317, "in-drivable-lane": 0, "deviation-heading": 0.35171107009370006, "deviation-center-line": 0.1702985030340966}, "ep003": {"driven_any": 2.1066666666666567, "driven_lanedir": 2.066698089009994, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.33465738903594666, "deviation-center-line": 0.2291035934160819}, "ep004": {"driven_any": 1.5866666666666656, "driven_lanedir": 1.2579129547459444, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.2760765640740437, "deviation-center-line": 0.1859811348549165}}
107451251heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3510:10:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10739487happyduckieROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3510:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.23619054777077464
deviation-center-line_median0.2122992984388151
in-drivable-lane_median0


other stats
deviation-center-line_max0.3435802749394205
deviation-center-line_mean0.22146211871814572
deviation-center-line_min0.06876149486487504
deviation-heading_max1.7672340193440526
deviation-heading_mean0.7765651471097197
deviation-heading_median0.5784709230855607
deviation-heading_min0.37515426849188127
driven_any_max0.7893180670859401
driven_any_mean0.33143018638787475
driven_any_median0.24999481945130073
driven_any_min0.06427740553989783
driven_lanedir_max0.5524173493881528
driven_lanedir_mean0.2737050879933765
driven_lanedir_min0.049781715934269055
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7893180670859401, "driven_lanedir": 0.5524173493881528, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7672340193440526, "deviation-center-line": 0.3435802749394205}, "ep001": {"driven_any": 0.06427740553989783, "driven_lanedir": 0.049781715934269055, "in-drivable-lane": 0, "deviation-heading": 0.37515426849188127, "deviation-center-line": 0.06876149486487504}, "ep002": {"driven_any": 0.1821229485410456, "driven_lanedir": 0.16801875360919505, "in-drivable-lane": 0, "deviation-heading": 0.5784709230855607, "deviation-center-line": 0.1570102915200551}, "ep003": {"driven_any": 0.3714376913211896, "driven_lanedir": 0.36211707326449094, "in-drivable-lane": 0, "deviation-heading": 0.5854056945652605, "deviation-center-line": 0.32565923382756284}, "ep004": {"driven_any": 0.24999481945130073, "driven_lanedir": 0.23619054777077464, "in-drivable-lane": 0, "deviation-heading": 0.5765608300618432, "deviation-center-line": 0.2122992984388151}}
107141253heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3510:10:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
107131143krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 188, "reward": -5.581093331109089, "good_angle": 2.8853886837868123, "survival_time": 6.266666666666654, "traveled_tiles": 1, "valid_direction": 5.13333333333332}, "ep001": {"nsteps": 184, "reward": -6.006585545190003, "good_angle": 0.027950161519413434, "survival_time": 6.133333333333321, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.28698273333907126, "good_angle": 0.5037599778514814, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 1.7000000000000297}, "ep003": {"nsteps": 500, "reward": -0.09759001524746418, "good_angle": 0.00037922062684382017, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.026040908180526456, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max2.8853886837868123
good_angle_mean0.6986869510876267
good_angle_median0.07595671165358207
good_angle_min0.00037922062684382017
reward_max0.026040908180526456
reward_mean-2.38924214334102
reward_median-0.28698273333907126
reward_min-6.006585545190003
survival_time_max16.666666666666654
survival_time_mean12.479999999999986
survival_time_min6.133333333333321
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.13333333333332
valid_direction_mean1.36666666666667
valid_direction_median0
valid_direction_min0
106961143krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessno3510:03:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10693308Andrea CensiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3510:00:32
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
106821269heyt0nyTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3510:03:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1858751062372497
deviation-center-line_median0.563832971626301
in-drivable-lane_median0


other stats
deviation-center-line_max1.171904084883277
deviation-center-line_mean0.6539107884903486
deviation-center-line_min0.24020081309801997
deviation-heading_max3.0057576388028675
deviation-heading_mean1.5424166222765243
deviation-heading_median1.7568368852682044
deviation-heading_min0.2120145709685025
driven_any_max2.881829737813101
driven_any_mean1.5227547131437291
driven_any_median1.3207264084194723
driven_any_min0.3081525678993841
driven_lanedir_max2.566276890528922
driven_lanedir_mean1.353809568945074
driven_lanedir_min0.30220264994404955
in-drivable-lane_max0.7666666666666639
in-drivable-lane_mean0.2999999999999995
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.2732605836701687, "driven_lanedir": 1.899170232720776, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 3.0057576388028675, "deviation-center-line": 0.7382793824375652}, "ep001": {"driven_any": 0.3081525678993841, "driven_lanedir": 0.30220264994404955, "in-drivable-lane": 0, "deviation-heading": 0.2120145709685025, "deviation-center-line": 0.24020081309801997}, "ep002": {"driven_any": 1.3207264084194723, "driven_lanedir": 1.1858751062372497, "in-drivable-lane": 0, "deviation-heading": 2.2534935478285467, "deviation-center-line": 0.5553366904065802}, "ep003": {"driven_any": 2.881829737813101, "driven_lanedir": 2.566276890528922, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 1.7568368852682044, "deviation-center-line": 1.171904084883277}, "ep004": {"driven_any": 0.8298042679165203, "driven_lanedir": 0.8155229652943727, "in-drivable-lane": 0, "deviation-heading": 0.4839804685145004, "deviation-center-line": 0.563832971626301}}
106771269heyt0nyTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes3510:01:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
106671269heyt0nyTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes3510:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.066666666666649


other stats
episodes
details{"ep000": {"nsteps": 366, "reward": -2.8605892974333647, "good_angle": 1.0505563586293576, "survival_time": 12.199999999999967, "traveled_tiles": 4, "valid_direction": 1.5999999999999943}, "ep001": {"nsteps": 68, "reward": -15.262957413845202, "good_angle": 0.07264626603606153, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.13333333333333286}, "ep002": {"nsteps": 242, "reward": -4.316510446161111, "good_angle": 0.7448688903986106, "survival_time": 8.066666666666649, "traveled_tiles": 3, "valid_direction": 1.1333333333333302}, "ep003": {"nsteps": 500, "reward": -0.28015136850846467, "good_angle": 0.36737863546305544, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.8333333333333304}, "ep004": {"nsteps": 185, "reward": -5.872051970217679, "good_angle": 0.12052446599570546, "survival_time": 6.1666666666666545, "traveled_tiles": 2, "valid_direction": 0.2333333333333325}}
good_angle_max1.0505563586293576
good_angle_mean0.47119492330455814
good_angle_median0.36737863546305544
good_angle_min0.07264626603606153
reward_max-0.28015136850846467
reward_mean-5.718452099233165
reward_median-4.316510446161111
reward_min-15.262957413845202
survival_time_max16.666666666666654
survival_time_mean9.07333333333332
survival_time_min2.2666666666666684
traveled_tiles_max6
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.5999999999999943
valid_direction_mean0.7866666666666641
valid_direction_median0.8333333333333304
valid_direction_min0.13333333333333286
106611269heyt0nyTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessno3510:02:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1