Duckietown Challenges Home Challenges Submissions

Evaluator 352

ID352
evaluatoridsc-rudolf-18140
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-18140
versionDC:3.1.57;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success66 10663
# timeout
# failed11 10747
# error2 11321
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
113951308Dzenan LapandicLFV bd testaido1_LFV_r1-v3step1-simulationfailednoidsc-rudolf-181400:02:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 135, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11390942Claudio RuchPython templateaido1_amod_service_quality_r1-v3step2-scoringsuccessyesidsc-rudolf-181400:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-32.87038394834193


other stats
efficiency-64.14325579336746
fleet_size-1000000000
No reset possible
11383944Claudio RuchPython templateaido1_amod_efficiency_r1-v3step2-scoringsuccessyesidsc-rudolf-181400:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency-73.46014637689947


other stats
fleet_size-1000000000
service_quality-35.14982659422455
No reset possible
11367945Claudio RuchPython templateaido1_amod_fleet_size_r1-v3step1-simulationsuccessyesidsc-rudolf-181400:04:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
11356950Claudio RuchFunky Controller 1aido1_amod_efficiency_r1-v3step2-scoringsuccessyesidsc-rudolf-181400:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency-73.71543919268404


other stats
fleet_size-1000000000
service_quality-35.358429798170974
No reset possible
11348212Andrea Censi 🇨🇭Python templateaido1_amod_efficiency_r1-v3step2-scoringsuccessyesidsc-rudolf-181400:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency-64.05881123584692


other stats
fleet_size-1000000000
service_quality-32.88480280896185
No reset possible
11338212Andrea Censi 🇨🇭Python templateaido1_amod_efficiency_r1-v3step1-simulationsuccessyesidsc-rudolf-181400:04:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
113271070Claudio RuchJava templateaido1_amod_service_quality_r1-v3step1-simulationerroryesidsc-rudolf-181400:10:52
Timeout: Waited 601 [...]
Timeout:

Waited 601.980234861 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113211078Claudio RuchBig Fleet Controlleraido1_amod_fleet_size_r1-v3step1-simulationerroryesidsc-rudolf-181400:11:14
Timeout: Waited 601 [...]
Timeout:

Waited 601.566462994 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113101307Tina ChuROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2272303180768307
deviation-center-line_median0.20681915361280567
in-drivable-lane_median0


other stats
deviation-center-line_max0.3568243903921427
deviation-center-line_mean0.2339024184529846
deviation-center-line_min0.12317304458368264
deviation-heading_max1.7477521518583374
deviation-heading_mean0.8385864351768578
deviation-heading_median0.625932399356574
deviation-heading_min0.4663073293798452
driven_any_max0.7928832038719099
driven_any_mean0.3442899087143174
driven_any_median0.2464303825004456
driven_any_min0.16427501307806475
driven_lanedir_max0.5568157761076884
driven_lanedir_mean0.28308198639260274
driven_lanedir_min0.1488538314418193
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7928832038719099, "driven_lanedir": 0.5568157761076884, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7477521518583374, "deviation-center-line": 0.3451234776069457}, "ep001": {"driven_any": 0.3285759873680623, "driven_lanedir": 0.3206965291801671, "in-drivable-lane": 0, "deviation-heading": 0.4663073293798452, "deviation-center-line": 0.3568243903921427}, "ep002": {"driven_any": 0.16427501307806475, "driven_lanedir": 0.1488538314418193, "in-drivable-lane": 0, "deviation-heading": 0.5559356998062136, "deviation-center-line": 0.137572026069346}, "ep003": {"driven_any": 0.18928495675310453, "driven_lanedir": 0.16181347715650807, "in-drivable-lane": 0, "deviation-heading": 0.7970045954833189, "deviation-center-line": 0.12317304458368264}, "ep004": {"driven_any": 0.2464303825004456, "driven_lanedir": 0.2272303180768307, "in-drivable-lane": 0, "deviation-heading": 0.625932399356574, "deviation-center-line": 0.20681915361280567}}
No reset possible
113041307Tina ChuROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-181400:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
112961307Tina ChuROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.366666666666668


other stats
episodes
details{"ep000": {"nsteps": 224, "reward": -4.614468659430713, "good_angle": 0.736912173000433, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 1.099999999999996}, "ep001": {"nsteps": 94, "reward": -11.249216741703924, "good_angle": 0.19649234145495015, "survival_time": 3.133333333333332, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 48, "reward": -21.30313229933381, "good_angle": 0.36602712571830665, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.6666666666666681}, "ep003": {"nsteps": 55, "reward": -18.556428309191357, "good_angle": 0.6146218368799753, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0.6666666666666687}, "ep004": {"nsteps": 71, "reward": -14.55548485525897, "good_angle": 0.42671573150912695, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0.6333333333333326}}
good_angle_max0.736912173000433
good_angle_mean0.4681538417125584
good_angle_median0.42671573150912695
good_angle_min0.19649234145495015
reward_max-4.614468659430713
reward_mean-14.055746172983756
reward_median-14.55548485525897
reward_min-21.30313229933381
survival_time_max7.46666666666665
survival_time_mean3.2799999999999976
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.099999999999996
valid_direction_mean0.6733333333333329
valid_direction_median0.6666666666666681
valid_direction_min0.29999999999999893
No reset possible
112801306Tri Cao 🇺🇸Baseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.199999999999974


other stats
episodes
details{"ep000": {"nsteps": 95, "reward": -10.783506638635146, "good_angle": 1.5058336819559393, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.666666666666665}, "ep001": {"nsteps": 83, "reward": -12.614138619368337, "good_angle": 0.017220027804123142, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 306, "reward": -3.879368552244177, "good_angle": 1.199392002118851, "survival_time": 10.199999999999974, "traveled_tiles": 3, "valid_direction": 2.633333333333325}, "ep003": {"nsteps": 353, "reward": -3.1296388487682463, "good_angle": 0.03134739572415276, "survival_time": 11.766666666666636, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 413, "reward": -3.021035787713016, "good_angle": 23.628148302403908, "survival_time": 13.766666666666628, "traveled_tiles": 3, "valid_direction": 4.699999999999983}}
good_angle_max23.628148302403908
good_angle_mean5.2763882820013945
good_angle_median1.199392002118851
good_angle_min0.017220027804123142
reward_max-3.021035787713016
reward_mean-6.685537689345783
reward_median-3.879368552244177
reward_min-12.614138619368337
survival_time_max13.766666666666628
survival_time_mean8.333333333333314
survival_time_min2.7666666666666666
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.699999999999983
valid_direction_mean1.999999999999995
valid_direction_median2.633333333333325
valid_direction_min0
No reset possible
112731306Tri Cao 🇺🇸Baseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
112621305Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:05:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median8.466416467829077
deviation-center-line_median0.7491075821771831
in-drivable-lane_median0.06666666666666643


other stats
deviation-center-line_max1.0852097769842697
deviation-center-line_mean0.6828056697229344
deviation-center-line_min0.110456458929874
deviation-heading_max3.088169914104725
deviation-heading_mean1.9361613489916736
deviation-heading_median1.9716545225234337
deviation-heading_min0.5532418461875583
driven_any_max9.395397994412496
driven_any_mean6.118783919231438
driven_any_median8.673270359145661
driven_any_min1.2271279931045092
driven_lanedir_max9.106972393834644
driven_lanedir_mean5.887907266761421
driven_lanedir_min1.1523564491476126
in-drivable-lane_max0.6999999999999994
in-drivable-lane_mean0.19999999999999968
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 9.13343633823087, "driven_lanedir": 8.632442293612678, "in-drivable-lane": 0.6999999999999994, "deviation-heading": 2.9109849023974417, "deviation-center-line": 1.0852097769842697}, "ep001": {"driven_any": 2.164686911263656, "driven_lanedir": 2.0813487293830906, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.1567555597452082, "deviation-center-line": 0.3937472257413113}, "ep002": {"driven_any": 1.2271279931045092, "driven_lanedir": 1.1523564491476126, "in-drivable-lane": 0, "deviation-heading": 0.5532418461875583, "deviation-center-line": 0.110456458929874}, "ep003": {"driven_any": 9.395397994412496, "driven_lanedir": 9.106972393834644, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.088169914104725, "deviation-center-line": 1.0755073047820347}, "ep004": {"driven_any": 8.673270359145661, "driven_lanedir": 8.466416467829077, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.9716545225234337, "deviation-center-line": 0.7491075821771831}}
No reset possible
112571305Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.999999999999956


other stats
episodes
details{"ep000": {"nsteps": 496, "reward": -2.0943019221591648, "good_angle": 0.7418744038601746, "survival_time": 16.533333333333314, "traveled_tiles": 15, "valid_direction": 2.0999999999999934}, "ep001": {"nsteps": 157, "reward": -6.806706450876608, "good_angle": 14.159941219201931, "survival_time": 5.2333333333333245, "traveled_tiles": 5, "valid_direction": 2.0999999999999996}, "ep002": {"nsteps": 59, "reward": -17.04080068322009, "good_angle": 0.15271570187640776, "survival_time": 1.9666666666666697, "traveled_tiles": 3, "valid_direction": 0.33333333333333437}, "ep003": {"nsteps": 500, "reward": 0.02414321799436584, "good_angle": 0.6871705559821161, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.1333333333333302}, "ep004": {"nsteps": 450, "reward": -2.2807499980605725, "good_angle": 35.64433197185651, "survival_time": 14.999999999999956, "traveled_tiles": 17, "valid_direction": 4.83333333333332}}
good_angle_max35.64433197185651
good_angle_mean10.277206770555429
good_angle_median0.7418744038601746
good_angle_min0.15271570187640776
reward_max0.02414321799436584
reward_mean-5.639683167264414
reward_median-2.2807499980605725
reward_min-17.04080068322009
survival_time_max16.666666666666654
survival_time_mean11.079999999999984
survival_time_min1.9666666666666697
traveled_tiles_max17
traveled_tiles_mean11.2
traveled_tiles_median15
traveled_tiles_min3
valid_direction_max4.83333333333332
valid_direction_mean2.0999999999999956
valid_direction_median2.0999999999999934
valid_direction_min0.33333333333333437
No reset possible
112461303Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:04:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.247947866530568
deviation-center-line_median0.4327948281734701
in-drivable-lane_median0.33333333333333215


other stats
deviation-center-line_max0.8951573984927605
deviation-center-line_mean0.5294639676056159
deviation-center-line_min0.2553864082264141
deviation-heading_max2.5086434238842648
deviation-heading_mean1.7176914721650511
deviation-heading_median1.3764712107670771
deviation-heading_min0.935815621123276
driven_any_max9.83643308694634
driven_any_mean5.49635327088284
driven_any_median4.3797351459243234
driven_any_min2.1044204655967538
driven_lanedir_max9.247955113262256
driven_lanedir_mean5.215254784547498
driven_lanedir_min1.8076115267915815
in-drivable-lane_max0.7999999999999972
in-drivable-lane_mean0.3466666666666658
in-drivable-lane_min0.033333333333333215
per-episodes
details{"ep000": {"driven_any": 2.4350440530543422, "driven_lanedir": 2.1641183480391843, "in-drivable-lane": 0.5, "deviation-heading": 0.935815621123276, "deviation-center-line": 0.2553864082264141}, "ep001": {"driven_any": 2.1044204655967538, "driven_lanedir": 1.8076115267915815, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 1.3764712107670771, "deviation-center-line": 0.3623346537121123}, "ep002": {"driven_any": 9.83643308694634, "driven_lanedir": 9.247955113262256, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 2.4644149719140565, "deviation-center-line": 0.8951573984927605}, "ep003": {"driven_any": 4.3797351459243234, "driven_lanedir": 4.247947866530568, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.3031121331365825, "deviation-center-line": 0.4327948281734701}, "ep004": {"driven_any": 8.726133602892439, "driven_lanedir": 8.608641068113897, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.5086434238842648, "deviation-center-line": 0.701646549423322}}
No reset possible
112311304Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-181400:04:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
112181304Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.025241015423089267, "good_angle": 0.5660956539852379, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.3333333333333302}, "ep001": {"nsteps": 500, "reward": -0.3052277488233522, "good_angle": 41.3027307319338, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.600000000000018}, "ep002": {"nsteps": 500, "reward": -0.10230048004770652, "good_angle": 0.6659104569093917, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.9666666666666597}, "ep003": {"nsteps": 500, "reward": -0.06712517729547107, "good_angle": 0.4061192818354377, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 0.9333333333333308}, "ep004": {"nsteps": 500, "reward": -0.3235300897718407, "good_angle": 41.2754370289088, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.099999999999985}}
good_angle_max41.3027307319338
good_angle_mean16.843258630714534
good_angle_median0.6659104569093917
good_angle_min0.4061192818354377
reward_max-0.025241015423089267
reward_mean-0.16468490227229196
reward_median-0.10230048004770652
reward_min-0.3235300897718407
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max17
traveled_tiles_mean16.4
traveled_tiles_median16
traveled_tiles_min16
valid_direction_max5.600000000000018
valid_direction_mean2.986666666666665
valid_direction_median1.9666666666666597
valid_direction_min0.9333333333333308
No reset possible
112101304Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:07:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
112051303Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.247947866530568
deviation-center-line_median0.4327948281734701
in-drivable-lane_median0.33333333333333215


other stats
deviation-center-line_max0.8951573984927605
deviation-center-line_mean0.5294639676056159
deviation-center-line_min0.2553864082264141
deviation-heading_max2.5086434238842648
deviation-heading_mean1.7176914721650511
deviation-heading_median1.3764712107670771
deviation-heading_min0.935815621123276
driven_any_max9.83643308694634
driven_any_mean5.49635327088284
driven_any_median4.3797351459243234
driven_any_min2.1044204655967538
driven_lanedir_max9.247955113262256
driven_lanedir_mean5.215254784547498
driven_lanedir_min1.8076115267915815
in-drivable-lane_max0.7999999999999972
in-drivable-lane_mean0.3466666666666658
in-drivable-lane_min0.033333333333333215
per-episodes
details{"ep000": {"driven_any": 2.4350440530543422, "driven_lanedir": 2.1641183480391843, "in-drivable-lane": 0.5, "deviation-heading": 0.935815621123276, "deviation-center-line": 0.2553864082264141}, "ep001": {"driven_any": 2.1044204655967538, "driven_lanedir": 1.8076115267915815, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 1.3764712107670771, "deviation-center-line": 0.3623346537121123}, "ep002": {"driven_any": 9.83643308694634, "driven_lanedir": 9.247955113262256, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 2.4644149719140565, "deviation-center-line": 0.8951573984927605}, "ep003": {"driven_any": 4.3797351459243234, "driven_lanedir": 4.247947866530568, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.3031121331365825, "deviation-center-line": 0.4327948281734701}, "ep004": {"driven_any": 8.726133602892439, "driven_lanedir": 8.608641068113897, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.5086434238842648, "deviation-center-line": 0.701646549423322}}
No reset possible
111901303Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.333333333333317


other stats
episodes
details{"ep000": {"nsteps": 135, "reward": -7.617946757625624, "good_angle": 0.24914791547711929, "survival_time": 4.499999999999994, "traveled_tiles": 5, "valid_direction": 0.5999999999999985}, "ep001": {"nsteps": 149, "reward": -7.085851560353032, "good_angle": 10.035174620388348, "survival_time": 4.966666666666659, "traveled_tiles": 5, "valid_direction": 1.8999999999999992}, "ep002": {"nsteps": 500, "reward": -0.12116984189208596, "good_angle": 0.6114449517312698, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.6333333333333275}, "ep003": {"nsteps": 220, "reward": -4.690160607782045, "good_angle": 0.18338344049862731, "survival_time": 7.333333333333317, "traveled_tiles": 8, "valid_direction": 0.3999999999999986}, "ep004": {"nsteps": 500, "reward": -0.31342388660390863, "good_angle": 33.864049863006905, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.833333333333349}}
good_angle_max33.864049863006905
good_angle_mean8.988640158220454
good_angle_median0.6114449517312698
good_angle_min0.18338344049862731
reward_max-0.12116984189208596
reward_mean-3.9657105308513385
reward_median-4.690160607782045
reward_min-7.617946757625624
survival_time_max16.666666666666654
survival_time_mean10.026666666666651
survival_time_min4.499999999999994
traveled_tiles_max18
traveled_tiles_mean10.8
traveled_tiles_median8
traveled_tiles_min5
valid_direction_max4.833333333333349
valid_direction_mean1.8733333333333348
valid_direction_median1.6333333333333275
valid_direction_min0.3999999999999986
No reset possible
111851303Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
111841302Anton Mashikhin 🇷🇺Template for ROS Submissionaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5323895106250947
deviation-center-line_median0.2069133082272764
in-drivable-lane_median1.7666666666666604


other stats
deviation-center-line_max0.5467131081696794
deviation-center-line_mean0.2602226065031052
deviation-center-line_min0.109306961893104
deviation-heading_max1.742323630223919
deviation-heading_mean1.1567573530878712
deviation-heading_median1.3282976503274275
deviation-heading_min0.24355646859871627
driven_any_max2.1899668958618665
driven_any_mean0.991835190048022
driven_any_median0.9696925230542558
driven_any_min0.3178171092322331
driven_lanedir_max0.7169311640978855
driven_lanedir_mean0.45386049169510273
driven_lanedir_min0.04178689899496413
in-drivable-lane_max6.533333333333311
in-drivable-lane_mean2.1733333333333262
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3178171092322331, "driven_lanedir": 0.04178689899496413, "in-drivable-lane": 0.633333333333334, "deviation-heading": 1.3282976503274275, "deviation-center-line": 0.109306961893104}, "ep001": {"driven_any": 1.1502565226532864, "driven_lanedir": 0.6512425203302821, "in-drivable-lane": 1.7666666666666604, "deviation-heading": 1.5861269978141073, "deviation-center-line": 0.30358180641808197}, "ep002": {"driven_any": 0.3314428994384689, "driven_lanedir": 0.32695236442728737, "in-drivable-lane": 0, "deviation-heading": 0.24355646859871627, "deviation-center-line": 0.1345978478073843}, "ep003": {"driven_any": 2.1899668958618665, "driven_lanedir": 0.7169311640978855, "in-drivable-lane": 6.533333333333311, "deviation-heading": 1.742323630223919, "deviation-center-line": 0.5467131081696794}, "ep004": {"driven_any": 0.9696925230542558, "driven_lanedir": 0.5323895106250947, "in-drivable-lane": 1.9333333333333265, "deviation-heading": 0.8834820184751857, "deviation-center-line": 0.2069133082272764}}
No reset possible
111521301Anton Mashikhin 🇷🇺Template for ROS Submissionaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-181400:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
111411301Anton Mashikhin 🇷🇺Template for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:05:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
111391300Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-181400:00:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 89, in solve
    cis.info('Logging. %s %s %s ' % (str(env.unwrapped.robot_speed), str(env.unwrapped.cur_pos), str(env.unwrapped.cur_angle)))
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'robot_speed'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111251299Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-181400:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 72, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 38, in make_env
    env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
AttributeError: 'module' object has no attribute 'UndistortWrapper'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111181298Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-181400:00:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 128, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 38, in make_env
    env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
  File "/workspace/wrappers.py", line 392, in __init__
    assert env.unwrapped.distortion, "Distortion is false, no need for this wrapper"
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'distortion'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
111121297Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:08:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.051829096858754
deviation-center-line_median0.92971426400998
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max0.942361718872175
deviation-center-line_mean0.8572808146222097
deviation-center-line_min0.6352737923652181
deviation-heading_max4.154968182851831
deviation-heading_mean3.0043615237383805
deviation-heading_median3.2100480227248354
deviation-heading_min1.448995458537678
driven_any_max4.685052912313802
driven_any_mean4.268651858623994
driven_any_median4.270000785139785
driven_any_min3.6056512932929903
driven_lanedir_max4.666314634594814
driven_lanedir_mean4.092641922881887
driven_lanedir_min3.3140298965753785
in-drivable-lane_max1.2666666666666664
in-drivable-lane_mean0.3999999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.270000785139785, "driven_lanedir": 3.9149195004453623, "in-drivable-lane": 1.2666666666666664, "deviation-heading": 3.4530617576225806, "deviation-center-line": 0.92971426400998}, "ep001": {"driven_any": 3.6056512932929903, "driven_lanedir": 3.3140298965753785, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 4.154968182851831, "deviation-center-line": 0.942361718872175}, "ep002": {"driven_any": 4.151214909073667, "driven_lanedir": 4.051829096858754, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 2.7547341969549755, "deviation-center-line": 0.8444769561548144}, "ep003": {"driven_any": 4.631339393299723, "driven_lanedir": 4.516116485935129, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.2100480227248354, "deviation-center-line": 0.9345773417088612}, "ep004": {"driven_any": 4.685052912313802, "driven_lanedir": 4.666314634594814, "in-drivable-lane": 0, "deviation-heading": 1.448995458537678, "deviation-center-line": 0.6352737923652181}}
No reset possible
111021297Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-181400:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
110881296Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.059602090256015
deviation-center-line_median0.9233774452974473
in-drivable-lane_median0.06666666666666643


other stats
deviation-center-line_max0.949820010509239
deviation-center-line_mean0.8471167073284788
deviation-center-line_min0.5946126139614508
deviation-heading_max4.152007344027524
deviation-heading_mean3.00191975331795
deviation-heading_median3.225164541782035
deviation-heading_min1.5002234411759428
driven_any_max4.71754922294293
driven_any_mean4.27810584519334
driven_any_median4.257084832627703
driven_any_min3.64324106737124
driven_lanedir_max4.698600876684635
driven_lanedir_mean4.1050019299967575
driven_lanedir_min3.3439683783780128
in-drivable-lane_max1.2666666666666666
in-drivable-lane_mean0.39999999999999947
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.257084832627703, "driven_lanedir": 3.912478498972464, "in-drivable-lane": 1.2666666666666666, "deviation-heading": 3.4242468414709983, "deviation-center-line": 0.9234806487754208}, "ep001": {"driven_any": 3.64324106737124, "driven_lanedir": 3.3439683783780128, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 4.152007344027524, "deviation-center-line": 0.949820010509239}, "ep002": {"driven_any": 4.147042135683437, "driven_lanedir": 4.059602090256015, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 2.70795659813325, "deviation-center-line": 0.8442928180988358}, "ep003": {"driven_any": 4.625611967341394, "driven_lanedir": 4.510359805692658, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.225164541782035, "deviation-center-line": 0.9233774452974473}, "ep004": {"driven_any": 4.71754922294293, "driven_lanedir": 4.698600876684635, "in-drivable-lane": 0, "deviation-heading": 1.5002234411759428, "deviation-center-line": 0.5946126139614508}}
No reset possible
110731296Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
110641295Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:05:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.910996529633443
deviation-center-line_median0.804829668110413
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max1.039879518692922
deviation-center-line_mean0.7667227890186241
deviation-center-line_min0.3222291105867537
deviation-heading_max3.2571936050662273
deviation-heading_mean2.1809540644258907
deviation-heading_median2.6458401641549094
deviation-heading_min0.9822962818116744
driven_any_max5.123266602593036
driven_any_mean3.5595592135593237
driven_any_median4.272131146626368
driven_any_min1.5077016675170083
driven_lanedir_max5.10905363944258
driven_lanedir_mean3.432994515958099
driven_lanedir_min1.4595445026629377
in-drivable-lane_max1.0999999999999994
in-drivable-lane_mean0.25999999999999973
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.272131146626368, "driven_lanedir": 3.910996529633443, "in-drivable-lane": 1.0999999999999994, "deviation-heading": 3.2571936050662273, "deviation-center-line": 1.039879518692922}, "ep001": {"driven_any": 2.1447119551227667, "driven_lanedir": 2.0224400944249012, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.6585454794779535, "deviation-center-line": 0.7527271103559265}, "ep002": {"driven_any": 1.5077016675170083, "driven_lanedir": 1.4595445026629377, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3608947916186889, "deviation-center-line": 0.3222291105867537}, "ep003": {"driven_any": 4.74998469593744, "driven_lanedir": 4.66293781362663, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.6458401641549094, "deviation-center-line": 0.804829668110413}, "ep004": {"driven_any": 5.123266602593036, "driven_lanedir": 5.10905363944258, "in-drivable-lane": 0, "deviation-heading": 0.9822962818116744, "deviation-center-line": 0.9139485373471052}}
No reset possible
110581295Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-181400:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
110441295Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:04:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
110321293Dzenan LapandicLFV bd testaido1_LFV_r1-v3step4-vizsuccessnoidsc-rudolf-181400:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.44433964314315433
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.5512591199175949
deviation-center-line_mean0.4645859205989189
deviation-center-line_min0.39335855914159346
deviation-heading_max3.5598471575751542
deviation-heading_mean1.764030711792994
deviation-heading_median1.381299485180658
deviation-heading_min1.1199561623878598
driven_any_max1.49079583364818
driven_any_mean1.1297417190774648
driven_any_median1.2306824401524008
driven_any_min0.6871560381108496
driven_lanedir_max1.450214316231856
driven_lanedir_mean0.9909222089183176
driven_lanedir_median1.1890923792085335
driven_lanedir_min0.1581492283862641
in-drivable-lane_max2.7333333333333316
in-drivable-lane_mean0.5599999999999996
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6871560381108496, "driven_lanedir": 0.1581492283862641, "in-drivable-lane": 2.7333333333333316, "deviation-heading": 3.5598471575751542, "deviation-center-line": 0.4027841572493933}, "ep001": {"driven_any": 0.8036306246797625, "driven_lanedir": 0.7607355319904787, "in-drivable-lane": 0, "deviation-heading": 1.1199561623878598, "deviation-center-line": 0.39335855914159346}, "ep002": {"driven_any": 1.2306824401524008, "driven_lanedir": 1.1890923792085335, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.381299485180658, "deviation-center-line": 0.5512591199175949}, "ep003": {"driven_any": 1.49079583364818, "driven_lanedir": 1.450214316231856, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3004450133719043, "deviation-center-line": 0.5311881235428586}, "ep004": {"driven_any": 1.4364436587961311, "driven_lanedir": 1.3964195887744555, "in-drivable-lane": 0, "deviation-heading": 1.458605740449393, "deviation-center-line": 0.44433964314315433}}
No reset possible
110181293Dzenan LapandicLFV bd testaido1_LFV_r1-v3step1-simulationsuccessnoidsc-rudolf-181400:04:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
109721286Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-181400:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    solve(params, cis)
  File "solution.py", line 68, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 37, in make_env
    env = FrameStackWrappper(env=env, k=3, config=config)
  File "/workspace/wrappers.py", line 89, in __init__
    self.seg_model.load_state_dict(torch.load(config['use_segmentation_weight'])['state_dict'],
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 508, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 104, in default_restore_location
    result = fn(storage, location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 75, in _cuda_deserialize
    raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location='cpu' to map your storages to the CPU.


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
109711285Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-181400:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    solve(params, cis)
  File "solution.py", line 68, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 37, in make_env
    env = FrameStackWrappper(env=env, k=3, config=config)
  File "/workspace/wrappers.py", line 89, in __init__
    self.seg_model.load_state_dict(torch.load(config['use_segmentation_weight'])['state_dict'])
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 508, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 104, in default_restore_location
    result = fn(storage, location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 75, in _cuda_deserialize
    raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location='cpu' to map your storages to the CPU.


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
109601282Yun Chen 🇨🇦PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-1.05985247177248
deviation-center-line_median0.32463013910329175
in-drivable-lane_median8.23333333333332


other stats
deviation-center-line_max1.2229848197846576
deviation-center-line_mean0.5013585011463242
deviation-center-line_min0.18421462158296809
deviation-heading_max6.639256027638261
deviation-heading_mean6.130316773672168
deviation-heading_median6.587348625790274
deviation-heading_min4.253182461720226
driven_any_max3.317636741607105
driven_any_mean3.31763674160709
driven_any_median3.317636741607098
driven_any_min3.3176367416070653
driven_lanedir_max-0.8727849850798894
driven_lanedir_mean-1.0237415377242507
driven_lanedir_min-1.0652501105207834
in-drivable-lane_max10.466666666666663
in-drivable-lane_mean8.686666666666657
in-drivable-lane_min8.233333333333318
per-episodes
details{"ep000": {"driven_any": 3.317636741607105, "driven_lanedir": -0.8727849850798894, "in-drivable-lane": 10.466666666666663, "deviation-heading": 4.253182461720226, "deviation-center-line": 1.2229848197846576}, "ep001": {"driven_any": 3.3176367416070653, "driven_lanedir": -1.0585760658647092, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.639256027638261, "deviation-center-line": 0.4939995088117161}, "ep002": {"driven_any": 3.317636741607098, "driven_lanedir": -1.0622440553833916, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.60795448532735, "deviation-center-line": 0.28096341644898776}, "ep003": {"driven_any": 3.317636741607083, "driven_lanedir": -1.05985247177248, "in-drivable-lane": 8.266666666666653, "deviation-heading": 6.563842267884727, "deviation-center-line": 0.18421462158296809}, "ep004": {"driven_any": 3.3176367416071, "driven_lanedir": -1.0652501105207834, "in-drivable-lane": 8.233333333333318, "deviation-heading": 6.587348625790274, "deviation-center-line": 0.32463013910329175}}
No reset possible
109401282Yun Chen 🇨🇦PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.966810409963131, "good_angle": 47.08330822850749, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.233333333333322}, "ep001": {"nsteps": 500, "reward": -1.300191262960434, "good_angle": 13.8317262841996, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}, "ep002": {"nsteps": 500, "reward": -1.117795492440462, "good_angle": 13.808909540839275, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.9294596527849426, "good_angle": 13.819737231108473, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}, "ep004": {"nsteps": 500, "reward": -1.163820459574461, "good_angle": 13.824014957850544, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}}
good_angle_max47.08330822850749
good_angle_mean20.473539248501076
good_angle_median13.824014957850544
good_angle_min13.808909540839275
reward_max-0.9294596527849426
reward_mean-1.0956154555446862
reward_median-1.117795492440462
reward_min-1.300191262960434
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.233333333333322
valid_direction_mean13.266666666666657
valid_direction_median13.09999999999999
valid_direction_min12.933333333333326
No reset possible
109321281Yun Chen 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.1277084947325524
deviation-center-line_median0.21813380591001513
in-drivable-lane_median4.899999999999988


other stats
deviation-center-line_max0.380914912819748
deviation-center-line_mean0.2305222638710954
deviation-center-line_min0.08042209529634169
deviation-heading_max6.695251918755404
deviation-heading_mean2.968397790615076
deviation-heading_median2.3803439804106667
deviation-heading_min0.7340334522927733
driven_any_max1.147514414161098
driven_any_mean0.6321277046803103
driven_any_median0.6292780798715786
driven_any_min0.1451745708877611
driven_lanedir_max-0.03062263736441606
driven_lanedir_mean-0.16399291768892374
driven_lanedir_min-0.38661333766655104
in-drivable-lane_max13.69999999999998
in-drivable-lane_mean5.933333333333326
in-drivable-lane_min1.0333333333333348
per-episodes
details{"ep000": {"driven_any": 1.147514414161098, "driven_lanedir": -0.1277084947325524, "in-drivable-lane": 13.69999999999998, "deviation-heading": 2.3803439804106667, "deviation-center-line": 0.380914912819748}, "ep001": {"driven_any": 0.24250416908067615, "driven_lanedir": -0.0847419274714194, "in-drivable-lane": 1.9333333333333311, "deviation-heading": 1.408962372196319, "deviation-center-line": 0.1930310368565834}, "ep002": {"driven_any": 0.9961672894004376, "driven_lanedir": -0.38661333766655104, "in-drivable-lane": 8.099999999999996, "deviation-heading": 6.695251918755404, "deviation-center-line": 0.2801094684727889}, "ep003": {"driven_any": 0.6292780798715786, "driven_lanedir": -0.1902781912096798, "in-drivable-lane": 4.899999999999988, "deviation-heading": 3.6233972294202177, "deviation-center-line": 0.21813380591001513}, "ep004": {"driven_any": 0.1451745708877611, "driven_lanedir": -0.03062263736441606, "in-drivable-lane": 1.0333333333333348, "deviation-heading": 0.7340334522927733, "deviation-center-line": 0.08042209529634169}}
No reset possible
109151281Yun Chen 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:09:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
109091280Yun Chen 🇨🇦Random executionaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0912619516892297
deviation-center-line_median0.35434867307286394
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max0.5503217644623789
deviation-center-line_mean0.3430555191422603
deviation-center-line_min0.19008849208663176
deviation-heading_max3.5738141012812856
deviation-heading_mean1.5780346998192003
deviation-heading_median1.6281599088608705
deviation-heading_min0.17673821454925606
driven_any_max1.600431044772758
driven_any_mean0.8967643246163399
driven_any_median1.0949819717424556
driven_any_min0.2573432846425337
driven_lanedir_max1.2646710312972245
driven_lanedir_mean0.7693333122921573
driven_lanedir_min0.1261801357102449
in-drivable-lane_max0.7999999999999972
in-drivable-lane_mean0.2999999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3483184683821576, "driven_lanedir": 0.1261801357102449, "in-drivable-lane": 0.6, "deviation-heading": 2.035647668091897, "deviation-center-line": 0.19008849208663176}, "ep001": {"driven_any": 0.2573432846425337, "driven_lanedir": 0.2561200256083098, "in-drivable-lane": 0, "deviation-heading": 0.17673821454925606, "deviation-center-line": 0.20420172648538432}, "ep002": {"driven_any": 1.182746853541795, "driven_lanedir": 1.1084334171557773, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.6281599088608705, "deviation-center-line": 0.35434867307286394}, "ep003": {"driven_any": 1.0949819717424556, "driven_lanedir": 1.0912619516892297, "in-drivable-lane": 0, "deviation-heading": 0.4758136063126942, "deviation-center-line": 0.4163169396040424}, "ep004": {"driven_any": 1.600431044772758, "driven_lanedir": 1.2646710312972245, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 3.5738141012812856, "deviation-center-line": 0.5503217644623789}}
No reset possible
109021280Yun Chen 🇨🇦Random executionaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-181400:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
108871280Yun Chen 🇨🇦Random executionaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
108851279Yun Chen 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2332896871989636
deviation-center-line_median0.2116792544883902
in-drivable-lane_median0


other stats
deviation-center-line_max0.6323564732185519
deviation-center-line_mean0.2912504656486582
deviation-center-line_min0.12670548452775535
deviation-heading_max1.728976789403258
deviation-heading_mean0.8194124233994693
deviation-heading_median0.582523377361064
deviation-heading_min0.4668112744530743
driven_any_max1.0714883694442423
driven_any_mean0.39858127916586666
driven_any_median0.25000443206491196
driven_any_min0.14641855465317552
driven_lanedir_max0.8388467814636376
driven_lanedir_mean0.33922668007033285
driven_lanedir_min0.129237910180789
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0714883694442423, "driven_lanedir": 0.8388467814636376, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.728976789403258, "deviation-center-line": 0.6323564732185519}, "ep001": {"driven_any": 0.3250077317230347, "driven_lanedir": 0.31702584203169426, "in-drivable-lane": 0, "deviation-heading": 0.4668112744530743, "deviation-center-line": 0.35258484316877714}, "ep002": {"driven_any": 0.14641855465317552, "driven_lanedir": 0.129237910180789, "in-drivable-lane": 0, "deviation-heading": 0.582523377361064, "deviation-center-line": 0.12670548452775535}, "ep003": {"driven_any": 0.1999873079439689, "driven_lanedir": 0.17773317947657974, "in-drivable-lane": 0, "deviation-heading": 0.742904646059641, "deviation-center-line": 0.13292627283981628}, "ep004": {"driven_any": 0.25000443206491196, "driven_lanedir": 0.2332896871989636, "in-drivable-lane": 0, "deviation-heading": 0.5758460297203092, "deviation-center-line": 0.2116792544883902}}
No reset possible
108741279Yun Chen 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-181400:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
108691279Yun Chen 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 302, "reward": -3.5777069131588557, "good_angle": 0.6024564633123007, "survival_time": 10.066666666666642, "traveled_tiles": 3, "valid_direction": 0.8333333333333304}, "ep001": {"nsteps": 93, "reward": -11.362867097380342, "good_angle": 0.1931402884433512, "survival_time": 3.0999999999999988, "traveled_tiles": 1, "valid_direction": 0.36666666666666536}, "ep002": {"nsteps": 43, "reward": -23.74938964081365, "good_angle": 0.392680801778661, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 0.7333333333333345}, "ep003": {"nsteps": 58, "reward": -17.61265381656844, "good_angle": 0.5138578545813727, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 0.7666666666666684}, "ep004": {"nsteps": 72, "reward": -14.360620699822904, "good_angle": 0.3875667065210761, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.5333333333333321}}
good_angle_max0.6024564633123007
good_angle_mean0.4179404229273523
good_angle_median0.392680801778661
good_angle_min0.1931402884433512
reward_max-3.5777069131588557
reward_mean-14.13264763354884
reward_median-14.360620699822904
reward_min-23.74938964081365
survival_time_max10.066666666666642
survival_time_mean3.786666666666662
survival_time_min1.4333333333333345
traveled_tiles_max3
traveled_tiles_mean1.6
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.8333333333333304
valid_direction_mean0.6466666666666662
valid_direction_median0.7333333333333345
valid_direction_min0.36666666666666536
No reset possible
108631279Yun Chen 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:03:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
108571278Rob VenablesSolution templateaido1_luck-v3step1successyesidsc-rudolf-181400:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score123.814914228374832


No reset possible
108481277Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-181400:10:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108431276Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-181400:10:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108321275Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-181400:10:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108311274Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-181400:10:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
108271273Guohao LiSolution templateaido1_luck-v3step1successyesidsc-rudolf-181400:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score145.87483798090116


No reset possible
108211272Guohao LiSolution templateaido1_luck-v3step1successyesidsc-rudolf-181400:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score172.99644279365036


No reset possible
108171271Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1317915302969372
deviation-center-line_median0.6743512715176876
in-drivable-lane_median0.1999999999999993


other stats
deviation-center-line_max0.7762408815258576
deviation-center-line_mean0.5626846477112066
deviation-center-line_min0.20970474862945557
deviation-heading_max4.509761849749127
deviation-heading_mean2.4032842730881687
deviation-heading_median1.9722356045778031
deviation-heading_min0.46119004706021777
driven_any_max1.6784777980539975
driven_any_mean1.1794130246561294
driven_any_median1.1774835000531658
driven_any_min0.3715917677008975
driven_lanedir_max1.6765159288409108
driven_lanedir_mean0.9841876945010644
driven_lanedir_min0.1602152995236219
in-drivable-lane_max0.7666666666666639
in-drivable-lane_mean0.3199999999999993
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3715917677008975, "driven_lanedir": 0.1602152995236219, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 1.9722356045778031, "deviation-center-line": 0.20970474862945557}, "ep001": {"driven_any": 1.0636571696641892, "driven_lanedir": 0.6917513213822795, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 4.509761849749127, "deviation-center-line": 0.7561787083427819}, "ep002": {"driven_any": 1.1774835000531658, "driven_lanedir": 1.1317915302969372, "in-drivable-lane": 0, "deviation-heading": 1.159371319469394, "deviation-center-line": 0.3969476285402502}, "ep003": {"driven_any": 1.6784777980539975, "driven_lanedir": 1.6765159288409108, "in-drivable-lane": 0, "deviation-heading": 0.46119004706021777, "deviation-center-line": 0.7762408815258576}, "ep004": {"driven_any": 1.6058548878083976, "driven_lanedir": 1.2606643924615717, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 3.913862544584301, "deviation-center-line": 0.6743512715176876}}
No reset possible
108111271Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.49999999999998


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -12.594963072856634, "good_angle": 1.179753153433826, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 230, "reward": -5.431255984695062, "good_angle": 16.109426524471456, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 255, "reward": -4.346870108328614, "good_angle": 1.0142558554378145, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.0999999999999934}, "ep003": {"nsteps": 361, "reward": -3.0704857812487516, "good_angle": 0.034109257356551625, "survival_time": 12.0333333333333, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.565080447820505, "good_angle": 21.142156874080055, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}
good_angle_max21.142156874080055
good_angle_mean7.8959403329559406
good_angle_median1.179753153433826
good_angle_min0.034109257356551625
reward_max-3.0704857812487516
reward_mean-5.8017310789899135
reward_median-4.346870108328614
reward_min-12.594963072856634
survival_time_max12.0333333333333
survival_time_mean8.486666666666647
survival_time_min2.7
traveled_tiles_max4
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.9666666666666535
valid_direction_mean2.4466666666666597
valid_direction_median2.2333333333333334
valid_direction_min0
No reset possible
108011271Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
107951270Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9394202467524176
deviation-center-line_median0.5005461180613384
in-drivable-lane_median0


other stats
deviation-center-line_max0.8019762026714526
deviation-center-line_mean0.46453888385325126
deviation-center-line_min0.21054410665275972
deviation-heading_max3.827263075148643
deviation-heading_mean1.494999243689109
deviation-heading_median0.9923897161178532
deviation-heading_min0.17098922103056
driven_any_max1.6105203163952195
driven_any_mean0.8935799240412866
driven_any_median0.9415373933628172
driven_any_min0.3657972991350469
driven_lanedir_max1.2454280154214263
driven_lanedir_mean0.7705575447787474
driven_lanedir_min0.15506621419634292
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.3199999999999993
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3657972991350469, "driven_lanedir": 0.15506621419634292, "in-drivable-lane": 0.6, "deviation-heading": 2.0441369547682884, "deviation-center-line": 0.21054410665275972}, "ep001": {"driven_any": 0.37268928175592897, "driven_lanedir": 0.37189411852472865, "in-drivable-lane": 0, "deviation-heading": 0.17098922103056, "deviation-center-line": 0.2916484846388874}, "ep002": {"driven_any": 1.1773553295574206, "driven_lanedir": 1.1409791289988214, "in-drivable-lane": 0, "deviation-heading": 0.9923897161178532, "deviation-center-line": 0.5005461180613384}, "ep003": {"driven_any": 0.9415373933628172, "driven_lanedir": 0.9394202467524176, "in-drivable-lane": 0, "deviation-heading": 0.4402172513802, "deviation-center-line": 0.5179795072418177}, "ep004": {"driven_any": 1.6105203163952195, "driven_lanedir": 1.2454280154214263, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 3.827263075148643, "deviation-center-line": 0.8019762026714526}}
No reset possible
107891270Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-181400:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
107861270Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.799999999999986


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -12.59392248302767, "good_angle": 1.2156126068944273, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 81, "reward": -12.911595400836733, "good_angle": 0.011156086737876828, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 254, "reward": -4.437077517995215, "good_angle": 0.8658368839697798, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 2.033333333333327}, "ep003": {"nsteps": 204, "reward": -5.272974844510649, "good_angle": 0.03033246554319256, "survival_time": 6.799999999999986, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.655747907953468, "good_angle": 21.771657353630022, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}
good_angle_max21.771657353630022
good_angle_mean4.77891907935506
good_angle_median0.8658368839697798
good_angle_min0.011156086737876828
reward_max-3.655747907953468
reward_mean-7.7742636308647475
reward_median-5.272974844510649
reward_min-12.911595400836733
survival_time_max11.533333333333305
survival_time_mean6.439999999999986
survival_time_min2.7
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.93333333333332
valid_direction_mean1.6399999999999963
valid_direction_median2.033333333333327
valid_direction_min0
No reset possible
10780356Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.481042290524149
deviation-center-line_median0.2339370288761713
in-drivable-lane_median3.1666666666666554


other stats
deviation-center-line_max0.3887111922952009
deviation-center-line_mean0.2586161601601217
deviation-center-line_min0.18135154954873856
deviation-heading_max2.50309613217222
deviation-heading_mean1.2944517420712691
deviation-heading_median0.9876146032429244
deviation-heading_min0.22282122232957288
driven_any_max1.2789432717800575
driven_any_mean0.8078205932391744
driven_any_median1.0186256472933577
driven_any_min0.2568548411010332
driven_lanedir_max0.6886799360751179
driven_lanedir_mean0.4077758085758731
driven_lanedir_min0.12255962906563632
in-drivable-lane_max4.366666666666651
in-drivable-lane_mean2.3533333333333255
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3451086440022018, "driven_lanedir": 0.12255962906563632, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 1.845635471935517, "deviation-center-line": 0.18135154954873856}, "ep001": {"driven_any": 0.2568548411010332, "driven_lanedir": 0.25402061296093104, "in-drivable-lane": 0, "deviation-heading": 0.22282122232957288, "deviation-center-line": 0.2339370288761713}, "ep002": {"driven_any": 1.2789432717800575, "driven_lanedir": 0.6886799360751179, "in-drivable-lane": 3.1666666666666554, "deviation-heading": 2.50309613217222, "deviation-center-line": 0.3887111922952009}, "ep003": {"driven_any": 1.1395705620192222, "driven_lanedir": 0.4925765742535315, "in-drivable-lane": 4.366666666666651, "deviation-heading": 0.913091280676112, "deviation-center-line": 0.25652286886349257}, "ep004": {"driven_any": 1.0186256472933577, "driven_lanedir": 0.481042290524149, "in-drivable-lane": 3.566666666666654, "deviation-heading": 0.9876146032429244, "deviation-center-line": 0.232558161217005}}
No reset possible
10771356Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.1666666666666545


other stats
episodes
details{"ep000": {"nsteps": 73, "reward": -13.967838363830408, "good_angle": 1.1348289113064052, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 1.966666666666668}, "ep001": {"nsteps": 64, "reward": -16.202794682234526, "good_angle": 0.02641407510084338, "survival_time": 2.1333333333333355, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 236, "reward": -4.795201715855401, "good_angle": 2.6918874701801223, "survival_time": 7.866666666666648, "traveled_tiles": 3, "valid_direction": 4.799999999999985}, "ep003": {"nsteps": 211, "reward": -6.0455723037704345, "good_angle": 1.1701484093436572, "survival_time": 7.033333333333318, "traveled_tiles": 3, "valid_direction": 5.899999999999984}, "ep004": {"nsteps": 185, "reward": -6.662634145226833, "good_angle": 1.516460368667395, "survival_time": 6.1666666666666545, "traveled_tiles": 2, "valid_direction": 5.066666666666654}}
good_angle_max2.6918874701801223
good_angle_mean1.3079478469196846
good_angle_median1.1701484093436572
good_angle_min0.02641407510084338
reward_max-4.795201715855401
reward_mean-9.53480824218352
reward_median-6.662634145226833
reward_min-16.202794682234526
survival_time_max7.866666666666648
survival_time_mean5.126666666666658
survival_time_min2.1333333333333355
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.899999999999984
valid_direction_mean3.5466666666666584
valid_direction_median4.799999999999985
valid_direction_min0
No reset possible
10763522Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.04411107874427467
deviation-center-line_median0.03382312812944439
in-drivable-lane_median0


other stats
deviation-center-line_max0.036932541750262865
deviation-center-line_mean0.025155405677972437
deviation-center-line_min0
deviation-heading_max0.33344468140579925
deviation-heading_mean0.22039329655951928
deviation-heading_median0.26280377843412867
deviation-heading_min0
driven_any_max3.3176367416071093
driven_any_mean0.7248170230659711
driven_any_median0.07328113284674392
driven_any_min0.05329536934308598
driven_lanedir_max0.04675978410254445
driven_lanedir_mean0.034855625077198346
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.3733333333333304
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 3.3176367416071093, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.05329536934308598, "driven_lanedir": 0.03825011064919037, "in-drivable-lane": 0, "deviation-heading": 0.21638555899448664, "deviation-center-line": 0.034025485829071465}, "ep002": {"driven_any": 0.07328113284674392, "driven_lanedir": 0.04515715188998226, "in-drivable-lane": 0, "deviation-heading": 0.33344468140579925, "deviation-center-line": 0.036932541750262865}, "ep003": {"driven_any": 0.11325265985405814, "driven_lanedir": 0.04411107874427467, "in-drivable-lane": 0.23333333333333336, "deviation-heading": 0.28933246396318174, "deviation-center-line": 0.020995872681083456}, "ep004": {"driven_any": 0.0666192116788584, "driven_lanedir": 0.04675978410254445, "in-drivable-lane": 0, "deviation-heading": 0.26280377843412867, "deviation-center-line": 0.03382312812944439}}
No reset possible
10760522Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-181400:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10755522Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.4333333333333333


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.68614059394598, "good_angle": 59.948933459239534, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.13333333333332}, "ep001": {"nsteps": 10, "reward": -100.64196230173113, "good_angle": 0.2519482119431119, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666666}, "ep002": {"nsteps": 13, "reward": -77.50082855499707, "good_angle": 0.42986404853629945, "survival_time": 0.4333333333333333, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep003": {"nsteps": 19, "reward": -54.13723141543175, "good_angle": 0.6432325258251529, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.5666666666666665}, "ep004": {"nsteps": 12, "reward": -83.87529777487119, "good_angle": 0.3259875752032355, "survival_time": 0.4, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}}
good_angle_max59.948933459239534
good_angle_mean12.319993164149468
good_angle_median0.42986404853629945
good_angle_min0.2519482119431119
reward_max-1.68614059394598
reward_mean-63.568292128195424
reward_median-77.50082855499707
reward_min-100.64196230173113
survival_time_max16.666666666666654
survival_time_mean3.6933333333333302
survival_time_min0.3333333333333333
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.13333333333332
valid_direction_mean3.3266666666666644
valid_direction_median0.3666666666666666
valid_direction_min0.2666666666666666
No reset possible
107471243Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-181400:10:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10736557Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-181400:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10731557Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.1977541041908553, "good_angle": 0.36298213052672623, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0.9666666666666676}, "ep001": {"nsteps": 500, "reward": -1.339590645131888, "good_angle": 34.7735258835203, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 8.700000000000006}, "ep002": {"nsteps": 500, "reward": -0.29502056005381744, "good_angle": 2.2339003307145195, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.8999999999999897}, "ep003": {"nsteps": 500, "reward": -0.2434058041125536, "good_angle": 0.01939698164440947, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.4378754947655834, "good_angle": 16.878384306223346, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 4.066666666666652}}
good_angle_max34.7735258835203
good_angle_mean10.85363792652586
good_angle_median2.2339003307145195
good_angle_min0.01939698164440947
reward_max-0.1977541041908553
reward_mean-0.5027293216509395
reward_median-0.29502056005381744
reward_min-1.339590645131888
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max5
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max8.700000000000006
valid_direction_mean3.326666666666663
valid_direction_median2.8999999999999897
valid_direction_min0
No reset possible
10722557Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:05:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
107041054David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:04:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.0554428873616786
deviation-center-line_median0.6141397077561574
in-drivable-lane_median0.466666666666665


other stats
deviation-center-line_max1.0185134787913035
deviation-center-line_mean0.6297267075674231
deviation-center-line_min0.15406282312759506
deviation-heading_max2.9719488126799143
deviation-heading_mean1.7041424503792009
deviation-heading_median1.5766709344975451
deviation-heading_min0.48776593329341816
driven_any_max4.640053907361315
driven_any_mean2.914472170500271
driven_any_median2.3759232888546973
driven_any_min1.136723992762137
driven_lanedir_max4.333227170761488
driven_lanedir_mean2.7064645304119317
driven_lanedir_min1.1165744195167024
in-drivable-lane_max0.8333333333333326
in-drivable-lane_mean0.413333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.3759232888546973, "driven_lanedir": 2.0554428873616786, "in-drivable-lane": 0.8333333333333326, "deviation-heading": 1.416877853155038, "deviation-center-line": 0.6141397077561574}, "ep001": {"driven_any": 2.1616056616275197, "driven_lanedir": 2.017934293509748, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 1.5766709344975451, "deviation-center-line": 0.4478209495868899}, "ep002": {"driven_any": 4.640053907361315, "driven_lanedir": 4.333227170761488, "in-drivable-lane": 0.5666666666666682, "deviation-heading": 2.9719488126799143, "deviation-center-line": 1.0185134787913035}, "ep003": {"driven_any": 4.258054001895686, "driven_lanedir": 4.009143880910043, "in-drivable-lane": 0.466666666666665, "deviation-heading": 2.0674487182700876, "deviation-center-line": 0.91409657857517}, "ep004": {"driven_any": 1.136723992762137, "driven_lanedir": 1.1165744195167024, "in-drivable-lane": 0, "deviation-heading": 0.48776593329341816, "deviation-center-line": 0.15406282312759506}}
No reset possible
10697382Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step4-vizsuccessnoidsc-rudolf-181400:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.135523488622255
in-drivable-lane_median0


other stats
deviation-center-line_max0.20277288570255247
deviation-center-line_mean0.15713995760247873
deviation-center-line_min0.12319705432375865
deviation-heading_max0.6730755856361216
deviation-heading_mean0.5580494388122992
deviation-heading_median0.6240102711938362
deviation-heading_min0.34745856663715596
driven_any_max2.7073291631833416
driven_any_mean1.5041500711544669
driven_any_median1.3999000061733755
driven_any_min0.7901078660859177
driven_lanedir_max2.1809273114937224
driven_lanedir_mean1.3680573066310124
driven_lanedir_median1.3418330633997482
driven_lanedir_min0.771662756347127
in-drivable-lane_max1.3000000000000005
in-drivable-lane_mean0.26000000000000006
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.7073291631833416, "driven_lanedir": 2.1809273114937224, "in-drivable-lane": 1.3000000000000005, "deviation-heading": 0.6240102711938362, "deviation-center-line": 0.20277288570255247}, "ep001": {"driven_any": 0.7901078660859177, "driven_lanedir": 0.771662756347127, "in-drivable-lane": 0, "deviation-heading": 0.34745856663715596, "deviation-center-line": 0.12319705432375865}, "ep002": {"driven_any": 1.1990049307302877, "driven_lanedir": 1.1529037630673282, "in-drivable-lane": 0, "deviation-heading": 0.6708255934156495, "deviation-center-line": 0.19167733007167811}, "ep003": {"driven_any": 1.4244083895994109, "driven_lanedir": 1.3929596388471372, "in-drivable-lane": 0, "deviation-heading": 0.4748771771787324, "deviation-center-line": 0.13252902929214944}, "ep004": {"driven_any": 1.3999000061733755, "driven_lanedir": 1.3418330633997482, "in-drivable-lane": 0, "deviation-heading": 0.6730755856361216, "deviation-center-line": 0.135523488622255}}
No reset possible
10686382Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step3-videossuccessyesidsc-rudolf-181400:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
106801269Anton Mashikhin 🇷🇺Tensorflow templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-181400:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1858751062372497
deviation-center-line_median0.563832971626301
in-drivable-lane_median0


other stats
deviation-center-line_max1.171904084883277
deviation-center-line_mean0.6539107884903486
deviation-center-line_min0.24020081309801997
deviation-heading_max3.0057576388028675
deviation-heading_mean1.5424166222765243
deviation-heading_median1.7568368852682044
deviation-heading_min0.2120145709685025
driven_any_max2.881829737813101
driven_any_mean1.5227547131437291
driven_any_median1.3207264084194723
driven_any_min0.3081525678993841
driven_lanedir_max2.566276890528922
driven_lanedir_mean1.353809568945074
driven_lanedir_min0.30220264994404955
in-drivable-lane_max0.7666666666666639
in-drivable-lane_mean0.2999999999999995
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.2732605836701687, "driven_lanedir": 1.899170232720776, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 3.0057576388028675, "deviation-center-line": 0.7382793824375652}, "ep001": {"driven_any": 0.3081525678993841, "driven_lanedir": 0.30220264994404955, "in-drivable-lane": 0, "deviation-heading": 0.2120145709685025, "deviation-center-line": 0.24020081309801997}, "ep002": {"driven_any": 1.3207264084194723, "driven_lanedir": 1.1858751062372497, "in-drivable-lane": 0, "deviation-heading": 2.2534935478285467, "deviation-center-line": 0.5553366904065802}, "ep003": {"driven_any": 2.881829737813101, "driven_lanedir": 2.566276890528922, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 1.7568368852682044, "deviation-center-line": 1.171904084883277}, "ep004": {"driven_any": 0.8298042679165203, "driven_lanedir": 0.8155229652943727, "in-drivable-lane": 0, "deviation-heading": 0.4839804685145004, "deviation-center-line": 0.563832971626301}}
No reset possible
106681269Anton Mashikhin 🇷🇺Tensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-181400:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.066666666666649


other stats
episodes
details{"ep000": {"nsteps": 366, "reward": -2.8605892974333647, "good_angle": 1.0505563586293576, "survival_time": 12.199999999999967, "traveled_tiles": 4, "valid_direction": 1.5999999999999943}, "ep001": {"nsteps": 68, "reward": -15.262957413845202, "good_angle": 0.07264626603606153, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.13333333333333286}, "ep002": {"nsteps": 242, "reward": -4.316510446161111, "good_angle": 0.7448688903986106, "survival_time": 8.066666666666649, "traveled_tiles": 3, "valid_direction": 1.1333333333333302}, "ep003": {"nsteps": 500, "reward": -0.28015136850846467, "good_angle": 0.36737863546305544, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.8333333333333304}, "ep004": {"nsteps": 185, "reward": -5.872051970217679, "good_angle": 0.12052446599570546, "survival_time": 6.1666666666666545, "traveled_tiles": 2, "valid_direction": 0.2333333333333325}}
good_angle_max1.0505563586293576
good_angle_mean0.47119492330455814
good_angle_median0.36737863546305544
good_angle_min0.07264626603606153
reward_max-0.28015136850846467
reward_mean-5.718452099233165
reward_median-4.316510446161111
reward_min-15.262957413845202
survival_time_max16.666666666666654
survival_time_mean9.07333333333332
survival_time_min2.2666666666666684
traveled_tiles_max6
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.5999999999999943
valid_direction_mean0.7866666666666641
valid_direction_median0.8333333333333304
valid_direction_min0.13333333333333286
No reset possible
106631269Anton Mashikhin 🇷🇺Tensorflow templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-181400:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible