Duckietown Challenges Home Challenges Submissions

Evaluator 320

ID320
evaluatorrudolf-3
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processrudolf-3
versionDC:3.1.56;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success374 5978
# timeout7 6179
# failed52 6013
# error14 6535
# aborted37 6018
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
96191224Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.18593727052428743
deviation-center-line_median0.13545724334442524
in-drivable-lane_median0


other stats
deviation-center-line_max0.2121252201534077
deviation-center-line_mean0.15204467621031437
deviation-center-line_min0.0907236145497465
deviation-heading_max1.8103033288132035
deviation-heading_mean0.8249094550042821
deviation-heading_median0.619221007243969
deviation-heading_min0.3806880627276445
driven_any_max0.5535890739311885
driven_any_mean0.24785545912074977
driven_any_median0.20712862085625497
driven_any_min0.08927803999964294
driven_lanedir_max0.2864168380688654
driven_lanedir_mean0.1796007061408972
driven_lanedir_min0.07496946865388754
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5535890739311885, "driven_lanedir": 0.2864168380688654, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8103033288132035, "deviation-center-line": 0.2121252201534077}, "ep001": {"driven_any": 0.08927803999964294, "driven_lanedir": 0.07496946865388754, "in-drivable-lane": 0, "deviation-heading": 0.3806880627276445, "deviation-center-line": 0.0907236145497465}, "ep002": {"driven_any": 0.15356656289145348, "driven_lanedir": 0.13200096264385608, "in-drivable-lane": 0, "deviation-heading": 0.619221007243969, "deviation-center-line": 0.12749989711054877}, "ep003": {"driven_any": 0.20712862085625497, "driven_lanedir": 0.18593727052428743, "in-drivable-lane": 0, "deviation-heading": 0.7317863776228286, "deviation-center-line": 0.13545724334442524}, "ep004": {"driven_any": 0.23571499792520892, "driven_lanedir": 0.21867899081358955, "in-drivable-lane": 0, "deviation-heading": 0.5825484986137648, "deviation-center-line": 0.19441740589344356}}
No reset possible
96101224Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.0000000000000027


other stats
episodes
details{"ep000": {"nsteps": 157, "reward": -6.492586920561735, "good_angle": 1.3683957633124388, "survival_time": 5.2333333333333245, "traveled_tiles": 2, "valid_direction": 1.4333333333333285}, "ep001": {"nsteps": 27, "reward": -37.624832691969694, "good_angle": 0.3679659130863424, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 45, "reward": -22.703929291831123, "good_angle": 0.48825827514856446, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 0.7333333333333347}, "ep003": {"nsteps": 60, "reward": -17.02826870282491, "good_angle": 0.49721794889685833, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 0.733333333333335}, "ep004": {"nsteps": 68, "reward": -15.165259198669125, "good_angle": 0.40395269719829463, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.5999999999999999}}
good_angle_max1.3683957633124388
good_angle_mean0.6251581195284996
good_angle_median0.48825827514856446
good_angle_min0.3679659130863424
reward_max-6.492586920561735
reward_mean-19.802975361171317
reward_median-17.02826870282491
reward_min-37.624832691969694
survival_time_max5.2333333333333245
survival_time_mean2.38
survival_time_min0.8999999999999999
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4333333333333285
valid_direction_mean0.7866666666666662
valid_direction_median0.7333333333333347
valid_direction_min0.4333333333333333
No reset possible
96011222Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
95981222Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9666666666666697


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -4.719582723466226, "good_angle": 0.827690981535544, "survival_time": 7.399999999999984, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 18, "reward": -56.20794405208694, "good_angle": 0.3910074945079643, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 49, "reward": -20.86513386332259, "good_angle": 0.4576640242189694, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.6666666666666685}, "ep003": {"nsteps": 59, "reward": -17.31513208580219, "good_angle": 0.5169655128458458, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.9000000000000025}, "ep004": {"nsteps": 68, "reward": -15.1840578650727, "good_angle": 0.3522119257447155, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.5666666666666664}}
good_angle_max0.827690981535544
good_angle_mean0.5091079877706078
good_angle_median0.4576640242189694
good_angle_min0.3522119257447155
reward_max-4.719582723466226
reward_mean-22.85837011795013
reward_median-17.31513208580219
reward_min-56.20794405208694
survival_time_max7.399999999999984
survival_time_mean2.773333333333331
survival_time_min0.6
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.8066666666666664
valid_direction_median0.6666666666666685
valid_direction_min0.4333333333333333
No reset possible
95941221Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22096312176243016
deviation-center-line_median0.19880498818659031
in-drivable-lane_median0


other stats
deviation-center-line_max0.6293552507428882
deviation-center-line_mean0.3202451642558324
deviation-center-line_min0.06352079267785976
deviation-heading_max1.788585017682982
deviation-heading_mean0.7994264028128917
deviation-heading_median0.6057069933900288
deviation-heading_min0.3982876917588236
driven_any_max1.0786314197900957
driven_any_mean0.4400159348473123
driven_any_median0.23928782003618104
driven_any_min0.05713532940008824
driven_lanedir_max0.8483114758933026
driven_lanedir_mean0.3831246381751648
driven_lanedir_min0.040915222436129994
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0786314197900957, "driven_lanedir": 0.8483114758933026, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.788585017682982, "deviation-center-line": 0.6293552507428882}, "ep001": {"driven_any": 0.05713532940008824, "driven_lanedir": 0.040915222436129994, "in-drivable-lane": 0, "deviation-heading": 0.3982876917588236, "deviation-center-line": 0.06352079267785976}, "ep002": {"driven_any": 0.18569565058563897, "driven_lanedir": 0.17032416721624788, "in-drivable-lane": 0, "deviation-heading": 0.6057069933900288, "deviation-center-line": 0.16088041312670429}, "ep003": {"driven_any": 0.6393294544245576, "driven_lanedir": 0.6351092035677133, "in-drivable-lane": 0, "deviation-heading": 0.5675983396169617, "deviation-center-line": 0.5486643765451195}, "ep004": {"driven_any": 0.23928782003618104, "driven_lanedir": 0.22096312176243016, "in-drivable-lane": 0, "deviation-heading": 0.6369539716156623, "deviation-center-line": 0.19880498818659031}}
No reset possible
95881221Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 304, "reward": -3.544891038253186, "good_angle": 0.6149347500527267, "survival_time": 10.133333333333308, "traveled_tiles": 3, "valid_direction": 1.0333333333333297}, "ep001": {"nsteps": 18, "reward": -56.21945972906219, "good_angle": 0.39524455375135303, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 54, "reward": -19.004341699458937, "good_angle": 0.35626957262112674, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 0.8666666666666689}, "ep003": {"nsteps": 181, "reward": -5.987739168766124, "good_angle": 0.07938019184648165, "survival_time": 6.033333333333322, "traveled_tiles": 2, "valid_direction": 0.06666666666666671}, "ep004": {"nsteps": 69, "reward": -14.957443509844769, "good_angle": 0.40783681279472545, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.7}}
good_angle_max0.6149347500527267
good_angle_mean0.37073317621328267
good_angle_median0.39524455375135303
good_angle_min0.07938019184648165
reward_max-3.544891038253186
reward_mean-19.942775029077037
reward_median-14.957443509844769
reward_min-56.21945972906219
survival_time_max10.133333333333308
survival_time_mean4.173333333333327
survival_time_min0.6
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.0333333333333297
valid_direction_mean0.6266666666666664
valid_direction_median0.7
valid_direction_min0.06666666666666671
No reset possible
95861220Mandana Samiei 🇨🇦Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.23324491367228983
deviation-center-line_median0.2150301579118613
in-drivable-lane_median0


other stats
deviation-center-line_max0.39913074511024854
deviation-center-line_mean0.24226981229149605
deviation-center-line_min0.13430345374789454
deviation-heading_max1.7789406744680691
deviation-heading_mean0.8156948451533571
deviation-heading_median0.6326450239806046
deviation-heading_min0.3245225962674903
driven_any_max0.7750395823665088
driven_any_mean0.35358002997555943
driven_any_median0.2500071083132829
driven_any_min0.16784180070863805
driven_lanedir_max0.5296447723104338
driven_lanedir_mean0.2924879656004834
driven_lanedir_min0.1481681858654882
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7750395823665088, "driven_lanedir": 0.5296447723104338, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7789406744680691, "deviation-center-line": 0.32632178600261635}, "ep001": {"driven_any": 0.3785966992602364, "driven_lanedir": 0.37673541038333824, "in-drivable-lane": 0, "deviation-heading": 0.3245225962674903, "deviation-center-line": 0.39913074511024854}, "ep002": {"driven_any": 0.16784180070863805, "driven_lanedir": 0.1481681858654882, "in-drivable-lane": 0, "deviation-heading": 0.6326450239806046, "deviation-center-line": 0.13656291868485962}, "ep003": {"driven_any": 0.19641495922913116, "driven_lanedir": 0.1746465457708668, "in-drivable-lane": 0, "deviation-heading": 0.7719826036797534, "deviation-center-line": 0.13430345374789454}, "ep004": {"driven_any": 0.2500071083132829, "driven_lanedir": 0.23324491367228983, "in-drivable-lane": 0, "deviation-heading": 0.5703833273708683, "deviation-center-line": 0.2150301579118613}}
No reset possible
95821220Mandana Samiei 🇨🇦Improved ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:11
Error while running [...]

Creating job9582-9883_scorer_1 ... error
stderr | ERROR: for job9582-9883_scorer_1  Cannot start service scorer: network job9582-9883_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9582-9883_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95761220Mandana Samiei 🇨🇦Improved ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
95741219Mandana Samiei 🇨🇦Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.319983455359965
deviation-center-line_median0.33174953750978914
in-drivable-lane_median0


other stats
deviation-center-line_max0.6509099876476642
deviation-center-line_mean0.33511713874589744
deviation-center-line_min0.1301864645305511
deviation-heading_max1.5797604979275617
deviation-heading_mean0.7649196786586597
deviation-heading_median0.6099670625891219
deviation-heading_min0.26011274137512863
driven_any_max1.1000741042066198
driven_any_mean0.4528758592856047
driven_any_median0.3214479430386286
driven_any_min0.15713599716398322
driven_lanedir_max0.8768350771073734
driven_lanedir_mean0.39849736172116934
driven_lanedir_min0.13699082192683787
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1000741042066198, "driven_lanedir": 0.8768350771073734, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.5797604979275617, "deviation-center-line": 0.6509099876476642}, "ep001": {"driven_any": 0.3214479430386286, "driven_lanedir": 0.319983455359965, "in-drivable-lane": 0, "deviation-heading": 0.26011274137512863, "deviation-center-line": 0.33174953750978914}, "ep002": {"driven_any": 0.15713599716398322, "driven_lanedir": 0.13699082192683787, "in-drivable-lane": 0, "deviation-heading": 0.6099670625891219, "deviation-center-line": 0.1301864645305511}, "ep003": {"driven_any": 0.45358418885246193, "driven_lanedir": 0.43892107953366954, "in-drivable-lane": 0, "deviation-heading": 0.7984988043681084, "deviation-center-line": 0.35299897661705215}, "ep004": {"driven_any": 0.23213706316633032, "driven_lanedir": 0.2197563746780009, "in-drivable-lane": 0, "deviation-heading": 0.5762592870333781, "deviation-center-line": 0.2097407274244307}}
No reset possible
95651219Mandana Samiei 🇨🇦Improved ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
95521218Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.09804204974533058, "good_angle": 1.1029803703513434, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.6999999999999904}, "ep001": {"nsteps": 33, "reward": -30.893865944761217, "good_angle": 0.005861928445149117, "survival_time": 1.1, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.17009984451299534, "good_angle": 0.9263830970823708, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.1333333333333275}, "ep003": {"nsteps": 500, "reward": -0.1293248508713441, "good_angle": 1.1081828344412037, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.8999999999999897}, "ep004": {"nsteps": 500, "reward": -0.33169459652155636, "good_angle": 15.213106584682173, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 3.333333333333332}}
good_angle_max15.213106584682173
good_angle_mean3.671302963000448
good_angle_median1.1029803703513434
good_angle_min0.005861928445149117
reward_max-0.09804204974533058
reward_mean-6.324605457282489
reward_median-0.17009984451299534
reward_min-30.893865944761217
survival_time_max16.666666666666654
survival_time_mean13.553333333333324
survival_time_min1.1
traveled_tiles_max13
traveled_tiles_mean10
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max3.333333333333332
valid_direction_mean2.213333333333328
valid_direction_median2.6999999999999904
valid_direction_min0
No reset possible
95471216Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median8.612961693827268
deviation-center-line_median1.66985101080796
in-drivable-lane_median2.866666666666658


other stats
deviation-center-line_max1.8035219663301965
deviation-center-line_mean1.6672943452898472
deviation-center-line_min1.4702979645281968
deviation-heading_max2.241648152033716
deviation-heading_mean1.9336734107589677
deviation-heading_median1.922786813802037
deviation-heading_min1.631921368105764
driven_any_max10.671132227372407
driven_any_mean10.670566151885527
driven_any_median10.67072031050144
driven_any_min10.66985370366328
driven_lanedir_max10.311802660582206
driven_lanedir_mean9.103591402096644
driven_lanedir_min8.108706441916016
in-drivable-lane_max3.633333333333322
in-drivable-lane_mean2.09333333333333
in-drivable-lane_min0.13333333333333286
per-episodes
details{"ep000": {"driven_any": 10.67107143524292, "driven_lanedir": 8.108706441916016, "in-drivable-lane": 3.633333333333322, "deviation-heading": 1.922786813802037, "deviation-center-line": 1.6270418552733978}, "ep001": {"driven_any": 10.66985370366328, "driven_lanedir": 9.999863293554435, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 2.1745670886237196, "deviation-center-line": 1.8035219663301965}, "ep002": {"driven_any": 10.67072031050144, "driven_lanedir": 8.612961693827268, "in-drivable-lane": 2.866666666666658, "deviation-heading": 1.6974436312296035, "deviation-center-line": 1.7657589295094858}, "ep003": {"driven_any": 10.671132227372407, "driven_lanedir": 8.484622920603297, "in-drivable-lane": 3.13333333333334, "deviation-heading": 1.631921368105764, "deviation-center-line": 1.66985101080796}, "ep004": {"driven_any": 10.6700530826476, "driven_lanedir": 10.311802660582206, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.241648152033716, "deviation-center-line": 1.4702979645281968}}
No reset possible
95381217Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3448611849734986
deviation-center-line_median0.1360940376865961
in-drivable-lane_median0.3000000000000007


other stats
deviation-center-line_max0.15279920351141194
deviation-center-line_mean0.12772547077005253
deviation-center-line_min0.09571424031611062
deviation-heading_max1.3544858425871171
deviation-heading_mean1.1507145477113467
deviation-heading_median1.26664579225075
deviation-heading_min0.8503816982382598
driven_any_max0.8317741189495187
driven_any_mean0.6576057717100768
driven_any_median0.6319029532825433
driven_any_min0.5809878032226854
driven_lanedir_max0.3754260468023478
driven_lanedir_mean0.33476230080705816
driven_lanedir_min0.28704714251197183
in-drivable-lane_max1.0999999999999996
in-drivable-lane_mean0.47333333333333394
in-drivable-lane_min0.23333333333333395
per-episodes
details{"ep000": {"driven_any": 0.8317741189495187, "driven_lanedir": 0.35578870004131047, "in-drivable-lane": 1.0999999999999996, "deviation-heading": 0.8503816982382598, "deviation-center-line": 0.15279920351141194}, "ep001": {"driven_any": 0.6428351884320265, "driven_lanedir": 0.3448611849734986, "in-drivable-lane": 0.2666666666666675, "deviation-heading": 1.3544858425871171, "deviation-center-line": 0.1360940376865961}, "ep002": {"driven_any": 0.6319029532825433, "driven_lanedir": 0.3754260468023478, "in-drivable-lane": 0.23333333333333395, "deviation-heading": 1.3254736560717963, "deviation-center-line": 0.1371939138429543}, "ep003": {"driven_any": 0.6005287946636105, "driven_lanedir": 0.31068842970616206, "in-drivable-lane": 0.466666666666668, "deviation-heading": 0.9565857494088108, "deviation-center-line": 0.09571424031611062}, "ep004": {"driven_any": 0.5809878032226854, "driven_lanedir": 0.28704714251197183, "in-drivable-lane": 0.3000000000000007, "deviation-heading": 1.26664579225075, "deviation-center-line": 0.11682595849318964}}
No reset possible
95351217Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9666666666666697


other stats
episodes
details{"ep000": {"nsteps": 77, "reward": -13.45209427590349, "good_angle": 1.6972135069765173, "survival_time": 2.5666666666666673, "traveled_tiles": 2, "valid_direction": 1.2333333333333332}, "ep001": {"nsteps": 59, "reward": -17.41927915849423, "good_angle": 1.984803598619705, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 1.6666666666666694}, "ep002": {"nsteps": 59, "reward": -17.332209585234523, "good_angle": 1.7016644552723914, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 1.7000000000000026}, "ep003": {"nsteps": 55, "reward": -18.766690986705097, "good_angle": 1.7208104625503398, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 1.5000000000000024}, "ep004": {"nsteps": 54, "reward": -19.025444146340575, "good_angle": 1.9358121763411735, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 1.6333333333333355}}
good_angle_max1.984803598619705
good_angle_mean1.8080608399520255
good_angle_median1.7208104625503398
good_angle_min1.6972135069765173
reward_max-13.45209427590349
reward_mean-17.19914363053558
reward_median-17.41927915849423
reward_min-19.025444146340575
survival_time_max2.5666666666666673
survival_time_mean2.026666666666669
survival_time_min1.8000000000000025
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.7000000000000026
valid_direction_mean1.5466666666666686
valid_direction_median1.6333333333333355
valid_direction_min1.2333333333333332
No reset possible
95261216Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:14
Error while running [...]

Creating job9526-4941_scorer_1 ... error
stderr | ERROR: for job9526-4941_scorer_1  Cannot start service scorer: network job9526-4941_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9526-4941_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95211215Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
95161214Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
95131214Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5630718003562651, "good_angle": 0.8280733763807488, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.2666666666666586}, "ep001": {"nsteps": 500, "reward": -0.33669511875876923, "good_angle": 16.193088908095046, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.8333333333333255}, "ep002": {"nsteps": 500, "reward": -0.4914418018744327, "good_angle": 0.8988409791019193, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.366666666666663}, "ep003": {"nsteps": 500, "reward": -0.3387374090035446, "good_angle": 0.848640220116467, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.9666666666666668}, "ep004": {"nsteps": 500, "reward": -0.394331519811818, "good_angle": 21.28040776776547, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.466666666666673}}
good_angle_max21.28040776776547
good_angle_mean8.009810250291931
good_angle_median0.8988409791019193
good_angle_min0.8280733763807488
reward_max-0.33669511875876923
reward_mean-0.4248555299609659
reward_median-0.394331519811818
reward_min-0.5630718003562651
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean16.8
traveled_tiles_median18
traveled_tiles_min12
valid_direction_max3.466666666666673
valid_direction_mean2.5799999999999974
valid_direction_median2.366666666666663
valid_direction_min1.9666666666666668
No reset possible
95021214Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:07:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
94921211Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median6.92597893401086
deviation-center-line_median1.9744094251013573
in-drivable-lane_median5.6000000000000165


other stats
deviation-center-line_max2.412506402931079
deviation-center-line_mean1.9923314338227096
deviation-center-line_min1.6892644281277758
deviation-heading_max2.343180019559618
deviation-heading_mean1.6975346844562966
deviation-heading_median1.7685466081464567
deviation-heading_min1.1973157422347669
driven_any_max10.669973460991814
driven_any_mean10.669363226940504
driven_any_median10.669198047061498
driven_any_min10.668567309263388
driven_lanedir_max9.963725117704788
driven_lanedir_mean7.718192564621501
driven_lanedir_min6.680626577679297
in-drivable-lane_max6.033333333333349
in-drivable-lane_mean4.313333333333339
in-drivable-lane_min0.7666666666666639
per-episodes
details{"ep000": {"driven_any": 10.669913484084343, "driven_lanedir": 6.680626577679297, "in-drivable-lane": 6.033333333333349, "deviation-heading": 1.3597931932720149, "deviation-center-line": 1.9744094251013573}, "ep001": {"driven_any": 10.668567309263388, "driven_lanedir": 9.963725117704788, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 2.343180019559618, "deviation-center-line": 2.412506402931079}, "ep002": {"driven_any": 10.669163833301482, "driven_lanedir": 6.747940147835243, "in-drivable-lane": 5.7666666666666515, "deviation-heading": 1.7685466081464567, "deviation-center-line": 1.8879245172062136}, "ep003": {"driven_any": 10.669973460991814, "driven_lanedir": 6.92597893401086, "in-drivable-lane": 5.6000000000000165, "deviation-heading": 1.1973157422347669, "deviation-center-line": 1.6892644281277758}, "ep004": {"driven_any": 10.669198047061498, "driven_lanedir": 8.27269204587732, "in-drivable-lane": 3.400000000000013, "deviation-heading": 1.8188378590686272, "deviation-center-line": 1.9975523957471204}}
No reset possible
94891211Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6727028522803448, "good_angle": 1.061834264301294, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.700000000000004}, "ep001": {"nsteps": 500, "reward": -0.4918768885266036, "good_angle": 26.66240743867511, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.166666666666671}, "ep002": {"nsteps": 500, "reward": -0.643743304630334, "good_angle": 1.1366230217516953, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.733333333333328}, "ep003": {"nsteps": 500, "reward": -0.6310292432021816, "good_angle": 1.0164029677895412, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.3999999999999924}, "ep004": {"nsteps": 500, "reward": -0.5092769675501623, "good_angle": 15.079546325318054, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 2.5333333333333266}}
good_angle_max26.66240743867511
good_angle_mean8.991362803567139
good_angle_median1.1366230217516953
good_angle_min1.0164029677895412
reward_max-0.4918768885266036
reward_mean-0.5897258512379253
reward_median-0.6310292432021816
reward_min-0.6727028522803448
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean17.4
traveled_tiles_median18
traveled_tiles_min15
valid_direction_max4.166666666666671
valid_direction_mean2.9066666666666645
valid_direction_median2.700000000000004
valid_direction_min2.3999999999999924
No reset possible
94831209Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.919384121294204
deviation-center-line_median0.8090704311097238
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max1.2165007639443852
deviation-center-line_mean0.6912095300596949
deviation-center-line_min0.2024779705418009
deviation-heading_max1.9527904544475656
deviation-heading_mean1.1608157432766617
deviation-heading_median1.7454793264284567
deviation-heading_min0.09255222029044716
driven_any_max5.990714562247108
driven_any_mean3.6126070931492302
driven_any_median4.569379080383874
driven_any_min0.6031719054655866
driven_lanedir_max4.393065475454879
driven_lanedir_mean2.4032076141458107
driven_lanedir_min0.6017873829115448
in-drivable-lane_max8.06666666666664
in-drivable-lane_mean3.19333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.990714562247108, "driven_lanedir": 3.1145491508668965, "in-drivable-lane": 7.80000000000001, "deviation-heading": 1.9527904544475656, "deviation-center-line": 0.8090704311097238}, "ep001": {"driven_any": 0.6031719054655866, "driven_lanedir": 0.6017873829115448, "in-drivable-lane": 0, "deviation-heading": 0.09255222029044716, "deviation-center-line": 0.2024779705418009}, "ep002": {"driven_any": 5.910998056623098, "driven_lanedir": 2.919384121294204, "in-drivable-lane": 8.06666666666664, "deviation-heading": 1.7454793264284567, "deviation-center-line": 1.2165007639443852}, "ep003": {"driven_any": 4.569379080383874, "driven_lanedir": 4.393065475454879, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.8997950754613688, "deviation-center-line": 1.0054983665617172}, "ep004": {"driven_any": 0.9887718610264866, "driven_lanedir": 0.9872519402015304, "in-drivable-lane": 0, "deviation-heading": 0.113461639755471, "deviation-center-line": 0.2225001181408475}}
No reset possible
94811198Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyesrudolf-30:00:13
Error while running [...]

Creating job9481-1560_visualization_1 ... error
stderr | ERROR: for job9481-1560_visualization_1  Cannot start service visualization: network job9481-1560_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9481-1560_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94771209Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.2333333333333


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6730641153701581, "good_angle": 1.1257769409562324, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.933333333333323}, "ep001": {"nsteps": 52, "reward": -19.990229403743378, "good_angle": 2.9851842843742027, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.3666666666666678}, "ep002": {"nsteps": 500, "reward": -0.7178257898052689, "good_angle": 1.356196950867545, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.066666666666656}, "ep003": {"nsteps": 367, "reward": -3.119152601437811, "good_angle": 0.4137677896881461, "survival_time": 12.2333333333333, "traveled_tiles": 9, "valid_direction": 1.1333333333333293}, "ep004": {"nsteps": 79, "reward": -13.080453655387782, "good_angle": 0.007977152289526793, "survival_time": 2.6333333333333337, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max2.9851842843742027
good_angle_mean1.1777806236351307
good_angle_median1.1257769409562324
good_angle_min0.007977152289526793
reward_max-0.6730641153701581
reward_mean-7.51614511314888
reward_median-3.119152601437811
reward_min-19.990229403743378
survival_time_max16.666666666666654
survival_time_mean9.986666666666654
survival_time_min1.7333333333333354
traveled_tiles_max12
traveled_tiles_mean7.4
traveled_tiles_median9
traveled_tiles_min2
valid_direction_max3.066666666666656
valid_direction_mean1.4999999999999951
valid_direction_median1.1333333333333293
valid_direction_min0
No reset possible
94621209Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
94561207Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.0000000000000027


other stats
episodes
details{"ep000": {"nsteps": 224, "reward": -4.61717138291507, "good_angle": 0.7420383481512122, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 0.9999999999999976}, "ep001": {"nsteps": 53, "reward": -19.42495947007863, "good_angle": 0.042955154905602984, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 43, "reward": -23.728515676287717, "good_angle": 0.5256172690114571, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 0.6666666666666679}, "ep003": {"nsteps": 60, "reward": -17.03257544413209, "good_angle": 0.5532114615614379, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 0.6000000000000015}, "ep004": {"nsteps": 71, "reward": -14.549652482002552, "good_angle": 0.43591104630443855, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0.5666666666666658}}
good_angle_max0.7420383481512122
good_angle_mean0.4599466559868297
good_angle_median0.5256172690114571
good_angle_min0.042955154905602984
reward_max-4.61717138291507
reward_mean-15.870574891083214
reward_median-17.03257544413209
reward_min-23.728515676287717
survival_time_max7.46666666666665
survival_time_mean3.006666666666665
survival_time_min1.4333333333333345
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.9999999999999976
valid_direction_mean0.5666666666666667
valid_direction_median0.6000000000000015
valid_direction_min0
No reset possible
94531207Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
94431203Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7666666666666688


other stats
episodes
details{"ep000": {"nsteps": 94, "reward": -10.880140648332445, "good_angle": 0.2389941919765413, "survival_time": 3.133333333333332, "traveled_tiles": 3, "valid_direction": 0.2333333333333325}, "ep001": {"nsteps": 13, "reward": -77.54556220540634, "good_angle": 0.12722664664767305, "survival_time": 0.4333333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666666}, "ep002": {"nsteps": 22, "reward": -45.918432533741, "good_angle": 0.04667275508301345, "survival_time": 0.7333333333333333, "traveled_tiles": 2, "valid_direction": 0.1333333333333333}, "ep003": {"nsteps": 500, "reward": -0.7811867533139885, "good_angle": 1.41219851160597, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.3666666666666556}, "ep004": {"nsteps": 53, "reward": -19.349999496959292, "good_angle": 0.09429089177989708, "survival_time": 1.7666666666666688, "traveled_tiles": 2, "valid_direction": 0.2333333333333341}}
good_angle_max1.41219851160597
good_angle_mean0.38387659941861896
good_angle_median0.12722664664767305
good_angle_min0.04667275508301345
reward_max-0.7811867533139885
reward_mean-30.895064327550617
reward_median-19.349999496959292
reward_min-77.54556220540634
survival_time_max16.666666666666654
survival_time_mean4.546666666666664
survival_time_min0.4333333333333333
traveled_tiles_max12
traveled_tiles_mean4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.3666666666666556
valid_direction_mean0.8466666666666643
valid_direction_median0.2333333333333341
valid_direction_min0.1333333333333333
No reset possible
94341201Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.9481850444094272
deviation-center-line_median0.32550056241262193
in-drivable-lane_median8.333333333333329


other stats
deviation-center-line_max1.2153478135504625
deviation-center-line_mean0.5013748879986238
deviation-center-line_min0.1836695230091552
deviation-heading_max6.589855691489218
deviation-heading_mean6.042797634356681
deviation-heading_median6.496699690885762
deviation-heading_min4.0636220927726505
driven_any_max2.996874232173031
driven_any_mean2.993616762079564
driven_any_median2.9926748839663193
driven_any_min2.991757319703342
driven_lanedir_max-0.8008001232404311
driven_lanedir_mean-0.9192185952416204
driven_lanedir_min-0.9525014373938534
in-drivable-lane_max10.499999999999988
in-drivable-lane_mean8.759999999999994
in-drivable-lane_min8.299999999999997
per-episodes
details{"ep000": {"driven_any": 2.9920549928535545, "driven_lanedir": -0.8008001232404311, "in-drivable-lane": 10.499999999999988, "deviation-heading": 4.0636220927726505, "deviation-center-line": 1.2153478135504625}, "ep001": {"driven_any": 2.9926748839663193, "driven_lanedir": -0.94482519851542, "in-drivable-lane": 8.366666666666664, "deviation-heading": 6.496699690885762, "deviation-center-line": 0.507176031247422}, "ep002": {"driven_any": 2.994722381701575, "driven_lanedir": -0.94978117264897, "in-drivable-lane": 8.299999999999997, "deviation-heading": 6.576357487989261, "deviation-center-line": 0.2751805097734573}, "ep003": {"driven_any": 2.996874232173031, "driven_lanedir": -0.9481850444094272, "in-drivable-lane": 8.299999999999997, "deviation-heading": 6.589855691489218, "deviation-center-line": 0.1836695230091552}, "ep004": {"driven_any": 2.991757319703342, "driven_lanedir": -0.9525014373938534, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.487453208646515, "deviation-center-line": 0.32550056241262193}}
No reset possible
94271201Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
94171201Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9740260388851166, "good_angle": 48.18570431826448, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.199999999999994}, "ep001": {"nsteps": 500, "reward": -1.3310678120851516, "good_angle": 13.696020621438183, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999991}, "ep002": {"nsteps": 500, "reward": -1.1231515201330184, "good_angle": 13.694909529387774, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.966666666666658}, "ep003": {"nsteps": 500, "reward": -0.934308636363945, "good_angle": 13.67484107418178, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.933333333333325}, "ep004": {"nsteps": 500, "reward": -1.1827638384401795, "good_angle": 13.717910197460723, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.86666666666666}}
good_angle_max48.18570431826448
good_angle_mean20.59387714814659
good_angle_median13.696020621438183
good_angle_min13.67484107418178
reward_max-0.934308636363945
reward_mean-1.1090635691814823
reward_median-1.1231515201330184
reward_min-1.3310678120851516
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.199999999999994
valid_direction_mean13.193333333333324
valid_direction_median12.966666666666658
valid_direction_min12.86666666666666
No reset possible
94111200Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
94061200Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 97, "reward": -10.544655245320737, "good_angle": 0.11173963995897508, "survival_time": 3.2333333333333316, "traveled_tiles": 3, "valid_direction": 0}, "ep001": {"nsteps": 30, "reward": -33.87644365131855, "good_angle": 0.023909317209167814, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.033333333333333326}, "ep002": {"nsteps": 500, "reward": -0.7842021786547266, "good_angle": 2.100840251866724, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.699999999999985}, "ep003": {"nsteps": 69, "reward": -14.911100610010866, "good_angle": 0.020366536763589224, "survival_time": 2.3000000000000016, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 27, "reward": -37.48049445395117, "good_angle": 0.15041063828894063, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.23333333333333328}}
good_angle_max2.100840251866724
good_angle_mean0.4814532768174794
good_angle_median0.11173963995897508
good_angle_min0.020366536763589224
reward_max-0.7842021786547266
reward_mean-19.51937922785121
reward_median-14.911100610010866
reward_min-37.48049445395117
survival_time_max16.666666666666654
survival_time_mean4.819999999999997
survival_time_min0.8999999999999999
traveled_tiles_max12
traveled_tiles_mean3.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.699999999999985
valid_direction_mean0.9933333333333304
valid_direction_median0.033333333333333326
valid_direction_min0
No reset possible
93991200Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
93951197Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.6000000000000005


other stats
episodes
details{"ep000": {"nsteps": 224, "reward": -4.623365467477145, "good_angle": 0.7319553509950669, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 1.2999999999999965}, "ep001": {"nsteps": 22, "reward": -46.07200496440584, "good_angle": 0.32625887867237263, "survival_time": 0.7333333333333333, "traveled_tiles": 1, "valid_direction": 0.49999999999999994}, "ep002": {"nsteps": 52, "reward": -19.717869508724945, "good_angle": 0.32697238196849376, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.7333333333333348}, "ep003": {"nsteps": 131, "reward": -8.08410547377954, "good_angle": 0.2988844426919217, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 0.5666666666666653}, "ep004": {"nsteps": 78, "reward": -13.277005767593018, "good_angle": 0.3977287577520742, "survival_time": 2.6000000000000005, "traveled_tiles": 1, "valid_direction": 0.6333333333333311}}
good_angle_max0.7319553509950669
good_angle_mean0.41635996241598583
good_angle_median0.32697238196849376
good_angle_min0.2988844426919217
reward_max-4.623365467477145
reward_mean-18.354870236396096
reward_median-13.277005767593018
reward_min-46.07200496440584
survival_time_max7.46666666666665
survival_time_mean3.3799999999999963
survival_time_min0.7333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.2999999999999965
valid_direction_mean0.7466666666666655
valid_direction_median0.6333333333333311
valid_direction_min0.49999999999999994
No reset possible
93901198Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortednorudolf-30:00:13
Error while running [...]

Creating job9390-4280_solution_1  ... error
stderr | ERROR: for job9390-4280_solution_1  Cannot start service solution: network job9390-4280_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9390-4280_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9390-4280_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93871195Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videosabortedyesrudolf-30:00:11
Error while running [...]

Creating job9387-8109_videos_1 ... error
stderr | ERROR: for job9387-8109_videos_1  Cannot start service videos: network job9387-8109_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9387-8109_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93851195Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9666666666666666


other stats
episodes
details{"ep000": {"nsteps": 74, "reward": -13.699949176028698, "good_angle": 0.14748177795058082, "survival_time": 2.4666666666666677, "traveled_tiles": 2, "valid_direction": 0.2666666666666665}, "ep001": {"nsteps": 21, "reward": -48.14663103080931, "good_angle": 0.009589617394702028, "survival_time": 0.7, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 29, "reward": -34.924622266457, "good_angle": 0.01849159249973419, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 38, "reward": -26.776573413688887, "good_angle": 0.12651254517403965, "survival_time": 1.2666666666666673, "traveled_tiles": 2, "valid_direction": 0.2333333333333341}, "ep004": {"nsteps": 25, "reward": -40.54986368060112, "good_angle": 0.1246671935580132, "survival_time": 0.8333333333333333, "traveled_tiles": 1, "valid_direction": 0.19999999999999996}}
good_angle_max0.14748177795058082
good_angle_mean0.08534854531541397
good_angle_median0.1246671935580132
good_angle_min0.009589617394702028
reward_max-13.699949176028698
reward_mean-32.81952791351701
reward_median-34.924622266457
reward_min-48.14663103080931
survival_time_max2.4666666666666677
survival_time_mean1.246666666666667
survival_time_min0.7
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.2666666666666665
valid_direction_mean0.1400000000000001
valid_direction_median0.19999999999999996
valid_direction_min0
No reset possible
93741193Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
93671193Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
93541191Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:08:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
93491190Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6048743495787494, "good_angle": 0.8846231554803591, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.1333333333333258}, "ep001": {"nsteps": 500, "reward": -0.6484833833500743, "good_angle": 32.0327640143225, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.833333333333334}, "ep002": {"nsteps": 500, "reward": -0.7368488358687609, "good_angle": 0.7951790339256591, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.166666666666659}, "ep003": {"nsteps": 500, "reward": -0.28837004880889433, "good_angle": 0.7430058403559094, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.699999999999994}, "ep004": {"nsteps": 500, "reward": -0.5163634683582932, "good_angle": 23.348413220397077, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.9000000000000163}}
good_angle_max32.0327640143225
good_angle_mean11.560797052896302
good_angle_median0.8846231554803591
good_angle_min0.7430058403559094
reward_max-0.28837004880889433
reward_mean-0.5589880171929544
reward_median-0.6048743495787494
reward_min-0.7368488358687609
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max13
traveled_tiles_mean12.6
traveled_tiles_median13
traveled_tiles_min12
valid_direction_max4.833333333333334
valid_direction_mean2.7466666666666657
valid_direction_median2.166666666666659
valid_direction_min1.699999999999994
No reset possible
93451188Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5517521831141785, "good_angle": 1.3940392531640815, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.466666666666659}, "ep001": {"nsteps": 500, "reward": -0.5873626086246222, "good_angle": 29.202632642123568, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.6333333333333515}, "ep002": {"nsteps": 500, "reward": -0.587249002658762, "good_angle": 1.2376569694641268, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.966666666666661}, "ep003": {"nsteps": 500, "reward": -0.790708413018845, "good_angle": 1.1750069721250749, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.6999999999999913}, "ep004": {"nsteps": 500, "reward": -0.5354723304156214, "good_angle": 23.129591305939392, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.7999999999999896}}
good_angle_max29.202632642123568
good_angle_mean11.227785428563248
good_angle_median1.3940392531640815
good_angle_min1.1750069721250749
reward_max-0.5354723304156214
reward_mean-0.6105089075664059
reward_median-0.587249002658762
reward_min-0.790708413018845
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max4.6333333333333515
valid_direction_mean3.3133333333333304
valid_direction_median2.966666666666661
valid_direction_min2.466666666666659
No reset possible
93331186Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93261183Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
93141184Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
93121184Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
93071180Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.624752186943482
deviation-center-line_median1.1295785831204983
in-drivable-lane_median2.933333333333323


other stats
deviation-center-line_max1.379343147692024
deviation-center-line_mean0.9007972237204894
deviation-center-line_min0.24741031396476473
deviation-heading_max3.1245182549161745
deviation-heading_mean2.07937344325996
deviation-heading_median2.44663621824183
deviation-heading_min0.5745931443622132
driven_any_max6.299996698962813
driven_any_mean4.328887643847964
driven_any_median6.215093919458589
driven_any_min1.201349522780205
driven_lanedir_max5.060471613390751
driven_lanedir_mean3.397957481084819
driven_lanedir_min0.9599442971508084
in-drivable-lane_max3.8666666666666543
in-drivable-lane_mean2.1999999999999926
in-drivable-lane_min0.3999999999999986
per-episodes
details{"ep000": {"driven_any": 6.215093919458589, "driven_lanedir": 4.624752186943482, "in-drivable-lane": 3.8666666666666543, "deviation-heading": 3.020428063423033, "deviation-center-line": 1.1295785831204983}, "ep001": {"driven_any": 1.201349522780205, "driven_lanedir": 0.9599442971508084, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 1.2306915353565488, "deviation-center-line": 0.24741031396476473}, "ep002": {"driven_any": 6.257336093288788, "driven_lanedir": 4.984035375238558, "in-drivable-lane": 2.933333333333323, "deviation-heading": 3.1245182549161745, "deviation-center-line": 1.379343147692024}, "ep003": {"driven_any": 6.299996698962813, "driven_lanedir": 5.060471613390751, "in-drivable-lane": 2.9999999999999893, "deviation-heading": 2.44663621824183, "deviation-center-line": 1.240540064820694}, "ep004": {"driven_any": 1.6706619847494255, "driven_lanedir": 1.3605839327004934, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.5745931443622132, "deviation-center-line": 0.5071140090044659}}
No reset possible
93001181Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22063538543918604
deviation-center-line_median0.20277270846504977
in-drivable-lane_median0


other stats
deviation-center-line_max0.6171226518096151
deviation-center-line_mean0.3109875124293243
deviation-center-line_min0.12423901964197331
deviation-heading_max1.8592949678117303
deviation-heading_mean0.7784862086779775
deviation-heading_median0.5996804875354138
deviation-heading_min0.2115007870530752
driven_any_max0.767871114225483
driven_any_mean0.4100120502507269
driven_any_median0.2392931239817974
driven_any_min0.1857224150004921
driven_lanedir_max0.6622456703814719
driven_lanedir_mean0.3509606805825811
driven_lanedir_min0.16715472113848007
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.767871114225483, "driven_lanedir": 0.52061066676762, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.8592949678117303, "deviation-center-line": 0.4211514251220343}, "ep001": {"driven_any": 0.1857224150004921, "driven_lanedir": 0.1841569591861476, "in-drivable-lane": 0, "deviation-heading": 0.2115007870530752, "deviation-center-line": 0.18965175710794907}, "ep002": {"driven_any": 0.6643298980785627, "driven_lanedir": 0.6622456703814719, "in-drivable-lane": 0, "deviation-heading": 0.43599702157458536, "deviation-center-line": 0.6171226518096151}, "ep003": {"driven_any": 0.1928436999672996, "driven_lanedir": 0.16715472113848007, "in-drivable-lane": 0, "deviation-heading": 0.7859577794150824, "deviation-center-line": 0.12423901964197331}, "ep004": {"driven_any": 0.2392931239817974, "driven_lanedir": 0.22063538543918604, "in-drivable-lane": 0, "deviation-heading": 0.5996804875354138, "deviation-center-line": 0.20277270846504977}}
No reset possible
92931181Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
92891181Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 217, "reward": -4.842466158233905, "good_angle": 0.948393067959257, "survival_time": 7.233333333333317, "traveled_tiles": 2, "valid_direction": 1.999999999999993}, "ep001": {"nsteps": 54, "reward": -19.071285682143987, "good_angle": 0.02955953031078824, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 188, "reward": -5.826680191178271, "good_angle": 0.04020312858748907, "survival_time": 6.266666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 56, "reward": -18.223405375810607, "good_angle": 0.5759211627899659, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0.9333333333333358}, "ep004": {"nsteps": 69, "reward": -14.968534817298254, "good_angle": 0.4190348981693709, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.5666666666666662}}
good_angle_max0.948393067959257
good_angle_mean0.4026223575633742
good_angle_median0.4190348981693709
good_angle_min0.02955953031078824
reward_max-4.842466158233905
reward_mean-12.586474444933003
reward_median-14.968534817298254
reward_min-19.071285682143987
survival_time_max7.233333333333317
survival_time_mean3.8933333333333286
survival_time_min1.8000000000000025
traveled_tiles_max3
traveled_tiles_mean1.6
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.999999999999993
valid_direction_mean0.699999999999999
valid_direction_median0.5666666666666662
valid_direction_min0
No reset possible
92841179Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
92771178Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.28060777012340976
deviation-center-line_median0.22721196650330475
in-drivable-lane_median0


other stats
deviation-center-line_max0.397387598231267
deviation-center-line_mean0.25293935350159086
deviation-center-line_min0.13210976538295569
deviation-heading_max1.7444564974638874
deviation-heading_mean0.7954867340184384
deviation-heading_median0.6045070411462525
deviation-heading_min0.2618915420632834
driven_any_max0.5678510646493321
driven_any_mean0.3450032324283415
driven_any_median0.2821608403404374
driven_any_min0.19998585583219508
driven_lanedir_max0.42669405448571496
driven_lanedir_mean0.2838617218300153
driven_lanedir_min0.1775901034723475
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5678510646493321, "driven_lanedir": 0.3130090110394963, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7444564974638874, "deviation-center-line": 0.22721196650330475}, "ep001": {"driven_any": 0.2821608403404374, "driven_lanedir": 0.28060777012340976, "in-drivable-lane": 0, "deviation-heading": 0.2618915420632834, "deviation-center-line": 0.30221720153425513}, "ep002": {"driven_any": 0.43572704749065816, "driven_lanedir": 0.42669405448571496, "in-drivable-lane": 0, "deviation-heading": 0.5989330467566464, "deviation-center-line": 0.397387598231267}, "ep003": {"driven_any": 0.19998585583219508, "driven_lanedir": 0.1775901034723475, "in-drivable-lane": 0, "deviation-heading": 0.7676455426621223, "deviation-center-line": 0.13210976538295569}, "ep004": {"driven_any": 0.2392913538290846, "driven_lanedir": 0.22140767002910788, "in-drivable-lane": 0, "deviation-heading": 0.6045070411462525, "deviation-center-line": 0.20577023585617177}}
No reset possible
92741178Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
92641178Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
92481176Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2897700948456188
deviation-center-line_median0.21325377575604887
in-drivable-lane_median0


other stats
deviation-center-line_max0.3839568997326553
deviation-center-line_mean0.26090764562259866
deviation-center-line_min0.125734762295888
deviation-heading_max1.8553375980302735
deviation-heading_mean0.8580896591975599
deviation-heading_median0.5903936570676821
deviation-heading_min0.4743116047801178
driven_any_max0.5607378452704351
driven_any_mean0.35572159647264345
driven_any_median0.3535794096134567
driven_any_min0.19642466917282783
driven_lanedir_max0.40935666493497447
driven_lanedir_mean0.28993617177336456
driven_lanedir_min0.16896276576503633
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5607378452704351, "driven_lanedir": 0.2897700948456188, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8553375980302735, "deviation-center-line": 0.20787567150415448}, "ep001": {"driven_any": 0.3535794096134567, "driven_lanedir": 0.3464077223005848, "in-drivable-lane": 0, "deviation-heading": 0.4743116047801178, "deviation-center-line": 0.37371711882424674}, "ep002": {"driven_any": 0.41787113051790353, "driven_lanedir": 0.40935666493497447, "in-drivable-lane": 0, "deviation-heading": 0.5903936570676821, "deviation-center-line": 0.3839568997326553}, "ep003": {"driven_any": 0.19642466917282783, "driven_lanedir": 0.16896276576503633, "in-drivable-lane": 0, "deviation-heading": 0.7825890900920623, "deviation-center-line": 0.125734762295888}, "ep004": {"driven_any": 0.24999492778859425, "driven_lanedir": 0.23518361102060847, "in-drivable-lane": 0, "deviation-heading": 0.5878163460176635, "deviation-center-line": 0.21325377575604887}}
No reset possible
92461176Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
92361175Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3198292882388407
deviation-center-line_median0.3442140004326623
in-drivable-lane_median0


other stats
deviation-center-line_max0.5084977754733367
deviation-center-line_mean0.32637755156458204
deviation-center-line_min0.20114700328454913
deviation-heading_max1.8488730206868011
deviation-heading_mean0.7564527184775777
deviation-heading_median0.5850884342234284
deviation-heading_min0.27352241127514826
driven_any_max0.5964671643893983
driven_any_mean0.42287287430129605
driven_any_median0.41073337460861187
driven_any_min0.2464243866716373
driven_lanedir_max0.5919301267665276
driven_lanedir_mean0.3641701319700679
driven_lanedir_min0.2315471302427792
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5392933092678736, "driven_lanedir": 0.2715638656812289, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8488730206868011, "deviation-center-line": 0.2179565389959786}, "ep001": {"driven_any": 0.32144613656895954, "driven_lanedir": 0.3198292882388407, "in-drivable-lane": 0, "deviation-heading": 0.27352241127514826, "deviation-center-line": 0.3442140004326623}, "ep002": {"driven_any": 0.41073337460861187, "driven_lanedir": 0.4059802489209632, "in-drivable-lane": 0, "deviation-heading": 0.470396127433358, "deviation-center-line": 0.36007243963638347}, "ep003": {"driven_any": 0.5964671643893983, "driven_lanedir": 0.5919301267665276, "in-drivable-lane": 0, "deviation-heading": 0.6043835987691525, "deviation-center-line": 0.5084977754733367}, "ep004": {"driven_any": 0.2464243866716373, "driven_lanedir": 0.2315471302427792, "in-drivable-lane": 0, "deviation-heading": 0.5850884342234284, "deviation-center-line": 0.20114700328454913}}
No reset possible
92291175Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
92231175Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.899999999999996


other stats
episodes
details{"ep000": {"nsteps": 153, "reward": -6.688718417593205, "good_angle": 1.3498627460913, "survival_time": 5.099999999999992, "traveled_tiles": 2, "valid_direction": 2.2333333333333254}, "ep001": {"nsteps": 92, "reward": -11.46228821089734, "good_angle": 0.030996602946483435, "survival_time": 3.0666666666666655, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 117, "reward": -9.020670182939268, "good_angle": 0.09301724975869884, "survival_time": 3.899999999999996, "traveled_tiles": 2, "valid_direction": 0.2666666666666657}, "ep003": {"nsteps": 169, "reward": -6.3763778808818765, "good_angle": 0.08570572926321202, "survival_time": 5.633333333333323, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 71, "reward": -14.53416777622532, "good_angle": 0.3426253908019395, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0.6666666666666663}}
good_angle_max1.3498627460913
good_angle_mean0.3804415437723267
good_angle_median0.09301724975869884
good_angle_min0.030996602946483435
reward_max-6.3763778808818765
reward_mean-9.616444493707402
reward_median-9.020670182939268
reward_min-14.53416777622532
survival_time_max5.633333333333323
survival_time_mean4.013333333333328
survival_time_min2.366666666666668
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.2333333333333254
valid_direction_mean0.6333333333333314
valid_direction_median0.2666666666666657
valid_direction_min0
No reset possible
92141175Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
92121172Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.23518523523100351
deviation-center-line_median0.21216378921428705
in-drivable-lane_median0


other stats
deviation-center-line_max0.3355513137099054
deviation-center-line_mean0.22765767116038305
deviation-center-line_min0.1215713398497193
deviation-heading_max1.7594597265455532
deviation-heading_mean0.8166892841993147
deviation-heading_median0.6462512609025532
deviation-heading_min0.3832108256495193
driven_any_max0.7821842590175593
driven_any_mean0.3428633014225608
driven_any_median0.2499988819611216
driven_any_min0.16427952934043574
driven_lanedir_max0.5396933937917132
driven_lanedir_mean0.2820533154018512
driven_lanedir_min0.141324480946456
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7821842590175593, "driven_lanedir": 0.5396933937917132, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7594597265455532, "deviation-center-line": 0.3355513137099054}, "ep001": {"driven_any": 0.3071508548942682, "driven_lanedir": 0.30234883341373475, "in-drivable-lane": 0, "deviation-heading": 0.3832108256495193, "deviation-center-line": 0.333886799546642}, "ep002": {"driven_any": 0.16427952934043574, "driven_lanedir": 0.141324480946456, "in-drivable-lane": 0, "deviation-heading": 0.6462512609025532, "deviation-center-line": 0.1215713398497193}, "ep003": {"driven_any": 0.21070298189941905, "driven_lanedir": 0.19171463362634844, "in-drivable-lane": 0, "deviation-heading": 0.7252818819018773, "deviation-center-line": 0.1351151134813613}, "ep004": {"driven_any": 0.2499988819611216, "driven_lanedir": 0.23518523523100351, "in-drivable-lane": 0, "deviation-heading": 0.5692427259970712, "deviation-center-line": 0.21216378921428705}}
No reset possible
92101172Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
92061174Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationtimeoutnorudolf-30:31:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
92001172Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 221, "reward": -4.680065435220433, "good_angle": 0.8143340540122375, "survival_time": 7.36666666666665, "traveled_tiles": 2, "valid_direction": 1.03333333333333}, "ep001": {"nsteps": 88, "reward": -11.970444464548068, "good_angle": 0.09934511537248952, "survival_time": 2.9333333333333327, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 48, "reward": -21.25994161920001, "good_angle": 0.5257756234168345, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.7000000000000017}, "ep003": {"nsteps": 61, "reward": -16.74233506925282, "good_angle": 0.4446579903733168, "survival_time": 2.033333333333336, "traveled_tiles": 1, "valid_direction": 0.8333333333333355}, "ep004": {"nsteps": 72, "reward": -14.358987438182035, "good_angle": 0.3486535214226296, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.599999999999999}}
good_angle_max0.8143340540122375
good_angle_mean0.4465532609195016
good_angle_median0.4446579903733168
good_angle_min0.09934511537248952
reward_max-4.680065435220433
reward_mean-13.802354805280675
reward_median-14.358987438182035
reward_min-21.25994161920001
survival_time_max7.36666666666665
survival_time_mean3.2666666666666644
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.03333333333333
valid_direction_mean0.693333333333333
valid_direction_median0.7000000000000017
valid_direction_min0.29999999999999893
No reset possible
91931172Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
91831171Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91801170Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91681166Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2839500280452585
deviation-center-line_median0.31253695822118716
in-drivable-lane_median0


other stats
deviation-center-line_max2.361289403227586
deviation-center-line_mean0.8120463882089988
deviation-center-line_min0.13515895373088802
deviation-heading_max3.909943694257534
deviation-heading_mean1.3254462682344457
deviation-heading_median0.7370986606285111
deviation-heading_min0.4026070830522108
driven_any_max1.7733015054305572
driven_any_mean0.740186356115103
driven_any_median0.2908682040158564
driven_any_min0.15753369098487494
driven_lanedir_max1.2664641516058868
driven_lanedir_mean0.5945394695412944
driven_lanedir_min0.1316487936379016
in-drivable-lane_max4.766666666666695
in-drivable-lane_mean0.9733333333333388
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.7733015054305572, "driven_lanedir": 1.2664641516058868, "in-drivable-lane": 4.766666666666695, "deviation-heading": 0.7370986606285111, "deviation-center-line": 2.361289403227586}, "ep001": {"driven_any": 0.2908682040158564, "driven_lanedir": 0.2839500280452585, "in-drivable-lane": 0, "deviation-heading": 0.4026070830522108, "deviation-center-line": 0.31253695822118716}, "ep002": {"driven_any": 0.15753369098487494, "driven_lanedir": 0.1316487936379016, "in-drivable-lane": 0, "deviation-heading": 0.7026479218509681, "deviation-center-line": 0.13993818579419373}, "ep003": {"driven_any": 0.20419214459788884, "driven_lanedir": 0.17273222849250347, "in-drivable-lane": 0, "deviation-heading": 0.8749339813830042, "deviation-center-line": 0.13515895373088802}, "ep004": {"driven_any": 1.2750362355463378, "driven_lanedir": 1.117902145924922, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 3.909943694257534, "deviation-center-line": 1.1113084400711386}}
No reset possible
91581166Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:05:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
91551164Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyesrudolf-30:00:11
Error while running [...]

Creating job9155-599_visualization_1 ... error
stderr | ERROR: for job9155-599_visualization_1  Cannot start service visualization: network job9155-599_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9155-599_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91481165Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
91361164Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
91311163Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
91241161Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.207501904724555
deviation-center-line_median0.199117543008356
in-drivable-lane_median0


other stats
deviation-center-line_max0.36013014379892433
deviation-center-line_mean0.21890563089739185
deviation-center-line_min0.06610701022197295
deviation-heading_max1.8220352535204696
deviation-heading_mean0.8418700647081033
deviation-heading_median0.6176041495564573
deviation-heading_min0.3793079412520295
driven_any_max0.7750332700063921
driven_any_mean0.3300067493966062
driven_any_median0.22142968999939713
driven_any_min0.06070246001438254
driven_lanedir_max0.5276151666340869
driven_lanedir_mean0.26774277386120654
driven_lanedir_min0.04620417581966674
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7750332700063921, "driven_lanedir": 0.5276151666340869, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8220352535204696, "deviation-center-line": 0.36013014379892433}, "ep001": {"driven_any": 0.06070246001438254, "driven_lanedir": 0.04620417581966674, "in-drivable-lane": 0, "deviation-heading": 0.3793079412520295, "deviation-center-line": 0.06610701022197295}, "ep002": {"driven_any": 0.14641926940265107, "driven_lanedir": 0.12549941503869144, "in-drivable-lane": 0, "deviation-heading": 0.6176041495564573, "deviation-center-line": 0.12449797931105276}, "ep003": {"driven_any": 0.446449057560208, "driven_lanedir": 0.4318932070890326, "in-drivable-lane": 0, "deviation-heading": 0.7968429744010335, "deviation-center-line": 0.34467547814665306}, "ep004": {"driven_any": 0.22142968999939713, "driven_lanedir": 0.207501904724555, "in-drivable-lane": 0, "deviation-heading": 0.5935600048105273, "deviation-center-line": 0.199117543008356}}
No reset possible
91181161Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
91091159Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.166666666666645


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.96006719721481, "good_angle": 0.4877534602247815, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 42, "reward": -24.4307058042004, "good_angle": 0.6437134891262761, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.06666666666666687}, "ep002": {"nsteps": 275, "reward": -4.021793213662141, "good_angle": 0.6766787948399278, "survival_time": 9.166666666666645, "traveled_tiles": 7, "valid_direction": 1.399999999999995}, "ep003": {"nsteps": 500, "reward": -0.4260526801729575, "good_angle": 0.6735225747691462, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 1.499999999999995}, "ep004": {"nsteps": 500, "reward": -0.4716504624746739, "good_angle": 23.644144496759186, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 3.1333333333333453}}
good_angle_max23.644144496759186
good_angle_mean5.225162563143863
good_angle_median0.6735225747691462
good_angle_min0.4877534602247815
reward_max-0.4260526801729575
reward_mean-13.062053871544997
reward_median-4.021793213662141
reward_min-35.96006719721481
survival_time_max16.666666666666654
survival_time_mean8.966666666666658
survival_time_min0.9333333333333332
traveled_tiles_max13
traveled_tiles_mean6.8
traveled_tiles_median7
traveled_tiles_min1
valid_direction_max3.1333333333333453
valid_direction_mean1.3800000000000003
valid_direction_median1.399999999999995
valid_direction_min0.06666666666666687
No reset possible
91001158David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1101918964409605
deviation-center-line_median0.4264052630691605
in-drivable-lane_median10.333333333333334


other stats
deviation-center-line_max0.8858535845217879
deviation-center-line_mean0.5311440203468543
deviation-center-line_min0.234202886401531
deviation-heading_max1.4096575925372257
deviation-heading_mean0.8364169828850242
deviation-heading_median0.6608668232516459
deviation-heading_min0.340749904207677
driven_any_max4.640049332926225
driven_any_mean3.9162458484764726
driven_any_median4.637588355885155
driven_any_min2.4031890794300694
driven_lanedir_max1.7007899331865348
driven_lanedir_mean1.0827797427751649
driven_lanedir_min0.5633401627106651
in-drivable-lane_max13.93333333333332
in-drivable-lane_mean10.046666666666656
in-drivable-lane_min6.499999999999978
per-episodes
details{"ep000": {"driven_any": 3.261059175339024, "driven_lanedir": 1.1101918964409605, "in-drivable-lane": 7.699999999999976, "deviation-heading": 0.340749904207677, "deviation-center-line": 0.7351663906709174}, "ep001": {"driven_any": 4.637588355885155, "driven_lanedir": 1.3080523770740686, "in-drivable-lane": 11.766666666666662, "deviation-heading": 1.1881383356422144, "deviation-center-line": 0.4264052630691605}, "ep002": {"driven_any": 2.4031890794300694, "driven_lanedir": 0.5633401627106651, "in-drivable-lane": 6.499999999999978, "deviation-heading": 0.6608668232516459, "deviation-center-line": 0.234202886401531}, "ep003": {"driven_any": 4.639343298801891, "driven_lanedir": 0.7315243444635957, "in-drivable-lane": 13.93333333333332, "deviation-heading": 0.582672258786358, "deviation-center-line": 0.37409197707087416}, "ep004": {"driven_any": 4.640049332926225, "driven_lanedir": 1.7007899331865348, "in-drivable-lane": 10.333333333333334, "deviation-heading": 1.4096575925372257, "deviation-center-line": 0.8858535845217879}}
No reset possible
90941158David AbrahamPytorch ILaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:12
Error while running [...]

Creating job9094-5029_scorer_1 ... error
stderr | ERROR: for job9094-5029_scorer_1  Cannot start service scorer: network job9094-5029_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9094-5029_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90891156Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22682055208981788
deviation-center-line_median0.20685353724444192
in-drivable-lane_median0


other stats
deviation-center-line_max0.3438949881944418
deviation-center-line_mean0.2294897469542859
deviation-center-line_min0.1323368790450466
deviation-heading_max1.7864186449786736
deviation-heading_mean0.8023591431457182
deviation-heading_median0.6083608666568896
deviation-heading_min0.29682051317084346
driven_any_max0.7821807938875655
driven_any_mean0.34286537120578225
driven_any_median0.24285852419726375
driven_any_min0.16070829106403728
driven_lanedir_max0.5370958971833832
driven_lanedir_mean0.28205755526882526
driven_lanedir_min0.1407045553147912
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7821807938875655, "driven_lanedir": 0.5370958971833832, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7864186449786736, "deviation-center-line": 0.33088608079042314}, "ep001": {"driven_any": 0.3250206310927961, "driven_lanedir": 0.32325673184379067, "in-drivable-lane": 0, "deviation-heading": 0.29682051317084346, "deviation-center-line": 0.3438949881944418}, "ep002": {"driven_any": 0.16070829106403728, "driven_lanedir": 0.1407045553147912, "in-drivable-lane": 0, "deviation-heading": 0.6083608666568896, "deviation-center-line": 0.1334772494970759}, "ep003": {"driven_any": 0.2035586157872487, "driven_lanedir": 0.18241003991234317, "in-drivable-lane": 0, "deviation-heading": 0.7476984117581289, "deviation-center-line": 0.1323368790450466}, "ep004": {"driven_any": 0.24285852419726375, "driven_lanedir": 0.22682055208981788, "in-drivable-lane": 0, "deviation-heading": 0.5724972791640558, "deviation-center-line": 0.20685353724444192}}
No reset possible
90731155Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
90661155Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
90581153David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationfailednorudolf-30:03:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 51, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
90521152Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.200000000000002


other stats
episodes
details{"ep000": {"nsteps": 165, "reward": -6.174903824806891, "good_angle": 1.283565821367642, "survival_time": 5.49999999999999, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 97, "reward": -10.920560585469314, "good_angle": 0.18588145102361045, "survival_time": 3.2333333333333316, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 46, "reward": -22.23213052360908, "good_angle": 0.3563900941668696, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.8333333333333347}, "ep003": {"nsteps": 54, "reward": -18.898264500278017, "good_angle": 0.6519035773051937, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0.7000000000000022}, "ep004": {"nsteps": 66, "reward": -15.628937987215592, "good_angle": 0.3027082238358728, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6333333333333337}}
good_angle_max1.283565821367642
good_angle_mean0.5560898335398378
good_angle_median0.3563900941668696
good_angle_min0.18588145102361045
reward_max-6.174903824806891
reward_mean-14.770959484275778
reward_median-15.628937987215592
reward_min-22.23213052360908
survival_time_max5.49999999999999
survival_time_mean2.8533333333333326
survival_time_min1.5333333333333348
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.7866666666666662
valid_direction_median0.7000000000000022
valid_direction_min0.29999999999999893
No reset possible
90461152Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
90361150Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 227, "reward": -4.559264687831013, "good_angle": 0.7455325117690063, "survival_time": 7.5666666666666496, "traveled_tiles": 2, "valid_direction": 1.13333333333333}, "ep001": {"nsteps": 19, "reward": -53.279084448751654, "good_angle": 0.3852564338693012, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 52, "reward": -19.671666050759647, "good_angle": 0.4949760268610196, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.533333333333335}, "ep003": {"nsteps": 139, "reward": -7.625754865703823, "good_angle": 0.2713265810696286, "survival_time": 4.633333333333327, "traveled_tiles": 2, "valid_direction": 0.29999999999999893}, "ep004": {"nsteps": 72, "reward": -14.392410603662332, "good_angle": 0.3309075633658851, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.7}}
good_angle_max0.7455325117690063
good_angle_mean0.4455998233869682
good_angle_median0.3852564338693012
good_angle_min0.2713265810696286
reward_max-4.559264687831013
reward_mean-19.90563613134169
reward_median-14.392410603662332
reward_min-53.279084448751654
survival_time_max7.5666666666666496
survival_time_mean3.3933333333333295
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.13333333333333
valid_direction_mean0.626666666666666
valid_direction_median0.533333333333335
valid_direction_min0.29999999999999893
No reset possible
90301148Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-1.459027695860371e-05
deviation-center-line_median0.49091729138564655
in-drivable-lane_median8.366666666666664


other stats
deviation-center-line_max0.737979263618922
deviation-center-line_mean0.4018884109286329
deviation-center-line_min0
deviation-heading_max6.544125539331323
deviation-heading_mean5.206786466293215
deviation-heading_median6.505520855142042
deviation-heading_min0
driven_any_max1.7339648630396301e-13
driven_any_mean1.027506277237568e-13
driven_any_median1.0409553657687865e-13
driven_any_min5.5524604662784894e-14
driven_lanedir_max5.070866762935111e-06
driven_lanedir_mean-1.3121856045561486e-05
driven_lanedir_min-4.052127534492911e-05
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean10.019999999999992
in-drivable-lane_min8.333333333333329
per-episodes
details{"ep000": {"driven_any": 5.5524604662784894e-14, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.7339648630396301e-13, "driven_lanedir": -4.052127534492911e-05, "in-drivable-lane": 8.366666666666664, "deviation-heading": 6.5256554741854425, "deviation-center-line": 0.737979263618922}, "ep002": {"driven_any": 7.440333645941004e-14, "driven_lanedir": -1.5568594687209725e-05, "in-drivable-lane": 8.366666666666664, "deviation-heading": 6.505520855142042, "deviation-center-line": 0.49091729138564655}, "ep003": {"driven_any": 1.0633317461574733e-13, "driven_lanedir": 5.070866762935111e-06, "in-drivable-lane": 8.399999999999995, "deviation-heading": 6.458630462807267, "deviation-center-line": 0.22765024759692803}, "ep004": {"driven_any": 1.0409553657687865e-13, "driven_lanedir": -1.459027695860371e-05, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.544125539331323, "deviation-center-line": 0.5528952520416683}}
No reset possible
90241149Martin Weiss 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
90181149Martin Weiss 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
90161147Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 188, "reward": -5.582159952426507, "good_angle": 2.8921088224751617, "survival_time": 6.266666666666654, "traveled_tiles": 1, "valid_direction": 5.166666666666654}, "ep001": {"nsteps": 184, "reward": -6.006585545190003, "good_angle": 0.027950161519413434, "survival_time": 6.133333333333321, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.28698273333907126, "good_angle": 0.5037599778514814, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 1.7000000000000297}, "ep003": {"nsteps": 500, "reward": -0.09759001524746418, "good_angle": 0.00037922062684382017, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.026040908180526456, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max2.8921088224751617
good_angle_mean0.7000309788252965
good_angle_median0.07595671165358207
good_angle_min0.00037922062684382017
reward_max0.026040908180526456
reward_mean-2.389455467604504
reward_median-0.28698273333907126
reward_min-6.006585545190003
survival_time_max16.666666666666654
survival_time_mean12.479999999999986
survival_time_min6.133333333333321
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.166666666666654
valid_direction_mean1.3733333333333366
valid_direction_median0
valid_direction_min0
No reset possible
89961145Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.5635627043832265
deviation-center-line_median1.0953437526295815
in-drivable-lane_median3.7666666666666537


other stats
deviation-center-line_max2.39963534383886
deviation-center-line_mean0.9933240906800872
deviation-center-line_min0.07053636961909314
deviation-heading_max3.117070883908659
deviation-heading_mean1.592456172798138
deviation-heading_median0.9192153372742848
deviation-heading_min0.6925938021446952
driven_any_max6.368688179603759
driven_any_mean4.075500763089576
driven_any_median6.292349042570948
driven_any_min0.34334452516443764
driven_lanedir_max4.9355432663570165
driven_lanedir_mean2.999886272563187
driven_lanedir_min0.1375875316981379
in-drivable-lane_max4.2666666666666515
in-drivable-lane_mean2.5799999999999907
in-drivable-lane_min0.2
per-episodes
details{"ep000": {"driven_any": 0.34334452516443764, "driven_lanedir": 0.1375875316981379, "in-drivable-lane": 0.2, "deviation-heading": 0.7157569988410777, "deviation-center-line": 0.07053636961909314}, "ep001": {"driven_any": 1.0747462472367428, "driven_lanedir": 0.7595452952562052, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 0.6925938021446952, "deviation-center-line": 0.2114484857359691}, "ep002": {"driven_any": 6.292349042570948, "driven_lanedir": 4.603192565121352, "in-drivable-lane": 3.966666666666653, "deviation-heading": 3.117070883908659, "deviation-center-line": 1.1896565015769316}, "ep003": {"driven_any": 6.298375820871993, "driven_lanedir": 4.5635627043832265, "in-drivable-lane": 4.2666666666666515, "deviation-heading": 2.517643841821974, "deviation-center-line": 1.0953437526295815}, "ep004": {"driven_any": 6.368688179603759, "driven_lanedir": 4.9355432663570165, "in-drivable-lane": 3.7666666666666537, "deviation-heading": 0.9192153372742848, "deviation-center-line": 2.39963534383886}}
No reset possible
89831141Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.522617242685771
deviation-center-line_median1.0722181438139846
in-drivable-lane_median3.6666666666666536


other stats
deviation-center-line_max2.427560823019536
deviation-center-line_mean0.989303812396787
deviation-center-line_min0.07084844041760953
deviation-heading_max2.9940108666606484
deviation-heading_mean1.6738970044968795
deviation-heading_median1.1978509745800303
deviation-heading_min0.7098822712947942
driven_any_max6.368037280314137
driven_any_mean4.093409343802219
driven_any_median6.270558193861044
driven_any_min0.3466666666666718
driven_lanedir_max4.968473186127305
driven_lanedir_mean3.024454216109337
driven_lanedir_min0.14089729353622693
in-drivable-lane_max4.2666666666666515
in-drivable-lane_mean2.5466666666666575
in-drivable-lane_min0.2
per-episodes
details{"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 1.1775735695514091, "driven_lanedir": 0.9286859742671404, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 1.1978509745800303, "deviation-center-line": 0.2442298264141319}, "ep002": {"driven_any": 6.270558193861044, "driven_lanedir": 4.522617242685771, "in-drivable-lane": 4.199999999999985, "deviation-heading": 2.9940108666606484, "deviation-center-line": 1.0722181438139846}, "ep003": {"driven_any": 6.304211008617831, "driven_lanedir": 4.561597383930241, "in-drivable-lane": 4.2666666666666515, "deviation-heading": 2.558912564235724, "deviation-center-line": 1.131661828318672}, "ep004": {"driven_any": 6.368037280314137, "driven_lanedir": 4.968473186127305, "in-drivable-lane": 3.6666666666666536, "deviation-heading": 0.9088283457132, "deviation-center-line": 2.427560823019536}}
No reset possible
89721141Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
89651141Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationfailednorudolf-30:05:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89611138Martin Weiss 🇨🇦PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1244940250770317
deviation-center-line_median0.1702985030340966
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.2291035934160819
deviation-center-line_mean0.15104091265992872
deviation-center-line_min0.07084844041760953
deviation-heading_max1.2760765640740437
deviation-heading_mean0.5466497354728592
deviation-heading_median0.35171107009370006
deviation-heading_min0.06092138286581164
driven_any_max2.1066666666666567
driven_any_mean1.1093333333333295
driven_any_median1.1599999999999824
driven_any_min0.3466666666666718
driven_lanedir_max2.066698089009994
driven_lanedir_mean0.9871748479623343
driven_lanedir_min0.14089729353622693
in-drivable-lane_max0.2666666666666657
in-drivable-lane_mean0.09999999999999978
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 1.1599999999999824, "driven_lanedir": 1.1244940250770317, "in-drivable-lane": 0, "deviation-heading": 0.35171107009370006, "deviation-center-line": 0.1702985030340966}, "ep003": {"driven_any": 2.1066666666666567, "driven_lanedir": 2.066698089009994, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.33465738903594666, "deviation-center-line": 0.2291035934160819}, "ep004": {"driven_any": 1.5866666666666656, "driven_lanedir": 1.2579129547459444, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.2760765640740437, "deviation-center-line": 0.1859811348549165}}
No reset possible
89491137Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationfailednorudolf-30:07:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89451130Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.902604775949742
deviation-center-line_median1.6603806871656346
in-drivable-lane_median6.39999999999999


other stats
deviation-center-line_max2.2903850356165467
deviation-center-line_mean1.7042929006175096
deviation-center-line_min1.2931044882771712
deviation-heading_max4.531045801882008
deviation-heading_mean3.890248649618073
deviation-heading_median3.765895792447494
deviation-heading_min3.426600861275784
driven_any_max10.64090117687493
driven_any_mean10.632344249387728
driven_any_median10.630163848526912
driven_any_min10.625750825570435
driven_lanedir_max9.187880243117494
driven_lanedir_mean6.472652910975929
driven_lanedir_min4.598271329403049
in-drivable-lane_max8.399999999999975
in-drivable-lane_mean5.526666666666652
in-drivable-lane_min1.4333333333333336
per-episodes
details{"ep000": {"driven_any": 10.64090117687493, "driven_lanedir": 9.187880243117494, "in-drivable-lane": 1.4333333333333336, "deviation-heading": 4.531045801882008, "deviation-center-line": 2.2903850356165467}, "ep001": {"driven_any": 10.625750825570435, "driven_lanedir": 5.35958684687758, "in-drivable-lane": 7.133333333333308, "deviation-heading": 3.696126264312728, "deviation-center-line": 1.2931044882771712}, "ep002": {"driven_any": 10.630163848526912, "driven_lanedir": 5.902604775949742, "in-drivable-lane": 6.39999999999999, "deviation-heading": 3.765895792447494, "deviation-center-line": 1.6603806871656346}, "ep003": {"driven_any": 10.636806058886538, "driven_lanedir": 7.314921359531789, "in-drivable-lane": 4.266666666666656, "deviation-heading": 4.031574528172349, "deviation-center-line": 1.9570576219399611}, "ep004": {"driven_any": 10.628099337079814, "driven_lanedir": 4.598271329403049, "in-drivable-lane": 8.399999999999975, "deviation-heading": 3.426600861275784, "deviation-center-line": 1.3205366700882342}}
No reset possible
89431135Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:13
Error while running [...]

Creating job8943-4529_scorer_1 ... error
stderr | ERROR: for job8943-4529_scorer_1  Cannot start service scorer: network job8943-4529_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8943-4529_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89371135Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
89351133Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.9666666666666623


other stats
episodes
details{"ep000": {"nsteps": 40, "reward": -25.253210436567315, "good_angle": 0.5980296935847024, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.066666666666667}, "ep001": {"nsteps": 37, "reward": -27.58707160240895, "good_angle": 0.0054983924300485675, "survival_time": 1.2333333333333338, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 119, "reward": -8.898221652172193, "good_angle": 0.4535483766196577, "survival_time": 3.9666666666666623, "traveled_tiles": 3, "valid_direction": 0.9999999999999964}, "ep003": {"nsteps": 213, "reward": -5.003741821527761, "good_angle": 0.48348808965549744, "survival_time": 7.0999999999999845, "traveled_tiles": 4, "valid_direction": 1.0333333333333297}, "ep004": {"nsteps": 161, "reward": -6.801499324441477, "good_angle": 9.442977120398757, "survival_time": 5.366666666666657, "traveled_tiles": 3, "valid_direction": 1.8333333333333268}}
good_angle_max9.442977120398757
good_angle_mean2.1967083345377323
good_angle_median0.48348808965549744
good_angle_min0.0054983924300485675
reward_max-5.003741821527761
reward_mean-14.70874896742354
reward_median-8.898221652172193
reward_min-27.58707160240895
survival_time_max7.0999999999999845
survival_time_mean3.7999999999999945
survival_time_min1.2333333333333338
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.8333333333333268
valid_direction_mean0.986666666666664
valid_direction_median1.0333333333333297
valid_direction_min0
No reset possible
89261133Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
89191122Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.678212511525196
deviation-center-line_median1.2997313490048656
in-drivable-lane_median6.033333333333313


other stats
deviation-center-line_max1.736512708556383
deviation-center-line_mean1.1764950766601203
deviation-center-line_min0.09897289157693905
deviation-heading_max1.9700452643517208
deviation-heading_mean1.3321225607422804
deviation-heading_median1.4969092646465725
deviation-heading_min0.06092138286581164
driven_any_max6.309491514219117
driven_any_mean5.048893796867289
driven_any_median6.243119859646946
driven_any_min0.34666666666667245
driven_lanedir_max4.226387937939422
driven_lanedir_mean3.013138328024679
driven_lanedir_min0.3458718774424743
in-drivable-lane_max8.600000000000005
in-drivable-lane_mean5.239999999999997
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.243119859646946, "driven_lanedir": 4.226387937939422, "in-drivable-lane": 5.066666666666651, "deviation-heading": 1.9700452643517208, "deviation-center-line": 1.736512708556383}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.301491506532981, "driven_lanedir": 3.9727114300752353, "in-drivable-lane": 6.033333333333313, "deviation-heading": 1.2017291443692388, "deviation-center-line": 1.6761658860727855}, "ep003": {"driven_any": 6.309491514219117, "driven_lanedir": 3.678212511525196, "in-drivable-lane": 6.500000000000013, "deviation-heading": 1.9310077474780585, "deviation-center-line": 1.07109254808963}, "ep004": {"driven_any": 6.043699437270728, "driven_lanedir": 2.8425078831410695, "in-drivable-lane": 8.600000000000005, "deviation-heading": 1.4969092646465725, "deviation-center-line": 1.2997313490048656}}
No reset possible
89141122Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyesrudolf-30:00:13
Error while running [...]

Creating job8914-5957_videos_1 ... error
stderr | ERROR: for job8914-5957_videos_1  Cannot start service videos: network job8914-5957_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8914-5957_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89061128Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1712941515220547
deviation-center-line_median0.27899688603984235
in-drivable-lane_median2.0666666666666664


other stats
deviation-center-line_max0.7689411168935266
deviation-center-line_mean0.4277846978542722
deviation-center-line_min0.1774300522257357
deviation-heading_max4.199505556750244
deviation-heading_mean2.2651397587817628
deviation-heading_median1.5093532121986049
deviation-heading_min1.0628363723804486
driven_any_max13.741216422834915
driven_any_mean6.238866454941861
driven_any_median3.52111640228564
driven_any_min2.384892536867285
driven_lanedir_max3.879106940033293
driven_lanedir_mean1.971570328292364
driven_lanedir_min0.854453165695908
in-drivable-lane_max7.53333333333331
in-drivable-lane_mean3.04666666666666
in-drivable-lane_min0.533333333333333
per-episodes
details{"ep000": {"driven_any": 3.491126840302257, "driven_lanedir": 0.854453165695908, "in-drivable-lane": 2.0666666666666664, "deviation-heading": 1.0628363723804486, "deviation-center-line": 0.1774300522257357}, "ep001": {"driven_any": 13.741216422834915, "driven_lanedir": 3.879106940033293, "in-drivable-lane": 7.53333333333331, "deviation-heading": 4.199505556750244, "deviation-center-line": 0.7689411168935266}, "ep002": {"driven_any": 2.384892536867285, "driven_lanedir": 1.1712941515220547, "in-drivable-lane": 0.533333333333333, "deviation-heading": 1.354939488134754, "deviation-center-line": 0.2729623793593397}, "ep003": {"driven_any": 8.05598007241921, "driven_lanedir": 2.871538129002206, "in-drivable-lane": 3.4999999999999902, "deviation-heading": 3.1990641644447626, "deviation-center-line": 0.6405930547529166}, "ep004": {"driven_any": 3.52111640228564, "driven_lanedir": 1.0814592552083582, "in-drivable-lane": 1.5999999999999988, "deviation-heading": 1.5093532121986049, "deviation-center-line": 0.27899688603984235}}
No reset possible
88991128Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.433333333333331


other stats
episodes
details{"ep000": {"nsteps": 103, "reward": -10.738487651906183, "good_angle": 6.623001189913441, "survival_time": 3.433333333333331, "traveled_tiles": 3, "valid_direction": 2.899999999999998}, "ep001": {"nsteps": 398, "reward": -3.573834209098602, "good_angle": 22.17096518362927, "survival_time": 13.26666666666663, "traveled_tiles": 5, "valid_direction": 10.399999999999972}, "ep002": {"nsteps": 70, "reward": -14.945861303220902, "good_angle": 2.0756036777075386, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.800000000000001}, "ep003": {"nsteps": 235, "reward": -5.1351538396351275, "good_angle": 6.174899015840222, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 5.999999999999986}, "ep004": {"nsteps": 103, "reward": -10.579931350063209, "good_angle": 3.1213364923864, "survival_time": 3.433333333333331, "traveled_tiles": 2, "valid_direction": 2.766666666666665}}
good_angle_max22.17096518362927
good_angle_mean8.033161111895375
good_angle_median6.174899015840222
good_angle_min2.0756036777075386
reward_max-3.573834209098602
reward_mean-8.994653670784803
reward_median-10.579931350063209
reward_min-14.945861303220902
survival_time_max13.26666666666663
survival_time_mean6.059999999999988
survival_time_min2.333333333333335
traveled_tiles_max5
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max10.399999999999972
valid_direction_mean4.7733333333333245
valid_direction_median2.899999999999998
valid_direction_min1.800000000000001
No reset possible
88901127Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3482643110874504
deviation-center-line_median0.11769469505431077
in-drivable-lane_median0.9999999999999992


other stats
deviation-center-line_max0.14324716545739985
deviation-center-line_mean0.1246804837925131
deviation-center-line_min0.11013026428779606
deviation-heading_max0.7916512827033291
deviation-heading_mean0.7334917727444747
deviation-heading_median0.7461705071785165
deviation-heading_min0.640055765062307
driven_any_max1.106982828376045
driven_any_mean0.7613879151977517
driven_any_median0.6659893310778022
driven_any_min0.6479896194270549
driven_lanedir_max0.5607387889676518
driven_lanedir_mean0.397940258142721
driven_lanedir_min0.3333690496174959
in-drivable-lane_max1.9666666666666628
in-drivable-lane_mean1.1866666666666652
in-drivable-lane_min0.9666666666666665
per-episodes
details{"ep000": {"driven_any": 1.106982828376045, "driven_lanedir": 0.5607387889676518, "in-drivable-lane": 1.9666666666666628, "deviation-heading": 0.7916512827033291, "deviation-center-line": 0.13970155341270693}, "ep001": {"driven_any": 0.728988321855431, "driven_lanedir": 0.4010751607941592, "in-drivable-lane": 0.9999999999999978, "deviation-heading": 0.7890184718931031, "deviation-center-line": 0.14324716545739985}, "ep002": {"driven_any": 0.6659893310778022, "driven_lanedir": 0.3482643110874504, "in-drivable-lane": 0.9999999999999992, "deviation-heading": 0.7005628368851173, "deviation-center-line": 0.112628740750352}, "ep003": {"driven_any": 0.6569894752524257, "driven_lanedir": 0.3462539802468476, "in-drivable-lane": 0.9999999999999996, "deviation-heading": 0.640055765062307, "deviation-center-line": 0.11013026428779606}, "ep004": {"driven_any": 0.6479896194270549, "driven_lanedir": 0.3333690496174959, "in-drivable-lane": 0.9666666666666665, "deviation-heading": 0.7461705071785165, "deviation-center-line": 0.11769469505431077}}
No reset possible
88881127Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.533333333333334


other stats
episodes
details{"ep000": {"nsteps": 128, "reward": -8.331383397015088, "good_angle": 1.8172293384627989, "survival_time": 4.266666666666661, "traveled_tiles": 2, "valid_direction": 2.16666666666666}, "ep001": {"nsteps": 83, "reward": -12.986788551917815, "good_angle": 2.191059095980004, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 2.0666666666666664}, "ep002": {"nsteps": 76, "reward": -14.077185579330513, "good_angle": 1.974462028658612, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 2.000000000000001}, "ep003": {"nsteps": 75, "reward": -14.233828892667468, "good_angle": 1.8206566345462152, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 1.900000000000001}, "ep004": {"nsteps": 74, "reward": -14.461316556141185, "good_angle": 2.0224477477182456, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 2.000000000000001}}
good_angle_max2.191059095980004
good_angle_mean1.965170969073175
good_angle_median1.974462028658612
good_angle_min1.8172293384627989
reward_max-8.331383397015088
reward_mean-12.818100595414412
reward_median-14.077185579330513
reward_min-14.461316556141185
survival_time_max4.266666666666661
survival_time_mean2.9066666666666663
survival_time_min2.4666666666666677
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.16666666666666
valid_direction_mean2.026666666666666
valid_direction_median2.000000000000001
valid_direction_min1.900000000000001
No reset possible
88831125Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.28736362035316415, "good_angle": 1.3699398663502953, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.199999999999989}, "ep001": {"nsteps": 121, "reward": -9.44257581414855, "good_angle": 13.558964465031329, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 2.7333333333333276}, "ep002": {"nsteps": 500, "reward": -0.30199863244325387, "good_angle": 1.3266642103894115, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.8333333333333304}, "ep003": {"nsteps": 500, "reward": -0.338634068045998, "good_angle": 1.1088716333917508, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.83333333333335}, "ep004": {"nsteps": 152, "reward": -7.412497799166503, "good_angle": 13.321708252101688, "survival_time": 5.066666666666658, "traveled_tiles": 3, "valid_direction": 2.4666666666666597}}
good_angle_max13.558964465031329
good_angle_mean6.137229685452894
good_angle_median1.3699398663502953
good_angle_min1.1088716333917508
reward_max-0.28736362035316415
reward_mean-3.5566139868314934
reward_median-0.338634068045998
reward_min-9.44257581414855
survival_time_max16.666666666666654
survival_time_mean11.81999999999999
survival_time_min4.033333333333329
traveled_tiles_max10
traveled_tiles_mean7.2
traveled_tiles_median10
traveled_tiles_min3
valid_direction_max4.199999999999989
valid_direction_mean3.4133333333333313
valid_direction_median3.8333333333333304
valid_direction_min2.4666666666666597
No reset possible
88771126Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
88741126Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.533333333333334


other stats
episodes
details{"ep000": {"nsteps": 128, "reward": -8.331383397015088, "good_angle": 1.8172293384627989, "survival_time": 4.266666666666661, "traveled_tiles": 2, "valid_direction": 2.16666666666666}, "ep001": {"nsteps": 83, "reward": -12.986788551917815, "good_angle": 2.191059095980004, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 2.0666666666666664}, "ep002": {"nsteps": 76, "reward": -14.077185579330513, "good_angle": 1.974462028658612, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 2.000000000000001}, "ep003": {"nsteps": 75, "reward": -14.233828892667468, "good_angle": 1.8206566345462152, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 1.900000000000001}, "ep004": {"nsteps": 74, "reward": -14.461316556141185, "good_angle": 2.0224477477182456, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 2.000000000000001}}
good_angle_max2.191059095980004
good_angle_mean1.965170969073175
good_angle_median1.974462028658612
good_angle_min1.8172293384627989
reward_max-8.331383397015088
reward_mean-12.818100595414412
reward_median-14.077185579330513
reward_min-14.461316556141185
survival_time_max4.266666666666661
survival_time_mean2.9066666666666663
survival_time_min2.4666666666666677
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.16666666666666
valid_direction_mean2.026666666666666
valid_direction_median2.000000000000001
valid_direction_min1.900000000000001
No reset possible
88711124Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyesrudolf-30:00:11
Error while running [...]

Creating job8871-2308_visualization_1 ... error
stderr | ERROR: for job8871-2308_visualization_1  Cannot start service visualization: network job8871-2308_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8871-2308_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88671124Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
88601124Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
88571123Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.2000000000000004


other stats
episodes
details{"ep000": {"nsteps": 51, "reward": -20.406392364443153, "good_angle": 0.8873066630450479, "survival_time": 1.700000000000002, "traveled_tiles": 2, "valid_direction": 0.7666666666666687}, "ep001": {"nsteps": 39, "reward": -26.159672717301127, "good_angle": 1.3410479232581582, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 1.066666666666667}, "ep002": {"nsteps": 36, "reward": -28.36412795754667, "good_angle": 1.2829153421511568, "survival_time": 1.2000000000000004, "traveled_tiles": 2, "valid_direction": 1.0000000000000004}, "ep003": {"nsteps": 35, "reward": -29.18184625437217, "good_angle": 1.221215282160583, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep004": {"nsteps": 35, "reward": -29.14305215664208, "good_angle": 1.279732575911705, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 1.0000000000000002}}
good_angle_max1.3410479232581582
good_angle_mean1.2024435573053305
good_angle_median1.279732575911705
good_angle_min0.8873066630450479
reward_max-20.406392364443153
reward_mean-26.65101829006104
reward_median-28.36412795754667
reward_min-29.18184625437217
survival_time_max1.700000000000002
survival_time_mean1.3066666666666673
survival_time_min1.166666666666667
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.066666666666667
valid_direction_mean0.9600000000000006
valid_direction_median1.0000000000000002
valid_direction_min0.7666666666666687
No reset possible
88451122Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:06:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
88411121Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:11
Error while running [...]

Creating job8841-4536_scorer_1 ... error
stderr | ERROR: for job8841-4536_scorer_1  Cannot start service scorer: network job8841-4536_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8841-4536_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88351118Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.0800191384151985
deviation-center-line_median1.4537620998520973
in-drivable-lane_median5.69999999999998


other stats
deviation-center-line_max1.7204669087765312
deviation-center-line_mean1.1874341263981512
deviation-center-line_min0.08414725295459423
deviation-heading_max1.7831337144331194
deviation-heading_mean1.1771825303886414
deviation-heading_median1.4718526205875515
deviation-heading_min0.06090207335592236
driven_any_max6.32998801859085
driven_any_mean5.07141095797302
driven_any_median6.268505372753538
driven_any_min0.29270692151363087
driven_lanedir_max4.772752515201063
driven_lanedir_mean3.340705977205901
driven_lanedir_min0.29177575401793865
in-drivable-lane_max7.56666666666667
in-drivable-lane_mean4.586666666666663
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.268505372753538, "driven_lanedir": 3.4774979430591326, "in-drivable-lane": 7.56666666666667, "deviation-heading": 0.911682657700122, "deviation-center-line": 1.657779837791391}, "ep001": {"driven_any": 0.29270692151363087, "driven_lanedir": 0.29177575401793865, "in-drivable-lane": 0, "deviation-heading": 0.06090207335592236, "deviation-center-line": 0.08414725295459423}, "ep002": {"driven_any": 6.322367338240872, "driven_lanedir": 4.0814845353361715, "in-drivable-lane": 5.700000000000015, "deviation-heading": 1.7831337144331194, "deviation-center-line": 1.4537620998520973}, "ep003": {"driven_any": 6.32998801859085, "driven_lanedir": 4.772752515201063, "in-drivable-lane": 3.966666666666653, "deviation-heading": 1.6583415858664925, "deviation-center-line": 1.0210145326161415}, "ep004": {"driven_any": 6.143487138766211, "driven_lanedir": 4.0800191384151985, "in-drivable-lane": 5.69999999999998, "deviation-heading": 1.4718526205875515, "deviation-center-line": 1.7204669087765312}}
No reset possible
88301118Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6716831328887493, "good_angle": 0.5418643666748314, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 0.9999999999999968}, "ep001": {"nsteps": 24, "reward": -42.21845681592822, "good_angle": 0.004903164463036015, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.534391786611639, "good_angle": 0.653873420892181, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 1.1333333333333293}, "ep003": {"nsteps": 500, "reward": -0.34749589752446625, "good_angle": 0.5094799271642615, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.1333333333333293}, "ep004": {"nsteps": 500, "reward": -0.6268078962262953, "good_angle": 9.587389930780583, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.299999999999992}}
good_angle_max9.587389930780583
good_angle_mean2.2595021619949787
good_angle_median0.5418643666748314
good_angle_min0.004903164463036015
reward_max-0.34749589752446625
reward_mean-8.879767105835874
reward_median-0.6268078962262953
reward_min-42.21845681592822
survival_time_max16.666666666666654
survival_time_mean13.493333333333323
survival_time_min0.7999999999999999
traveled_tiles_max13
traveled_tiles_mean9.6
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max2.299999999999992
valid_direction_mean1.1133333333333293
valid_direction_median1.1333333333333293
valid_direction_min0
No reset possible
88251119Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step4-vizabortedyesrudolf-30:00:13
Error while running [...]

Creating job8825-5205_visualization_1 ... error
stderr | ERROR: for job8825-5205_visualization_1  Cannot start service visualization: network job8825-5205_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8825-5205_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88171119Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
88121116Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.0502553195198097
deviation-center-line_median1.5387789622913712
in-drivable-lane_median4.633333333333341


other stats
deviation-center-line_max1.786655127731741
deviation-center-line_mean1.1110780352113605
deviation-center-line_min0.09897289157693905
deviation-heading_max1.6826435888486173
deviation-heading_mean0.9976915779897167
deviation-heading_median0.9748482745124268
deviation-heading_min0.06092138286581164
driven_any_max6.2705947479480475
driven_any_mean4.370125896439274
driven_any_median6.122568758169924
driven_any_min0.34666666666667245
driven_lanedir_max4.4886177150374635
driven_lanedir_mean2.8572473966098544
driven_lanedir_min0.3458718774424743
in-drivable-lane_max8.500000000000007
in-drivable-lane_mean3.9933333333333314
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.201473434954682, "driven_lanedir": 3.0502553195198097, "in-drivable-lane": 8.500000000000007, "deviation-heading": 0.9748482745124268, "deviation-center-line": 1.5387789622913712}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.2705947479480475, "driven_lanedir": 4.4886177150374635, "in-drivable-lane": 4.633333333333341, "deviation-heading": 1.4601870069628116, "deviation-center-line": 1.786655127731741}, "ep003": {"driven_any": 2.909325874457043, "driven_lanedir": 2.835259752199985, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.8098576367589169, "deviation-center-line": 0.3836799244729227}, "ep004": {"driven_any": 6.122568758169924, "driven_lanedir": 3.5662323188495373, "in-drivable-lane": 6.799999999999978, "deviation-heading": 1.6826435888486173, "deviation-center-line": 1.7473032699838285}}
No reset possible
88091116Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7121228661422502, "good_angle": 0.6289510252872001, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.3666666666666625}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.497267006195616, "good_angle": 0.4817720498773324, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.1999999999999955}, "ep003": {"nsteps": 226, "reward": -4.5931772413951775, "good_angle": 0.080180669304443, "survival_time": 7.533333333333316, "traveled_tiles": 5, "valid_direction": 0.033333333333333215}, "ep004": {"nsteps": 500, "reward": -0.7465832089912147, "good_angle": 22.31499710031131, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 4.299999999999988}}
good_angle_max22.31499710031131
good_angle_mean4.702004927820564
good_angle_median0.4817720498773324
good_angle_min0.004123794322536422
reward_max-0.497267006195616
reward_mean-8.56391394660422
reward_median-0.7465832089912147
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean11.693333333333324
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean7.4
traveled_tiles_median7
traveled_tiles_min1
valid_direction_max4.299999999999988
valid_direction_mean1.379999999999996
valid_direction_median1.1999999999999955
valid_direction_min0
No reset possible
87971114Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.082504584496517
deviation-center-line_median1.4213223962150685
in-drivable-lane_median4.699999999999987


other stats
deviation-center-line_max1.6933122370849438
deviation-center-line_mean1.1386942129245123
deviation-center-line_min0.09897289157693905
deviation-heading_max1.9148581555476023
deviation-heading_mean1.4473556308766535
deviation-heading_median1.8108213480222968
deviation-heading_min0.06092138286581164
driven_any_max6.295938102764451
driven_any_mean5.088299035557098
driven_any_median6.253828164121973
driven_any_min0.34666666666667245
driven_lanedir_max5.139916753040794
driven_lanedir_mean3.5184652864023205
driven_lanedir_min0.3458718774424743
in-drivable-lane_max6.699999999999977
in-drivable-lane_mean3.9933333333333274
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.250979620371302, "driven_lanedir": 4.365396730185181, "in-drivable-lane": 4.699999999999987, "deviation-heading": 1.8108213480222968, "deviation-center-line": 1.6933122370849438}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.295938102764451, "driven_lanedir": 4.082504584496517, "in-drivable-lane": 5.800000000000015, "deviation-heading": 1.5873098348142642, "deviation-center-line": 1.479346434076568}, "ep003": {"driven_any": 6.294082623861087, "driven_lanedir": 5.139916753040794, "in-drivable-lane": 2.766666666666657, "deviation-heading": 1.9148581555476023, "deviation-center-line": 1.0005171056690436}, "ep004": {"driven_any": 6.253828164121973, "driven_lanedir": 3.6586364868466377, "in-drivable-lane": 6.699999999999977, "deviation-heading": 1.8628674331332924, "deviation-center-line": 1.4213223962150685}}
No reset possible
87921114Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.500694146130234, "good_angle": 0.911197145557986, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.766666666666662}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.556684414820047, "good_angle": 0.6492836056174036, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 1.2999999999999954}, "ep003": {"nsteps": 500, "reward": -0.31227157474868, "good_angle": 0.45083800620122894, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 0.9666666666666632}, "ep004": {"nsteps": 500, "reward": -0.7018088672138983, "good_angle": 22.694390984151426, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 3.63333333333332}}
good_angle_max22.694390984151426
good_angle_mean4.941966707170116
good_angle_median0.6492836056174036
good_angle_min0.004123794322536422
reward_max-0.31227157474868
reward_mean-7.668375682641941
reward_median-0.556684414820047
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean13.51999999999999
survival_time_min0.9333333333333332
traveled_tiles_max13
traveled_tiles_mean9.6
traveled_tiles_median11
traveled_tiles_min1
valid_direction_max3.63333333333332
valid_direction_mean1.5333333333333283
valid_direction_median1.2999999999999954
valid_direction_min0
No reset possible
87871113Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.15741338591251397
deviation-center-line_median0.4650944282204903
in-drivable-lane_median8.299999999999994


other stats
deviation-center-line_max0.7159918628482274
deviation-center-line_mean0.3821124886057812
deviation-center-line_min0
deviation-heading_max6.540131967240777
deviation-heading_mean5.221082427757779
deviation-heading_median6.537669075338772
deviation-heading_min0
driven_any_max0.49735405772776664
driven_any_mean0.496556394292239
driven_any_median0.4973540577277655
driven_any_min0.4933657405501446
driven_lanedir_max0
driven_lanedir_mean-0.125929382017318
driven_lanedir_min-0.15748677407321887
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean9.973333333333326
in-drivable-lane_min8.299999999999994
per-episodes
details{"ep000": {"driven_any": 0.4933657405501446, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.49735405772775193, "driven_lanedir": -0.15748677407321887, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.540131967240777, "deviation-center-line": 0.7159918628482274}, "ep002": {"driven_any": 0.49735405772776664, "driven_lanedir": -0.15729812685794475, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.487894280561919, "deviation-center-line": 0.4650944282204903}, "ep003": {"driven_any": 0.4973540577277655, "driven_lanedir": -0.15744862324291242, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.539716815647427, "deviation-center-line": 0.2023017828020126}, "ep004": {"driven_any": 0.4973540577277666, "driven_lanedir": -0.15741338591251397, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.537669075338772, "deviation-center-line": 0.527174369158176}}
No reset possible
87781112Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.15741338591251397
deviation-center-line_median0.4650944282204903
in-drivable-lane_median8.299999999999994


other stats
deviation-center-line_max0.7159918628482274
deviation-center-line_mean0.3821124886057812
deviation-center-line_min0
deviation-heading_max6.540131967240777
deviation-heading_mean5.221082427757779
deviation-heading_median6.537669075338772
deviation-heading_min0
driven_any_max0.49735405772776664
driven_any_mean0.4968059124553689
driven_any_median0.4973540577277655
driven_any_min0.4946133313657941
driven_lanedir_max0
driven_lanedir_mean-0.125929382017318
driven_lanedir_min-0.15748677407321887
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean9.973333333333326
in-drivable-lane_min8.299999999999994
per-episodes
details{"ep000": {"driven_any": 0.4946133313657941, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.49735405772775193, "driven_lanedir": -0.15748677407321887, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.540131967240777, "deviation-center-line": 0.7159918628482274}, "ep002": {"driven_any": 0.49735405772776664, "driven_lanedir": -0.15729812685794475, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.487894280561919, "deviation-center-line": 0.4650944282204903}, "ep003": {"driven_any": 0.4973540577277655, "driven_lanedir": -0.15744862324291242, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.539716815647427, "deviation-center-line": 0.2023017828020126}, "ep004": {"driven_any": 0.4973540577277666, "driven_lanedir": -0.15741338591251397, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.537669075338772, "deviation-center-line": 0.527174369158176}}
No reset possible
87721112Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
87681112Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.30106463265419, "good_angle": 54.24953817239443, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.833333333333323}, "ep001": {"nsteps": 500, "reward": -1.753247414290905, "good_angle": 13.665899235634638, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.899999999999988}, "ep002": {"nsteps": 500, "reward": -1.575717896401882, "good_angle": 13.670340188871982, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.866666666666656}, "ep003": {"nsteps": 500, "reward": -1.3772086943238973, "good_angle": 13.665101915411906, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.03333333333332}, "ep004": {"nsteps": 500, "reward": -1.6150296981334686, "good_angle": 13.667722647448745, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666653}}
good_angle_max54.24953817239443
good_angle_mean21.78372043195234
good_angle_median13.667722647448745
good_angle_min13.665101915411906
reward_max-1.30106463265419
reward_mean-1.5244536671608688
reward_median-1.575717896401882
reward_min-1.753247414290905
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.833333333333323
valid_direction_mean13.319999999999988
valid_direction_median12.966666666666653
valid_direction_min12.866666666666656
No reset possible
87551111Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:04:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
87491109Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
87451110Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:11
Error while running [...]

Creating job8745-719_scorer_1 ... error
stderr | ERROR: for job8745-719_scorer_1  Cannot start service scorer: network job8745-719_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8745-719_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87381108Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.770405108500412
deviation-center-line_median1.2882499664978988
in-drivable-lane_median1.533333333333328


other stats
deviation-center-line_max2.6795700709364354
deviation-center-line_mean1.6171486262204433
deviation-center-line_min0.7957689340509382
deviation-heading_max3.3901748526040403
deviation-heading_mean2.315147760415663
deviation-heading_median2.325774299185338
deviation-heading_min1.1332800828333809
driven_any_max5.648673734230038
driven_any_mean4.91142241599376
driven_any_median5.287518881534349
driven_any_min2.9804186489360935
driven_lanedir_max5.620425621008038
driven_lanedir_mean4.396179359628715
driven_lanedir_min2.363778209447126
in-drivable-lane_max2.266666666666673
in-drivable-lane_mean1.2533333333333323
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.17202384603784, "driven_lanedir": 4.287933297769848, "in-drivable-lane": 2.266666666666673, "deviation-heading": 3.3901748526040403, "deviation-center-line": 1.2882499664978988}, "ep001": {"driven_any": 5.4684769692304815, "driven_lanedir": 4.770405108500412, "in-drivable-lane": 1.6666666666666607, "deviation-heading": 2.4959908952433354, "deviation-center-line": 2.212813773513863}, "ep002": {"driven_any": 2.9804186489360935, "driven_lanedir": 2.363778209447126, "in-drivable-lane": 1.533333333333328, "deviation-heading": 2.325774299185338, "deviation-center-line": 0.7957689340509382}, "ep003": {"driven_any": 5.287518881534349, "driven_lanedir": 4.93835456141815, "in-drivable-lane": 0.8000000000000007, "deviation-heading": 2.2305186722122214, "deviation-center-line": 1.1093403861030806}, "ep004": {"driven_any": 5.648673734230038, "driven_lanedir": 5.620425621008038, "in-drivable-lane": 0, "deviation-heading": 1.1332800828333809, "deviation-center-line": 2.6795700709364354}}
No reset possible
87321108Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
87291108Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.15644692612317157, "good_angle": 1.1850549188777757, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.333333333333326}, "ep001": {"nsteps": 500, "reward": -0.4832332623641705, "good_angle": 26.90511062716362, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.166666666666655}, "ep002": {"nsteps": 289, "reward": -3.6313355645461622, "good_angle": 0.8995114903146415, "survival_time": 9.63333333333331, "traveled_tiles": 7, "valid_direction": 2.5666666666666584}, "ep003": {"nsteps": 500, "reward": -0.15980873936373974, "good_angle": 0.7956928799808193, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.0999999999999925}, "ep004": {"nsteps": 500, "reward": -0.43849080500460696, "good_angle": 21.48062272864873, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.3999999999999915}}
good_angle_max26.90511062716362
good_angle_mean10.253198528997116
good_angle_median1.1850549188777757
good_angle_min0.7956928799808193
reward_max-0.15644692612317157
reward_mean-0.9738630594803704
reward_median-0.43849080500460696
reward_min-3.6313355645461622
survival_time_max16.666666666666654
survival_time_mean15.259999999999986
survival_time_min9.63333333333331
traveled_tiles_max11
traveled_tiles_mean9.8
traveled_tiles_median10
traveled_tiles_min7
valid_direction_max4.166666666666655
valid_direction_mean2.9133333333333247
valid_direction_median2.5666666666666584
valid_direction_min2.0999999999999925
No reset possible
87171104Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.126771979630813
deviation-center-line_median0.46435872745159856
in-drivable-lane_median0.5333333333333333


other stats
deviation-center-line_max1.808579564144713
deviation-center-line_mean0.8495553728548695
deviation-center-line_min0.09897289157693905
deviation-heading_max1.729391419294423
deviation-heading_mean0.9304119531322328
deviation-heading_median0.8944355666605296
deviation-heading_min0.06092138286581164
driven_any_max6.321014103528449
driven_any_mean3.4601736124961966
driven_any_median3.2144447511749368
driven_any_min0.34666666666667245
driven_lanedir_max4.550276242403497
driven_lanedir_mean2.6433744411794375
driven_lanedir_min0.3458718774424743
in-drivable-lane_max5.599999999999987
in-drivable-lane_mean2.133333333333334
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.3497004489545636, "driven_lanedir": 1.1412575970121452, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 0.443215985761529, "deviation-center-line": 0.246687227657432}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.321014103528449, "driven_lanedir": 4.550276242403497, "in-drivable-lane": 4.5000000000000195, "deviation-heading": 1.729391419294423, "deviation-center-line": 1.6291784534436649}, "ep003": {"driven_any": 3.2144447511749368, "driven_lanedir": 3.126771979630813, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.8944355666605296, "deviation-center-line": 0.46435872745159856}, "ep004": {"driven_any": 6.069042092156363, "driven_lanedir": 4.0526945094082585, "in-drivable-lane": 5.599999999999987, "deviation-heading": 1.5240954110788711, "deviation-center-line": 1.808579564144713}}
No reset possible
87111104Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.299999999999981


other stats
episodes
details{"ep000": {"nsteps": 107, "reward": -9.594545846596082, "good_angle": 0.102420292933044, "survival_time": 3.566666666666664, "traveled_tiles": 3, "valid_direction": 0.10000000000000003}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.4894663843177259, "good_angle": 0.6984814895113812, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 1.1999999999999955}, "ep003": {"nsteps": 249, "reward": -4.202906203987339, "good_angle": 0.113877381115421, "survival_time": 8.299999999999981, "traveled_tiles": 6, "valid_direction": 0.16666666666666607}, "ep004": {"nsteps": 500, "reward": -0.6918814052544767, "good_angle": 23.70003543719283, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.499999999999993}}
good_angle_max23.70003543719283
good_angle_mean4.923787679015043
good_angle_median0.113877381115421
good_angle_min0.004123794322536422
reward_max-0.4894663843177259
reward_mean-10.249843850090494
reward_median-4.202906203987339
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean9.226666666666656
survival_time_min0.9333333333333332
traveled_tiles_max13
traveled_tiles_mean6.4
traveled_tiles_median6
traveled_tiles_min1
valid_direction_max3.499999999999993
valid_direction_mean0.9933333333333308
valid_direction_median0.16666666666666607
valid_direction_min0
No reset possible
87051104Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:06:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
87021103Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 552, in run
    solve(params, cis)
  File "solution.py", line 470, in solve
    if len(lines) == 0:
TypeError: object of type 'NoneType' has no len()


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86921100Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.15741338591251397
deviation-center-line_median0.4650944282204903
in-drivable-lane_median8.299999999999994


other stats
deviation-center-line_max0.7159918628482274
deviation-center-line_mean0.3821124886057812
deviation-center-line_min0
deviation-heading_max6.540131967240777
deviation-heading_mean5.221082427757779
deviation-heading_median6.537669075338772
deviation-heading_min0
driven_any_max0.49735405772776664
driven_any_mean0.49675584668913847
driven_any_median0.4973540577277655
driven_any_min0.4943630025346415
driven_lanedir_max0
driven_lanedir_mean-0.125929382017318
driven_lanedir_min-0.15748677407321887
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean9.973333333333326
in-drivable-lane_min8.299999999999994
per-episodes
details{"ep000": {"driven_any": 0.4943630025346415, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.49735405772775193, "driven_lanedir": -0.15748677407321887, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.540131967240777, "deviation-center-line": 0.7159918628482274}, "ep002": {"driven_any": 0.49735405772776664, "driven_lanedir": -0.15729812685794475, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.487894280561919, "deviation-center-line": 0.4650944282204903}, "ep003": {"driven_any": 0.4973540577277655, "driven_lanedir": -0.15744862324291242, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.539716815647427, "deviation-center-line": 0.2023017828020126}, "ep004": {"driven_any": 0.4973540577277666, "driven_lanedir": -0.15741338591251397, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.537669075338772, "deviation-center-line": 0.527174369158176}}
No reset possible
86891100Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step3-videosabortedyesrudolf-30:00:11
Error while running [...]

Creating job8689-5772_videos_1 ... error
stderr | ERROR: for job8689-5772_videos_1  Cannot start service videos: network job8689-5772_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8689-5772_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86781087Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.5987188584299385
deviation-center-line_median1.8416151292724297
in-drivable-lane_median1.4333333333333442


other stats
deviation-center-line_max2.746436279588349
deviation-center-line_mean1.753310582875055
deviation-center-line_min0.9243765168994036
deviation-heading_max3.299741976835285
deviation-heading_mean2.4093418963344275
deviation-heading_median2.521168234028518
deviation-heading_min1.0786789834874522
driven_any_max5.6992452923144175
driven_any_mean4.8956603988036465
driven_any_median5.261910475343271
driven_any_min3.0012519774993613
driven_lanedir_max5.598366737779154
driven_lanedir_mean4.401905506185358
driven_lanedir_min2.7846382858558973
in-drivable-lane_max2.099999999999996
in-drivable-lane_mean1.16
in-drivable-lane_min0.1999999999999993
per-episodes
details{"ep000": {"driven_any": 5.16044354177468, "driven_lanedir": 4.357360699317013, "in-drivable-lane": 2.099999999999996, "deviation-heading": 2.9603234097169464, "deviation-center-line": 1.1177859827449028}, "ep001": {"driven_any": 5.355450707086503, "driven_lanedir": 4.670442949544786, "in-drivable-lane": 1.7666666666666604, "deviation-heading": 2.521168234028518, "deviation-center-line": 2.1363390058701883}, "ep002": {"driven_any": 3.0012519774993613, "driven_lanedir": 2.7846382858558973, "in-drivable-lane": 0.2999999999999998, "deviation-heading": 2.186796877603935, "deviation-center-line": 0.9243765168994036}, "ep003": {"driven_any": 5.261910475343271, "driven_lanedir": 4.5987188584299385, "in-drivable-lane": 1.4333333333333442, "deviation-heading": 3.299741976835285, "deviation-center-line": 1.8416151292724297}, "ep004": {"driven_any": 5.6992452923144175, "driven_lanedir": 5.598366737779154, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 1.0786789834874522, "deviation-center-line": 2.746436279588349}}
No reset possible
86711096Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
86661093Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyesrudolf-30:00:12
Error while running [...]

Creating job8666-1135_visualization_1 ... error
stderr | ERROR: for job8666-1135_visualization_1  Cannot start service visualization: network job8666-1135_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8666-1135_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86641093Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyesrudolf-30:00:13
Error while running [...]

Creating job8664-6344_videos_1 ... error
stderr | ERROR: for job8664-6344_videos_1  Cannot start service videos: network job8664-6344_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8664-6344_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86611093Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:11
Error while running [...]

Creating job8661-7096_scorer_1 ... error
stderr | ERROR: for job8661-7096_scorer_1  Cannot start service scorer: network job8661-7096_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8661-7096_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86591094Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 544, in run
    solve(params, cis)
  File "solution.py", line 471, in solve
    color_classes = [0 for i in range(lines.shape[0])]
AttributeError: 'NoneType' object has no attribute 'shape'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86501091Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 77, "reward": -13.608360718488209, "good_angle": 1.5062601676545182, "survival_time": 2.5666666666666673, "traveled_tiles": 2, "valid_direction": 1.3666666666666667}, "ep001": {"nsteps": 60, "reward": -17.057688444604477, "good_angle": 1.8258357325297336, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 1.8000000000000027}, "ep002": {"nsteps": 58, "reward": -17.61266718628206, "good_angle": 1.781738406408049, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 1.7000000000000026}, "ep003": {"nsteps": 53, "reward": -19.279425655421363, "good_angle": 1.873411065546353, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 1.4666666666666688}, "ep004": {"nsteps": 54, "reward": -18.98923834634048, "good_angle": 1.891105457200604, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 1.5333333333333354}}
good_angle_max1.891105457200604
good_angle_mean1.7756701658678515
good_angle_median1.8258357325297336
good_angle_min1.5062601676545182
reward_max-13.608360718488209
reward_mean-17.309476070227316
reward_median-17.61266718628206
reward_min-19.279425655421363
survival_time_max2.5666666666666673
survival_time_mean2.0133333333333354
survival_time_min1.7666666666666688
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.8000000000000027
valid_direction_mean1.5733333333333352
valid_direction_median1.5333333333333354
valid_direction_min1.3666666666666667
No reset possible
86421088Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.050757583513121
deviation-center-line_median1.2994125499262943
in-drivable-lane_median2.033333333333326


other stats
deviation-center-line_max1.9993221263501044
deviation-center-line_mean1.1369861220422568
deviation-center-line_min0.09897289157693905
deviation-heading_max2.5472271240189612
deviation-heading_mean1.4902215688941052
deviation-heading_median1.8055175325629285
deviation-heading_min0.06092138286581164
driven_any_max6.273227779451769
driven_any_mean4.200189455821631
driven_any_median5.950123558240415
driven_any_min0.34666666666667245
driven_lanedir_max5.240250528782286
driven_lanedir_mean3.121772270637142
driven_lanedir_min0.3458718774424743
in-drivable-lane_max5.033333333333319
in-drivable-lane_mean2.613333333333325
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.950123558240415, "driven_lanedir": 4.050757583513121, "in-drivable-lane": 5.033333333333319, "deviation-heading": 2.1148164814004757, "deviation-center-line": 1.9993221263501044}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.222005883634688, "driven_lanedir": 4.237402110410632, "in-drivable-lane": 4.8999999999999835, "deviation-heading": 1.8055175325629285, "deviation-center-line": 1.8198826995902624}, "ep003": {"driven_any": 6.273227779451769, "driven_lanedir": 5.240250528782286, "in-drivable-lane": 2.033333333333326, "deviation-heading": 2.5472271240189612, "deviation-center-line": 1.2994125499262943}, "ep004": {"driven_any": 2.2089233911146127, "driven_lanedir": 1.7345792530371982, "in-drivable-lane": 1.099999999999996, "deviation-heading": 0.9226253236223484, "deviation-center-line": 0.46734034276768266}}
No reset possible
86401088Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
86371088Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:13
Error while running [...]

Creating job8637-8742_scorer_1 ... error
stderr | ERROR: for job8637-8742_scorer_1  Cannot start service scorer: network job8637-8742_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8637-8742_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86241085Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
86041081Samuel LavoieFast Dukeaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.026502901894182
deviation-center-line_median0.29609876542896774
in-drivable-lane_median0.29999999999999977


other stats
deviation-center-line_max0.3881679462765726
deviation-center-line_mean0.256009892841337
deviation-center-line_min0.09787105195906504
deviation-heading_max1.2582883465122523
deviation-heading_mean0.8164403444433781
deviation-heading_median0.715757844928046
deviation-heading_min0.4619409384167616
driven_any_max4.851083690340034
driven_any_mean2.809838600737188
driven_any_median2.333012060010903
driven_any_min1.107061441768452
driven_lanedir_max4.233987097596685
driven_lanedir_mean2.3892392162612115
driven_lanedir_min0.7446460531440169
in-drivable-lane_max0.7333333333333325
in-drivable-lane_mean0.3533333333333329
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.333012060010903, "driven_lanedir": 2.026502901894182, "in-drivable-lane": 0.29999999999999977, "deviation-heading": 0.5546790906108472, "deviation-center-line": 0.29609876542896774}, "ep001": {"driven_any": 1.107061441768452, "driven_lanedir": 0.7446460531440169, "in-drivable-lane": 0.23333333333333384, "deviation-heading": 0.715757844928046, "deviation-center-line": 0.09787105195906504}, "ep002": {"driven_any": 1.413184619768975, "driven_lanedir": 1.3337674686937264, "in-drivable-lane": 0, "deviation-heading": 0.4619409384167616, "deviation-center-line": 0.1205768150315524}, "ep003": {"driven_any": 4.851083690340034, "driven_lanedir": 4.233987097596685, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.0915355017489827, "deviation-center-line": 0.3881679462765726}, "ep004": {"driven_any": 4.344851191797576, "driven_lanedir": 3.607292559977447, "in-drivable-lane": 0.7333333333333325, "deviation-heading": 1.2582883465122523, "deviation-center-line": 0.37733488551052735}}
No reset possible
85991081Samuel LavoieFast Dukeaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
85941080Samuel LavoieFast Dukeaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.9955057655691024
deviation-center-line_median0.1791085878890079
in-drivable-lane_median0.2999999999999999


other stats
deviation-center-line_max0.406582772712122
deviation-center-line_mean0.21464777531241547
deviation-center-line_min0.09990963253085516
deviation-heading_max1.3252755756263568
deviation-heading_mean0.9049024242324478
deviation-heading_median0.8008368094712541
deviation-heading_min0.6182295439664158
driven_any_max5.010720305760874
driven_any_mean2.600240589232639
driven_any_median2.298846435398382
driven_any_min1.1455711013459484
driven_lanedir_max4.285751379767374
driven_lanedir_mean2.110527600514174
driven_lanedir_min0.6898227592988182
in-drivable-lane_max0.6666666666666643
in-drivable-lane_mean0.3933333333333327
in-drivable-lane_min0.16666666666666718
per-episodes
details{"ep000": {"driven_any": 2.298846435398382, "driven_lanedir": 1.9955057655691024, "in-drivable-lane": 0.2999999999999999, "deviation-heading": 0.6456679078137356, "deviation-center-line": 0.1791085878890079}, "ep001": {"driven_any": 1.1455711013459484, "driven_lanedir": 0.6898227592988182, "in-drivable-lane": 0.2666666666666673, "deviation-heading": 0.8008368094712541, "deviation-center-line": 0.09990963253085516}, "ep002": {"driven_any": 2.9194744673313804, "driven_lanedir": 2.232484946025281, "in-drivable-lane": 0.5666666666666649, "deviation-heading": 1.3252755756263568, "deviation-center-line": 0.28530215074242776}, "ep003": {"driven_any": 5.010720305760874, "driven_lanedir": 4.285751379767374, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 1.1345022842844763, "deviation-center-line": 0.406582772712122}, "ep004": {"driven_any": 1.6265906363266105, "driven_lanedir": 1.3490731519102948, "in-drivable-lane": 0.16666666666666718, "deviation-heading": 0.6182295439664158, "deviation-center-line": 0.10233573268766444}}
No reset possible
85871080Samuel LavoieFast Dukeaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
85831079Samuel LavoieFast Dukeaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
85801079Samuel LavoieFast Dukeaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
85711078Claudio RuchBig Fleet Controlleraido1_amod_fleet_size_r1-v3step1-simulationerrornorudolf-30:10:34
Timeout: Waited 601 [...]
Timeout:

Waited 601.704304934 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
85671077David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
85621075Claudio RuchBig Fleet Controlleraido1_amod_service_quality_r1-v3step1-simulationsuccessnorudolf-30:03:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
85551072Claudio RuchAlgorithm of Webinaraido1_amod_service_quality_r1-v3step1-simulationerrornorudolf-30:10:50
Timeout: Waited 603 [...]
Timeout:

Waited 603.647610903 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
85511071Krishna Murthy Jatavallabhula 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:43
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
85481070Claudio RuchJava templateaido1_amod_service_quality_r1-v3step1-simulationerrornorudolf-30:10:53
Timeout: Waited 603 [...]
Timeout:

Waited 603.653151989 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
85391068Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
85351066Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
85271065Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.8140952124698827
deviation-center-line_median0.2874404898251744
in-drivable-lane_median0.3999999999999986


other stats
deviation-center-line_max0.7043908907436521
deviation-center-line_mean0.3755826744380205
deviation-center-line_min0.09446512545928508
deviation-heading_max1.7017221611406226
deviation-heading_mean1.1388624039620745
deviation-heading_median1.24129178914597
deviation-heading_min0.6315848785724153
driven_any_max2.1338761202291217
driven_any_mean1.297228563227727
driven_any_median1.191449652706252
driven_any_min0.4300074700579597
driven_lanedir_max2.016314575179443
driven_lanedir_mean0.9995426543174636
driven_lanedir_min0.23110894173291197
in-drivable-lane_max1.3333333333333286
in-drivable-lane_mean0.5533333333333317
in-drivable-lane_min0.16666666666666607
per-episodes
details{"ep000": {"driven_any": 0.4300074700579597, "driven_lanedir": 0.23110894173291197, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 0.6315848785724153, "deviation-center-line": 0.09446512545928508}, "ep001": {"driven_any": 1.0737288111046677, "driven_lanedir": 0.696594063639485, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 1.7017221611406226, "deviation-center-line": 0.25882612724089177}, "ep002": {"driven_any": 1.191449652706252, "driven_lanedir": 0.8140952124698827, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.473328955836251, "deviation-center-line": 0.2874404898251744}, "ep003": {"driven_any": 2.1338761202291217, "driven_lanedir": 2.016314575179443, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.24129178914597, "deviation-center-line": 0.7043908907436521}, "ep004": {"driven_any": 1.6570807620406336, "driven_lanedir": 1.2396004785655954, "in-drivable-lane": 1.3333333333333286, "deviation-heading": 0.6463842351151142, "deviation-center-line": 0.5327907389210992}}
No reset possible
85201064Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
85131064Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
85031063Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:08:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
84971061Mandana Samiei 🇨🇦bazinga!!!aido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
84911061Mandana Samiei 🇨🇦bazinga!!!aido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
84881059Mandana Samiei 🇨🇦bazinga!!!aido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.18432958645266373
deviation-center-line_median0.1903067388339497
in-drivable-lane_median0


other stats
deviation-center-line_max0.3638369144072225
deviation-center-line_mean0.20281651861136468
deviation-center-line_min0.12969935361256285
deviation-heading_max1.764454269158792
deviation-heading_mean0.7934173788539537
deviation-heading_median0.6420676885644672
deviation-heading_min0.21000204087185195
driven_any_max0.8143193326557515
driven_any_mean0.31857438282486134
driven_any_median0.1999837410490108
driven_any_min0.15712882070308834
driven_lanedir_max0.5781194172899131
driven_lanedir_mean0.2592283223446602
driven_lanedir_min0.1361674384288447
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8143193326557515, "driven_lanedir": 0.5781194172899131, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.764454269158792, "deviation-center-line": 0.3638369144072225}, "ep001": {"driven_any": 0.18572532904378736, "driven_lanedir": 0.18432958645266373, "in-drivable-lane": 0, "deviation-heading": 0.21000204087185195, "deviation-center-line": 0.1903067388339497}, "ep002": {"driven_any": 0.15712882070308834, "driven_lanedir": 0.1361674384288447, "in-drivable-lane": 0, "deviation-heading": 0.6420676885644672, "deviation-center-line": 0.12969935361256285}, "ep003": {"driven_any": 0.1999837410490108, "driven_lanedir": 0.17974964386648518, "in-drivable-lane": 0, "deviation-heading": 0.7291853471865158, "deviation-center-line": 0.1320024695877375}, "ep004": {"driven_any": 0.2357146906726685, "driven_lanedir": 0.2177755256853944, "in-drivable-lane": 0, "deviation-heading": 0.6213775484881418, "deviation-center-line": 0.1982371166153506}}
No reset possible
84831059Mandana Samiei 🇨🇦bazinga!!!aido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 230, "reward": -4.504660017999729, "good_angle": 0.7494184430192025, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 1.0666666666666629}, "ep001": {"nsteps": 54, "reward": -19.073132278742612, "good_angle": 0.026206026893927845, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 46, "reward": -22.21546394604704, "good_angle": 0.46558265554962186, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.8666666666666681}, "ep003": {"nsteps": 58, "reward": -17.606012451879938, "good_angle": 0.47617846417278115, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 0.8000000000000019}, "ep004": {"nsteps": 68, "reward": -15.176614952438015, "good_angle": 0.39932839326070946, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.6666666666666667}}
good_angle_max0.7494184430192025
good_angle_mean0.4233427965792485
good_angle_median0.46558265554962186
good_angle_min0.026206026893927845
reward_max-4.504660017999729
reward_mean-15.715176729421469
reward_median-17.606012451879938
reward_min-22.21546394604704
survival_time_max7.666666666666649
survival_time_mean3.039999999999998
survival_time_min1.5333333333333348
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.0666666666666629
valid_direction_mean0.6799999999999999
valid_direction_median0.8000000000000019
valid_direction_min0
No reset possible
84671056Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
84631056Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.6666666666666634


other stats
episodes
details{"ep000": {"nsteps": 34, "reward": -29.653921192765292, "good_angle": 0.5432750363228189, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep001": {"nsteps": 34, "reward": -29.970305812709473, "good_angle": 0.0050401930608778515, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 110, "reward": -9.593723950873722, "good_angle": 0.43242677581517874, "survival_time": 3.6666666666666634, "traveled_tiles": 3, "valid_direction": 0.93333333333333}, "ep003": {"nsteps": 196, "reward": -5.411052850930362, "good_angle": 0.4479678779418729, "survival_time": 6.53333333333332, "traveled_tiles": 4, "valid_direction": 0.9666666666666632}, "ep004": {"nsteps": 148, "reward": -7.345814647617108, "good_angle": 8.8217135095513, "survival_time": 4.933333333333326, "traveled_tiles": 3, "valid_direction": 1.699999999999994}}
good_angle_max8.8217135095513
good_angle_mean2.05008467853841
good_angle_median0.4479678779418729
good_angle_min0.0050401930608778515
reward_max-5.411052850930362
reward_mean-16.39496369097919
reward_median-9.593723950873722
reward_min-29.970305812709473
survival_time_max6.53333333333332
survival_time_mean3.4799999999999955
survival_time_min1.1333333333333335
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.699999999999994
valid_direction_mean0.9133333333333308
valid_direction_median0.9666666666666632
valid_direction_min0
No reset possible
84591055Benjamin Ramtoula 🇨🇦My ROS solution - param 3aido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.27823326643947355
deviation-center-line_median0.1754483586704807
in-drivable-lane_median14.799999999999985


other stats
deviation-center-line_max0.20899834319026736
deviation-center-line_mean0.15320968266867013
deviation-center-line_min0.023037552405942577
deviation-heading_max1.2386213492038547
deviation-heading_mean0.8573000528571967
deviation-heading_median1.0299514458628671
deviation-heading_min0.013555570229481402
driven_any_max3.8920911916260423
driven_any_mean3.7744849641040914
driven_any_median3.819814656332734
driven_any_min3.60000451186592
driven_lanedir_max0.31956498306497005
driven_lanedir_mean0.23903991065794175
driven_lanedir_min0.02978106876073494
in-drivable-lane_max16.53333333333332
in-drivable-lane_mean15.079999999999988
in-drivable-lane_min14.53333333333332
per-episodes
details{"ep000": {"driven_any": 3.8523436137415583, "driven_lanedir": 0.02978106876073494, "in-drivable-lane": 16.53333333333332, "deviation-heading": 0.013555570229481402, "deviation-center-line": 0.023037552405942577}, "ep001": {"driven_any": 3.708170846954202, "driven_lanedir": 0.305872389512019, "in-drivable-lane": 14.53333333333332, "deviation-heading": 1.2386213492038547, "deviation-center-line": 0.20899834319026736}, "ep002": {"driven_any": 3.60000451186592, "driven_lanedir": 0.27823326643947355, "in-drivable-lane": 14.799999999999985, "deviation-heading": 1.0665703560324402, "deviation-center-line": 0.1754483586704807}, "ep003": {"driven_any": 3.819814656332734, "driven_lanedir": 0.2617478455125113, "in-drivable-lane": 14.866666666666651, "deviation-heading": 0.9378015429573398, "deviation-center-line": 0.15942617918544966}, "ep004": {"driven_any": 3.8920911916260423, "driven_lanedir": 0.31956498306497005, "in-drivable-lane": 14.666666666666652, "deviation-heading": 1.0299514458628671, "deviation-center-line": 0.1991379798912105}}
No reset possible
84501055Benjamin Ramtoula 🇨🇦My ROS solution - param 3aido1_LF1_r3-v3step1-simulationabortednorudolf-30:00:13
Error while running [...]

Creating job8450-4145_solution_1  ... error
stderr | ERROR: for job8450-4145_solution_1  Cannot start service solution: network job8450-4145_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8450-4145_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8450-4145_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84441054David AbrahamPytorch ILaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
84381053Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
84281052Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
84221051David AbrahamPytorch ILaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
84181051David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
84171050David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.9557426648705187
deviation-center-line_median0.22080288697236833
in-drivable-lane_median0.3


other stats
deviation-center-line_max0.6516762720666056
deviation-center-line_mean0.33603350166836843
deviation-center-line_min0.09194481541531384
deviation-heading_max2.368714320527091
deviation-heading_mean1.4452621853421288
deviation-heading_median1.2411722126023677
deviation-heading_min0.9618995210386724
driven_any_max4.640074180233533
driven_any_mean2.582787568840291
driven_any_median2.124384084046963
driven_any_min0.32610597033581473
driven_lanedir_max3.428880812689395
driven_lanedir_mean1.9005735372761112
driven_lanedir_min0.0940113216818208
in-drivable-lane_max5.766666666666647
in-drivable-lane_mean1.98666666666666
in-drivable-lane_min0.033333333333333215
per-episodes
details{"ep000": {"driven_any": 0.32610597033581473, "driven_lanedir": 0.0940113216818208, "in-drivable-lane": 0.3, "deviation-heading": 1.0510367418758613, "deviation-center-line": 0.09194481541531384}, "ep001": {"driven_any": 4.640056376074319, "driven_lanedir": 3.428880812689395, "in-drivable-lane": 3.699999999999987, "deviation-heading": 2.368714320527091, "deviation-center-line": 0.6516762720666056}, "ep002": {"driven_any": 1.1833172335108262, "driven_lanedir": 1.0910296637731989, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.9618995210386724, "deviation-center-line": 0.15986026217004917}, "ep003": {"driven_any": 2.124384084046963, "driven_lanedir": 1.9557426648705187, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.2411722126023677, "deviation-center-line": 0.22080288697236833}, "ep004": {"driven_any": 4.640074180233533, "driven_lanedir": 2.9332032233656236, "in-drivable-lane": 5.766666666666647, "deviation-heading": 1.6034881306666526, "deviation-center-line": 0.5558832717175051}}
No reset possible
84101049Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.14353239706145726
deviation-center-line_median0.2611249267004372
in-drivable-lane_median8.166666666666654


other stats
deviation-center-line_max0.48868500565471173
deviation-center-line_mean0.3070331243774142
deviation-center-line_min0.1340678952733617
deviation-heading_max6.643668630970864
deviation-heading_mean3.821496343273332
deviation-heading_median2.675464152341786
deviation-heading_min1.0454401062248788
driven_any_max1.1116828683255884
driven_any_mean0.7501320866951738
driven_any_median1.0598125943360273
driven_any_min0.14340491274231532
driven_lanedir_max-0.04060430073660149
driven_lanedir_mean-0.19841643353470348
driven_lanedir_min-0.3726552663841538
in-drivable-lane_max13.066666666666643
in-drivable-lane_mean6.7466666666666555
in-drivable-lane_min1.3999999999999997
per-episodes
details{"ep000": {"driven_any": 1.1116828683255884, "driven_lanedir": -0.14353239706145726, "in-drivable-lane": 13.066666666666643, "deviation-heading": 2.675464152341786, "deviation-center-line": 0.48868500565471173}, "ep001": {"driven_any": 0.14340491274231532, "driven_lanedir": -0.04060430073660149, "in-drivable-lane": 1.3999999999999997, "deviation-heading": 1.0454401062248788, "deviation-center-line": 0.1340678952733617}, "ep002": {"driven_any": 1.0598125943360273, "driven_lanedir": -0.3726552663841538, "in-drivable-lane": 8.166666666666654, "deviation-heading": 6.643668630970864, "deviation-center-line": 0.4247018404398309}, "ep003": {"driven_any": 1.111274571625996, "driven_lanedir": -0.35278280525851313, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.589442248739042, "deviation-center-line": 0.2611249267004372}, "ep004": {"driven_any": 0.32448548644594255, "driven_lanedir": -0.08250739823279174, "in-drivable-lane": 2.866666666666661, "deviation-heading": 2.15346657809009, "deviation-center-line": 0.2265859538187296}}
No reset possible
84031049Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
84001042Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.04593065588153422
deviation-center-line_median0.04889858809432139
in-drivable-lane_median0


other stats
deviation-center-line_max0.05146284982227555
deviation-center-line_mean0.03672633422420539
deviation-center-line_min0
deviation-heading_max0.4693723938016831
deviation-heading_mean0.32252083548413774
deviation-heading_median0.3787742025787767
deviation-heading_min0
driven_any_max2.3231893140653552
driven_any_mean0.5290153980221113
driven_any_median0.07464062053222065
driven_any_min0.05598046539916547
driven_lanedir_max0.049006275094063856
driven_lanedir_mean0.036499239166509365
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.39333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.3231893140653552, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.05598046539916547, "driven_lanedir": 0.04042772695966379, "in-drivable-lane": 0, "deviation-heading": 0.3068924305301613, "deviation-center-line": 0.04889858809432139}, "ep002": {"driven_any": 0.07464062053222065, "driven_lanedir": 0.04713153789728497, "in-drivable-lane": 0, "deviation-heading": 0.45756515051006746, "deviation-center-line": 0.05146284982227555}, "ep003": {"driven_any": 0.12129100836485852, "driven_lanedir": 0.04593065588153422, "in-drivable-lane": 0.33333333333333326, "deviation-heading": 0.4693723938016831, "deviation-center-line": 0.03413515654502517}, "ep004": {"driven_any": 0.06997558174895666, "driven_lanedir": 0.049006275094063856, "in-drivable-lane": 0, "deviation-heading": 0.3787742025787767, "deviation-center-line": 0.04913507665940483}}
No reset possible
83921047Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.197739092302043, "good_angle": 52.80917847452318, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.499999999999986}, "ep001": {"nsteps": 138, "reward": -9.111790748178096, "good_angle": 3.800184563779621, "survival_time": 4.599999999999993, "traveled_tiles": 1, "valid_direction": 3.666666666666661}, "ep002": {"nsteps": 500, "reward": -1.104745883501571, "good_angle": 13.562967526417962, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.93333333333332}, "ep003": {"nsteps": 500, "reward": -1.1998082705645938, "good_angle": 14.056458667043689, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.933333333333325}, "ep004": {"nsteps": 369, "reward": -4.568006843570771, "good_angle": 10.217857107443788, "survival_time": 12.299999999999969, "traveled_tiles": 1, "valid_direction": 9.733333333333308}}
good_angle_max52.80917847452318
good_angle_mean18.88932926784165
good_angle_median13.562967526417962
good_angle_min3.800184563779621
reward_max-1.104745883501571
reward_mean-3.4364181676234153
reward_median-1.1998082705645938
reward_min-9.111790748178096
survival_time_max16.666666666666654
survival_time_mean13.379999999999985
survival_time_min4.599999999999993
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.499999999999986
valid_direction_mean10.75333333333332
valid_direction_median12.93333333333332
valid_direction_min3.666666666666661
No reset possible
83881046David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.0287551757877349
deviation-center-line_median0.12887127804655438
in-drivable-lane_median0


other stats
deviation-center-line_max1.3055452259467493
deviation-center-line_mean0.4128332733565342
deviation-center-line_min0.10470549043519804
deviation-heading_max1.560728089590664
deviation-heading_mean1.1499961285867597
deviation-heading_median1.235034329706992
deviation-heading_min0.5857141305205529
driven_any_max1.4013774339277096
driven_any_mean0.6023537546101042
driven_any_median0.11419433161375846
driven_any_min0.0777512932251633
driven_lanedir_max1.3258921453155008
driven_lanedir_mean0.5054427072427473
driven_lanedir_min-0.012587778975440056
in-drivable-lane_max1.8333333333333357
in-drivable-lane_mean0.36666666666666714
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.4013774339277096, "driven_lanedir": 1.1901609269596607, "in-drivable-lane": 1.8333333333333357, "deviation-heading": 1.2770458737264296, "deviation-center-line": 1.3055452259467493}, "ep001": {"driven_any": 0.0777512932251633, "driven_lanedir": -0.00500693287371945, "in-drivable-lane": 0, "deviation-heading": 1.0914582193891589, "deviation-center-line": 0.10470549043519804}, "ep002": {"driven_any": 0.11419433161375846, "driven_lanedir": 0.0287551757877349, "in-drivable-lane": 0, "deviation-heading": 1.235034329706992, "deviation-center-line": 0.12887127804655438}, "ep003": {"driven_any": 1.3270737341692072, "driven_lanedir": 1.3258921453155008, "in-drivable-lane": 0, "deviation-heading": 0.5857141305205529, "deviation-center-line": 0.4147726383645404}, "ep004": {"driven_any": 0.09137198011468232, "driven_lanedir": -0.012587778975440056, "in-drivable-lane": 0, "deviation-heading": 1.560728089590664, "deviation-center-line": 0.11027173398962888}}
No reset possible
83851045David AbrahamPytorch ILaido1_LF1_r3-v3step3-videosabortedyesrudolf-30:00:12
Error while running [...]

Creating job8385-248_videos_1 ... error
stderr | ERROR: for job8385-248_videos_1  Cannot start service videos: network job8385-248_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8385-248_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
83801046David AbrahamPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.500000000000001


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.09325168824731372, "good_angle": 0.18020738089029603, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep001": {"nsteps": 33, "reward": -30.98901853055665, "good_angle": 1.2657713331716582, "survival_time": 1.1, "traveled_tiles": 1, "valid_direction": 1.0333333333333332}, "ep002": {"nsteps": 45, "reward": -22.798829552200104, "good_angle": 1.2133847718007158, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 1.3000000000000014}, "ep003": {"nsteps": 500, "reward": 0.21674357235806385, "good_angle": 0.029752104799119085, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 43, "reward": -23.87344189854555, "good_angle": 2.080046900562485, "survival_time": 1.4333333333333345, "traveled_tiles": 1, "valid_direction": 1.2666666666666675}}
good_angle_max2.080046900562485
good_angle_mean0.9538324982448548
good_angle_median1.2133847718007158
good_angle_min0.029752104799119085
reward_max0.21674357235806385
reward_mean-15.470258944139385
reward_median-22.798829552200104
reward_min-30.98901853055665
survival_time_max16.666666666666654
survival_time_mean7.473333333333329
survival_time_min1.1
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.3000000000000014
valid_direction_mean0.7200000000000004
valid_direction_median1.0333333333333332
valid_direction_min0
No reset possible
83751046David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
83721044David AbrahamPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.833333333333315


other stats
episodes
details{"ep000": {"nsteps": 235, "reward": -4.062971331277228, "good_angle": 0.683882339362836, "survival_time": 7.833333333333315, "traveled_tiles": 4, "valid_direction": 0.7666666666666639}, "ep001": {"nsteps": 19, "reward": -53.207290230613005, "good_angle": 0.037655511704543704, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.06666666666666665}, "ep002": {"nsteps": 302, "reward": -3.895407359184395, "good_angle": 3.3392309434551373, "survival_time": 10.066666666666642, "traveled_tiles": 6, "valid_direction": 3.4999999999999876}, "ep003": {"nsteps": 435, "reward": -2.0974298458787257, "good_angle": 0.659590743648572, "survival_time": 14.49999999999996, "traveled_tiles": 7, "valid_direction": 0.7333333333333307}, "ep004": {"nsteps": 178, "reward": -6.137244381180572, "good_angle": 11.582440449413555, "survival_time": 5.933333333333322, "traveled_tiles": 4, "valid_direction": 2.166666666666659}}
good_angle_max11.582440449413555
good_angle_mean3.2605599975169284
good_angle_median0.683882339362836
good_angle_min0.037655511704543704
reward_max-2.0974298458787257
reward_mean-13.880068629626786
reward_median-4.062971331277228
reward_min-53.207290230613005
survival_time_max14.49999999999996
survival_time_mean7.7933333333333135
survival_time_min0.6333333333333333
traveled_tiles_max7
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max3.4999999999999876
valid_direction_mean1.4466666666666614
valid_direction_median0.7666666666666639
valid_direction_min0.06666666666666665
No reset possible
83641044David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
83581042Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step3-videosabortedyesrudolf-30:00:11
Error while running [...]

Creating job8358-8880_videos_1 ... error
stderr | ERROR: for job8358-8880_videos_1  Cannot start service videos: network job8358-8880_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8358-8880_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
83521042Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.6


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.6635833896398544, "good_angle": 59.10111581671121, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.13333333333332}, "ep001": {"nsteps": 14, "reward": -72.08509808140141, "good_angle": 0.32793213429047213, "survival_time": 0.4666666666666666, "traveled_tiles": 1, "valid_direction": 0.3666666666666666}, "ep002": {"nsteps": 18, "reward": -56.13111195961634, "good_angle": 0.5592134700687729, "survival_time": 0.6, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}, "ep003": {"nsteps": 28, "reward": -37.21505528422339, "good_angle": 0.9237378106184164, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.8333333333333331}, "ep004": {"nsteps": 17, "reward": -59.37879015067045, "good_angle": 0.4376820075900353, "survival_time": 0.5666666666666667, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}}
good_angle_max59.10111581671121
good_angle_mean12.26993624785578
good_angle_median0.5592134700687729
good_angle_min0.32793213429047213
reward_max-1.6635833896398544
reward_mean-45.29472777311029
reward_median-56.13111195961634
reward_min-72.08509808140141
survival_time_max16.666666666666654
survival_time_mean3.846666666666664
survival_time_min0.4666666666666666
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.13333333333332
valid_direction_mean3.4533333333333305
valid_direction_median0.49999999999999994
valid_direction_min0.3666666666666666
No reset possible
83441039Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1971371751644295
deviation-center-line_median0.3781389002902561
in-drivable-lane_median0.13333333333333286


other stats
deviation-center-line_max1.0028741930463625
deviation-center-line_mean0.4956787540651866
deviation-center-line_min0.33176024375139374
deviation-heading_max2.7840284680934433
deviation-heading_mean1.5796420827522142
deviation-heading_median1.565955575994314
deviation-heading_min0.2665744628931571
driven_any_max3.8077365560900622
driven_any_mean1.9287108915350435
driven_any_median1.2795956262289876
driven_any_min0.9100053137868086
driven_lanedir_max3.698532540818267
driven_lanedir_mean1.5399989077138194
driven_lanedir_min0.611415135950161
in-drivable-lane_max7.333333333333313
in-drivable-lane_mean1.7399999999999949
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.702056648963074, "driven_lanedir": 1.2869412570884318, "in-drivable-lane": 7.333333333333313, "deviation-heading": 1.1398424072777742, "deviation-center-line": 0.3781389002902561}, "ep001": {"driven_any": 0.9441603126062847, "driven_lanedir": 0.611415135950161, "in-drivable-lane": 1.233333333333329, "deviation-heading": 2.7840284680934433, "deviation-center-line": 0.40032011674789875}, "ep002": {"driven_any": 1.2795956262289876, "driven_lanedir": 1.1971371751644295, "in-drivable-lane": 0, "deviation-heading": 1.565955575994314, "deviation-center-line": 0.3653003164900218}, "ep003": {"driven_any": 3.8077365560900622, "driven_lanedir": 3.698532540818267, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.1418094995023815, "deviation-center-line": 1.0028741930463625}, "ep004": {"driven_any": 0.9100053137868086, "driven_lanedir": 0.9059684295478072, "in-drivable-lane": 0, "deviation-heading": 0.2665744628931571, "deviation-center-line": 0.33176024375139374}}
No reset possible
83401040Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortednorudolf-30:00:13
Error while running [...]

Creating job8340-5184_solution_1  ... error
stderr | ERROR: for job8340-5184_solution_1  Cannot start service solution: network job8340-5184_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8340-5184_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8340-5184_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
83371038Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.13806526205428948
deviation-center-line_median0.102009000895267
in-drivable-lane_median0


other stats
deviation-center-line_max0.3628429863650274
deviation-center-line_mean0.1469315378158457
deviation-center-line_min0.06440998989810495
deviation-heading_max2.610674736500284
deviation-heading_mean0.8993390544048525
deviation-heading_median0.4974425787034586
deviation-heading_min0.3916093126081396
driven_any_max2.074558617600871
driven_any_mean0.5391343537461835
driven_any_median0.19255580990632737
driven_any_min0.052784877179512885
driven_lanedir_max0.1797688277475031
driven_lanedir_mean0.12055276914839869
driven_lanedir_min0.039230050910547654
in-drivable-lane_max14.466666666666637
in-drivable-lane_mean2.979999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.074558617600871, "driven_lanedir": 0.08456578465685204, "in-drivable-lane": 14.466666666666637, "deviation-heading": 2.610674736500284, "deviation-center-line": 0.3628429863650274}, "ep001": {"driven_any": 0.052784877179512885, "driven_lanedir": 0.039230050910547654, "in-drivable-lane": 0, "deviation-heading": 0.3916093126081396, "deviation-center-line": 0.06440998989810495}, "ep002": {"driven_any": 0.15528572315447434, "driven_lanedir": 0.13806526205428948, "in-drivable-lane": 0, "deviation-heading": 0.4974425787034586, "deviation-center-line": 0.102009000895267}, "ep003": {"driven_any": 0.22048674088973164, "driven_lanedir": 0.16113392037280105, "in-drivable-lane": 0.4333333333333347, "deviation-heading": 0.545639049940578, "deviation-center-line": 0.07069787421195953}, "ep004": {"driven_any": 0.19255580990632737, "driven_lanedir": 0.1797688277475031, "in-drivable-lane": 0, "deviation-heading": 0.4513295942718027, "deviation-center-line": 0.13469783770886962}}
No reset possible
83231036Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednorudolf-30:04:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
83161034Samuel LavoieYoung Dukeaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.8341183952516875
deviation-center-line_median0.1358348793072531
in-drivable-lane_median0.8333333333333304


other stats
deviation-center-line_max0.6382228311645498
deviation-center-line_mean0.2245195044722196
deviation-center-line_min0
deviation-heading_max1.9602035414083736
deviation-heading_mean0.7779025626180096
deviation-heading_median0.26837434244431935
deviation-heading_min0
driven_any_max4.013385758739609
driven_any_mean1.5186964751910996
driven_any_median1.0537632787052789
driven_any_min0.5266524301703258
driven_lanedir_max2.6815313575984794
driven_lanedir_mean1.0169025785818993
driven_lanedir_min0
in-drivable-lane_max2.7333333333333236
in-drivable-lane_mean1.1133333333333313
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6130818994328824, "driven_lanedir": 0, "in-drivable-lane": 2.0000000000000027, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.5266524301703258, "driven_lanedir": 0.5218129970084366, "in-drivable-lane": 0, "deviation-heading": 0.16141368104811712, "deviation-center-line": 0.1214156436616722}, "ep002": {"driven_any": 1.386599008907402, "driven_lanedir": 0.8341183952516875, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 1.4995212481892382, "deviation-center-line": 0.227124168227623}, "ep003": {"driven_any": 4.013385758739609, "driven_lanedir": 2.6815313575984794, "in-drivable-lane": 2.7333333333333236, "deviation-heading": 1.9602035414083736, "deviation-center-line": 0.6382228311645498}, "ep004": {"driven_any": 1.0537632787052789, "driven_lanedir": 1.047050143050892, "in-drivable-lane": 0, "deviation-heading": 0.26837434244431935, "deviation-center-line": 0.1358348793072531}}
No reset possible
83001033Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednorudolf-30:05:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82971031Laurent MandrileTensorflow templateaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 86, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 29, in solve
    from model import TensorflowModel
  File "/workspace/model.py", line 55
    return vels
SyntaxError: 'return' outside function


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82821027Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:07:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
82731025Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-30:06:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 89, in solve
    observation, reward, done, info = env.step(action)
  File "/workspace/wrappers.py", line 252, in step
    return self.step_wait()
  File "/workspace/wrappers.py", line 271, in step_wait
    results = [env.step(a) for (a,env) in zip(self.actions, self.envs)]
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82701024Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-30:05:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 89, in solve
    observation, reward, done, info = env.step(action)
  File "/workspace/wrappers.py", line 252, in step
    return self.step_wait()
  File "/workspace/wrappers.py", line 271, in step_wait
    results = [env.step(a) for (a,env) in zip(self.actions, self.envs)]
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82671023Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationabortednorudolf-30:00:15
Error while running [...]

Creating job8267-5782_evaluator_1 ... error
stderr | ERROR: for job8267-5782_evaluator_1  Cannot start service evaluator: network job8267-5782_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8267-5782_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8267-5782_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82571018Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 285, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
NameError: name 'os' is not defined

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 285, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
NameError: name 'os' is not defined


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82561017Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-30:02:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    num_stack=1)
  File "/workspace/model.py", line 239, in __init__
    self._obs_shape = (obs_shape[0] * args.num_stack, *obs_shape[1:])
NameError: name 'args' is not defined

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    num_stack=1)
  File "/workspace/model.py", line 239, in __init__
    self._obs_shape = (obs_shape[0] * args.num_stack, *obs_shape[1:])
NameError: name 'args' is not defined


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82511016Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0420704966136085
deviation-center-line_median0.450762725966435
in-drivable-lane_median1.4333333333333282


other stats
deviation-center-line_max0.6883340509228337
deviation-center-line_mean0.4338478802433427
deviation-center-line_min0.20320804757303057
deviation-heading_max2.472742851242546
deviation-heading_mean1.6272956424260854
deviation-heading_median1.779711963877342
deviation-heading_min0.3847169219113941
driven_any_max3.3232179923540857
driven_any_mean1.4969973296695418
driven_any_median1.434880110160263
driven_any_min0.3975416116703704
driven_lanedir_max2.9516039212976346
driven_lanedir_mean1.1778170860958144
driven_lanedir_min0.19414959063454773
in-drivable-lane_max2.633333333333325
in-drivable-lane_mean1.3266666666666622
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3975416116703704, "driven_lanedir": 0.19414959063454773, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 1.938830071623383, "deviation-center-line": 0.20320804757303057}, "ep001": {"driven_any": 0.5652526814066909, "driven_lanedir": 0.5544790059832945, "in-drivable-lane": 0, "deviation-heading": 0.3847169219113941, "deviation-center-line": 0.3704325753311614}, "ep002": {"driven_any": 1.434880110160263, "driven_lanedir": 1.0420704966136085, "in-drivable-lane": 1.4333333333333282, "deviation-heading": 2.472742851242546, "deviation-center-line": 0.450762725966435}, "ep003": {"driven_any": 3.3232179923540857, "driven_lanedir": 2.9516039212976346, "in-drivable-lane": 2.199999999999992, "deviation-heading": 1.5604764034757617, "deviation-center-line": 0.6883340509228337}, "ep004": {"driven_any": 1.7640942527562995, "driven_lanedir": 1.1467824159499866, "in-drivable-lane": 2.633333333333325, "deviation-heading": 1.779711963877342, "deviation-center-line": 0.456502001423253}}
No reset possible
82481016Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
82411016Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.533333333333316


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -13.416412785493058, "good_angle": 0.9723576108709706, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.333333333333334}, "ep001": {"nsteps": 108, "reward": -9.848042460503402, "good_angle": 2.041641545621004, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5666666666666647}, "ep002": {"nsteps": 226, "reward": -4.574839447271614, "good_angle": 1.5760425170941503, "survival_time": 7.533333333333316, "traveled_tiles": 5, "valid_direction": 2.5999999999999908}, "ep003": {"nsteps": 500, "reward": -0.13448444758018013, "good_angle": 0.6536031283623902, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 2.06666666666666}, "ep004": {"nsteps": 282, "reward": -4.769903202343019, "good_angle": 16.060156931528677, "survival_time": 9.399999999999975, "traveled_tiles": 3, "valid_direction": 4.166666666666653}}
good_angle_max16.060156931528677
good_angle_mean4.260760346695439
good_angle_median1.5760425170941503
good_angle_min0.6536031283623902
reward_max-0.13448444758018013
reward_mean-6.548736468638255
reward_median-4.769903202343019
reward_min-13.416412785493058
survival_time_max16.666666666666654
survival_time_mean7.946666666666656
survival_time_min2.533333333333334
traveled_tiles_max6
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.166666666666653
valid_direction_mean2.3466666666666605
valid_direction_median2.333333333333334
valid_direction_min0.5666666666666647
No reset possible
82251015David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.08394985266846833
deviation-center-line_median0.0778449551053503
in-drivable-lane_median0


other stats
deviation-center-line_max0.16898661366894904
deviation-center-line_mean0.10439867905289547
deviation-center-line_min0.07248195277312836
deviation-heading_max1.7253708370840477
deviation-heading_mean0.7875510991650424
deviation-heading_median0.5037614413554353
deviation-heading_min0.4630156498742613
driven_any_max0.7513848549189196
driven_any_mean0.2360831876768089
driven_any_median0.10707211462789996
driven_any_min0.0994549271256484
driven_lanedir_max0.18517716028379183
driven_lanedir_mean0.10393327662038757
driven_lanedir_min0.07534926778880213
in-drivable-lane_max3.1999999999999984
in-drivable-lane_mean0.6399999999999997
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7513848549189196, "driven_lanedir": 0.18517716028379183, "in-drivable-lane": 3.1999999999999984, "deviation-heading": 1.7253708370840477, "deviation-center-line": 0.16898661366894904}, "ep001": {"driven_any": 0.10707211462789996, "driven_lanedir": 0.09269693187246995, "in-drivable-lane": 0, "deviation-heading": 0.5037614413554353, "deviation-center-line": 0.1279065617281198}, "ep002": {"driven_any": 0.0994549271256484, "driven_lanedir": 0.07534926778880213, "in-drivable-lane": 0, "deviation-heading": 0.4951494830918272, "deviation-center-line": 0.07248195277312836}, "ep003": {"driven_any": 0.11762045880819127, "driven_lanedir": 0.08249317048840554, "in-drivable-lane": 0, "deviation-heading": 0.7504580844196407, "deviation-center-line": 0.07477331198892995}, "ep004": {"driven_any": 0.1048835829033852, "driven_lanedir": 0.08394985266846833, "in-drivable-lane": 0, "deviation-heading": 0.4630156498742613, "deviation-center-line": 0.0778449551053503}}
No reset possible
82201015David AbrahamPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.0333333333333332


other stats
episodes
details{"ep000": {"nsteps": 155, "reward": -7.928455918022402, "good_angle": 17.758304816561402, "survival_time": 5.166666666666658, "traveled_tiles": 2, "valid_direction": 5.099999999999991}, "ep001": {"nsteps": 33, "reward": -30.971099093104858, "good_angle": 0.31413444773879146, "survival_time": 1.1, "traveled_tiles": 1, "valid_direction": 0.7333333333333334}, "ep002": {"nsteps": 24, "reward": -42.22066667675972, "good_angle": 0.4302781715543296, "survival_time": 0.7999999999999999, "traveled_tiles": 2, "valid_direction": 0.6333333333333332}, "ep003": {"nsteps": 31, "reward": -32.72767851429601, "good_angle": 0.7111464604092419, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0.8666666666666665}, "ep004": {"nsteps": 25, "reward": -40.55672740459442, "good_angle": 0.3797999025980012, "survival_time": 0.8333333333333333, "traveled_tiles": 1, "valid_direction": 0.5999999999999999}}
good_angle_max17.758304816561402
good_angle_mean3.918732759772354
good_angle_median0.4302781715543296
good_angle_min0.31413444773879146
reward_max-7.928455918022402
reward_mean-30.880925521355483
reward_median-32.72767851429601
reward_min-42.22066667675972
survival_time_max5.166666666666658
survival_time_mean1.7866666666666648
survival_time_min0.7999999999999999
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max5.099999999999991
valid_direction_mean1.586666666666665
valid_direction_median0.7333333333333334
valid_direction_min0.5999999999999999
No reset possible
82121013David AbrahamPytorch ILaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
82061012David AbrahamPytorch ILaido1_LF1_r3-v3step3-videosabortedyesrudolf-30:00:12
Error while running [...]

Creating job8206-6457_videos_1 ... error
stderr | ERROR: for job8206-6457_videos_1  Cannot start service videos: network job8206-6457_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8206-6457_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81991012David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
81871009Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 45, in solve
    env = DummyVecEnv([make_env(params)])
TypeError: make_env() takes 0 positional arguments but 1 was given

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 45, in solve
    env = DummyVecEnv([make_env(params)])
TypeError: make_env() takes 0 positional arguments but 1 was given


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81821008Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationabortednorudolf-30:00:13
Error while running [...]

Creating job8182-9143_evaluator_1 ... error
stderr | ERROR: for job8182-9143_evaluator_1  Cannot start service evaluator: network job8182-9143_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8182-9143_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8182-9143_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81751007Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 122, in run
    solve(params, cis)
  File "solution.py", line 43, in solve
    env = DummyVecEnv([env])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'ScaleObservations' object is not callable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 122, in run
    solve(params, cis)
  File "solution.py", line 43, in solve
    env = DummyVecEnv([env])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'ScaleObservations' object is not callable


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81721006Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-30:01:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 122, in run
    solve(params, cis)
  File "solution.py", line 42, in solve
    env = ScaleObservations(env)
  File "/workspace/wrappers.py", line 184, in __init__
    self.observation_space = Box(0.0, 1.0, obs_shape, dtype=np.float32)
NameError: name 'Box' is not defined

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 122, in run
    solve(params, cis)
  File "solution.py", line 42, in solve
    env = ScaleObservations(env)
  File "/workspace/wrappers.py", line 184, in __init__
    self.observation_space = Box(0.0, 1.0, obs_shape, dtype=np.float32)
NameError: name 'Box' is not defined


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81651004Laurent MandrileTensorflow templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
81631004Laurent MandrileTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.533333333333308


other stats
episodes
details{"ep000": {"nsteps": 244, "reward": -6.2869903129815565, "good_angle": 1.776589935962943, "survival_time": 8.133333333333315, "traveled_tiles": 4, "valid_direction": 2.6999999999999997}, "ep001": {"nsteps": 316, "reward": -5.700926186605297, "good_angle": 40.99984006033056, "survival_time": 10.533333333333308, "traveled_tiles": 3, "valid_direction": 7.099999999999983}, "ep002": {"nsteps": 500, "reward": -2.864125187820755, "good_angle": 41.203790317142946, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 7.699999999999982}, "ep003": {"nsteps": 138, "reward": -9.236848439602856, "good_angle": 1.853637092777763, "survival_time": 4.599999999999993, "traveled_tiles": 2, "valid_direction": 2.5}, "ep004": {"nsteps": 316, "reward": -4.6504965261512, "good_angle": 1.752446115197312, "survival_time": 10.533333333333308, "traveled_tiles": 4, "valid_direction": 3.166666666666659}}
good_angle_max41.203790317142946
good_angle_mean17.517260704282304
good_angle_median1.853637092777763
good_angle_min1.752446115197312
reward_max-2.864125187820755
reward_mean-5.747877330632333
reward_median-5.700926186605297
reward_min-9.236848439602856
survival_time_max16.666666666666654
survival_time_mean10.093333333333314
survival_time_min4.599999999999993
traveled_tiles_max6
traveled_tiles_mean3.8
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max7.699999999999982
valid_direction_mean4.633333333333324
valid_direction_median3.166666666666659
valid_direction_min2.5
No reset possible
81511002Laurent MandrileTensorflow templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
81411001Ruixiang Zhang 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81371000Ruixiang Zhang 🇨🇦stay simpleaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.2171028180718422, "good_angle": 48.97482659061072, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.999999999999991}, "ep001": {"nsteps": 500, "reward": -1.6295727347135545, "good_angle": 12.537820502688945, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.366666666666664}, "ep002": {"nsteps": 500, "reward": -1.448073302745819, "good_angle": 12.631829880438866, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.566666666666665}, "ep003": {"nsteps": 500, "reward": -1.2542260830253362, "good_angle": 12.6059242905706, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.499999999999998}, "ep004": {"nsteps": 500, "reward": -1.4929706085324288, "good_angle": 12.700758660733726, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.666666666666664}}
good_angle_max48.97482659061072
good_angle_mean19.890231985008572
good_angle_median12.631829880438866
good_angle_min12.537820502688945
reward_max-1.2171028180718422
reward_mean-1.408389109417796
reward_median-1.448073302745819
reward_min-1.6295727347135545
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.999999999999991
valid_direction_mean12.82
valid_direction_median12.566666666666665
valid_direction_min12.366666666666664
No reset possible
8129997Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.475756387262958
deviation-center-line_median0.49560335850959286
in-drivable-lane_median0.4999999999999982


other stats
deviation-center-line_max0.6065490419207544
deviation-center-line_mean0.4244847081266988
deviation-center-line_min0.14133001541463242
deviation-heading_max2.0975060124105807
deviation-heading_mean1.3631473642597385
deviation-heading_median1.3679922168602072
deviation-heading_min0.489578171429585
driven_any_max4.919781794687056
driven_any_mean3.5985282374288516
driven_any_median3.7340983940482646
driven_any_min1.7385862129427283
driven_lanedir_max4.139898140690089
driven_lanedir_mean3.043896426628955
driven_lanedir_min1.3724302605954322
in-drivable-lane_max1.0666666666666638
in-drivable-lane_mean0.6666666666666645
in-drivable-lane_min0.2666666666666657
per-episodes
details{"ep000": {"driven_any": 4.454081912764259, "driven_lanedir": 3.5609636276616254, "in-drivable-lane": 1.066666666666663, "deviation-heading": 2.0975060124105807, "deviation-center-line": 0.49560335850959286}, "ep001": {"driven_any": 3.1460928727019506, "driven_lanedir": 2.6704337169346704, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.187324127325582, "deviation-center-line": 0.36788207121595706}, "ep002": {"driven_any": 3.7340983940482646, "driven_lanedir": 3.475756387262958, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.3679922168602072, "deviation-center-line": 0.5110590535725572}, "ep003": {"driven_any": 4.919781794687056, "driven_lanedir": 4.139898140690089, "in-drivable-lane": 1.0666666666666638, "deviation-heading": 1.6733362932727374, "deviation-center-line": 0.6065490419207544}, "ep004": {"driven_any": 1.7385862129427283, "driven_lanedir": 1.3724302605954322, "in-drivable-lane": 0.4333333333333318, "deviation-heading": 0.489578171429585, "deviation-center-line": 0.14133001541463242}}
No reset possible
8122997Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.033333333333318


other stats
episodes
details{"ep000": {"nsteps": 239, "reward": -4.242474540087071, "good_angle": 0.7376290935237234, "survival_time": 7.966666666666648, "traveled_tiles": 9, "valid_direction": 2.033333333333327}, "ep001": {"nsteps": 182, "reward": -6.025205468514916, "good_angle": 14.05828564655136, "survival_time": 6.066666666666655, "traveled_tiles": 6, "valid_direction": 3.133333333333328}, "ep002": {"nsteps": 211, "reward": -5.041387968665757, "good_angle": 0.40104802004664575, "survival_time": 7.033333333333318, "traveled_tiles": 7, "valid_direction": 1.0666666666666629}, "ep003": {"nsteps": 247, "reward": -4.259314230150215, "good_angle": 1.126885887792093, "survival_time": 8.233333333333315, "traveled_tiles": 9, "valid_direction": 1.799999999999995}, "ep004": {"nsteps": 86, "reward": -12.251422303685445, "good_angle": 6.0966390643710415, "survival_time": 2.8666666666666663, "traveled_tiles": 4, "valid_direction": 1.2333333333333312}}
good_angle_max14.05828564655136
good_angle_mean4.484097542456974
good_angle_median1.126885887792093
good_angle_min0.40104802004664575
reward_max-4.242474540087071
reward_mean-6.363960902220681
reward_median-5.041387968665757
reward_min-12.251422303685445
survival_time_max8.233333333333315
survival_time_mean6.43333333333332
survival_time_min2.8666666666666663
traveled_tiles_max9
traveled_tiles_mean7
traveled_tiles_median7
traveled_tiles_min4
valid_direction_max3.133333333333328
valid_direction_mean1.8533333333333288
valid_direction_median1.799999999999995
valid_direction_min1.0666666666666629
No reset possible
8119996Laurent MandrileTensorflow templateaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 86, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 29, in solve
    from model import TfInference
  File "/workspace/model.py", line 3, in <module>
    import cv2
  File "/usr/local/lib/python2.7/dist-packages/cv2/__init__.py", line 3, in <module>
    from .cv2 import *
ImportError: libSM.so.6: cannot open shared object file: No such file or directory


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8110993Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.018178118009569
deviation-center-line_median1.965294419475176
in-drivable-lane_median3.3333333333333215


other stats
deviation-center-line_max2.5142959541530927
deviation-center-line_mean1.921574347693932
deviation-center-line_min1.179912219027208
deviation-heading_max2.113493649906563
deviation-heading_mean1.4029373450137657
deviation-heading_median1.5650509357643805
deviation-heading_min0.7646317340288142
driven_any_max6.347814373442964
driven_any_mean6.300181880076241
driven_any_median6.28249514506833
driven_any_min6.252555601809628
driven_lanedir_max5.624356289833099
driven_lanedir_mean4.701019617389227
driven_lanedir_min3.718552525972793
in-drivable-lane_max6.866666666666645
in-drivable-lane_mean4.133333333333321
in-drivable-lane_min1.6333333333333275
per-episodes
details{"ep000": {"driven_any": 6.278256029765172, "driven_lanedir": 3.7387916547240905, "in-drivable-lane": 6.866666666666645, "deviation-heading": 0.7646317340288142, "deviation-center-line": 1.965294419475176}, "ep001": {"driven_any": 6.252555601809628, "driven_lanedir": 3.718552525972793, "in-drivable-lane": 6.833333333333319, "deviation-heading": 0.9646217044708942, "deviation-center-line": 1.902382838906595}, "ep002": {"driven_any": 6.3397882502951095, "driven_lanedir": 5.018178118009569, "in-drivable-lane": 3.3333333333333215, "deviation-heading": 1.5650509357643805, "deviation-center-line": 2.045986306907588}, "ep003": {"driven_any": 6.28249514506833, "driven_lanedir": 5.405219498406585, "in-drivable-lane": 1.999999999999993, "deviation-heading": 2.113493649906563, "deviation-center-line": 1.179912219027208}, "ep004": {"driven_any": 6.347814373442964, "driven_lanedir": 5.624356289833099, "in-drivable-lane": 1.6333333333333275, "deviation-heading": 1.6068887008981765, "deviation-center-line": 2.5142959541530927}}
No reset possible
8102993Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8097993Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.732358459893614, "good_angle": 0.7240931219756537, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.06666666666666}, "ep001": {"nsteps": 500, "reward": -0.8166965480893851, "good_angle": 4.595518930008325, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.633333333333332}, "ep002": {"nsteps": 500, "reward": -0.5397966891722754, "good_angle": 0.6194322536008012, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 1.6333333333333275}, "ep003": {"nsteps": 500, "reward": -0.31135352698806673, "good_angle": 0.5891132255178639, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 1.4666666666666617}, "ep004": {"nsteps": 500, "reward": -0.5582869492536411, "good_angle": 24.80906323546956, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.333333333333359}}
good_angle_max24.80906323546956
good_angle_mean6.267444153314441
good_angle_median0.7240931219756537
good_angle_min0.5891132255178639
reward_max-0.31135352698806673
reward_mean-0.5916984346793965
reward_median-0.5582869492536411
reward_min-0.8166965480893851
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max13
traveled_tiles_mean11.6
traveled_tiles_median12
traveled_tiles_min10
valid_direction_max3.333333333333359
valid_direction_mean2.026666666666668
valid_direction_median1.633333333333332
valid_direction_min1.4666666666666617
No reset possible
8077991Manfred DiazTensorflow templateaido1_LF1_r3-v3step3-videosabortedyesrudolf-30:00:12
Error while running [...]

Creating job8077-2145_videos_1 ... error
stderr | ERROR: for job8077-2145_videos_1  Cannot start service videos: network job8077-2145_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8077-2145_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8070989Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5431600785318297, "good_angle": 0.9067805821867386, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.9333333333333265}, "ep001": {"nsteps": 500, "reward": -0.616796643519774, "good_angle": 31.053615074944535, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.866666666666654}, "ep002": {"nsteps": 500, "reward": -0.6115267089046538, "good_angle": 0.82679593498224, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.2333333333333254}, "ep003": {"nsteps": 500, "reward": -0.3262829188723117, "good_angle": 0.811202341751506, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.0666666666666593}, "ep004": {"nsteps": 500, "reward": -0.5283348486777395, "good_angle": 22.3351322728827, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.2333333333333583}}
good_angle_max31.053615074944535
good_angle_mean11.186705241349545
good_angle_median0.9067805821867386
good_angle_min0.811202341751506
reward_max-0.3262829188723117
reward_mean-0.5252202397012617
reward_median-0.5431600785318297
reward_min-0.616796643519774
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max13
traveled_tiles_mean12.2
traveled_tiles_median12
traveled_tiles_min11
valid_direction_max4.866666666666654
valid_direction_mean2.866666666666665
valid_direction_median2.2333333333333254
valid_direction_min1.9333333333333265
No reset possible
8063988Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.933333333333315


other stats
episodes
details{"ep000": {"nsteps": 135, "reward": -7.811137713613506, "good_angle": 1.054362292114864, "survival_time": 4.499999999999994, "traveled_tiles": 3, "valid_direction": 1.5666666666666624}, "ep001": {"nsteps": 238, "reward": -4.649118053036187, "good_angle": 14.600517222387271, "survival_time": 7.933333333333315, "traveled_tiles": 6, "valid_direction": 3.599999999999992}, "ep002": {"nsteps": 500, "reward": -0.07094690808211453, "good_angle": 1.1407597136128242, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.766666666666667}, "ep003": {"nsteps": 77, "reward": -13.622681488784924, "good_angle": 1.054481050152695, "survival_time": 2.5666666666666673, "traveled_tiles": 2, "valid_direction": 1.2666666666666662}, "ep004": {"nsteps": 500, "reward": -0.18726079167518764, "good_angle": 9.461565170109742, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.5999999999999908}}
good_angle_max14.600517222387271
good_angle_mean5.462337089675479
good_angle_median1.1407597136128242
good_angle_min1.054362292114864
reward_max-0.07094690808211453
reward_mean-5.268228991038383
reward_median-4.649118053036187
reward_min-13.622681488784924
survival_time_max16.666666666666654
survival_time_mean9.666666666666655
survival_time_min2.5666666666666673
traveled_tiles_max12
traveled_tiles_mean6.2
traveled_tiles_median6
traveled_tiles_min2
valid_direction_max3.599999999999992
valid_direction_mean2.5599999999999956
valid_direction_median2.766666666666667
valid_direction_min1.2666666666666662
No reset possible
8050986Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:07:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8048985Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8044985Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.333333333333317


other stats
episodes
details{"ep000": {"nsteps": 91, "reward": -11.150584790064086, "good_angle": 0.1407140490017567, "survival_time": 3.0333333333333323, "traveled_tiles": 3, "valid_direction": 0.30000000000000004}, "ep001": {"nsteps": 243, "reward": -4.586310418257049, "good_angle": 15.139074582275237, "survival_time": 8.099999999999982, "traveled_tiles": 6, "valid_direction": 3.1666666666666607}, "ep002": {"nsteps": 333, "reward": -3.1747410535463567, "good_angle": 0.8234156515103922, "survival_time": 11.099999999999971, "traveled_tiles": 8, "valid_direction": 2.399999999999996}, "ep003": {"nsteps": 220, "reward": -4.907579297724773, "good_angle": 0.12808957681956995, "survival_time": 7.333333333333317, "traveled_tiles": 5, "valid_direction": 0.09999999999999964}, "ep004": {"nsteps": 206, "reward": -5.029392477991263, "good_angle": 8.353891473535883, "survival_time": 6.866666666666652, "traveled_tiles": 5, "valid_direction": 1.1999999999999955}}
good_angle_max15.139074582275237
good_angle_mean4.917037066628568
good_angle_median0.8234156515103922
good_angle_min0.12808957681956995
reward_max-3.1747410535463567
reward_mean-5.769721607516705
reward_median-4.907579297724773
reward_min-11.150584790064086
survival_time_max11.099999999999971
survival_time_mean7.28666666666665
survival_time_min3.0333333333333323
traveled_tiles_max8
traveled_tiles_mean5.4
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max3.1666666666666607
valid_direction_mean1.4333333333333305
valid_direction_median1.1999999999999955
valid_direction_min0.09999999999999964
No reset possible
8038984Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.024886501224279
deviation-center-line_median1.8043977172023455
in-drivable-lane_median7.066666666666678


other stats
deviation-center-line_max1.9308261644361475
deviation-center-line_mean1.6018991034393832
deviation-center-line_min1.1671966428533498
deviation-heading_max2.2649005296651534
deviation-heading_mean1.8983809318604443
deviation-heading_median2.1466095478076372
deviation-heading_min0.9571005554953588
driven_any_max3.5573201908868275
driven_any_mean3.5416338490366632
driven_any_median3.5558386258484695
driven_any_min3.4895233229730733
driven_lanedir_max2.345636374824788
driven_lanedir_mean2.0195802424136806
driven_lanedir_min1.6447698293293558
in-drivable-lane_max8.299999999999972
in-drivable-lane_mean6.819999999999993
in-drivable-lane_min5.40000000000002
per-episodes
details{"ep000": {"driven_any": 3.5572611657489728, "driven_lanedir": 2.345636374824788, "in-drivable-lane": 5.40000000000002, "deviation-heading": 1.967512636740114, "deviation-center-line": 1.9308261644361475}, "ep001": {"driven_any": 3.5482259397259757, "driven_lanedir": 1.8160964651132705, "in-drivable-lane": 7.6666666666666465, "deviation-heading": 2.155781389593958, "deviation-center-line": 1.2721241838262272}, "ep002": {"driven_any": 3.5558386258484695, "driven_lanedir": 2.266512041576709, "in-drivable-lane": 5.6666666666666465, "deviation-heading": 2.1466095478076372, "deviation-center-line": 1.8043977172023455}, "ep003": {"driven_any": 3.5573201908868275, "driven_lanedir": 2.024886501224279, "in-drivable-lane": 7.066666666666678, "deviation-heading": 0.9571005554953588, "deviation-center-line": 1.834950808878846}, "ep004": {"driven_any": 3.4895233229730733, "driven_lanedir": 1.6447698293293558, "in-drivable-lane": 8.299999999999972, "deviation-heading": 2.2649005296651534, "deviation-center-line": 1.1671966428533498}}
No reset possible
8035984Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5933083943328821, "good_angle": 1.3142779938637892, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.766666666666655}, "ep001": {"nsteps": 500, "reward": -0.6878863608606626, "good_angle": 9.96153965201236, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 3.8333333333333233}, "ep002": {"nsteps": 500, "reward": -0.6394640733152628, "good_angle": 1.455422230306047, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.9666666666666552}, "ep003": {"nsteps": 500, "reward": -0.7588395650137681, "good_angle": 0.7369878185864341, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 2.133333333333352}, "ep004": {"nsteps": 500, "reward": -0.722406002654694, "good_angle": 9.152423372860108, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 5.36666666666669}}
good_angle_max9.96153965201236
good_angle_mean4.524130213525747
good_angle_median1.455422230306047
good_angle_min0.7369878185864341
reward_max-0.5933083943328821
reward_mean-0.680380879235454
reward_median-0.6878863608606626
reward_min-0.7588395650137681
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max8
traveled_tiles_mean7
traveled_tiles_median7
traveled_tiles_min6
valid_direction_max5.36666666666669
valid_direction_mean3.8133333333333352
valid_direction_median3.8333333333333233
valid_direction_min2.133333333333352
No reset possible
8031983Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8666666666666623


other stats
episodes
details{"ep000": {"nsteps": 116, "reward": -8.89257429624182, "good_angle": 0.1330432528398118, "survival_time": 3.8666666666666623, "traveled_tiles": 3, "valid_direction": 0.2333333333333333}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 329, "reward": -3.31293563591741, "good_angle": 0.3681829161344062, "survival_time": 10.966666666666638, "traveled_tiles": 8, "valid_direction": 0.466666666666665}, "ep003": {"nsteps": 56, "reward": -18.23833635702197, "good_angle": 0.02139515126107087, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.2012757088522776, "good_angle": 8.827879681561576, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.533333333333321}}
good_angle_max8.827879681561576
good_angle_mean1.87092495922388
good_angle_median0.1330432528398118
good_angle_min0.004123794322536422
reward_max-0.2012757088522776
reward_mean-13.383108281666065
reward_median-8.89257429624182
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean6.8599999999999905
survival_time_min0.9333333333333332
traveled_tiles_max8
traveled_tiles_mean4.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.533333333333321
valid_direction_mean0.8466666666666638
valid_direction_median0.2333333333333333
valid_direction_min0
No reset possible
8021982Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8008980Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7999977Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8000000000000025


other stats
episodes
details{"ep000": {"nsteps": 54, "reward": -18.739795033500908, "good_angle": 0.17111099844596908, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 0.6666666666666665}, "ep001": {"nsteps": 23, "reward": -44.04389274120331, "good_angle": 0.007825117906309196, "survival_time": 0.7666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 31, "reward": -32.69075833405218, "good_angle": 0.013064824326917994, "survival_time": 1.0333333333333332, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 169, "reward": -6.273822177544556, "good_angle": 0.4380316878030926, "survival_time": 5.633333333333323, "traveled_tiles": 4, "valid_direction": 1.2999999999999965}, "ep004": {"nsteps": 70, "reward": -14.708262841722794, "good_angle": 1.2340384580676431, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.7000000000000015}}
good_angle_max1.2340384580676431
good_angle_mean0.3728142173099864
good_angle_median0.17111099844596908
good_angle_min0.007825117906309196
reward_max-6.273822177544556
reward_mean-23.29130622560475
reward_median-18.739795033500908
reward_min-44.04389274120331
survival_time_max5.633333333333323
survival_time_mean2.3133333333333317
survival_time_min0.7666666666666666
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.7000000000000015
valid_direction_mean0.7333333333333328
valid_direction_median0.6666666666666665
valid_direction_min0
No reset possible
7996977Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7991976Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.5472678870867416
deviation-center-line_median0.3359071713314118
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.46773144496088725
deviation-center-line_mean0.32517829066895737
deviation-center-line_min0.16866482502596974
deviation-heading_max1.6293053285312915
deviation-heading_mean1.0663511152258056
deviation-heading_median1.0755561144898615
deviation-heading_min0.4078274737159362
driven_any_max1.9999452675796772
driven_any_mean1.589298862446067
driven_any_median1.6232923958510668
driven_any_min1.0166496092576491
driven_lanedir_max1.7724508685709552
driven_lanedir_mean1.432386566731796
driven_lanedir_min0.8551238051906974
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.18666666666666615
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0166496092576491, "driven_lanedir": 0.8551238051906974, "in-drivable-lane": 0.2666666666666666, "deviation-heading": 0.616923463458322, "deviation-center-line": 0.2349479397681263}, "ep001": {"driven_any": 1.9999452675796772, "driven_lanedir": 1.685268598805122, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.6021431959336172, "deviation-center-line": 0.4186400722583914}, "ep002": {"driven_any": 1.3216422669515713, "driven_lanedir": 1.301821674005465, "in-drivable-lane": 0, "deviation-heading": 0.4078274737159362, "deviation-center-line": 0.16866482502596974}, "ep003": {"driven_any": 1.6232923958510668, "driven_lanedir": 1.5472678870867416, "in-drivable-lane": 0, "deviation-heading": 1.0755561144898615, "deviation-center-line": 0.46773144496088725}, "ep004": {"driven_any": 1.984964772590372, "driven_lanedir": 1.7724508685709552, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.6293053285312915, "deviation-center-line": 0.3359071713314118}}
No reset possible
7986976Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.533333333333327


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -12.52588034088996, "good_angle": 0.17952429330929992, "survival_time": 2.7333333333333334, "traveled_tiles": 3, "valid_direction": 0.6666666666666665}, "ep001": {"nsteps": 172, "reward": -6.511317504494083, "good_angle": 5.578101579727321, "survival_time": 5.733333333333323, "traveled_tiles": 3, "valid_direction": 1.7666666666666644}, "ep002": {"nsteps": 107, "reward": -9.778149597277151, "good_angle": 0.03286934148681326, "survival_time": 3.566666666666664, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 136, "reward": -7.620555359009065, "good_angle": 0.4826043130813186, "survival_time": 4.533333333333327, "traveled_tiles": 3, "valid_direction": 1.1333333333333313}, "ep004": {"nsteps": 162, "reward": -6.687916881631899, "good_angle": 5.260282393500154, "survival_time": 5.399999999999991, "traveled_tiles": 3, "valid_direction": 2.5333333333333243}}
good_angle_max5.578101579727321
good_angle_mean2.306676384220981
good_angle_median0.4826043130813186
good_angle_min0.03286934148681326
reward_max-6.511317504494083
reward_mean-8.624763936660433
reward_median-7.620555359009065
reward_min-12.52588034088996
survival_time_max5.733333333333323
survival_time_mean4.393333333333328
survival_time_min2.7333333333333334
traveled_tiles_max3
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max2.5333333333333243
valid_direction_mean1.2199999999999973
valid_direction_median1.1333333333333313
valid_direction_min0
No reset possible
7971974Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6265215747606048
deviation-center-line_median0.607494048957489
in-drivable-lane_median0


other stats
deviation-center-line_max0.6495016046287412
deviation-center-line_mean0.5309295980722656
deviation-center-line_min0.33273595264346006
deviation-heading_max1.546889597996067
deviation-heading_mean0.6466674829044743
deviation-heading_median0.4233646963244864
deviation-heading_min0.2887009286973376
driven_any_max1.1250794556315609
driven_any_mean0.6536182871501773
driven_any_median0.6286179118526486
driven_any_min0.31430732071544254
driven_lanedir_max0.9001668163287937
driven_lanedir_mean0.6067702335617516
driven_lanedir_min0.31267344503052197
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1250794556315609, "driven_lanedir": 0.9001668163287937, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.546889597996067, "deviation-center-line": 0.6495016046287412}, "ep001": {"driven_any": 0.31430732071544254, "driven_lanedir": 0.31267344503052197, "in-drivable-lane": 0, "deviation-heading": 0.2887009286973376, "deviation-center-line": 0.33273595264346006}, "ep002": {"driven_any": 0.6286179118526486, "driven_lanedir": 0.6265215747606048, "in-drivable-lane": 0, "deviation-heading": 0.4233646963244864, "deviation-center-line": 0.607494048957489}, "ep003": {"driven_any": 0.7250534689028811, "driven_lanedir": 0.7214747889992279, "in-drivable-lane": 0, "deviation-heading": 0.5927178567152452, "deviation-center-line": 0.6202123184120287}, "ep004": {"driven_any": 0.4750332786483535, "driven_lanedir": 0.4730145426896099, "in-drivable-lane": 0, "deviation-heading": 0.38166433478923545, "deviation-center-line": 0.4447040657196087}}
No reset possible
7958973Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6505766153109622
deviation-center-line_median0.16014963851655162
in-drivable-lane_median0


other stats
deviation-center-line_max0.7603053620165483
deviation-center-line_mean0.2564637341640809
deviation-center-line_min0.09210699726460604
deviation-heading_max0.9642614812629324
deviation-heading_mean0.3996068763062016
deviation-heading_median0.1951626949882956
deviation-heading_min0.08068462255521815
driven_any_max2.9665349579780176
driven_any_mean1.03460971155806
driven_any_median0.6566328495709304
driven_any_min0.3366328495709288
driven_lanedir_max2.923355747095626
driven_lanedir_mean0.9885477295561832
driven_lanedir_min0.3321162244136633
in-drivable-lane_max0.3666666666666667
in-drivable-lane_mean0.07333333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8532550200589977, "driven_lanedir": 0.6787448401236269, "in-drivable-lane": 0.3666666666666667, "deviation-heading": 0.6046620566532065, "deviation-center-line": 0.1704259240979422}, "ep001": {"driven_any": 0.3599928806114263, "driven_lanedir": 0.3579452208370377, "in-drivable-lane": 0, "deviation-heading": 0.08068462255521815, "deviation-center-line": 0.09933074892475642}, "ep002": {"driven_any": 0.3366328495709288, "driven_lanedir": 0.3321162244136633, "in-drivable-lane": 0, "deviation-heading": 0.15326352607135502, "deviation-center-line": 0.09210699726460604}, "ep003": {"driven_any": 0.6566328495709304, "driven_lanedir": 0.6505766153109622, "in-drivable-lane": 0, "deviation-heading": 0.1951626949882956, "deviation-center-line": 0.16014963851655162}, "ep004": {"driven_any": 2.9665349579780176, "driven_lanedir": 2.923355747095626, "in-drivable-lane": 0, "deviation-heading": 0.9642614812629324, "deviation-center-line": 0.7603053620165483}}
No reset possible
7956973Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7952973Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7936969Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.48002489967466366
deviation-center-line_median0.44953434650307456
in-drivable-lane_median0


other stats
deviation-center-line_max0.6756217955980963
deviation-center-line_mean0.4833167647192167
deviation-center-line_min0.323985028575557
deviation-heading_max1.5605662884765823
deviation-heading_mean0.6458602657996781
deviation-heading_median0.4177354672861499
deviation-heading_min0.28266642664419916
driven_any_max1.1357953095799675
driven_any_mean0.6064721685498519
driven_any_median0.48217925094209535
driven_any_min0.3071639224382481
driven_lanedir_max0.9110541729309414
driven_lanedir_mean0.5595193937183736
driven_lanedir_min0.3055487827497947
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1357953095799675, "driven_lanedir": 0.9110541729309414, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.5605662884765823, "deviation-center-line": 0.6756217955980963}, "ep001": {"driven_any": 0.3071639224382481, "driven_lanedir": 0.3055487827497947, "in-drivable-lane": 0, "deviation-heading": 0.28266642664419916, "deviation-center-line": 0.323985028575557}, "ep002": {"driven_any": 0.48217925094209535, "driven_lanedir": 0.48002489967466366, "in-drivable-lane": 0, "deviation-heading": 0.3954137312242298, "deviation-center-line": 0.4473292486088852}, "ep003": {"driven_any": 0.6250467479521936, "driven_lanedir": 0.6212443458493215, "in-drivable-lane": 0, "deviation-heading": 0.5729194153672296, "deviation-center-line": 0.5201134043104702}, "ep004": {"driven_any": 0.4821756118367546, "driven_lanedir": 0.4797247673871461, "in-drivable-lane": 0, "deviation-heading": 0.4177354672861499, "deviation-center-line": 0.44953434650307456}}
No reset possible
7932969Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.56666666666666


other stats
episodes
details{"ep000": {"nsteps": 320, "reward": -3.381913361936313, "good_angle": 0.40924222842854624, "survival_time": 10.66666666666664, "traveled_tiles": 3, "valid_direction": 0.033333333333333215}, "ep001": {"nsteps": 88, "reward": -11.945536375045776, "good_angle": 0.03079516501183432, "survival_time": 2.9333333333333327, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 137, "reward": -7.804261677021528, "good_angle": 0.040477326450326694, "survival_time": 4.56666666666666, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 177, "reward": -6.0954075103341525, "good_angle": 0.07120488514549578, "survival_time": 5.899999999999989, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 137, "reward": -7.807459540610766, "good_angle": 0.04590786371962807, "survival_time": 4.56666666666666, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.40924222842854624
good_angle_mean0.1195254937511662
good_angle_median0.04590786371962807
good_angle_min0.03079516501183432
reward_max-3.381913361936313
reward_mean-7.406915692989708
reward_median-7.804261677021528
reward_min-11.945536375045776
survival_time_max10.66666666666664
survival_time_mean5.726666666666656
survival_time_min2.9333333333333327
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.033333333333333215
valid_direction_mean0.006666666666666643
valid_direction_median0
valid_direction_min0
No reset possible
7918962David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizabortedyesrudolf-30:00:12
Error while running [...]

Creating job7918-4796_visualization_1 ... error
stderr | ERROR: for job7918-4796_visualization_1  Cannot start service visualization: network job7918-4796_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7918-4796_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7913965Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.523110090355543
deviation-center-line_median0.4845094806933155
in-drivable-lane_median0


other stats
deviation-center-line_max0.6815008642183696
deviation-center-line_mean0.49996742671162686
deviation-center-line_min0.36269661692896626
deviation-heading_max1.5530983284955573
deviation-heading_mean0.6471315776332308
deviation-heading_median0.4004742234813052
deviation-heading_min0.32294155437192584
driven_any_max1.142936733603595
driven_any_mean0.6264727775847596
driven_any_median0.5250366567352842
driven_any_min0.3428779985523343
driven_lanedir_max0.9175821596661686
driven_lanedir_mean0.5794747945952479
driven_lanedir_min0.3409009799870435
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.142936733603595, "driven_lanedir": 0.9175821596661686, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.5530983284955573, "deviation-center-line": 0.6815008642183696}, "ep001": {"driven_any": 0.3428779985523343, "driven_lanedir": 0.3409009799870435, "in-drivable-lane": 0, "deviation-heading": 0.32294155437192584, "deviation-center-line": 0.36269661692896626}, "ep002": {"driven_any": 0.4928940676992426, "driven_lanedir": 0.49081375090330925, "in-drivable-lane": 0, "deviation-heading": 0.4004742234813052, "deviation-center-line": 0.45150014173355096}, "ep003": {"driven_any": 0.6286184313333419, "driven_lanedir": 0.6249669920641754, "in-drivable-lane": 0, "deviation-heading": 0.5723177448918395, "deviation-center-line": 0.5196300299839322}, "ep004": {"driven_any": 0.5250366567352842, "driven_lanedir": 0.523110090355543, "in-drivable-lane": 0, "deviation-heading": 0.3868260369255263, "deviation-center-line": 0.4845094806933155}}
No reset possible
7896964David AbrahamPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.433333333333317


other stats
episodes
details{"ep000": {"nsteps": 189, "reward": -5.522914407748936, "good_angle": 0.21676897568825448, "survival_time": 6.299999999999987, "traveled_tiles": 4, "valid_direction": 0.5999999999999994}, "ep001": {"nsteps": 108, "reward": -9.84552641486732, "good_angle": 5.314864534758055, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 2.266666666666663}, "ep002": {"nsteps": 223, "reward": -4.884434156034208, "good_angle": 3.954315274137616, "survival_time": 7.433333333333317, "traveled_tiles": 5, "valid_direction": 1.9333333333333265}, "ep003": {"nsteps": 336, "reward": -3.129161556486603, "good_angle": 0.18118114134753743, "survival_time": 11.19999999999997, "traveled_tiles": 7, "valid_direction": 0.36666666666666536}, "ep004": {"nsteps": 309, "reward": -3.449449091241017, "good_angle": 5.872544350805746, "survival_time": 10.299999999999974, "traveled_tiles": 4, "valid_direction": 1.999999999999993}}
good_angle_max5.872544350805746
good_angle_mean3.107934855347442
good_angle_median3.954315274137616
good_angle_min0.18118114134753743
reward_max-3.129161556486603
reward_mean-5.366297125275617
reward_median-4.884434156034208
reward_min-9.84552641486732
survival_time_max11.19999999999997
survival_time_mean7.766666666666649
survival_time_min3.599999999999997
traveled_tiles_max7
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max2.266666666666663
valid_direction_mean1.4333333333333296
valid_direction_median1.9333333333333265
valid_direction_min0.36666666666666536
No reset possible
7874961Benjamin Ramtoula 🇨🇦My ROS solution - param 3aido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7871959Benjamin Ramtoula 🇨🇦My ROS solution - param 1aido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7863957Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7859957Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -13.472630231287331, "good_angle": 0.5650858384191995, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 0.8666666666666656}, "ep001": {"nsteps": 86, "reward": -12.291817300541457, "good_angle": 3.096612917709483, "survival_time": 2.8666666666666663, "traveled_tiles": 2, "valid_direction": 0.3999999999999986}, "ep002": {"nsteps": 500, "reward": -0.2399373869235278, "good_angle": 0.7272814547114197, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 1.533333333333328}, "ep003": {"nsteps": 500, "reward": -0.3687578693628311, "good_angle": 0.11293968960795968, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.1858477357146476, "good_angle": 14.809956130802265, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.5999999999999908}}
good_angle_max14.809956130802265
good_angle_mean3.8623752062500656
good_angle_median0.7272814547114197
good_angle_min0.11293968960795968
reward_max-0.1858477357146476
reward_mean-5.311798104765959
reward_median-0.3687578693628311
reward_min-13.472630231287331
survival_time_max16.666666666666654
survival_time_mean11.073333333333329
survival_time_min2.500000000000001
traveled_tiles_max9
traveled_tiles_mean5.6
traveled_tiles_median7
traveled_tiles_min2
valid_direction_max2.5999999999999908
valid_direction_mean1.0799999999999963
valid_direction_median0.8666666666666656
valid_direction_min0
No reset possible
7844956Jason Chun Lok Li 🇭🇰PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.966810409963131, "good_angle": 47.08330822850749, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.233333333333322}, "ep001": {"nsteps": 500, "reward": -1.300191262960434, "good_angle": 13.8317262841996, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}, "ep002": {"nsteps": 500, "reward": -1.117795492440462, "good_angle": 13.808909540839275, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.9294596527849426, "good_angle": 13.819737231108473, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}, "ep004": {"nsteps": 500, "reward": -1.163820459574461, "good_angle": 13.824014957850544, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}}
good_angle_max47.08330822850749
good_angle_mean20.473539248501076
good_angle_median13.824014957850544
good_angle_min13.808909540839275
reward_max-0.9294596527849426
reward_mean-1.0956154555446862
reward_median-1.117795492440462
reward_min-1.300191262960434
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.233333333333322
valid_direction_mean13.266666666666657
valid_direction_median13.09999999999999
valid_direction_min12.933333333333326
No reset possible
7842956Jason Chun Lok Li 🇭🇰PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7839955Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7836955Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:05:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7834954Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5322997840560242
deviation-center-line_median0.25851915149849297
in-drivable-lane_median2.933333333333323


other stats
deviation-center-line_max0.42313942837894
deviation-center-line_mean0.283248635861003
deviation-center-line_min0.21538408702334091
deviation-heading_max2.4072546675648545
deviation-heading_mean1.3389815792954791
deviation-heading_median0.9615453863351658
deviation-heading_min0.2072455655983546
driven_any_max1.2614294421853502
driven_any_mean0.8593630302752873
driven_any_median1.1499887211452298
driven_any_min0.28341893175670346
driven_lanedir_max0.6706048105417823
driven_lanedir_mean0.4460695510497624
driven_lanedir_min0.11300065554320328
in-drivable-lane_max4.833333333333316
in-drivable-lane_mean2.3199999999999923
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3430509919227809, "driven_lanedir": 0.11300065554320328, "in-drivable-lane": 0.6, "deviation-heading": 2.205604921372015, "deviation-center-line": 0.21538408702334091}, "ep001": {"driven_any": 0.28341893175670346, "driven_lanedir": 0.28070421975728177, "in-drivable-lane": 0, "deviation-heading": 0.2072455655983546, "deviation-center-line": 0.22942876787662583}, "ep002": {"driven_any": 1.258927064366372, "driven_lanedir": 0.6706048105417823, "in-drivable-lane": 2.933333333333323, "deviation-heading": 2.4072546675648545, "deviation-center-line": 0.42313942837894}, "ep003": {"driven_any": 1.2614294421853502, "driven_lanedir": 0.5322997840560242, "in-drivable-lane": 4.833333333333316, "deviation-heading": 0.9132573556070078, "deviation-center-line": 0.2897717445276153}, "ep004": {"driven_any": 1.1499887211452298, "driven_lanedir": 0.6337382853505207, "in-drivable-lane": 3.233333333333322, "deviation-heading": 0.9615453863351658, "deviation-center-line": 0.25851915149849297}}
No reset possible
7827952Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.0672675368220776
deviation-center-line_median0.6566656999765133
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max1.4643514655555545
deviation-center-line_mean0.8334349074486465
deviation-center-line_min0.24338888302510395
deviation-heading_max3.895204271440406
deviation-heading_mean2.4961505054632283
deviation-heading_median2.7219860107949923
deviation-heading_min1.2930067462546844
driven_any_max4.506138192977895
driven_any_mean2.2237786474344547
driven_any_median2.2046019076161603
driven_any_min0.5841864345325466
driven_lanedir_max4.447833623411079
driven_lanedir_mean2.114176640245193
driven_lanedir_min0.4026670018218528
in-drivable-lane_max0.433333333333334
in-drivable-lane_mean0.14666666666666658
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5841864345325466, "driven_lanedir": 0.4026670018218528, "in-drivable-lane": 0.433333333333334, "deviation-heading": 1.2930067462546844, "deviation-center-line": 0.24338888302510395}, "ep001": {"driven_any": 2.2046019076161603, "driven_lanedir": 2.0672675368220776, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.895204271440406, "deviation-center-line": 1.3143242925087115}, "ep002": {"driven_any": 1.3807368787922434, "driven_lanedir": 1.3045249361196944, "in-drivable-lane": 0, "deviation-heading": 2.7219860107949923, "deviation-center-line": 0.48844419617734985}, "ep003": {"driven_any": 2.4432298232534286, "driven_lanedir": 2.3485901030512597, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.8472393554659785, "deviation-center-line": 0.6566656999765133}, "ep004": {"driven_any": 4.506138192977895, "driven_lanedir": 4.447833623411079, "in-drivable-lane": 0, "deviation-heading": 2.723316143360079, "deviation-center-line": 1.4643514655555545}}
No reset possible
7822953Claudio RuchFunky Controller 1aido1_amod_fleet_size_r1-v3step2-scoringsuccessyesrudolf-30:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
fleet_size-1000000000


other stats
efficiency-63.89231136588219
service_quality-32.640257841471076
No reset possible
7810951Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:06:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.95806685359063
deviation-center-line_median0.8229586821678466
in-drivable-lane_median1.7999999999999936


other stats
deviation-center-line_max1.2178174872322198
deviation-center-line_mean0.8570354312606204
deviation-center-line_min0.4614272679950055
deviation-heading_max6.299073364900543
deviation-heading_mean3.988919607703714
deviation-heading_median3.4254359889357633
deviation-heading_min2.678582496270513
driven_any_max4.384777253768588
driven_any_mean3.0599646230133075
driven_any_median3.9161897556702505
driven_any_min1.209814646378925
driven_lanedir_max3.878313403791397
driven_lanedir_mean2.508606696808085
driven_lanedir_min0.8623461482676087
in-drivable-lane_max4.533333333333324
in-drivable-lane_mean2.1266666666666607
in-drivable-lane_min1.099999999999996
per-episodes
details{"ep000": {"driven_any": 3.9161897556702505, "driven_lanedir": 2.95806685359063, "in-drivable-lane": 4.533333333333324, "deviation-heading": 3.153968132790692, "deviation-center-line": 1.05564604009203}, "ep001": {"driven_any": 1.209814646378925, "driven_lanedir": 0.8623461482676087, "in-drivable-lane": 1.3333333333333286, "deviation-heading": 6.299073364900543, "deviation-center-line": 0.727327678816}, "ep002": {"driven_any": 4.076256359067669, "driven_lanedir": 3.5683430262872036, "in-drivable-lane": 1.099999999999996, "deviation-heading": 4.387538055621058, "deviation-center-line": 1.2178174872322198}, "ep003": {"driven_any": 4.384777253768588, "driven_lanedir": 3.878313403791397, "in-drivable-lane": 1.86666666666666, "deviation-heading": 3.4254359889357633, "deviation-center-line": 0.8229586821678466}, "ep004": {"driven_any": 1.712785100181106, "driven_lanedir": 1.2759640521035855, "in-drivable-lane": 1.7999999999999936, "deviation-heading": 2.678582496270513, "deviation-center-line": 0.4614272679950055}}
No reset possible
7801950Claudio RuchFunky Controller 1aido1_amod_efficiency_r1-v3step1-simulationsuccessnorudolf-30:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
7792945Claudio RuchPython templateaido1_amod_fleet_size_r1-v3step2-scoringsuccessyesrudolf-30:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
fleet_size-1000000000


other stats
efficiency-63.39357988341456
service_quality-32.53305497085425
No reset possible
7785944Claudio RuchPython templateaido1_amod_efficiency_r1-v3step2-scoringsuccessyesrudolf-30:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency-64.1497490894183


other stats
fleet_size-1000000000
service_quality-33.01488727235483
No reset possible
7782945Claudio RuchPython templateaido1_amod_fleet_size_r1-v3step1-simulationabortednorudolf-30:00:14
Error while running [...]

Creating job7782-7224_solution_1  ... error
stderr | ERROR: for job7782-7224_solution_1  Cannot start service solution: network job7782-7224_evaluation not found
stderr | 
stderr | ERROR: for aido-host  Cannot start service aido-host: network job7782-7224_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job7782-7224_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7772941David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4524595137794645
deviation-center-line_median0.12839941939762656
in-drivable-lane_median0


other stats
deviation-center-line_max0.7983372443672196
deviation-center-line_mean0.3380569545926784
deviation-center-line_min0.07408682132034992
deviation-heading_max5.279562013364543
deviation-heading_mean2.036813170556792
deviation-heading_median0.3199694854199965
deviation-heading_min0.1808021473176744
driven_any_max9.64812532793395
driven_any_mean3.716725938501999
driven_any_median0.7942371126606618
driven_any_min0.4879643179665967
driven_lanedir_max4.224767646159132
driven_lanedir_mean1.4928239510861143
driven_lanedir_min0.2364698935657361
in-drivable-lane_max6.1000000000000085
in-drivable-lane_mean1.4600000000000009
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.869135875499666, "driven_lanedir": 2.2877849291825276, "in-drivable-lane": 6.1000000000000085, "deviation-heading": 5.279562013364543, "deviation-center-line": 0.6012225514085052}, "ep001": {"driven_any": 0.7942371126606618, "driven_lanedir": 0.26263777274371103, "in-drivable-lane": 0, "deviation-heading": 0.3199694854199965, "deviation-center-line": 0.08823873646969087}, "ep002": {"driven_any": 0.7841670584491253, "driven_lanedir": 0.4524595137794645, "in-drivable-lane": 0, "deviation-heading": 0.29175076592833826, "deviation-center-line": 0.12839941939762656}, "ep003": {"driven_any": 9.64812532793395, "driven_lanedir": 4.224767646159132, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 4.111981440753408, "deviation-center-line": 0.7983372443672196}, "ep004": {"driven_any": 0.4879643179665967, "driven_lanedir": 0.2364698935657361, "in-drivable-lane": 0, "deviation-heading": 0.1808021473176744, "deviation-center-line": 0.07408682132034992}}
No reset possible
7766940David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4524595137794645
deviation-center-line_median0.12839941939762656
in-drivable-lane_median0


other stats
deviation-center-line_max0.7983372443672196
deviation-center-line_mean0.3380569545926784
deviation-center-line_min0.07408682132034992
deviation-heading_max5.279562013364543
deviation-heading_mean2.036813170556792
deviation-heading_median0.3199694854199965
deviation-heading_min0.1808021473176744
driven_any_max9.64812532793395
driven_any_mean3.716725938501999
driven_any_median0.7942371126606618
driven_any_min0.4879643179665967
driven_lanedir_max4.224767646159132
driven_lanedir_mean1.4928239510861143
driven_lanedir_min0.2364698935657361
in-drivable-lane_max6.1000000000000085
in-drivable-lane_mean1.4600000000000009
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.869135875499666, "driven_lanedir": 2.2877849291825276, "in-drivable-lane": 6.1000000000000085, "deviation-heading": 5.279562013364543, "deviation-center-line": 0.6012225514085052}, "ep001": {"driven_any": 0.7942371126606618, "driven_lanedir": 0.26263777274371103, "in-drivable-lane": 0, "deviation-heading": 0.3199694854199965, "deviation-center-line": 0.08823873646969087}, "ep002": {"driven_any": 0.7841670584491253, "driven_lanedir": 0.4524595137794645, "in-drivable-lane": 0, "deviation-heading": 0.29175076592833826, "deviation-center-line": 0.12839941939762656}, "ep003": {"driven_any": 9.64812532793395, "driven_lanedir": 4.224767646159132, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 4.111981440753408, "deviation-center-line": 0.7983372443672196}, "ep004": {"driven_any": 0.4879643179665967, "driven_lanedir": 0.2364698935657361, "in-drivable-lane": 0, "deviation-heading": 0.1808021473176744, "deviation-center-line": 0.07408682132034992}}
No reset possible
7754938Hristo Vrigazov 🇧🇬ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22441378044490048
deviation-center-line_median0.20461859560324655
in-drivable-lane_median0


other stats
deviation-center-line_max0.35117867998151586
deviation-center-line_mean0.2321390040111884
deviation-center-line_min0.11717741145249154
deviation-heading_max1.7689633985112407
deviation-heading_mean0.8436685155746894
deviation-heading_median0.6163705402862939
deviation-heading_min0.47882103104580054
driven_any_max0.792884836955395
driven_any_mean0.3471504714895969
driven_any_median0.24285936883078943
driven_any_min0.1821423849156732
driven_lanedir_max0.5524478189545186
driven_lanedir_mean0.2841118190815721
driven_lanedir_min0.1638919573009654
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.792884836955395, "driven_lanedir": 0.5524478189545186, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7689633985112407, "deviation-center-line": 0.3441421247225109}, "ep001": {"driven_any": 0.3214341180106259, "driven_lanedir": 0.31362340026870106, "in-drivable-lane": 0, "deviation-heading": 0.47882103104580054, "deviation-center-line": 0.35117867998151586}, "ep002": {"driven_any": 0.1821423849156732, "driven_lanedir": 0.1638919573009654, "in-drivable-lane": 0, "deviation-heading": 0.5481629995268564, "deviation-center-line": 0.14357820829617726}, "ep003": {"driven_any": 0.19643164873550087, "driven_lanedir": 0.16618213843877516, "in-drivable-lane": 0, "deviation-heading": 0.8060246085032547, "deviation-center-line": 0.11717741145249154}, "ep004": {"driven_any": 0.24285936883078943, "driven_lanedir": 0.22441378044490048, "in-drivable-lane": 0, "deviation-heading": 0.6163705402862939, "deviation-center-line": 0.20461859560324655}}
No reset possible
7752938Hristo Vrigazov 🇧🇬ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyesrudolf-30:00:13
Error while running [...]

Creating job7752-8515_videos_1 ... error
stderr | ERROR: for job7752-8515_videos_1  Cannot start service videos: network job7752-8515_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7752-8515_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7747938Hristo Vrigazov 🇧🇬ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.333333333333335


other stats
episodes
details{"ep000": {"nsteps": 224, "reward": -4.621182094348375, "good_angle": 0.7706784765932334, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 0.8999999999999968}, "ep001": {"nsteps": 92, "reward": -11.484535440478636, "good_angle": 0.19582252450820103, "survival_time": 3.0666666666666655, "traveled_tiles": 1, "valid_direction": 0.3999999999999986}, "ep002": {"nsteps": 53, "reward": -19.31181934138514, "good_angle": 0.45340019768764384, "survival_time": 1.7666666666666688, "traveled_tiles": 2, "valid_direction": 0.4666666666666681}, "ep003": {"nsteps": 57, "reward": -17.88823687298256, "good_angle": 0.6787207341248404, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.7000000000000022}, "ep004": {"nsteps": 70, "reward": -14.757806219799178, "good_angle": 0.4106352195159575, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 0.6333333333333329}}
good_angle_max0.7706784765932334
good_angle_mean0.5018514304859752
good_angle_median0.45340019768764384
good_angle_min0.19582252450820103
reward_max-4.621182094348375
reward_mean-13.612715993798778
reward_median-14.757806219799178
reward_min-19.31181934138514
survival_time_max7.46666666666665
survival_time_mean3.306666666666664
survival_time_min1.7666666666666688
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.8999999999999968
valid_direction_mean0.6199999999999998
valid_direction_median0.6333333333333329
valid_direction_min0.3999999999999986
No reset possible
7742936David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationfailednorudolf-30:02:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 28, in solve
    model = PytorchTrainer().load().eval()
  File "/workspace/pytorch_model.py", line 33, in load
    self.model.load_state_dict(torch.load("trained_models/pytorch_convnet.pth"))
  File "/usr/local/lib/python2.7/dist-packages/torch/serialization.py", line 356, in load
    f = open(f, 'rb')
IOError: [Errno 2] No such file or directory: 'trained_models/pytorch_convnet.pth'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7729933Hristo Vrigazov 🇧🇬ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7727931David AbrahamILaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 27, in solve
    from pytorch_model import TensorflowModel
ImportError: No module named pytorch_model


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7717930Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7709929Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 211, "reward": -5.7434931063839185, "good_angle": 12.759182482620506, "survival_time": 7.033333333333318, "traveled_tiles": 1, "valid_direction": 3.4999999999999933}, "ep001": {"nsteps": 34, "reward": -30.07684792928836, "good_angle": 0.8204342376068108, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0.9333333333333336}, "ep002": {"nsteps": 232, "reward": -5.451557237446179, "good_angle": 6.710493016160334, "survival_time": 7.733333333333316, "traveled_tiles": 2, "valid_direction": 7.499999999999982}, "ep003": {"nsteps": 93, "reward": -11.284307637522298, "good_angle": 0.7455433373413412, "survival_time": 3.0999999999999988, "traveled_tiles": 1, "valid_direction": 1.633333333333331}, "ep004": {"nsteps": 70, "reward": -15.381517261692457, "good_angle": 2.393471387754525, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 2.166666666666668}}
good_angle_max12.759182482620506
good_angle_mean4.685824892296703
good_angle_median2.393471387754525
good_angle_min0.7455433373413412
reward_max-5.451557237446179
reward_mean-13.587544634466642
reward_median-11.284307637522298
reward_min-30.07684792928836
survival_time_max7.733333333333316
survival_time_mean4.26666666666666
survival_time_min1.1333333333333335
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max7.499999999999982
valid_direction_mean3.1466666666666616
valid_direction_median2.166666666666668
valid_direction_min0.9333333333333336
No reset possible
7701928Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7693927Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:36
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7689926Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.08995210883203586
deviation-center-line_median0.13999283732729784
in-drivable-lane_median0


other stats
deviation-center-line_max0.5967702926810171
deviation-center-line_mean0.22107473955257056
deviation-center-line_min0.09553931818728711
deviation-heading_max5.561174620118044
deviation-heading_mean2.052529886458908
deviation-heading_median1.2003638965457502
deviation-heading_min0.8821821364432593
driven_any_max2.72233971937701
driven_any_mean0.7572215383759043
driven_any_median0.25726582444831586
driven_any_min0.1327951737101693
driven_lanedir_max0.2016102188459316
driven_lanedir_mean0.08463395806118029
driven_lanedir_min-0.015412842586705278
in-drivable-lane_max5.9999999999999805
in-drivable-lane_mean1.1999999999999962
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.72233971937701, "driven_lanedir": 0.2016102188459316, "in-drivable-lane": 5.9999999999999805, "deviation-heading": 5.561174620118044, "deviation-center-line": 0.5967702926810171}, "ep001": {"driven_any": 0.25726582444831586, "driven_lanedir": 0.03969031674007928, "in-drivable-lane": 0, "deviation-heading": 0.8821821364432593, "deviation-center-line": 0.13999283732729784}, "ep002": {"driven_any": 0.2353800698745608, "driven_lanedir": 0.08995210883203586, "in-drivable-lane": 0, "deviation-heading": 1.0206839946950763, "deviation-center-line": 0.15601821040973946}, "ep003": {"driven_any": 0.4383269044694661, "driven_lanedir": 0.10732998847456, "in-drivable-lane": 0, "deviation-heading": 1.5982447844924086, "deviation-center-line": 0.117053039157511}, "ep004": {"driven_any": 0.1327951737101693, "driven_lanedir": -0.015412842586705278, "in-drivable-lane": 0, "deviation-heading": 1.2003638965457502, "deviation-center-line": 0.09553931818728711}}
No reset possible
7682926Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7674925Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 92, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 50, in solve
    if np.abs(action) > 0.8:
ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7670924Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 92, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 27, in solve
    from model import TensorflowModel
  File "/workspace/model.py", line 4, in <module>
    from _layers import one_residual
ImportError: No module named _layers


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7668923Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.5052791857174235
deviation-center-line_median0.6675226976710577
in-drivable-lane_median0


other stats
deviation-center-line_max1.2122755078759224
deviation-center-line_mean0.7392349741123463
deviation-center-line_min0.3046805042375413
deviation-heading_max3.4037557607672726
deviation-heading_mean1.621496146500134
deviation-heading_median1.186568095326838
deviation-heading_min0.21958112812442057
driven_any_max3.834444920860273
driven_any_mean2.2396308998994257
driven_any_median2.5478605083758676
driven_any_min0.5996897987150797
driven_lanedir_max3.4595689580977314
driven_lanedir_mean2.1126959313415576
driven_lanedir_min0.595994418939527
in-drivable-lane_max1.3333333333333348
in-drivable-lane_mean0.3200000000000001
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 3.834444920860273, "driven_lanedir": 3.4595689580977314, "in-drivable-lane": 1.3333333333333348, "deviation-heading": 2.9572606903634493, "deviation-center-line": 1.2122755078759224}, "ep001": {"driven_any": 0.5996897987150797, "driven_lanedir": 0.595994418939527, "in-drivable-lane": 0, "deviation-heading": 0.21958112812442057, "deviation-center-line": 0.3046805042375413}, "ep002": {"driven_any": 3.0784809206830843, "driven_lanedir": 2.870092279068573, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 3.4037557607672726, "deviation-center-line": 1.1136649920112496}, "ep003": {"driven_any": 2.5478605083758676, "driven_lanedir": 2.5052791857174235, "in-drivable-lane": 0, "deviation-heading": 1.186568095326838, "deviation-center-line": 0.6675226976710577}, "ep004": {"driven_any": 1.137678350862825, "driven_lanedir": 1.1325448148845323, "in-drivable-lane": 0, "deviation-heading": 0.3403150579186888, "deviation-center-line": 0.3980311687659599}}
No reset possible
7658923Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:07:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7656922Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationfailednorudolf-30:01:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 96, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7653921Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.133333333333325


other stats
episodes
details{"ep000": {"nsteps": 323, "reward": -3.373436011742706, "good_angle": 0.4277255536353703, "survival_time": 10.76666666666664, "traveled_tiles": 3, "valid_direction": 0.4333333333333318}, "ep001": {"nsteps": 98, "reward": -10.767834626594368, "good_angle": 0.02614814443455957, "survival_time": 3.266666666666665, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 147, "reward": -7.312656618705412, "good_angle": 0.03826660554037584, "survival_time": 4.899999999999992, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 182, "reward": -5.954730473499704, "good_angle": 0.07132900253647763, "survival_time": 6.066666666666655, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 154, "reward": -6.9997793360577, "good_angle": 0.033870046442718384, "survival_time": 5.133333333333325, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.4277255536353703
good_angle_mean0.11946787051790037
good_angle_median0.03826660554037584
good_angle_min0.02614814443455957
reward_max-3.373436011742706
reward_mean-6.881687413319978
reward_median-6.9997793360577
reward_min-10.767834626594368
survival_time_max10.76666666666664
survival_time_mean6.026666666666655
survival_time_min3.266666666666665
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.4333333333333318
valid_direction_mean0.08666666666666636
valid_direction_median0
valid_direction_min0
No reset possible
7641920Manfred DiazTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.466666666666626


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.15423863659892958, "good_angle": 0.4357973211464265, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 0.33333333333333215}, "ep001": {"nsteps": 434, "reward": -2.55035256082581, "good_angle": 14.408324500717573, "survival_time": 14.466666666666626, "traveled_tiles": 12, "valid_direction": 2.433333333333329}, "ep002": {"nsteps": 112, "reward": -9.13167920045089, "good_angle": 0.4244389336872031, "survival_time": 3.73333333333333, "traveled_tiles": 4, "valid_direction": 0.5333333333333314}, "ep003": {"nsteps": 500, "reward": -0.1675045478786342, "good_angle": 0.28052233622904055, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 0.2666666666666657}, "ep004": {"nsteps": 241, "reward": -4.376776966674029, "good_angle": 4.8572073110175795, "survival_time": 8.033333333333315, "traveled_tiles": 7, "valid_direction": 0.966666666666664}}
good_angle_max14.408324500717573
good_angle_mean4.081258080559564
good_angle_median0.4357973211464265
good_angle_min0.28052233622904055
reward_max-0.15423863659892958
reward_mean-3.2761103824856592
reward_median-2.55035256082581
reward_min-9.13167920045089
survival_time_max16.666666666666654
survival_time_mean11.913333333333316
survival_time_min3.73333333333333
traveled_tiles_max12
traveled_tiles_mean9.4
traveled_tiles_median12
traveled_tiles_min4
valid_direction_max2.433333333333329
valid_direction_mean0.9066666666666644
valid_direction_median0.5333333333333314
valid_direction_min0.2666666666666657
No reset possible
7631919Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7628917Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5693719098903334
deviation-center-line_median0.5418837316596581
in-drivable-lane_median0


other stats
deviation-center-line_max0.6527915930368603
deviation-center-line_mean0.5192269892022757
deviation-center-line_min0.34625426507822943
deviation-heading_max1.5398373543640604
deviation-heading_mean0.6405045895188292
deviation-heading_median0.41561568198288235
deviation-heading_min0.28964303128969804
driven_any_max1.1357971363146686
driven_any_mean0.6471899489412869
driven_any_median0.5714705567746667
driven_any_min0.33216565723868
driven_lanedir_max0.9115876280709476
driven_lanedir_mean0.6005323472596954
driven_lanedir_min0.33057988645909475
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1357971363146686, "driven_lanedir": 0.9115876280709476, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.5398373543640604, "deviation-center-line": 0.6527915930368603}, "ep001": {"driven_any": 0.33216565723868, "driven_lanedir": 0.33057988645909475, "in-drivable-lane": 0, "deviation-heading": 0.28964303128969804, "deviation-center-line": 0.34625426507822943}, "ep002": {"driven_any": 0.5714705567746667, "driven_lanedir": 0.5693719098903334, "in-drivable-lane": 0, "deviation-heading": 0.41561568198288235, "deviation-center-line": 0.5467871352119719}, "ep003": {"driven_any": 0.6500485107285895, "driven_lanedir": 0.6463861122598429, "in-drivable-lane": 0, "deviation-heading": 0.5776491728311405, "deviation-center-line": 0.5418837316596581}, "ep004": {"driven_any": 0.5464678836498296, "driven_lanedir": 0.5447361996182583, "in-drivable-lane": 0, "deviation-heading": 0.3797777071263643, "deviation-center-line": 0.5084182210246588}}
No reset possible
7625917Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.399999999999991


other stats
episodes
details{"ep000": {"nsteps": 320, "reward": -3.3702033510577167, "good_angle": 0.3978927124329888, "survival_time": 10.66666666666664, "traveled_tiles": 3, "valid_direction": 0}, "ep001": {"nsteps": 95, "reward": -11.101196649200038, "good_angle": 0.03024576564469162, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 162, "reward": -6.697556388230971, "good_angle": 0.03960914715409381, "survival_time": 5.399999999999991, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 184, "reward": -5.8814700272582146, "good_angle": 0.06862985423233506, "survival_time": 6.133333333333321, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 155, "reward": -6.9587464757504005, "good_angle": 0.032520295971645685, "survival_time": 5.166666666666658, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.3978927124329888
good_angle_mean0.113779555087151
good_angle_median0.03960914715409381
good_angle_min0.03024576564469162
reward_max-3.3702033510577167
reward_mean-6.801834578299467
reward_median-6.697556388230971
reward_min-11.101196649200038
survival_time_max10.66666666666664
survival_time_mean6.106666666666655
survival_time_min3.166666666666665
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0
valid_direction_mean0
valid_direction_median0
valid_direction_min0
No reset possible
7620916Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7600914Manfred DiazTensorflow templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7568908Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7559908Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.233333333333321


other stats
episodes
details{"ep000": {"nsteps": 77, "reward": -13.25760446571104, "good_angle": 1.2102786325198769, "survival_time": 2.5666666666666673, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 54, "reward": -19.086375530119295, "good_angle": 0.06435254244870461, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 226, "reward": -4.901912556033977, "good_angle": 2.5406340061787915, "survival_time": 7.533333333333316, "traveled_tiles": 3, "valid_direction": 4.966666666666653}, "ep003": {"nsteps": 221, "reward": -5.707385117474657, "good_angle": 1.0355929673408153, "survival_time": 7.36666666666665, "traveled_tiles": 3, "valid_direction": 4.999999999999986}, "ep004": {"nsteps": 187, "reward": -6.5791364537432475, "good_angle": 1.5165908226878455, "survival_time": 6.233333333333321, "traveled_tiles": 2, "valid_direction": 5.099999999999987}}
good_angle_max2.5406340061787915
good_angle_mean1.2734897942352066
good_angle_median1.2102786325198769
good_angle_min0.06435254244870461
reward_max-4.901912556033977
reward_mean-9.906482824616443
reward_median-6.5791364537432475
reward_min-19.086375530119295
survival_time_max7.533333333333316
survival_time_mean5.099999999999992
survival_time_min1.8000000000000025
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.099999999999987
valid_direction_mean3.439999999999992
valid_direction_median4.966666666666653
valid_direction_min0
No reset possible
7548906Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7546906Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:13
Error while running [...]

Creating job7546-9738_scorer_1 ... error
stderr | ERROR: for job7546-9738_scorer_1  Cannot start service scorer: network job7546-9738_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7546-9738_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7541904Ruixiang Zhang 🇨🇦stay simpleaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0596231357493375
deviation-center-line_median0.3228417878598156
in-drivable-lane_median8.23333333333332


other stats
deviation-center-line_max1.178853686937113
deviation-center-line_mean0.49307942765254
deviation-center-line_min0.18588213866629325
deviation-heading_max6.6392179351503
deviation-heading_mean6.100365571637213
deviation-heading_median6.612469159930811
deviation-heading_min4.0425265634157785
driven_any_max3.3176367416070964
driven_any_mean3.317383613534671
driven_any_median3.3176367416070947
driven_any_min3.31637110124498
driven_lanedir_max1.0652280073004148
driven_lanedir_mean1.020858211229782
driven_lanedir_min0.8601120957658444
in-drivable-lane_max10.66666666666667
in-drivable-lane_mean8.71999999999999
in-drivable-lane_min8.233333333333318
per-episodes
details{"ep000": {"driven_any": 3.31637110124498, "driven_lanedir": 0.8601120957658444, "in-drivable-lane": 10.66666666666667, "deviation-heading": 4.0425265634157785, "deviation-center-line": 1.178853686937113}, "ep001": {"driven_any": 3.3176367416070893, "driven_lanedir": 1.0652280073004148, "in-drivable-lane": 8.233333333333318, "deviation-heading": 6.587302914804712, "deviation-center-line": 0.4968610821754272}, "ep002": {"driven_any": 3.3176367416070964, "driven_lanedir": 1.0596231357493375, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.6203112848844645, "deviation-center-line": 0.2809584426240513}, "ep003": {"driven_any": 3.317636741607095, "driven_lanedir": 1.0607772412651335, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.612469159930811, "deviation-center-line": 0.18588213866629325}, "ep004": {"driven_any": 3.3176367416070947, "driven_lanedir": 1.0585505760681793, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.6392179351503, "deviation-center-line": 0.3228417878598156}}
No reset possible
7535904Ruixiang Zhang 🇨🇦stay simpleaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9621531757116316, "good_angle": 46.42717754437712, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.16666666666665}, "ep001": {"nsteps": 500, "reward": -1.3020373888611794, "good_angle": 13.82404463718111, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}, "ep002": {"nsteps": 500, "reward": -1.1174760079681874, "good_angle": 13.82628678256673, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333326}, "ep003": {"nsteps": 500, "reward": -0.9247168089353216, "good_angle": 13.813277564508354, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.899999999999991}, "ep004": {"nsteps": 500, "reward": -1.161978100210428, "good_angle": 13.831768282780049, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}}
good_angle_max46.42717754437712
good_angle_mean20.344510962282673
good_angle_median13.82628678256673
good_angle_min13.813277564508354
reward_max-0.9247168089353216
reward_mean-1.0936722963373495
reward_median-1.1174760079681874
reward_min-1.3020373888611794
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.16666666666665
valid_direction_mean13.259999999999993
valid_direction_median13.09999999999999
valid_direction_min12.899999999999991
No reset possible
7530903Ruixiang Zhang 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.059623135749142
deviation-center-line_median0.32284178785982215
in-drivable-lane_median8.23333333333332


other stats
deviation-center-line_max1.187192627920309
deviation-center-line_mean0.4947472158491816
deviation-center-line_min0.1858821386662933
deviation-heading_max6.6392179351502945
deviation-heading_mean6.108896043028005
deviation-heading_median6.612469159930811
deviation-heading_min4.08517892036974
driven_any_max3.317636741607098
driven_any_mean3.3172983690472555
driven_any_median3.3176367416070893
driven_any_min3.315944878807913
driven_lanedir_max1.0652280073004148
driven_lanedir_mean1.02118515399691
driven_lanedir_min0.8617468096016637
in-drivable-lane_max10.633333333333338
in-drivable-lane_mean8.713333333333324
in-drivable-lane_min8.233333333333318
per-episodes
details{"ep000": {"driven_any": 3.315944878807913, "driven_lanedir": 0.8617468096016637, "in-drivable-lane": 10.633333333333338, "deviation-heading": 4.08517892036974, "deviation-center-line": 1.187192627920309}, "ep001": {"driven_any": 3.3176367416070893, "driven_lanedir": 1.0652280073004148, "in-drivable-lane": 8.233333333333318, "deviation-heading": 6.587302914804712, "deviation-center-line": 0.4968610821754272}, "ep002": {"driven_any": 3.317636741607094, "driven_lanedir": 1.059623135749142, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.620311284884465, "deviation-center-line": 0.28095844262405595}, "ep003": {"driven_any": 3.317636741607098, "driven_lanedir": 1.0607772412651295, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.612469159930811, "deviation-center-line": 0.1858821386662933}, "ep004": {"driven_any": 3.317636741607083, "driven_lanedir": 1.0585505760681992, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.6392179351502945, "deviation-center-line": 0.32284178785982215}}
No reset possible
7524902Ruixiang Zhang 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.06181048546565604
deviation-center-line_median0.2113972315917868
in-drivable-lane_median8.166666666666663


other stats
deviation-center-line_max0.49248932378794785
deviation-center-line_mean0.26398105451852627
deviation-center-line_min0.08779314428751073
deviation-heading_max6.707536597788457
deviation-heading_mean3.292239163133085
deviation-heading_median1.7981154878545835
deviation-heading_min0.6996258807922352
driven_any_max1.1172639330043346
driven_any_mean0.7156906119073392
driven_any_median0.9980131767229768
driven_any_min0.10123459605053756
driven_lanedir_max-0.025257889087850316
driven_lanedir_mean-0.16446314382424757
driven_lanedir_min-0.35830256055537646
in-drivable-lane_max15.46666666666664
in-drivable-lane_mean7.053333333333323
in-drivable-lane_min0.9333333333333348
per-episodes
details{"ep000": {"driven_any": 1.1172639330043346, "driven_lanedir": -0.043283602002308186, "in-drivable-lane": 15.46666666666664, "deviation-heading": 1.011321095802808, "deviation-center-line": 0.2113972315917868}, "ep001": {"driven_any": 0.10123459605053756, "driven_lanedir": -0.025257889087850316, "in-drivable-lane": 0.9333333333333348, "deviation-heading": 0.6996258807922352, "deviation-center-line": 0.08779314428751073}, "ep002": {"driven_any": 0.9980131767229768, "driven_lanedir": -0.35830256055537646, "in-drivable-lane": 8.166666666666663, "deviation-heading": 6.707536597788457, "deviation-center-line": 0.49248932378794785}, "ep003": {"driven_any": 1.0925940885121594, "driven_lanedir": -0.3336611820100468, "in-drivable-lane": 8.299999999999985, "deviation-heading": 6.244596753427343, "deviation-center-line": 0.3278257192102758}, "ep004": {"driven_any": 0.2693472652466871, "driven_lanedir": -0.06181048546565604, "in-drivable-lane": 2.3999999999999964, "deviation-heading": 1.7981154878545835, "deviation-center-line": 0.2003998537151099}}
No reset possible
7516902Ruixiang Zhang 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7515901Laurent MandrileTensorflow templateaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 86, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 29, in solve
    from model import TfInference
  File "/workspace/model.py", line 4, in <module>
    from _layers import one_residual
ImportError: No module named _layers


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7512899Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7510898Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7507897Tina ChuRandom executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7504897Tina ChuRandom executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7497894Martin Weiss 🇨🇦PyTorch templateaido1_LF1_r3-v3step3-videosabortedyesrudolf-30:00:13
Error while running [...]

Creating job7497-8170_videos_1 ... error
stderr | ERROR: for job7497-8170_videos_1  Cannot start service videos: network job7497-8170_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7497-8170_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7484893Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994


other stats
episodes
details{"ep000": {"nsteps": 48, "reward": -22.10871991511279, "good_angle": 3.150220155346793, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 1.266666666666668}, "ep001": {"nsteps": 14, "reward": -72.85214451168265, "good_angle": 0.4903066366810786, "survival_time": 0.4666666666666666, "traveled_tiles": 1, "valid_direction": 0.4}, "ep002": {"nsteps": 14, "reward": -72.56261728703976, "good_angle": 0.38122320781889096, "survival_time": 0.4666666666666666, "traveled_tiles": 1, "valid_direction": 0.3666666666666666}, "ep003": {"nsteps": 15, "reward": -67.71164356426647, "good_angle": 0.4429239307234649, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep004": {"nsteps": 15, "reward": -68.05443244576455, "good_angle": 0.44260828931489266, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0.3999999999999999}}
good_angle_max3.150220155346793
good_angle_mean0.981456443977024
good_angle_median0.4429239307234649
good_angle_min0.38122320781889096
reward_max-22.10871991511279
reward_mean-60.65791154477324
reward_median-68.05443244576455
reward_min-72.85214451168265
survival_time_max1.6000000000000016
survival_time_mean0.706666666666667
survival_time_min0.4666666666666666
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.266666666666668
valid_direction_mean0.5733333333333335
valid_direction_median0.4
valid_direction_min0.3666666666666666
No reset possible
7476891Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationerrornorudolf-30:01:07
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7473890Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7467889Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:33
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7464888Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationerrornorudolf-30:01:07
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7461887Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7457887Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:11
Error while running [...]

Creating job7457-9453_scorer_1 ... error
stderr | ERROR: for job7457-9453_scorer_1  Cannot start service scorer: network job7457-9453_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7457-9453_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7454886Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.25751103414270027
deviation-center-line_median0.2316766280237925
in-drivable-lane_median0


other stats
deviation-center-line_max0.353851215952034
deviation-center-line_mean0.2491435731069917
deviation-center-line_min0.12859740325554045
deviation-heading_max1.786421122268535
deviation-heading_mean0.7913033785668815
deviation-heading_median0.6072484431772607
deviation-heading_min0.217993163684858
driven_any_max0.7964697703754341
driven_any_mean0.3771525772806887
driven_any_median0.27142160418020644
driven_any_min0.16070296388132274
driven_lanedir_max0.5556348189361362
driven_lanedir_mean0.3191292478835238
driven_lanedir_min0.14057228504037322
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7964697703754341, "driven_lanedir": 0.5556348189361362, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.786421122268535, "deviation-center-line": 0.33782433590773453}, "ep001": {"driven_any": 0.18929400406129007, "driven_lanedir": 0.187596066353239, "in-drivable-lane": 0, "deviation-heading": 0.217993163684858, "deviation-center-line": 0.19376828239585708}, "ep002": {"driven_any": 0.16070296388132274, "driven_lanedir": 0.14057228504037322, "in-drivable-lane": 0, "deviation-heading": 0.6072484431772607, "deviation-center-line": 0.12859740325554045}, "ep003": {"driven_any": 0.46787454390519007, "driven_lanedir": 0.4543320349451702, "in-drivable-lane": 0, "deviation-heading": 0.7592086640997087, "deviation-center-line": 0.353851215952034}, "ep004": {"driven_any": 0.27142160418020644, "driven_lanedir": 0.25751103414270027, "in-drivable-lane": 0, "deviation-heading": 0.5856454996040452, "deviation-center-line": 0.2316766280237925}}
No reset possible
7446886Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7442885Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.0000000000000027


other stats
episodes
details{"ep000": {"nsteps": 224, "reward": -4.621444148860194, "good_angle": 0.7496573045041304, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 1.2333333333333298}, "ep001": {"nsteps": 56, "reward": -18.413757285369293, "good_angle": 0.04244108594787884, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 54, "reward": -18.950653522654815, "good_angle": 0.4074084653387328, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 0.7333333333333354}, "ep003": {"nsteps": 60, "reward": -17.039696267495554, "good_angle": 0.4729038471070624, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 0.8666666666666686}, "ep004": {"nsteps": 69, "reward": -14.965573401986688, "good_angle": 0.37706997932906167, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.6666666666666665}}
good_angle_max0.7496573045041304
good_angle_mean0.4098961364453732
good_angle_median0.4074084653387328
good_angle_min0.04244108594787884
reward_max-4.621444148860194
reward_mean-14.798224925273308
reward_median-17.039696267495554
reward_min-18.950653522654815
survival_time_max7.46666666666665
survival_time_mean3.086666666666665
survival_time_min1.8000000000000025
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.2333333333333298
valid_direction_mean0.7000000000000001
valid_direction_median0.7333333333333354
valid_direction_min0
No reset possible
7440885Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7433883Amina Khatun 🇧🇩Solution templateaido1_luck-v3step1successyesrudolf-30:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score176.15893469617743


No reset possible
7432882Benjamin Ramtoula 🇨🇦My ROS Submissionaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 89, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: __init__() got an unexpected keyword argument 'dtype'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7414878Mandana Samiei 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.2333333333333316


other stats
episodes
details{"ep000": {"nsteps": 71, "reward": -14.38939671668316, "good_angle": 0.7496343144478863, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 1.8333333333333344}, "ep001": {"nsteps": 116, "reward": -8.956627277789861, "good_angle": 5.476824528401408, "survival_time": 3.8666666666666623, "traveled_tiles": 2, "valid_direction": 2.6999999999999957}, "ep002": {"nsteps": 110, "reward": -10.047834566732954, "good_angle": 1.5761100266806696, "survival_time": 3.6666666666666634, "traveled_tiles": 4, "valid_direction": 2.766666666666664}, "ep003": {"nsteps": 97, "reward": -10.94542623118056, "good_angle": 1.261777326348147, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.466666666666665}, "ep004": {"nsteps": 58, "reward": -18.156620403141552, "good_angle": 1.5198559032862808, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 1.5000000000000029}}
good_angle_max5.476824528401408
good_angle_mean2.1168404198328785
good_angle_median1.5198559032862808
good_angle_min0.7496343144478863
reward_max-8.956627277789861
reward_mean-12.499181039105618
reward_median-10.94542623118056
reward_min-18.156620403141552
survival_time_max3.8666666666666623
survival_time_mean3.0133333333333323
survival_time_min1.933333333333336
traveled_tiles_max4
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.766666666666664
valid_direction_mean2.2533333333333325
valid_direction_median2.466666666666665
valid_direction_min1.5000000000000029
No reset possible
7397873Tan Gemicioglu 🇹🇷Solution templateaido1_luck-v3step1successyesrudolf-30:00:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score150.46302193976344


No reset possible
7392872Patrick Pfreundschuh 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7384871Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7381871Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7373870Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.233333333333335


other stats
episodes
details{"ep000": {"nsteps": 163, "reward": -6.258271661729901, "good_angle": 1.2955035304809206, "survival_time": 5.433333333333324, "traveled_tiles": 2, "valid_direction": 1.566666666666661}, "ep001": {"nsteps": 53, "reward": -19.42526002987376, "good_angle": 0.05263431640405235, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 0.03333333333333344}, "ep002": {"nsteps": 113, "reward": -9.305504051984938, "good_angle": 0.06958273889170784, "survival_time": 3.766666666666663, "traveled_tiles": 2, "valid_direction": 0.09999999999999964}, "ep003": {"nsteps": 53, "reward": -19.229105192254178, "good_angle": 0.5903635772146183, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 0.8333333333333355}, "ep004": {"nsteps": 67, "reward": -15.392894756438126, "good_angle": 0.3927225749111881, "survival_time": 2.233333333333335, "traveled_tiles": 1, "valid_direction": 0.7000000000000004}}
good_angle_max1.2955035304809206
good_angle_mean0.4801613475804974
good_angle_median0.3927225749111881
good_angle_min0.05263431640405235
reward_max-6.258271661729901
reward_mean-13.922207138456178
reward_median-15.392894756438126
reward_min-19.42526002987376
survival_time_max5.433333333333324
survival_time_mean2.9933333333333314
survival_time_min1.7666666666666688
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.566666666666661
valid_direction_mean0.646666666666666
valid_direction_median0.7000000000000004
valid_direction_min0.03333333333333344
No reset possible
7368869Bhairav MehtaDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.15853155651776518
deviation-center-line_median0.12257998665904676
in-drivable-lane_median0


other stats
deviation-center-line_max0.35930398442203687
deviation-center-line_mean0.1746914793680183
deviation-center-line_min0.06265818245724168
deviation-heading_max1.7452895256014618
deviation-heading_mean0.8245579979926234
deviation-heading_median0.6083889750085985
deviation-heading_min0.3816631270157232
driven_any_max0.8071729299414795
driven_any_mean0.2871454276221734
driven_any_median0.18570541233263693
driven_any_min0.057134721676808
driven_lanedir_max0.5685754779264094
driven_lanedir_mean0.2236035483862599
driven_lanedir_min0.04184921826141519
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8071729299414795, "driven_lanedir": 0.5685754779264094, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7452895256014618, "deviation-center-line": 0.35930398442203687}, "ep001": {"driven_any": 0.057134721676808, "driven_lanedir": 0.04184921826141519, "in-drivable-lane": 0, "deviation-heading": 0.3816631270157232, "deviation-center-line": 0.06265818245724168}, "ep002": {"driven_any": 0.15000031589493798, "driven_lanedir": 0.12732125646470105, "in-drivable-lane": 0, "deviation-heading": 0.6083889750085985, "deviation-center-line": 0.12202033279064292}, "ep003": {"driven_any": 0.18570541233263693, "driven_lanedir": 0.15853155651776518, "in-drivable-lane": 0, "deviation-heading": 0.8049386919464118, "deviation-center-line": 0.12257998665904676}, "ep004": {"driven_any": 0.23571375826500457, "driven_lanedir": 0.2217402327610087, "in-drivable-lane": 0, "deviation-heading": 0.582509670390922, "deviation-center-line": 0.2068949105111232}}
No reset possible
7360868Bhairav MehtaDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.3333333333333313


other stats
episodes
details{"ep000": {"nsteps": 227, "reward": -4.559573450204988, "good_angle": 0.8955598871374765, "survival_time": 7.5666666666666496, "traveled_tiles": 2, "valid_direction": 1.1333333333333293}, "ep001": {"nsteps": 100, "reward": -10.613562700152396, "good_angle": 0.19943732972108769, "survival_time": 3.3333333333333313, "traveled_tiles": 1, "valid_direction": 0.33333333333333215}, "ep002": {"nsteps": 45, "reward": -22.72289766603046, "good_angle": 0.40867230163282, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 0.8333333333333347}, "ep003": {"nsteps": 125, "reward": -8.39144970458746, "good_angle": 0.36369337315531985, "survival_time": 4.166666666666662, "traveled_tiles": 2, "valid_direction": 0.5666666666666647}, "ep004": {"nsteps": 68, "reward": -15.192827325971688, "good_angle": 0.4321920121833141, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.6333333333333333}}
good_angle_max0.8955598871374765
good_angle_mean0.4599109807660036
good_angle_median0.40867230163282
good_angle_min0.19943732972108769
reward_max-4.559573450204988
reward_mean-12.296062169389398
reward_median-10.613562700152396
reward_min-22.72289766603046
survival_time_max7.5666666666666496
survival_time_mean3.766666666666663
survival_time_min1.500000000000001
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.1333333333333293
valid_direction_mean0.6999999999999988
valid_direction_median0.6333333333333333
valid_direction_min0.33333333333333215
No reset possible
7352867Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7336864Philippe LacailleROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.26722985583421366
deviation-center-line_median0.2401863658044282
in-drivable-lane_median0


other stats
deviation-center-line_max0.6131154673652297
deviation-center-line_mean0.2853280204056398
deviation-center-line_min0.06294280999054228
deviation-heading_max1.8113572863187677
deviation-heading_mean0.8136154952171321
deviation-heading_median0.6239573365613308
deviation-heading_min0.3928921969922846
driven_any_max1.0822002222814116
driven_any_mean0.4164427672898186
driven_any_median0.2785762338817466
driven_any_min0.05713382178258263
driven_lanedir_max0.8479800333679799
driven_lanedir_mean0.35745540310759827
driven_lanedir_min0.0410770096323958
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0822002222814116, "driven_lanedir": 0.8479800333679799, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8113572863187677, "deviation-center-line": 0.6131154673652297}, "ep001": {"driven_any": 0.05713382178258263, "driven_lanedir": 0.0410770096323958, "in-drivable-lane": 0, "deviation-heading": 0.3928921969922846, "deviation-center-line": 0.06294280999054228}, "ep002": {"driven_any": 0.15713960627427803, "driven_lanedir": 0.1345842994903539, "in-drivable-lane": 0, "deviation-heading": 0.6239573365613308, "deviation-center-line": 0.12444682403289437}, "ep003": {"driven_any": 0.5071639522290741, "driven_lanedir": 0.4964058172130481, "in-drivable-lane": 0, "deviation-heading": 0.7397419938357113, "deviation-center-line": 0.3859486348351047}, "ep004": {"driven_any": 0.2785762338817466, "driven_lanedir": 0.26722985583421366, "in-drivable-lane": 0, "deviation-heading": 0.5001286623775663, "deviation-center-line": 0.2401863658044282}}
No reset possible
7330864Philippe LacailleROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.666666666666667


other stats
episodes
details{"ep000": {"nsteps": 305, "reward": -3.5262617528130353, "good_angle": 0.6237079283220934, "survival_time": 10.16666666666664, "traveled_tiles": 3, "valid_direction": 0.7999999999999972}, "ep001": {"nsteps": 18, "reward": -56.21339219146304, "good_angle": 0.4019755726060293, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 46, "reward": -22.198606933588568, "good_angle": 0.5099936677105174, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.7000000000000015}, "ep003": {"nsteps": 144, "reward": -7.349649251800859, "good_angle": 0.2659715577381501, "survival_time": 4.799999999999993, "traveled_tiles": 2, "valid_direction": 0.29999999999999893}, "ep004": {"nsteps": 80, "reward": -12.972921772301197, "good_angle": 0.2893694062165316, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 0.36666666666666536}}
good_angle_max0.6237079283220934
good_angle_mean0.41820362651866433
good_angle_median0.4019755726060293
good_angle_min0.2659715577381501
reward_max-3.5262617528130353
reward_mean-20.45216638039334
reward_median-12.972921772301197
reward_min-56.21339219146304
survival_time_max10.16666666666664
survival_time_mean3.9533333333333274
survival_time_min0.6
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.7999999999999972
valid_direction_mean0.5266666666666658
valid_direction_median0.4666666666666666
valid_direction_min0.29999999999999893
No reset possible
7325861Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7322860Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7318857Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7316856Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7309854Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3493700966360873
deviation-center-line_median0.10064492309489552
in-drivable-lane_median0


other stats
deviation-center-line_max0.126236662901327
deviation-center-line_mean0.10006171036715011
deviation-center-line_min0.07694772270470739
deviation-heading_max1.030311130604008
deviation-heading_mean0.3532445703768824
deviation-heading_median0.1839193439669325
deviation-heading_min0.10717054834728
driven_any_max0.4099686882910525
driven_any_mean0.3335654327459031
driven_any_median0.3540638671604564
driven_any_min0.18634940376866105
driven_lanedir_max0.4054653003100581
driven_lanedir_mean0.2835800318814334
driven_lanedir_min0.08669111443694189
in-drivable-lane_max0.3
in-drivable-lane_mean0.06
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.316793986406723, "driven_lanedir": 0.08669111443694189, "in-drivable-lane": 0.3, "deviation-heading": 1.030311130604008, "deviation-center-line": 0.08520179175839271}, "ep001": {"driven_any": 0.18634940376866105, "driven_lanedir": 0.1839841973901657, "in-drivable-lane": 0, "deviation-heading": 0.10717054834728, "deviation-center-line": 0.07694772270470739}, "ep002": {"driven_any": 0.3540638671604564, "driven_lanedir": 0.3493700966360873, "in-drivable-lane": 0, "deviation-heading": 0.1815876966586882, "deviation-center-line": 0.11127745137642794}, "ep003": {"driven_any": 0.4006512181026224, "driven_lanedir": 0.39238945063391384, "in-drivable-lane": 0, "deviation-heading": 0.2632341323075033, "deviation-center-line": 0.10064492309489552}, "ep004": {"driven_any": 0.4099686882910525, "driven_lanedir": 0.4054653003100581, "in-drivable-lane": 0, "deviation-heading": 0.1839193439669325, "deviation-center-line": 0.126236662901327}}
No reset possible
7296853Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.366666666666657


other stats
episodes
details{"ep000": {"nsteps": 288, "reward": -3.641058176822197, "good_angle": 0.504815426236077, "survival_time": 9.599999999999977, "traveled_tiles": 4, "valid_direction": 0.7333333333333307}, "ep001": {"nsteps": 29, "reward": -35.031422510229305, "good_angle": 0.013708599184171211, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 161, "reward": -6.359810015043498, "good_angle": 0.3901540835820118, "survival_time": 5.366666666666657, "traveled_tiles": 3, "valid_direction": 0.7999999999999972}, "ep003": {"nsteps": 500, "reward": -2.210993104908848, "good_angle": 0.7451144779839413, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 1.7333333333333627}, "ep004": {"nsteps": 114, "reward": -9.057214901570166, "good_angle": 0.07631486728121534, "survival_time": 3.799999999999996, "traveled_tiles": 2, "valid_direction": 0.033333333333333215}}
good_angle_max0.7451144779839413
good_angle_mean0.34602149085348327
good_angle_median0.3901540835820118
good_angle_min0.013708599184171211
reward_max-2.210993104908848
reward_mean-11.260099741714802
reward_median-6.359810015043498
reward_min-35.031422510229305
survival_time_max16.666666666666654
survival_time_mean7.27999999999999
survival_time_min0.9666666666666666
traveled_tiles_max7
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.7333333333333627
valid_direction_mean0.6600000000000048
valid_direction_median0.7333333333333307
valid_direction_min0
No reset possible
7292851Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7281849Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:09:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7277847Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1677331265841218
deviation-center-line_median0.21369449920758316
in-drivable-lane_median0


other stats
deviation-center-line_max1.464411830780586
deviation-center-line_mean0.4563088753418883
deviation-center-line_min0.14607759722589408
deviation-heading_max3.4927926401690663
deviation-heading_mean1.2063914448630155
deviation-heading_median1.058876716298759
deviation-heading_min0.09639253705307378
driven_any_max4.602452585926608
driven_any_mean1.6442723429191433
driven_any_median1.1704445826380951
driven_any_min0.40884157584142633
driven_lanedir_max4.490264233223098
driven_lanedir_mean1.5726566807857558
driven_lanedir_min0.4075578251135321
in-drivable-lane_max0.633333333333334
in-drivable-lane_mean0.1266666666666668
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6526231909238541, "driven_lanedir": 0.4609044611207218, "in-drivable-lane": 0.633333333333334, "deviation-heading": 1.058876716298759, "deviation-center-line": 0.21369449920758316}, "ep001": {"driven_any": 0.40884157584142633, "driven_lanedir": 0.4075578251135321, "in-drivable-lane": 0, "deviation-heading": 0.09639253705307378, "deviation-center-line": 0.14607759722589408}, "ep002": {"driven_any": 1.3869997792657325, "driven_lanedir": 1.3368237578873048, "in-drivable-lane": 0, "deviation-heading": 1.212248936259134, "deviation-center-line": 0.2647632241426425}, "ep003": {"driven_any": 1.1704445826380951, "driven_lanedir": 1.1677331265841218, "in-drivable-lane": 0, "deviation-heading": 0.17164639453504657, "deviation-center-line": 0.19259722535273616}, "ep004": {"driven_any": 4.602452585926608, "driven_lanedir": 4.490264233223098, "in-drivable-lane": 0, "deviation-heading": 3.4927926401690663, "deviation-center-line": 1.464411830780586}}
No reset possible
7267845Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7260844Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.199999999999974


other stats
episodes
details{"ep000": {"nsteps": 99, "reward": -10.357130566721246, "good_angle": 1.4536343166176198, "survival_time": 3.299999999999998, "traveled_tiles": 1, "valid_direction": 2.6999999999999984}, "ep001": {"nsteps": 76, "reward": -13.722857417636796, "good_angle": 0.020176811885747135, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 306, "reward": -3.8458391985082936, "good_angle": 1.1729555888336536, "survival_time": 10.199999999999974, "traveled_tiles": 3, "valid_direction": 2.666666666666658}, "ep003": {"nsteps": 500, "reward": -0.2625894590616226, "good_angle": 0.34741842439261117, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 1.166666666666698}, "ep004": {"nsteps": 414, "reward": -3.0101514331835317, "good_angle": 24.16140234813183, "survival_time": 13.799999999999962, "traveled_tiles": 3, "valid_direction": 4.699999999999983}}
good_angle_max24.16140234813183
good_angle_mean5.431117497972292
good_angle_median1.1729555888336536
good_angle_min0.020176811885747135
reward_max-0.2625894590616226
reward_mean-6.239713615022298
reward_median-3.8458391985082936
reward_min-13.722857417636796
survival_time_max16.666666666666654
survival_time_mean9.299999999999985
survival_time_min2.533333333333334
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.699999999999983
valid_direction_mean2.2466666666666675
valid_direction_median2.666666666666658
valid_direction_min0
No reset possible
7251843Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:02:00
Error while running [...]

Creating job7251-6696_scorer_1 ... error
stderr | ERROR: for job7251-6696_scorer_1  Cannot start service scorer: network job7251-6696_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7251-6696_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7243645Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9667184269351564
deviation-center-line_median1.2944816163430288
in-drivable-lane_median0.4666666666666668


other stats
deviation-center-line_max1.332540552664937
deviation-center-line_mean0.9557224490437596
deviation-center-line_min0.3160574297309683
deviation-heading_max12.275421338609751
deviation-heading_mean8.530644290489814
deviation-heading_median12.103540642741873
deviation-heading_min1.351018203217863
driven_any_max1.546688395233118
driven_any_mean1.169644276395163
driven_any_median1.5466883952331036
driven_any_min0.5869961981908871
driven_lanedir_max1.0061254000059208
driven_lanedir_mean0.694241123541594
driven_lanedir_min0.11832612271112986
in-drivable-lane_max4.366666666666661
in-drivable-lane_mean1.2666666666666655
in-drivable-lane_min0.3999999999999986
per-episodes
details{"ep000": {"driven_any": 0.5869961981908871, "driven_lanedir": 0.11832612271112986, "in-drivable-lane": 4.366666666666661, "deviation-heading": 1.351018203217863, "deviation-center-line": 0.3160574297309683}, "ep001": {"driven_any": 1.5466883952331036, "driven_lanedir": 1.0061254000059208, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 12.103540642741873, "deviation-center-line": 1.31446479721917}, "ep002": {"driven_any": 1.546688395233118, "driven_lanedir": 0.9909278972008222, "in-drivable-lane": 0.4666666666666668, "deviation-heading": 12.26450711077056, "deviation-center-line": 1.332540552664937}, "ep003": {"driven_any": 0.6211599980856, "driven_lanedir": 0.38910777085494086, "in-drivable-lane": 0.4333333333333318, "deviation-heading": 4.6587341571090235, "deviation-center-line": 0.5210678492606929}, "ep004": {"driven_any": 1.5466883952331063, "driven_lanedir": 0.9667184269351564, "in-drivable-lane": 0.6666666666666696, "deviation-heading": 12.275421338609751, "deviation-center-line": 1.2944816163430288}}
No reset possible
7237646Julian ZillyROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22314677952336393
deviation-center-line_median0.20103975714762165
in-drivable-lane_median0


other stats
deviation-center-line_max0.3516216984482968
deviation-center-line_mean0.23806215808098496
deviation-center-line_min0.13905956265520614
deviation-heading_max1.7602652484256691
deviation-heading_mean0.7745989853156303
deviation-heading_median0.5898118502612003
deviation-heading_min0.21717624725924584
driven_any_max0.7786138011702203
driven_any_mean0.3635821762769181
driven_any_median0.2357157086089037
driven_any_min0.16426673648448958
driven_lanedir_max0.5344344841372923
driven_lanedir_mean0.30603830643630037
driven_lanedir_min0.14827117076994445
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7786138011702203, "driven_lanedir": 0.5344344841372923, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7602652484256691, "deviation-center-line": 0.3183742804553118}, "ep001": {"driven_any": 0.17500876627313106, "driven_lanedir": 0.1732402364437835, "in-drivable-lane": 0, "deviation-heading": 0.21717624725924584, "deviation-center-line": 0.1802154916984885}, "ep002": {"driven_any": 0.16426673648448958, "driven_lanedir": 0.14827117076994445, "in-drivable-lane": 0, "deviation-heading": 0.5898118502612003, "deviation-center-line": 0.13905956265520614}, "ep003": {"driven_any": 0.4643058688478457, "driven_lanedir": 0.4510988613071176, "in-drivable-lane": 0, "deviation-heading": 0.7667185959126711, "deviation-center-line": 0.3516216984482968}, "ep004": {"driven_any": 0.2357157086089037, "driven_lanedir": 0.22314677952336393, "in-drivable-lane": 0, "deviation-heading": 0.5390229847193653, "deviation-center-line": 0.20103975714762165}}
No reset possible
7235646Julian ZillyROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7233643Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 103, in run
    solve(params, cis)
  File "solution.py", line 44, in solve
    env = make_env(config)
  File "solution.py", line 22, in make_env
    env.__init__(frame_skip=config['frame_skip'])
TypeError: __init__() got an unexpected keyword argument 'frame_skip'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7210654Aleksandar Petrov 🇨🇭Tuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7192664Manish PrajapatTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7189674Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3488793237522416
deviation-center-line_median0.0889692481169104
in-drivable-lane_median0.7333333333333356


other stats
deviation-center-line_max0.10804224268701285
deviation-center-line_mean0.09487224786148496
deviation-center-line_min0.08348977239520798
deviation-heading_max0.608366051951121
deviation-heading_mean0.5574968980788961
deviation-heading_median0.5632226516257168
deviation-heading_min0.48363659503855955
driven_any_max1.1039685593698203
driven_any_mean0.758378401654052
driven_any_median0.6599812039710905
driven_any_min0.6479815457170728
driven_lanedir_max0.5716983112111842
driven_lanedir_mean0.39952468480261855
driven_lanedir_min0.33211979888331666
in-drivable-lane_max1.3666666666666638
in-drivable-lane_mean0.8666666666666678
in-drivable-lane_min0.733333333333335
per-episodes
details{"ep000": {"driven_any": 1.1039685593698203, "driven_lanedir": 0.5716983112111842, "in-drivable-lane": 1.3666666666666638, "deviation-heading": 0.608366051951121, "deviation-center-line": 0.10673177973707754}, "ep001": {"driven_any": 0.7199794952411871, "driven_lanedir": 0.39976300809979626, "in-drivable-lane": 0.733333333333335, "deviation-heading": 0.5955376409473666, "deviation-center-line": 0.10804224268701285}, "ep002": {"driven_any": 0.659981203971089, "driven_lanedir": 0.3488793237522416, "in-drivable-lane": 0.7333333333333356, "deviation-heading": 0.5367215508317167, "deviation-center-line": 0.08712819637121608}, "ep003": {"driven_any": 0.6599812039710905, "driven_lanedir": 0.34516298206655405, "in-drivable-lane": 0.766666666666669, "deviation-heading": 0.48363659503855955, "deviation-center-line": 0.08348977239520798}, "ep004": {"driven_any": 0.6479815457170728, "driven_lanedir": 0.33211979888331666, "in-drivable-lane": 0.7333333333333356, "deviation-heading": 0.5632226516257168, "deviation-center-line": 0.0889692481169104}}
No reset possible
7184674Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7183674Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9000000000000024


other stats
episodes
details{"ep000": {"nsteps": 94, "reward": -11.171671843166129, "good_angle": 1.4044183981168703, "survival_time": 3.133333333333332, "traveled_tiles": 2, "valid_direction": 1.63333333333333}, "ep001": {"nsteps": 62, "reward": -17.048769331417017, "good_angle": 1.6329867996476355, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 1.566666666666669}, "ep002": {"nsteps": 57, "reward": -18.454871453794144, "good_angle": 1.4903659537432206, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.5000000000000024}, "ep003": {"nsteps": 57, "reward": -18.47161357804904, "good_angle": 1.4299329130305087, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.4666666666666692}, "ep004": {"nsteps": 56, "reward": -18.81965266557277, "good_angle": 1.5658464039151478, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 1.533333333333336}}
good_angle_max1.6329867996476355
good_angle_mean1.5047100936906768
good_angle_median1.4903659537432206
good_angle_min1.4044183981168703
reward_max-11.171671843166129
reward_mean-16.793315774399822
reward_median-18.454871453794144
reward_min-18.81965266557277
survival_time_max3.133333333333332
survival_time_mean2.1733333333333347
survival_time_min1.8666666666666691
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.63333333333333
valid_direction_mean1.5400000000000014
valid_direction_median1.533333333333336
valid_direction_min1.4666666666666692
No reset possible
7175674Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7166682Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2947164849694768
deviation-center-line_median0.3177777172601363
in-drivable-lane_median0


other stats
deviation-center-line_max2.5225122078542856
deviation-center-line_mean0.713452507582164
deviation-center-line_min0.12137529223058054
deviation-heading_max0.7780304126506045
deviation-heading_mean0.5738805979754095
deviation-heading_median0.6164308786648545
deviation-heading_min0.25308344122102144
driven_any_max1.778693955806478
driven_any_mean0.5878854761102923
driven_any_median0.29644412309687707
driven_any_min0.18570803887587417
driven_lanedir_max1.3561037699806358
driven_lanedir_mean0.493271603741094
driven_lanedir_min0.1605528432369332
in-drivable-lane_max3.9333333333333647
in-drivable-lane_mean0.786666666666673
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.778693955806478, "driven_lanedir": 1.3561037699806358, "in-drivable-lane": 3.9333333333333647, "deviation-heading": 0.658067922688946, "deviation-center-line": 2.5225122078542856}, "ep001": {"driven_any": 0.29644412309687707, "driven_lanedir": 0.2947164849694768, "in-drivable-lane": 0, "deviation-heading": 0.25308344122102144, "deviation-center-line": 0.3177777172601363}, "ep002": {"driven_any": 0.4357300422811418, "driven_lanedir": 0.4264082690608777, "in-drivable-lane": 0, "deviation-heading": 0.6164308786648545, "deviation-center-line": 0.4006920974819611}, "ep003": {"driven_any": 0.18570803887587417, "driven_lanedir": 0.1605528432369332, "in-drivable-lane": 0, "deviation-heading": 0.7780304126506045, "deviation-center-line": 0.12137529223058054}, "ep004": {"driven_any": 0.24285122049109056, "driven_lanedir": 0.2285766514575469, "in-drivable-lane": 0, "deviation-heading": 0.5637903346516211, "deviation-center-line": 0.2049052230838569}}
No reset possible
7160682Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7153680Vadim Volodin 🇷🇺Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7146686Anna Tsalapova 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.31138697990640174
deviation-center-line_median0.2676004326803052
in-drivable-lane_median0


other stats
deviation-center-line_max0.36002040891302733
deviation-center-line_mean0.2815267715274968
deviation-center-line_min0.20574893771960487
deviation-heading_max1.7771766008961405
deviation-heading_mean0.8095693906304795
deviation-heading_median0.6255942094536937
deviation-heading_min0.23333627674604035
driven_any_max0.5714346839198894
driven_any_mean0.39072631979727646
driven_any_median0.4250183935623863
driven_any_min0.2357200426673864
driven_lanedir_max0.45481661335724555
driven_lanedir_mean0.3296022216572411
driven_lanedir_min0.21708366796949363
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5714346839198894, "driven_lanedir": 0.31138697990640174, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7771766008961405, "deviation-center-line": 0.2155232544596732}, "ep001": {"driven_any": 0.25358709522832873, "driven_lanedir": 0.2521320933772193, "in-drivable-lane": 0, "deviation-heading": 0.23333627674604035, "deviation-center-line": 0.2676004326803052}, "ep002": {"driven_any": 0.4250183935623863, "driven_lanedir": 0.41259175367584544, "in-drivable-lane": 0, "deviation-heading": 0.6255942094536937, "deviation-center-line": 0.36002040891302733}, "ep003": {"driven_any": 0.4678713836083913, "driven_lanedir": 0.45481661335724555, "in-drivable-lane": 0, "deviation-heading": 0.8025525215247044, "deviation-center-line": 0.35874082386487316}, "ep004": {"driven_any": 0.2357200426673864, "driven_lanedir": 0.21708366796949363, "in-drivable-lane": 0, "deviation-heading": 0.609187344531819, "deviation-center-line": 0.20574893771960487}}
No reset possible
7142686Anna Tsalapova 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7140686Anna Tsalapova 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.033333333333329


other stats
episodes
details{"ep000": {"nsteps": 162, "reward": -6.298381745919476, "good_angle": 1.2143208017681504, "survival_time": 5.399999999999991, "traveled_tiles": 2, "valid_direction": 1.699999999999994}, "ep001": {"nsteps": 73, "reward": -14.278019573182275, "good_angle": 0.02735622974691657, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 121, "reward": -8.727037758374017, "good_angle": 0.29314793594950317, "survival_time": 4.033333333333329, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep003": {"nsteps": 133, "reward": -7.929723706964712, "good_angle": 0.2956070282426133, "survival_time": 4.433333333333327, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep004": {"nsteps": 68, "reward": -15.197884105145931, "good_angle": 0.4127440318052308, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.5666666666666664}}
good_angle_max1.2143208017681504
good_angle_mean0.4486352055024828
good_angle_median0.2956070282426133
good_angle_min0.02735622974691657
reward_max-6.298381745919476
reward_mean-10.486209377917282
reward_median-8.727037758374017
reward_min-15.197884105145931
survival_time_max5.399999999999991
survival_time_mean3.71333333333333
survival_time_min2.2666666666666684
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.699999999999994
valid_direction_mean0.6266666666666648
valid_direction_median0.4333333333333318
valid_direction_min0
No reset possible
7130686Anna Tsalapova 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7117694Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.41821185446825937
deviation-center-line_median0.13052950702115704
in-drivable-lane_median0


other stats
deviation-center-line_max2.1412888979001576
deviation-center-line_mean0.528139925822931
deviation-center-line_min0.0823851669008786
deviation-heading_max1.8771939929266048
deviation-heading_mean0.522495954200477
deviation-heading_median0.20864534735856888
deviation-heading_min0.07936420360036045
driven_any_max5.335168421842062
driven_any_mean1.4033844416518628
driven_any_median0.4284619447723728
driven_any_min0.27833027265841837
driven_lanedir_max3.92925581850529
driven_lanedir_mean1.1165375849438717
driven_lanedir_min0.26746477056569784
in-drivable-lane_max3.96666666666669
in-drivable-lane_mean0.793333333333338
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.335168421842062, "driven_lanedir": 3.92925581850529, "in-drivable-lane": 3.96666666666669, "deviation-heading": 1.8771939929266048, "deviation-center-line": 2.1412888979001576}, "ep001": {"driven_any": 0.28930564103593726, "driven_lanedir": 0.28809462878381664, "in-drivable-lane": 0, "deviation-heading": 0.07936420360036045, "deviation-center-line": 0.10128937722954191}, "ep002": {"driven_any": 0.4284619447723728, "driven_lanedir": 0.41821185446825937, "in-drivable-lane": 0, "deviation-heading": 0.2021335532960725, "deviation-center-line": 0.13052950702115704}, "ep003": {"driven_any": 0.6856559279505237, "driven_lanedir": 0.6796608523962941, "in-drivable-lane": 0, "deviation-heading": 0.24514267382077864, "deviation-center-line": 0.1852066800629204}, "ep004": {"driven_any": 0.27833027265841837, "driven_lanedir": 0.26746477056569784, "in-drivable-lane": 0, "deviation-heading": 0.20864534735856888, "deviation-center-line": 0.0823851669008786}}
No reset possible
7114694Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7110695Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7106695Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9000000000000024


other stats
episodes
details{"ep000": {"nsteps": 207, "reward": -5.075237931504256, "good_angle": 0.3368281585779238, "survival_time": 6.899999999999985, "traveled_tiles": 3, "valid_direction": 0.3999999999999988}, "ep001": {"nsteps": 51, "reward": -20.179373666936275, "good_angle": 0.013250600510246915, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 37, "reward": -27.527634460378337, "good_angle": 0.4989038091641797, "survival_time": 1.2333333333333338, "traveled_tiles": 2, "valid_direction": 0.6666666666666672}, "ep003": {"nsteps": 95, "reward": -10.92723784125165, "good_angle": 0.30898954368795667, "survival_time": 3.166666666666665, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep004": {"nsteps": 57, "reward": -18.03258322780592, "good_angle": 0.3858975034948594, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.533333333333335}}
good_angle_max0.4989038091641797
good_angle_mean0.3087739230870333
good_angle_median0.3368281585779238
good_angle_min0.013250600510246915
reward_max-5.075237931504256
reward_mean-16.34841342557529
reward_median-18.03258322780592
reward_min-27.527634460378337
survival_time_max6.899999999999985
survival_time_mean2.9799999999999978
survival_time_min1.2333333333333338
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.6666666666666672
valid_direction_mean0.40666666666666657
valid_direction_median0.4333333333333318
valid_direction_min0
No reset possible
7096695Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7087697Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7081703Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.985960888453684
deviation-center-line_median0.3316282739140341
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.5263014249450844
deviation-center-line_mean0.3657556648283331
deviation-center-line_min0.20927762643906303
deviation-heading_max2.0233458066794565
deviation-heading_mean1.0412741347161538
deviation-heading_median0.983736770512144
deviation-heading_min0.18659482956274165
driven_any_max1.599659838212718
driven_any_mean0.8872017008738127
driven_any_median0.9881170809400164
driven_any_min0.3024324871138906
driven_lanedir_max1.257986435824977
driven_lanedir_mean0.7651581122757557
driven_lanedir_min0.1535174434632688
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean0.5533333333333318
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.36517644671645305, "driven_lanedir": 0.1535174434632688, "in-drivable-lane": 0.6, "deviation-heading": 2.0233458066794565, "deviation-center-line": 0.20927762643906303}, "ep001": {"driven_any": 0.3024324871138906, "driven_lanedir": 0.3013152376601651, "in-drivable-lane": 0, "deviation-heading": 0.18659482956274165, "deviation-center-line": 0.23988806576920604}, "ep002": {"driven_any": 1.1806226513859843, "driven_lanedir": 1.127010555976684, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 0.983736770512144, "deviation-center-line": 0.5263014249450844}, "ep003": {"driven_any": 0.9881170809400164, "driven_lanedir": 0.985960888453684, "in-drivable-lane": 0, "deviation-heading": 0.4494073382150737, "deviation-center-line": 0.5216829330742779}, "ep004": {"driven_any": 1.599659838212718, "driven_lanedir": 1.257986435824977, "in-drivable-lane": 1.999999999999993, "deviation-heading": 1.5632859286113523, "deviation-center-line": 0.3316282739140341}}
No reset possible
7072703Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7058717Mikita Sazanovich 🇷🇺PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.014829571594378477
deviation-center-line_median0.5158599622303721
in-drivable-lane_median7.499999999999974


other stats
deviation-center-line_max0.7894100851027657
deviation-center-line_mean0.4226299060803923
deviation-center-line_min0
deviation-heading_max6.565470517960705
deviation-heading_mean5.168740436686087
deviation-heading_median6.446194473336412
deviation-heading_min0
driven_any_max0.04638568884686974
driven_any_mean0.04082964152172745
driven_any_median0.03944062937732364
driven_any_min0.039440629376751295
driven_lanedir_max0.014926061780292432
driven_lanedir_mean0.011877651544317167
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean9.326666666666643
in-drivable-lane_min7.499999999999974
per-episodes
details{"ep000": {"driven_any": 0.04638568884686974, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.039440629376751295, "driven_lanedir": 0.014926061780292432, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.35137730604908, "deviation-center-line": 0.7894100851027657}, "ep002": {"driven_any": 0.03944062937681773, "driven_lanedir": 0.014829571594378477, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.480659886084238, "deviation-center-line": 0.5158599622303721}, "ep003": {"driven_any": 0.03944063063087483, "driven_lanedir": 0.01488347041430904, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.446194473336412, "deviation-center-line": 0.22611077060231463}, "ep004": {"driven_any": 0.03944062937732364, "driven_lanedir": 0.014749153932605896, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.565470517960705, "deviation-center-line": 0.581768712466509}}
No reset possible
7051717Mikita Sazanovich 🇷🇺PyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7042719Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4366447299532587
deviation-center-line_median0.12725035871119866
in-drivable-lane_median0


other stats
deviation-center-line_max0.17946472266952915
deviation-center-line_mean0.12527037807415553
deviation-center-line_min0.04463202661702347
deviation-heading_max0.5002463173837549
deviation-heading_mean0.320803904643936
deviation-heading_median0.4512647638492277
deviation-heading_min0.03952729996388999
driven_any_max1.0300575251882975
driven_any_mean0.5074553265283417
driven_any_median0.44858695106391305
driven_any_min0.235731344087411
driven_lanedir_max0.8063917747764366
driven_lanedir_mean0.45672956645993407
driven_lanedir_min0.2345382196861281
in-drivable-lane_max1.0666666666666669
in-drivable-lane_mean0.21333333333333332
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0300575251882975, "driven_lanedir": 0.8063917747764366, "in-drivable-lane": 1.0666666666666669, "deviation-heading": 0.5002463173837549, "deviation-center-line": 0.17946472266952915}, "ep001": {"driven_any": 0.235731344087411, "driven_lanedir": 0.2345382196861281, "in-drivable-lane": 0, "deviation-heading": 0.03952729996388999, "deviation-center-line": 0.04463202661702347}, "ep002": {"driven_any": 0.44858695106391305, "driven_lanedir": 0.4366447299532587, "in-drivable-lane": 0, "deviation-heading": 0.4572125571655401, "deviation-center-line": 0.17076299134918638}, "ep003": {"driven_any": 0.5657511091026461, "driven_lanedir": 0.5619952738638605, "in-drivable-lane": 0, "deviation-heading": 0.15576858485726697, "deviation-center-line": 0.10424179102383992}, "ep004": {"driven_any": 0.25714970319943997, "driven_lanedir": 0.24407783401998628, "in-drivable-lane": 0, "deviation-heading": 0.4512647638492277, "deviation-center-line": 0.12725035871119866}}
No reset possible
7040719Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7038719Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.466666666666668


other stats
episodes
details{"ep000": {"nsteps": 109, "reward": -9.393621907116623, "good_angle": 0.1661673181162158, "survival_time": 3.63333333333333, "traveled_tiles": 3, "valid_direction": 0.2666666666666675}, "ep001": {"nsteps": 13, "reward": -77.46549738828952, "good_angle": 0.00404488976206659, "survival_time": 0.4333333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 55, "reward": -18.685888680002908, "good_angle": 0.3232679514009352, "survival_time": 1.8333333333333357, "traveled_tiles": 2, "valid_direction": 0.4333333333333347}, "ep003": {"nsteps": 44, "reward": -23.070657879791476, "good_angle": 0.01975065514980769, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 40, "reward": -25.532332188636065, "good_angle": 0.34517285474987, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.4666666666666675}}
good_angle_max0.34517285474987
good_angle_mean0.17168073383577903
good_angle_median0.1661673181162158
good_angle_min0.00404488976206659
reward_max-9.393621907116623
reward_mean-30.829599608767317
reward_median-23.070657879791476
reward_min-77.46549738828952
survival_time_max3.63333333333333
survival_time_mean1.7400000000000002
survival_time_min0.4333333333333333
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.4666666666666675
valid_direction_mean0.23333333333333392
valid_direction_median0.2666666666666675
valid_direction_min0
No reset possible
7030719Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7027721Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.27166145187899216
deviation-center-line_median0.06982684751280697
in-drivable-lane_median0


other stats
deviation-center-line_max0.09121055353973138
deviation-center-line_mean0.07130333073964615
deviation-center-line_min0.05456890085637663
deviation-heading_max0.944685763458342
deviation-heading_mean0.3834970165266852
deviation-heading_median0.3264354941499832
deviation-heading_min0.05021748795992387
driven_any_max0.5284609511802155
driven_any_mean0.33849801886083447
driven_any_median0.28137456043563647
driven_any_min0.18279801253754996
driven_lanedir_max0.48202969322924094
driven_lanedir_mean0.276481825484506
driven_lanedir_min0.1543739659564478
in-drivable-lane_max0.6666666666666666
in-drivable-lane_mean0.13333333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5284609511802155, "driven_lanedir": 0.27166145187899216, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 0.944685763458342, "deviation-center-line": 0.08501350579060386}, "ep001": {"driven_any": 0.28137456043563647, "driven_lanedir": 0.27965589558635484, "in-drivable-lane": 0, "deviation-heading": 0.05021748795992387, "deviation-center-line": 0.05589684599871194}, "ep002": {"driven_any": 0.4856321857248615, "driven_lanedir": 0.48202969322924094, "in-drivable-lane": 0, "deviation-heading": 0.1001570248122372, "deviation-center-line": 0.09121055353973138}, "ep003": {"driven_any": 0.18279801253754996, "driven_lanedir": 0.1543739659564478, "in-drivable-lane": 0, "deviation-heading": 0.49598931225293985, "deviation-center-line": 0.05456890085637663}, "ep004": {"driven_any": 0.21422438442590885, "driven_lanedir": 0.19468812077149433, "in-drivable-lane": 0, "deviation-heading": 0.3264354941499832, "deviation-center-line": 0.06982684751280697}}
No reset possible
7024721Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7021721Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.8999999999999999


other stats
episodes
details{"ep000": {"nsteps": 70, "reward": -14.459956789069942, "good_angle": 0.7379630217116221, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.3000000000000005}, "ep001": {"nsteps": 16, "reward": -63.05317232757807, "good_angle": 0.006916687727668338, "survival_time": 0.5333333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 29, "reward": -34.96981922614163, "good_angle": 0.015756994520687698, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 27, "reward": -37.39793286389775, "good_angle": 0.4596092159046318, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.6333333333333333}, "ep004": {"nsteps": 25, "reward": -40.46419783353806, "good_angle": 0.2232183073046352, "survival_time": 0.8333333333333333, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}}
good_angle_max0.7379630217116221
good_angle_mean0.288692845433849
good_angle_median0.2232183073046352
good_angle_min0.006916687727668338
reward_max-14.459956789069942
reward_mean-38.06901580804509
reward_median-37.39793286389775
reward_min-63.05317232757807
survival_time_max2.333333333333335
survival_time_mean1.1133333333333335
survival_time_min0.5333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3000000000000005
valid_direction_mean0.4800000000000001
valid_direction_median0.4666666666666666
valid_direction_min0
No reset possible
7014723Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5738440970339456
deviation-center-line_median0.12235017075498116
in-drivable-lane_median0


other stats
deviation-center-line_max0.9204496299052368
deviation-center-line_mean0.2862257955043034
deviation-center-line_min0.05310501647711141
deviation-heading_max2.2495007574776156
deviation-heading_mean0.916547186592467
deviation-heading_median0.7874587575394523
deviation-heading_min0.07515429016980169
driven_any_max4.363284148336103
driven_any_mean1.401504112763503
driven_any_median0.8117609083006859
driven_any_min0.060343962049002074
driven_lanedir_max3.5896468747956014
driven_lanedir_mean1.1749729389813997
driven_lanedir_min0.04835882741583486
in-drivable-lane_max1.0333333333333297
in-drivable-lane_mean0.2866666666666659
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8117609083006859, "driven_lanedir": 0.5738440970339456, "in-drivable-lane": 0.4, "deviation-heading": 0.7874587575394523, "deviation-center-line": 0.12235017075498116}, "ep001": {"driven_any": 0.060343962049002074, "driven_lanedir": 0.04835882741583486, "in-drivable-lane": 0, "deviation-heading": 0.31846381037490124, "deviation-center-line": 0.05310501647711141}, "ep002": {"driven_any": 0.2909839292685916, "driven_lanedir": 0.28685044249406455, "in-drivable-lane": 0, "deviation-heading": 0.07515429016980169, "deviation-center-line": 0.055114925912600816}, "ep003": {"driven_any": 4.363284148336103, "driven_lanedir": 3.5896468747956014, "in-drivable-lane": 1.0333333333333297, "deviation-heading": 2.2495007574776156, "deviation-center-line": 0.9204496299052368}, "ep004": {"driven_any": 1.481147615863133, "driven_lanedir": 1.3761644531675514, "in-drivable-lane": 0, "deviation-heading": 1.1521583174005647, "deviation-center-line": 0.2801092344715864}}
No reset possible
7011723Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7009723Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1666666666666687


other stats
episodes
details{"ep000": {"nsteps": 65, "reward": -15.644166091679097, "good_angle": 0.5615742626996267, "survival_time": 2.1666666666666687, "traveled_tiles": 2, "valid_direction": 1.1000000000000003}, "ep001": {"nsteps": 14, "reward": -72.14171672293118, "good_angle": 0.314739678970929, "survival_time": 0.4666666666666666, "traveled_tiles": 1, "valid_direction": 0.3999999999999999}, "ep002": {"nsteps": 18, "reward": -56.03072348568175, "good_angle": 0.013703167782588843, "survival_time": 0.6, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 283, "reward": -3.914150375292831, "good_angle": 1.1112920954178704, "survival_time": 9.43333333333331, "traveled_tiles": 9, "valid_direction": 2.5333333333333266}, "ep004": {"nsteps": 104, "reward": -9.805047729966017, "good_angle": 4.575055184868748, "survival_time": 3.466666666666664, "traveled_tiles": 4, "valid_direction": 1.7333333333333305}}
good_angle_max4.575055184868748
good_angle_mean1.3152728779479526
good_angle_median0.5615742626996267
good_angle_min0.013703167782588843
reward_max-3.914150375292831
reward_mean-31.507160881110178
reward_median-15.644166091679097
reward_min-72.14171672293118
survival_time_max9.43333333333331
survival_time_mean3.226666666666662
survival_time_min0.4666666666666666
traveled_tiles_max9
traveled_tiles_mean3.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.5333333333333266
valid_direction_mean1.1533333333333315
valid_direction_median1.1000000000000003
valid_direction_min0
No reset possible
6995723Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6974743Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6968751Philippe LacailleROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2503015040334695
deviation-center-line_median0.23026838249227685
in-drivable-lane_median0


other stats
deviation-center-line_max0.3556118232850458
deviation-center-line_mean0.2508226180564321
deviation-center-line_min0.14421785024309844
deviation-heading_max1.7285404828584428
deviation-heading_mean0.7895011572921733
deviation-heading_median0.624093438615076
deviation-heading_min0.2212772212020476
driven_any_max0.7857441320161966
driven_any_mean0.3714350911233368
driven_any_median0.2642812444160832
driven_any_min0.17498150766952306
driven_lanedir_max0.5456865504653916
driven_lanedir_mean0.31427380551167
driven_lanedir_min0.15750039087200007
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7857441320161966, "driven_lanedir": 0.5456865504653916, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7285404828584428, "deviation-center-line": 0.3358347523404327}, "ep001": {"driven_any": 0.17858036162321272, "driven_lanedir": 0.1768420097533201, "in-drivable-lane": 0, "deviation-heading": 0.2212772212020476, "deviation-center-line": 0.1881802819213067}, "ep002": {"driven_any": 0.17498150766952306, "driven_lanedir": 0.15750039087200007, "in-drivable-lane": 0, "deviation-heading": 0.624093438615076, "deviation-center-line": 0.14421785024309844}, "ep003": {"driven_any": 0.4535882098916684, "driven_lanedir": 0.4410385724341688, "in-drivable-lane": 0, "deviation-heading": 0.7916045101889103, "deviation-center-line": 0.3556118232850458}, "ep004": {"driven_any": 0.2642812444160832, "driven_lanedir": 0.2503015040334695, "in-drivable-lane": 0, "deviation-heading": 0.5819901335963901, "deviation-center-line": 0.23026838249227685}}
No reset possible
6964751Philippe LacailleROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6958748Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6954841Yun Chen 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.200000000000002


other stats
episodes
details{"ep000": {"nsteps": 161, "reward": -6.3366512591492885, "good_angle": 1.431965613446931, "survival_time": 5.366666666666657, "traveled_tiles": 2, "valid_direction": 1.6666666666666607}, "ep001": {"nsteps": 98, "reward": -10.796505676240336, "good_angle": 0.2002026267258306, "survival_time": 3.266666666666665, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 47, "reward": -21.76382921287354, "good_angle": 0.3564300186337092, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.7333333333333348}, "ep003": {"nsteps": 59, "reward": -17.30805952948029, "good_angle": 0.4764891418712454, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.8000000000000025}, "ep004": {"nsteps": 66, "reward": -15.63450666945992, "good_angle": 0.3912094516293645, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6000000000000003}}
good_angle_max1.431965613446931
good_angle_mean0.5712593704614162
good_angle_median0.3912094516293645
good_angle_min0.2002026267258306
reward_max-6.3366512591492885
reward_mean-14.367910469440677
reward_median-15.63450666945992
reward_min-21.76382921287354
survival_time_max5.366666666666657
survival_time_mean2.8733333333333326
survival_time_min1.5666666666666682
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.6666666666666607
valid_direction_mean0.8133333333333328
valid_direction_median0.7333333333333348
valid_direction_min0.2666666666666657
No reset possible
6947740Andrea Censi 🇨🇭Copy of #15: sub 574 by trimcao (PyTorch template)aido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5614275299281082
deviation-center-line_median0.24074572260838195
in-drivable-lane_median2.7333333333333236


other stats
deviation-center-line_max0.4858359449710459
deviation-center-line_mean0.2714970349116245
deviation-center-line_min0.15662464623297012
deviation-heading_max2.7826572858730247
deviation-heading_mean1.318271980947146
deviation-heading_median0.909090330317573
deviation-heading_min0.2943028797757328
driven_any_max1.271188928326132
driven_any_mean0.8292849181224229
driven_any_median1.1211700327286362
driven_any_min0.13532939296734506
driven_lanedir_max0.6746418481169767
driven_lanedir_mean0.4171338714425306
driven_lanedir_min0.12977188347704827
in-drivable-lane_max4.56666666666665
in-drivable-lane_mean2.3266666666666587
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.35308307867448174, "driven_lanedir": 0.12977188347704827, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 1.7051569266381157, "deviation-center-line": 0.169573081051767}, "ep001": {"driven_any": 0.13532939296734506, "driven_lanedir": 0.1302066794455139, "in-drivable-lane": 0, "deviation-heading": 0.2943028797757328, "deviation-center-line": 0.15662464623297012}, "ep002": {"driven_any": 1.2656531579155192, "driven_lanedir": 0.6746418481169767, "in-drivable-lane": 2.7333333333333236, "deviation-heading": 2.7826572858730247, "deviation-center-line": 0.4858359449710459}, "ep003": {"driven_any": 1.271188928326132, "driven_lanedir": 0.5614275299281082, "in-drivable-lane": 4.56666666666665, "deviation-heading": 0.909090330317573, "deviation-center-line": 0.3047057796939576}, "ep004": {"driven_any": 1.1211700327286362, "driven_lanedir": 0.5896214162450066, "in-drivable-lane": 3.533333333333321, "deviation-heading": 0.9001524821312847, "deviation-center-line": 0.24074572260838195}}
No reset possible
6936767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:04:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.3951592279035328
deviation-center-line_median0.9209023156556018
in-drivable-lane_median0


other stats
deviation-center-line_max1.153170231723081
deviation-center-line_mean0.8814908991333796
deviation-center-line_min0.5775873104006392
deviation-heading_max3.1865238405586487
deviation-heading_mean1.4572051480522077
deviation-heading_median1.2092223609379702
deviation-heading_min0.5045415745149314
driven_any_max1.7787016440800651
driven_any_mean1.357224840138994
driven_any_median1.4965184567385157
driven_any_min0.632160064765642
driven_lanedir_max1.7765097039916993
driven_lanedir_mean1.2776032798047894
driven_lanedir_min0.6007379205207939
in-drivable-lane_max1.9666666666666692
in-drivable-lane_mean0.4066666666666672
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.7786763540123485, "driven_lanedir": 1.544686227965359, "in-drivable-lane": 1.9666666666666692, "deviation-heading": 1.3154095626075617, "deviation-center-line": 0.9615218532951404}, "ep001": {"driven_any": 0.632160064765642, "driven_lanedir": 0.6007379205207939, "in-drivable-lane": 0, "deviation-heading": 1.2092223609379702, "deviation-center-line": 0.5775873104006392}, "ep002": {"driven_any": 1.4965184567385157, "driven_lanedir": 1.3951592279035328, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.1865238405586487, "deviation-center-line": 0.9209023156556018}, "ep003": {"driven_any": 1.7787016440800651, "driven_lanedir": 1.7765097039916993, "in-drivable-lane": 0, "deviation-heading": 0.5045415745149314, "deviation-center-line": 1.153170231723081}, "ep004": {"driven_any": 1.1000676810983998, "driven_lanedir": 1.0709233186425622, "in-drivable-lane": 0, "deviation-heading": 1.0703284016419266, "deviation-center-line": 0.7942727845924359}}
No reset possible
6928767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6925767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.033333333333294


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.253138579121558, "good_angle": 0.4900760890824776, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0.7666666666666642}, "ep001": {"nsteps": 179, "reward": -6.190601719741049, "good_angle": 6.186553177054577, "survival_time": 5.966666666666655, "traveled_tiles": 2, "valid_direction": 1.2999999999999954}, "ep002": {"nsteps": 421, "reward": -2.665209446491584, "good_angle": 1.319257070271045, "survival_time": 14.033333333333294, "traveled_tiles": 4, "valid_direction": 1.0666666666666629}, "ep003": {"nsteps": 500, "reward": -0.3370800910294056, "good_angle": 0.04797618386752133, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 310, "reward": -3.620830317081944, "good_angle": 1.6901437714687553, "survival_time": 10.333333333333307, "traveled_tiles": 3, "valid_direction": 0.7999999999999972}}
good_angle_max6.186553177054577
good_angle_mean1.946801258348875
good_angle_median1.319257070271045
good_angle_min0.04797618386752133
reward_max-0.253138579121558
reward_mean-2.613372030693108
reward_median-2.665209446491584
reward_min-6.190601719741049
survival_time_max16.666666666666654
survival_time_mean12.733333333333311
survival_time_min5.966666666666655
traveled_tiles_max4
traveled_tiles_mean3.4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max1.2999999999999954
valid_direction_mean0.7866666666666638
valid_direction_median0.7999999999999972
valid_direction_min0
No reset possible
6897767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:07:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6882765Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0721548581068183
deviation-center-line_median0.659154295227623
in-drivable-lane_median0.6333333333333333


other stats
deviation-center-line_max1.0309770090866746
deviation-center-line_mean0.60523882244769
deviation-center-line_min0.2027063719180269
deviation-heading_max3.964069905718704
deviation-heading_mean2.4990647637071626
deviation-heading_median2.0397009753183077
deviation-heading_min0.9234000545513706
driven_any_max2.116332619691193
driven_any_mean1.2653763627252677
driven_any_median1.184565950014441
driven_any_min0.3618917482823966
driven_lanedir_max2.0458183965948344
driven_lanedir_mean1.038320123798816
driven_lanedir_min0.1442496989940112
in-drivable-lane_max0.8666666666666636
in-drivable-lane_mean0.5799999999999984
in-drivable-lane_min0.1999999999999993
per-episodes
details{"ep000": {"driven_any": 0.3618917482823966, "driven_lanedir": 0.1442496989940112, "in-drivable-lane": 0.6333333333333333, "deviation-heading": 2.033526113951627, "deviation-center-line": 0.2027063719180269}, "ep001": {"driven_any": 1.06082089878508, "driven_lanedir": 0.6906705694482811, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 3.5346267689958037, "deviation-center-line": 0.659154295227623}, "ep002": {"driven_any": 1.184565950014441, "driven_lanedir": 1.0721548581068183, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 2.0397009753183077, "deviation-center-line": 0.40881065593869054}, "ep003": {"driven_any": 2.116332619691193, "driven_lanedir": 2.0458183965948344, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 0.9234000545513706, "deviation-center-line": 1.0309770090866746}, "ep004": {"driven_any": 1.603270596853227, "driven_lanedir": 1.2387070958501347, "in-drivable-lane": 0.8666666666666636, "deviation-heading": 3.964069905718704, "deviation-center-line": 0.7245457800674345}}
No reset possible
6878765Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6875765Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.566666666666647


other stats
episodes
details{"ep000": {"nsteps": 80, "reward": -12.758418948506003, "good_angle": 1.2814019700173669, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 2.2}, "ep001": {"nsteps": 229, "reward": -5.425126334725509, "good_angle": 15.74563080168776, "survival_time": 7.633333333333316, "traveled_tiles": 2, "valid_direction": 3.899999999999986}, "ep002": {"nsteps": 257, "reward": -3.97979418733583, "good_angle": 1.0734557794135722, "survival_time": 8.566666666666647, "traveled_tiles": 3, "valid_direction": 1.9666666666666608}, "ep003": {"nsteps": 456, "reward": -2.6816790554868546, "good_angle": 0.9501227254895194, "survival_time": 15.199999999999957, "traveled_tiles": 4, "valid_direction": 2.199999999999992}, "ep004": {"nsteps": 346, "reward": -3.6106259491966872, "good_angle": 21.817265579961138, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}
good_angle_max21.817265579961138
good_angle_mean8.17357537131387
good_angle_median1.2814019700173669
good_angle_min0.9501227254895194
reward_max-2.6816790554868546
reward_mean-5.691128895050177
reward_median-3.97979418733583
reward_min-12.758418948506003
survival_time_max15.199999999999957
survival_time_mean9.11999999999998
survival_time_min2.666666666666667
traveled_tiles_max4
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.93333333333332
valid_direction_mean2.839999999999992
valid_direction_median2.2
valid_direction_min1.9666666666666608
No reset possible
6860779Aleksandar Petrov 🇨🇭Random executionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1407957446895125
deviation-center-line_median0.5242691687411398
in-drivable-lane_median0.1999999999999993


other stats
deviation-center-line_max0.7542062213571629
deviation-center-line_mean0.49747654752323384
deviation-center-line_min0.21312211875706255
deviation-heading_max4.531165407492779
deviation-heading_mean2.2206973005344386
deviation-heading_median1.7876920944346557
deviation-heading_min1.0229540538019115
driven_any_max2.1173213189678965
driven_any_mean1.266644330982707
driven_any_median1.1800557139677663
driven_any_min0.3736875733207174
driven_lanedir_max2.0281225915699763
driven_lanedir_mean1.0569132974993316
driven_lanedir_min0.165114373534616
in-drivable-lane_max1.8333333333333268
in-drivable-lane_mean0.5599999999999985
in-drivable-lane_min0.033333333333333215
per-episodes
details{"ep000": {"driven_any": 0.3736875733207174, "driven_lanedir": 0.165114373534616, "in-drivable-lane": 0.6, "deviation-heading": 2.0265254728905995, "deviation-center-line": 0.21312211875706255}, "ep001": {"driven_any": 1.0640896478374515, "driven_lanedir": 0.6978521899608232, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 4.531165407492779, "deviation-center-line": 0.7542062213571629}, "ep002": {"driven_any": 1.1800557139677663, "driven_lanedir": 1.1407957446895125, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.0229540538019115, "deviation-center-line": 0.5842089356035222}, "ep003": {"driven_any": 2.1173213189678965, "driven_lanedir": 2.0281225915699763, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.7351494740522475, "deviation-center-line": 0.41157629315728206}, "ep004": {"driven_any": 1.598067400819703, "driven_lanedir": 1.2526815877417294, "in-drivable-lane": 1.8333333333333268, "deviation-heading": 1.7876920944346557, "deviation-center-line": 0.5242691687411398}}
No reset possible
6849781Aneri MuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6563528361539146
deviation-center-line_median0.2953971598388384
in-drivable-lane_median0.5333333333333333


other stats
deviation-center-line_max0.6647032776516654
deviation-center-line_mean0.3725370031291633
deviation-center-line_min0.15844274308335793
deviation-heading_max3.5770000783727793
deviation-heading_mean2.0132571220501334
deviation-heading_median1.87793503883297
deviation-heading_min0.3275083836010684
driven_any_max1.6103720212868673
driven_any_mean0.9681277352122944
driven_any_median1.0935520511365866
driven_any_min0.3327271210224425
driven_lanedir_max1.2429579850638162
driven_lanedir_mean0.6158989768051985
driven_lanedir_min0.09515152751007494
in-drivable-lane_max4.999999999999983
in-drivable-lane_mean1.3599999999999957
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3327271210224425, "driven_lanedir": 0.09515152751007494, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.87793503883297, "deviation-center-line": 0.15844274308335793}, "ep001": {"driven_any": 1.0935520511365866, "driven_lanedir": 0.7563867063502803, "in-drivable-lane": 0.5333333333333314, "deviation-heading": 3.5770000783727793, "deviation-center-line": 0.5476508542770249}, "ep002": {"driven_any": 0.3331003527683718, "driven_lanedir": 0.32864582894790617, "in-drivable-lane": 0, "deviation-heading": 0.3275083836010684, "deviation-center-line": 0.19649098079493005}, "ep003": {"driven_any": 1.4708871298472035, "driven_lanedir": 0.6563528361539146, "in-drivable-lane": 4.999999999999983, "deviation-heading": 1.0476944878622192, "deviation-center-line": 0.2953971598388384}, "ep004": {"driven_any": 1.6103720212868673, "driven_lanedir": 1.2429579850638162, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.2361476215816305, "deviation-center-line": 0.6647032776516654}}
No reset possible
6847780Amaury Camus 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringabortedyesrudolf-30:00:12
Error while running [...]

Creating job6847-785_scorer_1 ... error
stderr | ERROR: for job6847-785_scorer_1  Cannot start service scorer: network job6847-785_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job6847-785_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6840784hanxue liangRandom executionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9535632523879292
deviation-center-line_median0.5050589613909403
in-drivable-lane_median0.6


other stats
deviation-center-line_max0.7340217062233995
deviation-center-line_mean0.4941162630827126
deviation-center-line_min0.19937546267915807
deviation-heading_max3.5645313256019793
deviation-heading_mean2.0753876787679246
deviation-heading_median2.04383053392832
deviation-heading_min0.4620990996983617
driven_any_max1.601085444156911
driven_any_mean1.0315173997395526
driven_any_median1.0641112941764688
driven_any_min0.35675991573719024
driven_lanedir_max1.2704316086486327
driven_lanedir_mean0.8349856317116853
driven_lanedir_min0.1383008739907522
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean0.5199999999999986
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.35675991573719024, "driven_lanedir": 0.1383008739907522, "in-drivable-lane": 0.6, "deviation-heading": 2.04383053392832, "deviation-center-line": 0.19937546267915807}, "ep001": {"driven_any": 1.0641112941764688, "driven_lanedir": 0.6791487391740294, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 3.076903128694505, "deviation-center-line": 0.7340217062233995}, "ep002": {"driven_any": 1.179678251503955, "driven_lanedir": 1.1334836843570824, "in-drivable-lane": 0, "deviation-heading": 1.2295743059164557, "deviation-center-line": 0.4040338730970795}, "ep003": {"driven_any": 0.955952093123238, "driven_lanedir": 0.9535632523879292, "in-drivable-lane": 0, "deviation-heading": 0.4620990996983617, "deviation-center-line": 0.5050589613909403}, "ep004": {"driven_any": 1.601085444156911, "driven_lanedir": 1.2704316086486327, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 3.5645313256019793, "deviation-center-line": 0.6280913120229862}}
No reset possible
6835784hanxue liangRandom executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6830784hanxue liangRandom executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.666666666666649


other stats
episodes
details{"ep000": {"nsteps": 78, "reward": -13.087629712911363, "good_angle": 1.2821741440032746, "survival_time": 2.6000000000000005, "traveled_tiles": 1, "valid_direction": 2.166666666666667}, "ep001": {"nsteps": 230, "reward": -5.449980183010516, "good_angle": 15.872284449138792, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 256, "reward": -4.339372618997004, "good_angle": 0.9559061475489112, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 2.033333333333327}, "ep003": {"nsteps": 208, "reward": -5.158497487839598, "good_angle": 0.034618722226127385, "survival_time": 6.9333333333333185, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 344, "reward": -3.434135173082617, "good_angle": 20.69529131474115, "survival_time": 11.466666666666637, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}
good_angle_max20.69529131474115
good_angle_mean7.768054955531651
good_angle_median1.2821741440032746
good_angle_min0.034618722226127385
reward_max-3.434135173082617
reward_mean-6.29392303516822
reward_median-5.158497487839598
reward_min-13.087629712911363
survival_time_max11.466666666666637
survival_time_mean7.439999999999984
survival_time_min2.6000000000000005
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.93333333333332
valid_direction_mean2.413333333333327
valid_direction_median2.166666666666667
valid_direction_min0
No reset possible
6822784hanxue liangRandom executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6810794Manish PrajapatAMOD18-AIDOaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0975104838575374
deviation-center-line_median0.3720201123073816
in-drivable-lane_median0.13333333333333286


other stats
deviation-center-line_max0.4541373215127029
deviation-center-line_mean0.3507053828650312
deviation-center-line_min0.19546767479674484
deviation-heading_max3.0740263186576424
deviation-heading_mean1.672933347136924
deviation-heading_median1.8152400519493184
deviation-heading_min0.19235115945583048
driven_any_max2.1132891369070976
driven_any_mean1.129574444404366
driven_any_median1.1882516789969753
driven_any_min0.35095844031089335
driven_lanedir_max2.0714299686515347
driven_lanedir_mean0.9924234339988824
driven_lanedir_min0.13159776440139714
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.3466666666666659
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.35095844031089335, "driven_lanedir": 0.13159776440139714, "in-drivable-lane": 0.6, "deviation-heading": 2.0395633979677026, "deviation-center-line": 0.19546767479674484}, "ep001": {"driven_any": 0.3962789183744984, "driven_lanedir": 0.39502434292444666, "in-drivable-lane": 0, "deviation-heading": 0.19235115945583048, "deviation-center-line": 0.30035989901396953}, "ep002": {"driven_any": 1.1882516789969753, "driven_lanedir": 1.0975104838575374, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.8152400519493184, "deviation-center-line": 0.3720201123073816}, "ep003": {"driven_any": 2.1132891369070976, "driven_lanedir": 2.0714299686515347, "in-drivable-lane": 0, "deviation-heading": 1.243485807654126, "deviation-center-line": 0.4315419066943574}, "ep004": {"driven_any": 1.5990940474323645, "driven_lanedir": 1.2665546101594969, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 3.0740263186576424, "deviation-center-line": 0.4541373215127029}}
No reset possible
6804794Manish PrajapatAMOD18-AIDOaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6803794Manish PrajapatAMOD18-AIDOaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.533333333333314


other stats
episodes
details{"ep000": {"nsteps": 77, "reward": -13.24325783502359, "good_angle": 1.277637193489936, "survival_time": 2.5666666666666673, "traveled_tiles": 1, "valid_direction": 2.166666666666667}, "ep001": {"nsteps": 87, "reward": -12.033398588155878, "good_angle": 0.018818938862116885, "survival_time": 2.8999999999999995, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 256, "reward": -4.099374128317322, "good_angle": 0.9958040715592736, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.9999999999999936}, "ep003": {"nsteps": 455, "reward": -2.4076888528323233, "good_angle": 0.9137723006687632, "survival_time": 15.166666666666623, "traveled_tiles": 4, "valid_direction": 2.1333333333333258}, "ep004": {"nsteps": 346, "reward": -3.5125782500760363, "good_angle": 19.652091200511613, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}
good_angle_max19.652091200511613
good_angle_mean4.571624741018341
good_angle_median0.9958040715592736
good_angle_min0.018818938862116885
reward_max-2.4076888528323233
reward_mean-7.059259530881031
reward_median-4.099374128317322
reward_min-13.24325783502359
survival_time_max15.166666666666623
survival_time_mean8.139999999999981
survival_time_min2.5666666666666673
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.93333333333332
valid_direction_mean2.046666666666661
valid_direction_median2.1333333333333258
valid_direction_min0
No reset possible
6800794Manish PrajapatAMOD18-AIDOaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6787795Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1128514299522214
deviation-center-line_median0.33681953376345325
in-drivable-lane_median0.36666666666666536


other stats
deviation-center-line_max0.7061115049197306
deviation-center-line_mean0.4170852687502137
deviation-center-line_min0.206101258264768
deviation-heading_max2.0356907912652367
deviation-heading_mean1.2924771865576126
deviation-heading_median1.526224496988953
deviation-heading_min0.18280005111396583
driven_any_max2.11722604983027
driven_any_mean1.1121026362949873
driven_any_median1.18061017933682
driven_any_min0.299379368264747
driven_lanedir_max2.0028242066855237
driven_lanedir_mean0.966758281324476
driven_lanedir_min0.1508372307238106
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean0.6399999999999981
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3633483538463435, "driven_lanedir": 0.1508372307238106, "in-drivable-lane": 0.6, "deviation-heading": 2.0356907912652367, "deviation-center-line": 0.206101258264768}, "ep001": {"driven_any": 0.299379368264747, "driven_lanedir": 0.29828766889386626, "in-drivable-lane": 0, "deviation-heading": 0.18280005111396583, "deviation-center-line": 0.23629002143949288}, "ep002": {"driven_any": 1.18061017933682, "driven_lanedir": 1.1128514299522214, "in-drivable-lane": 0.36666666666666536, "deviation-heading": 0.8183732011965573, "deviation-center-line": 0.7061115049197306}, "ep003": {"driven_any": 2.11722604983027, "driven_lanedir": 2.0028242066855237, "in-drivable-lane": 0.2333333333333325, "deviation-heading": 1.8992973922233505, "deviation-center-line": 0.600104025363624}, "ep004": {"driven_any": 1.5999492301967555, "driven_lanedir": 1.2689908703669572, "in-drivable-lane": 1.999999999999993, "deviation-heading": 1.526224496988953, "deviation-center-line": 0.33681953376345325}}
No reset possible
6781812Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.2442880286555738, "good_angle": 49.27850673721177, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.899999999999991}, "ep001": {"nsteps": 35, "reward": -30.17108565824373, "good_angle": 0.9524494896916972, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep002": {"nsteps": 500, "reward": -0.844765876989637, "good_angle": 12.509740325592723, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.96666666666666}, "ep003": {"nsteps": 500, "reward": -0.7657762226680643, "good_angle": 13.3664816792467, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999988}, "ep004": {"nsteps": 20, "reward": -52.504125183820726, "good_angle": 0.5956607844272193, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.4666666666666667}}
good_angle_max49.27850673721177
good_angle_mean15.340567803234023
good_angle_median12.509740325592723
good_angle_min0.5956607844272193
reward_max-0.7657762226680643
reward_mean-17.106008194075546
reward_median-1.2442880286555738
reward_min-52.504125183820726
survival_time_max16.666666666666654
survival_time_mean10.366666666666658
survival_time_min0.6666666666666666
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.899999999999991
valid_direction_mean8.259999999999994
valid_direction_median12.96666666666666
valid_direction_min0.4666666666666667
No reset possible
6775818Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.23121960360611823
deviation-center-line_median0.1998053111237546
in-drivable-lane_median0


other stats
deviation-center-line_max0.35396938863433036
deviation-center-line_mean0.2396109503483846
deviation-center-line_min0.12236485836105336
deviation-heading_max1.7316807421662197
deviation-heading_mean0.7964148451921946
deviation-heading_median0.6379761965328706
deviation-heading_min0.2125416965180202
driven_any_max0.7964647461318576
driven_any_mean0.3714411626523829
driven_any_median0.25000059357333293
driven_any_min0.18214745926228204
driven_lanedir_max0.5556189939906881
driven_lanedir_mean0.31101672831415683
driven_lanedir_min0.18011089490974985
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7964647461318576, "driven_lanedir": 0.5556189939906881, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7316807421662197, "deviation-center-line": 0.3417954704435611}, "ep001": {"driven_any": 0.18214745926228204, "driven_lanedir": 0.18011089490974985, "in-drivable-lane": 0, "deviation-heading": 0.2125416965180202, "deviation-center-line": 0.18011972317922345}, "ep002": {"driven_any": 0.4178774563356439, "driven_lanedir": 0.40573223402677105, "in-drivable-lane": 0, "deviation-heading": 0.6379761965328706, "deviation-center-line": 0.35396938863433036}, "ep003": {"driven_any": 0.2107155579587982, "driven_lanedir": 0.18240191503745695, "in-drivable-lane": 0, "deviation-heading": 0.7780653210245672, "deviation-center-line": 0.12236485836105336}, "ep004": {"driven_any": 0.25000059357333293, "driven_lanedir": 0.23121960360611823, "in-drivable-lane": 0, "deviation-heading": 0.6218102697192953, "deviation-center-line": 0.1998053111237546}}
No reset possible
6774818Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6759817Gianmarco BernasconiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:05:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6745826Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:11:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6741838Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-30:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.12359674190976476
deviation-center-line_median0.12238138077443382
in-drivable-lane_median0


other stats
deviation-center-line_max0.13702760592893315
deviation-center-line_mean0.11729473134601724
deviation-center-line_min0.08315785863508816
deviation-heading_max0.7986076240859723
deviation-heading_mean0.5418889769496378
deviation-heading_median0.4680718405031842
deviation-heading_min0.30999458991613704
driven_any_max0.3741734732674933
driven_any_mean0.18392017241021116
driven_any_median0.1382037140748112
driven_any_min0.09914003453888184
driven_lanedir_max0.1628659134238145
driven_lanedir_mean0.12901847834681207
driven_lanedir_min0.08989762480900332
in-drivable-lane_max1.2000000000000004
in-drivable-lane_mean0.24000000000000007
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3741734732674933, "driven_lanedir": 0.1628659134238145, "in-drivable-lane": 1.2000000000000004, "deviation-heading": 0.7986076240859723, "deviation-center-line": 0.08315785863508816}, "ep001": {"driven_any": 0.09914003453888184, "driven_lanedir": 0.08989762480900332, "in-drivable-lane": 0, "deviation-heading": 0.30999458991613704, "deviation-center-line": 0.12238138077443382}, "ep002": {"driven_any": 0.1376685426912673, "driven_lanedir": 0.1219421615072558, "in-drivable-lane": 0, "deviation-heading": 0.4680718405031842, "deviation-center-line": 0.1290123765224733}, "ep003": {"driven_any": 0.1704150974786023, "driven_lanedir": 0.14678995008422202, "in-drivable-lane": 0, "deviation-heading": 0.7199235019249762, "deviation-center-line": 0.11489443486915768}, "ep004": {"driven_any": 0.1382037140748112, "driven_lanedir": 0.12359674190976476, "in-drivable-lane": 0, "deviation-heading": 0.4128473283179192, "deviation-center-line": 0.13702760592893315}}
No reset possible
6737836Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:27
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6733838Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8000000000000025


other stats
episodes
details{"ep000": {"nsteps": 62, "reward": -16.480567826288603, "good_angle": 0.5199929754613491, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 1.3666666666666691}, "ep001": {"nsteps": 38, "reward": -26.826975192678603, "good_angle": 0.09399320853986312, "survival_time": 1.2666666666666673, "traveled_tiles": 1, "valid_direction": 0.23333333333333328}, "ep002": {"nsteps": 53, "reward": -19.238203171289193, "good_angle": 0.16474947520162866, "survival_time": 1.7666666666666688, "traveled_tiles": 2, "valid_direction": 0.7666666666666686}, "ep003": {"nsteps": 65, "reward": -15.641500975420842, "good_angle": 0.302302143547876, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 1.3000000000000025}, "ep004": {"nsteps": 54, "reward": -18.90388865492962, "good_angle": 0.13175402752540685, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0.4666666666666681}}
good_angle_max0.5199929754613491
good_angle_mean0.2425583660552247
good_angle_median0.16474947520162866
good_angle_min0.09399320853986312
reward_max-15.641500975420842
reward_mean-19.418227164121372
reward_median-18.90388865492962
reward_min-26.826975192678603
survival_time_max2.1666666666666687
survival_time_mean1.813333333333335
survival_time_min1.2666666666666673
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3666666666666691
valid_direction_mean0.8266666666666683
valid_direction_median0.7666666666666686
valid_direction_min0.23333333333333328
No reset possible
6732838Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6679684Maxim Kuzmin 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6622737Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornorudolf-30:02:17
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6555812Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.2442880286555738, "good_angle": 49.27850673721177, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.899999999999991}, "ep001": {"nsteps": 35, "reward": -30.17108565824373, "good_angle": 0.9524494896916972, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep002": {"nsteps": 500, "reward": -0.844765876989637, "good_angle": 12.509740325592723, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.96666666666666}, "ep003": {"nsteps": 500, "reward": -0.7657762226680643, "good_angle": 13.3664816792467, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999988}, "ep004": {"nsteps": 20, "reward": -52.504125183820726, "good_angle": 0.5956607844272193, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.4666666666666667}}
good_angle_max49.27850673721177
good_angle_mean15.340567803234023
good_angle_median12.509740325592723
good_angle_min0.5956607844272193
reward_max-0.7657762226680643
reward_mean-17.106008194075546
reward_median-1.2442880286555738
reward_min-52.504125183820726
survival_time_max16.666666666666654
survival_time_mean10.366666666666658
survival_time_min0.6666666666666666
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.899999999999991
valid_direction_mean8.259999999999994
valid_direction_median12.96666666666666
valid_direction_min0.4666666666666667
No reset possible
6535837Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:55
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6369763Bhairav MehtaTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6337787Cliff LiAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortednorudolf-30:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6330792Edoardo Gabbi 🇮🇹Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6326801Philippe LacailleROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.21101151621352351
deviation-center-line_median0.199404356118788
in-drivable-lane_median0


other stats
deviation-center-line_max0.3741287613222496
deviation-center-line_mean0.2455087583191516
deviation-center-line_min0.12648922446863706
deviation-heading_max1.790291819959332
deviation-heading_mean0.8021888473413389
deviation-heading_median0.6047426502341454
deviation-heading_min0.2501223460579
driven_any_max0.7893219717916308
driven_any_mean0.36072364057772055
driven_any_median0.2285795229625236
driven_any_min0.15356097689607384
driven_lanedir_max0.5484535224764031
driven_lanedir_mean0.3023235715341157
driven_lanedir_min0.1353797797620091
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7893219717916308, "driven_lanedir": 0.5484535224764031, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.790291819959332, "deviation-center-line": 0.3449793872795823}, "ep001": {"driven_any": 0.17857807149661362, "driven_lanedir": 0.17630702182207392, "in-drivable-lane": 0, "deviation-heading": 0.2501223460579, "deviation-center-line": 0.18254206240650117}, "ep002": {"driven_any": 0.15356097689607384, "driven_lanedir": 0.1353797797620091, "in-drivable-lane": 0, "deviation-heading": 0.5781193626940818, "deviation-center-line": 0.12648922446863706}, "ep003": {"driven_any": 0.45357765974176095, "driven_lanedir": 0.4404660173965689, "in-drivable-lane": 0, "deviation-heading": 0.7876680577612354, "deviation-center-line": 0.3741287613222496}, "ep004": {"driven_any": 0.2285795229625236, "driven_lanedir": 0.21101151621352351, "in-drivable-lane": 0, "deviation-heading": 0.6047426502341454, "deviation-center-line": 0.199404356118788}}
No reset possible
6324801Philippe LacailleROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6315801Philippe LacailleROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.200000000000002


other stats
episodes
details{"ep000": {"nsteps": 223, "reward": -4.641026302191717, "good_angle": 0.8420404222845859, "survival_time": 7.433333333333317, "traveled_tiles": 2, "valid_direction": 1.1666666666666623}, "ep001": {"nsteps": 52, "reward": -19.784977277310993, "good_angle": 0.04344170612363317, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 45, "reward": -22.69143515229225, "good_angle": 0.4180990970040329, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 0.766666666666668}, "ep003": {"nsteps": 129, "reward": -8.20047055254149, "good_angle": 0.2970683289021301, "survival_time": 4.2999999999999945, "traveled_tiles": 2, "valid_direction": 0.6333333333333317}, "ep004": {"nsteps": 66, "reward": -15.64182143455202, "good_angle": 0.3865016918410927, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6333333333333337}}
good_angle_max0.8420404222845859
good_angle_mean0.39743024923109493
good_angle_median0.3865016918410927
good_angle_min0.04344170612363317
reward_max-4.641026302191717
reward_mean-14.191946143777692
reward_median-15.64182143455202
reward_min-22.69143515229225
survival_time_max7.433333333333317
survival_time_mean3.43333333333333
survival_time_min1.500000000000001
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.1666666666666623
valid_direction_mean0.6399999999999991
valid_direction_median0.6333333333333337
valid_direction_min0
No reset possible
6307802Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:03:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 118, in run
    solve(params, cis)
  File "solution.py", line 83, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 89, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6298805Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:03:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 118, in run
    solve(params, cis)
  File "solution.py", line 83, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 89, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6293807Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednorudolf-30:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 97, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6290808Samuel LavoiePyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.166666666666665


other stats
episodes
details{"ep000": {"nsteps": 128, "reward": -8.518161884603614, "good_angle": 8.464937440905624, "survival_time": 4.266666666666661, "traveled_tiles": 1, "valid_direction": 3.433333333333329}, "ep001": {"nsteps": 73, "reward": -14.761783132916444, "good_angle": 2.348111231598612, "survival_time": 2.4333333333333345, "traveled_tiles": 2, "valid_direction": 2.1333333333333337}, "ep002": {"nsteps": 95, "reward": -10.994051871389935, "good_angle": 2.522985456126539, "survival_time": 3.166666666666665, "traveled_tiles": 2, "valid_direction": 2.6666666666666643}, "ep003": {"nsteps": 500, "reward": -0.3111895803490188, "good_angle": 13.09448810013201, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.866666666666656}, "ep004": {"nsteps": 82, "reward": -12.973693240524792, "good_angle": 2.2585344963266425, "survival_time": 2.7333333333333334, "traveled_tiles": 1, "valid_direction": 2.199999999999999}}
good_angle_max13.09448810013201
good_angle_mean5.737811345017885
good_angle_median2.522985456126539
good_angle_min2.2585344963266425
reward_max-0.3111895803490188
reward_mean-9.51177594195676
reward_median-10.994051871389935
reward_min-14.761783132916444
survival_time_max16.666666666666654
survival_time_mean5.85333333333333
survival_time_min2.4333333333333345
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max12.866666666666656
valid_direction_mean4.659999999999996
valid_direction_median2.6666666666666643
valid_direction_min2.1333333333333337
No reset possible
6286809Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2579668219643292
deviation-center-line_median0.1059593895156474
in-drivable-lane_median0


other stats
deviation-center-line_max0.23676070016860404
deviation-center-line_mean0.1239773311253622
deviation-center-line_min0.07144299629218012
deviation-heading_max0.8181796391735762
deviation-heading_mean0.4469072023299918
deviation-heading_median0.36906308614551
deviation-heading_min0.2710018149084613
driven_any_max1.0689339474507558
driven_any_mean0.4083166910259283
driven_any_median0.27009149109606245
driven_any_min0.07997017530105253
driven_lanedir_max0.8885961471158105
driven_lanedir_mean0.3628381430554117
driven_lanedir_min0.06769193659032569
in-drivable-lane_max0.2666666666666667
in-drivable-lane_mean0.053333333333333344
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0689339474507558, "driven_lanedir": 0.8885961471158105, "in-drivable-lane": 0.2666666666666667, "deviation-heading": 0.8181796391735762, "deviation-center-line": 0.23676070016860404}, "ep001": {"driven_any": 0.07997017530105253, "driven_lanedir": 0.06769193659032569, "in-drivable-lane": 0, "deviation-heading": 0.36906308614551, "deviation-center-line": 0.07144299629218012}, "ep002": {"driven_any": 0.17198956616441874, "driven_lanedir": 0.15787482520656693, "in-drivable-lane": 0, "deviation-heading": 0.40961119047542144, "deviation-center-line": 0.09596478563038988}, "ep003": {"driven_any": 0.45059827511735223, "driven_lanedir": 0.44206098440002606, "in-drivable-lane": 0, "deviation-heading": 0.2710018149084613, "deviation-center-line": 0.10975878401998948}, "ep004": {"driven_any": 0.27009149109606245, "driven_lanedir": 0.2579668219643292, "in-drivable-lane": 0, "deviation-heading": 0.3666802809469904, "deviation-center-line": 0.1059593895156474}}
No reset possible
6281809Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:00:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6280809Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.0333333333333332


other stats
episodes
details{"ep000": {"nsteps": 80, "reward": -12.825791479519102, "good_angle": 0.34161687192991563, "survival_time": 2.666666666666667, "traveled_tiles": 3, "valid_direction": 0.8333333333333323}, "ep001": {"nsteps": 20, "reward": -50.64446276128293, "good_angle": 0.3399300848775853, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.4}, "ep002": {"nsteps": 28, "reward": -36.30582820624113, "good_angle": 0.3227372332688498, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.4333333333333333}, "ep003": {"nsteps": 39, "reward": -26.075828602298714, "good_angle": 0.0811972979379939, "survival_time": 1.3000000000000007, "traveled_tiles": 2, "valid_direction": 0.33333333333333326}, "ep004": {"nsteps": 31, "reward": -32.83416813611984, "good_angle": 0.2723518728988802, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0.3999999999999999}}
good_angle_max0.34161687192991563
good_angle_mean0.27156667218264496
good_angle_median0.3227372332688498
good_angle_min0.0811972979379939
reward_max-12.825791479519102
reward_mean-31.737215837092343
reward_median-32.83416813611984
reward_min-50.64446276128293
survival_time_max2.666666666666667
survival_time_mean1.32
survival_time_min0.6666666666666666
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.8333333333333323
valid_direction_mean0.4799999999999997
valid_direction_median0.4
valid_direction_min0.33333333333333326
No reset possible
6274809Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6260818Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2482206145486816
deviation-center-line_median0.2210288078414068
in-drivable-lane_median0


other stats
deviation-center-line_max0.3617533163994265
deviation-center-line_mean0.23709828112705944
deviation-center-line_min0.13306158377372387
deviation-heading_max1.817713299610764
deviation-heading_mean0.8088235836719229
deviation-heading_median0.600322451860592
deviation-heading_min0.2619771005149048
driven_any_max0.5714385859974358
driven_any_mean0.34071983728228894
driven_any_median0.2500133890290756
driven_any_min0.19998324812322693
driven_lanedir_max0.41975948835652455
driven_lanedir_mean0.2776347080381498
driven_lanedir_min0.177555627093402
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5714385859974358, "driven_lanedir": 0.31131154120886473, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.817713299610764, "deviation-center-line": 0.2210288078414068}, "ep001": {"driven_any": 0.2500133890290756, "driven_lanedir": 0.2482206145486816, "in-drivable-lane": 0, "deviation-heading": 0.2619771005149048, "deviation-center-line": 0.26325975704890087}, "ep002": {"driven_any": 0.4321609929419086, "driven_lanedir": 0.41975948835652455, "in-drivable-lane": 0, "deviation-heading": 0.5966209504337485, "deviation-center-line": 0.3617533163994265}, "ep003": {"driven_any": 0.19998324812322693, "driven_lanedir": 0.177555627093402, "in-drivable-lane": 0, "deviation-heading": 0.7674841159396049, "deviation-center-line": 0.13306158377372387}, "ep004": {"driven_any": 0.2500029703197979, "driven_lanedir": 0.23132626898327624, "in-drivable-lane": 0, "deviation-heading": 0.600322451860592, "deviation-center-line": 0.20638794057183923}}
No reset possible
6254819Samuel LavoieBaby Dukeaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.892203518004523
deviation-center-line_median0.4216991734542454
in-drivable-lane_median0.6333333333333311


other stats
deviation-center-line_max1.1195789442539406
deviation-center-line_mean0.5188454003100915
deviation-center-line_min0.086115861693336
deviation-heading_max3.4025822864326662
deviation-heading_mean1.5535548314198853
deviation-heading_median1.707259919818114
deviation-heading_min0.112948969838207
driven_any_max6.26893889513719
driven_any_mean2.8108421779807573
driven_any_median2.3477454137805305
driven_any_min0.31018536791138707
driven_lanedir_max5.145180928393593
driven_lanedir_mean2.4010137837956607
driven_lanedir_min0.30679824078126705
in-drivable-lane_max2.166666666666659
in-drivable-lane_mean0.7199999999999978
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.3477454137805305, "driven_lanedir": 1.892203518004523, "in-drivable-lane": 0.799999999999999, "deviation-heading": 1.707259919818114, "deviation-center-line": 0.4216991734542454}, "ep001": {"driven_any": 0.31018536791138707, "driven_lanedir": 0.30679824078126705, "in-drivable-lane": 0, "deviation-heading": 0.112948969838207, "deviation-center-line": 0.086115861693336}, "ep002": {"driven_any": 6.26893889513719, "driven_lanedir": 5.145180928393593, "in-drivable-lane": 2.166666666666659, "deviation-heading": 3.4025822864326662, "deviation-center-line": 1.1195789442539406}, "ep003": {"driven_any": 4.270647842102277, "driven_lanedir": 3.8088867775021704, "in-drivable-lane": 0.6333333333333311, "deviation-heading": 2.3377648973443166, "deviation-center-line": 0.8176240789606297}, "ep004": {"driven_any": 0.8566933709724004, "driven_lanedir": 0.8519994542967497, "in-drivable-lane": 0, "deviation-heading": 0.2072180836661223, "deviation-center-line": 0.14920894318830602}}
No reset possible
6249839Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:03:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.12031344862095585
deviation-center-line_median0.14351497747151423
in-drivable-lane_median0


other stats
deviation-center-line_max0.21344619242654947
deviation-center-line_mean0.1443684602876851
deviation-center-line_min0.07730061207473819
deviation-heading_max1.1581601681000258
deviation-heading_mean0.6814716404988106
deviation-heading_median0.5598962097687539
deviation-heading_min0.35864772946578727
driven_any_max0.3520845665811553
driven_any_mean0.18966651839328125
driven_any_median0.15659723751646318
driven_any_min0.1185392255213892
driven_lanedir_max0.15381746557917086
driven_lanedir_mean0.12710804160472566
driven_lanedir_min0.10754013654090322
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3520845665811553, "driven_lanedir": 0.11583955801204592, "in-drivable-lane": 1.500000000000001, "deviation-heading": 0.8508081091790168, "deviation-center-line": 0.07730061207473819}, "ep001": {"driven_any": 0.1185392255213892, "driven_lanedir": 0.10754013654090322, "in-drivable-lane": 0, "deviation-heading": 0.35864772946578727, "deviation-center-line": 0.14650499185659807}, "ep002": {"driven_any": 0.15659723751646318, "driven_lanedir": 0.13802959927055247, "in-drivable-lane": 0, "deviation-heading": 0.5598962097687539, "deviation-center-line": 0.1410755276090256}, "ep003": {"driven_any": 0.18515162061266377, "driven_lanedir": 0.15381746557917086, "in-drivable-lane": 0, "deviation-heading": 1.1581601681000258, "deviation-center-line": 0.21344619242654947}, "ep004": {"driven_any": 0.13595994173473494, "driven_lanedir": 0.12031344862095585, "in-drivable-lane": 0, "deviation-heading": 0.4798459859804696, "deviation-center-line": 0.14351497747151423}}
No reset possible
6242821Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1677331265841218
deviation-center-line_median0.21369449920758316
in-drivable-lane_median0


other stats
deviation-center-line_max1.464411830780586
deviation-center-line_mean0.4563088753418883
deviation-center-line_min0.14607759722589408
deviation-heading_max3.4927926401690663
deviation-heading_mean1.2063914448630155
deviation-heading_median1.058876716298759
deviation-heading_min0.09639253705307378
driven_any_max4.602452585926608
driven_any_mean1.6442723429191433
driven_any_median1.1704445826380951
driven_any_min0.40884157584142633
driven_lanedir_max4.490264233223098
driven_lanedir_mean1.5726566807857558
driven_lanedir_min0.4075578251135321
in-drivable-lane_max0.633333333333334
in-drivable-lane_mean0.1266666666666668
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6526231909238541, "driven_lanedir": 0.4609044611207218, "in-drivable-lane": 0.633333333333334, "deviation-heading": 1.058876716298759, "deviation-center-line": 0.21369449920758316}, "ep001": {"driven_any": 0.40884157584142633, "driven_lanedir": 0.4075578251135321, "in-drivable-lane": 0, "deviation-heading": 0.09639253705307378, "deviation-center-line": 0.14607759722589408}, "ep002": {"driven_any": 1.3869997792657325, "driven_lanedir": 1.3368237578873048, "in-drivable-lane": 0, "deviation-heading": 1.212248936259134, "deviation-center-line": 0.2647632241426425}, "ep003": {"driven_any": 1.1704445826380951, "driven_lanedir": 1.1677331265841218, "in-drivable-lane": 0, "deviation-heading": 0.17164639453504657, "deviation-center-line": 0.19259722535273616}, "ep004": {"driven_any": 4.602452585926608, "driven_lanedir": 4.490264233223098, "in-drivable-lane": 0, "deviation-heading": 3.4927926401690663, "deviation-center-line": 1.464411830780586}}
No reset possible
6240821Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesrudolf-30:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6238821Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.133333333333332


other stats
episodes
details{"ep000": {"nsteps": 91, "reward": -11.133975536662287, "good_angle": 0.3514170286521865, "survival_time": 3.0333333333333323, "traveled_tiles": 2, "valid_direction": 1.5666666666666689}, "ep001": {"nsteps": 42, "reward": -24.354641834185237, "good_angle": 0.010658120455247468, "survival_time": 1.400000000000001, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 161, "reward": -6.566677953238073, "good_angle": 0.08521069523088277, "survival_time": 5.366666666666657, "traveled_tiles": 3, "valid_direction": 0.1999999999999993}, "ep003": {"nsteps": 94, "reward": -10.92018834564914, "good_angle": 0.015010823644457265, "survival_time": 3.133333333333332, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.10944171024032402, "good_angle": 15.476339074918, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.76666666666665}}
good_angle_max15.476339074918
good_angle_mean3.1877271485801546
good_angle_median0.08521069523088277
good_angle_min0.010658120455247468
reward_max-0.10944171024032402
reward_mean-10.61698507599501
reward_median-10.92018834564914
reward_min-24.354641834185237
survival_time_max16.666666666666654
survival_time_mean5.9199999999999955
survival_time_min1.400000000000001
traveled_tiles_max10
traveled_tiles_mean3.8
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.76666666666665
valid_direction_mean1.3066666666666635
valid_direction_median0.1999999999999993
valid_direction_min0
No reset possible
6235821Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6233823Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 64, in solve
    model = Model(config_name=config_name, config=config)
  File "/workspace/model.py", line 15, in __init__
    self.init_model(config_name)
  File "/workspace/model.py", line 45, in init_model
    map_location=self.device))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 719, in load_state_dict
    self.__class__.__name__, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for RainbowDQN:
	Missing key(s) in state_dict: "noisy_value1.bias_sigma", "noisy_value1.weight_epsilon", "noisy_value1.weight_mu", "noisy_value1.weight_sigma", "noisy_value1.bias_mu", "noisy_value1.bias_epsilon", "noisy_value2.bias_sigma", "noisy_value2.weight_epsilon", "noisy_value2.weight_mu", "noisy_value2.weight_sigma", "noisy_value2.bias_mu", "noisy_value2.bias_epsilon", "noisy_advantage1.bias_sigma", "noisy_advantage1.weight_epsilon", "noisy_advantage1.weight_mu", "noisy_advantage1.weight_sigma", "noisy_advantage1.bias_mu", "noisy_advantage1.bias_epsilon", "noisy_advantage2.bias_sigma", "noisy_advantage2.weight_epsilon", "noisy_advantage2.weight_mu", "noisy_advantage2.weight_sigma", "noisy_advantage2.bias_mu", "noisy_advantage2.bias_epsilon". 
	Unexpected key(s) in state_dict: "noisy2.weight_mu", "noisy2.weight_sigma", "noisy2.bias_mu", "noisy2.bias_sigma", "noisy2.weight_epsilon", "noisy2.bias_epsilon", "noisy1.weight_mu", "noisy1.weight_sigma", "noisy1.bias_mu", "noisy1.bias_sigma", "noisy1.weight_epsilon", "noisy1.bias_epsilon". 


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6231825Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 64, in solve
    model = Model(config_name=config_name, config=config)
  File "/workspace/model.py", line 15, in __init__
    self.init_model(config_name)
  File "/workspace/model.py", line 45, in init_model
    map_location=self.device))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 719, in load_state_dict
    self.__class__.__name__, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for NoisyDQN:
	size mismatch for cnn.conv1.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv1.weight: copying a param of torch.Size([256, 3, 7, 7]) from checkpoint, where the shape is torch.Size([64, 3, 7, 7]) in current model.
	size mismatch for cnn.bn1.running_var: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn1.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn1.weight: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn1.running_mean: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv2.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv2.weight: copying a param of torch.Size([256, 256, 5, 5]) from checkpoint, where the shape is torch.Size([64, 64, 5, 5]) in current model.
	size mismatch for cnn.bn2.running_var: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn2.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn2.weight: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn2.running_mean: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv3.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv3.weight: copying a param of torch.Size([256, 256, 3, 3]) from checkpoint, where the shape is torch.Size([64, 64, 3, 3]) in current model.
	size mismatch for cnn.bn3.running_var: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn3.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn3.weight: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn3.running_mean: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv4.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv4.weight: copying a param of torch.Size([256, 256, 3, 3]) from checkpoint, where the shape is torch.Size([64, 64, 3, 3]) in current model.
	size mismatch for cnn.bn4.running_var: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn4.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn4.weight: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn4.running_mean: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for noisy2.weight_epsilon: copying a param of torch.Size([5, 256]) from checkpoint, where the shape is torch.Size([5, 64]) in current model.
	size mismatch for noisy2.weight_mu: copying a param of torch.Size([5, 256]) from checkpoint, where the shape is torch.Size([5, 64]) in current model.
	size mismatch for noisy2.weight_sigma: copying a param of torch.Size([5, 256]) from checkpoint, where the shape is torch.Size([5, 64]) in current model.
	size mismatch for noisy1.bias_sigma: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for noisy1.weight_epsilon: copying a param of torch.Size([256, 1024]) from checkpoint, where the shape is torch.Size([64, 256]) in current model.
	size mismatch for noisy1.weight_mu: copying a param of torch.Size([256, 1024]) from checkpoint, where the shape is torch.Size([64, 256]) in current model.
	size mismatch for noisy1.weight_sigma: copying a param of torch.Size([256, 1024]) from checkpoint, where the shape is torch.Size([64, 256]) in current model.
	size mismatch for noisy1.bias_mu: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for noisy1.bias_epsilon: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6223830Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6220833Orlando Marquez 🇨🇦Baseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationtimeoutnorudolf-30:31:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6217834Samuel LavoieYoung Dukeaido1_LF1_r3-v3step1-simulationtimeoutnorudolf-30:31:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6214838Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step3-videostimeoutyesrudolf-30:31:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6212838Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8000000000000025


other stats
episodes
details{"ep000": {"nsteps": 62, "reward": -16.476209455477676, "good_angle": 0.5005522135713053, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 1.3666666666666691}, "ep001": {"nsteps": 37, "reward": -27.530120182681728, "good_angle": 0.09259917590374704, "survival_time": 1.2333333333333338, "traveled_tiles": 1, "valid_direction": 0.23333333333333328}, "ep002": {"nsteps": 52, "reward": -19.591462997862926, "good_angle": 0.16945723347049738, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.7333333333333352}, "ep003": {"nsteps": 67, "reward": -15.205426388378465, "good_angle": 0.3164877561361908, "survival_time": 2.233333333333335, "traveled_tiles": 1, "valid_direction": 1.3666666666666687}, "ep004": {"nsteps": 54, "reward": -18.903807604202516, "good_angle": 0.13643665976135383, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0.533333333333335}}
good_angle_max0.5005522135713053
good_angle_mean0.2431066077686189
good_angle_median0.16945723347049738
good_angle_min0.09259917590374704
reward_max-15.205426388378465
reward_mean-19.54140532572066
reward_median-18.903807604202516
reward_min-27.530120182681728
survival_time_max2.233333333333335
survival_time_mean1.813333333333335
survival_time_min1.2333333333333338
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3666666666666691
valid_direction_mean0.8466666666666682
valid_direction_median0.7333333333333352
valid_direction_min0.23333333333333328
No reset possible
6205829Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationtimeoutnorudolf-30:33:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6193839Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationtimeoutnorudolf-30:49:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6179833Orlando Marquez 🇨🇦Baseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationtimeoutnorudolf-30:33:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6172838Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-30:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8000000000000025


other stats
episodes
details{"ep000": {"nsteps": 62, "reward": -16.476209455477676, "good_angle": 0.5005522135713053, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 1.3666666666666691}, "ep001": {"nsteps": 37, "reward": -27.530120182681728, "good_angle": 0.09259917590374704, "survival_time": 1.2333333333333338, "traveled_tiles": 1, "valid_direction": 0.23333333333333328}, "ep002": {"nsteps": 52, "reward": -19.591462997862926, "good_angle": 0.16945723347049738, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.7333333333333352}, "ep003": {"nsteps": 67, "reward": -15.205426388378465, "good_angle": 0.3164877561361908, "survival_time": 2.233333333333335, "traveled_tiles": 1, "valid_direction": 1.3666666666666687}, "ep004": {"nsteps": 54, "reward": -18.903807604202516, "good_angle": 0.13643665976135383, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0.533333333333335}}
good_angle_max0.5005522135713053
good_angle_mean0.2431066077686189
good_angle_median0.16945723347049738
good_angle_min0.09259917590374704
reward_max-15.205426388378465
reward_mean-19.54140532572066
reward_median-18.903807604202516
reward_min-27.530120182681728
survival_time_max2.233333333333335
survival_time_mean1.813333333333335
survival_time_min1.2333333333333338
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3666666666666691
valid_direction_mean0.8466666666666682
valid_direction_median0.7333333333333352
valid_direction_min0.23333333333333328
No reset possible
6166836Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationabortednorudolf-30:00:29
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6157839Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6142838Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step3-videossuccessnorudolf-30:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6138838Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6131834Samuel LavoieYoung Dukeaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6121834Samuel LavoieYoung Dukeaido1_LF1_r3-v3step2-scoringsuccessnorudolf-30:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.733333333333302


other stats
episodes
details{"ep000": {"nsteps": 168, "reward": -7.934439358700599, "good_angle": 19.888117786020445, "survival_time": 5.59999999999999, "traveled_tiles": 6, "valid_direction": 3.099999999999997}, "ep001": {"nsteps": 242, "reward": -5.63131987395858, "good_angle": 18.727965412663018, "survival_time": 8.066666666666649, "traveled_tiles": 7, "valid_direction": 3.4666666666666552}, "ep002": {"nsteps": 500, "reward": -0.5593890390801244, "good_angle": 2.5609619856563275, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.9666666666666455}, "ep003": {"nsteps": 352, "reward": -5.00258318618448, "good_angle": 36.28035911926448, "survival_time": 11.733333333333302, "traveled_tiles": 10, "valid_direction": 4.966666666666652}, "ep004": {"nsteps": 500, "reward": -0.8166006759773009, "good_angle": 2.5717428190104616, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.5333333333333155}}
good_angle_max36.28035911926448
good_angle_mean16.005829424522947
good_angle_median18.727965412663018
good_angle_min2.5609619856563275
reward_max-0.5593890390801244
reward_mean-3.988866426780217
reward_median-5.00258318618448
reward_min-7.934439358700599
survival_time_max16.666666666666654
survival_time_mean11.74666666666665
survival_time_min5.59999999999999
traveled_tiles_max13
traveled_tiles_mean9.8
traveled_tiles_median10
traveled_tiles_min6
valid_direction_max5.9666666666666455
valid_direction_mean4.606666666666653
valid_direction_median4.966666666666652
valid_direction_min3.099999999999997
No reset possible
6113833Orlando Marquez 🇨🇦Baseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessnorudolf-30:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.833333333333306


other stats
episodes
details{"ep000": {"nsteps": 204, "reward": -6.806972599789208, "good_angle": 29.295953235105024, "survival_time": 6.799999999999986, "traveled_tiles": 2, "valid_direction": 4.699999999999983}, "ep001": {"nsteps": 454, "reward": -2.9128666053590724, "good_angle": 26.583267419570053, "survival_time": 15.13333333333329, "traveled_tiles": 3, "valid_direction": 4.7333333333333165}, "ep002": {"nsteps": 435, "reward": -2.3686694582060497, "good_angle": 0.13028082235550945, "survival_time": 14.49999999999996, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 310, "reward": -5.502394236672309, "good_angle": 31.415372396718254, "survival_time": 10.333333333333307, "traveled_tiles": 3, "valid_direction": 4.699999999999984}, "ep004": {"nsteps": 325, "reward": -4.9345840130345175, "good_angle": 5.88129958380946, "survival_time": 10.833333333333306, "traveled_tiles": 3, "valid_direction": 3.566666666666655}}
good_angle_max31.415372396718254
good_angle_mean18.661234691511662
good_angle_median26.583267419570053
good_angle_min0.13028082235550945
reward_max-2.3686694582060497
reward_mean-4.505097382612231
reward_median-4.9345840130345175
reward_min-6.806972599789208
survival_time_max15.13333333333329
survival_time_mean11.519999999999971
survival_time_min6.799999999999986
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.7333333333333165
valid_direction_mean3.5399999999999876
valid_direction_median4.699999999999983
valid_direction_min0
No reset possible
6104828Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessnorudolf-30:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.533333333333308


other stats
episodes
details{"ep000": {"nsteps": 235, "reward": -4.686489805744149, "good_angle": 16.581324771165296, "survival_time": 7.833333333333315, "traveled_tiles": 5, "valid_direction": 3.399999999999994}, "ep001": {"nsteps": 316, "reward": -3.551720138605687, "good_angle": 14.5595987074719, "survival_time": 10.533333333333308, "traveled_tiles": 5, "valid_direction": 3.7999999999999874}, "ep002": {"nsteps": 449, "reward": -2.8138463129590208, "good_angle": 1.4849135792931378, "survival_time": 14.966666666666624, "traveled_tiles": 9, "valid_direction": 3.0333333333333226}, "ep003": {"nsteps": 484, "reward": -2.935699830079944, "good_angle": 46.30386110351722, "survival_time": 16.133333333333294, "traveled_tiles": 8, "valid_direction": 7.099999999999982}, "ep004": {"nsteps": 196, "reward": -7.483443850461318, "good_angle": 4.736916652604615, "survival_time": 6.53333333333332, "traveled_tiles": 3, "valid_direction": 2.766666666666657}}
good_angle_max46.30386110351722
good_angle_mean16.733322962810437
good_angle_median14.5595987074719
good_angle_min1.4849135792931378
reward_max-2.8138463129590208
reward_mean-4.294239987570023
reward_median-3.551720138605687
reward_min-7.483443850461318
survival_time_max16.133333333333294
survival_time_mean11.19999999999997
survival_time_min6.53333333333332
traveled_tiles_max9
traveled_tiles_mean6
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max7.099999999999982
valid_direction_mean4.019999999999989
valid_direction_median3.399999999999994
valid_direction_min2.766666666666657
No reset possible
6100828Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6093826Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:10:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6086824Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 64, in solve
    model = Model(config_name=config_name, config=config)
  File "/workspace/model.py", line 15, in __init__
    self.init_model(config_name)
  File "/workspace/model.py", line 31, in init_model
    use_lstm=self.config.get("use_lstm", False)).to(self.device)
TypeError: __init__() got an unexpected keyword argument 'use_lstm'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6085823Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 64, in solve
    model = Model(config_name=config_name, config=config)
  File "/workspace/model.py", line 15, in __init__
    self.init_model(config_name)
  File "/workspace/model.py", line 45, in init_model
    map_location=self.device))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 719, in load_state_dict
    self.__class__.__name__, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for RainbowDQN:
	Missing key(s) in state_dict: "noisy_value1.bias_sigma", "noisy_value1.weight_epsilon", "noisy_value1.weight_mu", "noisy_value1.weight_sigma", "noisy_value1.bias_mu", "noisy_value1.bias_epsilon", "noisy_value2.bias_sigma", "noisy_value2.weight_epsilon", "noisy_value2.weight_mu", "noisy_value2.weight_sigma", "noisy_value2.bias_mu", "noisy_value2.bias_epsilon", "noisy_advantage1.bias_sigma", "noisy_advantage1.weight_epsilon", "noisy_advantage1.weight_mu", "noisy_advantage1.weight_sigma", "noisy_advantage1.bias_mu", "noisy_advantage1.bias_epsilon", "noisy_advantage2.bias_sigma", "noisy_advantage2.weight_epsilon", "noisy_advantage2.weight_mu", "noisy_advantage2.weight_sigma", "noisy_advantage2.bias_mu", "noisy_advantage2.bias_epsilon". 
	Unexpected key(s) in state_dict: "noisy2.weight_mu", "noisy2.weight_sigma", "noisy2.bias_mu", "noisy2.bias_sigma", "noisy2.weight_epsilon", "noisy2.bias_epsilon", "noisy1.weight_mu", "noisy1.weight_sigma", "noisy1.bias_mu", "noisy1.bias_sigma", "noisy1.weight_epsilon", "noisy1.bias_epsilon". 


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6084822Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 64, in solve
    model = Model(config_name=config_name, config=config)
  File "/workspace/model.py", line 15, in __init__
    self.init_model(config_name)
  File "/workspace/model.py", line 45, in init_model
    map_location=self.device))
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 356, in load
    f = open(f, 'rb')
IOError: [Errno 2] No such file or directory: '/workspace/models/weights/mml2_d_28_178000.pth.pth'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6066820Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:07:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6048814Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6042814Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6040812Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6035812Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessnorudolf-30:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6025813Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6018810Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortednorudolf-30:00:13
Error while running [...]

Creating job6018-7478_videos_1 ... error
stderr | ERROR: for job6018-7478_videos_1  Cannot start service videos: network job6018-7478_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job6018-7478_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6013811Samuel LavoieBaby Dukeaido1_LF1_r3-v3step1-simulationfailednorudolf-30:02:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 111, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    model.load("DDPG_2_2", "pytorch_models")
  File "/workspace/ddpg.py", line 199, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 303, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 469, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 437, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 323, in restore_location
    result = map_location(storage, location)
TypeError: 'torch.Device' object is not callable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 111, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    model.load("DDPG_2_2", "pytorch_models")
  File "/workspace/ddpg.py", line 199, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 303, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 469, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 437, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 323, in restore_location
    result = map_location(storage, location)
TypeError: 'torch.Device' object is not callable


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6010809Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6004809Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:07:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5998808Samuel LavoiePyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessnorudolf-30:00:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5990807Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessnorudolf-30:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5986807Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessnorudolf-30:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.4666167200943454, "good_angle": 46.39080979801388, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 7.366666666666646}, "ep001": {"nsteps": 500, "reward": -1.2634545236681587, "good_angle": 37.88893282859414, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 7.766666666666679}, "ep002": {"nsteps": 500, "reward": -0.07651321510050911, "good_angle": 1.0177427658431246, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.400000000000018}, "ep003": {"nsteps": 500, "reward": -1.4610914323935285, "good_angle": 46.29232436895133, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 7.1999999999999815}, "ep004": {"nsteps": 70, "reward": -16.389432545219147, "good_angle": 1.3617442721877837, "survival_time": 2.333333333333335, "traveled_tiles": 5, "valid_direction": 0.8666666666666678}}
good_angle_max46.39080979801388
good_angle_mean26.590310806718055
good_angle_median37.88893282859414
good_angle_min1.0177427658431246
reward_max-0.07651321510050911
reward_mean-4.131421687295138
reward_median-1.4610914323935285
reward_min-16.389432545219147
survival_time_max16.666666666666654
survival_time_mean13.799999999999988
survival_time_min2.333333333333335
traveled_tiles_max18
traveled_tiles_mean15.4
traveled_tiles_median18
traveled_tiles_min5
valid_direction_max7.766666666666679
valid_direction_mean5.119999999999999
valid_direction_median7.1999999999999815
valid_direction_min0.8666666666666678
No reset possible
5978806Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-30:07:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible