AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 372

evaluator372
ownerAndrea Censi
machineidsc-rudolf
processidsc-rudolf-17957
versionDC:3.1.58;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success561
# timeout2
# failed55
# error26
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
167462210lmandrileSim Il Pytorch hypeaido1_LFV_r2_cont-v3step3-videossuccessyes3720:00:41(hidden)
other stats
videos1
167412209lmandrileSim Il Pytorch hypeaido1_LFV_r2_cont-v3step3-videossuccessyes3720:00:46(hidden)
other stats
videos1
167392209lmandrileSim Il Pytorch hypeaido1_LFV_r2_cont-v3step1-simulationsuccessyes3720:01:49(hidden)
other stats
simulation-passed1
167262199yangzm11Solution templateaido1_luck-v3step1successyes3720:00:52(hidden)
score159.52844448616921


166792182SashkasemCopy of #51: sub 428 by Sashkasem (Random execution)aido1_LF1_r4-v3step4-vizsuccessyes3720:06:19(hidden)
driven_lanedir_consec_median0.40561391098299393
deviation-center-line_median0.7693287076782744
in-drivable-lane_median0


other stats
deviation-center-line_max1.6632356794503025
deviation-center-line_mean0.8939114322520325
deviation-center-line_min0
deviation-heading_max1.7749519972446195
deviation-heading_mean0.7792702986286383
deviation-heading_median0.9133708374733646
deviation-heading_min0
driven_any_max19.95999999999997
driven_any_mean17.222857142857016
driven_any_median19.959999999999827
driven_any_min0.800000000000002
driven_lanedir_consec_max0.7063142480974243
driven_lanedir_consec_mean0.3479649632208747
driven_lanedir_consec_min-0.2795993126444638
driven_lanedir_max0.7063142480974243
driven_lanedir_mean0.3479649632208747
driven_lanedir_median0.40561391098299393
driven_lanedir_min-0.2795993126444638
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean2.376190476190474
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 19.95999999999997, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 19.959999999999926, "driven_lanedir": 0.3592261140897226, "in-drivable-lane": 0, "deviation-heading": 1.0920028198391911, "deviation-center-line": 1.5777939893488258, "driven_lanedir_consec": 0.3592261140897226}, "ep002": {"driven_any": 19.959999999999763, "driven_lanedir": 0.40561391098299393, "in-drivable-lane": 0, "deviation-heading": 1.7749519972446195, "deviation-center-line": 0.7211924866362391, "driven_lanedir_consec": 0.40561391098299393}, "ep003": {"driven_any": 19.959999999999827, "driven_lanedir": 0.6065347311880471, "in-drivable-lane": 0, "deviation-heading": 0.6624640921684289, "deviation-center-line": 1.6632356794503025, "driven_lanedir_consec": 0.6065347311880471}, "ep004": {"driven_any": 19.959999999999795, "driven_lanedir": 0.7063142480974243, "in-drivable-lane": 0, "deviation-heading": 0.9551433370964606, "deviation-center-line": 1.455867552919619, "driven_lanedir_consec": 0.7063142480974243}, "ep005": {"driven_any": 0.800000000000002, "driven_lanedir": 0.6376650508323989, "in-drivable-lane": 0, "deviation-heading": 0.05695900657840228, "deviation-center-line": 0.06996160973096617, "driven_lanedir_consec": 0.6376650508323989}, "ep006": {"driven_any": 19.959999999999845, "driven_lanedir": -0.2795993126444638, "in-drivable-lane": 0, "deviation-heading": 0.9133708374733646, "deviation-center-line": 0.7693287076782744, "driven_lanedir_consec": -0.2795993126444638}}
166722175licCopy of #44: sub 783 by lic (AMOD18-AIDO not that random execution)aido1_LF1_r4-v3step4-vizsuccessyes3720:01:10(hidden)
driven_lanedir_consec_median0.5579571365591243
deviation-center-line_median0.056023723178873094
in-drivable-lane_median0.23333333333333328


other stats
deviation-center-line_max0.07856940306194948
deviation-center-line_mean0.04942475608133575
deviation-center-line_min0.01769642696719341
deviation-heading_max0.22754513379675223
deviation-heading_mean0.09422523198060184
deviation-heading_median0.07111836021471112
deviation-heading_min0.039871304604881586
driven_any_max1.1599999999999997
driven_any_mean0.9200000000000006
driven_any_median0.9199999999999956
driven_any_min0.5600000000000018
driven_lanedir_consec_max0.8690088227445094
driven_lanedir_consec_mean0.5959210438966147
driven_lanedir_consec_min0.10048931934583294
driven_lanedir_max0.8690088227445094
driven_lanedir_mean0.5959210438966147
driven_lanedir_median0.5579571365591243
driven_lanedir_min0.10048931934583294
in-drivable-lane_max0.7
in-drivable-lane_mean0.24285714285714283
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0800000000000023, "driven_lanedir": 0.10048931934583294, "in-drivable-lane": 0.7, "deviation-heading": 0.22754513379675223, "deviation-center-line": 0.01769642696719341, "driven_lanedir_consec": 0.10048931934583294}, "ep001": {"driven_any": 0.800000000000006, "driven_lanedir": 0.7982762706436004, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.07856940306194948, "driven_lanedir_consec": 0.7982762706436004}, "ep002": {"driven_any": 0.7999999999999972, "driven_lanedir": 0.5427180225543602, "in-drivable-lane": 0.2, "deviation-heading": 0.08858834572731211, "deviation-center-line": 0.027277636636860392, "driven_lanedir_consec": 0.5427180225543602}, "ep003": {"driven_any": 1.1200000000000006, "driven_lanedir": 0.7545365681033178, "in-drivable-lane": 0.29999999999999993, "deviation-heading": 0.04954101015386472, "deviation-center-line": 0.0709131907199231, "driven_lanedir_consec": 0.7545365681033178}, "ep004": {"driven_any": 1.1599999999999997, "driven_lanedir": 0.8690088227445094, "in-drivable-lane": 0.23333333333333328, "deviation-heading": 0.07111836021471112, "deviation-center-line": 0.07233129477553597, "driven_lanedir_consec": 0.8690088227445094}, "ep005": {"driven_any": 0.5600000000000018, "driven_lanedir": 0.5579571365591243, "in-drivable-lane": 0, "deviation-heading": 0.039871304604881586, "deviation-center-line": 0.056023723178873094, "driven_lanedir_consec": 0.5579571365591243}, "ep006": {"driven_any": 0.9199999999999956, "driven_lanedir": 0.5484611673255573, "in-drivable-lane": 0.2666666666666666, "deviation-heading": 0.13914482127694405, "deviation-center-line": 0.023161617229014827, "driven_lanedir_consec": 0.5484611673255573}}
166622165inat777Copy of #34: sub 897 by inat777 (Random execution)aido1_LF1_r4-v3step4-vizsuccessyes3720:01:37(hidden)
driven_lanedir_consec_median0.5507618692262288
deviation-center-line_median0.12319873311098832
in-drivable-lane_median0.4999999999999982


other stats
deviation-center-line_max0.24957631000988173
deviation-center-line_mean0.1431337925951226
deviation-center-line_min0.05615341490667505
deviation-heading_max0.6606609621387093
deviation-heading_mean0.278250149167354
deviation-heading_median0.22496413245356375
deviation-heading_min0.13256553421995546
driven_any_max1.1624493332667416
driven_any_mean0.8788381699901361
driven_any_median0.9207863445296022
driven_any_min0.4761285258238226
driven_lanedir_consec_max0.9365908649274995
driven_lanedir_consec_mean0.6042421851045491
driven_lanedir_consec_min0.11548938232659234
driven_lanedir_max0.9365908649274995
driven_lanedir_mean0.6042421851045491
driven_lanedir_median0.5507618692262288
driven_lanedir_min0.11548938232659234
in-drivable-lane_max2.033333333333336
in-drivable-lane_mean0.5666666666666672
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1175219448245266, "driven_lanedir": 0.11548938232659234, "in-drivable-lane": 2.033333333333336, "deviation-heading": 0.6606609621387093, "deviation-center-line": 0.05615341490667505, "driven_lanedir_consec": 0.11548938232659234}, "ep001": {"driven_any": 0.4761285258238226, "driven_lanedir": 0.47223118975003153, "in-drivable-lane": 0, "deviation-heading": 0.13256553421995546, "deviation-center-line": 0.12319873311098832, "driven_lanedir_consec": 0.47223118975003153}, "ep002": {"driven_any": 0.7991012175109364, "driven_lanedir": 0.5158454915780023, "in-drivable-lane": 0.6333333333333353, "deviation-heading": 0.22496413245356375, "deviation-center-line": 0.09144729540685224, "driven_lanedir_consec": 0.5158454915780023}, "ep003": {"driven_any": 0.7506825781901135, "driven_lanedir": 0.7167410422014366, "in-drivable-lane": 0.06666666666666687, "deviation-heading": 0.15455985114584458, "deviation-center-line": 0.18955591465514365, "driven_lanedir_consec": 0.7167410422014366}, "ep004": {"driven_any": 1.1624493332667416, "driven_lanedir": 0.9365908649274995, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 0.24157084264650497, "deviation-center-line": 0.21757605228195273, "driven_lanedir_consec": 0.9365908649274995}, "ep005": {"driven_any": 0.9251972457852105, "driven_lanedir": 0.9220354557220528, "in-drivable-lane": 0, "deviation-heading": 0.14010974097851367, "deviation-center-line": 0.24957631000988173, "driven_lanedir_consec": 0.9220354557220528}, "ep006": {"driven_any": 0.9207863445296022, "driven_lanedir": 0.5507618692262288, "in-drivable-lane": 0.7333333333333338, "deviation-heading": 0.39331998058838674, "deviation-center-line": 0.07442882779436454, "driven_lanedir_consec": 0.5507618692262288}}
166532156krishnaCopy of #25: sub 1143 by krishna (gym_duckietown + opencv)aido1_LF1_r4-v3step4-vizsuccessyes3720:02:34(hidden)
driven_lanedir_consec_median0.5858533607158978
deviation-center-line_median0.3907951129585367
in-drivable-lane_median1.499999999999995


other stats
deviation-center-line_max0.5245398845042427
deviation-center-line_mean0.34044892664602705
deviation-center-line_min0.13597635957867354
deviation-heading_max1.6222965474696691
deviation-heading_mean0.6500615837360443
deviation-heading_median0.4879651432549319
deviation-heading_min0.2790991322341711
driven_any_max1.1700000000000153
driven_any_mean0.9342857142857236
driven_any_median0.923999999999984
driven_any_min0.5880000000000161
driven_lanedir_consec_max0.8885977804633738
driven_lanedir_consec_mean0.6141915226510594
driven_lanedir_consec_min0.10933109167321264
driven_lanedir_max0.8885977804633738
driven_lanedir_mean0.6141915226510594
driven_lanedir_median0.5858533607158978
driven_lanedir_min0.10933109167321264
in-drivable-lane_max4.866666666666659
in-drivable-lane_mean1.6047619047619006
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1160000000000478, "driven_lanedir": 0.10933109167321264, "in-drivable-lane": 4.866666666666659, "deviation-heading": 1.6222965474696691, "deviation-center-line": 0.13597635957867354, "driven_lanedir_consec": 0.10933109167321264}, "ep001": {"driven_any": 0.8100000000000089, "driven_lanedir": 0.8082501369885908, "in-drivable-lane": 0, "deviation-heading": 0.29564933403289745, "deviation-center-line": 0.5245398845042427, "driven_lanedir_consec": 0.8082501369885908}, "ep002": {"driven_any": 0.797999999999984, "driven_lanedir": 0.5738295134514448, "in-drivable-lane": 1.1333333333333293, "deviation-heading": 0.6532227584047176, "deviation-center-line": 0.2045512888015031, "driven_lanedir_consec": 0.5738295134514448}, "ep003": {"driven_any": 1.134000000000009, "driven_lanedir": 0.7742660170707185, "in-drivable-lane": 1.9666666666666597, "deviation-heading": 0.340701712661844, "deviation-center-line": 0.4841454504207269, "driven_lanedir_consec": 0.7742660170707185}, "ep004": {"driven_any": 1.1700000000000153, "driven_lanedir": 0.8885977804633738, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.4879651432549319, "deviation-center-line": 0.49601082602115254, "driven_lanedir_consec": 0.8885977804633738}, "ep005": {"driven_any": 0.5880000000000161, "driven_lanedir": 0.5858533607158978, "in-drivable-lane": 0, "deviation-heading": 0.2790991322341711, "deviation-center-line": 0.3907951129585367, "driven_lanedir_consec": 0.5858533607158978}, "ep006": {"driven_any": 0.923999999999984, "driven_lanedir": 0.5592127581941768, "in-drivable-lane": 1.7666666666666604, "deviation-heading": 0.8714964580940783, "deviation-center-line": 0.14712356423735393, "driven_lanedir_consec": 0.5592127581941768}}
166332105iban_alexCopy of #32: sub 651 by iban_alex (PyTorch template)aido1_LFV_r2-v3step4-vizsuccessyes3720:01:17(hidden)
driven_lanedir_consec_median0.3915926073534841
deviation-center-line_median0.05189867033824725
in-drivable-lane_median0.7000000000000003


other stats
deviation-center-line_max0.09899768634323863
deviation-center-line_mean0.048315596929828515
deviation-center-line_min0
deviation-heading_max0.34108379146150014
deviation-heading_mean0.2334140576262228
deviation-heading_median0.25372281396630153
deviation-heading_min0
driven_any_max1.1449126520974544
driven_any_mean0.7439335620191435
driven_any_median0.7169204658838656
driven_any_min0.4298251595500821
driven_lanedir_consec_max0.6341081898676812
driven_lanedir_consec_mean0.3709121389317665
driven_lanedir_consec_min0
driven_lanedir_max0.6341081898676812
driven_lanedir_mean0.3709121389317665
driven_lanedir_median0.3915926073534841
driven_lanedir_min0
in-drivable-lane_max1.233333333333336
in-drivable-lane_mean0.5857142857142865
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.536607298025143, "driven_lanedir": 0, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.8535526652150991, "driven_lanedir": 0.437048195547439, "in-drivable-lane": 0.6000000000000004, "deviation-heading": 0.26088086699013086, "deviation-center-line": 0.052521652630908126, "driven_lanedir_consec": 0.437048195547439}, "ep002": {"driven_any": 0.5102856643801488, "driven_lanedir": 0.38871735215992653, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 0.3185988908936407, "deviation-center-line": 0.054365075957726966, "driven_lanedir_consec": 0.38871735215992653}, "ep003": {"driven_any": 0.7169204658838656, "driven_lanedir": 0.30124488583207376, "in-drivable-lane": 0.7000000000000003, "deviation-heading": 0.2455897142022135, "deviation-center-line": 0.0395106092243809, "driven_lanedir_consec": 0.30124488583207376}, "ep004": {"driven_any": 0.4298251595500821, "driven_lanedir": 0.3915926073534841, "in-drivable-lane": 0, "deviation-heading": 0.21402232586977288, "deviation-center-line": 0.040915484014297704, "driven_lanedir_consec": 0.3915926073534841}, "ep005": {"driven_any": 1.0154310289822108, "driven_lanedir": 0.4436737417617609, "in-drivable-lane": 1.233333333333336, "deviation-heading": 0.25372281396630153, "deviation-center-line": 0.05189867033824725, "driven_lanedir_consec": 0.4436737417617609}, "ep006": {"driven_any": 1.1449126520974544, "driven_lanedir": 0.6341081898676812, "in-drivable-lane": 0.7000000000000022, "deviation-heading": 0.34108379146150014, "deviation-center-line": 0.09899768634323863, "driven_lanedir_consec": 0.6341081898676812}}
166242088yangzm11Copy of #15: sub 1491 by yangzm11 (Tensorflow template)aido1_LFV_r2-v3step4-vizsuccessyes3720:01:11(hidden)
driven_lanedir_consec_median0.3670453944126635
deviation-center-line_median0.08638618681634436
in-drivable-lane_median0


other stats
deviation-center-line_max0.16650059640480563
deviation-center-line_mean0.08639511477695842
deviation-center-line_min0
deviation-heading_max0.6799860707109011
deviation-heading_mean0.2326588286126913
deviation-heading_median0.16991079660076824
deviation-heading_min0
driven_any_max1.2138803305883838
driven_any_mean0.6384744806684012
driven_any_median0.4595591034902214
driven_any_min0.37928694048500305
driven_lanedir_consec_max1.1114494526101797
driven_lanedir_consec_mean0.5376944819279441
driven_lanedir_consec_min0
driven_lanedir_max1.1114494526101797
driven_lanedir_mean0.5376944819279441
driven_lanedir_median0.3670453944126635
driven_lanedir_min0
in-drivable-lane_max0.7
in-drivable-lane_mean0.10476190476190476
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.4595591034902214, "driven_lanedir": 0, "in-drivable-lane": 0.7, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.37928694048500305, "driven_lanedir": 0.35836639140687754, "in-drivable-lane": 0, "deviation-heading": 0.12088153131604928, "deviation-center-line": 0.07317524466586352, "driven_lanedir_consec": 0.35836639140687754}, "ep002": {"driven_any": 1.0704277785516898, "driven_lanedir": 1.044979783403577, "in-drivable-lane": 0, "deviation-heading": 0.3409217769656097, "deviation-center-line": 0.16650059640480563, "driven_lanedir_consec": 1.044979783403577}, "ep003": {"driven_any": 0.4013170569384968, "driven_lanedir": 0.3670453944126635, "in-drivable-lane": 0, "deviation-heading": 0.20762646181753952, "deviation-center-line": 0.062458088347513034, "driven_lanedir_consec": 0.3670453944126635}, "ep004": {"driven_any": 1.2138803305883838, "driven_lanedir": 1.1114494526101797, "in-drivable-lane": 0, "deviation-heading": 0.6799860707109011, "deviation-center-line": 0.12290006404935576, "driven_lanedir_consec": 1.1114494526101797}, "ep005": {"driven_any": 0.5356468256258972, "driven_lanedir": 0.517322004414885, "in-drivable-lane": 0, "deviation-heading": 0.16991079660076824, "deviation-center-line": 0.09334562315482674, "driven_lanedir_consec": 0.517322004414885}, "ep006": {"driven_any": 0.4092033289991156, "driven_lanedir": 0.36469834724742656, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.10928516287797116, "deviation-center-line": 0.08638618681634436, "driven_lanedir_consec": 0.36469834724742656}}
166142119AmaurXCopy of #46: sub 780 by AmaurX (AMOD18-AIDO not that random execution)aido1_LFV_r2-v3step4-vizsuccessyes3720:02:10(hidden)
driven_lanedir_consec_median0.19464982819928256
deviation-center-line_median0.04529652650277543
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.07590267743509972
deviation-center-line_mean0.04311959073999867
deviation-center-line_min0
deviation-heading_max0.34231635625636603
deviation-heading_mean0.14764939325368573
deviation-heading_median0.09815660860820606
deviation-heading_min0
driven_any_max1.132768864979162
driven_any_mean0.482663948461779
driven_any_median0.43888327901862023
driven_any_min0.17473972573010244
driven_lanedir_consec_max0.7375358608366209
driven_lanedir_consec_mean0.287526522514589
driven_lanedir_consec_min0
driven_lanedir_max0.7375358608366209
driven_lanedir_mean0.287526522514589
driven_lanedir_median0.19464982819928256
driven_lanedir_min0
in-drivable-lane_max0.7999999999999999
in-drivable-lane_mean0.29523809523809547
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.43888327901862023, "driven_lanedir": 0, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.17473972573010244, "driven_lanedir": 0.14272987599762654, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.09815660860820606, "deviation-center-line": 0.03601867852705085, "driven_lanedir_consec": 0.14272987599762654}, "ep002": {"driven_any": 0.2007401511114999, "driven_lanedir": 0.19464982819928256, "in-drivable-lane": 0, "deviation-heading": 0.0767714619199504, "deviation-center-line": 0.04529652650277543, "driven_lanedir_consec": 0.19464982819928256}, "ep003": {"driven_any": 0.64553894232394, "driven_lanedir": 0.17018100040389506, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 0.2846736334189275, "deviation-center-line": 0.02829988396111871, "driven_lanedir_consec": 0.17018100040389506}, "ep004": {"driven_any": 0.3353790579323773, "driven_lanedir": 0.3322006756820617, "in-drivable-lane": 0, "deviation-heading": 0.06104140676297285, "deviation-center-line": 0.0647522367347806, "driven_lanedir_consec": 0.3322006756820617}, "ep005": {"driven_any": 0.4505976181367511, "driven_lanedir": 0.435388416482636, "in-drivable-lane": 0, "deviation-heading": 0.1705862858093772, "deviation-center-line": 0.05156713201916537, "driven_lanedir_consec": 0.435388416482636}, "ep006": {"driven_any": 1.132768864979162, "driven_lanedir": 0.7375358608366209, "in-drivable-lane": 0.5666666666666682, "deviation-heading": 0.34231635625636603, "deviation-center-line": 0.07590267743509972, "driven_lanedir_consec": 0.7375358608366209}}
166072106martatintoreCopy of #33: sub 786 by martatintore (AMOD18-AIDO not that random execution)aido1_LFV_r2-v3step4-vizsuccessyes3720:01:44(hidden)
driven_lanedir_consec_median0.5279391527108857
deviation-center-line_median0.1218470405215174
in-drivable-lane_median0.6666666666666674


other stats
deviation-center-line_max0.3070674866597604
deviation-center-line_mean0.14201640370773308
deviation-center-line_min0.04627062009108976
deviation-heading_max0.7336265499896395
deviation-heading_mean0.41289971036982426
deviation-heading_median0.47206426169382665
deviation-heading_min0.03661968047836495
driven_any_max2.4727018240308376
driven_any_mean1.1298052550832176
driven_any_median0.9968020226186676
driven_any_min0.27931982033094876
driven_lanedir_consec_max2.03843080998904
driven_lanedir_consec_mean0.7457739678571773
driven_lanedir_consec_min0.06411022026975788
driven_lanedir_max2.03843080998904
driven_lanedir_mean0.7457739678571773
driven_lanedir_median0.5279391527108857
driven_lanedir_min0.06411022026975788
in-drivable-lane_max2.366666666666668
in-drivable-lane_mean0.7666666666666659
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.228070354302232, "driven_lanedir": 0.06411022026975788, "in-drivable-lane": 2.366666666666668, "deviation-heading": 0.7336265499896395, "deviation-center-line": 0.05280390694687345, "driven_lanedir_consec": 0.06411022026975788}, "ep001": {"driven_any": 0.893868426160327, "driven_lanedir": 0.5279391527108857, "in-drivable-lane": 0.6666666666666674, "deviation-heading": 0.5268488219522447, "deviation-center-line": 0.113655923547413, "driven_lanedir_consec": 0.5279391527108857}, "ep002": {"driven_any": 0.9968020226186676, "driven_lanedir": 0.6316817719321202, "in-drivable-lane": 0.6333333333333324, "deviation-heading": 0.5917969755931286, "deviation-center-line": 0.14328139278754287, "driven_lanedir_consec": 0.6316817719321202}, "ep003": {"driven_any": 0.46969402387489745, "driven_lanedir": 0.4693135726112394, "in-drivable-lane": 0, "deviation-heading": 0.03661968047836495, "deviation-center-line": 0.1218470405215174, "driven_lanedir_consec": 0.4693135726112394}, "ep004": {"driven_any": 1.568180314264613, "driven_lanedir": 1.2113467982965327, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 0.47206426169382665, "deviation-center-line": 0.2091884553999348, "driven_lanedir_consec": 1.2113467982965327}, "ep005": {"driven_any": 2.4727018240308376, "driven_lanedir": 2.03843080998904, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 0.462068209276685, "deviation-center-line": 0.3070674866597604, "driven_lanedir_consec": 2.03843080998904}, "ep006": {"driven_any": 0.27931982033094876, "driven_lanedir": 0.27759544919066537, "in-drivable-lane": 0, "deviation-heading": 0.06727347360487974, "deviation-center-line": 0.04627062009108976, "driven_lanedir_consec": 0.27759544919066537}}
165882140orlando.m.bol@gmail.comCopy of #9: sub 436 by orlando.m.bol@gmail.com (PyTorch DDPG template)aido1_LF1_r4-v3step4-vizsuccessyes3720:07:15(hidden)
driven_lanedir_consec_median4.660972601809645
deviation-center-line_median1.0471529978202343
in-drivable-lane_median1.699999999999997


other stats
deviation-center-line_max1.1490350613988942
deviation-center-line_mean1.0504708003120018
deviation-center-line_min0.93658483864408
deviation-heading_max10.856514258870236
deviation-heading_mean10.28519658029301
deviation-heading_median10.63118630323542
deviation-heading_min8.821929989783744
driven_any_max14.9460303612426
driven_any_mean14.945969701594125
driven_any_median14.945975873385963
driven_any_min14.945878578073598
driven_lanedir_consec_max4.707109518269156
driven_lanedir_consec_mean4.47560755397745
driven_lanedir_consec_min4.1574234022662
driven_lanedir_max9.378424148600503
driven_lanedir_mean9.139108618516786
driven_lanedir_median9.24074124735164
driven_lanedir_min8.626010688058416
in-drivable-lane_max3.2666666666666604
in-drivable-lane_mean1.9904761904761872
in-drivable-lane_min1.466666666666664
per-episodes
details{"ep000": {"driven_any": 14.945975873385963, "driven_lanedir": 9.275757957398024, "in-drivable-lane": 1.5666666666666638, "deviation-heading": 10.806032286975588, "deviation-center-line": 1.0460345287563428, "driven_lanedir_consec": 4.707109518269156}, "ep001": {"driven_any": 14.945883699005018, "driven_lanedir": 9.320532076506971, "in-drivable-lane": 1.4999999999999971, "deviation-heading": 10.856514258870236, "deviation-center-line": 0.973351038594387, "driven_lanedir_consec": 4.668599181797434}, "ep002": {"driven_any": 14.9460303612426, "driven_lanedir": 9.16486930441657, "in-drivable-lane": 1.9666666666666648, "deviation-heading": 10.30581734168244, "deviation-center-line": 1.0471529978202343, "driven_lanedir_consec": 4.217482438964028}, "ep003": {"driven_any": 14.946030361242586, "driven_lanedir": 8.967424907285379, "in-drivable-lane": 2.4666666666666632, "deviation-heading": 9.735558515644255, "deviation-center-line": 1.1490350613988942, "driven_lanedir_consec": 4.1574234022662}, "ep004": {"driven_any": 14.946030361242595, "driven_lanedir": 9.24074124735164, "in-drivable-lane": 1.699999999999997, "deviation-heading": 10.63118630323542, "deviation-center-line": 1.0605488751185932, "driven_lanedir_consec": 4.705340131370488}, "ep005": {"driven_any": 14.945878578073598, "driven_lanedir": 9.378424148600503, "in-drivable-lane": 1.466666666666664, "deviation-heading": 10.839337365859397, "deviation-center-line": 0.93658483864408, "driven_lanedir_consec": 4.660972601809645}, "ep006": {"driven_any": 14.945958676966518, "driven_lanedir": 8.626010688058416, "in-drivable-lane": 3.2666666666666604, "deviation-heading": 8.821929989783744, "deviation-center-line": 1.1405882618514804, "driven_lanedir_consec": 4.212325603365202}}
165792075heyt0nyCopy of #2: sub 1579 by heyt0ny (SAIC MOSCOW MML)aido1_LFV_r2-v3step4-vizsuccessno3720:02:32(hidden)
driven_lanedir_consec_median0.022026454564842347
deviation-center-line_median0.0617404067696424
in-drivable-lane_median0


other stats
deviation-center-line_max0.3717058067205543
deviation-center-line_mean0.133928443841444
deviation-center-line_min0.013449871682650836
deviation-heading_max1.293586912582576
deviation-heading_mean0.4446588712110294
deviation-heading_median0.1710489987560285
deviation-heading_min0.07389426111101743
driven_any_max0.6286990626351769
driven_any_mean0.16629685996987434
driven_any_median0.02804675525618663
driven_any_min0.009329652976392247
driven_lanedir_consec_max0.6257137505668134
driven_lanedir_consec_mean0.1624135886239463
driven_lanedir_consec_min0.0017205966685367737
driven_lanedir_max0.6257137505668134
driven_lanedir_mean0.1624135886239463
driven_lanedir_median0.022026454564842347
driven_lanedir_min0.0017205966685367737
in-drivable-lane_max0.3
in-drivable-lane_mean0.08095238095238096
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.012162370091556542, "driven_lanedir": 0.0017205966685367737, "in-drivable-lane": 0.3, "deviation-heading": 0.07389426111101743, "deviation-center-line": 0.013449871682650836, "driven_lanedir_consec": 0.0017205966685367737}, "ep001": {"driven_any": 0.6286990626351769, "driven_lanedir": 0.6257137505668134, "in-drivable-lane": 0, "deviation-heading": 1.041919912324025, "deviation-center-line": 0.3717058067205543, "driven_lanedir_consec": 0.6257137505668134}, "ep002": {"driven_any": 0.02804675525618663, "driven_lanedir": 0.022026454564842347, "in-drivable-lane": 0.2333333333333334, "deviation-heading": 0.27848021311069615, "deviation-center-line": 0.04171683889056563, "driven_lanedir_consec": 0.022026454564842347}, "ep003": {"driven_any": 0.06176351012535536, "driven_lanedir": 0.06133845520699866, "in-drivable-lane": 0, "deviation-heading": 0.1710489987560285, "deviation-center-line": 0.06490106855962777, "driven_lanedir_consec": 0.06133845520699866}, "ep004": {"driven_any": 0.4113329784574994, "driven_lanedir": 0.4048564805123381, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.293586912582576, "deviation-center-line": 0.3422142088794193, "driven_lanedir_consec": 0.4048564805123381}, "ep005": {"driven_any": 0.012743690246953036, "driven_lanedir": 0.012303207170347094, "in-drivable-lane": 0, "deviation-heading": 0.1140906803817543, "deviation-center-line": 0.04177090538764784, "driven_lanedir_consec": 0.012303207170347094}, "ep006": {"driven_any": 0.009329652976392247, "driven_lanedir": 0.008936175677747692, "in-drivable-lane": 0, "deviation-heading": 0.1395911202111085, "deviation-center-line": 0.0617404067696424, "driven_lanedir_consec": 0.008936175677747692}}
165622182SashkasemCopy of #51: sub 428 by Sashkasem (Random execution)aido1_LF1_r4-v3step4-vizsuccessno3720:06:12(hidden)
driven_lanedir_consec_median0.01483889336629208
deviation-center-line_median0.7693287076782744
in-drivable-lane_median0


other stats
deviation-center-line_max1.6632356794503025
deviation-center-line_mean0.8939114322520325
deviation-center-line_min0
deviation-heading_max1.7749519972446195
deviation-heading_mean0.7792702986286383
deviation-heading_median0.9133708374733646
deviation-heading_min0
driven_any_max0.6639999999999999
driven_any_mean0.5727619047619027
driven_any_median0.6639999999999968
driven_any_min0.0253333333333334
driven_lanedir_consec_max0.02484009440101614
driven_lanedir_consec_mean0.01197247173332311
driven_lanedir_consec_min-0.00798865485088825
driven_lanedir_max0.02484009440101614
driven_lanedir_mean0.01197247173332311
driven_lanedir_median0.01483889336629208
driven_lanedir_min-0.00798865485088825
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean2.376190476190474
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6639999999999993, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.6639999999999968, "driven_lanedir": 0.013304664837680082, "in-drivable-lane": 0, "deviation-heading": 1.0920028198391911, "deviation-center-line": 1.5777939893488258, "driven_lanedir_consec": 0.013304664837680082}, "ep002": {"driven_any": 0.6639999999999968, "driven_lanedir": 0.01483889336629208, "in-drivable-lane": 0, "deviation-heading": 1.7749519972446195, "deviation-center-line": 0.7211924866362391, "driven_lanedir_consec": 0.01483889336629208}, "ep003": {"driven_any": 0.6639999999999999, "driven_lanedir": 0.018885275984998708, "in-drivable-lane": 0, "deviation-heading": 0.6624640921684289, "deviation-center-line": 1.6632356794503025, "driven_lanedir_consec": 0.018885275984998708}, "ep004": {"driven_any": 0.6639999999999969, "driven_lanedir": 0.02484009440101614, "in-drivable-lane": 0, "deviation-heading": 0.9551433370964606, "deviation-center-line": 1.455867552919619, "driven_lanedir_consec": 0.02484009440101614}, "ep005": {"driven_any": 0.0253333333333334, "driven_lanedir": 0.019927028394163, "in-drivable-lane": 0, "deviation-heading": 0.05695900657840228, "deviation-center-line": 0.06996160973096617, "driven_lanedir_consec": 0.019927028394163}, "ep006": {"driven_any": 0.663999999999996, "driven_lanedir": -0.00798865485088825, "in-drivable-lane": 0, "deviation-heading": 0.9133708374733646, "deviation-center-line": 0.7693287076782744, "driven_lanedir_consec": -0.00798865485088825}}
165362182SashkasemCopy of #51: sub 428 by Sashkasem (Random execution)aido1_LF1_r4-v3step3-videossuccessyes3720:03:44(hidden)
other stats
videos1
164932153gunshiCopy of #22: sub 1268 by gunshi (ROS-based Lane Following)aido1_LF1_r4-v3step4-vizsuccessno3720:05:11(hidden)
driven_lanedir_consec_median0.03912315982061517
deviation-center-line_median0.36600946549873087
in-drivable-lane_median12.133333333333328


other stats
deviation-center-line_max0.7892463753388207
deviation-center-line_mean0.3951215682416315
deviation-center-line_min0.12172793401097429
deviation-heading_max1.547246484186424
deviation-heading_mean0.954433662346131
deviation-heading_median0.8152831003637339
deviation-heading_min0.26053298692700383
driven_any_max0.17784859085224383
driven_any_mean0.1545767909409664
driven_any_median0.17783996076579578
driven_any_min0.015000419402007142
driven_lanedir_consec_max0.08503499812489285
driven_lanedir_consec_mean0.04144115901631562
driven_lanedir_consec_min0.013307495432731934
driven_lanedir_max0.08503499812489285
driven_lanedir_mean0.04144115901631562
driven_lanedir_median0.03912315982061517
driven_lanedir_min0.013307495432731934
in-drivable-lane_max15.13333333333329
in-drivable-lane_mean10.342857142857133
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.17782244578976666, "driven_lanedir": 0.013307495432731934, "in-drivable-lane": 15.13333333333329, "deviation-heading": 0.7397524588173773, "deviation-center-line": 0.1713687177544723, "driven_lanedir_consec": 0.013307495432731934}, "ep001": {"driven_any": 0.17784859085224383, "driven_lanedir": 0.04604397804761317, "in-drivable-lane": 12.133333333333328, "deviation-heading": 0.7977745749012363, "deviation-center-line": 0.41170705561230936, "driven_lanedir_consec": 0.04604397804761317}, "ep002": {"driven_any": 0.177843142984788, "driven_lanedir": 0.01936590187729064, "in-drivable-lane": 14.53333333333332, "deviation-heading": 1.014870976359327, "deviation-center-line": 0.1960304897721509, "driven_lanedir_consec": 0.01936590187729064}, "ep003": {"driven_any": 0.17784447272737364, "driven_lanedir": 0.03912315982061517, "in-drivable-lane": 12.733333333333318, "deviation-heading": 0.8152831003637339, "deviation-center-line": 0.36600946549873087, "driven_lanedir_consec": 0.03912315982061517}, "ep004": {"driven_any": 0.17783996076579578, "driven_lanedir": 0.07269459913059054, "in-drivable-lane": 9.500000000000004, "deviation-heading": 1.547246484186424, "deviation-center-line": 0.7097609397039621, "driven_lanedir_consec": 0.07269459913059054}, "ep005": {"driven_any": 0.17783850406478974, "driven_lanedir": 0.08503499812489285, "in-drivable-lane": 8.366666666666672, "deviation-heading": 1.505575054867816, "deviation-center-line": 0.7892463753388207, "driven_lanedir_consec": 0.08503499812489285}, "ep006": {"driven_any": 0.015000419402007142, "driven_lanedir": 0.014517980680475048, "in-drivable-lane": 0, "deviation-heading": 0.26053298692700383, "deviation-center-line": 0.12172793401097429, "driven_lanedir_consec": 0.014517980680475048}}
164882175licCopy of #44: sub 783 by lic (AMOD18-AIDO not that random execution)aido1_LF1_r4-v3step3-videossuccessyes3720:00:37(hidden)
other stats
videos1
164782173kbensonCopy of #42: sub 769 by kbenson (AMOD18-AIDO not that random execution)aido1_LF1_r4-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median0.7999999999999999


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -36.6421162430197, "good_angle": 0.5231223188267838, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 21, "reward": -47.253679474549635, "good_angle": 0.15423356340546784, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.26666666666666666}, "ep003": {"nsteps": 29, "reward": -34.48776989465515, "good_angle": 0.13377976232358335, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0.29999999999999993}, "ep004": {"nsteps": 30, "reward": -33.12740348378817, "good_angle": 0.13484239023230782, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.2666666666666666}, "ep005": {"nsteps": 15, "reward": -66.34810793648164, "good_angle": 0.0034065448519183875, "survival_time": 0.49999999999999994, "traveled_tiles": 2, "valid_direction": 0}, "ep006": {"nsteps": 24, "reward": -42.623495357731976, "good_angle": 2.440009577414256, "survival_time": 0.7999999999999999, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max2.440009577414256
good_angle_mean0.48463078663456993
good_angle_median0.13484239023230782
good_angle_min0.0030213493876724944
reward_max-33.12740348378817
reward_mean-43.966013249189565
reward_median-42.623495357731976
reward_min-66.34810793648164
survival_time_max1
survival_time_mean0.7999999999999999
survival_time_min0.49999999999999994
traveled_tiles_max3
traveled_tiles_mean2.142857142857143
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.49999999999999994
valid_direction_mean0.24285714285714283
valid_direction_median0.26666666666666666
valid_direction_min0
164682174yanberCopy of #43: sub 777 by yanber (AMOD18-AIDO not that random execution)aido1_LF1_r4-v3step1-simulationsuccessyes3720:01:10(hidden)
other stats
simulation-passed1
164622153gunshiCopy of #22: sub 1268 by gunshi (ROS-based Lane Following)aido1_LF1_r4-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.15425739301522845, "good_angle": 1.340801148650894, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.0666666666666806}, "ep001": {"nsteps": 500, "reward": 0.12507998795295133, "good_angle": 0.7121302499161586, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.6333333333333275}, "ep002": {"nsteps": 500, "reward": -0.018269332091556865, "good_angle": 0.9331107286854536, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.299999999999999}, "ep003": {"nsteps": 500, "reward": 0.04373759501459426, "good_angle": 1.1656287852150669, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.5000000000000124}, "ep004": {"nsteps": 500, "reward": 0.10872741486754968, "good_angle": 1.2318949252514173, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.6999999999999904}, "ep005": {"nsteps": 500, "reward": 0.10380904392851516, "good_angle": 1.3807552057630608, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.266666666666655}, "ep006": {"nsteps": 44, "reward": -22.56496056355536, "good_angle": 1.8976087223414628, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0.466666666666668}}
good_angle_max1.8976087223414628
good_angle_mean1.2374185379747875
good_angle_median1.2318949252514173
good_angle_min0.7121302499161586
reward_max0.12507998795295133
reward_mean-3.1937333209855048
reward_median0.04373759501459426
reward_min-22.56496056355536
survival_time_max16.666666666666654
survival_time_mean14.495238095238085
survival_time_min1.466666666666668
traveled_tiles_max11
traveled_tiles_mean9
traveled_tiles_median10
traveled_tiles_min2
valid_direction_max3.266666666666655
valid_direction_mean2.276190476190476
valid_direction_median2.5000000000000124
valid_direction_min0.466666666666668
164502170marshinCopy of #39: sub 756 by marshin (PyTorch template)aido1_LF1_r4-v3step1-simulationsuccessyes3720:01:44(hidden)
other stats
simulation-passed1
164452167lmandrileCopy of #36: sub 613 by lmandrile (PyTorch template)aido1_LF1_r4-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median1.7333333333333354


other stats
episodes
details{"ep000": {"nsteps": 23, "reward": -45.12110706256784, "good_angle": 0.15804366841343703, "survival_time": 0.7666666666666666, "traveled_tiles": 1, "valid_direction": 0.4}, "ep001": {"nsteps": 47, "reward": -21.59243374095952, "good_angle": 0.4910666015565669, "survival_time": 1.5666666666666682, "traveled_tiles": 3, "valid_direction": 1.233333333333335}, "ep002": {"nsteps": 52, "reward": -18.76065266576524, "good_angle": 0.3616975127229674, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.9666666666666688}, "ep003": {"nsteps": 66, "reward": -14.623223635043498, "good_angle": 0.2489732614201837, "survival_time": 2.200000000000002, "traveled_tiles": 3, "valid_direction": 0.8333333333333335}, "ep004": {"nsteps": 81, "reward": -12.500163105994831, "good_angle": 1.2746111654279828, "survival_time": 2.7, "traveled_tiles": 3, "valid_direction": 2.066666666666666}, "ep005": {"nsteps": 26, "reward": -38.09058407149636, "good_angle": 0.024603976351533986, "survival_time": 0.8666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep006": {"nsteps": 59, "reward": -19.11632652808044, "good_angle": 6.012327928416546, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 1.5000000000000029}}
good_angle_max6.012327928416546
good_angle_mean1.2244748734727453
good_angle_median0.3616975127229674
good_angle_min0.024603976351533986
reward_max-12.500163105994831
reward_mean-24.25778440141539
reward_median-19.11632652808044
reward_min-45.12110706256784
survival_time_max2.7
survival_time_mean1.6857142857142868
survival_time_min0.7666666666666666
traveled_tiles_max3
traveled_tiles_mean2.142857142857143
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.066666666666666
valid_direction_mean1.0000000000000009
valid_direction_median0.9666666666666688
valid_direction_min0
164312166haliangCopy of #35: sub 784 by haliang (Random execution)aido1_LF1_r4-v3step1-simulationsuccessyes3720:01:31(hidden)
other stats
simulation-passed1
164072149melorianCopy of #18: sub 1378 by melorian (Tensorflow template)aido1_LF1_r4-v3step4-vizsuccessno3720:03:28(hidden)
driven_lanedir_consec_median0.17011593062607544
deviation-center-line_median0.42982403948464265
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max1.1177213363740506
deviation-center-line_mean0.45635593389536216
deviation-center-line_min0.034399238980026385
deviation-heading_max2.063134627582097
deviation-heading_mean1.2686593512338322
deviation-heading_median1.6015780209519317
deviation-heading_min0.15835941082778038
driven_any_max0.2875562532247857
driven_any_mean0.13802014371262064
driven_any_median0.18459677392850252
driven_any_min0.005918040145406378
driven_lanedir_consec_max0.28358732031203443
driven_lanedir_consec_mean0.1315498930976078
driven_lanedir_consec_min0.005190561561356643
driven_lanedir_max0.28358732031203443
driven_lanedir_mean0.13190415702456856
driven_lanedir_median0.17259577811480076
driven_lanedir_min0.005190561561356643
in-drivable-lane_max0.36666666666666664
in-drivable-lane_mean0.12857142857142842
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.1934574121066837, "driven_lanedir": 0.1790097669707271, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 1.6153687740917066, "deviation-center-line": 0.42982403948464265, "driven_lanedir_consec": 0.1790097669707271}, "ep001": {"driven_any": 0.18459677392850252, "driven_lanedir": 0.17259577811480076, "in-drivable-lane": 0.33333333333333304, "deviation-heading": 2.063134627582097, "deviation-center-line": 0.5883624280799811, "driven_lanedir_consec": 0.17011593062607544}, "ep002": {"driven_any": 0.2875562532247857, "driven_lanedir": 0.28358732031203443, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.943382718464844, "deviation-center-line": 1.1177213363740506, "driven_lanedir_consec": 0.28358732031203443}, "ep003": {"driven_any": 0.19181326595311096, "driven_lanedir": 0.1879542235784359, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.6015780209519317, "deviation-center-line": 0.6055464657185989, "driven_lanedir_consec": 0.1879542235784359}, "ep004": {"driven_any": 0.04238009746832437, "driven_lanedir": 0.04043898034746672, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 0.5636996088527138, "deviation-center-line": 0.23853954917653675, "driven_lanedir_consec": 0.04043898034746672}, "ep005": {"driven_any": 0.06041916316153064, "driven_lanedir": 0.05455246828715847, "in-drivable-lane": 0, "deviation-heading": 0.9350922978657532, "deviation-center-line": 0.18009847945369828, "driven_lanedir_consec": 0.05455246828715847}, "ep006": {"driven_any": 0.005918040145406378, "driven_lanedir": 0.005190561561356643, "in-drivable-lane": 0, "deviation-heading": 0.15835941082778038, "deviation-center-line": 0.034399238980026385, "driven_lanedir_consec": 0.005190561561356643}}
164032157Maxim KuzminCopy of #26: sub 395 by Maxim Kuzmin (Random execution)aido1_LF1_r4-v3step2-scoringsuccessyes3720:00:19(hidden)
survival_time_median2.200000000000002


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -13.222754719403072, "good_angle": 1.582013816043542, "survival_time": 2.7333333333333334, "traveled_tiles": 2, "valid_direction": 1.0333333333333314}, "ep001": {"nsteps": 97, "reward": -10.231313268010764, "good_angle": 0.24550250485151076, "survival_time": 3.2333333333333316, "traveled_tiles": 3, "valid_direction": 0.5999999999999979}, "ep002": {"nsteps": 58, "reward": -16.799054542395833, "good_angle": 0.2574926723746642, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 0.7000000000000022}, "ep003": {"nsteps": 30, "reward": -32.97473869969448, "good_angle": 0.01827195658765832, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 84, "reward": -11.507226644039507, "good_angle": 0.35065624656957345, "survival_time": 2.8, "traveled_tiles": 3, "valid_direction": 0.7333333333333307}, "ep005": {"nsteps": 30, "reward": -33.00785765722394, "good_angle": 0.015305149192755245, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0}, "ep006": {"nsteps": 66, "reward": -15.99866004784902, "good_angle": 6.64847317830668, "survival_time": 2.200000000000002, "traveled_tiles": 2, "valid_direction": 1.300000000000002}}
good_angle_max6.64847317830668
good_angle_mean1.3025307891323403
good_angle_median0.2574926723746642
good_angle_min0.015305149192755245
reward_max-10.231313268010764
reward_mean-19.10594365408809
reward_median-15.99866004784902
reward_min-33.00785765722394
survival_time_max3.2333333333333316
survival_time_mean2.128571428571429
survival_time_min1
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.300000000000002
valid_direction_mean0.6238095238095234
valid_direction_median0.7000000000000022
valid_direction_min0
163932157Maxim KuzminCopy of #26: sub 395 by Maxim Kuzmin (Random execution)aido1_LF1_r4-v3step1-simulationsuccessyes3720:01:19(hidden)
other stats
simulation-passed1
163702146yangzm11Copy of #15: sub 1491 by yangzm11 (Tensorflow template)aido1_LF1_r4-v3step3-videossuccessyes3720:03:29(hidden)
other stats
videos1
163412134miksazCopy of #3: sub 1859 by miksaz (JetBrains Research)aido1_LF1_r4-v3step4-vizsuccessno3720:05:39(hidden)
driven_lanedir_consec_median0.16068888617474317
deviation-center-line_median0.5603265425589657
in-drivable-lane_median0.3999999999999986


other stats
deviation-center-line_max2.0584097747833163
deviation-center-line_mean1.019046189776833
deviation-center-line_min0.021579039423084992
deviation-heading_max1.4355724727489445
deviation-heading_mean0.901613699997327
deviation-heading_median1.195867436192223
deviation-heading_min0.21904177543400905
driven_any_max0.6313162353034047
driven_any_mean0.319858142046077
driven_any_median0.17476927279081392
driven_any_min0.002856388169070805
driven_lanedir_consec_max0.6122936110773585
driven_lanedir_consec_mean0.3033807746321861
driven_lanedir_consec_min0.0008518203526621951
driven_lanedir_max0.6122936110773585
driven_lanedir_mean0.30435793914517234
driven_lanedir_median0.16068888617474317
driven_lanedir_min0.0008518203526621951
in-drivable-lane_max0.733333333333331
in-drivable-lane_mean0.38095238095237993
in-drivable-lane_min0.06666666666666665
per-episodes
details{"ep000": {"driven_any": 0.6313162353034047, "driven_lanedir": 0.6122936110773585, "in-drivable-lane": 0.4666666666666656, "deviation-heading": 1.258572245974052, "deviation-center-line": 2.0584097747833163, "driven_lanedir_consec": 0.6122936110773585}, "ep001": {"driven_any": 0.6244045933152805, "driven_lanedir": 0.5952479405389326, "in-drivable-lane": 0.733333333333331, "deviation-heading": 1.4355724727489445, "deviation-center-line": 2.0557430176800495, "driven_lanedir_consec": 0.5952479405389326}, "ep002": {"driven_any": 0.624615484046199, "driven_lanedir": 0.6029890679717159, "in-drivable-lane": 0.5333333333333314, "deviation-heading": 1.3488225260588536, "deviation-center-line": 2.0389218396017195, "driven_lanedir_consec": 0.6029890679717159}, "ep003": {"driven_any": 0.17476927279081392, "driven_lanedir": 0.16068888617474317, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 0.41139948138548094, "deviation-center-line": 0.5603265425589657, "driven_lanedir_consec": 0.16068888617474317}, "ep004": {"driven_any": 0.002856388169070805, "driven_lanedir": 0.0008518203526621951, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 0.21904177543400905, "deviation-center-line": 0.021579039423084992, "driven_lanedir_consec": 0.0008518203526621951}, "ep005": {"driven_any": 0.15561672624893252, "driven_lanedir": 0.1434863250687618, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.195867436192223, "deviation-center-line": 0.34787682020174526, "driven_lanedir_consec": 0.1405400206237973}, "ep006": {"driven_any": 0.02542829444883758, "driven_lanedir": 0.014947922832032223, "in-drivable-lane": 0.3333333333333333, "deviation-heading": 0.4420199621877253, "deviation-center-line": 0.0504662941889501, "driven_lanedir_consec": 0.01105407568609317}}
163192130zgxsinCopy of #57: sub 1534 by zgxsin (Random execution)aido1_LFV_r2-v3step4-vizsuccessno3720:02:36(hidden)
driven_lanedir_consec_median0.017512151401404823
deviation-center-line_median0.13133508267497437
in-drivable-lane_median0.6999999999999993


other stats
deviation-center-line_max0.4941073953745878
deviation-center-line_mean0.1659014936554777
deviation-center-line_min0.054726313363399184
deviation-heading_max0.6884552036779031
deviation-heading_mean0.4103720651073696
deviation-heading_median0.5208548466345448
deviation-heading_min0.03150181490997008
driven_any_max0.08208368248433609
driven_any_mean0.03718861597038934
driven_any_median0.032493000841134885
driven_any_min0.008913765159559842
driven_lanedir_consec_max0.06913860794911872
driven_lanedir_consec_mean0.02380438611427441
driven_lanedir_consec_min0.0033996997026402415
driven_lanedir_max0.06913860794911872
driven_lanedir_mean0.02380438611427441
driven_lanedir_median0.017512151401404823
driven_lanedir_min0.0033996997026402415
in-drivable-lane_max2.3000000000000016
in-drivable-lane_mean0.8380952380952372
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.0400055409544738, "driven_lanedir": 0.0033996997026402415, "in-drivable-lane": 2.3000000000000016, "deviation-heading": 0.6884552036779031, "deviation-center-line": 0.05644152320133636, "driven_lanedir_consec": 0.0033996997026402415}, "ep001": {"driven_any": 0.02886617845598464, "driven_lanedir": 0.017512151401404823, "in-drivable-lane": 0.6333333333333344, "deviation-heading": 0.5208548466345448, "deviation-center-line": 0.10847698540083728, "driven_lanedir_consec": 0.017512151401404823}, "ep002": {"driven_any": 0.032493000841134885, "driven_lanedir": 0.02036720731002847, "in-drivable-lane": 0.6999999999999993, "deviation-heading": 0.5326711088571606, "deviation-center-line": 0.13133508267497437, "driven_lanedir_consec": 0.02036720731002847}, "ep003": {"driven_any": 0.015308433067815793, "driven_lanedir": 0.01529957324363863, "in-drivable-lane": 0, "deviation-heading": 0.03150181490997008, "deviation-center-line": 0.1441641879014538, "driven_lanedir_consec": 0.01529957324363863}, "ep004": {"driven_any": 0.05264971082942029, "driven_lanedir": 0.032052165577499264, "in-drivable-lane": 1.4666666666666617, "deviation-heading": 0.4299607100274604, "deviation-center-line": 0.17205896767175505, "driven_lanedir_consec": 0.032052165577499264}, "ep005": {"driven_any": 0.08208368248433609, "driven_lanedir": 0.06913860794911872, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 0.6064508649788919, "deviation-center-line": 0.4941073953745878, "driven_lanedir_consec": 0.06913860794911872}, "ep006": {"driven_any": 0.008913765159559842, "driven_lanedir": 0.008861297615590713, "in-drivable-lane": 0, "deviation-heading": 0.06270990666565668, "deviation-center-line": 0.054726313363399184, "driven_lanedir_consec": 0.008861297615590713}}
163062128amuniCopy of #55: sub 781 by amuni (AMOD18-AIDO not that random execution)aido1_LFV_r2-v3step3-videossuccessyes3720:02:16(hidden)
other stats
videos1
162702124SashkasemCopy of #51: sub 428 by Sashkasem (Random execution)aido1_LFV_r2-v3step1-simulationsuccessyes3720:03:56(hidden)
other stats
simulation-passed1
162532109lmandrileCopy of #36: sub 613 by lmandrile (PyTorch template)aido1_LFV_r2-v3step4-vizsuccessno3720:01:18(hidden)
driven_lanedir_consec_median0.012786834814808443
deviation-center-line_median0.052193589039849185
in-drivable-lane_median0.6666666666666687


other stats
deviation-center-line_max0.13620625506524003
deviation-center-line_mean0.0697778044666716
deviation-center-line_min0
deviation-heading_max0.26340284214818016
deviation-heading_mean0.1793565056162759
deviation-heading_median0.17183198817944967
deviation-heading_min0
driven_any_max0.03583373059748198
driven_any_mean0.020836155759651316
driven_any_median0.01789118000316696
driven_any_min0.008706781731362398
driven_lanedir_consec_max0.015436788801782965
driven_lanedir_consec_mean0.01120980407914654
driven_lanedir_consec_min0
driven_lanedir_max0.015436788801782965
driven_lanedir_mean0.01120980407914654
driven_lanedir_median0.012786834814808443
driven_lanedir_min0
in-drivable-lane_max1.366666666666669
in-drivable-lane_mean0.5571428571428579
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.01789118000316696, "driven_lanedir": 0, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.01621911742847205, "driven_lanedir": 0.012326920703596042, "in-drivable-lane": 0.19999999999999996, "deviation-heading": 0.256058243651626, "deviation-center-line": 0.049097842881715995, "driven_lanedir_consec": 0.012326920703596042}, "ep002": {"driven_any": 0.01311010315448613, "driven_lanedir": 0.012786834814808443, "in-drivable-lane": 0, "deviation-heading": 0.1494006993176271, "deviation-center-line": 0.13620625506524003, "driven_lanedir_consec": 0.012786834814808443}, "ep003": {"driven_any": 0.008706781731362398, "driven_lanedir": 0.008313911161474048, "in-drivable-lane": 0, "deviation-heading": 0.1641824474953315, "deviation-center-line": 0.0794239402013504, "driven_lanedir_consec": 0.008313911161474048}, "ep004": {"driven_any": 0.025292197843663752, "driven_lanedir": 0.014411578395595898, "in-drivable-lane": 0.6666666666666687, "deviation-heading": 0.17183198817944967, "deviation-center-line": 0.11980011870786712, "driven_lanedir_consec": 0.014411578395595898}, "ep005": {"driven_any": 0.02879997955892595, "driven_lanedir": 0.015436788801782965, "in-drivable-lane": 0.8000000000000017, "deviation-heading": 0.25061931852171687, "deviation-center-line": 0.052193589039849185, "driven_lanedir_consec": 0.015436788801782965}, "ep006": {"driven_any": 0.03583373059748198, "driven_lanedir": 0.015192594676768372, "in-drivable-lane": 1.366666666666669, "deviation-heading": 0.26340284214818016, "deviation-center-line": 0.05172288537067849, "driven_lanedir_consec": 0.015192594676768372}}
162462109lmandrileCopy of #36: sub 613 by lmandrile (PyTorch template)aido1_LFV_r2-v3step3-videossuccessyes3720:00:42(hidden)
other stats
videos1
162312109lmandrileCopy of #36: sub 613 by lmandrile (PyTorch template)aido1_LFV_r2-v3step2-scoringsuccessyes3720:01:39(hidden)
survival_time_median1.0666666666666669


other stats
episodes
details{"ep000": {"nsteps": 27, "reward": -38.75777017187189, "good_angle": 0.05528757194987871, "survival_time": 0.8999999999999999, "traveled_tiles": 2, "valid_direction": 0.16666666666666663}, "ep001": {"nsteps": 25, "reward": -41.4339464700222, "good_angle": 0.2376342339208612, "survival_time": 0.8333333333333333, "traveled_tiles": 1, "valid_direction": 0.5999999999999999}, "ep002": {"nsteps": 32, "reward": -31.074218523222953, "good_angle": 0.02706133652592451, "survival_time": 1.0666666666666669, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 26, "reward": -38.016180529760625, "good_angle": 0.04928769140254806, "survival_time": 0.8666666666666666, "traveled_tiles": 1, "valid_direction": 0.1333333333333333}, "ep004": {"nsteps": 54, "reward": -18.588955110283912, "good_angle": 0.2878786571686594, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 0.7333333333333356}, "ep005": {"nsteps": 48, "reward": -21.391011279076334, "good_angle": 0.6811105660279715, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 1.2000000000000015}, "ep006": {"nsteps": 64, "reward": -16.354310508817434, "good_angle": 0.4747656366650754, "survival_time": 2.1333333333333355, "traveled_tiles": 3, "valid_direction": 1.633333333333335}}
good_angle_max0.6811105660279715
good_angle_mean0.2590036705229884
good_angle_median0.2376342339208612
good_angle_min0.02706133652592451
reward_max-16.354310508817434
reward_mean-29.37377037043648
reward_median-31.074218523222953
reward_min-41.4339464700222
survival_time_max2.1333333333333355
survival_time_mean1.3142857142857152
survival_time_min0.8333333333333333
traveled_tiles_max3
traveled_tiles_mean1.8571428571428572
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.633333333333335
valid_direction_mean0.6380952380952388
valid_direction_median0.5999999999999999
valid_direction_min0
162282105iban_alexCopy of #32: sub 651 by iban_alex (PyTorch template)aido1_LFV_r2-v3step3-videossuccessyes3720:00:41(hidden)
other stats
videos1
162122105iban_alexCopy of #32: sub 651 by iban_alex (PyTorch template)aido1_LFV_r2-v3step2-scoringsuccessyes3720:01:39(hidden)
survival_time_median1.166666666666667


other stats
episodes
details{"ep000": {"nsteps": 25, "reward": -41.73104838371277, "good_angle": 0.048952125964664694, "survival_time": 0.8333333333333333, "traveled_tiles": 2, "valid_direction": 0.09999999999999998}, "ep001": {"nsteps": 36, "reward": -29.66558608516223, "good_angle": 1.529742329455314, "survival_time": 1.2000000000000004, "traveled_tiles": 2, "valid_direction": 0.966666666666667}, "ep002": {"nsteps": 23, "reward": -44.437222817507774, "good_angle": 0.2265013683038732, "survival_time": 0.7666666666666666, "traveled_tiles": 1, "valid_direction": 0.6333333333333332}, "ep003": {"nsteps": 35, "reward": -29.07613977431985, "good_angle": 2.441230815961144, "survival_time": 1.166666666666667, "traveled_tiles": 2, "valid_direction": 1.0666666666666669}, "ep004": {"nsteps": 18, "reward": -57.92347499065929, "good_angle": 0.11717379490700086, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.3333333333333333}, "ep005": {"nsteps": 58, "reward": -18.316585029451304, "good_angle": 3.2157615251239635, "survival_time": 1.933333333333336, "traveled_tiles": 3, "valid_direction": 1.7000000000000026}, "ep006": {"nsteps": 58, "reward": -17.27882873164169, "good_angle": 0.4542876574328766, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 1.233333333333336}}
good_angle_max3.2157615251239635
good_angle_mean1.1476642310212626
good_angle_median0.4542876574328766
good_angle_min0.048952125964664694
reward_max-17.27882873164169
reward_mean-34.06126940177927
reward_median-29.66558608516223
reward_min-57.92347499065929
survival_time_max1.933333333333336
survival_time_mean1.2047619047619056
survival_time_min0.6
traveled_tiles_max3
traveled_tiles_mean1.8571428571428572
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.7000000000000026
valid_direction_mean0.8619047619047627
valid_direction_median0.966666666666667
valid_direction_min0.09999999999999998
162002107inat777Copy of #34: sub 897 by inat777 (Random execution)aido1_LFV_r2-v3step1-simulationsuccessyes3720:01:19(hidden)
other stats
simulation-passed1
161852085Allen OuCopy of #12: sub 590 by Allen Ou (Tensorflow template)aido1_LFV_r2-v3step4-vizsuccessno3720:01:15(hidden)
driven_lanedir_consec_median0.012199001728359202
deviation-center-line_median0.08928429919940616
in-drivable-lane_median0


other stats
deviation-center-line_max0.16282647938735895
deviation-center-line_mean0.07739049098141691
deviation-center-line_min0
deviation-heading_max0.3368300424757655
deviation-heading_mean0.218462573657956
deviation-heading_median0.24329461262426316
deviation-heading_min0
driven_any_max0.03701438474200881
driven_any_mean0.01698519647584837
driven_any_median0.01351839174906143
driven_any_min0.003822176205857615
driven_lanedir_consec_max0.03637807995694594
driven_lanedir_consec_mean0.014047437020456011
driven_lanedir_consec_min0
driven_lanedir_max0.03637807995694594
driven_lanedir_mean0.014047437020456011
driven_lanedir_median0.012199001728359202
driven_lanedir_min0
in-drivable-lane_max0.6
in-drivable-lane_mean0.09523809523809525
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.01351839174906143, "driven_lanedir": 0, "in-drivable-lane": 0.6, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.009261033456581249, "driven_lanedir": 0.008027322487289648, "in-drivable-lane": 0, "deviation-heading": 0.24329461262426316, "deviation-center-line": 0.05484059563762287, "driven_lanedir_consec": 0.008027322487289648}, "ep002": {"driven_any": 0.0153023880189365, "driven_lanedir": 0.015022884993331136, "in-drivable-lane": 0, "deviation-heading": 0.1731575041889414, "deviation-center-line": 0.09749786546862492, "driven_lanedir_consec": 0.015022884993331136}, "ep003": {"driven_any": 0.003822176205857615, "driven_lanedir": 0.002304111648432516, "in-drivable-lane": 0, "deviation-heading": 0.2568532361244332, "deviation-center-line": 0.03342758403938514, "driven_lanedir_consec": 0.002304111648432516}, "ep004": {"driven_any": 0.026540410603525095, "driven_lanedir": 0.024400658328833653, "in-drivable-lane": 0, "deviation-heading": 0.3368300424757655, "deviation-center-line": 0.10385661313752031, "driven_lanedir_consec": 0.024400658328833653}, "ep005": {"driven_any": 0.013437590554967883, "driven_lanedir": 0.012199001728359202, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.2274732295451025, "deviation-center-line": 0.08928429919940616, "driven_lanedir_consec": 0.012199001728359202}, "ep006": {"driven_any": 0.03701438474200881, "driven_lanedir": 0.03637807995694594, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.291629390647186, "deviation-center-line": 0.16282647938735895, "driven_lanedir_consec": 0.03637807995694594}}
161782085Allen OuCopy of #12: sub 590 by Allen Ou (Tensorflow template)aido1_LFV_r2-v3step3-videossuccessyes3720:00:41(hidden)
other stats
videos1
161732085Allen OuCopy of #12: sub 590 by Allen Ou (Tensorflow template)aido1_LFV_r2-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median0.8666666666666666


other stats
episodes
details{"ep000": {"nsteps": 19, "reward": -54.35796157623592, "good_angle": 0.08067835862962254, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.3333333333333333}, "ep001": {"nsteps": 18, "reward": -56.71967331899537, "good_angle": 0.23704432988187343, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.23333333333333336}, "ep002": {"nsteps": 29, "reward": -34.69493276163422, "good_angle": 0.04666765185923659, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0.1333333333333333}, "ep003": {"nsteps": 10, "reward": -100.06362156905234, "good_angle": 0.30849965877187824, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666666}, "ep004": {"nsteps": 47, "reward": -21.059680652841827, "good_angle": 0.11818877082593798, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.30000000000000027}, "ep005": {"nsteps": 26, "reward": -38.26443574821147, "good_angle": 0.18138514158013025, "survival_time": 0.8666666666666666, "traveled_tiles": 1, "valid_direction": 0.2666666666666666}, "ep006": {"nsteps": 52, "reward": -19.38722899206914, "good_angle": 0.1258777557361241, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.16666666666666718}}
good_angle_max0.30849965877187824
good_angle_mean0.1569059524692576
good_angle_median0.1258777557361241
good_angle_min0.04666765185923659
reward_max-19.38722899206914
reward_mean-46.36393351700576
reward_median-38.26443574821147
reward_min-100.06362156905234
survival_time_max1.7333333333333354
survival_time_mean0.9571428571428576
survival_time_min0.3333333333333333
traveled_tiles_max2
traveled_tiles_mean1.5714285714285714
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.3333333333333333
valid_direction_mean0.24285714285714297
valid_direction_median0.2666666666666666
valid_direction_min0.1333333333333333
161632085Allen OuCopy of #12: sub 590 by Allen Ou (Tensorflow template)aido1_LFV_r2-v3step1-simulationsuccessyes3720:01:18(hidden)
other stats
simulation-passed1
161552087shandonguniversityInspurCopy of #14: sub 1482 by shandonguniversityInspur (Inspur CNN)aido1_LFV_r2-v3step4-vizsuccessno3720:01:10(hidden)
driven_lanedir_consec_median0.014341562472446863
deviation-center-line_median0.08292627901438232
in-drivable-lane_median0


other stats
deviation-center-line_max0.16911123460387836
deviation-center-line_mean0.08416368845722541
deviation-center-line_min0
deviation-heading_max0.3809468285678669
deviation-heading_mean0.17060973077104188
deviation-heading_median0.17271262114053937
deviation-heading_min0
driven_any_max0.03545442770883109
driven_any_mean0.01684455217603587
driven_any_median0.01438045727036298
driven_any_min0.003691963094065061
driven_lanedir_consec_max0.03442274928355223
driven_lanedir_consec_mean0.014301692130265876
driven_lanedir_consec_min0
driven_lanedir_max0.03442274928355223
driven_lanedir_mean0.014301692130265876
driven_lanedir_median0.014341562472446863
driven_lanedir_min0
in-drivable-lane_max0.6
in-drivable-lane_mean0.09523809523809525
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.013448917422211552, "driven_lanedir": 0, "in-drivable-lane": 0.6, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.0080502411946243, "driven_lanedir": 0.007230566303399405, "in-drivable-lane": 0.03333333333333338, "deviation-heading": 0.1490193864806944, "deviation-center-line": 0.0420604325369771, "driven_lanedir_consec": 0.007230566303399405}, "ep002": {"driven_any": 0.01438045727036298, "driven_lanedir": 0.014341562472446863, "in-drivable-lane": 0, "deviation-heading": 0.0667905449688808, "deviation-center-line": 0.08292627901438232, "driven_lanedir_consec": 0.014341562472446863}, "ep003": {"driven_any": 0.003691963094065061, "driven_lanedir": 0.002252425948876269, "in-drivable-lane": 0, "deviation-heading": 0.24743332824161743, "deviation-center-line": 0.030974795928632136, "driven_lanedir_consec": 0.002252425948876269}, "ep004": {"driven_any": 0.02432028288239262, "driven_lanedir": 0.02403130233616144, "in-drivable-lane": 0, "deviation-heading": 0.1773654059976942, "deviation-center-line": 0.16462851797691835, "driven_lanedir_consec": 0.02403130233616144}, "ep005": {"driven_any": 0.01856557565976348, "driven_lanedir": 0.017833238567424935, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.17271262114053937, "deviation-center-line": 0.09944455913978954, "driven_lanedir_consec": 0.017833238567424935}, "ep006": {"driven_any": 0.03545442770883109, "driven_lanedir": 0.03442274928355223, "in-drivable-lane": 0, "deviation-heading": 0.3809468285678669, "deviation-center-line": 0.16911123460387836, "driven_lanedir_consec": 0.03442274928355223}}
161502087shandonguniversityInspurCopy of #14: sub 1482 by shandonguniversityInspur (Inspur CNN)aido1_LFV_r2-v3step3-videossuccessyes3720:00:39(hidden)
other stats
videos1
161442087shandonguniversityInspurCopy of #14: sub 1482 by shandonguniversityInspur (Inspur CNN)aido1_LFV_r2-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median0.7333333333333333


other stats
episodes
details{"ep000": {"nsteps": 19, "reward": -54.27920136326238, "good_angle": 0.14521790289680636, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep001": {"nsteps": 16, "reward": -63.99120529927313, "good_angle": 0.1327357377744756, "survival_time": 0.5333333333333333, "traveled_tiles": 1, "valid_direction": 0.23333333333333336}, "ep002": {"nsteps": 22, "reward": -45.91469998115843, "good_angle": 0.009013564682049658, "survival_time": 0.7333333333333333, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 10, "reward": -100.01138191819192, "good_angle": 0.3012657964866646, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666666}, "ep004": {"nsteps": 41, "reward": -24.459685502482987, "good_angle": 0.04974315543027146, "survival_time": 1.3666666666666676, "traveled_tiles": 2, "valid_direction": 0.06666666666666676}, "ep005": {"nsteps": 30, "reward": -33.19597049094737, "good_angle": 0.12746849143106237, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.23333333333333328}, "ep006": {"nsteps": 53, "reward": -19.051104388876272, "good_angle": 0.15544491503938854, "survival_time": 1.7666666666666688, "traveled_tiles": 2, "valid_direction": 0.3666666666666677}}
good_angle_max0.3012657964866646
good_angle_mean0.1315556519629598
good_angle_median0.1327357377744756
good_angle_min0.009013564682049658
reward_max-19.051104388876272
reward_mean-48.700464134884655
reward_median-45.91469998115843
reward_min-100.01138191819192
survival_time_max1.7666666666666688
survival_time_mean0.9095238095238098
survival_time_min0.3333333333333333
traveled_tiles_max2
traveled_tiles_mean1.5714285714285714
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.3666666666666677
valid_direction_mean0.21904761904761916
valid_direction_median0.23333333333333336
valid_direction_min0
161332090trimcaoCopy of #17: sub 1515 by trimcao (Tensorflow template)aido1_LFV_r2-v3step1-simulationsuccessyes3720:01:29(hidden)
other stats
simulation-passed1
161042069WEIGAOCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LFV_r1-v3step3-videossuccessyes3720:01:54(hidden)
other stats
videos1
161002070heyt0nyCopy of #2: sub 1579 by heyt0ny (SAIC MOSCOW MML)aido1_LFV_r1-v3step3-videossuccessyes3720:01:03(hidden)
other stats
videos1
160982070heyt0nyCopy of #2: sub 1579 by heyt0ny (SAIC MOSCOW MML)aido1_LFV_r1-v3step1-simulationsuccessyes3720:02:31(hidden)
other stats
simulation-passed1
160792064BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationfailedyes3720:10:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
(hidden)
160071984BenjaminCopy of #6: sub 1063 by Benjamin (My ROS solution)aido1_LFV_r1-v3step3-videossuccessyes3720:02:12(hidden)
other stats
videos1
159981983VincentMaiCopy of #5: sub 1033 by VincentMai (ROS-based Lane Following)aido1_LFV_r1-v3step3-videossuccessyes3720:00:54(hidden)
other stats
videos1
159731983VincentMaiCopy of #5: sub 1033 by VincentMai (ROS-based Lane Following)aido1_LFV_r1-v3step1-simulationsuccessyes3720:02:46(hidden)
other stats
simulation-passed1
159602038WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step4-vizsuccessyes3720:02:05(hidden)
driven_lanedir_consec_median0.0515512620648684
deviation-center-line_median0.08910421488258806
in-drivable-lane_median0.6666666666666672


other stats
deviation-center-line_max0.6458277721055414
deviation-center-line_mean0.1960429545747329
deviation-center-line_min0.03916224255447411
deviation-heading_max2.8275165736392
deviation-heading_mean0.8933060314426289
deviation-heading_median0.46620825618968825
deviation-heading_min0.15726047748702124
driven_any_max0.5438855411023378
driven_any_mean0.16356247121463172
driven_any_median0.07837502862299087
driven_any_min0.03255828446331582
driven_lanedir_consec_max0.4304020061478586
driven_lanedir_consec_mean0.12276843582574282
driven_lanedir_consec_min0.021402102185106315
driven_lanedir_max0.4304020061478586
driven_lanedir_mean0.12276843582574282
driven_lanedir_median0.0515512620648684
driven_lanedir_min0.021402102185106315
in-drivable-lane_max2.633333333333324
in-drivable-lane_mean0.979999999999998
in-drivable-lane_min0.29999999999999993
per-episodes
details{"ep000": {"driven_any": 0.07045828559591112, "driven_lanedir": 0.04566552911317437, "in-drivable-lane": 0.6666666666666672, "deviation-heading": 0.2800094892834792, "deviation-center-line": 0.05030972943580639, "driven_lanedir_consec": 0.04566552911317437}, "ep001": {"driven_any": 0.5438855411023378, "driven_lanedir": 0.4304020061478586, "in-drivable-lane": 2.633333333333324, "deviation-heading": 2.8275165736392, "deviation-center-line": 0.6458277721055414, "driven_lanedir_consec": 0.4304020061478586}, "ep002": {"driven_any": 0.07837502862299087, "driven_lanedir": 0.0515512620648684, "in-drivable-lane": 0.6999999999999991, "deviation-heading": 0.46620825618968825, "deviation-center-line": 0.08910421488258806, "driven_lanedir_consec": 0.0515512620648684}, "ep003": {"driven_any": 0.03255828446331582, "driven_lanedir": 0.021402102185106315, "in-drivable-lane": 0.29999999999999993, "deviation-heading": 0.15726047748702124, "deviation-center-line": 0.03916224255447411, "driven_lanedir_consec": 0.021402102185106315}, "ep004": {"driven_any": 0.09253521628860298, "driven_lanedir": 0.06482127961770642, "in-drivable-lane": 0.5999999999999995, "deviation-heading": 0.7355353606137561, "deviation-center-line": 0.15581081389525456, "driven_lanedir_consec": 0.06482127961770642}}
159572040BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median1.1


other stats
episodes
details{"ep000": {"nsteps": 29, "reward": -36.05535569067659, "good_angle": 1.2277961612851362, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0.4666666666666666}, "ep001": {"nsteps": 30, "reward": -33.3029251969109, "good_angle": 0.3598288146325851, "survival_time": 1, "traveled_tiles": 3, "valid_direction": 0.7999999999999998}, "ep002": {"nsteps": 104, "reward": -9.765000095405131, "good_angle": 1.5623640716548828, "survival_time": 3.466666666666664, "traveled_tiles": 7, "valid_direction": 1.2333333333333316}, "ep003": {"nsteps": 106, "reward": -9.526976527136592, "good_angle": 0.3041455232278314, "survival_time": 3.5333333333333306, "traveled_tiles": 6, "valid_direction": 0.5666666666666655}, "ep004": {"nsteps": 33, "reward": -29.818791325796735, "good_angle": 0.19099099382936244, "survival_time": 1.1, "traveled_tiles": 2, "valid_direction": 0.3666666666666667}}
good_angle_max1.5623640716548828
good_angle_mean0.7290251129259596
good_angle_median0.3598288146325851
good_angle_min0.19099099382936244
reward_max-9.526976527136592
reward_mean-23.69380976718519
reward_median-29.818791325796735
reward_min-36.05535569067659
survival_time_max3.5333333333333306
survival_time_mean2.0133333333333323
survival_time_min0.9666666666666666
traveled_tiles_max7
traveled_tiles_mean4
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max1.2333333333333316
valid_direction_mean0.6866666666666661
valid_direction_median0.5666666666666655
valid_direction_min0.3666666666666667
159562041BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median1.1


other stats
episodes
details{"ep000": {"nsteps": 33, "reward": -30.97589511469458, "good_angle": 0.37697441745897936, "survival_time": 1.1, "traveled_tiles": 2, "valid_direction": 0.5333333333333334}, "ep001": {"nsteps": 40, "reward": -24.76182020492852, "good_angle": 0.27577984745158063, "survival_time": 1.333333333333334, "traveled_tiles": 3, "valid_direction": 0.9000000000000008}, "ep002": {"nsteps": 12, "reward": -82.88447736265759, "good_angle": 0.030457664454720923, "survival_time": 0.4, "traveled_tiles": 2, "valid_direction": 0.09999999999999998}, "ep003": {"nsteps": 101, "reward": -9.26325378980082, "good_angle": 0.2396476986195279, "survival_time": 3.3666666666666645, "traveled_tiles": 7, "valid_direction": 0.5999999999999985}, "ep004": {"nsteps": 32, "reward": -30.98954703757772, "good_angle": 0.07005285637346223, "survival_time": 1.0666666666666669, "traveled_tiles": 2, "valid_direction": 0.23333333333333328}}
good_angle_max0.37697441745897936
good_angle_mean0.19858249687165425
good_angle_median0.2396476986195279
good_angle_min0.030457664454720923
reward_max-9.26325378980082
reward_mean-35.77499870193184
reward_median-30.97589511469458
reward_min-82.88447736265759
survival_time_max3.3666666666666645
survival_time_mean1.4533333333333331
survival_time_min0.4
traveled_tiles_max7
traveled_tiles_mean3.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.9000000000000008
valid_direction_mean0.4733333333333333
valid_direction_median0.5333333333333334
valid_direction_min0.09999999999999998
159432041BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessyes3720:02:08(hidden)
other stats
simulation-passed1
159332034zgxsinCopy of #57: sub 1534 by zgxsin (Random execution)aido1_LFV_r1-v3step4-vizsuccessyes3720:01:26(hidden)
driven_lanedir_consec_median0.018140076439702984
deviation-center-line_median0.08939070049725159
in-drivable-lane_median0.6666666666666643


other stats
deviation-center-line_max0.21070764725540073
deviation-center-line_mean0.0946443499289294
deviation-center-line_min0
deviation-heading_max0.4518806146942741
deviation-heading_mean0.23401528382785203
deviation-heading_median0.2062726853168902
deviation-heading_min0
driven_any_max0.0589171782151851
driven_any_mean0.038217735966481106
driven_any_median0.04390051531212183
driven_any_min0.00797344575463498
driven_lanedir_consec_max0.046842385644860894
driven_lanedir_consec_mean0.021230371307561183
driven_lanedir_consec_min0
driven_lanedir_max0.046842385644860894
driven_lanedir_mean0.021230371307561183
driven_lanedir_median0.018140076439702984
driven_lanedir_min0
in-drivable-lane_max3.8333333333333295
in-drivable-lane_mean1.193333333333332
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.05334202301234309, "driven_lanedir": 0, "in-drivable-lane": 3.8333333333333295, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.04390051531212183, "driven_lanedir": 0.03329380414957712, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 0.4518806146942741, "deviation-center-line": 0.08939070049725159, "driven_lanedir_consec": 0.03329380414957712}, "ep002": {"driven_any": 0.02695551753812051, "driven_lanedir": 0.018140076439702984, "in-drivable-lane": 0.6333333333333351, "deviation-heading": 0.2062726853168902, "deviation-center-line": 0.09473622579848752, "driven_lanedir_consec": 0.018140076439702984}, "ep003": {"driven_any": 0.0589171782151851, "driven_lanedir": 0.046842385644860894, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 0.42182657536246354, "deviation-center-line": 0.21070764725540073, "driven_lanedir_consec": 0.046842385644860894}, "ep004": {"driven_any": 0.00797344575463498, "driven_lanedir": 0.007875590303664937, "in-drivable-lane": 0, "deviation-heading": 0.09009654376563228, "deviation-center-line": 0.07838717609350722, "driven_lanedir_consec": 0.007875590303664937}}
159282034zgxsinCopy of #57: sub 1534 by zgxsin (Random execution)aido1_LFV_r1-v3step3-videossuccessyes3720:00:45(hidden)
other stats
videos1
159252034zgxsinCopy of #57: sub 1534 by zgxsin (Random execution)aido1_LFV_r1-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median3.1999999999999984


other stats
episodes
details{"ep000": {"nsteps": 116, "reward": -10.888919395105592, "good_angle": 9.197526059028704, "survival_time": 3.8666666666666623, "traveled_tiles": 3, "valid_direction": 1.3333333333333286}, "ep001": {"nsteps": 96, "reward": -10.740368355686464, "good_angle": 7.382163859743457, "survival_time": 3.1999999999999984, "traveled_tiles": 3, "valid_direction": 1.3666666666666627}, "ep002": {"nsteps": 60, "reward": -16.443923931972435, "good_angle": 0.4103474408085163, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 0.8000000000000023}, "ep003": {"nsteps": 128, "reward": -7.936311284080148, "good_angle": 7.48069302584796, "survival_time": 4.266666666666661, "traveled_tiles": 4, "valid_direction": 1.3333333333333286}, "ep004": {"nsteps": 19, "reward": -52.37916383558982, "good_angle": 0.015898830348609585, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max9.197526059028704
good_angle_mean4.897325843155449
good_angle_median7.382163859743457
good_angle_min0.015898830348609585
reward_max-7.936311284080148
reward_mean-19.677737360486898
reward_median-10.888919395105592
reward_min-52.37916383558982
survival_time_max4.266666666666661
survival_time_mean2.7933333333333317
survival_time_min0.6333333333333333
traveled_tiles_max4
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max1.3666666666666627
valid_direction_mean0.9666666666666645
valid_direction_median1.3333333333333286
valid_direction_min0
159212034zgxsinCopy of #57: sub 1534 by zgxsin (Random execution)aido1_LFV_r1-v3step1-simulationsuccessyes3720:01:13(hidden)
other stats
simulation-passed1
159122029zxcvfd13502Copy of #52: sub 788 by zxcvfd13502 (Random execution)aido1_LFV_r1-v3step3-videossuccessyes3720:00:36(hidden)
other stats
videos1
159082027anna.tsalapovaCopy of #50: sub 396 by anna.tsalapova (simple submition)aido1_LFV_r1-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 22, "reward": -46.49275234612551, "good_angle": 1.2316452772062616, "survival_time": 0.7333333333333333, "traveled_tiles": 3, "valid_direction": 0.1333333333333333}, "ep001": {"nsteps": 500, "reward": -0.242874888420105, "good_angle": 48.4977843635283, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 7.199999999999993}, "ep002": {"nsteps": 500, "reward": 0.7278018383979797, "good_angle": 0.05539447854092207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": 1.02485899913311, "good_angle": 0.16525518815679727, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 18, "reward": -55.26115652380718, "good_angle": 0.002231893414425505, "survival_time": 0.6, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max48.4977843635283
good_angle_mean9.99046224016934
good_angle_median0.16525518815679727
good_angle_min0.002231893414425505
reward_max1.02485899913311
reward_mean-20.048824584164343
reward_median-0.242874888420105
reward_min-55.26115652380718
survival_time_max16.666666666666654
survival_time_mean10.26666666666666
survival_time_min0.6
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max7.199999999999993
valid_direction_mean1.4666666666666657
valid_direction_median0
valid_direction_min0
158942027anna.tsalapovaCopy of #50: sub 396 by anna.tsalapova (simple submition)aido1_LFV_r1-v3step1-simulationsuccessyes3720:01:59(hidden)
other stats
simulation-passed1
158892024sischaefCopy of #47: sub 770 by sischaef (AMOD18-AIDO not that random execution)aido1_LFV_r1-v3step3-videossuccessyes3720:00:36(hidden)
other stats
videos1
158842024sischaefCopy of #47: sub 770 by sischaef (AMOD18-AIDO not that random execution)aido1_LFV_r1-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median2.200000000000002


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -14.69995212336866, "good_angle": 6.65667704223881, "survival_time": 2.7333333333333334, "traveled_tiles": 3, "valid_direction": 0.9666666666666646}, "ep001": {"nsteps": 66, "reward": -15.58014577536872, "good_angle": 4.307042875025382, "survival_time": 2.200000000000002, "traveled_tiles": 3, "valid_direction": 0.9333333333333348}, "ep002": {"nsteps": 42, "reward": -23.687238975206306, "good_angle": 0.2712250888110818, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.5666666666666678}, "ep003": {"nsteps": 90, "reward": -11.363539161284764, "good_angle": 5.194875623318005, "survival_time": 2.999999999999999, "traveled_tiles": 3, "valid_direction": 0.93333333333333}, "ep004": {"nsteps": 28, "reward": -35.45923779612141, "good_angle": 0.003544771893499332, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max6.65667704223881
good_angle_mean3.286673080257356
good_angle_median4.307042875025382
good_angle_min0.003544771893499332
reward_max-11.363539161284764
reward_mean-20.158022766269973
reward_median-15.58014577536872
reward_min-35.45923779612141
survival_time_max2.999999999999999
survival_time_mean2.0533333333333337
survival_time_min0.9333333333333332
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max0.9666666666666646
valid_direction_mean0.6799999999999994
valid_direction_median0.93333333333333
valid_direction_min0
158742024sischaefCopy of #47: sub 770 by sischaef (AMOD18-AIDO not that random execution)aido1_LFV_r1-v3step1-simulationsuccessyes3720:01:16(hidden)
other stats
simulation-passed1
158692019kbensonCopy of #42: sub 769 by kbenson (AMOD18-AIDO not that random execution)aido1_LFV_r1-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median1.1


other stats
episodes
details{"ep000": {"nsteps": 41, "reward": -26.865506938317928, "good_angle": 3.448171093298203, "survival_time": 1.3666666666666676, "traveled_tiles": 3, "valid_direction": 0.500000000000001}, "ep001": {"nsteps": 33, "reward": -30.689429684118792, "good_angle": 2.0942018881011277, "survival_time": 1.1, "traveled_tiles": 3, "valid_direction": 0.4666666666666668}, "ep002": {"nsteps": 21, "reward": -47.48281242006591, "good_angle": 0.14268697583755116, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.3}, "ep003": {"nsteps": 45, "reward": -22.438209524419573, "good_angle": 2.5514199605694157, "survival_time": 1.500000000000001, "traveled_tiles": 3, "valid_direction": 0.4666666666666681}, "ep004": {"nsteps": 14, "reward": -71.18296972928303, "good_angle": 0.0017067420227959746, "survival_time": 0.4666666666666666, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max3.448171093298203
good_angle_mean1.6476373319658186
good_angle_median2.0942018881011277
good_angle_min0.0017067420227959746
reward_max-22.438209524419573
reward_mean-39.731785659241055
reward_median-30.689429684118792
reward_min-71.18296972928303
survival_time_max1.500000000000001
survival_time_mean1.0266666666666673
survival_time_min0.4666666666666666
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max0.500000000000001
valid_direction_mean0.3466666666666672
valid_direction_median0.4666666666666668
valid_direction_min0
158612019kbensonCopy of #42: sub 769 by kbenson (AMOD18-AIDO not that random execution)aido1_LFV_r1-v3step1-simulationsuccessyes3720:01:01(hidden)
other stats
simulation-passed1
158532013coolcat647Copy of #37: sub 592 by coolcat647 (PyTorch template)aido1_LFV_r1-v3step3-videossuccessyes3720:00:37(hidden)
other stats
videos1
158442015marshinCopy of #39: sub 756 by marshin (PyTorch template)aido1_LFV_r1-v3step1-simulationsuccessyes3720:01:15(hidden)
other stats
simulation-passed1
158332007happyduckieCopy of #31: sub 419 by happyduckie (PyTorch template)aido1_LFV_r1-v3step4-vizsuccessyes3720:01:05(hidden)
driven_lanedir_consec_median0.016501453965360832
deviation-center-line_median0.05411777831278745
in-drivable-lane_median0.7


other stats
deviation-center-line_max0.07701266914278128
deviation-center-line_mean0.04771564448994613
deviation-center-line_min0
deviation-heading_max0.3879987240353249
deviation-heading_mean0.23084185678087615
deviation-heading_median0.2691692016436856
deviation-heading_min0
driven_any_max0.03508223226528643
driven_any_mean0.02798120497202234
driven_any_median0.028668234846007185
driven_any_min0.0147084008510635
driven_lanedir_consec_max0.02355194994695753
driven_lanedir_consec_mean0.015483951546034016
driven_lanedir_consec_min0
driven_lanedir_max0.02355194994695753
driven_lanedir_mean0.015483951546034016
driven_lanedir_median0.016501453965360832
driven_lanedir_min0
in-drivable-lane_max1.3333333333333353
in-drivable-lane_mean0.7200000000000012
in-drivable-lane_min0.10000000000000032
per-episodes
details{"ep000": {"driven_any": 0.0147084008510635, "driven_lanedir": 0, "in-drivable-lane": 0.7, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.028668234846007185, "driven_lanedir": 0.016501453965360832, "in-drivable-lane": 0.6666666666666679, "deviation-heading": 0.22518029566963085, "deviation-center-line": 0.0436665392127559, "driven_lanedir_consec": 0.016501453965360832}, "ep002": {"driven_any": 0.027151863220436088, "driven_lanedir": 0.02355194994695753, "in-drivable-lane": 0.10000000000000032, "deviation-heading": 0.3879987240353249, "deviation-center-line": 0.06378123578140601, "driven_lanedir_consec": 0.02355194994695753}, "ep003": {"driven_any": 0.03508223226528643, "driven_lanedir": 0.016404688811290778, "in-drivable-lane": 1.3333333333333353, "deviation-heading": 0.2691692016436856, "deviation-center-line": 0.05411777831278745, "driven_lanedir_consec": 0.016404688811290778}, "ep004": {"driven_any": 0.034295293677318484, "driven_lanedir": 0.020961665006560947, "in-drivable-lane": 0.8000000000000024, "deviation-heading": 0.2718610625557395, "deviation-center-line": 0.07701266914278128, "driven_lanedir_consec": 0.020961665006560947}}
158272007happyduckieCopy of #31: sub 419 by happyduckie (PyTorch template)aido1_LFV_r1-v3step3-videossuccessyes3720:00:36(hidden)
other stats
videos1
158011998pravishsainathCopy of #21: sub 1085 by pravishsainath (PyTorch DDPG template)aido1_LFV_r1-v3step4-vizsuccessyes3720:04:37(hidden)
driven_lanedir_consec_median0.10284795622808086
deviation-center-line_median0.4489781223485317
in-drivable-lane_median8.266666666666657


other stats
deviation-center-line_max0.6208863127616698
deviation-center-line_mean0.4190213137684443
deviation-center-line_min0.22593433738349036
deviation-heading_max6.568981588399773
deviation-heading_mean6.552663454651523
deviation-heading_median6.564780356912128
deviation-heading_min6.525413633693745
driven_any_max0.3298766989117144
driven_any_mean0.3298746382940945
driven_any_median0.3298766989117039
driven_any_min0.32986639691494546
driven_lanedir_consec_max0.10381344315702191
driven_lanedir_consec_mean0.10285069992952992
driven_lanedir_consec_min0.1017639624341226
driven_lanedir_max0.10381344315702191
driven_lanedir_mean0.10285069992952992
driven_lanedir_median0.10284795622808086
driven_lanedir_min0.1017639624341226
in-drivable-lane_max8.33333333333333
in-drivable-lane_mean8.286666666666658
in-drivable-lane_min8.266666666666657
per-episodes
details{"ep000": {"driven_any": 0.32986639691494546, "driven_lanedir": 0.1017639624341226, "in-drivable-lane": 8.33333333333333, "deviation-heading": 6.5359494005291445, "deviation-center-line": 0.5182622972414631, "driven_lanedir_consec": 0.1017639624341226}, "ep001": {"driven_any": 0.3298766989117039, "driven_lanedir": 0.10284795622808086, "in-drivable-lane": 8.266666666666657, "deviation-heading": 6.568981588399773, "deviation-center-line": 0.28104549910706655, "driven_lanedir_consec": 0.10284795622808086}, "ep002": {"driven_any": 0.3298766989117144, "driven_lanedir": 0.10304332166377736, "in-drivable-lane": 8.266666666666657, "deviation-heading": 6.56819229372282, "deviation-center-line": 0.22593433738349036, "driven_lanedir_consec": 0.10304332166377736}, "ep003": {"driven_any": 0.32987669891170424, "driven_lanedir": 0.1027848161646468, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.525413633693745, "deviation-center-line": 0.4489781223485317, "driven_lanedir_consec": 0.1027848161646468}, "ep004": {"driven_any": 0.3298766978204045, "driven_lanedir": 0.10381344315702191, "in-drivable-lane": 8.266666666666657, "deviation-heading": 6.564780356912128, "deviation-center-line": 0.6208863127616698, "driven_lanedir_consec": 0.10381344315702191}}
157952003jahanviCopy of #27: sub 422 by jahanvi (Random execution)aido1_LFV_r1-v3step1-simulationsuccessyes3720:01:17(hidden)
other stats
simulation-passed1
157771990Allen OuCopy of #12: sub 590 by Allen Ou (Tensorflow template)aido1_LFV_r1-v3step4-vizsuccessyes3720:01:24(hidden)
driven_lanedir_consec_median0.03368375156132309
deviation-center-line_median0.1703274248466203
in-drivable-lane_median0


other stats
deviation-center-line_max0.333292359643504
deviation-center-line_mean0.18762015674155155
deviation-center-line_min0.08910943046691909
deviation-heading_max0.7369826707643546
deviation-heading_mean0.3924868805317489
deviation-heading_median0.3005432110452179
deviation-heading_min0.19251684699893273
driven_any_max0.13672880423758005
driven_any_mean0.06227533615988464
driven_any_median0.03405758179418869
driven_any_min0.018042317885216593
driven_lanedir_consec_max0.1010052620597408
driven_lanedir_consec_mean0.046758303760353434
driven_lanedir_consec_min0.017648002660514396
driven_lanedir_max0.1010052620597408
driven_lanedir_mean0.046758303760353434
driven_lanedir_median0.03368375156132309
driven_lanedir_min0.017648002660514396
in-drivable-lane_max3.73333333333333
in-drivable-lane_mean0.7466666666666659
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.13672880423758005, "driven_lanedir": 0.061560459435134725, "in-drivable-lane": 3.73333333333333, "deviation-heading": 0.4996191012921624, "deviation-center-line": 0.22182784138353157, "driven_lanedir_consec": 0.061560459435134725}, "ep001": {"driven_any": 0.018042317885216593, "driven_lanedir": 0.017648002660514396, "in-drivable-lane": 0, "deviation-heading": 0.19251684699893273, "deviation-center-line": 0.08910943046691909, "driven_lanedir_consec": 0.017648002660514396}, "ep002": {"driven_any": 0.1019748524804021, "driven_lanedir": 0.1010052620597408, "in-drivable-lane": 0, "deviation-heading": 0.7369826707643546, "deviation-center-line": 0.333292359643504, "driven_lanedir_consec": 0.1010052620597408}, "ep003": {"driven_any": 0.03405758179418869, "driven_lanedir": 0.03368375156132309, "in-drivable-lane": 0, "deviation-heading": 0.23277257255807632, "deviation-center-line": 0.1703274248466203, "driven_lanedir_consec": 0.03368375156132309}, "ep004": {"driven_any": 0.020573124402035792, "driven_lanedir": 0.019894043085054124, "in-drivable-lane": 0, "deviation-heading": 0.3005432110452179, "deviation-center-line": 0.12354372736718278, "driven_lanedir_consec": 0.019894043085054124}}
157701990Allen OuCopy of #12: sub 590 by Allen Ou (Tensorflow template)aido1_LFV_r1-v3step3-videossuccessyes3720:00:59(hidden)
other stats
videos1
157631991tongqiusuiCopy of #13: sub 1363 by tongqiusui (Tensorflow template)aido1_LFV_r1-v3step3-videossuccessyes3720:00:41(hidden)
other stats
videos1
157551997sodabetaCopy of #20: sub 903 by sodabeta (PyTorch DDPG template)aido1_LFV_r1-v3step1-simulationsuccessyes3720:03:54(hidden)
other stats
simulation-passed1
157441980heyt0nyCopy of #2: sub 1579 by heyt0ny (SAIC MOSCOW MML)aido1_LFV_r1-v3step1-simulationsuccessyes3720:03:38(hidden)
other stats
simulation-passed1
157401977BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3720:00:57(hidden)
other stats
videos1
157281976WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step3-videossuccessyes3720:01:10(hidden)
other stats
videos1
157121976WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step1-simulationsuccessyes3720:03:52(hidden)
other stats
simulation-passed1
157041968CpPICopy of #54: sub 798 by CpPI (Random execution)aido1_LFV_r1-v3step1-simulationerroryes3720:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job15704-6994', 'pull']:

   >  Command '['docker-compose', '-p', 'job15704-6994', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling solution  ... error

Pulling evaluator ... done

stderr | ERROR: for solution  invalid reference format: repository name must be lowercase
stderr | invalid reference format: repository name must be lowercase
stderr | 
(hidden)
156971961sischaefCopy of #47: sub 770 by sischaef (AMOD18-AIDO not that random execution)aido1_LFV_r1-v3step1-simulationerroryes3720:00:09
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job15697-2005', 'pull']:

   >  Command '['docker-compose', '-p', 'job15697-2005', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling solution  ... error

Pulling evaluator ... done

stderr | ERROR: for solution  invalid reference format: repository name must be lowercase
stderr | invalid reference format: repository name must be lowercase
stderr | 
(hidden)
156921957yanberCopy of #43: sub 777 by yanber (AMOD18-AIDO not that random execution)aido1_LFV_r1-v3step1-simulationerroryes3720:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job15692-9878', 'pull']:

   >  Command '['docker-compose', '-p', 'job15692-9878', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling solution  ... error

Pulling evaluator ... done

stderr | ERROR: for solution  invalid reference format: repository name must be lowercase
stderr | invalid reference format: repository name must be lowercase
stderr | 
(hidden)
156691936gunshiCopy of #22: sub 1268 by gunshi (ROS-based Lane Following)aido1_LFV_r1-v3step1-simulationerroryes3720:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job15669-294', 'pull']:

   >  Command '['docker-compose', '-p', 'job15669-294', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling solution  ... error

Pulling evaluator ... done

stderr | ERROR: for solution  invalid reference format: repository name must be lowercase
stderr | invalid reference format: repository name must be lowercase
stderr | 
(hidden)
156641916heyt0nyCopy of #2: sub 1579 by heyt0ny (SAIC MOSCOW MML)aido1_LFV_r1-v3step1-simulationerroryes3720:00:09
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job15664-9648', 'pull']:

   >  Command '['docker-compose', '-p', 'job15664-9648', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling solution  ... error

Pulling evaluator ... done

stderr | ERROR: for solution  invalid reference format: repository name must be lowercase
stderr | invalid reference format: repository name must be lowercase
stderr | 
(hidden)
156601922DavidCopy of #8: sub 1139 by David (Pytorch IL)aido1_LFV_r1-v3step1-simulationerroryes3720:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job15660-6105', 'pull']:

   >  Command '['docker-compose', '-p', 'job15660-6105', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling solution  ... error

Pulling evaluator ... done

stderr | ERROR: for solution  invalid reference format: repository name must be lowercase
stderr | invalid reference format: repository name must be lowercase
stderr | 
(hidden)
156371907Andrea CensiCopy of #1: sub 1633 by WEIGAO (First trial)aido1_LFV_r1-v3step1-simulationsuccessyes3720:04:46(hidden)
other stats
simulation-passed1
156321898Andrea CensiCopy of #2: sub 1579 by heyt0ny (SAIC MOSCOW MML)aido1_LF1_r3-v3step4-vizsuccessyes3720:04:31(hidden)
driven_lanedir_median18.358291331688935
deviation-center-line_median0.8630577791166484
in-drivable-lane_median0.3666666666666657


other stats
deviation-center-line_max0.9966685897280584
deviation-center-line_mean0.8117822941791137
deviation-center-line_min0.4163515776910264
deviation-heading_max2.032746966466714
deviation-heading_mean1.664872503619165
deviation-heading_median1.8588812527985563
deviation-heading_min0.895015895127912
driven_any_max19.153764865517523
driven_any_mean16.80964327207318
driven_any_median18.85425250651645
driven_any_min8.159524621221731
driven_lanedir_max18.47549257674789
driven_lanedir_mean16.243749877203218
driven_lanedir_min7.947519896949768
in-drivable-lane_max0.5000000000000009
in-drivable-lane_mean0.2933333333333335
in-drivable-lane_min0.06666666666666665
per-episodes
details{"ep000": {"driven_any": 18.81346749362545, "driven_lanedir": 17.987896145920274, "in-drivable-lane": 0.5000000000000009, "deviation-heading": 2.032746966466714, "deviation-center-line": 0.9966685897280584}, "ep001": {"driven_any": 19.153764865517523, "driven_lanedir": 18.47549257674789, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 1.5958643332116875, "deviation-center-line": 0.8490829322938326}, "ep002": {"driven_any": 19.067206873484764, "driven_lanedir": 18.358291331688935, "in-drivable-lane": 0.3666666666666657, "deviation-heading": 1.8588812527985563, "deviation-center-line": 0.9337505920660032}, "ep003": {"driven_any": 18.85425250651645, "driven_lanedir": 18.449549434709205, "in-drivable-lane": 0.13333333333333552, "deviation-heading": 1.9418540704909557, "deviation-center-line": 0.8630577791166484}, "ep004": {"driven_any": 8.159524621221731, "driven_lanedir": 7.947519896949768, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 0.895015895127912, "deviation-center-line": 0.4163515776910264}}
156211900Andrea CensiCopy of #4: sub 1684 by Jon (JP pipeline)aido1_LF1_r3-v3step2-scoringsuccessyes3720:00:19(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 281, "reward": -2.937057418397419, "good_angle": 0.4814128988854183, "survival_time": 9.366666666666644, "traveled_tiles": 18, "valid_direction": 1.266666666666663}, "ep001": {"nsteps": 500, "reward": 0.6952469130083918, "good_angle": 0.6986461979085694, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.9333333333333345}, "ep002": {"nsteps": 500, "reward": 0.6934763562232256, "good_angle": 0.7767277540521826, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.9333333333333376}, "ep003": {"nsteps": 295, "reward": -2.769530088795444, "good_angle": 0.30418303096524696, "survival_time": 9.833333333333307, "traveled_tiles": 18, "valid_direction": 0.7333333333333308}, "ep004": {"nsteps": 500, "reward": 0.6765617783814669, "good_angle": 0.6903158224376169, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.0666666666666744}}
good_angle_max0.7767277540521826
good_angle_mean0.590257140849807
good_angle_median0.6903158224376169
good_angle_min0.30418303096524696
reward_max0.6952469130083918
reward_mean-0.7282604919159558
reward_median0.6765617783814669
reward_min-2.937057418397419
survival_time_max16.666666666666654
survival_time_mean13.83999999999998
survival_time_min9.366666666666644
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max2.0666666666666744
valid_direction_mean1.586666666666668
valid_direction_median1.9333333333333345
valid_direction_min0.7333333333333308
156161905Andrea CensiCopy of #8: sub 1139 by David (Pytorch IL)aido1_LFV_r1-v3step1-simulationerroryes3720:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job15616-470', 'pull']:

   >  Command '['docker-compose', '-p', 'job15616-470', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling solution  ... error

Pulling evaluator ... done

stderr | ERROR: for solution  invalid reference format: repository name must be lowercase
stderr | invalid reference format: repository name must be lowercase
stderr | 
(hidden)
156141901Andrea CensiCopy of #5: sub 1033 by VincentMai (ROS-based Lane Following)aido1_LF1_r3-v3step1-simulationsuccessyes3720:07:53(hidden)
other stats
simulation-passed1
155511520trimcaoTensorflow templateaido1_LFV_r1-v3step4-vizsuccessyes3720:03:19(hidden)
driven_lanedir_consec_median0.023290153112226444
deviation-center-line_median0.13135875163998006
in-drivable-lane_median0.03333333333333344


other stats
deviation-center-line_max0.4102592419992988
deviation-center-line_mean0.18630073398571917
deviation-center-line_min0.07201676359142307
deviation-heading_max0.6864165307733071
deviation-heading_mean0.3707926797998172
deviation-heading_median0.336115272219095
deviation-heading_min0.1810792893668544
driven_any_max0.10387078068695162
driven_any_mean0.04440333369988021
driven_any_median0.03307523801881645
driven_any_min0.02254145773500417
driven_lanedir_consec_max0.10262643803374048
driven_lanedir_consec_mean0.041248975828050774
driven_lanedir_consec_min0.0203568997214555
driven_lanedir_max0.10262643803374048
driven_lanedir_mean0.041248975828050774
driven_lanedir_median0.023290153112226444
driven_lanedir_min0.0203568997214555
in-drivable-lane_max0.7999999999999999
in-drivable-lane_mean0.17333333333333337
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.03307523801881645, "driven_lanedir": 0.0203568997214555, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 0.386916800913653, "deviation-center-line": 0.07201676359142307, "driven_lanedir_consec": 0.0203568997214555}, "ep001": {"driven_any": 0.02254145773500417, "driven_lanedir": 0.02228517319393545, "in-drivable-lane": 0, "deviation-heading": 0.1810792893668544, "deviation-center-line": 0.12189535491283816, "driven_lanedir_consec": 0.02228517319393545}, "ep002": {"driven_any": 0.10387078068695162, "driven_lanedir": 0.10262643803374048, "in-drivable-lane": 0, "deviation-heading": 0.6864165307733071, "deviation-center-line": 0.4102592419992988, "driven_lanedir_consec": 0.10262643803374048}, "ep003": {"driven_any": 0.03840942730664932, "driven_lanedir": 0.03768621507889603, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.2634355057261767, "deviation-center-line": 0.19597355778505576, "driven_lanedir_consec": 0.03768621507889603}, "ep004": {"driven_any": 0.024119764751979533, "driven_lanedir": 0.023290153112226444, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.336115272219095, "deviation-center-line": 0.13135875163998006, "driven_lanedir_consec": 0.023290153112226444}}
155431834WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step4-vizsuccessyes3720:03:05(hidden)
driven_lanedir_consec_median0.010639149058345891
deviation-center-line_median0.04050937269604616
in-drivable-lane_median0.3


other stats
deviation-center-line_max0.07267058582761846
deviation-center-line_mean0.03783962709905586
deviation-center-line_min0
deviation-heading_max0.5000094600895295
deviation-heading_mean0.2466698602546133
deviation-heading_median0.18164470096333452
deviation-heading_min0
driven_any_max0.14824501048964012
driven_any_mean0.04671357799956288
driven_any_median0.030693581101702654
driven_any_min0.00981659484567766
driven_lanedir_consec_max0.14164186171225973
driven_lanedir_consec_mean0.03641795133548772
driven_lanedir_consec_min0
driven_lanedir_max0.14164186171225973
driven_lanedir_mean0.03641795133548772
driven_lanedir_median0.010639149058345891
driven_lanedir_min0
in-drivable-lane_max0.49999999999999994
in-drivable-lane_mean0.2666666666666665
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.00981659484567766, "driven_lanedir": 0, "in-drivable-lane": 0.3, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.011248131301448422, "driven_lanedir": 0.010639149058345891, "in-drivable-lane": 0, "deviation-heading": 0.10915147395024764, "deviation-center-line": 0.03180972915422395, "driven_lanedir_consec": 0.010639149058345891}, "ep002": {"driven_any": 0.030693581101702654, "driven_lanedir": 0.009382064642825688, "in-drivable-lane": 0.49999999999999994, "deviation-heading": 0.4425436662699549, "deviation-center-line": 0.04050937269604616, "driven_lanedir_consec": 0.009382064642825688}, "ep003": {"driven_any": 0.14824501048964012, "driven_lanedir": 0.14164186171225973, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 0.5000094600895295, "deviation-center-line": 0.07267058582761846, "driven_lanedir_consec": 0.14164186171225973}, "ep004": {"driven_any": 0.033564572259345574, "driven_lanedir": 0.02042668126400728, "in-drivable-lane": 0.3666666666666666, "deviation-heading": 0.18164470096333452, "deviation-center-line": 0.04420844781739077, "driven_lanedir_consec": 0.02042668126400728}}
155401860WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step4-vizsuccessyes3720:01:14(hidden)
driven_lanedir_consec_median0.02616316152572078
deviation-center-line_median0.07274714197029863
in-drivable-lane_median0.3


other stats
deviation-center-line_max0.2523730911522131
deviation-center-line_mean0.08936830941054834
deviation-center-line_min0
deviation-heading_max0.9400184154757276
deviation-heading_mean0.34766039433257695
deviation-heading_median0.2775909917383111
deviation-heading_min0
driven_any_max0.18398456139554265
driven_any_mean0.06716674545053657
driven_any_median0.037804246688142015
driven_any_min0.008927519014936028
driven_lanedir_consec_max0.15417536568667126
driven_lanedir_consec_mean0.05264653234142166
driven_lanedir_consec_min0
driven_lanedir_max0.15417536568667126
driven_lanedir_mean0.05264653234142166
driven_lanedir_median0.02616316152572078
driven_lanedir_min0
in-drivable-lane_max0.6999999999999992
in-drivable-lane_mean0.3666666666666664
in-drivable-lane_min0.2666666666666657
per-episodes
details{"ep000": {"driven_any": 0.008927519014936028, "driven_lanedir": 0, "in-drivable-lane": 0.3, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.0787794041199492, "driven_lanedir": 0.06830551492630484, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 0.33394414075079565, "deviation-center-line": 0.09014780737970986, "driven_lanedir_consec": 0.06830551492630484}, "ep002": {"driven_any": 0.037804246688142015, "driven_lanedir": 0.02616316152572078, "in-drivable-lane": 0.2666666666666667, "deviation-heading": 0.2775909917383111, "deviation-center-line": 0.07274714197029863, "driven_lanedir_consec": 0.02616316152572078}, "ep003": {"driven_any": 0.18398456139554265, "driven_lanedir": 0.15417536568667126, "in-drivable-lane": 0.6999999999999992, "deviation-heading": 0.9400184154757276, "deviation-center-line": 0.2523730911522131, "driven_lanedir_consec": 0.15417536568667126}, "ep004": {"driven_any": 0.02633799603411294, "driven_lanedir": 0.014588619568411431, "in-drivable-lane": 0.3, "deviation-heading": 0.18674842369805025, "deviation-center-line": 0.031573506550520124, "driven_lanedir_consec": 0.014588619568411431}}
155371860WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step3-videossuccessyes3720:00:48(hidden)
other stats
videos1
155331860WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step2-scoringsuccessyes3720:01:37(hidden)
survival_time_median1.1


other stats
episodes
details{"ep000": {"nsteps": 10, "reward": -101.62385665774346, "good_angle": 0.18938482014563104, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.2333333333333333}, "ep001": {"nsteps": 68, "reward": -14.437461231917364, "good_angle": 2.717401596541885, "survival_time": 2.2666666666666684, "traveled_tiles": 5, "valid_direction": 0.8666666666666668}, "ep002": {"nsteps": 33, "reward": -30.73163685315486, "good_angle": 1.5401716224014876, "survival_time": 1.1, "traveled_tiles": 3, "valid_direction": 0.5666666666666668}, "ep003": {"nsteps": 153, "reward": -6.687988355670587, "good_angle": 0.5449733425595659, "survival_time": 5.099999999999992, "traveled_tiles": 10, "valid_direction": 1.466666666666665}, "ep004": {"nsteps": 24, "reward": -42.44755696194867, "good_angle": 1.569821113535555, "survival_time": 0.7999999999999999, "traveled_tiles": 2, "valid_direction": 0.5333333333333332}}
good_angle_max2.717401596541885
good_angle_mean1.312350499036825
good_angle_median1.5401716224014876
good_angle_min0.18938482014563104
reward_max-6.687988355670587
reward_mean-39.18570001208699
reward_median-30.73163685315486
reward_min-101.62385665774346
survival_time_max5.099999999999992
survival_time_mean1.9199999999999988
survival_time_min0.3333333333333333
traveled_tiles_max10
traveled_tiles_mean4.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.466666666666665
valid_direction_mean0.7333333333333331
valid_direction_median0.5666666666666668
valid_direction_min0.2333333333333333
155201873dcharrezPyTorch DDPG templateaido1_LFV_r1-v3step1-simulationtimeoutyes3720:31:00(hidden)
155141544yangzm11Tensorflow templateaido1_LFV_r1-v3step4-viztimeoutyes3720:31:00(hidden)
155011707WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LFV_r1-v3step4-vizsuccessyes3720:03:01(hidden)
driven_lanedir_consec_median0.16263167139232226
deviation-center-line_median0.3064073354399167
in-drivable-lane_median0.13333333333333286


other stats
deviation-center-line_max0.646130135938356
deviation-center-line_mean0.36686586013857425
deviation-center-line_min0.12390813933426528
deviation-heading_max3.6085550779947178
deviation-heading_mean2.0440976230749444
deviation-heading_median2.139780715856112
deviation-heading_min0.2858781416498939
driven_any_max0.34367751736504754
driven_any_mean0.19485320591379085
driven_any_median0.20884015022163288
driven_any_min0.02105314350544647
driven_lanedir_consec_max0.26825496236319113
driven_lanedir_consec_mean0.1491564811038526
driven_lanedir_consec_min0.01683861880460146
driven_lanedir_max0.26825496236319113
driven_lanedir_mean0.15188321599409765
driven_lanedir_median0.16263167139232226
driven_lanedir_min0.01683861880460146
in-drivable-lane_max0.6666666666666652
in-drivable-lane_mean0.24666666666666776
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.27743218601742575, "driven_lanedir": 0.20872109479918888, "in-drivable-lane": 0.6666666666666652, "deviation-heading": 2.946996816368478, "deviation-center-line": 0.5037037738593685, "driven_lanedir_consec": 0.1950874203479637}, "ep001": {"driven_any": 0.20884015022163288, "driven_lanedir": 0.16263167139232226, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.139780715856112, "deviation-center-line": 0.2541799161209645, "driven_lanedir_consec": 0.16263167139232226}, "ep002": {"driven_any": 0.12326303245940146, "driven_lanedir": 0.10296973261118451, "in-drivable-lane": 0, "deviation-heading": 1.2392773635055188, "deviation-center-line": 0.3064073354399167, "driven_lanedir_consec": 0.10296973261118451}, "ep003": {"driven_any": 0.02105314350544647, "driven_lanedir": 0.01683861880460146, "in-drivable-lane": 0, "deviation-heading": 0.2858781416498939, "deviation-center-line": 0.12390813933426528, "driven_lanedir_consec": 0.01683861880460146}, "ep004": {"driven_any": 0.34367751736504754, "driven_lanedir": 0.26825496236319113, "in-drivable-lane": 0.4333333333333407, "deviation-heading": 3.6085550779947178, "deviation-center-line": 0.646130135938356, "driven_lanedir_consec": 0.26825496236319113}}
15496560Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step4-vizsuccessyes3720:05:24(hidden)
driven_lanedir_consec_median0.0356915370604246
deviation-center-line_median0.2361477756771472
in-drivable-lane_median2.3999999999999915


other stats
deviation-center-line_max0.8447288048880904
deviation-center-line_mean0.30054139001000485
deviation-center-line_min0
deviation-heading_max0.7239187150985681
deviation-heading_mean0.519390163054791
deviation-heading_median0.6056126422955245
deviation-heading_min0
driven_any_max0.14830090943673074
driven_any_mean0.08998996229916109
driven_any_median0.08502106489878367
driven_any_min0.04464527060073122
driven_lanedir_consec_max0.10735915169148884
driven_lanedir_consec_mean0.04396790263656898
driven_lanedir_consec_min0
driven_lanedir_max0.10735915169148884
driven_lanedir_mean0.04396790263656898
driven_lanedir_median0.0356915370604246
driven_lanedir_min0
in-drivable-lane_max9.499999999999968
in-drivable-lane_mean3.866666666666656
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.08502106489878367, "driven_lanedir": 0, "in-drivable-lane": 7.333333333333317, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.06405635864384283, "driven_lanedir": 0.03412367144608393, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 0.6808716732583516, "deviation-center-line": 0.2361477756771472, "driven_lanedir_consec": 0.03412367144608393}, "ep002": {"driven_any": 0.107926207915717, "driven_lanedir": 0.10735915169148884, "in-drivable-lane": 0, "deviation-heading": 0.6056126422955245, "deviation-center-line": 0.8447288048880904, "driven_lanedir_consec": 0.10735915169148884}, "ep003": {"driven_any": 0.04464527060073122, "driven_lanedir": 0.042665152984847535, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 0.5865477846215109, "deviation-center-line": 0.13313264028959357, "driven_lanedir_consec": 0.042665152984847535}, "ep004": {"driven_any": 0.14830090943673074, "driven_lanedir": 0.0356915370604246, "in-drivable-lane": 9.499999999999968, "deviation-heading": 0.7239187150985681, "deviation-center-line": 0.28869772919519315, "driven_lanedir_consec": 0.0356915370604246}}
15492766Andrea CensiRandom executionaido1_LFV_r1-v3step4-vizsuccessyes3720:03:40(hidden)
driven_lanedir_consec_median0.031160225450642363
deviation-center-line_median0.19636251961557025
in-drivable-lane_median0.7666666666666688


other stats
deviation-center-line_max0.23589872458540137
deviation-center-line_mean0.15300238436386626
deviation-center-line_min0
deviation-heading_max0.7342713093415238
deviation-heading_mean0.3731877276965648
deviation-heading_median0.40241661887519536
deviation-heading_min0
driven_any_max0.059585467722623686
driven_any_mean0.039920067688992755
driven_any_median0.04375704638423899
driven_any_min0.02447280077041375
driven_lanedir_consec_max0.04270296740629999
driven_lanedir_consec_mean0.024604651763751963
driven_lanedir_consec_min0
driven_lanedir_max0.04270296740629999
driven_lanedir_mean0.024604651763751963
driven_lanedir_median0.031160225450642363
driven_lanedir_min0
in-drivable-lane_max1.8000000000000025
in-drivable-lane_mean1.026666666666666
in-drivable-lane_min0.6333333333333311
per-episodes
details{"ep000": {"driven_any": 0.02447280077041375, "driven_lanedir": 0, "in-drivable-lane": 1.8000000000000025, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.04375704638423899, "driven_lanedir": 0.031160225450642363, "in-drivable-lane": 0.6333333333333311, "deviation-heading": 0.7342713093415238, "deviation-center-line": 0.2268761019701035, "driven_lanedir_consec": 0.031160225450642363}, "ep002": {"driven_any": 0.027012576246216377, "driven_lanedir": 0.016133592445169872, "in-drivable-lane": 0.7666666666666688, "deviation-heading": 0.2092228708857977, "deviation-center-line": 0.10587457564825618, "driven_lanedir_consec": 0.016133592445169872}, "ep003": {"driven_any": 0.059585467722623686, "driven_lanedir": 0.04270296740629999, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 0.40241661887519536, "deviation-center-line": 0.19636251961557025, "driven_lanedir_consec": 0.04270296740629999}, "ep004": {"driven_any": 0.04477244732147097, "driven_lanedir": 0.0330264735166476, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 0.5200278393803074, "deviation-center-line": 0.23589872458540137, "driven_lanedir_consec": 0.0330264735166476}}
154881838WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step4-vizsuccessyes3720:01:36(hidden)
driven_lanedir_consec_median0.06116983801796232
deviation-center-line_median0.0524775006981949
in-drivable-lane_median0.4333333333333347


other stats
deviation-center-line_max0.15055604380112594
deviation-center-line_mean0.06741690275312907
deviation-center-line_min0.02874368971480238
deviation-heading_max0.8392139720268186
deviation-heading_mean0.3781154080253976
deviation-heading_median0.25323906150052106
deviation-heading_min0.13535621995723046
driven_any_max0.21310237885664385
driven_any_mean0.10024509352433068
driven_any_median0.08059280778260998
driven_any_min0.021136192167987473
driven_lanedir_consec_max0.16506125358381746
driven_lanedir_consec_mean0.07175142255971992
driven_lanedir_consec_min0.016872041455304475
driven_lanedir_max0.16506125358381746
driven_lanedir_mean0.07175142255971992
driven_lanedir_median0.06116983801796232
driven_lanedir_min0.016872041455304475
in-drivable-lane_max2.066666666666667
in-drivable-lane_mean0.7800000000000006
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.050424755341909926, "driven_lanedir": 0.03571235926426875, "in-drivable-lane": 0.4333333333333347, "deviation-heading": 0.19086497420051815, "deviation-center-line": 0.02874368971480238, "driven_lanedir_consec": 0.03571235926426875}, "ep001": {"driven_any": 0.21310237885664385, "driven_lanedir": 0.16506125358381746, "in-drivable-lane": 1.2666666666666682, "deviation-heading": 0.8392139720268186, "deviation-center-line": 0.15055604380112594, "driven_lanedir_consec": 0.16506125358381746}, "ep002": {"driven_any": 0.08059280778260998, "driven_lanedir": 0.07994162047724655, "in-drivable-lane": 0, "deviation-heading": 0.25323906150052106, "deviation-center-line": 0.0524775006981949, "driven_lanedir_consec": 0.07994162047724655}, "ep003": {"driven_any": 0.1359693334725023, "driven_lanedir": 0.06116983801796232, "in-drivable-lane": 2.066666666666667, "deviation-heading": 0.4719028124418994, "deviation-center-line": 0.07482525542168067, "driven_lanedir_consec": 0.06116983801796232}, "ep004": {"driven_any": 0.021136192167987473, "driven_lanedir": 0.016872041455304475, "in-drivable-lane": 0.1333333333333333, "deviation-heading": 0.13535621995723046, "deviation-center-line": 0.030482024129841464, "driven_lanedir_consec": 0.016872041455304475}}
154801779heyt0nySAIC MOSCOW MMLaido1_LFV_r1-v3step4-vizsuccessyes3720:04:42(hidden)
driven_lanedir_consec_median0.6229354781323941
deviation-center-line_median0.25702653274689496
in-drivable-lane_median0


other stats
deviation-center-line_max0.312845368339678
deviation-center-line_mean0.1959676789686745
deviation-center-line_min0.03247064239380601
deviation-heading_max1.0088421659552809
deviation-heading_mean0.6490711027062754
deviation-heading_median0.7702930779632661
deviation-heading_min0.25178384988358676
driven_any_max0.6310084969497675
driven_any_mean0.40514110944530624
driven_any_median0.6257745763575799
driven_any_min0.037332951551372666
driven_lanedir_consec_max0.6295264657418261
driven_lanedir_consec_mean0.4029034985299075
driven_lanedir_consec_min0.03392822612671987
driven_lanedir_max0.6295264657418261
driven_lanedir_mean0.4029034985299075
driven_lanedir_median0.6229354781323941
driven_lanedir_min0.03392822612671987
in-drivable-lane_max0.1
in-drivable-lane_mean0.02
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.037332951551372666, "driven_lanedir": 0.03392822612671987, "in-drivable-lane": 0.1, "deviation-heading": 0.25178384988358676, "deviation-center-line": 0.03247064239380601, "driven_lanedir_consec": 0.03392822612671987}, "ep001": {"driven_any": 0.6282213470854661, "driven_lanedir": 0.6256581483153261, "in-drivable-lane": 0, "deviation-heading": 0.9262225516024524, "deviation-center-line": 0.312845368339678, "driven_lanedir_consec": 0.6256581483153261}, "ep002": {"driven_any": 0.10336817528234502, "driven_lanedir": 0.10246917433327116, "in-drivable-lane": 0, "deviation-heading": 0.2882138681267911, "deviation-center-line": 0.09877019830482894, "driven_lanedir_consec": 0.10246917433327116}, "ep003": {"driven_any": 0.6310084969497675, "driven_lanedir": 0.6295264657418261, "in-drivable-lane": 0, "deviation-heading": 0.7702930779632661, "deviation-center-line": 0.25702653274689496, "driven_lanedir_consec": 0.6295264657418261}, "ep004": {"driven_any": 0.6257745763575799, "driven_lanedir": 0.6229354781323941, "in-drivable-lane": 0, "deviation-heading": 1.0088421659552809, "deviation-center-line": 0.27872565305816466, "driven_lanedir_consec": 0.6229354781323941}}
154711861licNo rebalanceaido1_amod_service_quality_r1-v3step1-simulationsuccessyes3720:03:40(hidden)
other stats
passedtrue
154631868licFreq no rebalanceaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:17(hidden)
service_quality-20.28668464892319


other stats
efficiency-33.67257859569076
fleet_size-1000000000
154381853BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3720:01:14(hidden)
driven_lanedir_median0.34309976727313507
deviation-center-line_median0.05583514497179351
in-drivable-lane_median0.7666666666666676


other stats
deviation-center-line_max0.2633089868918129
deviation-center-line_mean0.0936079292941516
deviation-center-line_min0.007612051055476067
deviation-heading_max1.271614701067752
deviation-heading_mean0.5554738545478785
deviation-heading_median0.4560461493219019
deviation-heading_min0.09486444358779944
driven_any_max5.922666645987081
driven_any_mean2.054608616474005
driven_any_median1.0032958876887428
driven_any_min0.5242156582854929
driven_lanedir_max2.3912564117030533
driven_lanedir_mean0.8085990969582809
driven_lanedir_min0.004292867119538801
in-drivable-lane_max2.999999999999994
in-drivable-lane_mean1.039999999999999
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ep000": {"driven_any": 1.0032958876887428, "driven_lanedir": 0.004292867119538801, "in-drivable-lane": 0.8999999999999999, "deviation-heading": 0.09486444358779944, "deviation-center-line": 0.007612051055476067}, "ep001": {"driven_any": 0.5242156582854929, "driven_lanedir": 0.2608731884872588, "in-drivable-lane": 0.09999999999999998, "deviation-heading": 0.43261329765492185, "deviation-center-line": 0.03933943896730513}, "ep002": {"driven_any": 5.922666645987081, "driven_lanedir": 2.3912564117030533, "in-drivable-lane": 2.999999999999994, "deviation-heading": 1.271614701067752, "deviation-center-line": 0.2633089868918129}, "ep003": {"driven_any": 0.969397880615562, "driven_lanedir": 0.34309976727313507, "in-drivable-lane": 0.4333333333333333, "deviation-heading": 0.5222306811070168, "deviation-center-line": 0.05583514497179351}, "ep004": {"driven_any": 1.8534670097931465, "driven_lanedir": 1.0434732502084194, "in-drivable-lane": 0.7666666666666676, "deviation-heading": 0.4560461493219019, "deviation-center-line": 0.1019440245843704}}
154371853BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3720:00:50(hidden)
other stats
videos1
154351853BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessyes3720:02:39(hidden)
other stats
simulation-passed1
154251851BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessyes3720:02:52(hidden)
other stats
simulation-passed1
154151843WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step3-videossuccessyes3720:03:02(hidden)
other stats
videos1
154091847WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step3-videossuccessyes3720:02:58(hidden)
other stats
videos1
154041848WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step1-simulationsuccessyes3720:04:36(hidden)
other stats
simulation-passed1
154031843WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step1-simulationsuccessyes3720:08:16(hidden)
other stats
simulation-passed1
153901842yanberNoneaido1_log_processing-v3logstep1erroryes3720:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job15390-9866', 'pull']:

   >  Command '['docker-compose', '-p', 'job15390-9866', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling solution  ... error

Pulling evaluator ... done

stderr | ERROR: for solution  pull access denied for yanber/aido1_log_processing-v3-submission, repository does not exist or may require 'docker login'
stderr | pull access denied for yanber/aido1_log_processing-v3-submission, repository does not exist or may require 'docker login'
stderr | 
(hidden)
153891841WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step3-videossuccessyes3720:02:10(hidden)
other stats
videos1
153791839WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:17(hidden)
other stats
simulation-passed1
153781838WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step1-simulationsuccessyes3720:03:04(hidden)
other stats
simulation-passed1
153751837WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step4-vizsuccessyes3720:06:33(hidden)
driven_lanedir_median18.17690898164171
deviation-center-line_median0.718179347127471
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.7433571034151505
deviation-center-line_mean0.6706577912907912
deviation-center-line_min0.5720334018931366
deviation-heading_max1.6849266118872992
deviation-heading_mean1.6091575136209098
deviation-heading_median1.6387418966879037
deviation-heading_min1.4261564599548235
driven_any_max18.819580043358236
driven_any_mean18.548392335612323
driven_any_median18.505874745763546
driven_any_min18.326728885433894
driven_lanedir_max18.22263117938114
driven_lanedir_mean18.061435546768976
driven_lanedir_min17.580725386595958
in-drivable-lane_max0.4999999999999995
in-drivable-lane_mean0.2599999999999996
in-drivable-lane_min0.06666666666666665
per-episodes
details{"ep000": {"driven_any": 18.326728885433894, "driven_lanedir": 17.580725386595958, "in-drivable-lane": 0.4999999999999995, "deviation-heading": 1.6849266118872992, "deviation-center-line": 0.5972468306173291}, "ep001": {"driven_any": 18.505874745763546, "driven_lanedir": 18.203476261773027, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.6387418966879037, "deviation-center-line": 0.5720334018931366}, "ep002": {"driven_any": 18.819580043358236, "driven_lanedir": 18.12343592445304, "in-drivable-lane": 0.46666666666666606, "deviation-heading": 1.4261564599548235, "deviation-center-line": 0.718179347127471}, "ep003": {"driven_any": 18.479936701267167, "driven_lanedir": 18.17690898164171, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 1.6744048961857416, "deviation-center-line": 0.722472273400869}, "ep004": {"driven_any": 18.60984130223876, "driven_lanedir": 18.22263117938114, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.6215577033887805, "deviation-center-line": 0.7433571034151505}}
153711836WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step1-simulationsuccessyes3720:04:07(hidden)
other stats
simulation-passed1
153671834WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step3-videossuccessyes3720:00:48(hidden)
other stats
videos1
153631835WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:43(hidden)
other stats
simulation-passed1
153431829hvrigazovVisteon perception teamaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:21(hidden)
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 93, "reward": -10.35364907467237, "good_angle": 0.3986358842413225, "survival_time": 3.0999999999999988, "traveled_tiles": 4, "valid_direction": 0.7999999999999999}, "ep001": {"nsteps": 34, "reward": -29.088773468838017, "good_angle": 0.04294873805020422, "survival_time": 1.1333333333333335, "traveled_tiles": 3, "valid_direction": 0.06666666666666665}, "ep002": {"nsteps": 126, "reward": -7.4828876296560916, "good_angle": 0.18853048688300364, "survival_time": 4.199999999999995, "traveled_tiles": 6, "valid_direction": 0.3666666666666668}, "ep003": {"nsteps": 101, "reward": -9.403789310835966, "good_angle": 0.1648477739493939, "survival_time": 3.3666666666666645, "traveled_tiles": 4, "valid_direction": 0.26666666666666683}, "ep004": {"nsteps": 68, "reward": -14.373798117918128, "good_angle": 0.4093449955148813, "survival_time": 2.2666666666666684, "traveled_tiles": 3, "valid_direction": 0.366666666666666}}
good_angle_max0.4093449955148813
good_angle_mean0.2408615757277611
good_angle_median0.18853048688300364
good_angle_min0.04294873805020422
reward_max-7.4828876296560916
reward_mean-14.140579520384112
reward_median-10.35364907467237
reward_min-29.088773468838017
survival_time_max4.199999999999995
survival_time_mean2.8133333333333317
survival_time_min1.1333333333333335
traveled_tiles_max6
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max0.7999999999999999
valid_direction_mean0.3733333333333333
valid_direction_median0.366666666666666
valid_direction_min0.06666666666666665
153311825BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessyes3720:03:11(hidden)
other stats
simulation-passed1
153291822BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3720:01:02(hidden)
driven_lanedir_median0.5859004395102256
deviation-center-line_median0.06534713571755005
in-drivable-lane_median0


other stats
deviation-center-line_max0.22955427980650236
deviation-center-line_mean0.09197484493366444
deviation-center-line_min0.02448053148776276
deviation-heading_max1.1871160012404696
deviation-heading_mean0.4585632507758918
deviation-heading_median0.3381496555366195
deviation-heading_min0.09465693614651184
driven_any_max3.502703775061254
driven_any_mean1.2795813376128815
driven_any_median0.7665394500494463
driven_any_min0.5442262198078825
driven_lanedir_max2.671485797398385
driven_lanedir_mean0.9847890049768108
driven_lanedir_min0.5005813501234493
in-drivable-lane_max0.4333333333333333
in-drivable-lane_mean0.15999999999999998
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 3.502703775061254, "driven_lanedir": 2.671485797398385, "in-drivable-lane": 0.4333333333333333, "deviation-heading": 1.1871160012404696, "deviation-center-line": 0.22955427980650236}, "ep001": {"driven_any": 0.8921160438204108, "driven_lanedir": 0.5005813501234493, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 0.24376485148096885, "deviation-center-line": 0.04981928908925677}, "ep002": {"driven_any": 0.5442262198078825, "driven_lanedir": 0.5326349045371388, "in-drivable-lane": 0, "deviation-heading": 0.09465693614651184, "deviation-center-line": 0.02448053148776276}, "ep003": {"driven_any": 0.6923211993254155, "driven_lanedir": 0.5859004395102256, "in-drivable-lane": 0, "deviation-heading": 0.3381496555366195, "deviation-center-line": 0.06534713571755005}, "ep004": {"driven_any": 0.7665394500494463, "driven_lanedir": 0.6333425333148555, "in-drivable-lane": 0, "deviation-heading": 0.4291288094748891, "deviation-center-line": 0.09067298856725038}}
153281822BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3720:00:45(hidden)
other stats
videos1
153201821BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3720:00:52(hidden)
other stats
videos1
153181820BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3720:00:55(hidden)
driven_lanedir_median0.2501198780453051
deviation-center-line_median0.035775550219895536
in-drivable-lane_median0.3


other stats
deviation-center-line_max0.1250999882649859
deviation-center-line_mean0.062052896715606695
deviation-center-line_min0.02051409749760813
deviation-heading_max0.8748657779055632
deviation-heading_mean0.4418722585056195
deviation-heading_median0.3262272270893851
deviation-heading_min0.19173604681614004
driven_any_max1.8156693570006972
driven_any_mean0.905935333432746
driven_any_median0.6791736573124317
driven_any_min0.5671014537316
driven_lanedir_max1.4429379987166142
driven_lanedir_mean0.5159820623352471
driven_lanedir_min0.09454211377901124
in-drivable-lane_max0.43333333333333335
in-drivable-lane_mean0.24000000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6791736573124317, "driven_lanedir": 0.09454211377901124, "in-drivable-lane": 0.43333333333333335, "deviation-heading": 0.3262272270893851, "deviation-center-line": 0.032514297997168116}, "ep001": {"driven_any": 0.6320202172685903, "driven_lanedir": 0.2501198780453051, "in-drivable-lane": 0.3, "deviation-heading": 0.3167152433383297, "deviation-center-line": 0.035775550219895536}, "ep002": {"driven_any": 0.5671014537316, "driven_lanedir": 0.13307507606291755, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 0.19173604681614004, "deviation-center-line": 0.02051409749760813}, "ep003": {"driven_any": 0.8357119818504116, "driven_lanedir": 0.6592352450723873, "in-drivable-lane": 0, "deviation-heading": 0.4998169973786794, "deviation-center-line": 0.0963605495983758}, "ep004": {"driven_any": 1.8156693570006972, "driven_lanedir": 1.4429379987166142, "in-drivable-lane": 0.09999999999999998, "deviation-heading": 0.8748657779055632, "deviation-center-line": 0.1250999882649859}}
153051818WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step1-simulationsuccessyes3720:08:04(hidden)
other stats
simulation-passed1
153041817WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step1-simulationfailedyes3720:09:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 80, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 52, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)
152811809WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step4-vizsuccessno3720:05:30(hidden)
deviation-center-line_median0.5397199608012343
in-drivable-lane_median0.06666666666666643


other stats
deviation-center-line_max0.6104222454369994
deviation-center-line_mean0.4598320101415602
deviation-center-line_min0.024044871430288307
deviation-heading_max1.2350470605810189
deviation-heading_mean0.932777463904519
deviation-heading_median1.11837182743884
deviation-heading_min0.1900818382993772
driven_any_max18.582643031926057
driven_any_mean14.978135918168189
driven_any_median18.514230479315856
driven_any_min0.815519040206997
driven_lanedir_max18.442054946621457
driven_lanedir_mean14.759181756287584
driven_lanedir_median18.35466491372891
driven_lanedir_min0.7075562993802273
in-drivable-lane_max0.4333333333333332
in-drivable-lane_mean0.12666666666666654
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 18.514230479315856, "driven_lanedir": 17.93384965967578, "in-drivable-lane": 0.4333333333333332, "deviation-heading": 1.1185930084147115, "deviation-center-line": 0.5397199608012343}, "ep001": {"driven_any": 18.582643031926057, "driven_lanedir": 18.442054946621457, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.0017935847886474, "deviation-center-line": 0.6104222454369994}, "ep002": {"driven_any": 0.815519040206997, "driven_lanedir": 0.7075562993802273, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 0.1900818382993772, "deviation-center-line": 0.024044871430288307}, "ep003": {"driven_any": 18.550028665758177, "driven_lanedir": 18.35466491372891, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.2350470605810189, "deviation-center-line": 0.599965187685063}, "ep004": {"driven_any": 18.42825837363386, "driven_lanedir": 18.35778296203155, "in-drivable-lane": 0, "deviation-heading": 1.11837182743884, "deviation-center-line": 0.5250077853542159}}
152791809WEIGAOPanasonic R&D Center Singapore & NUSaido1_LFV_r1-v3step3-videossuccessyes3720:02:27(hidden)
other stats
videos1
152761810WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step1-simulationsuccessyes3720:07:35(hidden)
other stats
simulation-passed1
152631805spetrykSolution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median3.1999999999999984


other stats
episodes
details{"ep000": {"nsteps": 96, "reward": -11.370472581630262, "good_angle": 1.7016861016330411, "survival_time": 3.1999999999999984, "traveled_tiles": 2, "valid_direction": 1.1666666666666623}, "ep001": {"nsteps": 68, "reward": -14.34477115553968, "good_angle": 0.010440679839553234, "survival_time": 2.2666666666666684, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 69, "reward": -14.05708481600859, "good_angle": 0.404026325865544, "survival_time": 2.3000000000000016, "traveled_tiles": 2, "valid_direction": 0.8333333333333337}, "ep003": {"nsteps": 98, "reward": -10.190791356013802, "good_angle": 0.3863687236630496, "survival_time": 3.266666666666665, "traveled_tiles": 2, "valid_direction": 0.8999999999999968}, "ep004": {"nsteps": 101, "reward": -9.668390420809535, "good_angle": 0.3775859338252155, "survival_time": 3.3666666666666645, "traveled_tiles": 3, "valid_direction": 0.8333333333333304}}
good_angle_max1.7016861016330411
good_angle_mean0.5760215529652808
good_angle_median0.3863687236630496
good_angle_min0.010440679839553234
reward_max-9.668390420809535
reward_mean-11.926302066000376
reward_median-11.370472581630262
reward_min-14.34477115553968
survival_time_max3.3666666666666645
survival_time_mean2.88
survival_time_min2.2666666666666684
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max1.1666666666666623
valid_direction_mean0.7466666666666647
valid_direction_median0.8333333333333337
valid_direction_min0
152561804hvrigazovVisteon perception teamaido1_LF1_r3-v3step1-simulationsuccessyes3720:02:57(hidden)
other stats
simulation-passed1
152531801spetrykSolution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedyes3720:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 133, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Cannot feed value of shape (1, 13824) for Tensor u'prefix/0:0', which has shape '(1, 3, 48, 96)'

(hidden)
152441792spetrykSolution using imitation learning from logsaido1_LF1_r3-v3step1-simulationerroryes3720:00:40
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
(hidden)
152381789BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:33(hidden)
other stats
simulation-passed1
152371788BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3720:01:16(hidden)
driven_lanedir_median0.521880514626113
deviation-center-line_median0.10426006578448918
in-drivable-lane_median0


other stats
deviation-center-line_max1.2990592798216096
deviation-center-line_mean0.33144156734544944
deviation-center-line_min0.034630287014328
deviation-heading_max1.7059702339635872
deviation-heading_mean0.5457277403950854
deviation-heading_median0.3670784168910863
deviation-heading_min0.0574016719936038
driven_any_max8.505247201192008
driven_any_mean2.470148079913101
driven_any_median0.7146642566390042
driven_any_min0.33253178359695534
driven_lanedir_max7.0208874410857325
driven_lanedir_mean1.942187961307048
driven_lanedir_min0.32358570953702337
in-drivable-lane_max1.299999999999998
in-drivable-lane_mean0.4599999999999996
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.4124533091907923, "driven_lanedir": 1.4644392729344096, "in-drivable-lane": 1.0000000000000002, "deviation-heading": 0.3670784168910863, "deviation-center-line": 0.18238878710288944}, "ep001": {"driven_any": 0.38584384894674423, "driven_lanedir": 0.3801468683519609, "in-drivable-lane": 0, "deviation-heading": 0.0574016719936038, "deviation-center-line": 0.034630287014328}, "ep002": {"driven_any": 8.505247201192008, "driven_lanedir": 7.0208874410857325, "in-drivable-lane": 1.299999999999998, "deviation-heading": 1.7059702339635872, "deviation-center-line": 1.2990592798216096}, "ep003": {"driven_any": 0.7146642566390042, "driven_lanedir": 0.521880514626113, "in-drivable-lane": 0, "deviation-heading": 0.5137712496104528, "deviation-center-line": 0.10426006578448918}, "ep004": {"driven_any": 0.33253178359695534, "driven_lanedir": 0.32358570953702337, "in-drivable-lane": 0, "deviation-heading": 0.08441712951669698, "deviation-center-line": 0.036869417003931}}
152341788BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessyes3720:02:55(hidden)
other stats
simulation-passed1
152251785Liam PaullRandom executionaido1_LF1_r3-v3step4-vizsuccessyes3720:01:02(hidden)
driven_lanedir_median0.7783192106360408
deviation-center-line_median0.11570483192692992
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.16670357033941505
deviation-center-line_mean0.09180087418015584
deviation-center-line_min0.010960488606122868
deviation-heading_max0.34166970533598884
deviation-heading_mean0.23686400729408288
deviation-heading_median0.26451178551660837
deviation-heading_min0.08753529617949395
driven_any_max1.1400000000000017
driven_any_mean0.9760000000000012
driven_any_median1.0799999999999996
driven_any_min0.7799999999999967
driven_lanedir_max1.1054561923632351
driven_lanedir_mean0.7307584818240866
driven_lanedir_min0.005399048963769193
in-drivable-lane_max1.633333333333335
in-drivable-lane_mean0.346666666666667
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0799999999999996, "driven_lanedir": 0.005399048963769193, "in-drivable-lane": 1.633333333333335, "deviation-heading": 0.30335649020653566, "deviation-center-line": 0.010960488606122868}, "ep001": {"driven_any": 0.7800000000000074, "driven_lanedir": 0.7783192106360408, "in-drivable-lane": 0, "deviation-heading": 0.08753529617949395, "deviation-center-line": 0.11570483192692992}, "ep002": {"driven_any": 0.7799999999999967, "driven_lanedir": 0.706093028267093, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.34166970533598884, "deviation-center-line": 0.04371207325047091}, "ep003": {"driven_any": 1.100000000000001, "driven_lanedir": 1.0585249288902947, "in-drivable-lane": 0.06666666666666687, "deviation-heading": 0.18724675923178744, "deviation-center-line": 0.16670357033941505}, "ep004": {"driven_any": 1.1400000000000017, "driven_lanedir": 1.1054561923632351, "in-drivable-lane": 0, "deviation-heading": 0.26451178551660837, "deviation-center-line": 0.12192340677784048}}
152211784mpicquetPython templateaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:19(hidden)
service_quality-30.489251895284983


other stats
efficiency-58.13296758113725
fleet_size-1000000000
152191783Liam PaullRandom executionaido1_LF1_r3-v3step4-vizsuccessyes3720:01:10(hidden)
driven_lanedir_median0.7783192106360408
deviation-center-line_median0.11570483192692992
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.16670357033941505
deviation-center-line_mean0.09180087418015584
deviation-center-line_min0.010960488606122868
deviation-heading_max0.34166970533598884
deviation-heading_mean0.23686400729408288
deviation-heading_median0.26451178551660837
deviation-heading_min0.08753529617949395
driven_any_max1.1400000000000017
driven_any_mean0.9760000000000012
driven_any_median1.0799999999999996
driven_any_min0.7799999999999967
driven_lanedir_max1.1054561923632351
driven_lanedir_mean0.7307584818240866
driven_lanedir_min0.005399048963769193
in-drivable-lane_max1.633333333333335
in-drivable-lane_mean0.346666666666667
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0799999999999996, "driven_lanedir": 0.005399048963769193, "in-drivable-lane": 1.633333333333335, "deviation-heading": 0.30335649020653566, "deviation-center-line": 0.010960488606122868}, "ep001": {"driven_any": 0.7800000000000074, "driven_lanedir": 0.7783192106360408, "in-drivable-lane": 0, "deviation-heading": 0.08753529617949395, "deviation-center-line": 0.11570483192692992}, "ep002": {"driven_any": 0.7799999999999967, "driven_lanedir": 0.706093028267093, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.34166970533598884, "deviation-center-line": 0.04371207325047091}, "ep003": {"driven_any": 1.100000000000001, "driven_lanedir": 1.0585249288902947, "in-drivable-lane": 0.06666666666666687, "deviation-heading": 0.18724675923178744, "deviation-center-line": 0.16670357033941505}, "ep004": {"driven_any": 1.1400000000000017, "driven_lanedir": 1.1054561923632351, "in-drivable-lane": 0, "deviation-heading": 0.26451178551660837, "deviation-center-line": 0.12192340677784048}}
152161783Liam PaullRandom executionaido1_LF1_r3-v3step1-simulationsuccessyes3720:01:05(hidden)
other stats
simulation-passed1
152041779heyt0nySAIC MOSCOW MMLaido1_LFV_r1-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 35, "reward": -28.140923289528914, "good_angle": 0.24285352790811623, "survival_time": 1.166666666666667, "traveled_tiles": 3, "valid_direction": 0.2666666666666666}, "ep001": {"nsteps": 500, "reward": 0.5925779729187488, "good_angle": 29.22764829763467, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.09999999999999}, "ep002": {"nsteps": 83, "reward": -11.232125293418584, "good_angle": 0.025908660109682347, "survival_time": 2.7666666666666666, "traveled_tiles": 6, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": 0.645043359220028, "good_angle": 29.059354701328186, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.0333333333333243}, "ep004": {"nsteps": 500, "reward": 0.6269584831595421, "good_angle": 29.684830139371364, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.233333333333342}}
good_angle_max29.684830139371364
good_angle_mean17.6481190652704
good_angle_median29.059354701328186
good_angle_min0.025908660109682347
reward_max0.645043359220028
reward_mean-7.501693753529837
reward_median0.5925779729187488
reward_min-28.140923289528914
survival_time_max16.666666666666654
survival_time_mean10.786666666666658
survival_time_min1.166666666666667
traveled_tiles_max18
traveled_tiles_mean12.6
traveled_tiles_median18
traveled_tiles_min3
valid_direction_max3.233333333333342
valid_direction_mean1.9266666666666643
valid_direction_median3.0333333333333243
valid_direction_min0
151951775WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step3-videossuccessyes3720:01:58(hidden)
other stats
videos1
151931775WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:04(hidden)
other stats
simulation-passed1
151881773WEIGAONUS & Panasonic R&D Center Singaporeaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:21(hidden)
other stats
simulation-passed1
151821770ossamaAhmedPython templateaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:18(hidden)
service_quality-32.582267091677096


other stats
efficiency-64.62706836670868
fleet_size-1000000000
151491761WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LF1_r3-v3step3-videossuccessyes3720:01:56(hidden)
other stats
videos1
151471761WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:03(hidden)
other stats
simulation-passed1
151461760WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LF1_r3-v3step4-vizsuccessyes3720:04:43(hidden)
driven_lanedir_median18.114766435890793
deviation-center-line_median0.7266737677036057
in-drivable-lane_median0.16666666666666785


other stats
deviation-center-line_max0.7618333216183896
deviation-center-line_mean0.6702522917461644
deviation-center-line_min0.535952551804748
deviation-heading_max1.78510555658121
deviation-heading_mean1.6367578179543454
deviation-heading_median1.6150554880840908
deviation-heading_min1.545677798003294
driven_any_max18.726615215760894
driven_any_mean18.547167496603045
driven_any_median18.530182239161984
driven_any_min18.418496852708422
driven_lanedir_max18.16376879861281
driven_lanedir_mean18.038888850229416
driven_lanedir_min17.658465007828422
in-drivable-lane_max0.4999999999999996
in-drivable-lane_mean0.26666666666666716
in-drivable-lane_min0.13333333333333286
per-episodes
details{"ep000": {"driven_any": 18.418496852708422, "driven_lanedir": 17.658465007828422, "in-drivable-lane": 0.4999999999999996, "deviation-heading": 1.6758431890840393, "deviation-center-line": 0.5885572468123389}, "ep001": {"driven_any": 18.5096428676622, "driven_lanedir": 18.143423701989953, "in-drivable-lane": 0.16666666666666785, "deviation-heading": 1.545677798003294, "deviation-center-line": 0.535952551804748}, "ep002": {"driven_any": 18.726615215760894, "driven_lanedir": 18.114766435890793, "in-drivable-lane": 0.36666666666666775, "deviation-heading": 1.562107058019093, "deviation-center-line": 0.7382445707917397}, "ep003": {"driven_any": 18.550900307721733, "driven_lanedir": 18.16376879861281, "in-drivable-lane": 0.16666666666666785, "deviation-heading": 1.6150554880840908, "deviation-center-line": 0.7266737677036057}, "ep004": {"driven_any": 18.530182239161984, "driven_lanedir": 18.114020306825097, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.78510555658121, "deviation-center-line": 0.7618333216183896}}
151451760WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LF1_r3-v3step3-videossuccessyes3720:02:06(hidden)
other stats
videos1
151441760WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.9314793206180912, "good_angle": 0.35102909818687095, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.5666666666666658}, "ep001": {"nsteps": 500, "reward": 0.9619058530330656, "good_angle": 0.1760269072638538, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.1999999999999995}, "ep002": {"nsteps": 500, "reward": 1.0248423970341682, "good_angle": 0.26583941462186617, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.4333333333333321}, "ep003": {"nsteps": 500, "reward": 0.989724625647068, "good_angle": 0.2850100010239843, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.4999999999999989}, "ep004": {"nsteps": 500, "reward": 0.9896642333865164, "good_angle": 0.4519108020210397, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.7333333333333325}}
good_angle_max0.4519108020210397
good_angle_mean0.305963244623523
good_angle_median0.2850100010239843
good_angle_min0.1760269072638538
reward_max1.0248423970341682
reward_mean0.979523285943782
reward_median0.9896642333865164
reward_min0.9314793206180912
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max0.7333333333333325
valid_direction_mean0.4866666666666658
valid_direction_median0.4999999999999989
valid_direction_min0.1999999999999995
151421759WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LF1_r3-v3step1-simulationfailedyes3720:06:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 80, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 52, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)
151411757WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LF1_r3-v3step4-vizsuccessyes3720:04:31(hidden)
driven_lanedir_median17.91468848396697
deviation-center-line_median0.6886453002162244
in-drivable-lane_median0.29999999999999916


other stats
deviation-center-line_max0.7418391533825798
deviation-center-line_mean0.6580369453193626
deviation-center-line_min0.5665967477457616
deviation-heading_max1.7334590674768626
deviation-heading_mean1.6168606854104646
deviation-heading_median1.588613647134545
deviation-heading_min1.5470858923283384
driven_any_max18.693018203387386
driven_any_mean18.491246621280435
driven_any_median18.460680550608178
driven_any_min18.35592902455691
driven_lanedir_max18.1078512569771
driven_lanedir_mean17.93625609629302
driven_lanedir_min17.668173509151664
in-drivable-lane_max0.5333333333333325
in-drivable-lane_mean0.32666666666666605
in-drivable-lane_min0.1666666666666662
per-episodes
details{"ep000": {"driven_any": 18.35592902455691, "driven_lanedir": 17.668173509151664, "in-drivable-lane": 0.46666666666666606, "deviation-heading": 1.588613647134545, "deviation-center-line": 0.5956716052125491}, "ep001": {"driven_any": 18.460680550608178, "driven_lanedir": 18.1078512569771, "in-drivable-lane": 0.1666666666666662, "deviation-heading": 1.575015524879832, "deviation-center-line": 0.5665967477457616}, "ep002": {"driven_any": 18.693018203387386, "driven_lanedir": 17.888535318811854, "in-drivable-lane": 0.5333333333333325, "deviation-heading": 1.5470858923283384, "deviation-center-line": 0.6886453002162244}, "ep003": {"driven_any": 18.44032714457728, "driven_lanedir": 17.91468848396697, "in-drivable-lane": 0.29999999999999916, "deviation-heading": 1.6401292952327444, "deviation-center-line": 0.697431920039698}, "ep004": {"driven_any": 18.506278183272432, "driven_lanedir": 18.102031912557525, "in-drivable-lane": 0.1666666666666664, "deviation-heading": 1.7334590674768626, "deviation-center-line": 0.7418391533825798}}
151391757WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LF1_r3-v3step3-videossuccessyes3720:02:08(hidden)
other stats
videos1
151381757WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:25(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.9365787135660648, "good_angle": 0.4037747364403636, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.633333333333334}, "ep001": {"nsteps": 500, "reward": 0.9627165818810464, "good_angle": 0.2546452760369114, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.40000000000000335}, "ep002": {"nsteps": 500, "reward": 1.0059203038811684, "good_angle": 0.28933255974595423, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.5000000000000008}, "ep003": {"nsteps": 500, "reward": 0.9587816730290653, "good_angle": 0.4093150387278217, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.6999999999999982}, "ep004": {"nsteps": 500, "reward": 1.004984638273716, "good_angle": 0.35288634045443823, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.599999999999999}}
good_angle_max0.4093150387278217
good_angle_mean0.3419907902810978
good_angle_median0.35288634045443823
good_angle_min0.2546452760369114
reward_max1.0059203038811684
reward_mean0.973796382126212
reward_median0.9627165818810464
reward_min0.9365787135660648
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max0.6999999999999982
valid_direction_mean0.566666666666667
valid_direction_median0.599999999999999
valid_direction_min0.40000000000000335
151361758WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LFV_r1-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.6490729692354799, "good_angle": 18.7704766716831, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.4999999999999942}, "ep001": {"nsteps": 500, "reward": 0.6638857601583004, "good_angle": 19.897063311580887, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.8666666666666605}, "ep002": {"nsteps": 12, "reward": -83.20068952813745, "good_angle": 0.114393071346664, "survival_time": 0.4, "traveled_tiles": 2, "valid_direction": 0.16666666666666663}, "ep003": {"nsteps": 500, "reward": 0.7009152868241072, "good_angle": 19.53875681251462, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.56666666666666}, "ep004": {"nsteps": 500, "reward": 0.6487571743819862, "good_angle": 20.246740512199036, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.366666666666659}}
good_angle_max20.246740512199036
good_angle_mean15.71348607586486
good_angle_median19.53875681251462
good_angle_min0.114393071346664
reward_max0.7009152868241072
reward_mean-16.107611667507513
reward_median0.6490729692354799
reward_min-83.20068952813745
survival_time_max16.666666666666654
survival_time_mean13.413333333333323
survival_time_min0.4
traveled_tiles_max18
traveled_tiles_mean14.8
traveled_tiles_median18
traveled_tiles_min2
valid_direction_max2.8666666666666605
valid_direction_mean2.093333333333328
valid_direction_median2.4999999999999942
valid_direction_min0.16666666666666663
151351758WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LFV_r1-v3step1-simulationsuccessyes3720:06:13(hidden)
other stats
simulation-passed1
151321756Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:00:40(hidden)
other stats
videos1
151301756Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:01:49(hidden)
other stats
simulation-passed1
151291755miksazJetBrains Researchaido1_LF1_r3-v3step4-vizsuccessyes3720:03:30(hidden)
driven_lanedir_median17.89579260954167
deviation-center-line_median1.1138339412029614
in-drivable-lane_median0.366666666666666


other stats
deviation-center-line_max1.1642435563210776
deviation-center-line_mean0.8926720679490134
deviation-center-line_min0.4770412005088365
deviation-heading_max2.7998706302122542
deviation-heading_mean2.160890769209721
deviation-heading_median2.602597044186774
deviation-heading_min1.286009106518449
driven_any_max19.084690881923184
driven_any_mean14.69767703362507
driven_any_median18.79944856682859
driven_any_min8.349083941906127
driven_lanedir_max18.37976706116731
driven_lanedir_mean13.994438644678205
driven_lanedir_min7.804296068712505
in-drivable-lane_max0.4333333333333357
in-drivable-lane_mean0.3333333333333334
in-drivable-lane_min0.1999999999999994
per-episodes
details{"ep000": {"driven_any": 19.084690881923184, "driven_lanedir": 18.37976706116731, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 2.602597044186774, "deviation-center-line": 1.16407763809586}, "ep001": {"driven_any": 8.437557793556802, "driven_lanedir": 7.991404150519965, "in-drivable-lane": 0.1999999999999994, "deviation-heading": 1.286009106518449, "deviation-center-line": 0.4770412005088365}, "ep002": {"driven_any": 18.79944856682859, "driven_lanedir": 17.900933333449565, "in-drivable-lane": 0.40000000000000047, "deviation-heading": 2.7998706302122542, "deviation-center-line": 1.1642435563210776}, "ep003": {"driven_any": 18.817603983910647, "driven_lanedir": 17.89579260954167, "in-drivable-lane": 0.4333333333333357, "deviation-heading": 2.786148419599385, "deviation-center-line": 1.1138339412029614}, "ep004": {"driven_any": 8.349083941906127, "driven_lanedir": 7.804296068712505, "in-drivable-lane": 0.366666666666666, "deviation-heading": 1.3298286455317416, "deviation-center-line": 0.5441640036163322}}
151281755miksazJetBrains Researchaido1_LF1_r3-v3step3-videossuccessyes3720:01:36(hidden)
other stats
videos1
151271755miksazJetBrains Researchaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.7125540226697922, "good_angle": 0.30995251822965386, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.29999999999999893}, "ep001": {"nsteps": 223, "reward": -3.841066211127914, "good_angle": 0.5931237097372027, "survival_time": 7.433333333333317, "traveled_tiles": 14, "valid_direction": 0.466666666666665}, "ep002": {"nsteps": 500, "reward": 0.76775694668293, "good_angle": 0.4075350115228915, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.3999999999999986}, "ep003": {"nsteps": 500, "reward": 0.776328907430172, "good_angle": 0.3931522566910569, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.3333333333333338}, "ep004": {"nsteps": 232, "reward": -3.7513002419266206, "good_angle": 1.423164776420114, "survival_time": 7.733333333333316, "traveled_tiles": 14, "valid_direction": 0.8333333333333326}}
good_angle_max1.423164776420114
good_angle_mean0.6253856545201838
good_angle_median0.4075350115228915
good_angle_min0.30995251822965386
reward_max0.776328907430172
reward_mean-1.067145315254328
reward_median0.7125540226697922
reward_min-3.841066211127914
survival_time_max16.666666666666654
survival_time_mean13.03333333333332
survival_time_min7.433333333333317
traveled_tiles_max18
traveled_tiles_mean16.4
traveled_tiles_median18
traveled_tiles_min14
valid_direction_max0.8333333333333326
valid_direction_mean0.4666666666666658
valid_direction_median0.3999999999999986
valid_direction_min0.29999999999999893
151261755miksazJetBrains Researchaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:05(hidden)
other stats
simulation-passed1
151181752BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median1.0666666666666669


other stats
episodes
details{"ep000": {"nsteps": 51, "reward": -19.423461345480938, "good_angle": 0.2179044089079148, "survival_time": 1.700000000000002, "traveled_tiles": 3, "valid_direction": 0.5333333333333334}, "ep001": {"nsteps": 10, "reward": -99.77443239316344, "good_angle": 0.0601187433039624, "survival_time": 0.3333333333333333, "traveled_tiles": 2, "valid_direction": 0.1}, "ep002": {"nsteps": 32, "reward": -30.85535250362591, "good_angle": 0.34172503925474595, "survival_time": 1.0666666666666669, "traveled_tiles": 2, "valid_direction": 0.3666666666666667}, "ep003": {"nsteps": 61, "reward": -16.056091997711384, "good_angle": 0.4951384382608525, "survival_time": 2.033333333333336, "traveled_tiles": 5, "valid_direction": 0.5666666666666681}, "ep004": {"nsteps": 22, "reward": -45.52115143780512, "good_angle": 1.963174594894916, "survival_time": 0.7333333333333333, "traveled_tiles": 3, "valid_direction": 0.26666666666666666}}
good_angle_max1.963174594894916
good_angle_mean0.6156122449244783
good_angle_median0.34172503925474595
good_angle_min0.0601187433039624
reward_max-16.056091997711384
reward_mean-42.32609793555736
reward_median-30.85535250362591
reward_min-99.77443239316344
survival_time_max2.033333333333336
survival_time_mean1.1733333333333342
survival_time_min0.3333333333333333
traveled_tiles_max5
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max0.5666666666666681
valid_direction_mean0.366666666666667
valid_direction_median0.3666666666666667
valid_direction_min0.1
151141751lsieberSimple FIFOaido1_amod_service_quality_r1-v3step1-simulationsuccessyes3720:04:10(hidden)
other stats
passedtrue
151111749Liam PaullTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessyes3720:00:41(hidden)
other stats
videos1
151091749Liam PaullTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessyes3720:02:03(hidden)
other stats
simulation-passed1
151071746Liam PaullTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3720:02:28(hidden)
driven_lanedir_median5.302566481656299
deviation-center-line_median0.5565671916823862
in-drivable-lane_median0.16666666666666652


other stats
deviation-center-line_max0.8859936557711611
deviation-center-line_mean0.528607812747053
deviation-center-line_min0.16606102536010822
deviation-heading_max3.033370854841319
deviation-heading_mean2.280705656084282
deviation-heading_median2.4561990578057573
deviation-heading_min0.9882049312556496
driven_any_max9.0481182555653
driven_any_mean6.141090110593249
driven_any_median5.90889969385339
driven_any_min1.2967673217013216
driven_lanedir_max8.21557018025004
driven_lanedir_mean5.398798112513221
driven_lanedir_min1.1127930583588117
in-drivable-lane_max1.433333333333331
in-drivable-lane_mean0.5466666666666657
in-drivable-lane_min0.03333333333333344
per-episodes
details{"ep000": {"driven_any": 5.90889969385339, "driven_lanedir": 4.810083815920299, "in-drivable-lane": 0.9666666666666656, "deviation-heading": 2.4510219442237524, "deviation-center-line": 0.44833422712128373}, "ep001": {"driven_any": 9.0481182555653, "driven_lanedir": 7.552977026380654, "in-drivable-lane": 1.433333333333331, "deviation-heading": 2.4747314922949313, "deviation-center-line": 0.5565671916823862}, "ep002": {"driven_any": 8.688836269603568, "driven_lanedir": 8.21557018025004, "in-drivable-lane": 0.13333333333333308, "deviation-heading": 3.033370854841319, "deviation-center-line": 0.8859936557711611}, "ep003": {"driven_any": 5.762829012242665, "driven_lanedir": 5.302566481656299, "in-drivable-lane": 0.16666666666666652, "deviation-heading": 2.4561990578057573, "deviation-center-line": 0.5860829638003254}, "ep004": {"driven_any": 1.2967673217013216, "driven_lanedir": 1.1127930583588117, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.9882049312556496, "deviation-center-line": 0.16606102536010822}}
151001744JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3720:03:32(hidden)
driven_lanedir_median16.335574011879036
deviation-center-line_median1.0444064856536095
in-drivable-lane_median1.6000000000000056


other stats
deviation-center-line_max1.1199208746741478
deviation-center-line_mean0.9034644580589164
deviation-center-line_min0.6475055535490419
deviation-heading_max2.4897497282854237
deviation-heading_mean2.001625775234914
deviation-heading_median2.435186744265479
deviation-heading_min1.160105984477231
driven_any_max19.08644144337508
driven_any_mean15.764722872947305
driven_any_median18.95343719128836
driven_any_min10.614911570017236
driven_lanedir_max16.63344870405414
driven_lanedir_mean13.574702733558876
driven_lanedir_min8.697876190248273
in-drivable-lane_max1.9666666666666763
in-drivable-lane_mean1.6200000000000003
in-drivable-lane_min1.099999999999996
per-episodes
details{"ep000": {"driven_any": 10.614911570017236, "driven_lanedir": 8.697876190248273, "in-drivable-lane": 1.4999999999999964, "deviation-heading": 1.4354348009897515, "deviation-center-line": 0.6475055535490419}, "ep001": {"driven_any": 19.04554329870867, "driven_lanedir": 16.436320008197605, "in-drivable-lane": 1.933333333333328, "deviation-heading": 2.435186744265479, "deviation-center-line": 1.0444064856536095}, "ep002": {"driven_any": 19.08644144337508, "driven_lanedir": 16.335574011879036, "in-drivable-lane": 1.9666666666666763, "deviation-heading": 2.4876516181566832, "deviation-center-line": 1.057638901024734}, "ep003": {"driven_any": 11.123280861347173, "driven_lanedir": 9.770294753415332, "in-drivable-lane": 1.099999999999996, "deviation-heading": 1.160105984477231, "deviation-center-line": 0.6478504753930472}, "ep004": {"driven_any": 18.95343719128836, "driven_lanedir": 16.63344870405414, "in-drivable-lane": 1.6000000000000056, "deviation-heading": 2.4897497282854237, "deviation-center-line": 1.1199208746741478}}
150901742Liam PaullRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median2.7333333333333334


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -13.345729552073086, "good_angle": 1.7078831181762997, "survival_time": 2.7333333333333334, "traveled_tiles": 2, "valid_direction": 1.0666666666666649}, "ep001": {"nsteps": 96, "reward": -10.319551954036193, "good_angle": 0.3776969166322244, "survival_time": 3.1999999999999984, "traveled_tiles": 3, "valid_direction": 0.7333333333333307}, "ep002": {"nsteps": 58, "reward": -16.897464768896842, "good_angle": 0.2781382823777851, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 0.7333333333333356}, "ep003": {"nsteps": 31, "reward": -31.928977087740936, "good_angle": 0.017450018670522992, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 85, "reward": -11.301660448794856, "good_angle": 0.32340701832600327, "survival_time": 2.833333333333333, "traveled_tiles": 3, "valid_direction": 0.6666666666666643}}
good_angle_max1.7078831181762997
good_angle_mean0.5409150708365671
good_angle_median0.32340701832600327
good_angle_min0.017450018670522992
reward_max-10.319551954036193
reward_mean-16.75867676230838
reward_median-13.345729552073086
reward_min-31.928977087740936
survival_time_max3.1999999999999984
survival_time_mean2.3466666666666667
survival_time_min1.0333333333333332
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.0666666666666649
valid_direction_mean0.6399999999999991
valid_direction_median0.7333333333333307
valid_direction_min0
150861741Liam PaullTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessyes3720:00:40(hidden)
other stats
videos1
150831740BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median1.7666666666666688


other stats
episodes
details{"ep000": {"nsteps": 38, "reward": -26.50024190216668, "good_angle": 0.1734727673880306, "survival_time": 1.2666666666666673, "traveled_tiles": 3, "valid_direction": 0.33333333333333326}, "ep001": {"nsteps": 65, "reward": -14.859583750660889, "good_angle": 0.1469238246053975, "survival_time": 2.1666666666666687, "traveled_tiles": 5, "valid_direction": 0.26666666666666694}, "ep002": {"nsteps": 40, "reward": -24.484914604760707, "good_angle": 0.03032870512478784, "survival_time": 1.333333333333334, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 78, "reward": -12.51068212545644, "good_angle": 0.06535693542431725, "survival_time": 2.6000000000000005, "traveled_tiles": 5, "valid_direction": 0.20000000000000015}, "ep004": {"nsteps": 53, "reward": -18.815159964673924, "good_angle": 0.8362778993652883, "survival_time": 1.7666666666666688, "traveled_tiles": 4, "valid_direction": 0.4666666666666681}}
good_angle_max0.8362778993652883
good_angle_mean0.2504720263815643
good_angle_median0.1469238246053975
good_angle_min0.03032870512478784
reward_max-12.51068212545644
reward_mean-19.434116469543728
reward_median-18.815159964673924
reward_min-26.50024190216668
survival_time_max2.6000000000000005
survival_time_mean1.826666666666668
survival_time_min1.2666666666666673
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max0.4666666666666681
valid_direction_mean0.2533333333333337
valid_direction_median0.26666666666666694
valid_direction_min0
150581727WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LFV_r1-v3step3-videossuccessyes3720:00:36(hidden)
other stats
videos1
150521726lsieberSimple FIFOaido1_amod_service_quality_r1-v3step1-simulationfailedyes3720:03:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 13, in run
    aidoGuest.run()
  File "/project/src/AidoGuest.py", line 62, in run
    command = dispatchingLogic.of(status)
  File "/project/src/DispatchingLogic.py", line 53, in of
    robotaxi = self.getClosestRoboTaxi(request, robotaxis, matchedTax)
  File "/project/src/DispatchingLogic.py", line 86, in getClosestRoboTaxi
    distance = self.getDistance(lat, lon, roboTaxi)
  File "/project/src/DispatchingLogic.py", line 99, in getDistance
    coord2 = (lat2, long2)
NameError: global name 'long2' is not defined


(hidden)
150511725miksazJetBrains Researchaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:32(hidden)
other stats
simulation-passed1
150481723WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LFV_r1-v3step3-videossuccessyes3720:00:42(hidden)
other stats
videos1
150461723WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LFV_r1-v3step1-simulationsuccessyes3720:01:38(hidden)
other stats
simulation-passed1
150411718WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LFV_r1-v3step1-simulationfailedyes3720:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 79, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 48, in solve
    action = aido_controller.get_action(undistorted_obs)
  File "/workspace/AIDO/controller.py", line 205, in get_action
    r_contours, r_lane, right_lane_predict = self.get_contour_points(mask, 2)
  File "/workspace/AIDO/controller.py", line 169, in get_contour_points
    ego.append(inverse_map[y,x])
IndexError: index 576 is out of bounds for axis 0 with size 480


(hidden)
150391710miksazJetBrains Researchaido1_LF1_r3-v3step4-vizsuccessyes3720:03:35(hidden)
driven_lanedir_median16.072005131773025
deviation-center-line_median1.0100526297629109
in-drivable-lane_median0.29999999999999893


other stats
deviation-center-line_max1.1361553217998652
deviation-center-line_mean0.7912385608888957
deviation-center-line_min0.09324673732420838
deviation-heading_max2.6980547759655584
deviation-heading_mean1.8581450461846956
deviation-heading_median2.350944841700525
deviation-heading_min0.4180616059953606
driven_any_max19.020924061015375
driven_any_mean13.14176513634113
driven_any_median16.831723561203994
driven_any_min1.7257840153406196
driven_lanedir_max18.317638229968253
driven_lanedir_mean12.54962431094819
driven_lanedir_min1.499425837540798
in-drivable-lane_max0.3666666666666655
in-drivable-lane_mean0.27999999999999975
in-drivable-lane_min0.1666666666666662
per-episodes
details{"ep000": {"driven_any": 9.203759788001683, "driven_lanedir": 8.76803194947519, "in-drivable-lane": 0.1666666666666662, "deviation-heading": 1.3006049925422591, "deviation-center-line": 0.5819182240681141}, "ep001": {"driven_any": 19.020924061015375, "driven_lanedir": 18.317638229968253, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 2.350944841700525, "deviation-center-line": 1.1361553217998652}, "ep002": {"driven_any": 16.831723561203994, "driven_lanedir": 16.072005131773025, "in-drivable-lane": 0.3666666666666655, "deviation-heading": 2.5230590147197747, "deviation-center-line": 1.0100526297629109}, "ep003": {"driven_any": 18.926634256143977, "driven_lanedir": 18.091020405983688, "in-drivable-lane": 0.33333333333333426, "deviation-heading": 2.6980547759655584, "deviation-center-line": 1.13481989148938}, "ep004": {"driven_any": 1.7257840153406196, "driven_lanedir": 1.499425837540798, "in-drivable-lane": 0.2333333333333341, "deviation-heading": 0.4180616059953606, "deviation-center-line": 0.09324673732420838}}
150371715EdwardSemSeg_testaido1_luck-v3step1successyes3720:00:24(hidden)
score1100


150361714EdwardSemSeg_testaido1_luck-v3step1successyes3720:00:24(hidden)
score1100


150331713BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median0.7999999999999999


other stats
episodes
details{"ep000": {"nsteps": 30, "reward": -33.90046761929989, "good_angle": 0.4431143602653267, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.46666666666666656}, "ep001": {"nsteps": 21, "reward": -47.253679474549635, "good_angle": 0.15423356340546784, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.26666666666666666}, "ep002": {"nsteps": 24, "reward": -41.39787075618127, "good_angle": 0.05938547713066195, "survival_time": 0.7999999999999999, "traveled_tiles": 2, "valid_direction": 0.1333333333333333}, "ep003": {"nsteps": 30, "reward": -33.12740348378817, "good_angle": 0.13484239023230782, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.2666666666666666}, "ep004": {"nsteps": 15, "reward": -66.34810793648164, "good_angle": 0.0034065448519183875, "survival_time": 0.49999999999999994, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.4431143602653267
good_angle_mean0.15899646717713656
good_angle_median0.13484239023230782
good_angle_min0.0034065448519183875
reward_max-33.12740348378817
reward_mean-44.40550585406013
reward_median-41.39787075618127
reward_min-66.34810793648164
survival_time_max1
survival_time_mean0.7999999999999999
survival_time_min0.49999999999999994
traveled_tiles_max2
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.46666666666666656
valid_direction_mean0.22666666666666663
valid_direction_median0.2666666666666666
valid_direction_min0
150281709WEIGAONUS&PANASONIC_R&D_SINGAPOREaido1_LFV_r1-v3step3-videossuccessyes3720:00:37(hidden)
other stats
videos1
149951698JoelGaechtergreedy but not so lazyaido1_amod_fleet_size_r1-v3step2-scoringsuccessyes3720:00:14(hidden)
fleet_size-1000000000


other stats
efficiency-34.87094990554855
service_quality-20.554737476387672
149731691JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3720:02:10(hidden)
other stats
videos1
149571681Andreas Aumiller simple redispatcheraido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:15(hidden)
service_quality-19.989186183442932


other stats
efficiency-32.89298473376916
fleet_size-1000000000
149521679rumpelstilzchenM876xzaido1_amod_fleet_size_r1-v3step1-simulationerroryes3720:30:47
Timeout: Waited 180 [...]
Timeout:

Waited 1803.51330709 for container to finish. Giving up. 
(hidden)
149471657rumpelstilzchenSimsalabimaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:19(hidden)
service_quality-32.91514582794956


other stats
efficiency-64.27898331179803
fleet_size-1000000000
149451659rumpelstilzchenSimsalabimaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:16(hidden)
service_quality-33.578766375371416


other stats
efficiency-68.58570550148647
fleet_size-1000000000
149441660rumpelstilzchenSimsalabimaido1_amod_fleet_size_r1-v3step2-scoringsuccessyes3720:00:19(hidden)
fleet_size-1000000000


other stats
efficiency-65.95883387856031
service_quality-33.06017846963999
149401662rumpelstilzchenSimsalabimaido1_amod_fleet_size_r1-v3step2-scoringsuccessyes3720:00:15(hidden)
fleet_size-1000000000


other stats
efficiency-71.32796059560592
service_quality-34.3279801489015
149281670rumpelstilzchenSimsalabimaido1_amod_fleet_size_r1-v3step1-simulationsuccessyes3720:03:38(hidden)
other stats
passedtrue
149261667lsieberPython template Test1aido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:18(hidden)
service_quality-34.708077660212105


other stats
efficiency-72.45695064084784
fleet_size-1000000000
149241668heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyes3720:01:34(hidden)
other stats
videos1
149201664rumpelstilzchenSimsalabimaido1_amod_efficiency_r1-v3step2-scoringsuccessyes3720:00:19(hidden)
efficiency-72.2975715577003


other stats
fleet_size-1000000000
service_quality-34.626242889425
149181664rumpelstilzchenSimsalabimaido1_amod_efficiency_r1-v3step1-simulationsuccessyes3720:03:45(hidden)
other stats
passedtrue
149141663rumpelstilzchenSimsalabimaido1_amod_efficiency_r1-v3step1-simulationsuccessyes3720:03:30(hidden)
other stats
passedtrue
149121662rumpelstilzchenSimsalabimaido1_amod_fleet_size_r1-v3step1-simulationsuccessyes3720:03:35(hidden)
other stats
passedtrue
149091657rumpelstilzchenSimsalabimaido1_amod_service_quality_r1-v3step1-simulationsuccessyes3720:03:45(hidden)
other stats
passedtrue
149001654yun chenPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessyes3720:04:56(hidden)
other stats
simulation-passed1
148901650Andreas Aumiller simple redispatcheraido1_amod_service_quality_r1-v3step1-simulationsuccessyes3720:04:18(hidden)
other stats
passedtrue
148871648hvrigazovVisteon perception teamaido1_LF1_r3-v3step3-videossuccessyes3720:01:27(hidden)
other stats
videos1
148851648hvrigazovVisteon perception teamaido1_LF1_r3-v3step1-simulationsuccessyes3720:04:12(hidden)
other stats
simulation-passed1
148711644WEIGAOFirst trialaido1_LF1_r3-v3step3-videossuccessyes3720:01:51(hidden)
other stats
videos1
148681639WEIGAOFirst trialaido1_LF1_r3-v3step4-vizsuccessyes3720:06:22(hidden)
driven_lanedir_median18.02792859911954
deviation-center-line_median0.6833498479689116
in-drivable-lane_median0.16666666666666785


other stats
deviation-center-line_max0.763672323305758
deviation-center-line_mean0.6671629074326019
deviation-center-line_min0.5332179186427433
deviation-heading_max1.8286242449297616
deviation-heading_mean1.686174786246422
deviation-heading_median1.6696623567681923
deviation-heading_min1.5658813597573862
driven_any_max18.604959018909557
driven_any_mean18.449272009119095
driven_any_median18.46511245314522
driven_any_min18.335908423608956
driven_lanedir_max18.116243564817182
driven_lanedir_mean17.938056587328344
driven_lanedir_min17.640962508702692
in-drivable-lane_max0.46666666666666606
in-drivable-lane_mean0.2666666666666669
in-drivable-lane_min0.13333333333333464
per-episodes
details{"ep000": {"driven_any": 18.335908423608956, "driven_lanedir": 17.640962508702692, "in-drivable-lane": 0.46666666666666606, "deviation-heading": 1.627516584629913, "deviation-center-line": 0.6054168225199797}, "ep001": {"driven_any": 18.364789132438275, "driven_lanedir": 18.02792859911954, "in-drivable-lane": 0.13333333333333464, "deviation-heading": 1.6696623567681923, "deviation-center-line": 0.5332179186427433}, "ep002": {"driven_any": 18.604959018909557, "driven_lanedir": 17.860613896574595, "in-drivable-lane": 0.3999999999999994, "deviation-heading": 1.8286242449297616, "deviation-center-line": 0.763672323305758}, "ep003": {"driven_any": 18.47559101749347, "driven_lanedir": 18.116243564817182, "in-drivable-lane": 0.16666666666666785, "deviation-heading": 1.5658813597573862, "deviation-center-line": 0.6833498479689116}, "ep004": {"driven_any": 18.46511245314522, "driven_lanedir": 18.04453436742771, "in-drivable-lane": 0.1666666666666662, "deviation-heading": 1.7391893851468565, "deviation-center-line": 0.7501576247256166}}
148631643WEIGAOFirst trialaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.9334924468696116, "good_angle": 0.3906483823857379, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.6333333333333322}, "ep001": {"nsteps": 500, "reward": 0.9633857913017272, "good_angle": 0.21549001670381857, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.2999999999999995}, "ep002": {"nsteps": 500, "reward": 0.9819535595700144, "good_angle": 0.4720039589385616, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.0333333333333314}, "ep003": {"nsteps": 500, "reward": 0.99284282964468, "good_angle": 0.3011480507992558, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.29999999999999893}, "ep004": {"nsteps": 500, "reward": 1.0140458444952964, "good_angle": 0.32350842253149137, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.5333333333333329}}
good_angle_max0.4720039589385616
good_angle_mean0.3405597662717731
good_angle_median0.32350842253149137
good_angle_min0.21549001670381857
reward_max1.0140458444952964
reward_mean0.977144094376266
reward_median0.9819535595700144
reward_min0.9334924468696116
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max1.0333333333333314
valid_direction_mean0.5599999999999989
valid_direction_median0.5333333333333329
valid_direction_min0.29999999999999893
148611643WEIGAOFirst trialaido1_LF1_r3-v3step1-simulationsuccessyes3720:07:01(hidden)
other stats
simulation-passed1
148551639WEIGAOFirst trialaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:21(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.9397015765607356, "good_angle": 0.4320778233628398, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.6999999999999988}, "ep001": {"nsteps": 500, "reward": 0.9412939656972884, "good_angle": 0.33516533551801925, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.433333333333332}, "ep002": {"nsteps": 500, "reward": 0.9889995897393674, "good_angle": 0.53669906385761, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.9999999999999992}, "ep003": {"nsteps": 500, "reward": 0.9927777369618416, "good_angle": 0.32505794056217135, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.4666666666666659}, "ep004": {"nsteps": 500, "reward": 1.000789312183857, "good_angle": 0.3885823383606332, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.7333333333333325}}
good_angle_max0.53669906385761
good_angle_mean0.4035165003322548
good_angle_median0.3885823383606332
good_angle_min0.32505794056217135
reward_max1.000789312183857
reward_mean0.972712436228618
reward_median0.9889995897393674
reward_min0.9397015765607356
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max0.9999999999999992
valid_direction_mean0.6666666666666657
valid_direction_median0.6999999999999988
valid_direction_min0.433333333333332
148431637WEIGAOFirst trialaido1_LF1_r3-v3step3-videossuccessyes3720:01:58(hidden)
other stats
videos1
148331636WEIGAOFirst trialaido1_LF1_r3-v3step1-simulationsuccessyes3720:07:25(hidden)
other stats
simulation-passed1
148261633WEIGAOFirst trialaido1_LF1_r3-v3step3-videossuccessyes3720:02:15(hidden)
other stats
videos1
148231632WEIGAOFirst trialaido1_LF1_r3-v3step3-videossuccessyes3720:01:48(hidden)
other stats
videos1
148061627trimcaoTensorflow templateaido1_LFV_r1-v3step1-simulationsuccessyes3720:02:21(hidden)
other stats
simulation-passed1
147991622alezananaive with time correctionaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:17(hidden)
service_quality-19.745990266229462


other stats
efficiency-32.32300106491542
fleet_size-1000000000
147951623JoelGaechtergreedy but not so lazyaido1_amod_fleet_size_r1-v3step1-simulationsuccessyes3720:03:23(hidden)
other stats
passedtrue
147941624alezananaive with time correctionaido1_amod_fleet_size_r1-v3step2-scoringsuccessyes3720:00:17(hidden)
fleet_size-1000000000


other stats
efficiency-32.32300106491542
service_quality-19.745990266229462
147851615JoelGaechtergreedy but not so lazyaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:17(hidden)
service_quality-20.77464398895128


other stats
efficiency-38.725975955804145
fleet_size-1000000000
147711606Dzenan LapandicPanos grayscale inv_kine manualaido1_LF1_r3-v3step4-vizsuccessyes3720:01:32(hidden)
driven_lanedir_median1.0577869091697232
deviation-center-line_median0.17768838035147677
in-drivable-lane_median0


other stats
deviation-center-line_max0.206046338359978
deviation-center-line_mean0.13728146693869508
deviation-center-line_min0
deviation-heading_max0.6313171845296605
deviation-heading_mean0.4917047154488351
deviation-heading_median0.60450289784329
deviation-heading_min0
driven_any_max1.3510165471864377
driven_any_mean1.134364526025199
driven_any_median1.1646670928368197
driven_any_min0.8152526537302318
driven_lanedir_max1.2869260099286406
driven_lanedir_mean0.8275165653403043
driven_lanedir_min0
in-drivable-lane_max3.4999999999999973
in-drivable-lane_mean0.7199999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.211161898755069, "driven_lanedir": 0, "in-drivable-lane": 3.4999999999999973, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.3510165471864377, "driven_lanedir": 1.2869260099286406, "in-drivable-lane": 0, "deviation-heading": 0.60450289784329, "deviation-center-line": 0.19563542486420768}, "ep002": {"driven_any": 0.8152526537302318, "driven_lanedir": 0.702136288998494, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 0.6204376776392341, "deviation-center-line": 0.10703719111781304}, "ep003": {"driven_any": 1.1297244376174385, "driven_lanedir": 1.0577869091697232, "in-drivable-lane": 0, "deviation-heading": 0.6022658172319909, "deviation-center-line": 0.17768838035147677}, "ep004": {"driven_any": 1.1646670928368197, "driven_lanedir": 1.090733618604664, "in-drivable-lane": 0, "deviation-heading": 0.6313171845296605, "deviation-center-line": 0.206046338359978}}
147691608Claudio RuchJava templateaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:14(hidden)
service_quality-35.39138077002181


other stats
efficiency-75.49264308008757
fleet_size-1000000000
147481599JoelGaechtergreedy but lazyaido1_amod_efficiency_r1-v3step2-scoringsuccessyes3720:00:17(hidden)
efficiency-34.95948912824103


other stats
fleet_size-1000000000
service_quality-21.01995228206084
147401600JoelGaechtergreedy but lazyaido1_amod_service_quality_r1-v3step1-simulationsuccessyes3720:04:38(hidden)
other stats
passedtrue
147321597WEIGAOFirst trialaido1_LF1_r3-v3step1-simulationfailedyes3720:05:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 80, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 52, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)
147241593JoelGaechtergreedy but lazyaido1_amod_service_quality_r1-v3step1-simulationsuccessyes3720:03:13(hidden)
other stats
passedtrue
147221595WEIGAOFirst trialaido1_LF1_r3-v3step1-simulationfailedyes3720:06:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 80, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 52, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)
147161589WEIGAOFirst trialaido1_LF1_r3-v3step1-simulationsuccessyes3720:02:02(hidden)
other stats
simulation-passed1
147031584yun chenPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:21(hidden)
survival_time_median2.533333333333334


other stats
episodes
details{"ep000": {"nsteps": 12, "reward": -85.07771186033885, "good_angle": 0.33701708276579606, "survival_time": 0.4, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}, "ep001": {"nsteps": 103, "reward": -9.84165864618658, "good_angle": 2.105086142298994, "survival_time": 3.433333333333331, "traveled_tiles": 1, "valid_direction": 2.0999999999999996}, "ep002": {"nsteps": 92, "reward": -10.49504119444274, "good_angle": 1.493561396559652, "survival_time": 3.0666666666666655, "traveled_tiles": 2, "valid_direction": 1.9666666666666672}, "ep003": {"nsteps": 76, "reward": -13.121241917049414, "good_angle": 2.0464520714316357, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 2.033333333333333}, "ep004": {"nsteps": 26, "reward": -39.167097843149136, "good_angle": 0.8151642447092997, "survival_time": 0.8666666666666666, "traveled_tiles": 2, "valid_direction": 0.7333333333333333}}
good_angle_max2.105086142298994
good_angle_mean1.3594561875530755
good_angle_median1.493561396559652
good_angle_min0.33701708276579606
reward_max-9.84165864618658
reward_mean-31.54055029223334
reward_median-13.121241917049414
reward_min-85.07771186033885
survival_time_max3.433333333333331
survival_time_mean2.0599999999999996
survival_time_min0.4
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.0999999999999996
valid_direction_mean1.4266666666666667
valid_direction_median1.9666666666666672
valid_direction_min0.29999999999999993
146981582WEIGAOFirst trialaido1_LF1_r3-v3step3-videossuccessyes3720:01:10(hidden)
other stats
videos1
146831577JoelGaechterreworkaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:18(hidden)
service_quality-30.489251895284983


other stats
efficiency-58.13296758113725
fleet_size-1000000000
146731575JoelGaechterrandomaido1_amod_service_quality_r1-v3step1-simulationsuccessyes3720:03:36(hidden)
other stats
passedtrue
146701570JoelGaechtertest submissionaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:14(hidden)
service_quality-32.918908339251274


other stats
efficiency-64.31227335700505
fleet_size-1000000000
146651571JoelGaechtertest submissionaido1_amod_service_quality_r1-v3step1-simulationsuccessyes3720:03:36(hidden)
other stats
passedtrue
146571564JoelGaechtertest submissionaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:20(hidden)
service_quality-32.221131657613924


other stats
efficiency-62.728806630453064
fleet_size-1000000000
146501558JoelGaechterrandomaido1_amod_service_quality_r1-v3step1-simulationfailedyes3720:04:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 13, in run
    aidoGuest.run()
  File "/project/src/AidoGuest.py", line 62, in run
    command = dispatchingLogic.of(status)
  File "/project/src/RandomDispatchingLogic.py", line 49, in of
    roboTaxi = random.choice(taxi for taxi in status[1]if taxi[0] not in self.matchedTax)
  File "/usr/lib/python2.7/random.py", line 275, in choice
    return seq[int(self.random() * len(seq))]  # raises IndexError if seq is empty
TypeError: object of type 'generator' has no len()


(hidden)
146401551hvrigazovTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes3720:01:49(hidden)
other stats
videos1
146271548WEIGAOFirst trialaido1_LF1_r3-v3step3-videossuccessyes3720:00:41(hidden)
other stats
videos1
146241543yangzm11Tensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3720:03:07(hidden)
driven_lanedir_median4.860168747083806
deviation-center-line_median0.5177261330238835
in-drivable-lane_median0.5000000000000007


other stats
deviation-center-line_max0.9871675545715244
deviation-center-line_mean0.5324138078256986
deviation-center-line_min0.17881747384937827
deviation-heading_max2.9948998980375268
deviation-heading_mean2.1226150535590556
deviation-heading_median2.1908094437128325
deviation-heading_min1.087158950713311
driven_any_max8.626687596743585
driven_any_mean5.398822816088453
driven_any_median5.7543979785933415
driven_any_min1.2714029240497298
driven_lanedir_max7.955102455468161
driven_lanedir_mean4.719230857114978
driven_lanedir_min1.1094450122785178
in-drivable-lane_max1.2333333333333318
in-drivable-lane_mean0.6266666666666663
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.803722363200518, "driven_lanedir": 4.860168747083806, "in-drivable-lane": 1.033333333333332, "deviation-heading": 2.1908094437128325, "deviation-center-line": 0.5177261330238835}, "ep001": {"driven_any": 5.537903217855085, "driven_lanedir": 4.575171984923749, "in-drivable-lane": 1.2333333333333318, "deviation-heading": 2.0604453764787127, "deviation-center-line": 0.4536673648475869}, "ep002": {"driven_any": 8.626687596743585, "driven_lanedir": 7.955102455468161, "in-drivable-lane": 0.366666666666666, "deviation-heading": 2.9948998980375268, "deviation-center-line": 0.9871675545715244}, "ep003": {"driven_any": 5.7543979785933415, "driven_lanedir": 5.096266085820653, "in-drivable-lane": 0.5000000000000007, "deviation-heading": 2.2797615988528945, "deviation-center-line": 0.5246905128361194}, "ep004": {"driven_any": 1.2714029240497298, "driven_lanedir": 1.1094450122785178, "in-drivable-lane": 0, "deviation-heading": 1.087158950713311, "deviation-center-line": 0.17881747384937827}}
146231543yangzm11Tensorflow templateaido1_LF1_r3-v3step3-videossuccessyes3720:01:06(hidden)
other stats
videos1
146211547WEIGAOFirst trialaido1_LF1_r3-v3step4-vizsuccessyes3720:01:08(hidden)
driven_lanedir_median1.1510404799853573
deviation-center-line_median0.07679119408473345
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.167049208755248
deviation-center-line_mean0.08677051892577205
deviation-center-line_min0.034671142437104306
deviation-heading_max0.5095788396876014
deviation-heading_mean0.34031169952527185
deviation-heading_median0.30126657138039
deviation-heading_min0.2543778990226073
driven_any_max3.749089015089843
driven_any_mean1.7104301764921304
driven_any_median1.323045145406072
driven_any_min0.7653576271531216
driven_lanedir_max3.2847557186698246
driven_lanedir_mean1.5268746041273111
driven_lanedir_min0.6489616769319332
in-drivable-lane_max0.3333333333333333
in-drivable-lane_mean0.09333333333333337
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 3.749089015089843, "driven_lanedir": 3.2847557186698246, "in-drivable-lane": 0.3333333333333333, "deviation-heading": 0.5095788396876014, "deviation-center-line": 0.167049208755248}, "ep001": {"driven_any": 1.323045145406072, "driven_lanedir": 1.1510404799853573, "in-drivable-lane": 0.06666666666666676, "deviation-heading": 0.34907319987801944, "deviation-center-line": 0.07679119408473345}, "ep002": {"driven_any": 0.7653576271531216, "driven_lanedir": 0.6489616769319332, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.2543778990226073, "deviation-center-line": 0.034671142437104306}, "ep003": {"driven_any": 1.12990341958994, "driven_lanedir": 1.0217378407100148, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.30126657138039, "deviation-center-line": 0.056813115608208765}, "ep004": {"driven_any": 1.5847556752216765, "driven_lanedir": 1.5278773043394254, "in-drivable-lane": 0, "deviation-heading": 0.28726198765774125, "deviation-center-line": 0.09852793374356568}}
146201547WEIGAOFirst trialaido1_LF1_r3-v3step3-videossuccessyes3720:00:46(hidden)
other stats
videos1
146181544yangzm11Tensorflow templateaido1_LFV_r1-v3step4-vizsuccessno3720:01:28(hidden)
deviation-center-line_median0.1173274248466202
in-drivable-lane_median0


other stats
deviation-center-line_max0.27512419180520054
deviation-center-line_mean0.14719628530105025
deviation-center-line_min0.05810943046691908
deviation-heading_max1.0978729863246326
deviation-heading_mean0.4707070659181244
deviation-heading_median0.3005432110452179
deviation-heading_min0.19251684699893273
driven_any_max4.101864127127411
driven_any_mean1.8682600847965416
driven_any_median1.021727453825659
driven_any_min0.541269536556498
driven_lanedir_max2.8225007413771737
driven_lanedir_mean1.3612176887275935
driven_lanedir_median1.0105125468396914
driven_lanedir_min0.5294400798154322
in-drivable-lane_max3.6999999999999966
in-drivable-lane_mean0.7733333333333328
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.101864127127411, "driven_lanedir": 1.8468137830540476, "in-drivable-lane": 3.6999999999999966, "deviation-heading": 0.529829712663762, "deviation-center-line": 0.19687665201932864}, "ep001": {"driven_any": 0.541269536556498, "driven_lanedir": 0.5294400798154322, "in-drivable-lane": 0, "deviation-heading": 0.19251684699893273, "deviation-center-line": 0.05810943046691908}, "ep002": {"driven_any": 3.059245574412067, "driven_lanedir": 2.8225007413771737, "in-drivable-lane": 0.16666666666666674, "deviation-heading": 1.0978729863246326, "deviation-center-line": 0.27512419180520054}, "ep003": {"driven_any": 1.021727453825659, "driven_lanedir": 1.0105125468396914, "in-drivable-lane": 0, "deviation-heading": 0.23277257255807632, "deviation-center-line": 0.1173274248466202}, "ep004": {"driven_any": 0.6171937320610735, "driven_lanedir": 0.5968212925516236, "in-drivable-lane": 0, "deviation-heading": 0.3005432110452179, "deviation-center-line": 0.08854372736718275}}
146081540JoelGaechtertests submissionaido1_amod_service_quality_r1-v3step1-simulationerroryes3720:30:38
Timeout: Waited 180 [...]
Timeout:

Waited 1803.76602411 for container to finish. Giving up. 
(hidden)
146061538JoelGaechtertests submissionaido1_amod_service_quality_r1-v3step1-simulationfailedyes3720:03:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 13, in run
    aidoGuest.run()
  File "/project/src/AidoGuest.py", line 62, in run
    command = dispatchingLogic.of(status)
  File "/project/src/DispatchingLogic.py", line 46, in of
    roboTaxis = list(RoboTaxi(taxi) for taxi in status[1])
  File "/project/src/DispatchingLogic.py", line 46, in <genexpr>
    roboTaxis = list(RoboTaxi(taxi) for taxi in status[1])
  File "/project/src/utils/Agents.py", line 33, in __init__
    assert isinstance(status, RoboTaxiStatus), "Expected <enum 'RoboTaxiStatus'>, got %s: %s!" % (type(status), status)
AssertionError: ("Expected <enum 'RoboTaxiStatus'>, got <enum 'RoboTaxiStatus'>: RoboTaxiStatus.STAY!", 60, [[0, [-122.43857069934029, 37.778729630241905], <RoboTaxiStatus.STAY: 'STAY'>, 1], [1, [-122.42937665049487, 37.79596103313535], <RoboTaxiStatus.STAY: 'STAY'>, 1], [2, [-122.47618194932636, 37.7804883802366], <RoboTaxiStatus.STAY: 'STAY'>, 1], [3, [-122.4659650984909, 37.7743386303191], <RoboTaxiStatus.STAY: 'STAY'>, 1], [4, [-122.4174777504897, 37.787145783105245], <RoboTaxiStatus.STAY: 'STAY'>, 1], [5, [-122.41289734874532, 37.78534058030454], <RoboTaxiStatus.STAY: 'STAY'>, 1], [6, [-122.40874359941864, 37.7863451304374], <RoboTaxiStatus.STAY: 'STAY'>, 1], [7, [-122.4513057498996, 37.76945798162273], <RoboTaxiStatus.STAY: 'STAY'>, 1], [8, [-122.43706384934049, 37.7712753802251], <RoboTaxiStatus.STAY: 'STAY'>, 1], [9, [-122.41495245048944, 37.799724733142774], <RoboTaxiStatus.STAY: 'STAY'>, 1], [10, [-122.43139735049496, 37.79761793314103], <RoboTaxiStatus.STAY: 'STAY'>, 1], [11, [-122.41093054874817, 37.79231018032074], <RoboTaxiStatus.STAY: 'STAY'>, 1], [12, [-122.4485011487488, 37.76933943026792], <RoboTaxiStatus.STAY: 'STAY'>, 1], [13, [-122.40875334941948, 37.79944083029075], <RoboTaxiStatus.STAY: 'STAY'>, 1], [14, [-122.41808429963909, 37.765155331632435], <RoboTaxiStatus.STAY: 'STAY'>, 1], [15, [-122.41408589872738, 37.80795653035676], <RoboTaxiStatus.STAY: 'STAY'>, 1], [16, [-122.43510109859267, 37.76165028026738], <RoboTaxiStatus.STAY: 'STAY'>, 1], [17, [-122.42177489933034, 37.79589888027082], <RoboTaxiStatus.STAY: 'STAY'>, 1], [18, [-122.40979464874539, 37.78668883030758], <RoboTaxiStatus.STAY: 'STAY'>, 1], [19, [-122.38845799963521, 37.616164929999044], <RoboTaxiStatus.STAY: 'STAY'>, 1]], [], [0.0, 0.0, 0])


(hidden)
146051537JoelGaechtertests submissionaido1_amod_service_quality_r1-v3step1-simulationfailedyes3720:03:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 13, in run
    aidoGuest.run()
  File "/project/src/AidoGuest.py", line 62, in run
    command = dispatchingLogic.of(status)
  File "/project/src/DispatchingLogic.py", line 46, in of
    roboTaxis = list(RoboTaxi(taxi) for taxi in status[1])
  File "/project/src/DispatchingLogic.py", line 46, in <genexpr>
    roboTaxis = list(RoboTaxi(taxi) for taxi in status[1])
  File "/project/src/utils/Agents.py", line 31, in __init__
    assert status in RoboTaxiStatus, "Expected <enum 'RoboTaxiStatus'>, got %s: %s!" % (type(status), status)
AssertionError: ("Expected <enum 'RoboTaxiStatus'>, got <enum 'RoboTaxiStatus'>: RoboTaxiStatus.STAY!", 60, [[0, [-122.43857069934029, 37.778729630241905], <RoboTaxiStatus.STAY: 'STAY'>, 1], [1, [-122.42937665049487, 37.79596103313535], <RoboTaxiStatus.STAY: 'STAY'>, 1], [2, [-122.47618194932636, 37.7804883802366], <RoboTaxiStatus.STAY: 'STAY'>, 1], [3, [-122.4659650984909, 37.7743386303191], <RoboTaxiStatus.STAY: 'STAY'>, 1], [4, [-122.4174777504897, 37.787145783105245], <RoboTaxiStatus.STAY: 'STAY'>, 1], [5, [-122.41289734874532, 37.78534058030454], <RoboTaxiStatus.STAY: 'STAY'>, 1], [6, [-122.40874359941864, 37.7863451304374], <RoboTaxiStatus.STAY: 'STAY'>, 1], [7, [-122.4513057498996, 37.76945798162273], <RoboTaxiStatus.STAY: 'STAY'>, 1], [8, [-122.43706384934049, 37.7712753802251], <RoboTaxiStatus.STAY: 'STAY'>, 1], [9, [-122.41495245048944, 37.799724733142774], <RoboTaxiStatus.STAY: 'STAY'>, 1], [10, [-122.43139735049496, 37.79761793314103], <RoboTaxiStatus.STAY: 'STAY'>, 1], [11, [-122.41093054874817, 37.79231018032074], <RoboTaxiStatus.STAY: 'STAY'>, 1], [12, [-122.4485011487488, 37.76933943026792], <RoboTaxiStatus.STAY: 'STAY'>, 1], [13, [-122.40875334941948, 37.79944083029075], <RoboTaxiStatus.STAY: 'STAY'>, 1], [14, [-122.41808429963909, 37.765155331632435], <RoboTaxiStatus.STAY: 'STAY'>, 1], [15, [-122.41408589872738, 37.80795653035676], <RoboTaxiStatus.STAY: 'STAY'>, 1], [16, [-122.43510109859267, 37.76165028026738], <RoboTaxiStatus.STAY: 'STAY'>, 1], [17, [-122.42177489933034, 37.79589888027082], <RoboTaxiStatus.STAY: 'STAY'>, 1], [18, [-122.40979464874539, 37.78668883030758], <RoboTaxiStatus.STAY: 'STAY'>, 1], [19, [-122.38845799963521, 37.616164929999044], <RoboTaxiStatus.STAY: 'STAY'>, 1]], [], [0.0, 0.0, 0])


(hidden)
146041536JoelGaechtertests submissionaido1_amod_service_quality_r1-v3step1-simulationfailedyes3720:02:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 13, in run
    aidoGuest.run()
  File "/project/src/AidoGuest.py", line 62, in run
    command = dispatchingLogic.of(status)
  File "/project/src/DispatchingLogic.py", line 46, in of
    roboTaxis = list(RoboTaxi(taxi) for taxi in status[1])
  File "/project/src/DispatchingLogic.py", line 46, in <genexpr>
    roboTaxis = list(RoboTaxi(taxi) for taxi in status[1])
  File "/project/src/utils/Agents.py", line 32, in __init__
    "Expected <type 'RoboTaxiStatus'>, got %s: %s!" % (type(status), status)
AssertionError: ("Expected <type 'RoboTaxiStatus'>, got <enum 'RoboTaxiStatus'>: RoboTaxiStatus.STAY!", 60, [[0, [-122.43857069934029, 37.778729630241905], <RoboTaxiStatus.STAY: 'STAY'>, 1], [1, [-122.42937665049487, 37.79596103313535], <RoboTaxiStatus.STAY: 'STAY'>, 1], [2, [-122.47618194932636, 37.7804883802366], <RoboTaxiStatus.STAY: 'STAY'>, 1], [3, [-122.4659650984909, 37.7743386303191], <RoboTaxiStatus.STAY: 'STAY'>, 1], [4, [-122.4174777504897, 37.787145783105245], <RoboTaxiStatus.STAY: 'STAY'>, 1], [5, [-122.41289734874532, 37.78534058030454], <RoboTaxiStatus.STAY: 'STAY'>, 1], [6, [-122.40874359941864, 37.7863451304374], <RoboTaxiStatus.STAY: 'STAY'>, 1], [7, [-122.4513057498996, 37.76945798162273], <RoboTaxiStatus.STAY: 'STAY'>, 1], [8, [-122.43706384934049, 37.7712753802251], <RoboTaxiStatus.STAY: 'STAY'>, 1], [9, [-122.41495245048944, 37.799724733142774], <RoboTaxiStatus.STAY: 'STAY'>, 1], [10, [-122.43139735049496, 37.79761793314103], <RoboTaxiStatus.STAY: 'STAY'>, 1], [11, [-122.41093054874817, 37.79231018032074], <RoboTaxiStatus.STAY: 'STAY'>, 1], [12, [-122.4485011487488, 37.76933943026792], <RoboTaxiStatus.STAY: 'STAY'>, 1], [13, [-122.40875334941948, 37.79944083029075], <RoboTaxiStatus.STAY: 'STAY'>, 1], [14, [-122.41808429963909, 37.765155331632435], <RoboTaxiStatus.STAY: 'STAY'>, 1], [15, [-122.41408589872738, 37.80795653035676], <RoboTaxiStatus.STAY: 'STAY'>, 1], [16, [-122.43510109859267, 37.76165028026738], <RoboTaxiStatus.STAY: 'STAY'>, 1], [17, [-122.42177489933034, 37.79589888027082], <RoboTaxiStatus.STAY: 'STAY'>, 1], [18, [-122.40979464874539, 37.78668883030758], <RoboTaxiStatus.STAY: 'STAY'>, 1], [19, [-122.38845799963521, 37.616164929999044], <RoboTaxiStatus.STAY: 'STAY'>, 1]], [], [0.0, 0.0, 0])


(hidden)
146031535JoelGaechtertests submissionaido1_amod_service_quality_r1-v3step1-simulationfailedyes3720:02:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 13, in run
    aidoGuest.run()
  File "/project/src/AidoGuest.py", line 62, in run
    command = dispatchingLogic.of(status)
  File "/project/src/DispatchingLogic.py", line 46, in of
    roboTaxis = list(RoboTaxi(taxi) for taxi in status[1])
  File "/project/src/DispatchingLogic.py", line 46, in <genexpr>
    roboTaxis = list(RoboTaxi(taxi) for taxi in status[1])
  File "/project/src/utils/Agents.py", line 31, in __init__
    "Expected <type 'bool'>, got %s: %s!" % (type(is_divertable), is_divertable)
AssertionError: ("Expected <type 'bool'>, got <type 'int'>: 1!", 60, [[0, [-122.43857069934029, 37.778729630241905], <RoboTaxiStatus.STAY: 'STAY'>, 1], [1, [-122.42937665049487, 37.79596103313535], <RoboTaxiStatus.STAY: 'STAY'>, 1], [2, [-122.47618194932636, 37.7804883802366], <RoboTaxiStatus.STAY: 'STAY'>, 1], [3, [-122.4659650984909, 37.7743386303191], <RoboTaxiStatus.STAY: 'STAY'>, 1], [4, [-122.4174777504897, 37.787145783105245], <RoboTaxiStatus.STAY: 'STAY'>, 1], [5, [-122.41289734874532, 37.78534058030454], <RoboTaxiStatus.STAY: 'STAY'>, 1], [6, [-122.40874359941864, 37.7863451304374], <RoboTaxiStatus.STAY: 'STAY'>, 1], [7, [-122.4513057498996, 37.76945798162273], <RoboTaxiStatus.STAY: 'STAY'>, 1], [8, [-122.43706384934049, 37.7712753802251], <RoboTaxiStatus.STAY: 'STAY'>, 1], [9, [-122.41495245048944, 37.799724733142774], <RoboTaxiStatus.STAY: 'STAY'>, 1], [10, [-122.43139735049496, 37.79761793314103], <RoboTaxiStatus.STAY: 'STAY'>, 1], [11, [-122.41093054874817, 37.79231018032074], <RoboTaxiStatus.STAY: 'STAY'>, 1], [12, [-122.4485011487488, 37.76933943026792], <RoboTaxiStatus.STAY: 'STAY'>, 1], [13, [-122.40875334941948, 37.79944083029075], <RoboTaxiStatus.STAY: 'STAY'>, 1], [14, [-122.41808429963909, 37.765155331632435], <RoboTaxiStatus.STAY: 'STAY'>, 1], [15, [-122.41408589872738, 37.80795653035676], <RoboTaxiStatus.STAY: 'STAY'>, 1], [16, [-122.43510109859267, 37.76165028026738], <RoboTaxiStatus.STAY: 'STAY'>, 1], [17, [-122.42177489933034, 37.79589888027082], <RoboTaxiStatus.STAY: 'STAY'>, 1], [18, [-122.40979464874539, 37.78668883030758], <RoboTaxiStatus.STAY: 'STAY'>, 1], [19, [-122.38845799963521, 37.616164929999044], <RoboTaxiStatus.STAY: 'STAY'>, 1]], [], [0.0, 0.0, 0])


(hidden)
145901527ngkelPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailedyes3720:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 105, in run
    solve(params, cis)
  File "solution.py", line 56, in solve
    model.load("model", "models")
  File "/workspace/model.py", line 299, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 719, in load_state_dict
    self.__class__.__name__, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for ActorCNN:
	Unexpected key(s) in state_dict: "lin3.weight", "lin3.bias". 
	size mismatch for lin1.bias: copying a param of torch.Size([512]) from checkpoint, where the shape is torch.Size([256]) in current model.
	size mismatch for lin1.weight: copying a param of torch.Size([512, 4032]) from checkpoint, where the shape is torch.Size([256, 4032]) in current model.
	size mismatch for lin2.bias: copying a param of torch.Size([2]) from checkpoint, where the shape is torch.Size([128]) in current model.
	size mismatch for lin2.weight: copying a param of torch.Size([2, 512]) from checkpoint, where the shape is torch.Size([128, 258]) in current model.


(hidden)
145861525trimcaoBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationsuccessyes3720:01:45(hidden)
other stats
simulation-passed1
145711520trimcaoTensorflow templateaido1_LFV_r1-v3step3-videossuccessyes3720:00:45(hidden)
other stats
videos1
145611515trimcaoTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3720:03:29(hidden)
driven_lanedir_median5.295794814756555
deviation-center-line_median0.5734429952590713
in-drivable-lane_median0.2999999999999994


other stats
deviation-center-line_max0.8827310413766501
deviation-center-line_mean0.5598188205239214
deviation-center-line_min0.20402435076080172
deviation-heading_max3.137654314582679
deviation-heading_mean2.280730885481763
deviation-heading_median2.407176857693123
deviation-heading_min1.130027798399824
driven_any_max9.101922075818896
driven_any_mean6.126381803994215
driven_any_median5.813179481679382
driven_any_min1.2705729293932662
driven_lanedir_max8.030993034453347
driven_lanedir_mean5.4181331915501945
driven_lanedir_min1.05041886652148
in-drivable-lane_max1.333333333333331
in-drivable-lane_mean0.5333333333333327
in-drivable-lane_min0.03333333333333344
per-episodes
details{"ep000": {"driven_any": 5.786731905950157, "driven_lanedir": 4.971497342668055, "in-drivable-lane": 0.733333333333333, "deviation-heading": 2.1539759626470447, "deviation-center-line": 0.5734429952590713}, "ep001": {"driven_any": 9.101922075818896, "driven_lanedir": 7.741961899351535, "in-drivable-lane": 1.333333333333331, "deviation-heading": 2.5748194940861437, "deviation-center-line": 0.6192612164524279}, "ep002": {"driven_any": 8.659502627129372, "driven_lanedir": 8.030993034453347, "in-drivable-lane": 0.2999999999999994, "deviation-heading": 3.137654314582679, "deviation-center-line": 0.8827310413766501}, "ep003": {"driven_any": 5.813179481679382, "driven_lanedir": 5.295794814756555, "in-drivable-lane": 0.2666666666666666, "deviation-heading": 2.407176857693123, "deviation-center-line": 0.5196344987706559}, "ep004": {"driven_any": 1.2705729293932662, "driven_lanedir": 1.05041886652148, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 1.130027798399824, "deviation-center-line": 0.20402435076080172}}
145561516trimcaoTensorflow templateaido1_LFV_r1-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 53, "reward": -19.02833392344556, "good_angle": 0.6263728848864989, "survival_time": 1.7666666666666688, "traveled_tiles": 2, "valid_direction": 0.9000000000000012}, "ep001": {"nsteps": 33, "reward": -29.89879388791142, "good_angle": 0.12539810145777774, "survival_time": 1.1, "traveled_tiles": 2, "valid_direction": 0.2333333333333335}, "ep002": {"nsteps": 116, "reward": -8.039052530673557, "good_angle": 0.30013056482574385, "survival_time": 3.8666666666666623, "traveled_tiles": 4, "valid_direction": 0.5999999999999986}, "ep003": {"nsteps": 58, "reward": -16.595153430701586, "good_angle": 0.21223806026265665, "survival_time": 1.933333333333336, "traveled_tiles": 3, "valid_direction": 0.40000000000000113}, "ep004": {"nsteps": 100, "reward": -9.62849192325026, "good_angle": 0.13480650014487716, "survival_time": 3.3333333333333313, "traveled_tiles": 4, "valid_direction": 0.13333333333333286}}
good_angle_max0.6263728848864989
good_angle_mean0.27978922231551084
good_angle_median0.21223806026265665
good_angle_min0.12539810145777774
reward_max-8.039052530673557
reward_mean-16.637965139196478
reward_median-16.595153430701586
reward_min-29.89879388791142
survival_time_max3.8666666666666623
survival_time_mean2.4
survival_time_min1.1
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max0.9000000000000012
valid_direction_mean0.4533333333333335
valid_direction_median0.40000000000000113
valid_direction_min0.13333333333333286
145451508trimcaoBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:19(hidden)
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 96, "reward": -11.320251888440302, "good_angle": 1.663768679929817, "survival_time": 3.1999999999999984, "traveled_tiles": 2, "valid_direction": 1.1666666666666623}, "ep001": {"nsteps": 57, "reward": -17.174051409881365, "good_angle": 0.013040696454772224, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 69, "reward": -14.10785008562, "good_angle": 0.4247445048917546, "survival_time": 2.3000000000000016, "traveled_tiles": 2, "valid_direction": 0.8333333333333337}, "ep003": {"nsteps": 72, "reward": -13.569253058897123, "good_angle": 0.04313472040718672, "survival_time": 2.4000000000000012, "traveled_tiles": 2, "valid_direction": 0.09999999999999964}, "ep004": {"nsteps": 101, "reward": -9.774076340489533, "good_angle": 0.4002757501415056, "survival_time": 3.3666666666666645, "traveled_tiles": 3, "valid_direction": 0.8666666666666636}}
good_angle_max1.663768679929817
good_angle_mean0.5089928703650072
good_angle_median0.4002757501415056
good_angle_min0.013040696454772224
reward_max-9.774076340489533
reward_mean-13.189096556665666
reward_median-13.569253058897123
reward_min-17.174051409881365
survival_time_max3.3666666666666645
survival_time_mean2.6333333333333337
survival_time_min1.9000000000000024
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max1.1666666666666623
valid_direction_mean0.5933333333333319
valid_direction_median0.8333333333333337
valid_direction_min0
145311499miksazJetBrains Researchaido1_LF1_r3-v3step3-videossuccessyes3720:02:39(hidden)
other stats
videos1
145221496miksazJetBrains Researchaido1_LF1_r3-v3step3-videossuccessyes3720:03:05(hidden)
other stats
videos1
145211496miksazJetBrains Researchaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:25(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.31629649897292256, "good_angle": 8.16272437863145, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 4.233333333333329}, "ep001": {"nsteps": 500, "reward": 0.4655268535763025, "good_angle": 7.8237118836288175, "survival_time": 16.666666666666654, "traveled_tiles": 14, "valid_direction": 3.933333333333332}, "ep002": {"nsteps": 500, "reward": 0.44413689414970575, "good_angle": 8.375449533744339, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.4000000000000075}, "ep003": {"nsteps": 500, "reward": 0.21005079813301564, "good_angle": 16.227807808511933, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 6.033333333333318}, "ep004": {"nsteps": 500, "reward": 0.18069299883628265, "good_angle": 15.79599304569553, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.999999999999986}}
good_angle_max16.227807808511933
good_angle_mean11.277137330042414
good_angle_median8.375449533744339
good_angle_min7.8237118836288175
reward_max0.4655268535763025
reward_mean0.3233408087336458
reward_median0.31629649897292256
reward_min0.18069299883628265
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max15
traveled_tiles_mean11.6
traveled_tiles_median13
traveled_tiles_min4
valid_direction_max6.033333333333318
valid_direction_mean4.719999999999994
valid_direction_median4.4000000000000075
valid_direction_min3.933333333333332
145191493yangzm11Random executionaido1_LFV_r1-v3step4-vizsuccessno3720:01:16(hidden)
deviation-center-line_median0.14318915359547124
in-drivable-lane_median0.10000000000000032


other stats
deviation-center-line_max0.2223532089100578
deviation-center-line_mean0.12188183248499149
deviation-center-line_min0
deviation-heading_max1.1494699104398598
deviation-heading_mean0.3408378391750328
deviation-heading_median0.150085450631444
deviation-heading_min0
driven_any_max1.7667995061219035
driven_any_mean0.9029475311446206
driven_any_median0.802504996724982
driven_any_min0.3656073461566603
driven_lanedir_max1.4564119994483526
driven_lanedir_mean0.6669304410262482
driven_lanedir_median0.7511063788168765
driven_lanedir_min0
in-drivable-lane_max2.0000000000000027
in-drivable-lane_mean0.47333333333333377
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8138210963524279, "driven_lanedir": 0, "in-drivable-lane": 2.0000000000000027, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.766004710367129, "driven_lanedir": 0.7631240097629894, "in-drivable-lane": 0, "deviation-heading": 0.150085450631444, "deviation-center-line": 0.14318915359547124}, "ep002": {"driven_any": 0.802504996724982, "driven_lanedir": 0.7511063788168765, "in-drivable-lane": 0.10000000000000032, "deviation-heading": 0.32214575005383617, "deviation-center-line": 0.1528878858979478}, "ep003": {"driven_any": 1.7667995061219035, "driven_lanedir": 1.4564119994483526, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.1494699104398598, "deviation-center-line": 0.2223532089100578}, "ep004": {"driven_any": 0.3656073461566603, "driven_lanedir": 0.36400981710302216, "in-drivable-lane": 0, "deviation-heading": 0.08248808475002406, "deviation-center-line": 0.09097891402148044}}
145161495yangzm11Tensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median9.266666666666644


other stats
episodes
details{"ep000": {"nsteps": 255, "reward": -3.2289562618076872, "good_angle": 1.1346931930881636, "survival_time": 8.49999999999998, "traveled_tiles": 11, "valid_direction": 1.933333333333329}, "ep001": {"nsteps": 385, "reward": -1.9227435327679303, "good_angle": 0.9429759282318948, "survival_time": 12.833333333333298, "traveled_tiles": 15, "valid_direction": 1.6999999999999953}, "ep002": {"nsteps": 411, "reward": -1.807526985767984, "good_angle": 0.7247250775367927, "survival_time": 13.699999999999962, "traveled_tiles": 14, "valid_direction": 1.166666666666664}, "ep003": {"nsteps": 278, "reward": -2.957609235784776, "good_angle": 0.7534854144834433, "survival_time": 9.266666666666644, "traveled_tiles": 9, "valid_direction": 0.9999999999999972}, "ep004": {"nsteps": 70, "reward": -13.692152492489134, "good_angle": 0.5108653120693448, "survival_time": 2.333333333333335, "traveled_tiles": 3, "valid_direction": 0.4666666666666657}}
good_angle_max1.1346931930881636
good_angle_mean0.8133489850819279
good_angle_median0.7534854144834433
good_angle_min0.5108653120693448
reward_max-1.807526985767984
reward_mean-4.721797701723502
reward_median-2.957609235784776
reward_min-13.692152492489134
survival_time_max13.699999999999962
survival_time_mean9.326666666666643
survival_time_min2.333333333333335
traveled_tiles_max15
traveled_tiles_mean10.4
traveled_tiles_median11
traveled_tiles_min3
valid_direction_max1.933333333333329
valid_direction_mean1.2533333333333303
valid_direction_median1.166666666666664
valid_direction_min0.4666666666666657
145141495yangzm11Tensorflow templateaido1_LF1_r3-v3step1-simulationsuccessyes3720:02:34(hidden)
other stats
simulation-passed1
145131494miksazJetBrains Researchaido1_LF1_r3-v3step3-videossuccessyes3720:01:57(hidden)
other stats
videos1
145011490yangzm11Random executionaido1_LF1_r3-v3step3-videossuccessyes3720:00:45(hidden)
other stats
videos1
144821482shandonguniversityInspurInspur CNNaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median9.266666666666644


other stats
episodes
details{"ep000": {"nsteps": 255, "reward": -3.2289562618076872, "good_angle": 1.1346931930881636, "survival_time": 8.49999999999998, "traveled_tiles": 11, "valid_direction": 1.933333333333329}, "ep001": {"nsteps": 385, "reward": -1.9227435327679303, "good_angle": 0.9429759282318948, "survival_time": 12.833333333333298, "traveled_tiles": 15, "valid_direction": 1.6999999999999953}, "ep002": {"nsteps": 411, "reward": -1.807526985767984, "good_angle": 0.7247250775367927, "survival_time": 13.699999999999962, "traveled_tiles": 14, "valid_direction": 1.166666666666664}, "ep003": {"nsteps": 278, "reward": -2.957609235784776, "good_angle": 0.7534854144834433, "survival_time": 9.266666666666644, "traveled_tiles": 9, "valid_direction": 0.9999999999999972}, "ep004": {"nsteps": 70, "reward": -13.692152492489134, "good_angle": 0.5108653120693448, "survival_time": 2.333333333333335, "traveled_tiles": 3, "valid_direction": 0.4666666666666657}}
good_angle_max1.1346931930881636
good_angle_mean0.8133489850819279
good_angle_median0.7534854144834433
good_angle_min0.5108653120693448
reward_max-1.807526985767984
reward_mean-4.721797701723502
reward_median-2.957609235784776
reward_min-13.692152492489134
survival_time_max13.699999999999962
survival_time_mean9.326666666666643
survival_time_min2.333333333333335
traveled_tiles_max15
traveled_tiles_mean10.4
traveled_tiles_median11
traveled_tiles_min3
valid_direction_max1.933333333333329
valid_direction_mean1.2533333333333303
valid_direction_median1.166666666666664
valid_direction_min0.4666666666666657
144771481shandonguniversityInspurNvidia CNNaido1_LF1_r3-v3step1-simulationsuccessyes3720:02:00(hidden)
other stats
simulation-passed1
144521465karlji1021PyTorch Rainbow by KarlJiaido1_LF1_r3-v3step1-simulationfailedyes3720:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 259, in run
    solve(params, cis)
  File "solution.py", line 202, in solve
    Variable(storage.current_obs())
  File "/workspace/model_obs_correction.py", line 114, in act
    dist = self.forward(observations)
  File "/workspace/model_obs_correction.py", line 45, in forward
    x = self.conv1(observations).cuda()
RuntimeError: cuda runtime error (35) : CUDA driver version is insufficient for CUDA runtime version at /tmp/pip-req-build-vRRdPa/aten/src/THC/THCGeneral.cpp:74


(hidden)
144231438rumpelstilzchenMein erster Zauberspruchaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:19(hidden)
service_quality-34.3478370756685


other stats
efficiency-71.77978830267541
fleet_size-1000000000
144221439karlji1021PyTorch Rainbow by KarlJiaido1_LF1_r3-v3step1-simulationfailedyes3720:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 236, in run
    solve(params, cis)
  File "solution.py", line 114, in solve
    obs_shape = env.observation_space.shape
AttributeError: 'function' object has no attribute 'observation_space'


(hidden)
144111428rumpelstilzchenMein erster Zauberspruchaido1_amod_fleet_size_r1-v3step1-simulationerroryes3720:30:43
Timeout: Waited 180 [...]
Timeout:

Waited 1800.80208302 for container to finish. Giving up. 
(hidden)
144101427karlji1021PyTorch Rainbow by KarlJiaido1_LF1_r3-v3step1-simulationerroryes3720:00:36
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
(hidden)
143931410GWLeePyTorch DDPG algorithm by Giwoong Leeaido1_LF1_r3-v3step1-simulationfailedyes3720:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 148, in run
    solve(params, cis)
  File "solution.py", line 79, in solve
    actor = torch.load(os.path.join(args.load_dir, args.env_name + "_actor.pt"))
NameError: global name 'os' is not defined


(hidden)
143831400GWLeePyTorch DDPG algorithm by Giwoong Leeaido1_LF1_r3-v3step1-simulationerroryes3720:00:33
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
(hidden)
143761396karlji1021Solution templateaido1_luck-v3step1successyes3720:00:46(hidden)
score167.00735456084976


143701394tongqiusuiNvidia CNNaido1_LF1_r3-v3step4-vizsuccessyes3720:02:07(hidden)
driven_lanedir_median-0.02224635332038316
deviation-center-line_median0.005519627355163419
in-drivable-lane_median1.9666666666666688


other stats
deviation-center-line_max1.1549148130237308
deviation-center-line_mean0.3030731343684491
deviation-center-line_min0.0016557031709663343
deviation-heading_max2.463178719184934
deviation-heading_mean0.9492344435328436
deviation-heading_median0.08970785290292499
deviation-heading_min0.07838763421317246
driven_any_max7.685708752927946
driven_any_mean3.229157116789841
driven_any_median1.1712334450306658
driven_any_min0.9902330309498452
driven_lanedir_max0.8901639185850052
driven_lanedir_mean0.21578944966750377
driven_lanedir_min-0.02720112841212208
in-drivable-lane_max7.166666666666651
in-drivable-lane_mean3.879999999999995
in-drivable-lane_min1.7333333333333356
per-episodes
details{"ep000": {"driven_any": 7.685708752927946, "driven_lanedir": 0.8901639185850052, "in-drivable-lane": 6.733333333333318, "deviation-heading": 2.463178719184934, "deviation-center-line": 1.1549148130237308}, "ep001": {"driven_any": 5.206121927765607, "driven_lanedir": 0.26349148662626787, "in-drivable-lane": 7.166666666666651, "deviation-heading": 2.0319891231479708, "deviation-center-line": 0.3506737549627578}, "ep002": {"driven_any": 1.1712334450306658, "driven_lanedir": -0.02720112841212208, "in-drivable-lane": 1.9666666666666688, "deviation-heading": 0.07838763421317246, "deviation-center-line": 0.0016557031709663343}, "ep003": {"driven_any": 1.0924884272751414, "driven_lanedir": -0.02224635332038316, "in-drivable-lane": 1.8000000000000025, "deviation-heading": 0.08970785290292499, "deviation-center-line": 0.0026017733296273293}, "ep004": {"driven_any": 0.9902330309498452, "driven_lanedir": -0.02526067514124919, "in-drivable-lane": 1.7333333333333356, "deviation-heading": 0.08290888821521611, "deviation-center-line": 0.005519627355163419}}
143671394tongqiusuiNvidia CNNaido1_LF1_r3-v3step1-simulationsuccessyes3720:02:11(hidden)
other stats
simulation-passed1
143601390miksazJetBrains Researchaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:28(hidden)
other stats
simulation-passed1
143531387miksazJetBrains Researchaido1_LF1_r3-v3step3-videossuccessyes3720:02:35(hidden)
other stats
videos1
143451384miksazJetBrains Researchaido1_LF1_r3-v3step4-vizsuccessyes3720:03:14(hidden)
driven_lanedir_median6.379347601295406
deviation-center-line_median0.42263536803548185
in-drivable-lane_median0.7999999999999972


other stats
deviation-center-line_max1.19259001842833
deviation-center-line_mean0.5806418964904518
deviation-center-line_min0.2969254264878926
deviation-heading_max2.704706683619285
deviation-heading_mean1.7059590008303982
deviation-heading_median1.4960547659131316
deviation-heading_min1.2440475129915256
driven_any_max18.713122883980237
driven_any_mean9.273121990593252
driven_any_median7.397186358952506
driven_any_min4.327768255117015
driven_lanedir_max17.477056794209883
driven_lanedir_mean7.905474333417229
driven_lanedir_min2.777591872416381
in-drivable-lane_max2.0333333333333283
in-drivable-lane_mean1.159999999999997
in-drivable-lane_min0.6666666666666654
per-episodes
details{"ep000": {"driven_any": 10.041312433456191, "driven_lanedir": 9.21613529190578, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 1.2440475129915256, "deviation-center-line": 0.6456298831154704}, "ep001": {"driven_any": 18.713122883980237, "driven_lanedir": 17.477056794209883, "in-drivable-lane": 0.6666666666666654, "deviation-heading": 2.704706683619285, "deviation-center-line": 1.19259001842833}, "ep002": {"driven_any": 7.397186358952506, "driven_lanedir": 6.379347601295406, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 1.4960547659131316, "deviation-center-line": 0.42263536803548185}, "ep003": {"driven_any": 5.886220021460311, "driven_lanedir": 3.677240107258695, "in-drivable-lane": 2.0333333333333283, "deviation-heading": 1.7130893063714954, "deviation-center-line": 0.34542878638508406}, "ep004": {"driven_any": 4.327768255117015, "driven_lanedir": 2.777591872416381, "in-drivable-lane": 1.53333333333333, "deviation-heading": 1.371896735256554, "deviation-center-line": 0.2969254264878926}}
143421384miksazJetBrains Researchaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:22(hidden)
other stats
simulation-passed1
143321380trimcaoBaseline solution using imitation learning from logsaido1_LF1_r3-v3step4-vizsuccessyes3720:01:25(hidden)
driven_lanedir_median0.7902967580872575
deviation-center-line_median0.19855585839492065
in-drivable-lane_median0


other stats
deviation-center-line_max0.2894693682847009
deviation-center-line_mean0.15662945027414327
deviation-center-line_min0.017126509775143482
deviation-heading_max0.5524766956621882
deviation-heading_mean0.3885387052482191
deviation-heading_median0.4545862124444802
deviation-heading_min0.15024982730046463
driven_any_max1.1530398301873184
driven_any_mean0.9876543184613752
driven_any_median1.094805494525663
driven_any_min0.7803400864958255
driven_lanedir_max1.114816521640618
driven_lanedir_mean0.7400974201666952
driven_lanedir_min0.005167253139660488
in-drivable-lane_max2.8666666666666663
in-drivable-lane_mean0.5999999999999999
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.094805494525663, "driven_lanedir": 0.005167253139660488, "in-drivable-lane": 2.8666666666666663, "deviation-heading": 0.4545862124444802, "deviation-center-line": 0.017126509775143482}, "ep001": {"driven_any": 0.7919869532359105, "driven_lanedir": 0.7902967580872575, "in-drivable-lane": 0, "deviation-heading": 0.15024982730046463, "deviation-center-line": 0.19855585839492065}, "ep002": {"driven_any": 0.7803400864958255, "driven_lanedir": 0.7283335369512874, "in-drivable-lane": 0, "deviation-heading": 0.5524766956621882, "deviation-center-line": 0.0703275729310235}, "ep003": {"driven_any": 1.1180992278621589, "driven_lanedir": 1.0618730310146525, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 0.3238835287080274, "deviation-center-line": 0.2894693682847009}, "ep004": {"driven_any": 1.1530398301873184, "driven_lanedir": 1.114816521640618, "in-drivable-lane": 0, "deviation-heading": 0.4614972621259349, "deviation-center-line": 0.20766794198492777}}
143301380trimcaoBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median3.1999999999999984


other stats
episodes
details{"ep000": {"nsteps": 96, "reward": -11.374895004866024, "good_angle": 1.723868079320345, "survival_time": 3.1999999999999984, "traveled_tiles": 2, "valid_direction": 1.1666666666666623}, "ep001": {"nsteps": 70, "reward": -13.925106139906816, "good_angle": 0.009851331462042591, "survival_time": 2.333333333333335, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 69, "reward": -14.058915856091872, "good_angle": 0.405991056207364, "survival_time": 2.3000000000000016, "traveled_tiles": 2, "valid_direction": 0.8333333333333337}, "ep003": {"nsteps": 98, "reward": -10.200652107349311, "good_angle": 0.3887921949287717, "survival_time": 3.266666666666665, "traveled_tiles": 2, "valid_direction": 0.8999999999999968}, "ep004": {"nsteps": 101, "reward": -9.66695157296513, "good_angle": 0.3784228726311371, "survival_time": 3.3666666666666645, "traveled_tiles": 3, "valid_direction": 0.8333333333333304}}
good_angle_max1.723868079320345
good_angle_mean0.5813851069099321
good_angle_median0.3887921949287717
good_angle_min0.009851331462042591
reward_max-9.66695157296513
reward_mean-11.84530413623583
reward_median-11.374895004866024
reward_min-14.058915856091872
survival_time_max3.3666666666666645
survival_time_mean2.893333333333333
survival_time_min2.3000000000000016
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max1.1666666666666623
valid_direction_mean0.7466666666666647
valid_direction_median0.8333333333333337
valid_direction_min0
143091374mpicquetTest runaido1_amod_efficiency_r1-v3step1-simulationerroryes3720:30:41
Timeout: Waited 180 [...]
Timeout:

Waited 1800.631639 for container to finish. Giving up. 
(hidden)
143081372heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessyes3720:04:51(hidden)
other stats
simulation-passed1
142801350dcharrezPyTorch Sagemaker templateaido1_LF1_r3-v3step1-simulationfailedyes3720:00:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 106, in run
    solve(params, cis)
  File "solution.py", line 56, in solve
    model.load("model", "models", for_inference=True)
  File "/workspace/model.py", line 229, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 356, in load
    f = open(f, 'rb')
IOError: [Errno 2] No such file or directory: 'models/model_actor.pth'


(hidden)
142791349alezananaiveaido1_amod_efficiency_r1-v3step2-scoringsuccessyes3720:00:15(hidden)
efficiency-32.303662281422895


other stats
fleet_size-1000000000
service_quality-19.72386557035632
142761349alezananaiveaido1_amod_efficiency_r1-v3step1-simulationsuccessyes3720:02:58(hidden)
other stats
passedtrue
142731346Andreas Aumiller test_runaido1_amod_fleet_size_r1-v3step2-scoringsuccessyes3720:00:16(hidden)
fleet_size-1000000000


other stats
efficiency-35.055102183616974
service_quality-20.936885545904772
142711345Andreas Aumiller test_runaido1_amod_efficiency_r1-v3step2-scoringsuccessyes3720:00:17(hidden)
efficiency-35.055102183616974


other stats
fleet_size-1000000000
service_quality-20.936885545904772
142601336alezanatest python3aido1_amod_service_quality_r1-v3step2-scoringsuccessyes3720:00:18(hidden)
service_quality-32.671462419864596


other stats
efficiency-63.754929679455465
fleet_size-1000000000
142571337alezanatest python3aido1_amod_fleet_size_r1-v3step1-simulationsuccessyes3720:02:54(hidden)
other stats
passedtrue
14239767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step4-vizsuccessyes3720:01:25(hidden)
driven_lanedir_median0.5533877691159188
deviation-center-line_median0.12195015270098004
in-drivable-lane_median0.1


other stats
deviation-center-line_max0.3952009770202863
deviation-center-line_mean0.20558993323871327
deviation-center-line_min0.012087615152603554
deviation-heading_max1.4853694799393096
deviation-heading_mean0.7155492938914458
deviation-heading_median0.6235264555364126
deviation-heading_min0.18869816594760372
driven_any_max1.9925165029075664
driven_any_mean0.9637978834501147
driven_any_median0.8133661708515834
driven_any_min0.0854093673345604
driven_lanedir_max1.9204883512752304
driven_lanedir_mean0.8478993535618787
driven_lanedir_min0.029142320680923817
in-drivable-lane_max0.6666666666666662
in-drivable-lane_mean0.18666666666666645
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8133661708515834, "driven_lanedir": 0.5533877691159188, "in-drivable-lane": 0.6666666666666662, "deviation-heading": 0.6235264555364126, "deviation-center-line": 0.12195015270098004}, "ep001": {"driven_any": 0.0854093673345604, "driven_lanedir": 0.029142320680923817, "in-drivable-lane": 0.1, "deviation-heading": 0.18869816594760372, "deviation-center-line": 0.012087615152603554}, "ep002": {"driven_any": 0.4282325999174936, "driven_lanedir": 0.40894070968264873, "in-drivable-lane": 0, "deviation-heading": 0.26439147748685654, "deviation-center-line": 0.11163523996455237}, "ep003": {"driven_any": 1.4994647762393696, "driven_lanedir": 1.327537617054672, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.4853694799393096, "deviation-center-line": 0.387075681355144}, "ep004": {"driven_any": 1.9925165029075664, "driven_lanedir": 1.9204883512752304, "in-drivable-lane": 0, "deviation-heading": 1.015760890547047, "deviation-center-line": 0.3952009770202863}}
14236767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step3-videossuccessyes3720:00:54(hidden)
other stats
videos1
14235149Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationerroryes3720:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job14235-1314', 'pull']:

   >  Command '['docker-compose', '-p', 'job14235-1314', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling solution  ... error

Pulling evaluator ... done

stderr | ERROR: for solution  manifest for julian121266/aido1_lf1_r3-v3-submission:2018_10_18_13_49_00 not found
stderr | manifest for julian121266/aido1_lf1_r3-v3-submission:2018_10_18_13_49_00 not found
stderr | 
(hidden)
14222767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:10(hidden)
other stats
simulation-passed1
14206765Andrea CensiRandom executionaido1_LF1_r3-v3step1-simulationsuccessyes3720:03:08(hidden)
other stats
simulation-passed1
14199764miksazRL solutionaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:24(hidden)
other stats
simulation-passed1
141941019sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedyes3720:00:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 286, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
ModuleNotFoundError: No module named 'duckietown_rl'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 286, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
ModuleNotFoundError: No module named 'duckietown_rl'


(hidden)
14185761Maxim KuzminROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:01:16(hidden)
other stats
videos1
14184761Maxim KuzminROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median1.6666666666666683


other stats
episodes
details{"ep000": {"nsteps": 498, "reward": -2.015725792229716, "good_angle": 1.870275228883281, "survival_time": 16.599999999999984, "traveled_tiles": 11, "valid_direction": 2.933333333333345}, "ep001": {"nsteps": 28, "reward": -35.39912098659469, "good_angle": 0.13240599425578498, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.19999999999999996}, "ep002": {"nsteps": 12, "reward": -83.34284892957658, "good_angle": 0.3413472840535252, "survival_time": 0.4, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}, "ep003": {"nsteps": 50, "reward": -19.702872732579703, "good_angle": 0.024895455254073304, "survival_time": 1.6666666666666683, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 140, "reward": -6.934026241076312, "good_angle": 1.7681436546878246, "survival_time": 4.66666666666666, "traveled_tiles": 5, "valid_direction": 2.133333333333327}}
good_angle_max1.870275228883281
good_angle_mean0.8274135234268979
good_angle_median0.3413472840535252
good_angle_min0.024895455254073304
reward_max-2.015725792229716
reward_mean-29.4789189364114
reward_median-19.702872732579703
reward_min-83.34284892957658
survival_time_max16.599999999999984
survival_time_mean4.853333333333329
survival_time_min0.4
traveled_tiles_max11
traveled_tiles_mean4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.933333333333345
valid_direction_mean1.1133333333333344
valid_direction_median0.29999999999999993
valid_direction_min0
14179506JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3720:00:56(hidden)
other stats
videos1
14176504JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median4.933333333333326


other stats
episodes
details{"ep000": {"nsteps": 47, "reward": -23.611418689819093, "good_angle": 1.9694038535614355, "survival_time": 1.5666666666666682, "traveled_tiles": 1, "valid_direction": 1.0000000000000016}, "ep001": {"nsteps": 131, "reward": -10.298114453563253, "good_angle": 5.0013595331785625, "survival_time": 4.366666666666661, "traveled_tiles": 1, "valid_direction": 4.199999999999994}, "ep002": {"nsteps": 148, "reward": -9.150817831021708, "good_angle": 5.936366314031501, "survival_time": 4.933333333333326, "traveled_tiles": 1, "valid_direction": 4.766666666666659}, "ep003": {"nsteps": 203, "reward": -7.411566213048591, "good_angle": 6.910941571655856, "survival_time": 6.766666666666652, "traveled_tiles": 2, "valid_direction": 6.599999999999985}, "ep004": {"nsteps": 171, "reward": -8.464119353838134, "good_angle": 4.957889232124596, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 5.566666666666656}}
good_angle_max6.910941571655856
good_angle_mean4.95519210091039
good_angle_median5.0013595331785625
good_angle_min1.9694038535614355
reward_max-7.411566213048591
reward_mean-11.787207308258155
reward_median-9.150817831021708
reward_min-23.611418689819093
survival_time_max6.766666666666652
survival_time_mean4.666666666666659
survival_time_min1.5666666666666682
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max6.599999999999985
valid_direction_mean4.42666666666666
valid_direction_median4.766666666666659
valid_direction_min1.0000000000000016
14159504JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessyes3720:04:47(hidden)
other stats
simulation-passed1
141451268gunshiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3720:04:38(hidden)
driven_lanedir_median2.77731591350373
deviation-center-line_median1.537759376552911
in-drivable-lane_median7.63333333333333


other stats
deviation-center-line_max2.187405573417125
deviation-center-line_mean1.4866601072050518
deviation-center-line_min0.8211243497210218
deviation-heading_max1.5549489905479466
deviation-heading_mean1.0025397268923266
deviation-heading_median1.0369515564281513
deviation-heading_min0.5047233584359054
driven_any_max5.335534701662079
driven_any_mean5.335211338217434
driven_any_median5.335349916860965
driven_any_min5.334697868532992
driven_lanedir_max3.8887343309829343
driven_lanedir_mean2.67010945516127
driven_lanedir_min1.276168482435512
in-drivable-lane_max12.533333333333298
in-drivable-lane_mean8.019999999999982
in-drivable-lane_min4.199999999999989
per-episodes
details{"ep000": {"driven_any": 5.334697868532992, "driven_lanedir": 1.276168482435512, "in-drivable-lane": 12.533333333333298, "deviation-heading": 0.5047233584359054, "deviation-center-line": 0.8211243497210218}, "ep001": {"driven_any": 5.335534701662079, "driven_lanedir": 3.8887343309829343, "in-drivable-lane": 4.199999999999989, "deviation-heading": 1.1362557322623894, "deviation-center-line": 2.187405573417125}, "ep002": {"driven_any": 5.3354471174857885, "driven_lanedir": 3.0317236399367906, "in-drivable-lane": 6.93333333333331, "deviation-heading": 0.7798189967872402, "deviation-center-line": 1.8743660550687131}, "ep003": {"driven_any": 5.335349916860965, "driven_lanedir": 2.77731591350373, "in-drivable-lane": 7.63333333333333, "deviation-heading": 1.0369515564281513, "deviation-center-line": 1.537759376552911}, "ep004": {"driven_any": 5.335027086545347, "driven_lanedir": 2.376604908947384, "in-drivable-lane": 8.799999999999983, "deviation-heading": 1.5549489905479466, "deviation-center-line": 1.0126451812654875}}
141351269heyt0nyTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes3720:01:13(hidden)
other stats
videos1
14125758miksazRL solutionaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:07(hidden)
other stats
simulation-passed1
141191013DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median1.4333333333333345


other stats
episodes
details{"ep000": {"nsteps": 40, "reward": -24.598873620852828, "good_angle": 0.2343483096750326, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0.6666666666666675}, "ep001": {"nsteps": 43, "reward": -22.897017329974577, "good_angle": 0.07873288847953958, "survival_time": 1.4333333333333345, "traveled_tiles": 3, "valid_direction": 0.06666666666666687}, "ep002": {"nsteps": 118, "reward": -8.032572047563933, "good_angle": 0.0646340224694327, "survival_time": 3.933333333333329, "traveled_tiles": 7, "valid_direction": 0.09999999999999964}, "ep003": {"nsteps": 106, "reward": -8.930403779965896, "good_angle": 0.07747041121920123, "survival_time": 3.5333333333333306, "traveled_tiles": 6, "valid_direction": 0.09999999999999964}, "ep004": {"nsteps": 39, "reward": -25.11623662731682, "good_angle": 0.4933183949248292, "survival_time": 1.3000000000000007, "traveled_tiles": 2, "valid_direction": 0.2333333333333341}}
good_angle_max0.4933183949248292
good_angle_mean0.18970080535360703
good_angle_median0.07873288847953958
good_angle_min0.0646340224694327
reward_max-8.032572047563933
reward_mean-17.915020681134813
reward_median-22.897017329974577
reward_min-25.11623662731682
survival_time_max3.933333333333329
survival_time_mean2.3066666666666658
survival_time_min1.3000000000000007
traveled_tiles_max7
traveled_tiles_mean4
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max0.6666666666666675
valid_direction_mean0.23333333333333356
valid_direction_median0.09999999999999964
valid_direction_min0.06666666666666687
141121012DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3720:00:56(hidden)
other stats
videos1
141001012DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessyes3720:04:28(hidden)
other stats
simulation-passed1
14092498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes3720:00:51(hidden)
driven_lanedir_median0.16591466119060105
deviation-center-line_median0.04563514860321881
in-drivable-lane_median0


other stats
deviation-center-line_max0.052457565484118215
deviation-center-line_mean0.04733024823121577
deviation-center-line_min0.04259575220107422
deviation-heading_max0.6019238797324175
deviation-heading_mean0.2684850161128224
deviation-heading_median0.19369349156262652
deviation-heading_min0.14734990381917845
driven_any_max0.5030991544385488
driven_any_mean0.25713956782414804
driven_any_median0.18167469465836633
driven_any_min0.18167469465836497
driven_lanedir_max0.21629449537176135
driven_lanedir_mean0.15704707060025752
driven_lanedir_min0.0692074502428428
in-drivable-lane_max0.7333333333333336
in-drivable-lane_mean0.14666666666666672
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5030991544385488, "driven_lanedir": 0.0692074502428428, "in-drivable-lane": 0.7333333333333336, "deviation-heading": 0.6019238797324175, "deviation-center-line": 0.052171135656159315}, "ep001": {"driven_any": 0.18167469465836633, "driven_lanedir": 0.16373653515156184, "in-drivable-lane": 0, "deviation-heading": 0.19369349156262652, "deviation-center-line": 0.04259575220107422}, "ep002": {"driven_any": 0.23757460070709407, "driven_lanedir": 0.21629449537176135, "in-drivable-lane": 0, "deviation-heading": 0.22037939975473647, "deviation-center-line": 0.04379163921150825}, "ep003": {"driven_any": 0.18167469465836497, "driven_lanedir": 0.16591466119060105, "in-drivable-lane": 0, "deviation-heading": 0.1790784056951531, "deviation-center-line": 0.04563514860321881}, "ep004": {"driven_any": 0.1816746946583661, "driven_lanedir": 0.1700822110445206, "in-drivable-lane": 0, "deviation-heading": 0.14734990381917845, "deviation-center-line": 0.052457565484118215}}
14089498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3720:00:40(hidden)
other stats
videos1
14083498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median0.49999999999999994


other stats
episodes
details{"ep000": {"nsteps": 38, "reward": -27.00213175590493, "good_angle": 1.191979654006145, "survival_time": 1.2666666666666673, "traveled_tiles": 1, "valid_direction": 1.0000000000000004}, "ep001": {"nsteps": 15, "reward": -66.46407719204824, "good_angle": 0.11591296852560276, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}, "ep002": {"nsteps": 19, "reward": -52.310602119290515, "good_angle": 0.13605931908803617, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.3333333333333333}, "ep003": {"nsteps": 15, "reward": -66.48775760158897, "good_angle": 0.1028767232202385, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}, "ep004": {"nsteps": 15, "reward": -66.54535975381732, "good_angle": 0.07772667659582114, "survival_time": 0.49999999999999994, "traveled_tiles": 2, "valid_direction": 0.23333333333333328}}
good_angle_max1.191979654006145
good_angle_mean0.3249110682871687
good_angle_median0.11591296852560276
good_angle_min0.07772667659582114
reward_max-27.00213175590493
reward_mean-55.76198568452999
reward_median-66.46407719204824
reward_min-66.54535975381732
survival_time_max1.2666666666666673
survival_time_mean0.68
survival_time_min0.49999999999999994
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.0000000000000004
valid_direction_mean0.4333333333333334
valid_direction_median0.29999999999999993
valid_direction_min0.23333333333333328
140611264gunshiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:07:07(hidden)
other stats
simulation-passed1
140461262Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:03(hidden)
other stats
simulation-passed1
14040748VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:00:53(hidden)
other stats
videos1
14039493heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3720:00:39(hidden)
other stats
videos1
140361260gunshiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median2.7666666666666666


other stats
episodes
details{"ep000": {"nsteps": 64, "reward": -16.437786463429802, "good_angle": 1.3958710248558466, "survival_time": 2.1333333333333355, "traveled_tiles": 1, "valid_direction": 1.7333333333333354}, "ep001": {"nsteps": 83, "reward": -11.83586702150214, "good_angle": 1.4637353577423906, "survival_time": 2.7666666666666666, "traveled_tiles": 2, "valid_direction": 1.8999999999999997}, "ep002": {"nsteps": 284, "reward": -4.032280063295973, "good_angle": 14.475995915753115, "survival_time": 9.466666666666644, "traveled_tiles": 3, "valid_direction": 7.799999999999981}, "ep003": {"nsteps": 25, "reward": -41.39783654123545, "good_angle": 0.9952929510118892, "survival_time": 0.8333333333333333, "traveled_tiles": 2, "valid_direction": 0.7333333333333333}, "ep004": {"nsteps": 223, "reward": -4.441130563867333, "good_angle": 5.551426876896807, "survival_time": 7.433333333333317, "traveled_tiles": 4, "valid_direction": 5.199999999999988}}
good_angle_max14.475995915753115
good_angle_mean4.77646442525201
good_angle_median1.4637353577423906
good_angle_min0.9952929510118892
reward_max-4.032280063295973
reward_mean-15.62898013066614
reward_median-11.83586702150214
reward_min-41.39783654123545
survival_time_max9.466666666666644
survival_time_mean4.526666666666659
survival_time_min0.8333333333333333
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max7.799999999999981
valid_direction_mean3.473333333333327
valid_direction_median1.8999999999999997
valid_direction_min0.7333333333333333
140281260gunshiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:03:43(hidden)
other stats
simulation-passed1
140211259gunshiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:01:07(hidden)
other stats
videos1
140111002lmandrileTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median1.166666666666667


other stats
episodes
details{"ep000": {"nsteps": 37, "reward": -28.33219768872132, "good_angle": 0.4841211643615117, "survival_time": 1.2333333333333338, "traveled_tiles": 3, "valid_direction": 0.5000000000000002}, "ep001": {"nsteps": 27, "reward": -38.29449649210329, "good_angle": 1.0248311898624871, "survival_time": 0.8999999999999999, "traveled_tiles": 3, "valid_direction": 0.7999999999999999}, "ep002": {"nsteps": 35, "reward": -29.095297619806868, "good_angle": 0.7352453722231659, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 0.9333333333333336}, "ep003": {"nsteps": 35, "reward": -29.02805897699935, "good_angle": 0.6327953431255243, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep004": {"nsteps": 23, "reward": -44.56027106228082, "good_angle": 0.9851564314367316, "survival_time": 0.7666666666666666, "traveled_tiles": 1, "valid_direction": 0.7333333333333333}}
good_angle_max1.0248311898624871
good_angle_mean0.7724299002018842
good_angle_median0.7352453722231659
good_angle_min0.4841211643615117
reward_max-28.33219768872132
reward_mean-33.86206436798233
reward_median-29.095297619806868
reward_min-44.56027106228082
survival_time_max1.2333333333333338
survival_time_mean1.0466666666666669
survival_time_min0.7666666666666666
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.9666666666666668
valid_direction_mean0.7866666666666668
valid_direction_median0.7999999999999999
valid_direction_min0.5000000000000002
140081259gunshiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:03:21(hidden)
other stats
simulation-passed1
140071003sodabetaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerroryes3720:00:46
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
(hidden)
14004491heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedyes3720:00:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    solve(params, cis)
  File "solution.py", line 28, in solve
    env = gym.make(params['env'])
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
    return registry.make(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
    spec = self.spec(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
    raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])


(hidden)
13992745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:55(hidden)
other stats
simulation-passed1
139751254gunshiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3720:03:34(hidden)
driven_lanedir_median1.5237096362238018
deviation-center-line_median0.7461469909284257
in-drivable-lane_median3.333333333333322


other stats
deviation-center-line_max1.174205871413685
deviation-center-line_mean0.758219411077514
deviation-center-line_min0.5245829192904474
deviation-heading_max6.035743825961684
deviation-heading_mean4.117912364173297
deviation-heading_median4.19068330302902
deviation-heading_min2.4829239817210462
driven_any_max4.954957478520294
driven_any_mean3.48421623626096
driven_any_median3.0182596094519667
driven_any_min2.1185653494547236
driven_lanedir_max2.452773810160352
driven_lanedir_mean1.5694228460578956
driven_lanedir_min0.82383279181929
in-drivable-lane_max7.166666666666645
in-drivable-lane_mean4.2599999999999865
in-drivable-lane_min2.3999999999999915
per-episodes
details{"ep000": {"driven_any": 2.1185653494547236, "driven_lanedir": 0.82383279181929, "in-drivable-lane": 2.999999999999993, "deviation-heading": 2.4829239817210462, "deviation-center-line": 0.5424900576186511}, "ep001": {"driven_any": 2.9538725289403325, "driven_lanedir": 1.6430561496688614, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 4.19068330302902, "deviation-center-line": 0.7461469909284257}, "ep002": {"driven_any": 4.375426214937483, "driven_lanedir": 1.4037418424171737, "in-drivable-lane": 7.166666666666645, "deviation-heading": 4.626702773046638, "deviation-center-line": 0.8036712161363606}, "ep003": {"driven_any": 4.954957478520294, "driven_lanedir": 2.452773810160352, "in-drivable-lane": 5.399999999999983, "deviation-heading": 6.035743825961684, "deviation-center-line": 1.174205871413685}, "ep004": {"driven_any": 3.0182596094519667, "driven_lanedir": 1.5237096362238018, "in-drivable-lane": 3.333333333333322, "deviation-heading": 3.2535079371080977, "deviation-center-line": 0.5245829192904474}}
139661254gunshiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:01:53(hidden)
other stats
videos1
139651254gunshiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median9.466666666666644


other stats
episodes
details{"ep000": {"nsteps": 200, "reward": -5.400322831270751, "good_angle": 5.357719448041962, "survival_time": 6.666666666666653, "traveled_tiles": 1, "valid_direction": 5.233333333333321}, "ep001": {"nsteps": 278, "reward": -3.796839781256272, "good_angle": 10.222309532613558, "survival_time": 9.266666666666644, "traveled_tiles": 4, "valid_direction": 6.799999999999984}, "ep002": {"nsteps": 411, "reward": -3.0930455271930746, "good_angle": 25.883467057869943, "survival_time": 13.699999999999962, "traveled_tiles": 3, "valid_direction": 11.666666666666632}, "ep003": {"nsteps": 465, "reward": -2.224413863945407, "good_angle": 9.794327216581122, "survival_time": 15.499999999999956, "traveled_tiles": 3, "valid_direction": 10.933333333333303}, "ep004": {"nsteps": 284, "reward": -3.8776170182054943, "good_angle": 17.221553272506885, "survival_time": 9.466666666666644, "traveled_tiles": 3, "valid_direction": 6.499999999999983}}
good_angle_max25.883467057869943
good_angle_mean13.695875305522694
good_angle_median10.222309532613558
good_angle_min5.357719448041962
reward_max-2.224413863945407
reward_mean-3.6784478043742
reward_median-3.796839781256272
reward_min-5.400322831270751
survival_time_max15.499999999999956
survival_time_mean10.919999999999972
survival_time_min6.666666666666653
traveled_tiles_max4
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max11.666666666666632
valid_direction_mean8.226666666666645
valid_direction_median6.799999999999984
valid_direction_min5.233333333333321
13963486JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3720:03:20(hidden)
driven_lanedir_median2.4034152885550273
deviation-center-line_median0.8111535006058613
in-drivable-lane_median6.399999999999997


other stats
deviation-center-line_max1.4760363244942405
deviation-center-line_mean0.7049395116156757
deviation-center-line_min0.09871551307676038
deviation-heading_max5.575615802049104
deviation-heading_mean2.0651006500704616
deviation-heading_median1.5795056862588357
deviation-heading_min0.4412652264199945
driven_any_max6.906746394497356
driven_any_mean3.379746053542932
driven_any_median4.051895715824647
driven_any_min0.8422445756832413
driven_lanedir_max2.9291420664386094
driven_lanedir_mean1.80791318898734
driven_lanedir_min0.44215016433627774
in-drivable-lane_max10.33333333333332
in-drivable-lane_mean5.613333333333332
in-drivable-lane_min0.9666666666666686
per-episodes
details{"ep000": {"driven_any": 4.081884141093223, "driven_lanedir": 2.692794877957573, "in-drivable-lane": 6.399999999999997, "deviation-heading": 5.575615802049104, "deviation-center-line": 1.4760363244942405}, "ep001": {"driven_any": 1.015959440616192, "driven_lanedir": 0.5720635476492122, "in-drivable-lane": 1.233333333333332, "deviation-heading": 0.4412652264199945, "deviation-center-line": 0.15132523838685363}, "ep002": {"driven_any": 6.906746394497356, "driven_lanedir": 2.9291420664386094, "in-drivable-lane": 9.133333333333344, "deviation-heading": 2.20821723440341, "deviation-center-line": 0.9874669815146624}, "ep003": {"driven_any": 0.8422445756832413, "driven_lanedir": 0.44215016433627774, "in-drivable-lane": 0.9666666666666686, "deviation-heading": 0.520899301220965, "deviation-center-line": 0.09871551307676038}, "ep004": {"driven_any": 4.051895715824647, "driven_lanedir": 2.4034152885550273, "in-drivable-lane": 10.33333333333332, "deviation-heading": 1.5795056862588357, "deviation-center-line": 0.8111535006058613}}
13949486JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessyes3720:04:51(hidden)
other stats
simulation-passed1
13935484JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 93, "reward": -11.815824954099552, "good_angle": 5.5076530058526405, "survival_time": 3.0999999999999988, "traveled_tiles": 1, "valid_direction": 2.666666666666665}, "ep001": {"nsteps": 39, "reward": -26.088028588738197, "good_angle": 0.6270622897180561, "survival_time": 1.3000000000000007, "traveled_tiles": 2, "valid_direction": 1.066666666666667}, "ep002": {"nsteps": 231, "reward": -4.7307317715573625, "good_angle": 12.602284929951203, "survival_time": 7.699999999999982, "traveled_tiles": 1, "valid_direction": 7.633333333333315}, "ep003": {"nsteps": 34, "reward": -29.80982903171988, "good_angle": 0.7790080076585797, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0.9000000000000001}, "ep004": {"nsteps": 200, "reward": -7.396486089006066, "good_angle": 6.729056750420412, "survival_time": 6.666666666666653, "traveled_tiles": 1, "valid_direction": 6.499999999999986}}
good_angle_max12.602284929951203
good_angle_mean5.249012996720178
good_angle_median5.5076530058526405
good_angle_min0.6270622897180561
reward_max-4.7307317715573625
reward_mean-15.968180087024212
reward_median-11.815824954099552
reward_min-29.80982903171988
survival_time_max7.699999999999982
survival_time_mean3.9799999999999938
survival_time_min1.1333333333333335
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max7.633333333333315
valid_direction_mean3.7533333333333263
valid_direction_median2.666666666666665
valid_direction_min0.9000000000000001
13926737heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes3720:02:34(hidden)
driven_lanedir_median0.5829770577558191
deviation-center-line_median0.14993212565362363
in-drivable-lane_median7.833333333333308


other stats
deviation-center-line_max0.4035387690525949
deviation-center-line_mean0.18334787608364267
deviation-center-line_min0
deviation-heading_max0.864736145138095
deviation-heading_mean0.4632284021511845
deviation-heading_median0.5111042462687017
deviation-heading_min0
driven_any_max6.0186968408770944
driven_any_mean3.6987786992331353
driven_any_median3.642897751243212
driven_any_min0.503104841855826
driven_lanedir_max1.451765387560334
driven_lanedir_mean0.6383250878346145
driven_lanedir_min0
in-drivable-lane_max15.799999999999988
in-drivable-lane_mean9.259999999999987
in-drivable-lane_min1.633333333333335
per-episodes
details{"ep000": {"driven_any": 0.503104841855826, "driven_lanedir": 0, "in-drivable-lane": 1.633333333333335, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 6.0186968408770944, "driven_lanedir": 0.8413546423716523, "in-drivable-lane": 14.199999999999989, "deviation-heading": 0.5469124646937337, "deviation-center-line": 0.28652288822864286}, "ep002": {"driven_any": 5.534181697502267, "driven_lanedir": 0.31552835148526714, "in-drivable-lane": 15.799999999999988, "deviation-heading": 0.39338915465539215, "deviation-center-line": 0.07674559748335193}, "ep003": {"driven_any": 2.7950123646872775, "driven_lanedir": 0.5829770577558191, "in-drivable-lane": 7.833333333333308, "deviation-heading": 0.5111042462687017, "deviation-center-line": 0.14993212565362363}, "ep004": {"driven_any": 3.642897751243212, "driven_lanedir": 1.451765387560334, "in-drivable-lane": 6.833333333333312, "deviation-heading": 0.864736145138095, "deviation-center-line": 0.4035387690525949}}
13921737heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3720:01:38(hidden)
other stats
videos1
13917737heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:21(hidden)
survival_time_median10.033333333333308


other stats
episodes
details{"ep000": {"nsteps": 50, "reward": -21.61791079998016, "good_angle": 0.3067147023758057, "survival_time": 1.6666666666666683, "traveled_tiles": 1, "valid_direction": 0.6000000000000019}, "ep001": {"nsteps": 500, "reward": -0.29254357146006077, "good_angle": 1.3218651452201142, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.6666666666666927}, "ep002": {"nsteps": 500, "reward": -0.7555890563689173, "good_angle": 1.6834095173865895, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.800000000000021}, "ep003": {"nsteps": 284, "reward": -4.330997165515494, "good_angle": 1.1445495758287336, "survival_time": 9.466666666666644, "traveled_tiles": 5, "valid_direction": 2.099999999999997}, "ep004": {"nsteps": 301, "reward": -3.9489842650257794, "good_angle": 1.585917504628602, "survival_time": 10.033333333333308, "traveled_tiles": 8, "valid_direction": 3.433333333333326}}
good_angle_max1.6834095173865895
good_angle_mean1.208491289087969
good_angle_median1.3218651452201142
good_angle_min0.3067147023758057
reward_max-0.29254357146006077
reward_mean-6.189204971670083
reward_median-3.9489842650257794
reward_min-21.61791079998016
survival_time_max16.666666666666654
survival_time_mean10.899999999999984
survival_time_min1.6666666666666683
traveled_tiles_max12
traveled_tiles_mean7.4
traveled_tiles_median8
traveled_tiles_min1
valid_direction_max3.433333333333326
valid_direction_mean2.3200000000000083
valid_direction_median2.6666666666666927
valid_direction_min0.6000000000000019
13910481JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedyes3720:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: 'NoneType' object has no attribute 'action_space'

(hidden)
13893223Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedyes3720:03:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

(hidden)
138821244heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyes3720:03:02(hidden)
other stats
videos1
13875733heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedyes3720:00:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 55, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 21, in make_env
    frame_skip=config['frame_skip'])
TypeError: make() got an unexpected keyword argument 'frame_skip'


(hidden)
13857731heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes3720:02:38(hidden)
driven_lanedir_median0.5829770577558191
deviation-center-line_median0.14993212565362363
in-drivable-lane_median7.833333333333308


other stats
deviation-center-line_max0.4035387690525949
deviation-center-line_mean0.18334787608364267
deviation-center-line_min0
deviation-heading_max0.864736145138095
deviation-heading_mean0.4632284021511845
deviation-heading_median0.5111042462687017
deviation-heading_min0
driven_any_max6.0186968408770944
driven_any_mean3.6987786992331353
driven_any_median3.642897751243212
driven_any_min0.503104841855826
driven_lanedir_max1.451765387560334
driven_lanedir_mean0.6383250878346145
driven_lanedir_min0
in-drivable-lane_max15.799999999999988
in-drivable-lane_mean9.259999999999987
in-drivable-lane_min1.633333333333335
per-episodes
details{"ep000": {"driven_any": 0.503104841855826, "driven_lanedir": 0, "in-drivable-lane": 1.633333333333335, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 6.0186968408770944, "driven_lanedir": 0.8413546423716523, "in-drivable-lane": 14.199999999999989, "deviation-heading": 0.5469124646937337, "deviation-center-line": 0.28652288822864286}, "ep002": {"driven_any": 5.534181697502267, "driven_lanedir": 0.31552835148526714, "in-drivable-lane": 15.799999999999988, "deviation-heading": 0.39338915465539215, "deviation-center-line": 0.07674559748335193}, "ep003": {"driven_any": 2.7950123646872775, "driven_lanedir": 0.5829770577558191, "in-drivable-lane": 7.833333333333308, "deviation-heading": 0.5111042462687017, "deviation-center-line": 0.14993212565362363}, "ep004": {"driven_any": 3.642897751243212, "driven_lanedir": 1.451765387560334, "in-drivable-lane": 6.833333333333312, "deviation-heading": 0.864736145138095, "deviation-center-line": 0.4035387690525949}}
13855731heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3720:01:54(hidden)
other stats
videos1
13851986VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:03:14(hidden)
other stats
videos1
138421242Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median0.49999999999999994


other stats
episodes
details{"ep000": {"nsteps": 155, "reward": -6.012635728159559, "good_angle": 0.9370266763475736, "survival_time": 5.166666666666658, "traveled_tiles": 3, "valid_direction": 1.6999999999999982}, "ep001": {"nsteps": 30, "reward": -32.95432401150465, "good_angle": 0.17817445608548357, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.23333333333333328}, "ep002": {"nsteps": 15, "reward": -66.51997305899859, "good_angle": 0.36817492992290135, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}, "ep003": {"nsteps": 15, "reward": -66.48542221582805, "good_angle": 0.2558686798553624, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}, "ep004": {"nsteps": 14, "reward": -71.24155682844243, "good_angle": 0.1494350212742218, "survival_time": 0.4666666666666666, "traveled_tiles": 2, "valid_direction": 0.16666666666666663}}
good_angle_max0.9370266763475736
good_angle_mean0.3777359526971086
good_angle_median0.2558686798553624
good_angle_min0.1494350212742218
reward_max-6.012635728159559
reward_mean-48.64278236858665
reward_median-66.48542221582805
reward_min-71.24155682844243
survival_time_max5.166666666666658
survival_time_mean1.526666666666665
survival_time_min0.4666666666666666
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.6999999999999982
valid_direction_mean0.5399999999999995
valid_direction_median0.29999999999999993
valid_direction_min0.16666666666666663
13833475JonJP pipelineaido1_LF1_r3-v3step1-simulationerroryes3720:00:44
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
(hidden)
13832219Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedyes3720:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
(hidden)
13828474JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedyes3720:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: local variable 'a' referenced before assignment

(hidden)
13800982placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3720:01:23(hidden)
other stats
videos1
13790727heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:57(hidden)
other stats
simulation-passed1
13786726JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median1.7333333333333354


other stats
episodes
details{"ep000": {"nsteps": 60, "reward": -16.812896430368223, "good_angle": 0.16725092791193047, "survival_time": 2.0000000000000027, "traveled_tiles": 5, "valid_direction": 0.2666666666666666}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 48, "reward": -20.090162189211696, "good_angle": 0.05127530661354473, "survival_time": 1.6000000000000016, "traveled_tiles": 4, "valid_direction": 0.10000000000000003}, "ep003": {"nsteps": 52, "reward": -18.76694420678541, "good_angle": 0.05594291817927141, "survival_time": 1.7333333333333354, "traveled_tiles": 3, "valid_direction": 0.1333333333333333}, "ep004": {"nsteps": 103, "reward": -9.498041331302376, "good_angle": 0.5151282818834407, "survival_time": 3.433333333333331, "traveled_tiles": 8, "valid_direction": 0.9000000000000006}}
good_angle_max0.5151282818834407
good_angle_mean0.15852375679517197
good_angle_median0.05594291817927141
good_angle_min0.0030213493876724944
reward_max-9.498041331302376
reward_mean-22.489512902353667
reward_median-18.76694420678541
reward_min-47.27952035410063
survival_time_max3.433333333333331
survival_time_mean1.893333333333334
survival_time_min0.7
traveled_tiles_max8
traveled_tiles_mean4.6
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max0.9000000000000006
valid_direction_mean0.28000000000000014
valid_direction_median0.1333333333333333
valid_direction_min0
13784726JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessyes3720:01:39(hidden)
other stats
simulation-passed1
13781470JonJP pipelineaido1_LF1_r3-v3step1-simulationerroryes3720:00:33
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
(hidden)
13768979placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3720:00:40(hidden)
other stats
videos1
13765979placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median0.8999999999999999


other stats
episodes
details{"ep000": {"nsteps": 69, "reward": -14.803114302530616, "good_angle": 0.90468589820781, "survival_time": 2.3000000000000016, "traveled_tiles": 3, "valid_direction": 1.2999999999999998}, "ep001": {"nsteps": 14, "reward": -71.0497931790139, "good_angle": 0.006364621940992221, "survival_time": 0.4666666666666666, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 27, "reward": -36.690565794706345, "good_angle": 0.24583813257416648, "survival_time": 0.8999999999999999, "traveled_tiles": 3, "valid_direction": 0.6}, "ep003": {"nsteps": 19, "reward": -53.083603034678255, "good_angle": 0.4818158453539517, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.5333333333333332}, "ep004": {"nsteps": 57, "reward": -17.667841038552293, "good_angle": 2.264110477702074, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0.8666666666666683}}
good_angle_max2.264110477702074
good_angle_mean0.7805629951557989
good_angle_median0.4818158453539517
good_angle_min0.006364621940992221
reward_max-14.803114302530616
reward_mean-38.658983469896285
reward_median-36.690565794706345
reward_min-71.0497931790139
survival_time_max2.3000000000000016
survival_time_mean1.2400000000000009
survival_time_min0.4666666666666666
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.2999999999999998
valid_direction_mean0.6600000000000004
valid_direction_median0.6
valid_direction_min0
13757468sodabetaPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessyes3720:03:42(hidden)
other stats
simulation-passed1
13747977placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3720:00:44(hidden)
other stats
videos1
13741465JonROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:01:07(hidden)
other stats
videos1
13736465JonROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median0.4666666666666666


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.01923186712068855, "good_angle": 1.538520867103462, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.3000000000000096}, "ep001": {"nsteps": 35, "reward": -28.226544765489443, "good_angle": 0.12442303706919013, "survival_time": 1.166666666666667, "traveled_tiles": 2, "valid_direction": 0.16666666666666707}, "ep002": {"nsteps": 11, "reward": -90.96522614715452, "good_angle": 0.32757135670288295, "survival_time": 0.36666666666666664, "traveled_tiles": 1, "valid_direction": 0.3333333333333333}, "ep003": {"nsteps": 14, "reward": -71.2183916975877, "good_angle": 0.1995894519648787, "survival_time": 0.4666666666666666, "traveled_tiles": 1, "valid_direction": 0.2333333333333333}, "ep004": {"nsteps": 10, "reward": -99.9551732391119, "good_angle": 0.13354365089029568, "survival_time": 0.3333333333333333, "traveled_tiles": 2, "valid_direction": 0.2}}
good_angle_max1.538520867103462
good_angle_mean0.4647296727461419
good_angle_median0.1995894519648787
good_angle_min0.12442303706919013
reward_max0.01923186712068855
reward_mean-58.069220796444576
reward_median-71.2183916975877
reward_min-99.9551732391119
survival_time_max16.666666666666654
survival_time_mean3.799999999999997
survival_time_min0.3333333333333333
traveled_tiles_max10
traveled_tiles_mean3.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.3000000000000096
valid_direction_mean0.8466666666666687
valid_direction_median0.2333333333333333
valid_direction_min0.16666666666666707
13733721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 73, "reward": -13.415154420528305, "good_angle": 0.3147043198739996, "survival_time": 2.4333333333333345, "traveled_tiles": 3, "valid_direction": 0.7000000000000006}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 47, "reward": -20.81093230098486, "good_angle": 0.05133578734780305, "survival_time": 1.5666666666666682, "traveled_tiles": 3, "valid_direction": 0.09999999999999998}, "ep003": {"nsteps": 58, "reward": -16.97874402054681, "good_angle": 0.1079669872452238, "survival_time": 1.933333333333336, "traveled_tiles": 3, "valid_direction": 0.3000000000000005}, "ep004": {"nsteps": 59, "reward": -16.696578025439027, "good_angle": 0.5824379166124307, "survival_time": 1.9666666666666697, "traveled_tiles": 3, "valid_direction": 0.5333333333333344}}
good_angle_max0.5824379166124307
good_angle_mean0.21189327209342596
good_angle_median0.1079669872452238
good_angle_min0.0030213493876724944
reward_max-13.415154420528305
reward_mean-23.03618582431993
reward_median-16.97874402054681
reward_min-47.27952035410063
survival_time_max2.4333333333333345
survival_time_mean1.7200000000000015
survival_time_min0.7
traveled_tiles_max3
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max0.7000000000000006
valid_direction_mean0.3266666666666671
valid_direction_median0.3000000000000005
valid_direction_min0
13726719BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3720:02:05(hidden)
driven_lanedir_median0.3640065191843638
deviation-center-line_median0.10335817329969928
in-drivable-lane_median0


other stats
deviation-center-line_max2.0198758754183856
deviation-center-line_mean0.6184886978264315
deviation-center-line_min0.05411036549986538
deviation-heading_max1.708211151838669
deviation-heading_mean0.5944077504361427
deviation-heading_median0.20380999803551533
deviation-heading_min0.10432771374703938
driven_any_max8.888429914610128
driven_any_mean2.802717342152169
driven_any_median0.3741695555713135
driven_any_min0.2885319601241892
driven_lanedir_max6.874394359842376
driven_lanedir_mean2.1107004094766637
driven_lanedir_min0.28440436146091064
in-drivable-lane_max4.866666666666674
in-drivable-lane_mean1.7200000000000002
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.151106157902547, "driven_lanedir": 2.7293599509177793, "in-drivable-lane": 3.7333333333333263, "deviation-heading": 0.8060348340430451, "deviation-center-line": 0.8395487371285528}, "ep001": {"driven_any": 0.3113491225526686, "driven_lanedir": 0.30133685597788773, "in-drivable-lane": 0, "deviation-heading": 0.14965505451644512, "deviation-center-line": 0.05411036549986538}, "ep002": {"driven_any": 8.888429914610128, "driven_lanedir": 6.874394359842376, "in-drivable-lane": 4.866666666666674, "deviation-heading": 1.708211151838669, "deviation-center-line": 2.0198758754183856}, "ep003": {"driven_any": 0.3741695555713135, "driven_lanedir": 0.3640065191843638, "in-drivable-lane": 0, "deviation-heading": 0.20380999803551533, "deviation-center-line": 0.10335817329969928}, "ep004": {"driven_any": 0.2885319601241892, "driven_lanedir": 0.28440436146091064, "in-drivable-lane": 0, "deviation-heading": 0.10432771374703938, "deviation-center-line": 0.07555033778565429}}
13719975placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3720:00:43(hidden)
other stats
videos1
13714719BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median1.0333333333333332


other stats
episodes
details{"ep000": {"nsteps": 270, "reward": -3.725159287288854, "good_angle": 1.2574383837996266, "survival_time": 8.999999999999979, "traveled_tiles": 8, "valid_direction": 3.0333333333333266}, "ep001": {"nsteps": 20, "reward": -49.70229233112186, "good_angle": 0.07062650970515366, "survival_time": 0.6666666666666666, "traveled_tiles": 2, "valid_direction": 0.16666666666666669}, "ep002": {"nsteps": 500, "reward": 0.1561640081521473, "good_angle": 1.8088570693959536, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 4.566666666666681}, "ep003": {"nsteps": 31, "reward": -32.05142838051242, "good_angle": 0.13322839595913957, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0.19999999999999996}, "ep004": {"nsteps": 21, "reward": -47.4484579286405, "good_angle": 0.027058826495636058, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.1333333333333333}}
good_angle_max1.8088570693959536
good_angle_mean0.6594418370711018
good_angle_median0.13322839595913957
good_angle_min0.027058826495636058
reward_max0.1561640081521473
reward_mean-26.5542347838823
reward_median-32.05142838051242
reward_min-49.70229233112186
survival_time_max16.666666666666654
survival_time_mean5.613333333333326
survival_time_min0.6666666666666666
traveled_tiles_max17
traveled_tiles_mean6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.566666666666681
valid_direction_mean1.6200000000000014
valid_direction_median0.19999999999999996
valid_direction_min0.1333333333333333
13712720BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:55(hidden)
other stats
simulation-passed1
13703972VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3720:01:57(hidden)
driven_lanedir_median0.5853469940094662
deviation-center-line_median0.17376858549019103
in-drivable-lane_median0


other stats
deviation-center-line_max1.570396378317595
deviation-center-line_mean0.471624344745615
deviation-center-line_min0.12417569802785836
deviation-heading_max2.489351852857024
deviation-heading_mean0.8118681308410174
deviation-heading_median0.19305546798584552
deviation-heading_min0.11021473760327184
driven_any_max4.49915597434609
driven_any_mean1.499813492251861
driven_any_median0.5893005761106987
driven_any_min0.3750086608106522
driven_lanedir_max3.042748744319971
driven_lanedir_mean1.19006462096586
driven_lanedir_min0.3730794782927829
in-drivable-lane_max3.733333333333324
in-drivable-lane_mean0.7533333333333314
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.49915597434609, "driven_lanedir": 3.042748744319971, "in-drivable-lane": 3.733333333333324, "deviation-heading": 2.489351852857024, "deviation-center-line": 1.570396378317595}, "ep001": {"driven_any": 0.5893005761106987, "driven_lanedir": 0.5853469940094662, "in-drivable-lane": 0, "deviation-heading": 0.19305546798584552, "deviation-center-line": 0.17376858549019103}, "ep002": {"driven_any": 1.564154327773445, "driven_lanedir": 1.4803979022252949, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.1223882788632389, "deviation-center-line": 0.34563523301371274}, "ep003": {"driven_any": 0.4714479222184164, "driven_lanedir": 0.4687499859817854, "in-drivable-lane": 0, "deviation-heading": 0.14433031689570727, "deviation-center-line": 0.14414582887871763}, "ep004": {"driven_any": 0.3750086608106522, "driven_lanedir": 0.3730794782927829, "in-drivable-lane": 0, "deviation-heading": 0.11021473760327184, "deviation-center-line": 0.12417569802785836}}
13697973placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3720:00:53(hidden)
other stats
videos1
13692973placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median1.9666666666666697


other stats
episodes
details{"ep000": {"nsteps": 50, "reward": -20.0966856482625, "good_angle": 0.5990378359523965, "survival_time": 1.6666666666666683, "traveled_tiles": 3, "valid_direction": 0.4333333333333335}, "ep001": {"nsteps": 68, "reward": -14.259877709233583, "good_angle": 0.1685047318409658, "survival_time": 2.2666666666666684, "traveled_tiles": 4, "valid_direction": 0.4}, "ep002": {"nsteps": 59, "reward": -17.348372658880397, "good_angle": 4.080510254651835, "survival_time": 1.9666666666666697, "traveled_tiles": 4, "valid_direction": 1.100000000000002}, "ep003": {"nsteps": 63, "reward": -15.445197835505482, "good_angle": 0.5825823431054453, "survival_time": 2.1000000000000023, "traveled_tiles": 4, "valid_direction": 0.6333333333333339}, "ep004": {"nsteps": 33, "reward": -29.909234636660777, "good_angle": 0.09352224674308492, "survival_time": 1.1, "traveled_tiles": 2, "valid_direction": 0.20000000000000004}}
good_angle_max4.080510254651835
good_angle_mean1.1048314824587453
good_angle_median0.5825823431054453
good_angle_min0.09352224674308492
reward_max-14.259877709233583
reward_mean-19.411873697708547
reward_median-17.348372658880397
reward_min-29.909234636660777
survival_time_max2.2666666666666684
survival_time_mean1.8200000000000016
survival_time_min1.1
traveled_tiles_max4
traveled_tiles_mean3.4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max1.100000000000002
valid_direction_mean0.5533333333333339
valid_direction_median0.4333333333333335
valid_direction_min0.20000000000000004
136631227gunshiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedyes3720:10:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
(hidden)
13652713BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3720:01:39(hidden)
driven_lanedir_median0.32518129152327657
deviation-center-line_median0.09202294891375778
in-drivable-lane_median0


other stats
deviation-center-line_max1.5188565412799526
deviation-center-line_mean0.3759974454857089
deviation-center-line_min0.07052587432933258
deviation-heading_max0.8843076837837718
deviation-heading_mean0.42037651825184463
deviation-heading_median0.3815754903025671
deviation-heading_min0.08528424699938733
driven_any_max4.837937055837859
driven_any_mean1.1944447417958397
driven_any_median0.3364268772138909
driven_any_min0.1524955517192679
driven_lanedir_max3.038169692691541
driven_lanedir_mean0.8256977042690599
driven_lanedir_min0.125532126997832
in-drivable-lane_max9.000000000000012
in-drivable-lane_mean1.8000000000000025
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.837937055837859, "driven_lanedir": 3.038169692691541, "in-drivable-lane": 9.000000000000012, "deviation-heading": 0.8843076837837718, "deviation-center-line": 1.5188565412799526}, "ep001": {"driven_any": 0.4146467022681418, "driven_lanedir": 0.4110962298354428, "in-drivable-lane": 0, "deviation-heading": 0.10019579714213234, "deviation-center-line": 0.07052587432933258}, "ep002": {"driven_any": 0.1524955517192679, "driven_lanedir": 0.125532126997832, "in-drivable-lane": 0, "deviation-heading": 0.6505193730313644, "deviation-center-line": 0.07355642869010752}, "ep003": {"driven_any": 0.3364268772138909, "driven_lanedir": 0.32518129152327657, "in-drivable-lane": 0, "deviation-heading": 0.3815754903025671, "deviation-center-line": 0.1250254342153936}, "ep004": {"driven_any": 0.23071752194003797, "driven_lanedir": 0.22850918029720704, "in-drivable-lane": 0, "deviation-heading": 0.08528424699938733, "deviation-center-line": 0.09202294891375778}}
136381225tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:00(hidden)
other stats
simulation-passed1
13635457JonRandom executionaido1_LF1_r3-v3step1-simulationfailedyes3720:00:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2

(hidden)
13616454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes3720:05:44(hidden)
driven_lanedir_median9.311616118207551
deviation-center-line_median1.375255229701354
in-drivable-lane_median1.333333333333331


other stats
deviation-center-line_max1.4071694961874588
deviation-center-line_mean1.3821684704865245
deviation-center-line_min1.3611208237516923
deviation-heading_max11.930941600943475
deviation-heading_mean11.129695717576102
deviation-heading_median11.099677050076671
deviation-heading_min10.273035298595412
driven_any_max14.916078396590812
driven_any_mean14.915701680642186
driven_any_median14.916065611371678
driven_any_min14.91430417179257
driven_lanedir_max9.428603454593718
driven_lanedir_mean9.299043868352044
driven_lanedir_min9.101215753661164
in-drivable-lane_max1.9999999999999976
in-drivable-lane_mean1.3266666666666649
in-drivable-lane_min0.7333333333333314
per-episodes
details{"ep000": {"driven_any": 14.916065611371678, "driven_lanedir": 9.356887200415844, "in-drivable-lane": 1.166666666666665, "deviation-heading": 11.325415227960324, "deviation-center-line": 1.3692282840701395}, "ep001": {"driven_any": 14.91430417179257, "driven_lanedir": 9.428603454593718, "in-drivable-lane": 0.7333333333333314, "deviation-heading": 11.930941600943475, "deviation-center-line": 1.4071694961874588}, "ep002": {"driven_any": 14.916078396590812, "driven_lanedir": 9.29689681488194, "in-drivable-lane": 1.3999999999999997, "deviation-heading": 11.019409410304627, "deviation-center-line": 1.375255229701354}, "ep003": {"driven_any": 14.91598182686506, "driven_lanedir": 9.101215753661164, "in-drivable-lane": 1.9999999999999976, "deviation-heading": 10.273035298595412, "deviation-center-line": 1.398068518721978}, "ep004": {"driven_any": 14.916078396590809, "driven_lanedir": 9.311616118207551, "in-drivable-lane": 1.333333333333331, "deviation-heading": 11.099677050076671, "deviation-center-line": 1.3611208237516923}}
136121222tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median1.333333333333334


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.046298592584207654, "good_angle": 1.6228247025964602, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.1333333333333524}, "ep001": {"nsteps": 56, "reward": -17.59138845130136, "good_angle": 0.10269670506805578, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0.16666666666666696}, "ep002": {"nsteps": 11, "reward": -90.94052983414043, "good_angle": 0.3159313836672587, "survival_time": 0.36666666666666664, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}, "ep003": {"nsteps": 40, "reward": -24.738229059427976, "good_angle": 0.10030832992722012, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.10000000000000032}, "ep004": {"nsteps": 11, "reward": -90.92483591322194, "good_angle": 0.113832621329858, "survival_time": 0.36666666666666664, "traveled_tiles": 2, "valid_direction": 0.3}}
good_angle_max1.6228247025964602
good_angle_mean0.4511187485177707
good_angle_median0.113832621329858
good_angle_min0.10030832992722012
reward_max0.046298592584207654
reward_mean-44.8297369331015
reward_median-24.738229059427976
reward_min-90.94052983414043
survival_time_max16.666666666666654
survival_time_mean4.119999999999999
survival_time_min0.36666666666666664
traveled_tiles_max10
traveled_tiles_mean3.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.1333333333333524
valid_direction_mean0.8000000000000039
valid_direction_median0.29999999999999993
valid_direction_min0.10000000000000032
13608709JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.3760608980022371, "good_angle": 1.3993681359402834, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.933333333333324}, "ep001": {"nsteps": 500, "reward": 0.5755687124319374, "good_angle": 1.087956023710125, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.733333333333334}, "ep002": {"nsteps": 500, "reward": 0.5731831927709281, "good_angle": 0.9565638553895884, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.1666666666666594}, "ep003": {"nsteps": 500, "reward": 0.482005890559405, "good_angle": 0.9054896641768444, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.4666666666666583}, "ep004": {"nsteps": 500, "reward": 0.4805345337111503, "good_angle": 1.4048006677158351, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.2999999999999936}}
good_angle_max1.4048006677158351
good_angle_mean1.1508356693865354
good_angle_median1.087956023710125
good_angle_min0.9054896641768444
reward_max0.5755687124319374
reward_mean0.4974706454951316
reward_median0.482005890559405
reward_min0.3760608980022371
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max3.2999999999999936
valid_direction_mean2.7199999999999935
valid_direction_median2.733333333333334
valid_direction_min2.1666666666666594
13587709JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessyes3720:10:11(hidden)
other stats
simulation-passed1
13580961BenjaminMy ROS solution - param 3aido1_LF1_r3-v3step4-vizsuccessyes3720:01:33(hidden)
driven_lanedir_median-0.0411401558932214
deviation-center-line_median0.031165455771212644
in-drivable-lane_median0.4333333333333333


other stats
deviation-center-line_max1.2612834693620063
deviation-center-line_mean0.27371026344859717
deviation-center-line_min0.01699408906810831
deviation-heading_max6.4719510414566495
deviation-heading_mean1.5446564830140888
deviation-heading_median0.31743992009110533
deviation-heading_min0.20860667595575896
driven_any_max2.1611324671971475
driven_any_mean0.5496497527184163
driven_any_median0.14535647564439216
driven_any_min0.08066490646930738
driven_lanedir_max-0.02443509004871558
driven_lanedir_mean-0.13407103263278647
driven_lanedir_min-0.5063152682995857
in-drivable-lane_max8.766666666666653
in-drivable-lane_mean2.1133333333333306
in-drivable-lane_min0.33333333333333326
per-episodes
details{"ep000": {"driven_any": 2.1611324671971475, "driven_lanedir": -0.5063152682995857, "in-drivable-lane": 8.766666666666653, "deviation-heading": 6.4719510414566495, "deviation-center-line": 1.2612834693620063}, "ep001": {"driven_any": 0.14535647564439216, "driven_lanedir": -0.0411401558932214, "in-drivable-lane": 0.4333333333333333, "deviation-heading": 0.31743992009110533, "deviation-center-line": 0.031165455771212644}, "ep002": {"driven_any": 0.09667070518632792, "driven_lanedir": -0.02443509004871558, "in-drivable-lane": 0.33333333333333326, "deviation-heading": 0.23446043661956031, "deviation-center-line": 0.022492528685646548}, "ep003": {"driven_any": 0.26442420909490655, "driven_lanedir": -0.07326936473154055, "in-drivable-lane": 0.6666666666666667, "deviation-heading": 0.4908243409473706, "deviation-center-line": 0.03661577435601206}, "ep004": {"driven_any": 0.08066490646930738, "driven_lanedir": -0.02519528419086914, "in-drivable-lane": 0.3666666666666666, "deviation-heading": 0.20860667595575896, "deviation-center-line": 0.01699408906810831}}
13579962DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3720:01:09(hidden)
driven_lanedir_median1.3343618181249366
deviation-center-line_median0.10277832601425917
in-drivable-lane_median0


other stats
deviation-center-line_max0.18919254801082824
deviation-center-line_mean0.1050128326079928
deviation-center-line_min0.05872466525059969
deviation-heading_max0.4392735645375891
deviation-heading_mean0.22774412657601809
deviation-heading_median0.15848093548478165
deviation-heading_min0.10590701651015888
driven_any_max4.165427849604654
driven_any_mean1.9705345560498209
driven_any_median1.5233417154399729
driven_any_min1.2881002032994942
driven_lanedir_max4.120128964331902
driven_lanedir_mean1.9114758986611613
driven_lanedir_min1.2807526591470308
in-drivable-lane_max0.16666666666666666
in-drivable-lane_mean0.03333333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.554240397192525, "driven_lanedir": 1.3343618181249366, "in-drivable-lane": 0.16666666666666666, "deviation-heading": 0.2850619370098363, "deviation-center-line": 0.1100755849230636}, "ep001": {"driven_any": 1.5233417154399729, "driven_lanedir": 1.5082589277233216, "in-drivable-lane": 0, "deviation-heading": 0.15848093548478165, "deviation-center-line": 0.10277832601425917}, "ep002": {"driven_any": 4.165427849604654, "driven_lanedir": 4.120128964331902, "in-drivable-lane": 0, "deviation-heading": 0.4392735645375891, "deviation-center-line": 0.18919254801082824}, "ep003": {"driven_any": 1.3215626147124568, "driven_lanedir": 1.3138771239786171, "in-drivable-lane": 0, "deviation-heading": 0.10590701651015888, "deviation-center-line": 0.0642930388412134}, "ep004": {"driven_any": 1.2881002032994942, "driven_lanedir": 1.2807526591470308, "in-drivable-lane": 0, "deviation-heading": 0.14999717933772433, "deviation-center-line": 0.05872466525059969}}
13575962DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3720:00:43(hidden)
other stats
videos1
13554957BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3720:05:02(hidden)
driven_lanedir_median10.722001744954593
deviation-center-line_median1.0745493886746962
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max1.6096453243973323
deviation-center-line_mean1.0871907691888372
deviation-center-line_min0.684721667931075
deviation-heading_max2.432954390823328
deviation-heading_mean2.104630176668983
deviation-heading_median2.261104242274425
deviation-heading_min1.5112762660583876
driven_any_max11.629342083011146
driven_any_mean10.245778595751656
driven_any_median11.11736202164761
driven_any_min6.467542603083343
driven_lanedir_max11.417723355821732
driven_lanedir_mean9.924130116950227
driven_lanedir_min6.278956655560808
in-drivable-lane_max0.533333333333333
in-drivable-lane_mean0.19333333333333372
in-drivable-lane_min0.033333333333333215
per-episodes
details{"ep000": {"driven_any": 11.367114035218492, "driven_lanedir": 10.831376757641598, "in-drivable-lane": 0.533333333333333, "deviation-heading": 2.307841979555294, "deviation-center-line": 1.0957133071856575}, "ep001": {"driven_any": 11.629342083011146, "driven_lanedir": 11.417723355821732, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.0099740046334817, "deviation-center-line": 1.0745493886746962}, "ep002": {"driven_any": 10.647532235797687, "driven_lanedir": 10.370592070772409, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 2.261104242274425, "deviation-center-line": 0.9713241577554252}, "ep003": {"driven_any": 6.467542603083343, "driven_lanedir": 6.278956655560808, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.5112762660583876, "deviation-center-line": 0.684721667931075}, "ep004": {"driven_any": 11.11736202164761, "driven_lanedir": 10.722001744954593, "in-drivable-lane": 0.26666666666666927, "deviation-heading": 2.432954390823328, "deviation-center-line": 1.6096453243973323}}
13547959BenjaminMy ROS solution - param 1aido1_LF1_r3-v3step3-videossuccessyes3720:01:15(hidden)
other stats
videos1
13545959BenjaminMy ROS solution - param 1aido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median2.8


other stats
episodes
details{"ep000": {"nsteps": 96, "reward": -11.07648214159417, "good_angle": 3.09009454149935, "survival_time": 3.1999999999999984, "traveled_tiles": 1, "valid_direction": 2.5999999999999983}, "ep001": {"nsteps": 84, "reward": -13.018592713633552, "good_angle": 2.6617438016394477, "survival_time": 2.8, "traveled_tiles": 1, "valid_direction": 2.3666666666666663}, "ep002": {"nsteps": 500, "reward": -0.4711989437979646, "good_angle": 14.974349024531282, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.366666666666658}, "ep003": {"nsteps": 45, "reward": -23.46743442337546, "good_angle": 1.604138423050775, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 1.2000000000000006}, "ep004": {"nsteps": 26, "reward": -39.95353956011912, "good_angle": 0.7415321076531799, "survival_time": 0.8666666666666666, "traveled_tiles": 2, "valid_direction": 0.5333333333333332}}
good_angle_max14.974349024531282
good_angle_mean4.614371579674806
good_angle_median2.6617438016394477
good_angle_min0.7415321076531799
reward_max-0.4711989437979646
reward_mean-17.597449556504053
reward_median-13.018592713633552
reward_min-39.95353956011912
survival_time_max16.666666666666654
survival_time_mean5.006666666666663
survival_time_min0.8666666666666666
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max13.366666666666658
valid_direction_mean4.013333333333331
valid_direction_median2.3666666666666663
valid_direction_min0.5333333333333332
13525959BenjaminMy ROS solution - param 1aido1_LF1_r3-v3step1-simulationsuccessyes3720:05:40(hidden)
other stats
simulation-passed1
13523447JonRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:22(hidden)
survival_time_median2.6333333333333337


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -13.554760562326711, "good_angle": 1.3638601821504437, "survival_time": 2.6333333333333337, "traveled_tiles": 2, "valid_direction": 0.9666666666666652}, "ep001": {"nsteps": 98, "reward": -9.94825712462165, "good_angle": 0.23857113399144075, "survival_time": 3.266666666666665, "traveled_tiles": 3, "valid_direction": 0.5666666666666647}, "ep002": {"nsteps": 57, "reward": -17.320575883089187, "good_angle": 0.4006333285845668, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0.766666666666669}, "ep003": {"nsteps": 30, "reward": -32.97934064753353, "good_angle": 0.019262225232788623, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 85, "reward": -11.443003183351282, "good_angle": 0.41845204641929784, "survival_time": 2.833333333333333, "traveled_tiles": 3, "valid_direction": 0.899999999999997}}
good_angle_max1.3638601821504437
good_angle_mean0.4881557832757076
good_angle_median0.4006333285845668
good_angle_min0.019262225232788623
reward_max-9.94825712462165
reward_mean-17.04918748018447
reward_median-13.554760562326711
reward_min-32.97934064753353
survival_time_max3.266666666666665
survival_time_mean2.3266666666666667
survival_time_min1
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.9666666666666652
valid_direction_mean0.6399999999999991
valid_direction_median0.766666666666669
valid_direction_min0
13521447JonRandom executionaido1_LF1_r3-v3step1-simulationsuccessyes3720:01:14(hidden)
other stats
simulation-passed1
135151212iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3720:02:30(hidden)
driven_lanedir_median0.40838498166406856
deviation-center-line_median0.09173143883284432
in-drivable-lane_median0


other stats
deviation-center-line_max2.045270441883505
deviation-center-line_mean0.832149653803541
deviation-center-line_min0.04070978727192118
deviation-heading_max2.0355929419544654
deviation-heading_mean0.7586429599028361
deviation-heading_median0.23491671934677055
deviation-heading_min0.17621603476131548
driven_any_max5.3354937716163375
driven_any_mean2.2969061034871205
driven_any_median0.4176378368430207
driven_any_min0.12845729203222228
driven_lanedir_max3.5973524192214157
driven_lanedir_mean1.513751395605064
driven_lanedir_min0.11031039552038636
in-drivable-lane_max6.433333333333314
in-drivable-lane_mean2.2599999999999927
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.3354937716163375, "driven_lanedir": 3.2001665207241823, "in-drivable-lane": 6.433333333333314, "deviation-heading": 1.1159671129264828, "deviation-center-line": 1.9125462387091523}, "ep001": {"driven_any": 0.26773807775716907, "driven_lanedir": 0.25254266089526745, "in-drivable-lane": 0, "deviation-heading": 0.23052199052514705, "deviation-center-line": 0.0704903623202828}, "ep002": {"driven_any": 0.4176378368430207, "driven_lanedir": 0.40838498166406856, "in-drivable-lane": 0, "deviation-heading": 0.23491671934677055, "deviation-center-line": 0.09173143883284432}, "ep003": {"driven_any": 5.335203539186853, "driven_lanedir": 3.5973524192214157, "in-drivable-lane": 4.866666666666649, "deviation-heading": 2.0355929419544654, "deviation-center-line": 2.045270441883505}, "ep004": {"driven_any": 0.12845729203222228, "driven_lanedir": 0.11031039552038636, "in-drivable-lane": 0, "deviation-heading": 0.17621603476131548, "deviation-center-line": 0.04070978727192118}}
13506701BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:02:09(hidden)
other stats
videos1
13494956jasonlclPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessyes3720:09:06(hidden)
other stats
simulation-passed1
134861210iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:01:11(hidden)
other stats
videos1
13481954pravishsainathPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3720:00:47(hidden)
other stats
videos1
13477954pravishsainathPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median2.666666666666667


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -14.274192822901044, "good_angle": 1.61681510598875, "survival_time": 2.533333333333334, "traveled_tiles": 3, "valid_direction": 1.733333333333334}, "ep001": {"nsteps": 96, "reward": -10.254181568229493, "good_angle": 0.6200617127922396, "survival_time": 3.1999999999999984, "traveled_tiles": 4, "valid_direction": 1.966666666666665}, "ep002": {"nsteps": 58, "reward": -16.939393431959868, "good_angle": 0.8043659437528756, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 1.3000000000000027}, "ep003": {"nsteps": 80, "reward": -12.753131070826203, "good_angle": 0.9077561547095208, "survival_time": 2.666666666666667, "traveled_tiles": 3, "valid_direction": 2.3000000000000007}, "ep004": {"nsteps": 80, "reward": -12.30024550712551, "good_angle": 0.8716741256856454, "survival_time": 2.666666666666667, "traveled_tiles": 3, "valid_direction": 1.5666666666666658}}
good_angle_max1.61681510598875
good_angle_mean0.9641346085858062
good_angle_median0.8716741256856454
good_angle_min0.6200617127922396
reward_max-10.254181568229493
reward_mean-13.304228880208422
reward_median-12.753131070826203
reward_min-16.939393431959868
survival_time_max3.1999999999999984
survival_time_mean2.6000000000000005
survival_time_min1.933333333333336
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max2.3000000000000007
valid_direction_mean1.773333333333334
valid_direction_median1.733333333333334
valid_direction_min1.3000000000000027
13465698BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:51(hidden)
other stats
simulation-passed1
13459952heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:21(hidden)
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 72, "reward": -14.411038156288363, "good_angle": 0.6605615542100804, "survival_time": 2.4000000000000012, "traveled_tiles": 3, "valid_direction": 1.1333333333333362}, "ep001": {"nsteps": 74, "reward": -12.765838293106976, "good_angle": 0.20844008299008732, "survival_time": 2.4666666666666677, "traveled_tiles": 4, "valid_direction": 0.5000000000000016}, "ep002": {"nsteps": 55, "reward": -17.68788756294684, "good_angle": 0.09171855515535872, "survival_time": 1.8333333333333357, "traveled_tiles": 3, "valid_direction": 0.26666666666666666}, "ep003": {"nsteps": 65, "reward": -14.98420949498048, "good_angle": 0.07577935237158451, "survival_time": 2.1666666666666687, "traveled_tiles": 3, "valid_direction": 0.1333333333333333}, "ep004": {"nsteps": 184, "reward": -4.982917675728221, "good_angle": 0.5087040816930656, "survival_time": 6.133333333333321, "traveled_tiles": 6, "valid_direction": 1.4999999999999956}}
good_angle_max0.6605615542100804
good_angle_mean0.3090407252840353
good_angle_median0.20844008299008732
good_angle_min0.07577935237158451
reward_max-4.982917675728221
reward_mean-12.966378236610176
reward_median-14.411038156288363
reward_min-17.68788756294684
survival_time_max6.133333333333321
survival_time_mean2.999999999999999
survival_time_min1.8333333333333357
traveled_tiles_max6
traveled_tiles_mean3.8
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max1.4999999999999956
valid_direction_mean0.7066666666666667
valid_direction_median0.5000000000000016
valid_direction_min0.1333333333333333
134581208VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:24(hidden)
survival_time_median1.400000000000001


other stats
episodes
details{"ep000": {"nsteps": 42, "reward": -23.747633462017845, "good_angle": 0.12060839245986892, "survival_time": 1.400000000000001, "traveled_tiles": 3, "valid_direction": 0.2666666666666666}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 31, "reward": -31.60856496855136, "good_angle": 0.02294859323561006, "survival_time": 1.0333333333333332, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 52, "reward": -18.898122761004533, "good_angle": 0.024212758098552774, "survival_time": 1.7333333333333354, "traveled_tiles": 3, "valid_direction": 0.033333333333333326}, "ep004": {"nsteps": 321, "reward": -3.0631952495125594, "good_angle": 11.847632125543017, "survival_time": 10.699999999999973, "traveled_tiles": 4, "valid_direction": 5.233333333333318}}
good_angle_max11.847632125543017
good_angle_mean2.4036846437449437
good_angle_median0.024212758098552774
good_angle_min0.0030213493876724944
reward_max-3.0631952495125594
reward_mean-24.919407359037383
reward_median-23.747633462017845
reward_min-47.27952035410063
survival_time_max10.699999999999973
survival_time_mean3.1133333333333284
survival_time_min0.7
traveled_tiles_max4
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max5.233333333333318
valid_direction_mean1.1066666666666636
valid_direction_median0.033333333333333326
valid_direction_min0
13452696MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:01:39(hidden)
other stats
videos1
13437438BenjaminROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:01:23(hidden)
other stats
videos1
134221206MandanaSamieiImproved ROS-based solutionaido1_LF1_r3-v3step1-simulationsuccessyes3720:03:45(hidden)
other stats
simulation-passed1
13406436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes3720:05:13(hidden)
driven_lanedir_median9.311616118207551
deviation-center-line_median1.3745504270569049
in-drivable-lane_median1.333333333333331


other stats
deviation-center-line_max1.4011942005038411
deviation-center-line_mean1.3772210504550673
deviation-center-line_min1.3611208237516923
deviation-heading_max11.74707094717592
deviation-heading_mean11.108784947195296
deviation-heading_median11.099677050076671
deviation-heading_min10.351507705045384
driven_any_max14.916078396590851
driven_any_mean14.91589944723149
driven_any_median14.915912413296308
driven_any_min14.915674103930964
driven_lanedir_max9.394942130563432
driven_lanedir_mean9.296269275478387
driven_lanedir_min9.122690663301016
in-drivable-lane_max1.9333333333333311
in-drivable-lane_mean1.3399999999999983
in-drivable-lane_min0.866666666666666
per-episodes
details{"ep000": {"driven_any": 14.916078396590851, "driven_lanedir": 9.356934605061218, "in-drivable-lane": 1.166666666666665, "deviation-heading": 11.325398647950186, "deviation-center-line": 1.369370369314258}, "ep001": {"driven_any": 14.915753925748524, "driven_lanedir": 9.394942130563432, "in-drivable-lane": 0.866666666666666, "deviation-heading": 11.74707094717592, "deviation-center-line": 1.37986943164864}, "ep002": {"driven_any": 14.915912413296308, "driven_lanedir": 9.295162860258728, "in-drivable-lane": 1.3999999999999997, "deviation-heading": 11.020270385728312, "deviation-center-line": 1.3745504270569049}, "ep003": {"driven_any": 14.915674103930964, "driven_lanedir": 9.122690663301016, "in-drivable-lane": 1.9333333333333311, "deviation-heading": 10.351507705045384, "deviation-center-line": 1.4011942005038411}, "ep004": {"driven_any": 14.916078396590809, "driven_lanedir": 9.311616118207551, "in-drivable-lane": 1.333333333333331, "deviation-heading": 11.099677050076671, "deviation-center-line": 1.3611208237516923}}
133921201sodabetastay youngaido1_LF1_r3-v3step4-vizsuccessyes3720:04:22(hidden)
driven_lanedir_median-2.7973249114236007
deviation-center-line_median0.2561049885676801
in-drivable-lane_median8.299999999999994


other stats
deviation-center-line_max0.3864955077773513
deviation-center-line_mean0.27228693810488414
deviation-center-line_min0.18214629234378507
deviation-heading_max6.640678727738283
deviation-heading_mean6.593831069430121
deviation-heading_median6.572690923338977
deviation-heading_min6.562734664550635
driven_any_max8.942870824541771
driven_any_mean8.93717868995179
driven_any_median8.937500905459578
driven_any_min8.92988627427586
driven_lanedir_max-2.782536493777563
driven_lanedir_mean-2.794191625043091
driven_lanedir_min-2.799694041995785
in-drivable-lane_max8.299999999999995
in-drivable-lane_mean8.286666666666662
in-drivable-lane_min8.266666666666659
per-episodes
details{"ep000": {"driven_any": 8.939519037337467, "driven_lanedir": -2.799694041995785, "in-drivable-lane": 8.266666666666659, "deviation-heading": 6.640678727738283, "deviation-center-line": 0.32896880884241425}, "ep001": {"driven_any": 8.92988627427586, "driven_lanedir": -2.782536493777563, "in-drivable-lane": 8.266666666666662, "deviation-heading": 6.625506213084874, "deviation-center-line": 0.20771909299318983}, "ep002": {"driven_any": 8.942870824541771, "driven_lanedir": -2.7975911889096587, "in-drivable-lane": 8.299999999999995, "deviation-heading": 6.567544818437834, "deviation-center-line": 0.18214629234378507}, "ep003": {"driven_any": 8.937500905459578, "driven_lanedir": -2.7973249114236007, "in-drivable-lane": 8.299999999999995, "deviation-heading": 6.572690923338977, "deviation-center-line": 0.2561049885676801}, "ep004": {"driven_any": 8.936116408144265, "driven_lanedir": -2.793811489108847, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.562734664550635, "deviation-center-line": 0.3864955077773513}}
133881203BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:01(hidden)
other stats
simulation-passed1
13382275heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerroryes3720:00:32
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
(hidden)
13377690yun chenRandom executionaido1_LF1_r3-v3step1-simulationsuccessyes3720:03:31(hidden)
other stats
simulation-passed1
13374434BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerroryes3720:00:31
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
(hidden)
13357688MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:06:08(hidden)
other stats
simulation-passed1
133551197iban_alexROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3720:00:23(hidden)
survival_time_median1


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.1866648413799703, "good_angle": 1.916735153662508, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.466666666666687}, "ep001": {"nsteps": 30, "reward": -33.01312140400211, "good_angle": 0.1707123407942909, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.23333333333333328}, "ep002": {"nsteps": 16, "reward": -62.219498477410525, "good_angle": 0.2872233345190054, "survival_time": 0.5333333333333333, "traveled_tiles": 1, "valid_direction": 0.26666666666666666}, "ep003": {"nsteps": 36, "reward": -27.477537317718895, "good_angle": 0.14673073239148715, "survival_time": 1.2000000000000004, "traveled_tiles": 1, "valid_direction": 0.13333333333333375}, "ep004": {"nsteps": 11, "reward": -90.86454373699698, "good_angle": 0.16104655723475125, "survival_time": 0.36666666666666664, "traveled_tiles": 2, "valid_direction": 0.16666666666666666}}
good_angle_max1.916735153662508
good_angle_mean0.5364896237204085
good_angle_median0.1707123407942909
good_angle_min0.14673073239148715
reward_max0.1866648413799703
reward_mean-42.67760721894971
reward_median-33.01312140400211
reward_min-90.86454373699698
survival_time_max16.666666666666654
survival_time_mean3.953333333333331
survival_time_min0.36666666666666664
traveled_tiles_max9
traveled_tiles_mean3
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.466666666666687
valid_direction_mean0.8533333333333376
valid_direction_median0.23333333333333328
valid_direction_min0.13333333333333375
13348684Maxim KuzminROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3720:01:53(hidden)
driven_lanedir_median0.3787247033184315
deviation-center-line_median0.11624539227357036
in-drivable-lane_median0


other stats
deviation-center-line_max1.994368756687222
deviation-center-line_mean0.49306293660051714
deviation-center-line_min0.04274900746062285
deviation-heading_max1.364217109167083
deviation-heading_mean0.6210446329698459
deviation-heading_median0.23418813284422776
deviation-heading_min0.14248351132838574
driven_any_max5.334972019167302
driven_any_mean1.4654144540208949
driven_any_median0.385639283216658
driven_any_min0.11770228765073182
driven_lanedir_max3.316070821535508
driven_lanedir_mean1.0311117430581171
driven_lanedir_min0.10886376354831095
in-drivable-lane_max5.999999999999982
in-drivable-lane_mean1.2133333333333298
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.334972019167302, "driven_lanedir": 3.316070821535508, "in-drivable-lane": 5.999999999999982, "deviation-heading": 1.364217109167083, "deviation-center-line": 1.994368756687222}, "ep001": {"driven_any": 0.2891880174496459, "driven_lanedir": 0.27105267547046186, "in-drivable-lane": 0, "deviation-heading": 0.23418813284422776, "deviation-center-line": 0.0722765353899775}, "ep002": {"driven_any": 1.1995706626201372, "driven_lanedir": 1.080846751417873, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.175896603727581, "deviation-center-line": 0.239674991191193}, "ep003": {"driven_any": 0.385639283216658, "driven_lanedir": 0.3787247033184315, "in-drivable-lane": 0, "deviation-heading": 0.18843780778195177, "deviation-center-line": 0.11624539227357036}, "ep004": {"driven_any": 0.11770228765073182, "driven_lanedir": 0.10886376354831095, "in-drivable-lane": 0, "deviation-heading": 0.14248351132838574, "deviation-center-line": 0.04274900746062285}}
13332685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:05:30(hidden)
other stats
simulation-passed1
13325682MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3720:01:40(hidden)
driven_lanedir_median0.4887370737287245
deviation-center-line_median0.1498932174680143
in-drivable-lane_median0


other stats
deviation-center-line_max1.8795599637081797
deviation-center-line_mean0.4563523121489438
deviation-center-line_min0.03486963867190834
deviation-heading_max1.0928556754490606
deviation-heading_mean0.3986618550945482
deviation-heading_median0.2202870790616051
deviation-heading_min0.17198973145725552
driven_any_max5.335447814694851
driven_any_mean1.32839530388578
driven_any_median0.4928087499095799
driven_any_min0.11759666271642762
driven_lanedir_max3.1663391590169416
driven_lanedir_mean0.8819632993354741
driven_lanedir_min0.08509093370492415
in-drivable-lane_max6.566666666666647
in-drivable-lane_mean1.3133333333333297
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.335447814694851, "driven_lanedir": 3.1663391590169416, "in-drivable-lane": 6.566666666666647, "deviation-heading": 1.0928556754490606, "deviation-center-line": 1.8795599637081797}, "ep001": {"driven_any": 0.5784782219465554, "driven_lanedir": 0.5712776118037759, "in-drivable-lane": 0, "deviation-heading": 0.2202870790616051, "deviation-center-line": 0.1745517031610948}, "ep002": {"driven_any": 0.11764507016148582, "driven_lanedir": 0.08509093370492415, "in-drivable-lane": 0, "deviation-heading": 0.28976072434530686, "deviation-center-line": 0.03486963867190834}, "ep003": {"driven_any": 0.11759666271642762, "driven_lanedir": 0.09837171842300396, "in-drivable-lane": 0, "deviation-heading": 0.2184160651595129, "deviation-center-line": 0.04288703773552204}, "ep004": {"driven_any": 0.4928087499095799, "driven_lanedir": 0.4887370737287245, "in-drivable-lane": 0, "deviation-heading": 0.17198973145725552, "deviation-center-line": 0.1498932174680143}}
13317682MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:01:07(hidden)
other stats
videos1
133101193BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3720:00:49(hidden)
other stats
videos1
13297938hvrigazovROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyes3720:04:14(hidden)
other stats
simulation-passed1
13292679MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3720:01:45(hidden)
driven_lanedir_median0.29833307519294916
deviation-center-line_median0.07470620860767714
in-drivable-lane_median0


other stats
deviation-center-line_max2.1235083846562373
deviation-center-line_mean0.4758050563431483
deviation-center-line_min0.026989637289038207
deviation-heading_max1.3761465772748154
deviation-heading_mean0.4389220252229345
deviation-heading_median0.20947452673521263
deviation-heading_min0.15588157513566775
driven_any_max5.335077676280056
driven_any_mean1.2619202777317309
driven_any_median0.3105964155580236
driven_any_min0.12844259717557582
driven_lanedir_max3.4404528004211294
driven_lanedir_mean0.8698423861833817
driven_lanedir_min0.09661630461519932
in-drivable-lane_max5.5333333333333155
in-drivable-lane_mean1.1066666666666631
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.335077676280056, "driven_lanedir": 3.4404528004211294, "in-drivable-lane": 5.5333333333333155, "deviation-heading": 1.3761465772748154, "deviation-center-line": 2.1235083846562373}, "ep001": {"driven_any": 0.3105964155580236, "driven_lanedir": 0.29833307519294916, "in-drivable-lane": 0, "deviation-heading": 0.20947452673521263, "deviation-center-line": 0.07470620860767714}, "ep002": {"driven_any": 0.12844259717557582, "driven_lanedir": 0.09661630461519932, "in-drivable-lane": 0, "deviation-heading": 0.25911674080598396, "deviation-center-line": 0.026989637289038207}, "ep003": {"driven_any": 0.37489825618844, "driven_lanedir": 0.3651586083928191, "in-drivable-lane": 0, "deviation-heading": 0.19399070616299244, "deviation-center-line": 0.10157925902155177}, "ep004": {"driven_any": 0.16058644345655726, "driven_lanedir": 0.14865114229481136, "in-drivable-lane": 0, "deviation-heading": 0.15588157513566775, "deviation-center-line": 0.05224179214123658}}
13289679MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3720:01:02(hidden)
other stats
videos1
13283423MandanaSamieiPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3720:01:08(hidden)
driven_lanedir_median0.6115409567358798
deviation-center-line_median0.1326971889976422
i