AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 332

evaluator332
ownerAndrea Censi
machineidsc-rudolf
processrudolf-9
versionDC:3.1.56;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success366
# timeout1
# failed43
# error7
# aborted39
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
96171224tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.18593727052428743
deviation-center-line_median0.13545724334442524
in-drivable-lane_median0


other stats
deviation-center-line_max0.2121252201534077
deviation-center-line_mean0.15204467621031437
deviation-center-line_min0.0907236145497465
deviation-heading_max1.8103033288132035
deviation-heading_mean0.8249094550042821
deviation-heading_median0.619221007243969
deviation-heading_min0.3806880627276445
driven_any_max0.5535890739311885
driven_any_mean0.24785545912074977
driven_any_median0.20712862085625497
driven_any_min0.08927803999964294
driven_lanedir_max0.2864168380688654
driven_lanedir_mean0.1796007061408972
driven_lanedir_min0.07496946865388754
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5535890739311885, "driven_lanedir": 0.2864168380688654, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8103033288132035, "deviation-center-line": 0.2121252201534077}, "ep001": {"driven_any": 0.08927803999964294, "driven_lanedir": 0.07496946865388754, "in-drivable-lane": 0, "deviation-heading": 0.3806880627276445, "deviation-center-line": 0.0907236145497465}, "ep002": {"driven_any": 0.15356656289145348, "driven_lanedir": 0.13200096264385608, "in-drivable-lane": 0, "deviation-heading": 0.619221007243969, "deviation-center-line": 0.12749989711054877}, "ep003": {"driven_any": 0.20712862085625497, "driven_lanedir": 0.18593727052428743, "in-drivable-lane": 0, "deviation-heading": 0.7317863776228286, "deviation-center-line": 0.13545724334442524}, "ep004": {"driven_any": 0.23571499792520892, "driven_lanedir": 0.21867899081358955, "in-drivable-lane": 0, "deviation-heading": 0.5825484986137648, "deviation-center-line": 0.19441740589344356}}
96131224tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
96081224tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9608-1705', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9608-1705', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9608-1705_evaluation" with the default driver
stderr | Creating job9608-1705_scorer_1 ...
stderr | 
Creating job9608-1705_scorer_1 ... error

stderr | ERROR: for job9608-1705_scorer_1  Cannot start service scorer: network job9608-1705_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9608-1705_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
96031222tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1807338873608093
deviation-center-line_median0.13452512547239487
in-drivable-lane_median0


other stats
deviation-center-line_max0.4124544142944212
deviation-center-line_mean0.18912194934377977
deviation-center-line_min0.06268266302842321
deviation-heading_max1.7871938259410494
deviation-heading_mean0.8226556950032606
deviation-heading_median0.5944441686133701
deviation-heading_min0.38613631001544
driven_any_max0.7857253580900156
driven_any_mean0.2899975734536556
driven_any_median0.2035598930350403
driven_any_min0.05713403004751415
driven_lanedir_max0.5414003755333896
driven_lanedir_mean0.2263753128558962
driven_lanedir_min0.04148445741543805
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7857253580900156, "driven_lanedir": 0.5414003755333896, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7871938259410494, "deviation-center-line": 0.4124544142944212}, "ep001": {"driven_any": 0.05713403004751415, "driven_lanedir": 0.04148445741543805, "in-drivable-lane": 0, "deviation-heading": 0.38613631001544, "deviation-center-line": 0.06268266302842321}, "ep002": {"driven_any": 0.16785200488169094, "driven_lanedir": 0.14806636739144352, "in-drivable-lane": 0, "deviation-heading": 0.5944441686133701, "deviation-center-line": 0.13452512547239487}, "ep003": {"driven_any": 0.2035598930350403, "driven_lanedir": 0.1807338873608093, "in-drivable-lane": 0, "deviation-heading": 0.7686117058905607, "deviation-center-line": 0.13346968114615476}, "ep004": {"driven_any": 0.23571658121401692, "driven_lanedir": 0.22019147657840055, "in-drivable-lane": 0, "deviation-heading": 0.5768924645558832, "deviation-center-line": 0.20247786277750465}}
96001222tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9666666666666697


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -4.719582723466226, "good_angle": 0.827690981535544, "survival_time": 7.399999999999984, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 18, "reward": -56.20794405208694, "good_angle": 0.3910074945079643, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 49, "reward": -20.86513386332259, "good_angle": 0.4576640242189694, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.6666666666666685}, "ep003": {"nsteps": 59, "reward": -17.31513208580219, "good_angle": 0.5169655128458458, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.9000000000000025}, "ep004": {"nsteps": 68, "reward": -15.1840578650727, "good_angle": 0.3522119257447155, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.5666666666666664}}
good_angle_max0.827690981535544
good_angle_mean0.5091079877706078
good_angle_median0.4576640242189694
good_angle_min0.3522119257447155
reward_max-4.719582723466226
reward_mean-22.85837011795013
reward_median-17.31513208580219
reward_min-56.20794405208694
survival_time_max7.399999999999984
survival_time_mean2.773333333333331
survival_time_min0.6
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.8066666666666664
valid_direction_median0.6666666666666685
valid_direction_min0.4333333333333333
95891221tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 304, "reward": -3.544891038253186, "good_angle": 0.6149347500527267, "survival_time": 10.133333333333308, "traveled_tiles": 3, "valid_direction": 1.0333333333333297}, "ep001": {"nsteps": 18, "reward": -56.21945972906219, "good_angle": 0.39524455375135303, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 54, "reward": -19.004341699458937, "good_angle": 0.35626957262112674, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 0.8666666666666689}, "ep003": {"nsteps": 181, "reward": -5.987739168766124, "good_angle": 0.07938019184648165, "survival_time": 6.033333333333322, "traveled_tiles": 2, "valid_direction": 0.06666666666666671}, "ep004": {"nsteps": 69, "reward": -14.957443509844769, "good_angle": 0.40783681279472545, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.7}}
good_angle_max0.6149347500527267
good_angle_mean0.37073317621328267
good_angle_median0.39524455375135303
good_angle_min0.07938019184648165
reward_max-3.544891038253186
reward_mean-19.942775029077037
reward_median-14.957443509844769
reward_min-56.21945972906219
survival_time_max10.133333333333308
survival_time_mean4.173333333333327
survival_time_min0.6
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.0333333333333297
valid_direction_mean0.6266666666666664
valid_direction_median0.7
valid_direction_min0.06666666666666671
95841220MandanaSamieiImproved ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
95811220MandanaSamieiImproved ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3320:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9581-5327', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9581-5327', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9581-5327_evaluation" with the default driver
stderr | Creating job9581-5327_scorer_1 ...
stderr | 
Creating job9581-5327_scorer_1 ... error

stderr | ERROR: for job9581-5327_scorer_1  Cannot start service scorer: network job9581-5327_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9581-5327_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
95711219MandanaSamieiImproved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3320:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9571-7794', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9571-7794', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9571-7794_evaluation" with the default driver
stderr | Creating job9571-7794_visualization_1 ...
stderr | 
Creating job9571-7794_visualization_1 ... error

stderr | ERROR: for job9571-7794_visualization_1  Cannot start service visualization: network job9571-7794_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9571-7794_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
95581218JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3320:01:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
95541218JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.09804204974533058, "good_angle": 1.1029803703513434, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.6999999999999904}, "ep001": {"nsteps": 33, "reward": -30.893865944761217, "good_angle": 0.005861928445149117, "survival_time": 1.1, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.17009984451299534, "good_angle": 0.9263830970823708, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.1333333333333275}, "ep003": {"nsteps": 500, "reward": -0.1293248508713441, "good_angle": 1.1081828344412037, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.8999999999999897}, "ep004": {"nsteps": 500, "reward": -0.33169459652155636, "good_angle": 15.213106584682173, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 3.333333333333332}}
good_angle_max15.213106584682173
good_angle_mean3.671302963000448
good_angle_median1.1029803703513434
good_angle_min0.005861928445149117
reward_max-0.09804204974533058
reward_mean-6.324605457282489
reward_median-0.17009984451299534
reward_min-30.893865944761217
survival_time_max16.666666666666654
survival_time_mean13.553333333333324
survival_time_min1.1
traveled_tiles_max13
traveled_tiles_mean10
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max3.333333333333332
valid_direction_mean2.213333333333328
valid_direction_median2.6999999999999904
valid_direction_min0
95361217pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes3320:00:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
95321217pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9666666666666697


other stats
episodes
details{"ep000": {"nsteps": 77, "reward": -13.45209427590349, "good_angle": 1.6972135069765173, "survival_time": 2.5666666666666673, "traveled_tiles": 2, "valid_direction": 1.2333333333333332}, "ep001": {"nsteps": 59, "reward": -17.41927915849423, "good_angle": 1.984803598619705, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 1.6666666666666694}, "ep002": {"nsteps": 59, "reward": -17.332209585234523, "good_angle": 1.7016644552723914, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 1.7000000000000026}, "ep003": {"nsteps": 55, "reward": -18.766690986705097, "good_angle": 1.7208104625503398, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 1.5000000000000024}, "ep004": {"nsteps": 54, "reward": -19.025444146340575, "good_angle": 1.9358121763411735, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 1.6333333333333355}}
good_angle_max1.984803598619705
good_angle_mean1.8080608399520255
good_angle_median1.7208104625503398
good_angle_min1.6972135069765173
reward_max-13.45209427590349
reward_mean-17.19914363053558
reward_median-17.41927915849423
reward_min-19.025444146340575
survival_time_max2.5666666666666673
survival_time_mean2.026666666666669
survival_time_min1.8000000000000025
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.7000000000000026
valid_direction_mean1.5466666666666686
valid_direction_median1.6333333333333355
valid_direction_min1.2333333333333332
95221215VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:02:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
95051215VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:08:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
94961212iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
94871212iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
94801209BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3320:01:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
94761209BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.2333333333333


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6730641153701581, "good_angle": 1.1257769409562324, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.933333333333323}, "ep001": {"nsteps": 52, "reward": -19.990229403743378, "good_angle": 2.9851842843742027, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.3666666666666678}, "ep002": {"nsteps": 500, "reward": -0.7178257898052689, "good_angle": 1.356196950867545, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.066666666666656}, "ep003": {"nsteps": 367, "reward": -3.119152601437811, "good_angle": 0.4137677896881461, "survival_time": 12.2333333333333, "traveled_tiles": 9, "valid_direction": 1.1333333333333293}, "ep004": {"nsteps": 79, "reward": -13.080453655387782, "good_angle": 0.007977152289526793, "survival_time": 2.6333333333333337, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max2.9851842843742027
good_angle_mean1.1777806236351307
good_angle_median1.1257769409562324
good_angle_min0.007977152289526793
reward_max-0.6730641153701581
reward_mean-7.51614511314888
reward_median-3.119152601437811
reward_min-19.990229403743378
survival_time_max16.666666666666654
survival_time_mean9.986666666666654
survival_time_min1.7333333333333354
traveled_tiles_max12
traveled_tiles_mean7.4
traveled_tiles_median9
traveled_tiles_min2
valid_direction_max3.066666666666656
valid_direction_mean1.4999999999999951
valid_direction_median1.1333333333333293
valid_direction_min0
94711210iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
94671210iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
94631206MandanaSamieiImproved ROS-based solutionaido1_LF1_r3-v3step4-vizabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9463-3143', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9463-3143', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9463-3143_evaluation" with the default driver
stderr | Creating job9463-3143_visualization_1 ...
stderr | 
Creating job9463-3143_visualization_1 ... error

stderr | ERROR: for job9463-3143_visualization_1  Cannot start service visualization: network job9463-3143_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9463-3143_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
94581206MandanaSamieiImproved ROS-based solutionaido1_LF1_r3-v3step3-videossuccessyes3320:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
94511207iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
94461203BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3320:01:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
94411203BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3320:01:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7666666666666688


other stats
episodes
details{"ep000": {"nsteps": 94, "reward": -10.880140648332445, "good_angle": 0.2389941919765413, "survival_time": 3.133333333333332, "traveled_tiles": 3, "valid_direction": 0.2333333333333325}, "ep001": {"nsteps": 13, "reward": -77.54556220540634, "good_angle": 0.12722664664767305, "survival_time": 0.4333333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666666}, "ep002": {"nsteps": 22, "reward": -45.918432533741, "good_angle": 0.04667275508301345, "survival_time": 0.7333333333333333, "traveled_tiles": 2, "valid_direction": 0.1333333333333333}, "ep003": {"nsteps": 500, "reward": -0.7811867533139885, "good_angle": 1.41219851160597, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.3666666666666556}, "ep004": {"nsteps": 53, "reward": -19.349999496959292, "good_angle": 0.09429089177989708, "survival_time": 1.7666666666666688, "traveled_tiles": 2, "valid_direction": 0.2333333333333341}}
good_angle_max1.41219851160597
good_angle_mean0.38387659941861896
good_angle_median0.12722664664767305
good_angle_min0.04667275508301345
reward_max-0.7811867533139885
reward_mean-30.895064327550617
reward_median-19.349999496959292
reward_min-77.54556220540634
survival_time_max16.666666666666654
survival_time_mean4.546666666666664
survival_time_min0.4333333333333333
traveled_tiles_max12
traveled_tiles_mean4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.3666666666666556
valid_direction_mean0.8466666666666643
valid_direction_median0.2333333333333341
valid_direction_min0.1333333333333333
94301201sodabetastay youngaido1_LF1_r3-v3step4-vizsuccessyes3320:04:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.9481850444094272
deviation-center-line_median0.32550056241262193
in-drivable-lane_median8.333333333333329


other stats
deviation-center-line_max1.2153478135504625
deviation-center-line_mean0.5013748879986238
deviation-center-line_min0.1836695230091552
deviation-heading_max6.589855691489218
deviation-heading_mean6.042797634356681
deviation-heading_median6.496699690885762
deviation-heading_min4.0636220927726505
driven_any_max2.996874232173031
driven_any_mean2.993616762079564
driven_any_median2.9926748839663193
driven_any_min2.991757319703342
driven_lanedir_max-0.8008001232404311
driven_lanedir_mean-0.9192185952416204
driven_lanedir_min-0.9525014373938534
in-drivable-lane_max10.499999999999988
in-drivable-lane_mean8.759999999999994
in-drivable-lane_min8.299999999999997
per-episodes
details{"ep000": {"driven_any": 2.9920549928535545, "driven_lanedir": -0.8008001232404311, "in-drivable-lane": 10.499999999999988, "deviation-heading": 4.0636220927726505, "deviation-center-line": 1.2153478135504625}, "ep001": {"driven_any": 2.9926748839663193, "driven_lanedir": -0.94482519851542, "in-drivable-lane": 8.366666666666664, "deviation-heading": 6.496699690885762, "deviation-center-line": 0.507176031247422}, "ep002": {"driven_any": 2.994722381701575, "driven_lanedir": -0.94978117264897, "in-drivable-lane": 8.299999999999997, "deviation-heading": 6.576357487989261, "deviation-center-line": 0.2751805097734573}, "ep003": {"driven_any": 2.996874232173031, "driven_lanedir": -0.9481850444094272, "in-drivable-lane": 8.299999999999997, "deviation-heading": 6.589855691489218, "deviation-center-line": 0.1836695230091552}, "ep004": {"driven_any": 2.991757319703342, "driven_lanedir": -0.9525014373938534, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.487453208646515, "deviation-center-line": 0.32550056241262193}}
94191201sodabetastay youngaido1_LF1_r3-v3step2-scoringsuccessyes3320:02:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9740260388851166, "good_angle": 48.18570431826448, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.199999999999994}, "ep001": {"nsteps": 500, "reward": -1.3310678120851516, "good_angle": 13.696020621438183, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999991}, "ep002": {"nsteps": 500, "reward": -1.1231515201330184, "good_angle": 13.694909529387774, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.966666666666658}, "ep003": {"nsteps": 500, "reward": -0.934308636363945, "good_angle": 13.67484107418178, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.933333333333325}, "ep004": {"nsteps": 500, "reward": -1.1827638384401795, "good_angle": 13.717910197460723, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.86666666666666}}
good_angle_max48.18570431826448
good_angle_mean20.59387714814659
good_angle_median13.696020621438183
good_angle_min13.67484107418178
reward_max-0.934308636363945
reward_mean-1.1090635691814823
reward_median-1.1231515201330184
reward_min-1.3310678120851516
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.199999999999994
valid_direction_mean13.193333333333324
valid_direction_median12.966666666666658
valid_direction_min12.86666666666666
94131200BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3320:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
94071200BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 97, "reward": -10.544655245320737, "good_angle": 0.11173963995897508, "survival_time": 3.2333333333333316, "traveled_tiles": 3, "valid_direction": 0}, "ep001": {"nsteps": 30, "reward": -33.87644365131855, "good_angle": 0.023909317209167814, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.033333333333333326}, "ep002": {"nsteps": 500, "reward": -0.7842021786547266, "good_angle": 2.100840251866724, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.699999999999985}, "ep003": {"nsteps": 69, "reward": -14.911100610010866, "good_angle": 0.020366536763589224, "survival_time": 2.3000000000000016, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 27, "reward": -37.48049445395117, "good_angle": 0.15041063828894063, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.23333333333333328}}
good_angle_max2.100840251866724
good_angle_mean0.4814532768174794
good_angle_median0.11173963995897508
good_angle_min0.020366536763589224
reward_max-0.7842021786547266
reward_mean-19.51937922785121
reward_median-14.911100610010866
reward_min-37.48049445395117
survival_time_max16.666666666666654
survival_time_mean4.819999999999997
survival_time_min0.8999999999999999
traveled_tiles_max12
traveled_tiles_mean3.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.699999999999985
valid_direction_mean0.9933333333333304
valid_direction_median0.033333333333333326
valid_direction_min0
93971200BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3320:03:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
93841197iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
93661193BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationabortedno3320:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9366-4112', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9366-4112', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9366-4112_evaluation" with the default driver
stderr | Creating job9366-4112_evaluator_1 ...
stderr | Creating job9366-4112_solution_1  ...
stderr | 
Creating job9366-4112_evaluator_1 ... error

stderr | ERROR: for job9366-4112_evaluator_1  Cannot start service evaluator: network job9366-4112_evaluation not found
stderr | 
Creating job9366-4112_solution_1  ... error

stderr | ERROR: for job9366-4112_solution_1  Cannot start service solution: network job9366-4112_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9366-4112_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9366-4112_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
93611192sodabetastay youngaido1_LF1_r3-v3step1-simulationerrorno3320:00:47
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
93551191BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationfailedno3320:08:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
93461188VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:02:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
93431188VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3320:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9343-1593', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9343-1593', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9343-1593_evaluation" with the default driver
stderr | Creating job9343-1593_scorer_1 ...
stderr | 
Creating job9343-1593_scorer_1 ... error

stderr | ERROR: for job9343-1593_scorer_1  Cannot start service scorer: network job9343-1593_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9343-1593_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
93351188VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:07:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
93301183BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3320:03:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.572094622720567
deviation-center-line_median1.0268326650454336
in-drivable-lane_median2.9000000000000252


other stats
deviation-center-line_max2.4722919320783845
deviation-center-line_mean1.1883245653497636
deviation-center-line_min0.12547869475003498
deviation-heading_max2.001039106664222
deviation-heading_mean1.3843315777054772
deviation-heading_median1.5516034705839648
deviation-heading_min0.06150333227412977
driven_any_max6.29911149925698
driven_any_mean5.098661940666561
driven_any_median6.282667364114203
driven_any_min0.4376161423520308
driven_lanedir_max6.237488834148862
driven_lanedir_mean3.759713838351967
driven_lanedir_min0.4368002742591542
in-drivable-lane_max7.066666666666675
in-drivable-lane_mean3.3800000000000026
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.189798211292995, "driven_lanedir": 3.4514667299345216, "in-drivable-lane": 7.066666666666675, "deviation-heading": 1.804691978191281, "deviation-center-line": 0.9945927606481}, "ep001": {"driven_any": 0.4376161423520308, "driven_lanedir": 0.4368002742591542, "in-drivable-lane": 0, "deviation-heading": 0.06150333227412977, "deviation-center-line": 0.12547869475003498}, "ep002": {"driven_any": 6.284116486316595, "driven_lanedir": 3.572094622720567, "in-drivable-lane": 6.93333333333331, "deviation-heading": 1.5028200008137895, "deviation-center-line": 1.3224267742268647}, "ep003": {"driven_any": 6.282667364114203, "driven_lanedir": 5.100718730696729, "in-drivable-lane": 2.9000000000000252, "deviation-heading": 2.001039106664222, "deviation-center-line": 1.0268326650454336}, "ep004": {"driven_any": 6.29911149925698, "driven_lanedir": 6.237488834148862, "in-drivable-lane": 0, "deviation-heading": 1.5516034705839648, "deviation-center-line": 2.4722919320783845}}
93231183BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3320:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
93191183BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6577665891668876, "good_angle": 0.9337697894955168, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.2333333333333254}, "ep001": {"nsteps": 36, "reward": -28.324007783499027, "good_angle": 0.00434334770210872, "survival_time": 1.2000000000000004, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.7150965188799892, "good_angle": 0.8009578206121651, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.0666666666666593}, "ep003": {"nsteps": 500, "reward": -0.45919114929344507, "good_angle": 0.5955313596451927, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.4333333333333282}, "ep004": {"nsteps": 500, "reward": -0.45975916462694294, "good_angle": 22.276000348281308, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.7666666666666835}}
good_angle_max22.276000348281308
good_angle_mean4.922120533147258
good_angle_median0.8009578206121651
good_angle_min0.00434334770210872
reward_max-0.45919114929344507
reward_mean-6.123164241093258
reward_median-0.6577665891668876
reward_min-28.324007783499027
survival_time_max16.666666666666654
survival_time_mean13.573333333333323
survival_time_min1.2000000000000004
traveled_tiles_max13
traveled_tiles_mean10.2
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max2.7666666666666835
valid_direction_mean1.6999999999999993
valid_direction_median2.0666666666666593
valid_direction_min0
93101182MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3320:10:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
93011180BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3320:01:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
92951180BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.2873053438300849, "good_angle": 1.3414091196782951, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.899999999999986}, "ep001": {"nsteps": 103, "reward": -10.591722322211972, "good_angle": 8.236018385735145, "survival_time": 3.433333333333331, "traveled_tiles": 2, "valid_direction": 2.333333333333331}, "ep002": {"nsteps": 500, "reward": -0.2954915684715379, "good_angle": 1.4333918973833295, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.566666666666654}, "ep003": {"nsteps": 500, "reward": -0.23761464420356787, "good_angle": 1.121569714476965, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.599999999999987}, "ep004": {"nsteps": 135, "reward": -8.226718127812017, "good_angle": 11.429720028085429, "survival_time": 4.499999999999994, "traveled_tiles": 3, "valid_direction": 2.099999999999994}}
good_angle_max11.429720028085429
good_angle_mean4.712421829071832
good_angle_median1.4333918973833295
good_angle_min1.121569714476965
reward_max-0.23761464420356787
reward_mean-3.927770401305835
reward_median-0.2954915684715379
reward_min-10.591722322211972
survival_time_max16.666666666666654
survival_time_mean11.586666666666655
survival_time_min3.433333333333331
traveled_tiles_max12
traveled_tiles_mean8.2
traveled_tiles_median12
traveled_tiles_min2
valid_direction_max4.566666666666654
valid_direction_mean3.29999999999999
valid_direction_median3.599999999999987
valid_direction_min2.099999999999994
92911181tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 217, "reward": -4.842466158233905, "good_angle": 0.948393067959257, "survival_time": 7.233333333333317, "traveled_tiles": 2, "valid_direction": 1.999999999999993}, "ep001": {"nsteps": 54, "reward": -19.071285682143987, "good_angle": 0.02955953031078824, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 188, "reward": -5.826680191178271, "good_angle": 0.04020312858748907, "survival_time": 6.266666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 56, "reward": -18.223405375810607, "good_angle": 0.5759211627899659, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0.9333333333333358}, "ep004": {"nsteps": 69, "reward": -14.968534817298254, "good_angle": 0.4190348981693709, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.5666666666666662}}
good_angle_max0.948393067959257
good_angle_mean0.4026223575633742
good_angle_median0.4190348981693709
good_angle_min0.02955953031078824
reward_max-4.842466158233905
reward_mean-12.586474444933003
reward_median-14.968534817298254
reward_min-19.071285682143987
survival_time_max7.233333333333317
survival_time_mean3.8933333333333286
survival_time_min1.8000000000000025
traveled_tiles_max3
traveled_tiles_mean1.6
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.999999999999993
valid_direction_mean0.699999999999999
valid_direction_median0.5666666666666662
valid_direction_min0
92851181tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
92781178tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.28060777012340976
deviation-center-line_median0.22721196650330475
in-drivable-lane_median0


other stats
deviation-center-line_max0.397387598231267
deviation-center-line_mean0.25293935350159086
deviation-center-line_min0.13210976538295569
deviation-heading_max1.7444564974638874
deviation-heading_mean0.7954867340184384
deviation-heading_median0.6045070411462525
deviation-heading_min0.2618915420632834
driven_any_max0.5678510646493321
driven_any_mean0.3450032324283415
driven_any_median0.2821608403404374
driven_any_min0.19998585583219508
driven_lanedir_max0.42669405448571496
driven_lanedir_mean0.2838617218300153
driven_lanedir_min0.1775901034723475
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5678510646493321, "driven_lanedir": 0.3130090110394963, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7444564974638874, "deviation-center-line": 0.22721196650330475}, "ep001": {"driven_any": 0.2821608403404374, "driven_lanedir": 0.28060777012340976, "in-drivable-lane": 0, "deviation-heading": 0.2618915420632834, "deviation-center-line": 0.30221720153425513}, "ep002": {"driven_any": 0.43572704749065816, "driven_lanedir": 0.42669405448571496, "in-drivable-lane": 0, "deviation-heading": 0.5989330467566464, "deviation-center-line": 0.397387598231267}, "ep003": {"driven_any": 0.19998585583219508, "driven_lanedir": 0.1775901034723475, "in-drivable-lane": 0, "deviation-heading": 0.7676455426621223, "deviation-center-line": 0.13210976538295569}, "ep004": {"driven_any": 0.2392913538290846, "driven_lanedir": 0.22140767002910788, "in-drivable-lane": 0, "deviation-heading": 0.6045070411462525, "deviation-center-line": 0.20577023585617177}}
92721178tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.7


other stats
episodes
details{"ep000": {"nsteps": 161, "reward": -6.347270734272666, "good_angle": 1.0985396853199512, "survival_time": 5.366666666666657, "traveled_tiles": 2, "valid_direction": 2.06666666666666}, "ep001": {"nsteps": 81, "reward": -12.93681447631047, "good_angle": 0.02926790529772029, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 124, "reward": -8.565655554254208, "good_angle": 0.226684440214113, "survival_time": 4.133333333333328, "traveled_tiles": 2, "valid_direction": 0.33333333333333215}, "ep003": {"nsteps": 58, "reward": -17.610239930579375, "good_angle": 0.5087837344309827, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 0.8666666666666691}, "ep004": {"nsteps": 69, "reward": -14.975191583667977, "good_angle": 0.4005178776614758, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.6333333333333331}}
good_angle_max1.0985396853199512
good_angle_mean0.45275872858484856
good_angle_median0.4005178776614758
good_angle_min0.02926790529772029
reward_max-6.347270734272666
reward_mean-12.08703445581694
reward_median-12.93681447631047
reward_min-17.610239930579375
survival_time_max5.366666666666657
survival_time_mean3.2866666666666644
survival_time_min1.933333333333336
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max2.06666666666666
valid_direction_mean0.7799999999999988
valid_direction_median0.6333333333333331
valid_direction_min0
92671178tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
92611177tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3140615527405992
deviation-center-line_median0.2120344929627202
in-drivable-lane_median0


other stats
deviation-center-line_max0.3825504647991373
deviation-center-line_mean0.2555782149297515
deviation-center-line_min0.13299211806624614
deviation-heading_max1.8124373524520645
deviation-heading_mean0.8371617918782187
deviation-heading_median0.6068979230123304
deviation-heading_min0.43067669951320775
driven_any_max0.5857327986545419
driven_any_mean0.3564370675813312
driven_any_median0.3214398113505129
driven_any_min0.20355954308580224
driven_lanedir_max0.41144029184237896
driven_lanedir_mean0.29196390143672385
driven_lanedir_min0.1819474087964288
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5857327986545419, "driven_lanedir": 0.32097209404557536, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8124373524520645, "deviation-center-line": 0.2120344929627202}, "ep001": {"driven_any": 0.3214398113505129, "driven_lanedir": 0.3140615527405992, "in-drivable-lane": 0, "deviation-heading": 0.43067669951320775, "deviation-center-line": 0.34423621628418904}, "ep002": {"driven_any": 0.4214477505013758, "driven_lanedir": 0.41144029184237896, "in-drivable-lane": 0, "deviation-heading": 0.6068979230123304, "deviation-center-line": 0.3825504647991373}, "ep003": {"driven_any": 0.20355954308580224, "driven_lanedir": 0.1819474087964288, "in-drivable-lane": 0, "deviation-heading": 0.739481192030715, "deviation-center-line": 0.13299211806624614}, "ep004": {"driven_any": 0.25000543431442346, "driven_lanedir": 0.23139815975863695, "in-drivable-lane": 0, "deviation-heading": 0.5963157923827757, "deviation-center-line": 0.2060777825364651}}
92551177tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0666666666666655


other stats
episodes
details{"ep000": {"nsteps": 166, "reward": -6.141837795618473, "good_angle": 1.3372447534482463, "survival_time": 5.5333333333333234, "traveled_tiles": 2, "valid_direction": 1.5333333333333283}, "ep001": {"nsteps": 92, "reward": -11.470290093966153, "good_angle": 0.1948014519258836, "survival_time": 3.0666666666666655, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 120, "reward": -8.832488053292035, "good_angle": 0.2355197720158204, "survival_time": 3.999999999999995, "traveled_tiles": 2, "valid_direction": 0.36666666666666536}, "ep003": {"nsteps": 59, "reward": -17.311628508618323, "good_angle": 0.5058377228999453, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.6666666666666686}, "ep004": {"nsteps": 72, "reward": -14.349266663193704, "good_angle": 0.4221524329968228, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.5333333333333321}}
good_angle_max1.3372447534482463
good_angle_mean0.5391112266573437
good_angle_median0.4221524329968228
good_angle_min0.1948014519258836
reward_max-6.141837795618473
reward_mean-11.621102222937738
reward_median-11.470290093966153
reward_min-17.311628508618323
survival_time_max5.5333333333333234
survival_time_mean3.393333333333331
survival_time_min1.9666666666666697
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.5333333333333283
valid_direction_mean0.6799999999999986
valid_direction_median0.5333333333333321
valid_direction_min0.29999999999999893
92491176tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2897700948456188
deviation-center-line_median0.21325377575604887
in-drivable-lane_median0


other stats
deviation-center-line_max0.3839568997326553
deviation-center-line_mean0.26090764562259866
deviation-center-line_min0.125734762295888
deviation-heading_max1.8553375980302735
deviation-heading_mean0.8580896591975599
deviation-heading_median0.5903936570676821
deviation-heading_min0.4743116047801178
driven_any_max0.5607378452704351
driven_any_mean0.35572159647264345
driven_any_median0.3535794096134567
driven_any_min0.19642466917282783
driven_lanedir_max0.40935666493497447
driven_lanedir_mean0.28993617177336456
driven_lanedir_min0.16896276576503633
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5607378452704351, "driven_lanedir": 0.2897700948456188, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8553375980302735, "deviation-center-line": 0.20787567150415448}, "ep001": {"driven_any": 0.3535794096134567, "driven_lanedir": 0.3464077223005848, "in-drivable-lane": 0, "deviation-heading": 0.4743116047801178, "deviation-center-line": 0.37371711882424674}, "ep002": {"driven_any": 0.41787113051790353, "driven_lanedir": 0.40935666493497447, "in-drivable-lane": 0, "deviation-heading": 0.5903936570676821, "deviation-center-line": 0.3839568997326553}, "ep003": {"driven_any": 0.19642466917282783, "driven_lanedir": 0.16896276576503633, "in-drivable-lane": 0, "deviation-heading": 0.7825890900920623, "deviation-center-line": 0.125734762295888}, "ep004": {"driven_any": 0.24999492778859425, "driven_lanedir": 0.23518361102060847, "in-drivable-lane": 0, "deviation-heading": 0.5878163460176635, "deviation-center-line": 0.21325377575604887}}
92441176tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
92391176tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.3666666666666645


other stats
episodes
details{"ep000": {"nsteps": 159, "reward": -6.4198667989727465, "good_angle": 1.4492498835654923, "survival_time": 5.299999999999991, "traveled_tiles": 2, "valid_direction": 1.7999999999999945}, "ep001": {"nsteps": 101, "reward": -10.492905078252944, "good_angle": 0.1911827441975591, "survival_time": 3.3666666666666645, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 119, "reward": -8.908292793927073, "good_angle": 0.20649372294072615, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 0.36666666666666536}, "ep003": {"nsteps": 57, "reward": -17.91029588159239, "good_angle": 0.6202963302408272, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.800000000000002}, "ep004": {"nsteps": 72, "reward": -14.361503334922922, "good_angle": 0.3358323416537987, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.6999999999999993}}
good_angle_max1.4492498835654923
good_angle_mean0.5606110045196807
good_angle_median0.3358323416537987
good_angle_min0.1911827441975591
reward_max-6.4198667989727465
reward_mean-11.618572777533617
reward_median-10.492905078252944
reward_min-17.91029588159239
survival_time_max5.299999999999991
survival_time_mean3.3866666666666645
survival_time_min1.9000000000000024
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.7999999999999945
valid_direction_mean0.7866666666666654
valid_direction_median0.6999999999999993
valid_direction_min0.2666666666666657
92351175iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3198292882388407
deviation-center-line_median0.3442140004326623
in-drivable-lane_median0


other stats
deviation-center-line_max0.5084977754733367
deviation-center-line_mean0.32637755156458204
deviation-center-line_min0.20114700328454913
deviation-heading_max1.8488730206868011
deviation-heading_mean0.7564527184775777
deviation-heading_median0.5850884342234284
deviation-heading_min0.27352241127514826
driven_any_max0.5964671643893983
driven_any_mean0.42287287430129605
driven_any_median0.41073337460861187
driven_any_min0.2464243866716373
driven_lanedir_max0.5919301267665276
driven_lanedir_mean0.3641701319700679
driven_lanedir_min0.2315471302427792
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5392933092678736, "driven_lanedir": 0.2715638656812289, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8488730206868011, "deviation-center-line": 0.2179565389959786}, "ep001": {"driven_any": 0.32144613656895954, "driven_lanedir": 0.3198292882388407, "in-drivable-lane": 0, "deviation-heading": 0.27352241127514826, "deviation-center-line": 0.3442140004326623}, "ep002": {"driven_any": 0.41073337460861187, "driven_lanedir": 0.4059802489209632, "in-drivable-lane": 0, "deviation-heading": 0.470396127433358, "deviation-center-line": 0.36007243963638347}, "ep003": {"driven_any": 0.5964671643893983, "driven_lanedir": 0.5919301267665276, "in-drivable-lane": 0, "deviation-heading": 0.6043835987691525, "deviation-center-line": 0.5084977754733367}, "ep004": {"driven_any": 0.2464243866716373, "driven_lanedir": 0.2315471302427792, "in-drivable-lane": 0, "deviation-heading": 0.5850884342234284, "deviation-center-line": 0.20114700328454913}}
92301175iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
92171175iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:03:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
92031174BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3320:07:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
91971172iban_alexROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 221, "reward": -4.680065435220433, "good_angle": 0.8143340540122375, "survival_time": 7.36666666666665, "traveled_tiles": 2, "valid_direction": 1.03333333333333}, "ep001": {"nsteps": 88, "reward": -11.970444464548068, "good_angle": 0.09934511537248952, "survival_time": 2.9333333333333327, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 48, "reward": -21.25994161920001, "good_angle": 0.5257756234168345, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.7000000000000017}, "ep003": {"nsteps": 61, "reward": -16.74233506925282, "good_angle": 0.4446579903733168, "survival_time": 2.033333333333336, "traveled_tiles": 1, "valid_direction": 0.8333333333333355}, "ep004": {"nsteps": 72, "reward": -14.358987438182035, "good_angle": 0.3486535214226296, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.599999999999999}}
good_angle_max0.8143340540122375
good_angle_mean0.4465532609195016
good_angle_median0.4446579903733168
good_angle_min0.09934511537248952
reward_max-4.680065435220433
reward_mean-13.802354805280675
reward_median-14.358987438182035
reward_min-21.25994161920001
survival_time_max7.36666666666665
survival_time_mean3.2666666666666644
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.03333333333333
valid_direction_mean0.693333333333333
valid_direction_median0.7000000000000017
valid_direction_min0.29999999999999893
91901172iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
91781170BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationerrorno3320:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Hidden. If you are the author, please login using the top-right link or use the dashboard.
91731167BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3320:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.26936507485481975
deviation-center-line_median0.07039598033995566
in-drivable-lane_median0


other stats
deviation-center-line_max0.11665430980832858
deviation-center-line_mean0.08227114373575059
deviation-center-line_min0.062318884862214464
deviation-heading_max0.735625189352947
deviation-heading_mean0.2853676486107783
deviation-heading_median0.2264361445357232
deviation-heading_min0.06311389727454018
driven_any_max0.4555315754961675
driven_any_mean0.33895657537295126
driven_any_median0.3336679407070042
driven_any_min0.20958298228081765
driven_lanedir_max0.4438433110342723
driven_lanedir_mean0.29098542539379046
driven_lanedir_min0.1278673760307676
in-drivable-lane_max0.2
in-drivable-lane_mean0.039999999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3336679407070042, "driven_lanedir": 0.1278673760307676, "in-drivable-lane": 0.2, "deviation-heading": 0.735625189352947, "deviation-center-line": 0.06943322117878079}, "ep001": {"driven_any": 0.20958298228081765, "driven_lanedir": 0.20825158682691616, "in-drivable-lane": 0, "deviation-heading": 0.06311389727454018, "deviation-center-line": 0.062318884862214464}, "ep002": {"driven_any": 0.4555315754961675, "driven_lanedir": 0.4438433110342723, "in-drivable-lane": 0, "deviation-heading": 0.23774405784705255, "deviation-center-line": 0.11665430980832858}, "ep003": {"driven_any": 0.4106124188478259, "driven_lanedir": 0.4055997782221765, "in-drivable-lane": 0, "deviation-heading": 0.16391895404362844, "deviation-center-line": 0.0925533224894735}, "ep004": {"driven_any": 0.2853879595329412, "driven_lanedir": 0.26936507485481975, "in-drivable-lane": 0, "deviation-heading": 0.2264361445357232, "deviation-center-line": 0.07039598033995566}}
91661167BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3320:01:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
91631166tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.833333333333333


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6136273357272148, "good_angle": 0.5537070922558297, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 1.90000000000002}, "ep001": {"nsteps": 85, "reward": -12.354958914307987, "good_angle": 0.21080076316883192, "survival_time": 2.833333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 50, "reward": -20.48418119311333, "good_angle": 0.6347664704960587, "survival_time": 1.6666666666666683, "traveled_tiles": 2, "valid_direction": 0.633333333333335}, "ep003": {"nsteps": 62, "reward": -16.497841009209232, "good_angle": 0.7729083682194203, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 0.7000000000000013}, "ep004": {"nsteps": 361, "reward": -2.9291283473774916, "good_angle": 7.2072485876985635, "survival_time": 12.0333333333333, "traveled_tiles": 3, "valid_direction": 3.366666666666659}}
good_angle_max7.2072485876985635
good_angle_mean1.8758862563677408
good_angle_median0.6347664704960587
good_angle_min0.21080076316883192
reward_max-0.6136273357272148
reward_mean-10.575947359947053
reward_median-12.354958914307987
reward_min-20.48418119311333
survival_time_max16.666666666666654
survival_time_mean7.053333333333325
survival_time_min1.6666666666666683
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.366666666666659
valid_direction_mean1.3733333333333362
valid_direction_median0.7000000000000013
valid_direction_min0.2666666666666657
91561164MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9156-2780', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9156-2780', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9156-2780_evaluation" with the default driver
stderr | Creating job9156-2780_visualization_1 ...
stderr | 
Creating job9156-2780_visualization_1 ... error

stderr | ERROR: for job9156-2780_visualization_1  Cannot start service visualization: network job9156-2780_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9156-2780_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
91461164MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1666666666666687


other stats
episodes
details{"ep000": {"nsteps": 224, "reward": -4.631782300203538, "good_angle": 0.8131950448457954, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 1.1333333333333309}, "ep001": {"nsteps": 27, "reward": -37.63428637495747, "good_angle": 0.35136522426430206, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 50, "reward": -20.46433407068253, "good_angle": 0.4230690672846215, "survival_time": 1.6666666666666683, "traveled_tiles": 2, "valid_direction": 0.7000000000000018}, "ep003": {"nsteps": 65, "reward": -15.740901627334264, "good_angle": 0.44774358190267566, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 0.8333333333333346}, "ep004": {"nsteps": 73, "reward": -14.169405204384294, "good_angle": 0.34434156301095536, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 0.4999999999999989}}
good_angle_max0.8131950448457954
good_angle_mean0.47594289626167
good_angle_median0.4230690672846215
good_angle_min0.34434156301095536
reward_max-4.631782300203538
reward_mean-18.528141915512418
reward_median-15.740901627334264
reward_min-37.63428637495747
survival_time_max7.46666666666665
survival_time_mean2.9266666666666636
survival_time_min0.8999999999999999
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.1333333333333309
valid_direction_mean0.7266666666666666
valid_direction_median0.7000000000000018
valid_direction_min0.4666666666666666
91421165BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3320:02:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
91391163BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videosabortedyes3320:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9139-7125', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9139-7125', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9139-7125_evaluation" with the default driver
stderr | Creating job9139-7125_videos_1 ...
stderr | 
Creating job9139-7125_videos_1 ... error

stderr | ERROR: for job9139-7125_videos_1  Cannot start service videos: network job9139-7125_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9139-7125_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
91341163BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringabortedyes3320:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9134-2322', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9134-2322', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9134-2322_evaluation" with the default driver
stderr | Creating job9134-2322_scorer_1 ...
stderr | 
Creating job9134-2322_scorer_1 ... error

stderr | ERROR: for job9134-2322_scorer_1  Cannot start service scorer: network job9134-2322_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9134-2322_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
91321163BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3320:01:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
91271162iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
91231161MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.207501904724555
deviation-center-line_median0.199117543008356
in-drivable-lane_median0


other stats
deviation-center-line_max0.36013014379892433
deviation-center-line_mean0.21890563089739185
deviation-center-line_min0.06610701022197295
deviation-heading_max1.8220352535204696
deviation-heading_mean0.8418700647081033
deviation-heading_median0.6176041495564573
deviation-heading_min0.3793079412520295
driven_any_max0.7750332700063921
driven_any_mean0.3300067493966062
driven_any_median0.22142968999939713
driven_any_min0.06070246001438254
driven_lanedir_max0.5276151666340869
driven_lanedir_mean0.26774277386120654
driven_lanedir_min0.04620417581966674
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7750332700063921, "driven_lanedir": 0.5276151666340869, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8220352535204696, "deviation-center-line": 0.36013014379892433}, "ep001": {"driven_any": 0.06070246001438254, "driven_lanedir": 0.04620417581966674, "in-drivable-lane": 0, "deviation-heading": 0.3793079412520295, "deviation-center-line": 0.06610701022197295}, "ep002": {"driven_any": 0.14641926940265107, "driven_lanedir": 0.12549941503869144, "in-drivable-lane": 0, "deviation-heading": 0.6176041495564573, "deviation-center-line": 0.12449797931105276}, "ep003": {"driven_any": 0.446449057560208, "driven_lanedir": 0.4318932070890326, "in-drivable-lane": 0, "deviation-heading": 0.7968429744010335, "deviation-center-line": 0.34467547814665306}, "ep004": {"driven_any": 0.22142968999939713, "driven_lanedir": 0.207501904724555, "in-drivable-lane": 0, "deviation-heading": 0.5935600048105273, "deviation-center-line": 0.199117543008356}}
91191161MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
91111161MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
91051160daredevilROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.966666666666666


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95936848815264, "good_angle": 0.4523226398291993, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 89, "reward": -11.722060765275794, "good_angle": 0.3368368393753734, "survival_time": 2.966666666666666, "traveled_tiles": 3, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 160, "reward": -6.5603199020959435, "good_angle": 0.375168348060673, "survival_time": 5.333333333333324, "traveled_tiles": 4, "valid_direction": 0.7999999999999972}, "ep004": {"nsteps": 121, "reward": -8.859963449884267, "good_angle": 7.247168345248417, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 1.399999999999995}}
good_angle_max7.247168345248417
good_angle_mean1.68312399336724
good_angle_median0.375168348060673
good_angle_min0.004123794322536422
reward_max-6.5603199020959435
reward_mean-19.874426403141097
reward_median-11.722060765275794
reward_min-36.270419410296846
survival_time_max5.333333333333324
survival_time_mean2.839999999999997
survival_time_min0.9333333333333332
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.399999999999995
valid_direction_mean0.7466666666666646
valid_direction_median0.7999999999999972
valid_direction_min0
91021158DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3320:03:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1101918964409605
deviation-center-line_median0.4264052630691605
in-drivable-lane_median10.333333333333334


other stats
deviation-center-line_max0.8858535845217879
deviation-center-line_mean0.5311440203468543
deviation-center-line_min0.234202886401531
deviation-heading_max1.4096575925372257
deviation-heading_mean0.8364169828850242
deviation-heading_median0.6608668232516459
deviation-heading_min0.340749904207677
driven_any_max4.640049332926225
driven_any_mean3.9162458484764726
driven_any_median4.637588355885155
driven_any_min2.4031890794300694
driven_lanedir_max1.7007899331865348
driven_lanedir_mean1.0827797427751649
driven_lanedir_min0.5633401627106651
in-drivable-lane_max13.93333333333332
in-drivable-lane_mean10.046666666666656
in-drivable-lane_min6.499999999999978
per-episodes
details{"ep000": {"driven_any": 3.261059175339024, "driven_lanedir": 1.1101918964409605, "in-drivable-lane": 7.699999999999976, "deviation-heading": 0.340749904207677, "deviation-center-line": 0.7351663906709174}, "ep001": {"driven_any": 4.637588355885155, "driven_lanedir": 1.3080523770740686, "in-drivable-lane": 11.766666666666662, "deviation-heading": 1.1881383356422144, "deviation-center-line": 0.4264052630691605}, "ep002": {"driven_any": 2.4031890794300694, "driven_lanedir": 0.5633401627106651, "in-drivable-lane": 6.499999999999978, "deviation-heading": 0.6608668232516459, "deviation-center-line": 0.234202886401531}, "ep003": {"driven_any": 4.639343298801891, "driven_lanedir": 0.7315243444635957, "in-drivable-lane": 13.93333333333332, "deviation-heading": 0.582672258786358, "deviation-center-line": 0.37409197707087416}, "ep004": {"driven_any": 4.640049332926225, "driven_lanedir": 1.7007899331865348, "in-drivable-lane": 10.333333333333334, "deviation-heading": 1.4096575925372257, "deviation-center-line": 0.8858535845217879}}
90961158DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3320:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
90921156MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22682055208981788
deviation-center-line_median0.20685353724444192
in-drivable-lane_median0


other stats
deviation-center-line_max0.3438949881944418
deviation-center-line_mean0.2294897469542859
deviation-center-line_min0.1323368790450466
deviation-heading_max1.7864186449786736
deviation-heading_mean0.8023591431457182
deviation-heading_median0.6083608666568896
deviation-heading_min0.29682051317084346
driven_any_max0.7821807938875655
driven_any_mean0.34286537120578225
driven_any_median0.24285852419726375
driven_any_min0.16070829106403728
driven_lanedir_max0.5370958971833832
driven_lanedir_mean0.28205755526882526
driven_lanedir_min0.1407045553147912
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7821807938875655, "driven_lanedir": 0.5370958971833832, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7864186449786736, "deviation-center-line": 0.33088608079042314}, "ep001": {"driven_any": 0.3250206310927961, "driven_lanedir": 0.32325673184379067, "in-drivable-lane": 0, "deviation-heading": 0.29682051317084346, "deviation-center-line": 0.3438949881944418}, "ep002": {"driven_any": 0.16070829106403728, "driven_lanedir": 0.1407045553147912, "in-drivable-lane": 0, "deviation-heading": 0.6083608666568896, "deviation-center-line": 0.1334772494970759}, "ep003": {"driven_any": 0.2035586157872487, "driven_lanedir": 0.18241003991234317, "in-drivable-lane": 0, "deviation-heading": 0.7476984117581289, "deviation-center-line": 0.1323368790450466}, "ep004": {"driven_any": 0.24285852419726375, "driven_lanedir": 0.22682055208981788, "in-drivable-lane": 0, "deviation-heading": 0.5724972791640558, "deviation-center-line": 0.20685353724444192}}
90771155orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step4-vizsuccessyes3320:02:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4191263213086181
deviation-center-line_median0.2133955691172394
in-drivable-lane_median3.6666666666666545


other stats
deviation-center-line_max0.7682024224971145
deviation-center-line_mean0.3092106397749039
deviation-center-line_min0.15544187546761248
deviation-heading_max2.397510274589595
deviation-heading_mean1.113178311662657
deviation-heading_median0.7793339123628685
deviation-heading_min0.15887850311444007
driven_any_max2.408529749764473
driven_any_mean1.2845537752179077
driven_any_median1.228346145363989
driven_any_min0.4223898486973128
driven_lanedir_max1.4297714032332258
driven_lanedir_mean0.5790803142850239
driven_lanedir_min0.301418228117613
in-drivable-lane_max8.333333333333306
in-drivable-lane_mean3.459999999999989
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.408529749764473, "driven_lanedir": 1.4297714032332258, "in-drivable-lane": 5.299999999999986, "deviation-heading": 2.397510274589595, "deviation-center-line": 0.7682024224971145}, "ep001": {"driven_any": 0.4223898486973128, "driven_lanedir": 0.4191263213086181, "in-drivable-lane": 0, "deviation-heading": 0.17155827029918472, "deviation-center-line": 0.2133955691172394}, "ep002": {"driven_any": 1.9395586908599585, "driven_lanedir": 0.301418228117613, "in-drivable-lane": 8.333333333333306, "deviation-heading": 2.058610597947196, "deviation-center-line": 0.25111311904332145}, "ep003": {"driven_any": 1.228346145363989, "driven_lanedir": 0.3233598066385248, "in-drivable-lane": 3.6666666666666545, "deviation-heading": 0.7793339123628685, "deviation-center-line": 0.15790021274923174}, "ep004": {"driven_any": 0.4239444414038046, "driven_lanedir": 0.4217258121271379, "in-drivable-lane": 0, "deviation-heading": 0.15887850311444007, "deviation-center-line": 0.15544187546761248}}
90641154BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3320:05:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
90591152iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.21550830194289936
deviation-center-line_median0.1974449326223282
in-drivable-lane_median0


other stats
deviation-center-line_max0.3690873456467426
deviation-center-line_mean0.2078889573124032
deviation-center-line_min0.12092993453408477
deviation-heading_max1.7970104457675162
deviation-heading_mean0.8396734311074644
deviation-heading_median0.5742535466768622
deviation-heading_min0.4532730876630539
driven_any_max0.5821560714738756
driven_any_mean0.298573489973921
driven_any_median0.22857351321845176
driven_any_min0.15712762241796052
driven_lanedir_max0.33229831008042865
driven_lanedir_mean0.23298634447059424
driven_lanedir_min0.1415705305787589
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5821560714738756, "driven_lanedir": 0.31933203541348143, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7970104457675162, "deviation-center-line": 0.2147581086569874}, "ep001": {"driven_any": 0.33929497550514376, "driven_lanedir": 0.33229831008042865, "in-drivable-lane": 0, "deviation-heading": 0.4532730876630539, "deviation-center-line": 0.3690873456467426}, "ep002": {"driven_any": 0.15712762241796052, "driven_lanedir": 0.1415705305787589, "in-drivable-lane": 0, "deviation-heading": 0.5742535466768622, "deviation-center-line": 0.13722446510187275}, "ep003": {"driven_any": 0.18571526725417337, "driven_lanedir": 0.1562225443374028, "in-drivable-lane": 0, "deviation-heading": 0.8203411438161585, "deviation-center-line": 0.12092993453408477}, "ep004": {"driven_any": 0.22857351321845176, "driven_lanedir": 0.21550830194289936, "in-drivable-lane": 0, "deviation-heading": 0.5534889316137311, "deviation-center-line": 0.1974449326223282}}
90541152iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
90481152iban_alexROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.200000000000002


other stats
episodes
details{"ep000": {"nsteps": 165, "reward": -6.174903824806891, "good_angle": 1.283565821367642, "survival_time": 5.49999999999999, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 97, "reward": -10.920560585469314, "good_angle": 0.18588145102361045, "survival_time": 3.2333333333333316, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 46, "reward": -22.23213052360908, "good_angle": 0.3563900941668696, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.8333333333333347}, "ep003": {"nsteps": 54, "reward": -18.898264500278017, "good_angle": 0.6519035773051937, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0.7000000000000022}, "ep004": {"nsteps": 66, "reward": -15.628937987215592, "good_angle": 0.3027082238358728, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6333333333333337}}
good_angle_max1.283565821367642
good_angle_mean0.5560898335398378
good_angle_median0.3563900941668696
good_angle_min0.18588145102361045
reward_max-6.174903824806891
reward_mean-14.770959484275778
reward_median-15.628937987215592
reward_min-22.23213052360908
survival_time_max5.49999999999999
survival_time_mean2.8533333333333326
survival_time_min1.5333333333333348
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.7866666666666662
valid_direction_median0.7000000000000022
valid_direction_min0.29999999999999893
90401147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes3320:03:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.993725116598154
deviation-center-line_median0.5250077714219962
in-drivable-lane_median0


other stats
deviation-center-line_max0.7726126305172341
deviation-center-line_mean0.5861487639610925
deviation-center-line_min0.4784991881634035
deviation-heading_max4.8001563106600385
deviation-heading_mean1.3576437708747016
deviation-heading_median0.4129115949793908
deviation-heading_min0.07942104943374341
driven_any_max0.9960000000000088
driven_any_mean0.7437333333333104
driven_any_median0.9959999999999054
driven_any_min0.36399999999998744
driven_lanedir_max0.9959758860580704
driven_lanedir_mean0.6994308115403024
driven_lanedir_min0.14899922016337996
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3666666666666991, "driven_lanedir": 0.14899922016337996, "in-drivable-lane": 1.500000000000001, "deviation-heading": 4.8001563106600385, "deviation-center-line": 0.4856116643692014}, "ep001": {"driven_any": 0.36399999999998744, "driven_lanedir": 0.3631534149294058, "in-drivable-lane": 0, "deviation-heading": 0.4129115949793908, "deviation-center-line": 0.6690125653336273}, "ep002": {"driven_any": 0.9959999999999518, "driven_lanedir": 0.9953004199525022, "in-drivable-lane": 0, "deviation-heading": 0.37171330518889034, "deviation-center-line": 0.7726126305172341}, "ep003": {"driven_any": 0.9959999999999054, "driven_lanedir": 0.9959758860580704, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374341, "deviation-center-line": 0.5250077714219962}, "ep004": {"driven_any": 0.9960000000000088, "driven_lanedir": 0.993725116598154, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4784991881634035}}
90351151krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailedno3320:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 556, in run
    solve(params, cis)
  File "solution.py", line 521, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 105, in step
    assert len(action) == 2
TypeError: object of type 'NoneType' has no len()


Hidden. If you are the author, please login using the top-right link or use the dashboard.
90251148krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videosabortedyes3320:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9025-549', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9025-549', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9025-549_evaluation" with the default driver
stderr | Creating job9025-549_videos_1 ...
stderr | 
Creating job9025-549_videos_1 ... error

stderr | ERROR: for job9025-549_videos_1  Cannot start service videos: network job9025-549_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9025-549_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
90201149daredevilROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.966666666666666


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95936848815264, "good_angle": 0.4523226398291993, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 89, "reward": -11.722060765275794, "good_angle": 0.3368368393753734, "survival_time": 2.966666666666666, "traveled_tiles": 3, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 160, "reward": -6.5603199020959435, "good_angle": 0.375168348060673, "survival_time": 5.333333333333324, "traveled_tiles": 4, "valid_direction": 0.7999999999999972}, "ep004": {"nsteps": 121, "reward": -8.859963449884267, "good_angle": 7.247168345248417, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 1.399999999999995}}
good_angle_max7.247168345248417
good_angle_mean1.68312399336724
good_angle_median0.375168348060673
good_angle_min0.004123794322536422
reward_max-6.5603199020959435
reward_mean-19.874426403141097
reward_median-11.722060765275794
reward_min-36.270419410296846
survival_time_max5.333333333333324
survival_time_mean2.839999999999997
survival_time_min0.9333333333333332
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.399999999999995
valid_direction_mean0.7466666666666646
valid_direction_median0.7999999999999972
valid_direction_min0
90121148krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationabortedno3320:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9012-7336', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9012-7336', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9012-7336_evaluation" with the default driver
stderr | Creating job9012-7336_solution_1 ...
stderr | Creating job9012-7336_evaluator_1 ...
stderr | 
Creating job9012-7336_solution_1  ... error

stderr | ERROR: for job9012-7336_solution_1  Cannot start service solution: network job9012-7336_evaluation not found
stderr | 
Creating job9012-7336_evaluator_1 ... error

stderr | ERROR: for job9012-7336_evaluator_1  Cannot start service evaluator: network job9012-7336_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9012-7336_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9012-7336_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
90081144VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:04:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.766216887792637
deviation-center-line_median1.0065939529985208
in-drivable-lane_median10.633333333333338


other stats
deviation-center-line_max2.060886647250259
deviation-center-line_mean1.3034017297130225
deviation-center-line_min0.7714244124291091
deviation-heading_max2.982981578967821
deviation-heading_mean1.6395480530831417
deviation-heading_median1.0447813802358168
deviation-heading_min0.9376552661037968
driven_any_max10.66903208544648
driven_any_mean10.668291646868228
driven_any_median10.668456758913718
driven_any_min10.666703621213706
driven_lanedir_max7.77956515729205
driven_lanedir_mean4.935970434534815
driven_lanedir_min2.8485590756121373
in-drivable-lane_max11.96666666666663
in-drivable-lane_mean8.593333333333328
in-drivable-lane_min3.766666666666689
per-episodes
details{"ep000": {"driven_any": 10.66903208544648, "driven_lanedir": 3.766216887792637, "in-drivable-lane": 10.633333333333338, "deviation-heading": 0.995428157851232, "deviation-center-line": 1.0065939529985208}, "ep001": {"driven_any": 10.666703621213706, "driven_lanedir": 7.77956515729205, "in-drivable-lane": 3.766666666666689, "deviation-heading": 2.982981578967821, "deviation-center-line": 2.060886647250259}, "ep002": {"driven_any": 10.66887253738005, "driven_lanedir": 3.7160019132437294, "in-drivable-lane": 10.699999999999974, "deviation-heading": 1.0447813802358168, "deviation-center-line": 0.963660002847558}, "ep003": {"driven_any": 10.66839323138717, "driven_lanedir": 2.8485590756121373, "in-drivable-lane": 11.96666666666663, "deviation-heading": 0.9376552661037968, "deviation-center-line": 0.7714244124291091}, "ep004": {"driven_any": 10.668456758913718, "driven_lanedir": 6.5695091387335225, "in-drivable-lane": 5.900000000000009, "deviation-heading": 2.2368938822570423, "deviation-center-line": 1.714443633039665}}
89981144VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:02:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
89931145BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3320:01:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
89881145BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3320:05:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
89811141BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3320:03:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.522617242685771
deviation-center-line_median1.0722181438139846
in-drivable-lane_median3.6666666666666536


other stats
deviation-center-line_max2.427560823019536
deviation-center-line_mean0.989303812396787
deviation-center-line_min0.07084844041760953
deviation-heading_max2.9940108666606484
deviation-heading_mean1.6738970044968795
deviation-heading_median1.1978509745800303
deviation-heading_min0.7098822712947942
driven_any_max6.368037280314137
driven_any_mean4.093409343802219
driven_any_median6.270558193861044
driven_any_min0.3466666666666718
driven_lanedir_max4.968473186127305
driven_lanedir_mean3.024454216109337
driven_lanedir_min0.14089729353622693
in-drivable-lane_max4.2666666666666515
in-drivable-lane_mean2.5466666666666575
in-drivable-lane_min0.2
per-episodes
details{"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 1.1775735695514091, "driven_lanedir": 0.9286859742671404, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 1.1978509745800303, "deviation-center-line": 0.2442298264141319}, "ep002": {"driven_any": 6.270558193861044, "driven_lanedir": 4.522617242685771, "in-drivable-lane": 4.199999999999985, "deviation-heading": 2.9940108666606484, "deviation-center-line": 1.0722181438139846}, "ep003": {"driven_any": 6.304211008617831, "driven_lanedir": 4.561597383930241, "in-drivable-lane": 4.2666666666666515, "deviation-heading": 2.558912564235724, "deviation-center-line": 1.131661828318672}, "ep004": {"driven_any": 6.368037280314137, "driven_lanedir": 4.968473186127305, "in-drivable-lane": 3.6666666666666536, "deviation-heading": 0.9088283457132, "deviation-center-line": 2.427560823019536}}
89761142iban_alexROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9000000000000024


other stats
episodes
details{"ep000": {"nsteps": 227, "reward": -4.583543770364998, "good_angle": 0.738769635694076, "survival_time": 7.5666666666666496, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 22, "reward": -46.080067251216285, "good_angle": 0.334784063353372, "survival_time": 0.7333333333333333, "traveled_tiles": 1, "valid_direction": 0.49999999999999994}, "ep002": {"nsteps": 49, "reward": -20.86456341098766, "good_angle": 0.415166648643947, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.6000000000000018}, "ep003": {"nsteps": 57, "reward": -17.917557120715315, "good_angle": 0.49385780909770777, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.8666666666666687}, "ep004": {"nsteps": 72, "reward": -14.377016751716534, "good_angle": 0.3078218672480584, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.5999999999999992}}
good_angle_max0.738769635694076
good_angle_mean0.4580800048074322
good_angle_median0.415166648643947
good_angle_min0.3078218672480584
reward_max-4.583543770364998
reward_mean-20.76454966100016
reward_median-17.917557120715315
reward_min-46.080067251216285
survival_time_max7.5666666666666496
survival_time_mean2.846666666666664
survival_time_min0.7333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.8066666666666663
valid_direction_median0.6000000000000018
valid_direction_min0.49999999999999994
89681142iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
89571140BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationfailedno3320:08:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
89561138daredevilPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3320:00:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
89551138daredevilPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.966666666666666


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95936848815264, "good_angle": 0.4523226398291993, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 89, "reward": -11.722060765275794, "good_angle": 0.3368368393753734, "survival_time": 2.966666666666666, "traveled_tiles": 3, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 160, "reward": -6.5603199020959435, "good_angle": 0.375168348060673, "survival_time": 5.333333333333324, "traveled_tiles": 4, "valid_direction": 0.7999999999999972}, "ep004": {"nsteps": 121, "reward": -8.859963449884267, "good_angle": 7.247168345248417, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 1.399999999999995}}
good_angle_max7.247168345248417
good_angle_mean1.68312399336724
good_angle_median0.375168348060673
good_angle_min0.004123794322536422
reward_max-6.5603199020959435
reward_mean-19.874426403141097
reward_median-11.722060765275794
reward_min-36.270419410296846
survival_time_max5.333333333333324
survival_time_mean2.839999999999997
survival_time_min0.9333333333333332
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.399999999999995
valid_direction_mean0.7466666666666646
valid_direction_median0.7999999999999972
valid_direction_min0
89531138daredevilPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3320:01:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
89461135krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes3320:01:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
89441135krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.3437076188921928, "good_angle": 55.135940055131385, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.666666666666654}, "ep001": {"nsteps": 500, "reward": -1.8242227222919465, "good_angle": 13.666679662354603, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.166666666666652}, "ep002": {"nsteps": 500, "reward": -1.641465624094009, "good_angle": 13.613143380984368, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.699999999999989}, "ep003": {"nsteps": 500, "reward": -1.4529106883704663, "good_angle": 13.631613664217934, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.866666666666656}, "ep004": {"nsteps": 500, "reward": -1.6807689650654791, "good_angle": 13.627327985051023, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.866666666666656}}
good_angle_max55.135940055131385
good_angle_mean21.934940949547865
good_angle_median13.631613664217934
good_angle_min13.613143380984368
reward_max-1.3437076188921928
reward_mean-1.588615123742819
reward_median-1.641465624094009
reward_min-1.8242227222919465
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.666666666666654
valid_direction_mean13.25333333333332
valid_direction_median12.866666666666656
valid_direction_min12.699999999999989
89361135krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessno3320:03:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
89341133krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.9666666666666623


other stats
episodes
details{"ep000": {"nsteps": 40, "reward": -25.253210436567315, "good_angle": 0.5980296935847024, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.066666666666667}, "ep001": {"nsteps": 37, "reward": -27.58707160240895, "good_angle": 0.0054983924300485675, "survival_time": 1.2333333333333338, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 119, "reward": -8.898221652172193, "good_angle": 0.4535483766196577, "survival_time": 3.9666666666666623, "traveled_tiles": 3, "valid_direction": 0.9999999999999964}, "ep003": {"nsteps": 213, "reward": -5.003741821527761, "good_angle": 0.48348808965549744, "survival_time": 7.0999999999999845, "traveled_tiles": 4, "valid_direction": 1.0333333333333297}, "ep004": {"nsteps": 161, "reward": -6.801499324441477, "good_angle": 9.442977120398757, "survival_time": 5.366666666666657, "traveled_tiles": 3, "valid_direction": 1.8333333333333268}}
good_angle_max9.442977120398757
good_angle_mean2.1967083345377323
good_angle_median0.48348808965549744
good_angle_min0.0054983924300485675
reward_max-5.003741821527761
reward_mean-14.70874896742354
reward_median-8.898221652172193
reward_min-27.58707160240895
survival_time_max7.0999999999999845
survival_time_mean3.7999999999999945
survival_time_min1.2333333333333338
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.8333333333333268
valid_direction_mean0.986666666666664
valid_direction_median1.0333333333333297
valid_direction_min0
89271133krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessno3320:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
89251129VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:02:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.319958099272601
deviation-center-line_median0.6290074550943408
in-drivable-lane_median4.7999999999999865


other stats
deviation-center-line_max1.0363460175895869
deviation-center-line_mean0.5673711014205496
deviation-center-line_min0.05125862468498726
deviation-heading_max5.581616445997745
deviation-heading_mean3.0284668257945477
deviation-heading_median3.5885070638715124
deviation-heading_min0.4626801317225393
driven_any_max15.182437535428065
driven_any_mean8.275596348119231
driven_any_median10.58969658552277
driven_any_min1.3300719972448023
driven_lanedir_max5.135720534799653
driven_lanedir_mean2.791380634387348
driven_lanedir_min0.4917271203082403
in-drivable-lane_max7.466666666666645
in-drivable-lane_mean3.8199999999999905
in-drivable-lane_min0.6000000000000003
per-episodes
details{"ep000": {"driven_any": 15.182437535428065, "driven_lanedir": 4.437011513393691, "in-drivable-lane": 7.466666666666645, "deviation-heading": 5.581616445997745, "deviation-center-line": 0.97775962116015}, "ep001": {"driven_any": 1.3300719972448023, "driven_lanedir": 0.4917271203082403, "in-drivable-lane": 0.6000000000000003, "deviation-heading": 0.4626801317225393, "deviation-center-line": 0.05125862468498726}, "ep002": {"driven_any": 2.08832931011554, "driven_lanedir": 0.5724859041625565, "in-drivable-lane": 0.9666666666666682, "deviation-heading": 0.9451594748068738, "deviation-center-line": 0.14248378857368388}, "ep003": {"driven_any": 10.58969658552277, "driven_lanedir": 3.319958099272601, "in-drivable-lane": 5.266666666666652, "deviation-heading": 3.5885070638715124, "deviation-center-line": 0.6290074550943408}, "ep004": {"driven_any": 12.18744631228498, "driven_lanedir": 5.135720534799653, "in-drivable-lane": 4.7999999999999865, "deviation-heading": 4.564371012574067, "deviation-center-line": 1.0363460175895869}}
89231129VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:01:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
89211131DavidPytorch ILaido1_LF1_r3-v3step1-simulationfailedno3320:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 49, in solve
    action = model.predict(observation)
  File "/workspace/pytorch_model.py", line 74, in predict
    input = torch.Tensor(input).permute(2, 0, 1).unsqueeze(0)
RuntimeError: number of dims don't match in permute


Hidden. If you are the author, please login using the top-right link or use the dashboard.
89181122VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8918-8918', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8918-8918', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8918-8918_evaluation" with the default driver
stderr | Creating job8918-8918_visualization_1 ...
stderr | 
Creating job8918-8918_visualization_1 ... error

stderr | ERROR: for job8918-8918_visualization_1  Cannot start service visualization: network job8918-8918_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8918-8918_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
89131122VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5698862613681703, "good_angle": 0.9963698273791038, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.2666666666666595}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.6392612993963994, "good_angle": 1.242364603166347, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.3999999999999915}, "ep003": {"nsteps": 500, "reward": -0.5397877506660298, "good_angle": 1.4000165353279184, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.099999999999989}, "ep004": {"nsteps": 500, "reward": -0.8430571288096252, "good_angle": 22.86696775785127, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 3.833333333333332}}
good_angle_max22.86696775785127
good_angle_mean5.3019685036094355
good_angle_median1.242364603166347
good_angle_min0.004123794322536422
reward_max-0.5397877506660298
reward_mean-7.772482370107414
reward_median-0.6392612993963994
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean13.51999999999999
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean8.8
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max3.833333333333332
valid_direction_mean2.3199999999999945
valid_direction_median2.3999999999999915
valid_direction_min0
89111128VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1712941515220547
deviation-center-line_median0.27899688603984235
in-drivable-lane_median2.0666666666666664


other stats
deviation-center-line_max0.7689411168935266
deviation-center-line_mean0.4277846978542722
deviation-center-line_min0.1774300522257357
deviation-heading_max4.199505556750244
deviation-heading_mean2.2651397587817628
deviation-heading_median1.5093532121986049
deviation-heading_min1.0628363723804486
driven_any_max13.741216422834915
driven_any_mean6.238866454941861
driven_any_median3.52111640228564
driven_any_min2.384892536867285
driven_lanedir_max3.879106940033293
driven_lanedir_mean1.971570328292364
driven_lanedir_min0.854453165695908
in-drivable-lane_max7.53333333333331
in-drivable-lane_mean3.04666666666666
in-drivable-lane_min0.533333333333333
per-episodes
details{"ep000": {"driven_any": 3.491126840302257, "driven_lanedir": 0.854453165695908, "in-drivable-lane": 2.0666666666666664, "deviation-heading": 1.0628363723804486, "deviation-center-line": 0.1774300522257357}, "ep001": {"driven_any": 13.741216422834915, "driven_lanedir": 3.879106940033293, "in-drivable-lane": 7.53333333333331, "deviation-heading": 4.199505556750244, "deviation-center-line": 0.7689411168935266}, "ep002": {"driven_any": 2.384892536867285, "driven_lanedir": 1.1712941515220547, "in-drivable-lane": 0.533333333333333, "deviation-heading": 1.354939488134754, "deviation-center-line": 0.2729623793593397}, "ep003": {"driven_any": 8.05598007241921, "driven_lanedir": 2.871538129002206, "in-drivable-lane": 3.4999999999999902, "deviation-heading": 3.1990641644447626, "deviation-center-line": 0.6405930547529166}, "ep004": {"driven_any": 3.52111640228564, "driven_lanedir": 1.0814592552083582, "in-drivable-lane": 1.5999999999999988, "deviation-heading": 1.5093532121986049, "deviation-center-line": 0.27899688603984235}}
89021128VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:01:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
88971128VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.433333333333331


other stats
episodes
details{"ep000": {"nsteps": 103, "reward": -10.738487651906183, "good_angle": 6.623001189913441, "survival_time": 3.433333333333331, "traveled_tiles": 3, "valid_direction": 2.899999999999998}, "ep001": {"nsteps": 398, "reward": -3.573834209098602, "good_angle": 22.17096518362927, "survival_time": 13.26666666666663, "traveled_tiles": 5, "valid_direction": 10.399999999999972}, "ep002": {"nsteps": 70, "reward": -14.945861303220902, "good_angle": 2.0756036777075386, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.800000000000001}, "ep003": {"nsteps": 235, "reward": -5.1351538396351275, "good_angle": 6.174899015840222, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 5.999999999999986}, "ep004": {"nsteps": 103, "reward": -10.579931350063209, "good_angle": 3.1213364923864, "survival_time": 3.433333333333331, "traveled_tiles": 2, "valid_direction": 2.766666666666665}}
good_angle_max22.17096518362927
good_angle_mean8.033161111895375
good_angle_median6.174899015840222
good_angle_min2.0756036777075386
reward_max-3.573834209098602
reward_mean-8.994653670784803
reward_median-10.579931350063209
reward_min-14.945861303220902
survival_time_max13.26666666666663
survival_time_mean6.059999999999988
survival_time_min2.333333333333335
traveled_tiles_max5
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max10.399999999999972
valid_direction_mean4.7733333333333245
valid_direction_median2.899999999999998
valid_direction_min1.800000000000001
88931125BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3320:03:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.401254793145835
deviation-center-line_median1.004071813202574
in-drivable-lane_median4.33333333333333


other stats
deviation-center-line_max1.6334991892077222
deviation-center-line_mean0.9257475435667752
deviation-center-line_min0.2525232676315132
deviation-heading_max2.9157783785804554
deviation-heading_mean1.8953560060396344
deviation-heading_median2.365965541896246
deviation-heading_min0.6930252417034689
driven_any_max5.46833029907314
driven_any_mean3.721113633643469
driven_any_median5.082566143627928
driven_any_min1.17078703020304
driven_lanedir_max3.9701898953282138
driven_lanedir_mean2.621207248845344
driven_lanedir_min0.7800845802918484
in-drivable-lane_max5.399999999999982
in-drivable-lane_mean3.406666666666659
in-drivable-lane_min0.8999999999999968
per-episodes
details{"ep000": {"driven_any": 5.082566143627928, "driven_lanedir": 3.5870343062156578, "in-drivable-lane": 5.033333333333323, "deviation-heading": 2.9157783785804554, "deviation-center-line": 1.1483376901396964}, "ep001": {"driven_any": 1.17078703020304, "driven_lanedir": 0.7800845802918484, "in-drivable-lane": 1.3666666666666618, "deviation-heading": 0.6930252417034689, "deviation-center-line": 0.2525232676315132}, "ep002": {"driven_any": 5.212069701613519, "driven_lanedir": 3.401254793145835, "in-drivable-lane": 5.399999999999982, "deviation-heading": 2.803529358749528, "deviation-center-line": 1.004071813202574}, "ep003": {"driven_any": 5.46833029907314, "driven_lanedir": 3.9701898953282138, "in-drivable-lane": 4.33333333333333, "deviation-heading": 2.365965541896246, "deviation-center-line": 1.6334991892077222}, "ep004": {"driven_any": 1.6718149936997175, "driven_lanedir": 1.3674726692451653, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 0.6984815092684744, "deviation-center-line": 0.5903057576523699}}
88871127krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.533333333333334


other stats
episodes
details{"ep000": {"nsteps": 128, "reward": -8.331383397015088, "good_angle": 1.8172293384627989, "survival_time": 4.266666666666661, "traveled_tiles": 2, "valid_direction": 2.16666666666666}, "ep001": {"nsteps": 83, "reward": -12.986788551917815, "good_angle": 2.191059095980004, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 2.0666666666666664}, "ep002": {"nsteps": 76, "reward": -14.077185579330513, "good_angle": 1.974462028658612, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 2.000000000000001}, "ep003": {"nsteps": 75, "reward": -14.233828892667468, "good_angle": 1.8206566345462152, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 1.900000000000001}, "ep004": {"nsteps": 74, "reward": -14.461316556141185, "good_angle": 2.0224477477182456, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 2.000000000000001}}
good_angle_max2.191059095980004
good_angle_mean1.965170969073175
good_angle_median1.974462028658612
good_angle_min1.8172293384627989
reward_max-8.331383397015088
reward_mean-12.818100595414412
reward_median-14.077185579330513
reward_min-14.461316556141185
survival_time_max4.266666666666661
survival_time_mean2.9066666666666663
survival_time_min2.4666666666666677
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.16666666666666
valid_direction_mean2.026666666666666
valid_direction_median2.000000000000001
valid_direction_min1.900000000000001
88841125BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.28736362035316415, "good_angle": 1.3699398663502953, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.199999999999989}, "ep001": {"nsteps": 121, "reward": -9.44257581414855, "good_angle": 13.558964465031329, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 2.7333333333333276}, "ep002": {"nsteps": 500, "reward": -0.30199863244325387, "good_angle": 1.3266642103894115, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.8333333333333304}, "ep003": {"nsteps": 500, "reward": -0.338634068045998, "good_angle": 1.1088716333917508, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.83333333333335}, "ep004": {"nsteps": 152, "reward": -7.412497799166503, "good_angle": 13.321708252101688, "survival_time": 5.066666666666658, "traveled_tiles": 3, "valid_direction": 2.4666666666666597}}
good_angle_max13.558964465031329
good_angle_mean6.137229685452894
good_angle_median1.3699398663502953
good_angle_min1.1088716333917508
reward_max-0.28736362035316415
reward_mean-3.5566139868314934
reward_median-0.338634068045998
reward_min-9.44257581414855
survival_time_max16.666666666666654
survival_time_mean11.81999999999999
survival_time_min4.033333333333329
traveled_tiles_max10
traveled_tiles_mean7.2
traveled_tiles_median10
traveled_tiles_min3
valid_direction_max4.199999999999989
valid_direction_mean3.4133333333333313
valid_direction_median3.8333333333333304
valid_direction_min2.4666666666666597
88801126krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes3320:01:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3482643110874504
deviation-center-line_median0.11769469505431077
in-drivable-lane_median0.9999999999999992


other stats
deviation-center-line_max0.14324716545739985
deviation-center-line_mean0.1246804837925131
deviation-center-line_min0.11013026428779606
deviation-heading_max0.7916512827033291
deviation-heading_mean0.7334917727444747
deviation-heading_median0.7461705071785165
deviation-heading_min0.640055765062307
driven_any_max1.106982828376045
driven_any_mean0.7613879151977517
driven_any_median0.6659893310778022
driven_any_min0.6479896194270549
driven_lanedir_max0.5607387889676518
driven_lanedir_mean0.397940258142721
driven_lanedir_min0.3333690496174959
in-drivable-lane_max1.9666666666666628
in-drivable-lane_mean1.1866666666666652
in-drivable-lane_min0.9666666666666665
per-episodes
details{"ep000": {"driven_any": 1.106982828376045, "driven_lanedir": 0.5607387889676518, "in-drivable-lane": 1.9666666666666628, "deviation-heading": 0.7916512827033291, "deviation-center-line": 0.13970155341270693}, "ep001": {"driven_any": 0.728988321855431, "driven_lanedir": 0.4010751607941592, "in-drivable-lane": 0.9999999999999978, "deviation-heading": 0.7890184718931031, "deviation-center-line": 0.14324716545739985}, "ep002": {"driven_any": 0.6659893310778022, "driven_lanedir": 0.3482643110874504, "in-drivable-lane": 0.9999999999999992, "deviation-heading": 0.7005628368851173, "deviation-center-line": 0.112628740750352}, "ep003": {"driven_any": 0.6569894752524257, "driven_lanedir": 0.3462539802468476, "in-drivable-lane": 0.9999999999999996, "deviation-heading": 0.640055765062307, "deviation-center-line": 0.11013026428779606}, "ep004": {"driven_any": 0.6479896194270549, "driven_lanedir": 0.3333690496174959, "in-drivable-lane": 0.9666666666666665, "deviation-heading": 0.7461705071785165, "deviation-center-line": 0.11769469505431077}}
88761126krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.533333333333334


other stats
episodes
details{"ep000": {"nsteps": 128, "reward": -8.331383397015088, "good_angle": 1.8172293384627989, "survival_time": 4.266666666666661, "traveled_tiles": 2, "valid_direction": 2.16666666666666}, "ep001": {"nsteps": 83, "reward": -12.986788551917815, "good_angle": 2.191059095980004, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 2.0666666666666664}, "ep002": {"nsteps": 76, "reward": -14.077185579330513, "good_angle": 1.974462028658612, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 2.000000000000001}, "ep003": {"nsteps": 75, "reward": -14.233828892667468, "good_angle": 1.8206566345462152, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 1.900000000000001}, "ep004": {"nsteps": 74, "reward": -14.461316556141185, "good_angle": 2.0224477477182456, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 2.000000000000001}}
good_angle_max2.191059095980004
good_angle_mean1.965170969073175
good_angle_median1.974462028658612
good_angle_min1.8172293384627989
reward_max-8.331383397015088
reward_mean-12.818100595414412
reward_median-14.077185579330513
reward_min-14.461316556141185
survival_time_max4.266666666666661
survival_time_mean2.9066666666666663
survival_time_min2.4666666666666677
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.16666666666666
valid_direction_mean2.026666666666666
valid_direction_median2.000000000000001
valid_direction_min1.900000000000001
88701126krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessno3320:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
88661124iban_alexROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.8666666666666663


other stats
episodes
details{"ep000": {"nsteps": 229, "reward": -4.523531859492025, "good_angle": 0.8158696060519307, "survival_time": 7.633333333333316, "traveled_tiles": 2, "valid_direction": 0.8999999999999975}, "ep001": {"nsteps": 86, "reward": -12.243025223529616, "good_angle": 0.1677374994364501, "survival_time": 2.8666666666666663, "traveled_tiles": 1, "valid_direction": 0.33333333333333215}, "ep002": {"nsteps": 47, "reward": -21.753968592653884, "good_angle": 0.4623292400062632, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.633333333333335}, "ep003": {"nsteps": 135, "reward": -7.813015364000091, "good_angle": 0.29149727495917394, "survival_time": 4.499999999999994, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep004": {"nsteps": 66, "reward": -15.63631043334802, "good_angle": 0.3644229858662539, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6000000000000003}}
good_angle_max0.8158696060519307
good_angle_mean0.4203713212640144
good_angle_median0.3644229858662539
good_angle_min0.1677374994364501
reward_max-4.523531859492025
reward_mean-12.39397029460473
reward_median-12.243025223529616
reward_min-21.753968592653884
survival_time_max7.633333333333316
survival_time_mean3.7533333333333294
survival_time_min1.5666666666666682
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.8999999999999975
valid_direction_mean0.5799999999999994
valid_direction_median0.6000000000000003
valid_direction_min0.33333333333333215
88621123krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes3320:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.28674844061045146
deviation-center-line_median0.06793354910593655
in-drivable-lane_median0.2666666666666666


other stats
deviation-center-line_max0.09524125006477782
deviation-center-line_mean0.07510325255182977
deviation-center-line_min0.06169944289313517
deviation-heading_max0.8568388123871659
deviation-heading_mean0.621048388090753
deviation-heading_median0.7106569803087657
deviation-heading_min0.19528928347629587
driven_any_max0.791109741951277
driven_any_mean0.6294426524023157
driven_any_median0.5847265560746605
driven_any_min0.5675287162575702
driven_lanedir_max0.3321797917490028
driven_lanedir_mean0.2968064935890601
driven_lanedir_min0.2699269406978213
in-drivable-lane_max1.0000000000000016
in-drivable-lane_mean0.4066666666666669
in-drivable-lane_min0.19999999999999996
per-episodes
details{"ep000": {"driven_any": 0.791109741951277, "driven_lanedir": 0.31949882482992176, "in-drivable-lane": 1.0000000000000016, "deviation-heading": 0.19528928347629587, "deviation-center-line": 0.09524125006477782}, "ep001": {"driven_any": 0.6363195314704962, "driven_lanedir": 0.3321797917490028, "in-drivable-lane": 0.19999999999999996, "deviation-heading": 0.8568388123871659, "deviation-center-line": 0.08729718798542509}, "ep002": {"driven_any": 0.5847265560746605, "driven_lanedir": 0.28674844061045146, "in-drivable-lane": 0.2666666666666666, "deviation-heading": 0.7143773536602905, "deviation-center-line": 0.06793354910593655}, "ep003": {"driven_any": 0.5675287162575702, "driven_lanedir": 0.2756784700581032, "in-drivable-lane": 0.29999999999999993, "deviation-heading": 0.6280795106212466, "deviation-center-line": 0.06169944289313517}, "ep004": {"driven_any": 0.5675287162575744, "driven_lanedir": 0.2699269406978213, "in-drivable-lane": 0.2666666666666666, "deviation-heading": 0.7106569803087657, "deviation-center-line": 0.0633448327098742}}
88551123krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringabortedyes3320:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8855-2343', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8855-2343', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8855-2343_evaluation" with the default driver
stderr | Creating job8855-2343_scorer_1 ...
stderr | 
Creating job8855-2343_scorer_1 ... error

stderr | ERROR: for job8855-2343_scorer_1  Cannot start service scorer: network job8855-2343_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8855-2343_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
88481121VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:03:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.773811521603105
deviation-center-line_median1.1525824328314664
in-drivable-lane_median6.2000000000000135


other stats
deviation-center-line_max1.54284737673533
deviation-center-line_mean0.9338462590361664
deviation-center-line_min0.16240523894655876
deviation-heading_max1.786770470808945
deviation-heading_mean1.210919513877175
deviation-heading_median1.34912830290192
deviation-heading_min0.43927931974536977
driven_any_max6.284736760390857
driven_any_mean4.440489223773457
driven_any_median5.901880146403633
driven_any_min1.0298625667734442
driven_lanedir_max3.886427488599245
driven_lanedir_mean2.695093808408512
driven_lanedir_min0.8032600454873398
in-drivable-lane_max9.233333333333306
in-drivable-lane_mean4.6066666666666665
in-drivable-lane_min0.06666666666666643
per-episodes
details{"ep000": {"driven_any": 1.0298625667734442, "driven_lanedir": 0.8032600454873398, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0.43927931974536977, "deviation-center-line": 0.16240523894655876}, "ep001": {"driven_any": 5.901880146403633, "driven_lanedir": 3.444590585672085, "in-drivable-lane": 6.966666666666678, "deviation-heading": 1.6111082569568158, "deviation-center-line": 1.43398125306032}, "ep002": {"driven_any": 6.284736760390857, "driven_lanedir": 3.886427488599245, "in-drivable-lane": 6.2000000000000135, "deviation-heading": 1.34912830290192, "deviation-center-line": 1.54284737673533}, "ep003": {"driven_any": 2.87021550318557, "driven_lanedir": 2.773811521603105, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 0.8683112189728236, "deviation-center-line": 0.37741499360715774}, "ep004": {"driven_any": 6.115751142113785, "driven_lanedir": 2.5673794006807875, "in-drivable-lane": 9.233333333333306, "deviation-heading": 1.786770470808945, "deviation-center-line": 1.1525824328314664}}
88381121VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:06:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
88221120VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3320:05:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
88201117VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:02:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
88191117VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6450484580438351, "good_angle": 0.5911228417179982, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.1333333333333293}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.6147386246518, "good_angle": 0.6803304545423917, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.2666666666666622}, "ep003": {"nsteps": 500, "reward": -0.5042214189479127, "good_angle": 0.828549263333209, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.7666666666666604}, "ep004": {"nsteps": 500, "reward": -0.7947898033311358, "good_angle": 10.65445602271227, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.5666666666666575}}
good_angle_max10.65445602271227
good_angle_mean2.551716475325682
good_angle_median0.6803304545423917
good_angle_min0.004123794322536422
reward_max-0.5042214189479127
reward_mean-7.765843543054307
reward_median-0.6450484580438351
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean13.51999999999999
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean9.2
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max3.5666666666666575
valid_direction_mean1.546666666666662
valid_direction_median1.2666666666666622
valid_direction_min0
88131117VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:07:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
88111116VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3320:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8811-9738', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8811-9738', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8811-9738_evaluation" with the default driver
stderr | Creating job8811-9738_visualization_1 ...
stderr | 
Creating job8811-9738_visualization_1 ... error

stderr | ERROR: for job8811-9738_visualization_1  Cannot start service visualization: network job8811-9738_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8811-9738_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
88061116VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7121228661422502, "good_angle": 0.6289510252872001, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.3666666666666625}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.497267006195616, "good_angle": 0.4817720498773324, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.1999999999999955}, "ep003": {"nsteps": 226, "reward": -4.5931772413951775, "good_angle": 0.080180669304443, "survival_time": 7.533333333333316, "traveled_tiles": 5, "valid_direction": 0.033333333333333215}, "ep004": {"nsteps": 500, "reward": -0.7465832089912147, "good_angle": 22.31499710031131, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 4.299999999999988}}
good_angle_max22.31499710031131
good_angle_mean4.702004927820564
good_angle_median0.4817720498773324
good_angle_min0.004123794322536422
reward_max-0.497267006195616
reward_mean-8.56391394660422
reward_median-0.7465832089912147
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean11.693333333333324
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean7.4
traveled_tiles_median7
traveled_tiles_min1
valid_direction_max4.299999999999988
valid_direction_mean1.379999999999996
valid_direction_median1.1999999999999955
valid_direction_min0
88021115VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:03:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.2295767450830923
deviation-center-line_median1.099141267147876
in-drivable-lane_median6.29999999999998


other stats
deviation-center-line_max1.850189075655979
deviation-center-line_mean0.9831013823471232
deviation-center-line_min0.09897289157693905
deviation-heading_max2.5410008280404077
deviation-heading_mean1.22763272889852
deviation-heading_median1.0517847499883468
deviation-heading_min0.06092138286581164
driven_any_max6.310896254262831
driven_any_mean4.375051647884639
driven_any_median5.9919952464510775
driven_any_min0.34666666666667245
driven_lanedir_max3.9675304045387656
driven_lanedir_mean2.7811325099765285
driven_lanedir_min0.3458718774424743
in-drivable-lane_max7.900000000000008
in-drivable-lane_mean4.12666666666666
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.250926780640661, "driven_lanedir": 3.9675304045387656, "in-drivable-lane": 6.29999999999998, "deviation-heading": 1.0517847499883468, "deviation-center-line": 1.850189075655979}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.310896254262831, "driven_lanedir": 3.2295767450830923, "in-drivable-lane": 7.900000000000008, "deviation-heading": 1.5733600713550395, "deviation-center-line": 1.099141267147876}, "ep003": {"driven_any": 2.9747732914019536, "driven_lanedir": 2.8824594423863212, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.911096612242994, "deviation-center-line": 0.4143077432253443}, "ep004": {"driven_any": 5.9919952464510775, "driven_lanedir": 3.480224080431987, "in-drivable-lane": 6.399999999999978, "deviation-heading": 2.5410008280404077, "deviation-center-line": 1.4528959341294785}}
87991115VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8799-8181', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8799-8181', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8799-8181_evaluation" with the default driver
stderr | Creating job8799-8181_videos_1 ...
stderr | 
Creating job8799-8181_videos_1 ... error

stderr | ERROR: for job8799-8181_videos_1  Cannot start service videos: network job8799-8181_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8799-8181_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
87911115VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:07:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
87841113krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes3320:03:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.15741338591251397
deviation-center-line_median0.4650944282204903
in-drivable-lane_median8.299999999999994


other stats
deviation-center-line_max0.7159918628482274
deviation-center-line_mean0.3821124886057812
deviation-center-line_min0
deviation-heading_max6.540131967240777
deviation-heading_mean5.221082427757779
deviation-heading_median6.537669075338772
deviation-heading_min0
driven_any_max0.49735405772776664
driven_any_mean0.496556394292239
driven_any_median0.4973540577277655
driven_any_min0.4933657405501446
driven_lanedir_max0
driven_lanedir_mean-0.125929382017318
driven_lanedir_min-0.15748677407321887
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean9.973333333333326
in-drivable-lane_min8.299999999999994
per-episodes
details{"ep000": {"driven_any": 0.4933657405501446, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.49735405772775193, "driven_lanedir": -0.15748677407321887, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.540131967240777, "deviation-center-line": 0.7159918628482274}, "ep002": {"driven_any": 0.49735405772776664, "driven_lanedir": -0.15729812685794475, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.487894280561919, "deviation-center-line": 0.4650944282204903}, "ep003": {"driven_any": 0.4973540577277655, "driven_lanedir": -0.15744862324291242, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.539716815647427, "deviation-center-line": 0.2023017828020126}, "ep004": {"driven_any": 0.4973540577277666, "driven_lanedir": -0.15741338591251397, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.537669075338772, "deviation-center-line": 0.527174369158176}}
87801113krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes3320:02:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.3001166402101516, "good_angle": 54.33312579346873, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.76666666666666}, "ep001": {"nsteps": 500, "reward": -1.753247414290905, "good_angle": 13.710775419046632, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.899999999999988}, "ep002": {"nsteps": 500, "reward": -1.575717896401882, "good_angle": 13.670340188871982, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.866666666666656}, "ep003": {"nsteps": 500, "reward": -1.3772086943238973, "good_angle": 13.665101915411906, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.03333333333332}, "ep004": {"nsteps": 500, "reward": -1.6150296981334686, "good_angle": 13.667722647448745, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666653}}
good_angle_max54.33312579346873
good_angle_mean21.809413192849597
good_angle_median13.670340188871982
good_angle_min13.665101915411906
reward_max-1.3001166402101516
reward_mean-1.524264068672061
reward_median-1.575717896401882
reward_min-1.753247414290905
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.76666666666666
valid_direction_mean13.306666666666654
valid_direction_median12.966666666666653
valid_direction_min12.866666666666656
87731112krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes3320:01:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
87701113krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessno3320:03:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
87641111iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.23337893423961376
deviation-center-line_median0.21274103692942703
in-drivable-lane_median0


other stats
deviation-center-line_max0.3573781939235156
deviation-center-line_mean0.23424649301877648
deviation-center-line_min0.11427212772104156
deviation-heading_max1.8131134446897523
deviation-heading_mean0.8549234120678835
deviation-heading_median0.6120039815709682
deviation-heading_min0.4941840774354186
driven_any_max0.7750266874769531
driven_any_mean0.3357175816313672
driven_any_median0.24642464810236747
driven_any_min0.15356510244405283
driven_lanedir_max0.5332045711640991
driven_lanedir_mean0.2735857130035904
driven_lanedir_min0.13383424307683667
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7750266874769531, "driven_lanedir": 0.5332045711640991, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.8131134446897523, "deviation-center-line": 0.3573781939235156}, "ep001": {"driven_any": 0.33214757875007084, "driven_lanedir": 0.3242557324569133, "in-drivable-lane": 0, "deviation-heading": 0.4941840774354186, "deviation-center-line": 0.3549146209582231}, "ep002": {"driven_any": 0.15356510244405283, "driven_lanedir": 0.13383424307683667, "in-drivable-lane": 0, "deviation-heading": 0.6120039815709682, "deviation-center-line": 0.13192648556167505}, "ep003": {"driven_any": 0.17142389138339187, "driven_lanedir": 0.14325508408048915, "in-drivable-lane": 0, "deviation-heading": 0.8101125566989754, "deviation-center-line": 0.11427212772104156}, "ep004": {"driven_any": 0.24642464810236747, "driven_lanedir": 0.23337893423961376, "in-drivable-lane": 0, "deviation-heading": 0.545202999944303, "deviation-center-line": 0.21274103692942703}}
87581111iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
87511110VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:03:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.4671741334926467
deviation-center-line_median1.2958101170355834
in-drivable-lane_median6.300000000000013


other stats
deviation-center-line_max1.6351280540821935
deviation-center-line_mean0.986355175052001
deviation-center-line_min0.09897289157693905
deviation-heading_max2.013916250570275
deviation-heading_mean1.2276586971395471
deviation-heading_median1.496818149580234
deviation-heading_min0.06092138286581164
driven_any_max6.300532347308807
driven_any_mean4.383603780695079
driven_any_median6.015722154991967
driven_any_min0.34666666666667245
driven_lanedir_max3.856705062202037
driven_lanedir_mean2.8568503518682036
driven_lanedir_min0.3458718774424743
in-drivable-lane_max6.9666666666666455
in-drivable-lane_mean3.9400000000000017
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.214405296996363, "driven_lanedir": 3.661117948394939, "in-drivable-lane": 6.4000000000000155, "deviation-heading": 2.013916250570275, "deviation-center-line": 1.4114794115316016}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.300532347308807, "driven_lanedir": 3.856705062202037, "in-drivable-lane": 6.300000000000013, "deviation-heading": 1.6193895682632025, "deviation-center-line": 1.2958101170355834}, "ep003": {"driven_any": 3.040692437511586, "driven_lanedir": 2.953382737808921, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.9472481344182136, "deviation-center-line": 0.4903854010336875}, "ep004": {"driven_any": 6.015722154991967, "driven_lanedir": 3.4671741334926467, "in-drivable-lane": 6.9666666666666455, "deviation-heading": 1.496818149580234, "deviation-center-line": 1.6351280540821935}}
87441110VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3320:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8744-8129', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8744-8129', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8744-8129_evaluation" with the default driver
stderr | Creating job8744-8129_scorer_1 ...
stderr | 
Creating job8744-8129_scorer_1 ... error

stderr | ERROR: for job8744-8129_scorer_1  Cannot start service scorer: network job8744-8129_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8744-8129_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
87371108BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3320:04:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.770405108500412
deviation-center-line_median1.2882499664978988
in-drivable-lane_median1.533333333333328


other stats
deviation-center-line_max2.6795700709364354
deviation-center-line_mean1.6171486262204433
deviation-center-line_min0.7957689340509382
deviation-heading_max3.3901748526040403
deviation-heading_mean2.315147760415663
deviation-heading_median2.325774299185338
deviation-heading_min1.1332800828333809
driven_any_max5.648673734230038
driven_any_mean4.91142241599376
driven_any_median5.287518881534349
driven_any_min2.9804186489360935
driven_lanedir_max5.620425621008038
driven_lanedir_mean4.396179359628715
driven_lanedir_min2.363778209447126
in-drivable-lane_max2.266666666666673
in-drivable-lane_mean1.2533333333333323
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.17202384603784, "driven_lanedir": 4.287933297769848, "in-drivable-lane": 2.266666666666673, "deviation-heading": 3.3901748526040403, "deviation-center-line": 1.2882499664978988}, "ep001": {"driven_any": 5.4684769692304815, "driven_lanedir": 4.770405108500412, "in-drivable-lane": 1.6666666666666607, "deviation-heading": 2.4959908952433354, "deviation-center-line": 2.212813773513863}, "ep002": {"driven_any": 2.9804186489360935, "driven_lanedir": 2.363778209447126, "in-drivable-lane": 1.533333333333328, "deviation-heading": 2.325774299185338, "deviation-center-line": 0.7957689340509382}, "ep003": {"driven_any": 5.287518881534349, "driven_lanedir": 4.93835456141815, "in-drivable-lane": 0.8000000000000007, "deviation-heading": 2.2305186722122214, "deviation-center-line": 1.1093403861030806}, "ep004": {"driven_any": 5.648673734230038, "driven_lanedir": 5.620425621008038, "in-drivable-lane": 0, "deviation-heading": 1.1332800828333809, "deviation-center-line": 2.6795700709364354}}
87311108BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.15644692612317157, "good_angle": 1.1850549188777757, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.333333333333326}, "ep001": {"nsteps": 500, "reward": -0.4832332623641705, "good_angle": 26.90511062716362, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.166666666666655}, "ep002": {"nsteps": 289, "reward": -3.6313355645461622, "good_angle": 0.8995114903146415, "survival_time": 9.63333333333331, "traveled_tiles": 7, "valid_direction": 2.5666666666666584}, "ep003": {"nsteps": 500, "reward": -0.15980873936373974, "good_angle": 0.7956928799808193, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.0999999999999925}, "ep004": {"nsteps": 500, "reward": -0.43849080500460696, "good_angle": 21.48062272864873, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.3999999999999915}}
good_angle_max26.90511062716362
good_angle_mean10.253198528997116
good_angle_median1.1850549188777757
good_angle_min0.7956928799808193
reward_max-0.15644692612317157
reward_mean-0.9738630594803704
reward_median-0.43849080500460696
reward_min-3.6313355645461622
survival_time_max16.666666666666654
survival_time_mean15.259999999999986
survival_time_min9.63333333333331
traveled_tiles_max11
traveled_tiles_mean9.8
traveled_tiles_median10
traveled_tiles_min7
valid_direction_max4.166666666666655
valid_direction_mean2.9133333333333247
valid_direction_median2.5666666666666584
valid_direction_min2.0999999999999925
87241107daredevilPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3320:00:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3488793237522416
deviation-center-line_median0.0889692481169104
in-drivable-lane_median0.7333333333333356


other stats
deviation-center-line_max0.10804224268701285
deviation-center-line_mean0.09487224786148496
deviation-center-line_min0.08348977239520798
deviation-heading_max0.608366051951121
deviation-heading_mean0.5574968980788961
deviation-heading_median0.5632226516257168
deviation-heading_min0.48363659503855955
driven_any_max1.1039685593698203
driven_any_mean0.758378401654052
driven_any_median0.6599812039710905
driven_any_min0.6479815457170728
driven_lanedir_max0.5716983112111842
driven_lanedir_mean0.39952468480261855
driven_lanedir_min0.33211979888331666
in-drivable-lane_max1.3666666666666638
in-drivable-lane_mean0.8666666666666678
in-drivable-lane_min0.733333333333335
per-episodes
details{"ep000": {"driven_any": 1.1039685593698203, "driven_lanedir": 0.5716983112111842, "in-drivable-lane": 1.3666666666666638, "deviation-heading": 0.608366051951121, "deviation-center-line": 0.10673177973707754}, "ep001": {"driven_any": 0.7199794952411871, "driven_lanedir": 0.39976300809979626, "in-drivable-lane": 0.733333333333335, "deviation-heading": 0.5955376409473666, "deviation-center-line": 0.10804224268701285}, "ep002": {"driven_any": 0.659981203971089, "driven_lanedir": 0.3488793237522416, "in-drivable-lane": 0.7333333333333356, "deviation-heading": 0.5367215508317167, "deviation-center-line": 0.08712819637121608}, "ep003": {"driven_any": 0.6599812039710905, "driven_lanedir": 0.34516298206655405, "in-drivable-lane": 0.766666666666669, "deviation-heading": 0.48363659503855955, "deviation-center-line": 0.08348977239520798}, "ep004": {"driven_any": 0.6479815457170728, "driven_lanedir": 0.33211979888331666, "in-drivable-lane": 0.7333333333333356, "deviation-heading": 0.5632226516257168, "deviation-center-line": 0.0889692481169104}}
87211107daredevilPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9000000000000024


other stats
episodes
details{"ep000": {"nsteps": 94, "reward": -11.171671843166129, "good_angle": 1.4044183981168703, "survival_time": 3.133333333333332, "traveled_tiles": 2, "valid_direction": 1.63333333333333}, "ep001": {"nsteps": 62, "reward": -17.048769331417017, "good_angle": 1.6329867996476355, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 1.566666666666669}, "ep002": {"nsteps": 57, "reward": -18.454871453794144, "good_angle": 1.4903659537432206, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.5000000000000024}, "ep003": {"nsteps": 57, "reward": -18.47161357804904, "good_angle": 1.4299329130305087, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.4666666666666692}, "ep004": {"nsteps": 56, "reward": -18.81965266557277, "good_angle": 1.5658464039151478, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 1.533333333333336}}
good_angle_max1.6329867996476355
good_angle_mean1.5047100936906768
good_angle_median1.4903659537432206
good_angle_min1.4044183981168703
reward_max-11.171671843166129
reward_mean-16.793315774399822
reward_median-18.454871453794144
reward_min-18.81965266557277
survival_time_max3.133333333333332
survival_time_mean2.1733333333333347
survival_time_min1.8666666666666691
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.63333333333333
valid_direction_mean1.5400000000000014
valid_direction_median1.533333333333336
valid_direction_min1.4666666666666692
87121105DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.699999999999982


other stats
episodes
details{"ep000": {"nsteps": 231, "reward": -4.165872219735273, "good_angle": 0.5547323267856684, "survival_time": 7.699999999999982, "traveled_tiles": 4, "valid_direction": 0.7999999999999972}, "ep001": {"nsteps": 206, "reward": -5.023156314717552, "good_angle": 6.549717674479366, "survival_time": 6.866666666666652, "traveled_tiles": 4, "valid_direction": 1.5666666666666618}, "ep002": {"nsteps": 133, "reward": -7.499549678124179, "good_angle": 0.4728772469984414, "survival_time": 4.433333333333327, "traveled_tiles": 3, "valid_direction": 0.6333333333333311}, "ep003": {"nsteps": 441, "reward": -2.1390510202527904, "good_angle": 0.593177011198781, "survival_time": 14.699999999999958, "traveled_tiles": 7, "valid_direction": 0.9666666666666632}, "ep004": {"nsteps": 500, "reward": -0.17025197575055062, "good_angle": 13.214492191749564, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.5333333333333243}}
good_angle_max13.214492191749564
good_angle_mean4.2769992902423635
good_angle_median0.593177011198781
good_angle_min0.4728772469984414
reward_max-0.17025197575055062
reward_mean-3.799576241716069
reward_median-4.165872219735273
reward_min-7.499549678124179
survival_time_max16.666666666666654
survival_time_mean10.073333333333316
survival_time_min4.433333333333327
traveled_tiles_max10
traveled_tiles_mean5.6
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max2.5333333333333243
valid_direction_mean1.2999999999999956
valid_direction_median0.9666666666666632
valid_direction_min0.6333333333333311
87101106krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailedno3320:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 553, in run
    solve(params, cis)
  File "solution.py", line 471, in solve
    if len(lines) == 0:
TypeError: object of type 'NoneType' has no len()


Hidden. If you are the author, please login using the top-right link or use the dashboard.
87081104VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:05:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
87011102krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailedno3320:00:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 551, in run
    solve(params, cis)
  File "solution.py", line 469, in solve
    if len(lines) == 0:
TypeError: object of type 'NoneType' has no len()


Hidden. If you are the author, please login using the top-right link or use the dashboard.
86941100krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes3320:03:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.15741338591251397
deviation-center-line_median0.4650944282204903
in-drivable-lane_median8.299999999999994


other stats
deviation-center-line_max0.7159918628482274
deviation-center-line_mean0.3821124886057812
deviation-center-line_min0
deviation-heading_max6.540131967240777
deviation-heading_mean5.221082427757779
deviation-heading_median6.537669075338772
deviation-heading_min0
driven_any_max0.49735405772776664
driven_any_mean0.49675584668913847
driven_any_median0.4973540577277655
driven_any_min0.4943630025346415
driven_lanedir_max0
driven_lanedir_mean-0.125929382017318
driven_lanedir_min-0.15748677407321887
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean9.973333333333326
in-drivable-lane_min8.299999999999994
per-episodes
details{"ep000": {"driven_any": 0.4943630025346415, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.49735405772775193, "driven_lanedir": -0.15748677407321887, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.540131967240777, "deviation-center-line": 0.7159918628482274}, "ep002": {"driven_any": 0.49735405772776664, "driven_lanedir": -0.15729812685794475, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.487894280561919, "deviation-center-line": 0.4650944282204903}, "ep003": {"driven_any": 0.4973540577277655, "driven_lanedir": -0.15744862324291242, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.539716815647427, "deviation-center-line": 0.2023017828020126}, "ep004": {"driven_any": 0.4973540577277666, "driven_lanedir": -0.15741338591251397, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.537669075338772, "deviation-center-line": 0.527174369158176}}
86901100krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes3320:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
86871100krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.299502514243126, "good_angle": 54.26909189387377, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.733333333333324}, "ep001": {"nsteps": 500, "reward": -1.753247414290905, "good_angle": 13.665899235634638, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.899999999999988}, "ep002": {"nsteps": 500, "reward": -1.575717896401882, "good_angle": 13.670340188871982, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.866666666666656}, "ep003": {"nsteps": 500, "reward": -1.3772086943238973, "good_angle": 13.665101915411906, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.03333333333332}, "ep004": {"nsteps": 500, "reward": -1.6150296981334686, "good_angle": 13.667722647448745, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666653}}
good_angle_max54.26909189387377
good_angle_mean21.787631176248208
good_angle_median13.667722647448745
good_angle_min13.665101915411906
reward_max-1.299502514243126
reward_mean-1.5241412434786556
reward_median-1.575717896401882
reward_min-1.753247414290905
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.733333333333324
valid_direction_mean13.299999999999988
valid_direction_median12.966666666666653
valid_direction_min12.866666666666656
86841090VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:01:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
86761096BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3320:01:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
86721097krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailedno3320:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 550, in run
    solve(params, cis)
  File "solution.py", line 469, in solve
    if len(lines) == 0:
TypeError: object of type 'NoneType' has no len()


Hidden. If you are the author, please login using the top-right link or use the dashboard.
86651093VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:01:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
86581093VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:04:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
86491091pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 77, "reward": -13.608360718488209, "good_angle": 1.5062601676545182, "survival_time": 2.5666666666666673, "traveled_tiles": 2, "valid_direction": 1.3666666666666667}, "ep001": {"nsteps": 60, "reward": -17.057688444604477, "good_angle": 1.8258357325297336, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 1.8000000000000027}, "ep002": {"nsteps": 58, "reward": -17.61266718628206, "good_angle": 1.781738406408049, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 1.7000000000000026}, "ep003": {"nsteps": 53, "reward": -19.279425655421363, "good_angle": 1.873411065546353, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 1.4666666666666688}, "ep004": {"nsteps": 54, "reward": -18.98923834634048, "good_angle": 1.891105457200604, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 1.5333333333333354}}
good_angle_max1.891105457200604
good_angle_mean1.7756701658678515
good_angle_median1.8258357325297336
good_angle_min1.5062601676545182
reward_max-13.608360718488209
reward_mean-17.309476070227316
reward_median-17.61266718628206
reward_min-19.279425655421363
survival_time_max2.5666666666666673
survival_time_mean2.0133333333333354
survival_time_min1.7666666666666688
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.8000000000000027
valid_direction_mean1.5733333333333352
valid_direction_median1.5333333333333354
valid_direction_min1.3666666666666667
86321089VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3320:06:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
86131083BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3320:03:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.794158165744824
deviation-center-line_median0.8186299987703587
in-drivable-lane_median0.7666666666666648


other stats
deviation-center-line_max2.850184294801161
deviation-center-line_mean1.152852122192602
deviation-center-line_min0.3076625833537595
deviation-heading_max2.5309710427287184
deviation-heading_mean1.5101321395550855
deviation-heading_median1.4970752123483373
deviation-heading_min0.5258667406312318
driven_any_max5.769422076826895
driven_any_mean3.773828651171583
driven_any_median3.165557893878553
driven_any_min2.2572553360664824
driven_lanedir_max5.741323962970992
driven_lanedir_mean3.4683433254653133
driven_lanedir_min1.710012389410291
in-drivable-lane_max1.3666666666666618
in-drivable-lane_mean0.6733333333333315
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.350831720232766, "driven_lanedir": 4.787456681119804, "in-drivable-lane": 1.2333333333333307, "deviation-heading": 2.5309710427287184, "deviation-center-line": 1.1294132480259695}, "ep001": {"driven_any": 2.2572553360664824, "driven_lanedir": 1.710012389410291, "in-drivable-lane": 1.3666666666666618, "deviation-heading": 1.4970752123483373, "deviation-center-line": 0.6583704860117613}, "ep002": {"driven_any": 3.165557893878553, "driven_lanedir": 2.794158165744824, "in-drivable-lane": 0.7666666666666648, "deviation-heading": 1.9642997505888415, "deviation-center-line": 0.8186299987703587}, "ep003": {"driven_any": 2.3260762288532173, "driven_lanedir": 2.3087654280806555, "in-drivable-lane": 0, "deviation-heading": 0.5258667406312318, "deviation-center-line": 0.3076625833537595}, "ep004": {"driven_any": 5.769422076826895, "driven_lanedir": 5.741323962970992, "in-drivable-lane": 0, "deviation-heading": 1.0324479514783, "deviation-center-line": 2.850184294801161}}
86101083BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.833333333333307


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.2706090895058587, "good_angle": 1.0463232627429253, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.9999999999999956}, "ep001": {"nsteps": 219, "reward": -5.045470407160348, "good_angle": 9.418936431059748, "survival_time": 7.299999999999984, "traveled_tiles": 4, "valid_direction": 1.9333333333333271}, "ep002": {"nsteps": 295, "reward": -3.723782868795413, "good_angle": 0.8967775962128568, "survival_time": 9.833333333333307, "traveled_tiles": 7, "valid_direction": 1.899999999999994}, "ep003": {"nsteps": 221, "reward": -4.8211422439209475, "good_angle": 0.08513647553084386, "survival_time": 7.36666666666665, "traveled_tiles": 4, "valid_direction": 0.06666666666666643}, "ep004": {"nsteps": 500, "reward": -0.4882887771707028, "good_angle": 22.451953030925186, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.8333333333333246}}
good_angle_max22.451953030925186
good_angle_mean6.779825359294312
good_angle_median1.0463232627429253
good_angle_min0.08513647553084386
reward_max-0.2706090895058587
reward_mean-2.869858677310654
reward_median-3.723782868795413
reward_min-5.045470407160348
survival_time_max16.666666666666654
survival_time_mean11.566666666666652
survival_time_min7.299999999999984
traveled_tiles_max11
traveled_tiles_mean7.2
traveled_tiles_median7
traveled_tiles_min4
valid_direction_max2.8333333333333246
valid_direction_mean1.7466666666666617
valid_direction_median1.9333333333333271
valid_direction_min0.06666666666666643
86061082krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailedno3320:01:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 475, in run
    solve(params, cis)
  File "solution.py", line 359, in solve
    env = wrappers.UndistortWrapper(env)
  File "/workspace/src/gym-duckietown/gym_duckietown/wrappers.py", line 148, in __init__
    assert env.unwrapped.distortion, "Distortion is false, no need for this wrapper"
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'distortion'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
86011081lavoiemsFast Dukeaido1_LF1_r3-v3step3-videossuccessyes3320:00:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
85921081lavoiemsFast Dukeaido1_LF1_r3-v3step1-simulationsuccessno3320:01:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
85761077DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3320:03:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.0554428873616786
deviation-center-line_median0.6141397077561574
in-drivable-lane_median0.466666666666665


other stats
deviation-center-line_max1.0185134787913035
deviation-center-line_mean0.6297267075674231
deviation-center-line_min0.15406282312759506
deviation-heading_max2.9719488126799143
deviation-heading_mean1.7041424503792009
deviation-heading_median1.5766709344975451
deviation-heading_min0.48776593329341816
driven_any_max4.640053907361315
driven_any_mean2.914472170500271
driven_any_median2.3759232888546973
driven_any_min1.136723992762137
driven_lanedir_max4.333227170761488
driven_lanedir_mean2.7064645304119317
driven_lanedir_min1.1165744195167024
in-drivable-lane_max0.8333333333333326
in-drivable-lane_mean0.413333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.3759232888546973, "driven_lanedir": 2.0554428873616786, "in-drivable-lane": 0.8333333333333326, "deviation-heading": 1.416877853155038, "deviation-center-line": 0.6141397077561574}, "ep001": {"driven_any": 2.1616056616275197, "driven_lanedir": 2.017934293509748, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 1.5766709344975451, "deviation-center-line": 0.4478209495868899}, "ep002": {"driven_any": 4.640053907361315, "driven_lanedir": 4.333227170761488, "in-drivable-lane": 0.5666666666666682, "deviation-heading": 2.9719488126799143, "deviation-center-line": 1.0185134787913035}, "ep003": {"driven_any": 4.258054001895686, "driven_lanedir": 4.009143880910043, "in-drivable-lane": 0.466666666666665, "deviation-heading": 2.0674487182700876, "deviation-center-line": 0.91409657857517}, "ep004": {"driven_any": 1.136723992762137, "driven_lanedir": 1.1165744195167024, "in-drivable-lane": 0, "deviation-heading": 0.48776593329341816, "deviation-center-line": 0.15406282312759506}}
85731077DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3320:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
85601075Claudio RuchBig Fleet Controlleraido1_amod_service_quality_r1-v3step1-simulationsuccessno3320:03:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
85541072Claudio RuchAlgorithm of Webinaraido1_amod_service_quality_r1-v3step1-simulationerrorno3320:10:49
Timeout: Waited 603 [...]
Timeout:

Waited 603.704154015 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
85491070Claudio RuchJava templateaido1_amod_service_quality_r1-v3step1-simulationerrorno3320:10:52
Timeout: Waited 604 [...]
Timeout:

Waited 604.023615122 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
85361066BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3320:04:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.989895791384896
deviation-center-line_median1.1553302918063904
in-drivable-lane_median1.1666666666666623


other stats
deviation-center-line_max2.3388961235533343
deviation-center-line_mean1.4609581191301255
deviation-center-line_min0.7844919613514744
deviation-heading_max2.4107762450679044
deviation-heading_mean1.807309896459126
deviation-heading_median1.9019886565358148
deviation-heading_min1.0937762649705445
driven_any_max5.615088377625264
driven_any_mean4.77235309113726
driven_any_median5.149049260363286
driven_any_min3.381530696392794
driven_lanedir_max5.572551454160816
driven_lanedir_mean4.4589456845011375
driven_lanedir_min2.961707707303685
in-drivable-lane_max1.7666666666666626
in-drivable-lane_mean0.8266666666666644
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.309930784496025, "driven_lanedir": 3.700232848313673, "in-drivable-lane": 1.7666666666666626, "deviation-heading": 2.4107762450679044, "deviation-center-line": 0.9759199581671592}, "ep001": {"driven_any": 5.406166336808935, "driven_lanedir": 4.989895791384896, "in-drivable-lane": 1.1666666666666623, "deviation-heading": 2.00735785023558, "deviation-center-line": 2.05015226077227}, "ep002": {"driven_any": 3.381530696392794, "driven_lanedir": 2.961707707303685, "in-drivable-lane": 1.1999999999999966, "deviation-heading": 1.622650465485788, "deviation-center-line": 0.7844919613514744}, "ep003": {"driven_any": 5.149049260363286, "driven_lanedir": 5.070340621342618, "in-drivable-lane": 0, "deviation-heading": 1.9019886565358148, "deviation-center-line": 1.1553302918063904}, "ep004": {"driven_any": 5.615088377625264, "driven_lanedir": 5.572551454160816, "in-drivable-lane": 0, "deviation-heading": 1.0937762649705445, "deviation-center-line": 2.3388961235533343}}
85311066BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3320:07:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
85251065BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3320:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
85171065BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3320:03:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
85041063BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3320:09:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
84981061MandanaSamieibazinga!!!aido1_LF1_r3-v3step3-videossuccessyes3320:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
84901061MandanaSamieibazinga!!!aido1_LF1_r3-v3step1-simulationsuccessno3320:03:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
84711056sodabetastay youngaido1_LF1_r3-v3step4-vizsuccessyes3320:01:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1335426343607509
deviation-center-line_median0.2163994710606635
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.28180888308880353
deviation-center-line_mean0.1868670999277449
deviation-center-line_min0.08957428132230419
deviation-heading_max1.5426025300799389
deviation-heading_mean0.6740741984343177
deviation-heading_median0.4611700117329748
deviation-heading_min0.07445946794710315
driven_any_max2.1088593834937095
driven_any_mean1.1131299013905018
driven_any_median1.174004192872781
driven_any_min0.347853094184539
driven_lanedir_max2.0685111737018964
driven_lanedir_mean0.990226087953578
driven_lanedir_min0.14358789111971848
in-drivable-lane_max0.33333333333333215
in-drivable-lane_mean0.11999999999999976
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3478530941845396, "driven_lanedir": 0.14358789111971848, "in-drivable-lane": 0.23333333333333336, "deviation-heading": 0.8789018596983168, "deviation-center-line": 0.08957428132230419}, "ep001": {"driven_any": 0.347853094184539, "driven_lanedir": 0.3470542158569685, "in-drivable-lane": 0, "deviation-heading": 0.07445946794710315, "deviation-center-line": 0.12073881609793594}, "ep002": {"driven_any": 1.174004192872781, "driven_lanedir": 1.1335426343607509, "in-drivable-lane": 0, "deviation-heading": 0.4611700117329748, "deviation-center-line": 0.2163994710606635}, "ep003": {"driven_any": 2.1088593834937095, "driven_lanedir": 2.0685111737018964, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.4132371227132552, "deviation-center-line": 0.28180888308880353}, "ep004": {"driven_any": 1.58707974221694, "driven_lanedir": 1.2584345247285562, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 1.5426025300799389, "deviation-center-line": 0.22581404806901717}}
84571055BenjaminMy ROS solution - param 3aido1_LF1_r3-v3step4-vizsuccessyes3320:03:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.27823326643947355
deviation-center-line_median0.1754483586704807
in-drivable-lane_median14.799999999999985


other stats
deviation-center-line_max0.20899834319026736
deviation-center-line_mean0.15320968266867013
deviation-center-line_min0.023037552405942577
deviation-heading_max1.2386213492038547
deviation-heading_mean0.8573000528571967
deviation-heading_median1.0299514458628671
deviation-heading_min0.013555570229481402
driven_any_max3.8920911916260423
driven_any_mean3.7744849641040914
driven_any_median3.819814656332734
driven_any_min3.60000451186592
driven_lanedir_max0.31956498306497005
driven_lanedir_mean0.23903991065794175
driven_lanedir_min0.02978106876073494
in-drivable-lane_max16.53333333333332
in-drivable-lane_mean15.079999999999988
in-drivable-lane_min14.53333333333332
per-episodes
details{"ep000": {"driven_any": 3.8523436137415583, "driven_lanedir": 0.02978106876073494, "in-drivable-lane": 16.53333333333332, "deviation-heading": 0.013555570229481402, "deviation-center-line": 0.023037552405942577}, "ep001": {"driven_any": 3.708170846954202, "driven_lanedir": 0.305872389512019, "in-drivable-lane": 14.53333333333332, "deviation-heading": 1.2386213492038547, "deviation-center-line": 0.20899834319026736}, "ep002": {"driven_any": 3.60000451186592, "driven_lanedir": 0.27823326643947355, "in-drivable-lane": 14.799999999999985, "deviation-heading": 1.0665703560324402, "deviation-center-line": 0.1754483586704807}, "ep003": {"driven_any": 3.819814656332734, "driven_lanedir": 0.2617478455125113, "in-drivable-lane": 14.866666666666651, "deviation-heading": 0.9378015429573398, "deviation-center-line": 0.15942617918544966}, "ep004": {"driven_any": 3.8920911916260423, "driven_lanedir": 0.31956498306497005, "in-drivable-lane": 14.666666666666652, "deviation-heading": 1.0299514458628671, "deviation-center-line": 0.1991379798912105}}
84481055BenjaminMy ROS solution - param 3aido1_LF1_r3-v3step1-simulationabortedno3320:00:15
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8448-1925', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8448-1925', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8448-1925_evaluation" with the default driver
stderr | Creating job8448-1925_solution_1 ...
stderr | Creating job8448-1925_evaluator_1 ...
stderr | 
Creating job8448-1925_evaluator_1 ... error

stderr | ERROR: for job8448-1925_evaluator_1  Cannot start service evaluator: network job8448-1925_evaluation not found
stderr | 
Creating job8448-1925_solution_1  ... error

stderr | ERROR: for job8448-1925_solution_1  Cannot start service solution: network job8448-1925_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8448-1925_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8448-1925_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
84431054DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3320:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
84411054DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.566666666666647


other stats
episodes
details{"ep000": {"nsteps": 257, "reward": -3.7163317949839065, "good_angle": 0.4040754514380267, "survival_time": 8.566666666666647, "traveled_tiles": 5, "valid_direction": 0.7333333333333316}, "ep001": {"nsteps": 234, "reward": -4.4394585757176035, "good_angle": 7.730404185747497, "survival_time": 7.799999999999982, "traveled_tiles": 5, "valid_direction": 1.6999999999999946}, "ep002": {"nsteps": 500, "reward": 0.18717753134015944, "good_angle": 0.470133995447931, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 0.9999999999999964}, "ep003": {"nsteps": 459, "reward": -1.9749117352453684, "good_angle": 0.4213946639061889, "survival_time": 15.299999999999956, "traveled_tiles": 8, "valid_direction": 0.6999999999999975}, "ep004": {"nsteps": 124, "reward": -8.247120564695516, "good_angle": 2.1871857981951406, "survival_time": 4.133333333333328, "traveled_tiles": 3, "valid_direction": 0.5999999999999979}}
good_angle_max7.730404185747497
good_angle_mean2.242638818946957
good_angle_median0.470133995447931
good_angle_min0.4040754514380267
reward_max0.18717753134015944
reward_mean-3.6381290278604466
reward_median-3.7163317949839065
reward_min-8.247120564695516
survival_time_max16.666666666666654
survival_time_mean10.493333333333313
survival_time_min4.133333333333328
traveled_tiles_max9
traveled_tiles_mean6
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max1.6999999999999946
valid_direction_mean0.9466666666666635
valid_direction_median0.7333333333333316
valid_direction_min0.5999999999999979
84371053sodabetastay youngaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.6666666666666634


other stats
episodes
details{"ep000": {"nsteps": 34, "reward": -29.653921192765292, "good_angle": 0.5432750363228189, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep001": {"nsteps": 34, "reward": -29.970305812709473, "good_angle": 0.0050401930608778515, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 110, "reward": -9.593723950873722, "good_angle": 0.43242677581517874, "survival_time": 3.6666666666666634, "traveled_tiles": 3, "valid_direction": 0.93333333333333}, "ep003": {"nsteps": 196, "reward": -5.411052850930362, "good_angle": 0.4479678779418729, "survival_time": 6.53333333333332, "traveled_tiles": 4, "valid_direction": 0.9666666666666632}, "ep004": {"nsteps": 148, "reward": -7.345814647617108, "good_angle": 8.8217135095513, "survival_time": 4.933333333333326, "traveled_tiles": 3, "valid_direction": 1.699999999999994}}
good_angle_max8.8217135095513
good_angle_mean2.05008467853841
good_angle_median0.4479678779418729
good_angle_min0.0050401930608778515
reward_max-5.411052850930362
reward_mean-16.39496369097919
reward_median-9.593723950873722
reward_min-29.970305812709473
survival_time_max6.53333333333332
survival_time_mean3.4799999999999955
survival_time_min1.1333333333333335
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.699999999999994
valid_direction_mean0.9133333333333308
valid_direction_median0.9666666666666632
valid_direction_min0
84271052MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
84231051DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3320:02:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.9557426648705187
deviation-center-line_median0.22080288697236833
in-drivable-lane_median0.3


other stats
deviation-center-line_max0.6516762720666056
deviation-center-line_mean0.33603350166836843
deviation-center-line_min0.09194481541531384
deviation-heading_max2.368714320527091
deviation-heading_mean1.4452621853421288
deviation-heading_median1.2411722126023677
deviation-heading_min0.9618995210386724
driven_any_max4.640074180233533
driven_any_mean2.582787568840291
driven_any_median2.124384084046963
driven_any_min0.32610597033581473
driven_lanedir_max3.428880812689395
driven_lanedir_mean1.9005735372761112
driven_lanedir_min0.0940113216818208
in-drivable-lane_max5.766666666666647
in-drivable-lane_mean1.98666666666666
in-drivable-lane_min0.033333333333333215
per-episodes
details{"ep000": {"driven_any": 0.32610597033581473, "driven_lanedir": 0.0940113216818208, "in-drivable-lane": 0.3, "deviation-heading": 1.0510367418758613, "deviation-center-line": 0.09194481541531384}, "ep001": {"driven_any": 4.640056376074319, "driven_lanedir": 3.428880812689395, "in-drivable-lane": 3.699999999999987, "deviation-heading": 2.368714320527091, "deviation-center-line": 0.6516762720666056}, "ep002": {"driven_any": 1.1833172335108262, "driven_lanedir": 1.0910296637731989, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.9618995210386724, "deviation-center-line": 0.15986026217004917}, "ep003": {"driven_any": 2.124384084046963, "driven_lanedir": 1.9557426648705187, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.2411722126023677, "deviation-center-line": 0.22080288697236833}, "ep004": {"driven_any": 4.640074180233533, "driven_lanedir": 2.9332032233656236, "in-drivable-lane": 5.766666666666647, "deviation-heading": 1.6034881306666526, "deviation-center-line": 0.5558832717175051}}
84191051DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.666666666666649


other stats
episodes
details{"ep000": {"nsteps": 37, "reward": -27.294602750913818, "good_angle": 0.8483111658711615, "survival_time": 1.2333333333333338, "traveled_tiles": 1, "valid_direction": 1.033333333333334}, "ep001": {"nsteps": 500, "reward": -0.4528968470962718, "good_angle": 21.56866975144795, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.233333333333319}, "ep002": {"nsteps": 129, "reward": -7.944797620781907, "good_angle": 0.5179636696946632, "survival_time": 4.2999999999999945, "traveled_tiles": 3, "valid_direction": 0.7666666666666639}, "ep003": {"nsteps": 230, "reward": -4.314899835234973, "good_angle": 0.54671284450962, "survival_time": 7.666666666666649, "traveled_tiles": 4, "valid_direction": 0.7666666666666639}, "ep004": {"nsteps": 500, "reward": -0.5305628583235666, "good_angle": 17.07359450863618, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.3333333333333215}}
good_angle_max21.56866975144795
good_angle_mean8.111050388031916
good_angle_median0.8483111658711615
good_angle_min0.5179636696946632
reward_max-0.4528968470962718
reward_mean-8.107551982470108
reward_median-4.314899835234973
reward_min-27.294602750913818
survival_time_max16.666666666666654
survival_time_mean9.306666666666658
survival_time_min1.2333333333333338
traveled_tiles_max10
traveled_tiles_mean5.4
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max4.233333333333319
valid_direction_mean2.0266666666666606
valid_direction_median1.033333333333334
valid_direction_min0.7666666666666639
84121050DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3320:02:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
84071049pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes3320:01:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83951047pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes3320:01:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83831046DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3320:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83711045DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3320:03:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
83671043DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3320:00:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83621043DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3320:01:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
83571042sodabetastay youngaido1_LF1_r3-v3step3-videossuccessyes3320:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83511042sodabetastay youngaido1_LF1_r3-v3step1-simulationsuccessno3320:04:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
83451041sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3320:00:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 128, in run
    solve(params, cis)
  File "solution.py", line 49, in solve
    env = DummyVecEnv([make_env(params)])()
TypeError: 'DummyVecEnv' object is not callable


Hidden. If you are the author, please login using the top-right link or use the dashboard.
83391039orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
83361038orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.13806526205428948
deviation-center-line_median0.102009000895267
in-drivable-lane_median0


other stats
deviation-center-line_max0.3628429863650274
deviation-center-line_mean0.1469315378158457
deviation-center-line_min0.06440998989810495
deviation-heading_max2.610674736500284
deviation-heading_mean0.8993390544048525
deviation-heading_median0.4974425787034586
deviation-heading_min0.3916093126081396
driven_any_max2.074558617600871
driven_any_mean0.5391343537461835
driven_any_median0.19255580990632737
driven_any_min0.052784877179512885
driven_lanedir_max0.1797688277475031
driven_lanedir_mean0.12055276914839869
driven_lanedir_min0.039230050910547654
in-drivable-lane_max14.466666666666637
in-drivable-lane_mean2.979999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.074558617600871, "driven_lanedir": 0.08456578465685204, "in-drivable-lane": 14.466666666666637, "deviation-heading": 2.610674736500284, "deviation-center-line": 0.3628429863650274}, "ep001": {"driven_any": 0.052784877179512885, "driven_lanedir": 0.039230050910547654, "in-drivable-lane": 0, "deviation-heading": 0.3916093126081396, "deviation-center-line": 0.06440998989810495}, "ep002": {"driven_any": 0.15528572315447434, "driven_lanedir": 0.13806526205428948, "in-drivable-lane": 0, "deviation-heading": 0.4974425787034586, "deviation-center-line": 0.102009000895267}, "ep003": {"driven_any": 0.22048674088973164, "driven_lanedir": 0.16113392037280105, "in-drivable-lane": 0.4333333333333347, "deviation-heading": 0.545639049940578, "deviation-center-line": 0.07069787421195953}, "ep004": {"driven_any": 0.19255580990632737, "driven_lanedir": 0.1797688277475031, "in-drivable-lane": 0, "deviation-heading": 0.4513295942718027, "deviation-center-line": 0.13469783770886962}}
83261036VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3320:04:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
83181034lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizsuccessyes3320:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.8341183952516875
deviation-center-line_median0.1358348793072531
in-drivable-lane_median0.8333333333333304


other stats
deviation-center-line_max0.6382228311645498
deviation-center-line_mean0.2245195044722196
deviation-center-line_min0
deviation-heading_max1.9602035414083736
deviation-heading_mean0.7779025626180096
deviation-heading_median0.26837434244431935
deviation-heading_min0
driven_any_max4.013385758739609
driven_any_mean1.5186964751910996
driven_any_median1.0537632787052789
driven_any_min0.5266524301703258
driven_lanedir_max2.6815313575984794
driven_lanedir_mean1.0169025785818993
driven_lanedir_min0
in-drivable-lane_max2.7333333333333236
in-drivable-lane_mean1.1133333333333313
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6130818994328824, "driven_lanedir": 0, "in-drivable-lane": 2.0000000000000027, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.5266524301703258, "driven_lanedir": 0.5218129970084366, "in-drivable-lane": 0, "deviation-heading": 0.16141368104811712, "deviation-center-line": 0.1214156436616722}, "ep002": {"driven_any": 1.386599008907402, "driven_lanedir": 0.8341183952516875, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 1.4995212481892382, "deviation-center-line": 0.227124168227623}, "ep003": {"driven_any": 4.013385758739609, "driven_lanedir": 2.6815313575984794, "in-drivable-lane": 2.7333333333333236, "deviation-heading": 1.9602035414083736, "deviation-center-line": 0.6382228311645498}, "ep004": {"driven_any": 1.0537632787052789, "driven_lanedir": 1.047050143050892, "in-drivable-lane": 0, "deviation-heading": 0.26837434244431935, "deviation-center-line": 0.1358348793072531}}
83061029VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:02:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.0602716239619054
deviation-center-line_median0.7730773308099039
in-drivable-lane_median1.9666666666666608


other stats
deviation-center-line_max1.1946875910387211
deviation-center-line_mean0.7221036052310261
deviation-center-line_min0.09897289157693905
deviation-heading_max3.242822349832869
deviation-heading_mean1.7504603583856997
deviation-heading_median1.498103664864646
deviation-heading_min0.06092138286581164
driven_any_max6.246060247204001
driven_any_mean3.676753904436093
driven_any_median3.4451260751526216
driven_any_min0.34666666666667245
driven_lanedir_max4.426556341399687
driven_lanedir_mean2.7568096489272724
driven_lanedir_min0.3458718774424743
in-drivable-lane_max5.299999999999984
in-drivable-lane_mean2.1599999999999935
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.246060247204001, "driven_lanedir": 4.124099198163025, "in-drivable-lane": 5.299999999999984, "deviation-heading": 2.929710249220569, "deviation-center-line": 1.0043519291648473}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 5.488181013798319, "driven_lanedir": 4.426556341399687, "in-drivable-lane": 1.9666666666666608, "deviation-heading": 3.242822349832869, "deviation-center-line": 1.1946875910387211}, "ep003": {"driven_any": 2.8577355193588514, "driven_lanedir": 1.8272492036692731, "in-drivable-lane": 2.6666666666666594, "deviation-heading": 1.0207441451446022, "deviation-center-line": 0.5394282835647191}, "ep004": {"driven_any": 3.4451260751526216, "driven_lanedir": 3.0602716239619054, "in-drivable-lane": 0.8666666666666636, "deviation-heading": 1.498103664864646, "deviation-center-line": 0.7730773308099039}}
83021029VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:02:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83011029VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.299999999999978


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.34568459894903936, "good_angle": 1.3612715983100865, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 3.6666666666666545}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 445, "reward": -2.572919675774445, "good_angle": 1.1484975988175092, "survival_time": 14.833333333333291, "traveled_tiles": 10, "valid_direction": 3.7666666666666537}, "ep003": {"nsteps": 224, "reward": -4.8573601154956645, "good_angle": 0.4191750594129948, "survival_time": 7.46666666666665, "traveled_tiles": 5, "valid_direction": 0.7333333333333307}, "ep004": {"nsteps": 279, "reward": -3.8909225920194386, "good_angle": 10.397136943650914, "survival_time": 9.299999999999978, "traveled_tiles": 4, "valid_direction": 2.4333333333333247}}
good_angle_max10.397136943650914
good_angle_mean2.666040998902808
good_angle_median1.1484975988175092
good_angle_min0.004123794322536422
reward_max-0.34568459894903936
reward_mean-9.587461278507089
reward_median-3.8909225920194386
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean9.83999999999998
survival_time_min0.9333333333333332
traveled_tiles_max11
traveled_tiles_mean6.2
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max3.7666666666666537
valid_direction_mean2.119999999999993
valid_direction_median2.4333333333333247
valid_direction_min0
82931029VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:06:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
82841028sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3320:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    num_stack=1)
  File "/workspace/model.py", line 246, in __init__
    self._current_obs = self._current_obs.cuda()
RuntimeError: cuda runtime error (35) : CUDA driver version is insufficient for CUDA runtime version at /tmp/pip-req-build-vRRdPa/aten/src/THC/THCGeneral.cpp:74


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82751025sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3320:06:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 89, in solve
    observation, reward, done, info = env.step(action)
  File "/workspace/wrappers.py", line 252, in step
    return self.step_wait()
  File "/workspace/wrappers.py", line 271, in step_wait
    results = [env.step(a) for (a,env) in zip(self.actions, self.envs)]
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82711024sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3320:05:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 89, in solve
    observation, reward, done, info = env.step(action)
  File "/workspace/wrappers.py", line 252, in step
    return self.step_wait()
  File "/workspace/wrappers.py", line 271, in step_wait
    results = [env.step(a) for (a,env) in zip(self.actions, self.envs)]
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82631020sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3320:00:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 81, in solve
    model.update_current_obs(observation)
  File "/workspace/model.py", line 257, in update_current_obs
    obs = torch.from_numpy(obs).float()
RuntimeError: PyTorch was compiled without NumPy support

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 81, in solve
    model.update_current_obs(observation)
  File "/workspace/model.py", line 257, in update_current_obs
    obs = torch.from_numpy(obs).float()
RuntimeError: PyTorch was compiled without NumPy support


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82591018sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3320:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 285, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
NameError: name 'os' is not defined

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 285, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
NameError: name 'os' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82531016orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step4-vizsuccessyes3320:02:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0420704966136085
deviation-center-line_median0.450762725966435
in-drivable-lane_median1.4333333333333282


other stats
deviation-center-line_max0.6883340509228337
deviation-center-line_mean0.4338478802433427
deviation-center-line_min0.20320804757303057
deviation-heading_max2.472742851242546
deviation-heading_mean1.6272956424260854
deviation-heading_median1.779711963877342
deviation-heading_min0.3847169219113941
driven_any_max3.3232179923540857
driven_any_mean1.4969973296695418
driven_any_median1.434880110160263
driven_any_min0.3975416116703704
driven_lanedir_max2.9516039212976346
driven_lanedir_mean1.1778170860958144
driven_lanedir_min0.19414959063454773
in-drivable-lane_max2.633333333333325
in-drivable-lane_mean1.3266666666666622
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3975416116703704, "driven_lanedir": 0.19414959063454773, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 1.938830071623383, "deviation-center-line": 0.20320804757303057}, "ep001": {"driven_any": 0.5652526814066909, "driven_lanedir": 0.5544790059832945, "in-drivable-lane": 0, "deviation-heading": 0.3847169219113941, "deviation-center-line": 0.3704325753311614}, "ep002": {"driven_any": 1.434880110160263, "driven_lanedir": 1.0420704966136085, "in-drivable-lane": 1.4333333333333282, "deviation-heading": 2.472742851242546, "deviation-center-line": 0.450762725966435}, "ep003": {"driven_any": 3.3232179923540857, "driven_lanedir": 2.9516039212976346, "in-drivable-lane": 2.199999999999992, "deviation-heading": 1.5604764034757617, "deviation-center-line": 0.6883340509228337}, "ep004": {"driven_any": 1.7640942527562995, "driven_lanedir": 1.1467824159499866, "in-drivable-lane": 2.633333333333325, "deviation-heading": 1.779711963877342, "deviation-center-line": 0.456502001423253}}
82431016orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step3-videossuccessyes3320:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
82361016orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.533333333333316


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -13.416412785493058, "good_angle": 0.9723576108709706, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.333333333333334}, "ep001": {"nsteps": 108, "reward": -9.848042460503402, "good_angle": 2.041641545621004, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5666666666666647}, "ep002": {"nsteps": 226, "reward": -4.574839447271614, "good_angle": 1.5760425170941503, "survival_time": 7.533333333333316, "traveled_tiles": 5, "valid_direction": 2.5999999999999908}, "ep003": {"nsteps": 500, "reward": -0.13448444758018013, "good_angle": 0.6536031283623902, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 2.06666666666666}, "ep004": {"nsteps": 282, "reward": -4.769903202343019, "good_angle": 16.060156931528677, "survival_time": 9.399999999999975, "traveled_tiles": 3, "valid_direction": 4.166666666666653}}
good_angle_max16.060156931528677
good_angle_mean4.260760346695439
good_angle_median1.5760425170941503
good_angle_min0.6536031283623902
reward_max-0.13448444758018013
reward_mean-6.548736468638255
reward_median-4.769903202343019
reward_min-13.416412785493058
survival_time_max16.666666666666654
survival_time_mean7.946666666666656
survival_time_min2.533333333333334
traveled_tiles_max6
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.166666666666653
valid_direction_mean2.3466666666666605
valid_direction_median2.333333333333334
valid_direction_min0.5666666666666647
82321014DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3320:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
82241014DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.866666666666652


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9306288996577204, "good_angle": 47.87430593067364, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.999999999999991}, "ep001": {"nsteps": 46, "reward": -23.185519551453385, "good_angle": 1.6313685002422855, "survival_time": 1.5333333333333348, "traveled_tiles": 1, "valid_direction": 1.3666666666666678}, "ep002": {"nsteps": 67, "reward": -16.407220910734207, "good_angle": 2.788345284479015, "survival_time": 2.233333333333335, "traveled_tiles": 2, "valid_direction": 1.9666666666666688}, "ep003": {"nsteps": 206, "reward": -6.157946786662401, "good_angle": 9.112657671054972, "survival_time": 6.866666666666652, "traveled_tiles": 1, "valid_direction": 6.2999999999999865}, "ep004": {"nsteps": 500, "reward": -0.7976089986190782, "good_angle": 14.963064557678637, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.033333333333324}}
good_angle_max47.87430593067364
good_angle_mean15.27394838882571
good_angle_median9.112657671054972
good_angle_min1.6313685002422855
reward_max-0.7976089986190782
reward_mean-9.495785029425358
reward_median-6.157946786662401
reward_min-23.185519551453385
survival_time_max16.666666666666654
survival_time_mean8.793333333333326
survival_time_min1.5333333333333348
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.033333333333324
valid_direction_mean7.733333333333327
valid_direction_median6.2999999999999865
valid_direction_min1.3666666666666678
82221015DavidPytorch ILaido1_LF1_r3-v3step3-videosabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8222-4618', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8222-4618', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8222-4618_evaluation" with the default driver
stderr | Creating job8222-4618_videos_1 ...
stderr | 
Creating job8222-4618_videos_1 ... error

stderr | ERROR: for job8222-4618_videos_1  Cannot start service videos: network job8222-4618_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8222-4618_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
82161013DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3320:01:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.045501921968241
deviation-center-line_median0.2091624126838803
in-drivable-lane_median0.6666666666666643


other stats
deviation-center-line_max0.4092460733590128
deviation-center-line_mean0.22209535103391645
deviation-center-line_min0.09069371930535795
deviation-heading_max1.9898991959179324
deviation-heading_mean0.94011531750907
deviation-heading_median0.9544381615223942
deviation-heading_min0.21977299030009587
driven_any_max4.767455751110348
driven_any_mean2.001900079658949
driven_any_median1.441799742533946
driven_any_min0.4699652285178057
driven_lanedir_max3.5709948744457645
driven_lanedir_mean1.5296434476594245
driven_lanedir_min0.3889697115797952
in-drivable-lane_max1.233333333333329
in-drivable-lane_mean0.6866666666666648
in-drivable-lane_min0.16666666666666718
per-episodes
details{"ep000": {"driven_any": 2.345456280523682, "driven_lanedir": 1.78342391275278, "in-drivable-lane": 1.0666666666666644, "deviation-heading": 1.272508723248177, "deviation-center-line": 0.3002014448323916}, "ep001": {"driven_any": 0.4699652285178057, "driven_lanedir": 0.3889697115797952, "in-drivable-lane": 0.16666666666666718, "deviation-heading": 0.26395751655675054, "deviation-center-line": 0.1011731049889396}, "ep002": {"driven_any": 1.441799742533946, "driven_lanedir": 1.045501921968241, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 0.9544381615223942, "deviation-center-line": 0.2091624126838803}, "ep003": {"driven_any": 4.767455751110348, "driven_lanedir": 3.5709948744457645, "in-drivable-lane": 1.233333333333329, "deviation-heading": 1.9898991959179324, "deviation-center-line": 0.4092460733590128}, "ep004": {"driven_any": 0.984823395608963, "driven_lanedir": 0.85932681755054, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 0.21977299030009587, "deviation-center-line": 0.09069371930535795}}
82091012DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3320:01:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.361710864104449
deviation-center-line_median0.2783072659197908
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.6050064686595661
deviation-center-line_mean0.31461217400608266
deviation-center-line_min0.17005166211675882
deviation-heading_max1.9169169762749656
deviation-heading_mean1.3761961901678326
deviation-heading_median1.2759200934769432
deviation-heading_min0.9383173707596384
driven_any_max4.252547344324386
driven_any_mean2.1598055194999795
driven_any_median1.595991497331806
driven_any_min1.1641876080390487
driven_lanedir_max4.024505797728752
driven_lanedir_mean1.923334501859577
driven_lanedir_min0.8874632716964423
in-drivable-lane_max0.5999999999999999
in-drivable-lane_mean0.2333333333333329
in-drivable-lane_min0.033333333333333215
per-episodes
details{"ep000": {"driven_any": 2.3423219042750647, "driven_lanedir": 2.039163406184771, "in-drivable-lane": 0.5999999999999999, "deviation-heading": 1.2641576047306058, "deviation-center-line": 0.2783072659197908}, "ep001": {"driven_any": 1.1641876080390487, "driven_lanedir": 0.8874632716964423, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.4856689055970107, "deviation-center-line": 0.29214794376015657}, "ep002": {"driven_any": 1.443979243529592, "driven_lanedir": 1.361710864104449, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.9383173707596384, "deviation-center-line": 0.227547529574141}, "ep003": {"driven_any": 4.252547344324386, "driven_lanedir": 4.024505797728752, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.9169169762749656, "deviation-center-line": 0.6050064686595661}, "ep004": {"driven_any": 1.595991497331806, "driven_lanedir": 1.3038291695834712, "in-drivable-lane": 0.2333333333333325, "deviation-heading": 1.2759200934769432, "deviation-center-line": 0.17005166211675882}}
82011012DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.133333333333328


other stats
episodes
details{"ep000": {"nsteps": 188, "reward": -5.302508274819628, "good_angle": 0.2336332078066926, "survival_time": 6.266666666666654, "traveled_tiles": 5, "valid_direction": 0.33333333333333215}, "ep001": {"nsteps": 96, "reward": -11.286469660078486, "good_angle": 5.260110817210399, "survival_time": 3.1999999999999984, "traveled_tiles": 2, "valid_direction": 1.8333333333333308}, "ep002": {"nsteps": 116, "reward": -8.673792693163831, "good_angle": 0.14625930291742983, "survival_time": 3.8666666666666623, "traveled_tiles": 4, "valid_direction": 0.36666666666666536}, "ep003": {"nsteps": 331, "reward": -3.113548352757646, "good_angle": 0.2870058529237993, "survival_time": 11.033333333333305, "traveled_tiles": 7, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 124, "reward": -8.645794202444977, "good_angle": 6.729997830887314, "survival_time": 4.133333333333328, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}}
good_angle_max6.729997830887314
good_angle_mean2.5314014023491267
good_angle_median0.2870058529237993
good_angle_min0.14625930291742983
reward_max-3.113548352757646
reward_mean-7.404422636652913
reward_median-8.645794202444977
reward_min-11.286469660078486
survival_time_max11.033333333333305
survival_time_mean5.6999999999999895
survival_time_min3.1999999999999984
traveled_tiles_max7
traveled_tiles_mean4.2
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max1.8333333333333308
valid_direction_mean0.9333333333333308
valid_direction_median0.6666666666666643
valid_direction_min0.33333333333333215
81961012DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3320:02:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
81901010sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3320:00:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 45, in solve
    env = DummyVecEnv([make_env(params)])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'NoneType' object is not callable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 45, in solve
    env = DummyVecEnv([make_env(params)])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'NoneType' object is not callable


Hidden. If you are the author, please login using the top-right link or use the dashboard.
81881009sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3320:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 45, in solve
    env = DummyVecEnv([make_env(params)])
TypeError: make_env() takes 0 positional arguments but 1 was given

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 45, in solve
    env = DummyVecEnv([make_env(params)])
TypeError: make_env() takes 0 positional arguments but 1 was given


Hidden. If you are the author, please login using the top-right link or use the dashboard.
81831008sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3320:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 122, in run
    solve(params, cis)
  File "solution.py", line 43, in solve
    env = DummyVecEnv([env])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'ScaleObservations' object is not callable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 122, in run
    solve(params, cis)
  File "solution.py", line 43, in solve
    env = DummyVecEnv([env])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'ScaleObservations' object is not callable


Hidden. If you are the author, please login using the top-right link or use the dashboard.
81741007sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3320:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 122, in run
    solve(params, cis)
  File "solution.py", line 43, in solve
    env = DummyVecEnv([env])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'ScaleObservations' object is not callable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 122, in run
    solve(params, cis)
  File "solution.py", line 43, in solve
    env = DummyVecEnv([env])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'ScaleObservations' object is not callable


Hidden. If you are the author, please login using the top-right link or use the dashboard.
81701004lmandrileTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3320:02:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.13312858444658682
deviation-center-line_median0.08744010848352336
in-drivable-lane_median8.366666666666639


other stats
deviation-center-line_max0.2951251593343002
deviation-center-line_mean0.12729673166499883
deviation-center-line_min0.047860468716545944
deviation-heading_max1.2058790583016687
deviation-heading_mean0.7178061254891885
deviation-heading_median0.7905924332634966
deviation-heading_min0.1745193388357215
driven_any_max4.454184189442348
driven_any_mean2.5257450968093726
driven_any_median2.3537329967677016
driven_any_min1.0662869877338133
driven_lanedir_max0.4531051551321528
driven_lanedir_mean0.193667880939661
driven_lanedir_min0.07969926819667117
in-drivable-lane_max15.999999999999988
in-drivable-lane_mean9.086666666666648
in-drivable-lane_min3.766666666666661
per-episodes
details{"ep000": {"driven_any": 1.995026722965619, "driven_lanedir": 0.07969926819667117, "in-drivable-lane": 7.866666666666648, "deviation-heading": 0.1745193388357215, "deviation-center-line": 0.047860468716545944}, "ep001": {"driven_any": 2.3537329967677016, "driven_lanedir": 0.13312858444658682, "in-drivable-lane": 9.433333333333303, "deviation-heading": 1.2058790583016687, "deviation-center-line": 0.1298299749331926}, "ep002": {"driven_any": 4.454184189442348, "driven_lanedir": 0.18029873261228624, "in-drivable-lane": 15.999999999999988, "deviation-heading": 0.47847911565363, "deviation-center-line": 0.07622794685743216}, "ep003": {"driven_any": 1.0662869877338133, "driven_lanedir": 0.12210766431060804, "in-drivable-lane": 3.766666666666661, "deviation-heading": 0.7905924332634966, "deviation-center-line": 0.08744010848352336}, "ep004": {"driven_any": 2.7594945871373833, "driven_lanedir": 0.4531051551321528, "in-drivable-lane": 8.366666666666639, "deviation-heading": 0.9395606813914256, "deviation-center-line": 0.2951251593343002}}
81591004lmandrileTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessno3320:02:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
81501002lmandrileTensorflow templateaido1_LF1_r3-v3step3-videosabortedyes3320:00:32
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8150-2724', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8150-2724', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8150-2724_evaluation" with the default driver
stderr | Creating job8150-2724_videos_1 ...
stderr | 
Creating job8150-2724_videos_1 ... error

stderr | ERROR: for job8150-2724_videos_1  Cannot start service videos: network job8150-2724_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8150-2724_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
81391000sodabetastay simpleaido1_LF1_r3-v3step4-vizsuccessyes3320:03:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.014829571611556512
deviation-center-line_median0.5158599622317641
in-drivable-lane_median7.499999999999974


other stats
deviation-center-line_max0.7894100851017714
deviation-center-line_mean0.42262990487267904
deviation-center-line_min0
deviation-heading_max6.565470517960345
deviation-heading_mean5.168740437815567
deviation-heading_median6.44619447898253
deviation-heading_min0
driven_any_max0.0434628991323474
driven_any_mean0.04024508332775765
driven_any_median0.03944062937661155
driven_any_min0.03944062937660501
driven_lanedir_max0.014926061784539256
driven_lanedir_mean0.011877589188984582
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean9.326666666666643
in-drivable-lane_min7.499999999999974
per-episodes
details{"ep000": {"driven_any": 0.0434628991323474, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.03944062937661494, "driven_lanedir": 0.014926061784539256, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.35137730604979, "deviation-center-line": 0.7894100851017714}, "ep002": {"driven_any": 0.039440629376609325, "driven_lanedir": 0.014829571611556512, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.480659886085168, "deviation-center-line": 0.5158599622317641}, "ep003": {"driven_any": 0.03944062937661155, "driven_lanedir": 0.014883158723512311, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.44619447898253, "deviation-center-line": 0.2261107645638975}, "ep004": {"driven_any": 0.03944062937660501, "driven_lanedir": 0.014749153825314831, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.565470517960345, "deviation-center-line": 0.5817687124659621}}
8114995Manfred DiazDAggeraido1_LF1_r3-v3step3-videossuccessyes3320:01:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
8107995Manfred DiazDAggeraido1_LF1_r3-v3step1-simulationsuccessno3320:03:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
8094989VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:05:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.134341320879944
deviation-center-line_median1.9231104123180216
in-drivable-lane_median2.6666666666666785


other stats
deviation-center-line_max2.4672838847978604
deviation-center-line_mean1.8802017935178892
deviation-center-line_min1.1510608107169331
deviation-heading_max2.122160942008872
deviation-heading_mean1.8617177696464784
deviation-heading_median1.9368236681807245
deviation-heading_min1.4598171163237277
driven_any_max6.296294432793152
driven_any_mean6.268011031189323
driven_any_median6.283075427615398
driven_any_min6.20626247640538
driven_lanedir_max5.590448107063559
driven_lanedir_mean5.034148207982884
driven_lanedir_min4.486003737617959
in-drivable-lane_max4.633333333333319
in-drivable-lane_mean3.026666666666661
in-drivable-lane_min1.4666666666666617
per-episodes
details{"ep000": {"driven_any": 6.295741885769301, "driven_lanedir": 4.486003737617959, "in-drivable-lane": 4.633333333333319, "deviation-heading": 1.836166422163057, "deviation-center-line": 1.546790168179425}, "ep001": {"driven_any": 6.20626247640538, "driven_lanedir": 5.36376955621475, "in-drivable-lane": 2.033333333333327, "deviation-heading": 2.122160942008872, "deviation-center-line": 2.312763691577205}, "ep002": {"driven_any": 6.283075427615398, "driven_lanedir": 4.59617831813821, "in-drivable-lane": 4.333333333333319, "deviation-heading": 1.4598171163237277, "deviation-center-line": 1.9231104123180216}, "ep003": {"driven_any": 6.296294432793152, "driven_lanedir": 5.134341320879944, "in-drivable-lane": 2.6666666666666785, "deviation-heading": 1.953620699556012, "deviation-center-line": 1.1510608107169331}, "ep004": {"driven_any": 6.258680933363384, "driven_lanedir": 5.590448107063559, "in-drivable-lane": 1.4666666666666617, "deviation-heading": 1.9368236681807245, "deviation-center-line": 2.4672838847978604}}
8090992placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3320:02:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
8085992placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessno3320:07:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
8081991Manfred DiazTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes3320:01:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
8076991Manfred DiazTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.02538924222346395, "good_angle": 0.9013978960212492, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.2999999999999954}, "ep001": {"nsteps": 500, "reward": -0.4714887079430846, "good_angle": 1.3620819612923076, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.3333333333333255}, "ep002": {"nsteps": 500, "reward": 0.017620765649015085, "good_angle": 0.8416206499212662, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 0.9666666666666632}, "ep003": {"nsteps": 500, "reward": -0.0066720743512705665, "good_angle": 0.9128915756311105, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.2999999999999972}, "ep004": {"nsteps": 500, "reward": -0.003458254712633789, "good_angle": 9.65186499002516, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.333333333333325}}
good_angle_max9.65186499002516
good_angle_mean2.7339714145782184
good_angle_median0.9128915756311105
good_angle_min0.8416206499212662
reward_max0.02538924222346395
reward_mean-0.08772180582690198
reward_median-0.003458254712633789
reward_min-0.4714887079430846
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max11
traveled_tiles_mean10.6
traveled_tiles_median11
traveled_tiles_min10
valid_direction_max2.3333333333333255
valid_direction_mean1.6466666666666612
valid_direction_median1.2999999999999972
valid_direction_min0.9666666666666632
8069989VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5431600785318297, "good_angle": 0.9067805821867386, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.9333333333333265}, "ep001": {"nsteps": 500, "reward": -0.616796643519774, "good_angle": 31.053615074944535, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.866666666666654}, "ep002": {"nsteps": 500, "reward": -0.6115267089046538, "good_angle": 0.82679593498224, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.2333333333333254}, "ep003": {"nsteps": 500, "reward": -0.3262829188723117, "good_angle": 0.811202341751506, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.0666666666666593}, "ep004": {"nsteps": 500, "reward": -0.5283348486777395, "good_angle": 22.3351322728827, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.2333333333333583}}
good_angle_max31.053615074944535
good_angle_mean11.186705241349545
good_angle_median0.9067805821867386
good_angle_min0.811202341751506
reward_max-0.3262829188723117
reward_mean-0.5252202397012617
reward_median-0.5431600785318297
reward_min-0.616796643519774
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max13
traveled_tiles_mean12.2
traveled_tiles_median12
traveled_tiles_min11
valid_direction_max4.866666666666654
valid_direction_mean2.866666666666665
valid_direction_median2.2333333333333254
valid_direction_min1.9333333333333265
8064988placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3320:01:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
8062988placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringabortedyes3320:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8062-716', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8062-716', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8062-716_evaluation" with the default driver
stderr | Creating job8062-716_scorer_1 ...
stderr | 
Creating job8062-716_scorer_1 ... error

stderr | ERROR: for job8062-716_scorer_1  Cannot start service scorer: network job8062-716_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8062-716_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
8055987placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationfailedno3320:07:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
8049985placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3320:02:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.498942345524522
deviation-center-line_median0.4713912898166789
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.7288792245355281
deviation-center-line_mean0.4610330643672519
deviation-center-line_min0.1999809376741018
deviation-heading_max2.691400643996171
deviation-heading_mean1.4381212266199
deviation-heading_median0.9907868240363548
deviation-heading_min0.6116162583641453
driven_any_max3.909752601246987
driven_any_mean2.594514311751132
driven_any_median2.709894989018494
driven_any_min1.0599323658085185
driven_lanedir_max3.743041347224687
driven_lanedir_mean2.4450599385941154
driven_lanedir_min0.8858751260873383
in-drivable-lane_max0.5333333333333314
in-drivable-lane_mean0.18666666666666623
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0599323658085185, "driven_lanedir": 0.8858751260873383, "in-drivable-lane": 0.3666666666666667, "deviation-heading": 0.6116162583641453, "deviation-center-line": 0.1999809376741018}, "ep001": {"driven_any": 2.839800657119857, "driven_lanedir": 2.498942345524522, "in-drivable-lane": 0.5333333333333314, "deviation-heading": 2.0103804865574872, "deviation-center-line": 0.4022511021695606}, "ep002": {"driven_any": 3.909752601246987, "driven_lanedir": 3.743041347224687, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.691400643996171, "deviation-center-line": 0.7288792245355281}, "ep003": {"driven_any": 2.709894989018494, "driven_lanedir": 2.679920745641426, "in-drivable-lane": 0, "deviation-heading": 0.8864219201453419, "deviation-center-line": 0.4713912898166789}, "ep004": {"driven_any": 2.4531909455618046, "driven_lanedir": 2.417520128492604, "in-drivable-lane": 0, "deviation-heading": 0.9907868240363548, "deviation-center-line": 0.5026627676403905}}
8046985placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.333333333333317


other stats
episodes
details{"ep000": {"nsteps": 91, "reward": -11.150584790064086, "good_angle": 0.1407140490017567, "survival_time": 3.0333333333333323, "traveled_tiles": 3, "valid_direction": 0.30000000000000004}, "ep001": {"nsteps": 243, "reward": -4.586310418257049, "good_angle": 15.139074582275237, "survival_time": 8.099999999999982, "traveled_tiles": 6, "valid_direction": 3.1666666666666607}, "ep002": {"nsteps": 333, "reward": -3.1747410535463567, "good_angle": 0.8234156515103922, "survival_time": 11.099999999999971, "traveled_tiles": 8, "valid_direction": 2.399999999999996}, "ep003": {"nsteps": 220, "reward": -4.907579297724773, "good_angle": 0.12808957681956995, "survival_time": 7.333333333333317, "traveled_tiles": 5, "valid_direction": 0.09999999999999964}, "ep004": {"nsteps": 206, "reward": -5.029392477991263, "good_angle": 8.353891473535883, "survival_time": 6.866666666666652, "traveled_tiles": 5, "valid_direction": 1.1999999999999955}}
good_angle_max15.139074582275237
good_angle_mean4.917037066628568
good_angle_median0.8234156515103922
good_angle_min0.12808957681956995
reward_max-3.1747410535463567
reward_mean-5.769721607516705
reward_median-4.907579297724773
reward_min-11.150584790064086
survival_time_max11.099999999999971
survival_time_mean7.28666666666665
survival_time_min3.0333333333333323
traveled_tiles_max8
traveled_tiles_mean5.4
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max3.1666666666666607
valid_direction_mean1.4333333333333305
valid_direction_median1.1999999999999955
valid_direction_min0.09999999999999964
8041985placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessno3320:04:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
8032983placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8666666666666623


other stats
episodes
details{"ep000": {"nsteps": 116, "reward": -8.89257429624182, "good_angle": 0.1330432528398118, "survival_time": 3.8666666666666623, "traveled_tiles": 3, "valid_direction": 0.2333333333333333}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 329, "reward": -3.31293563591741, "good_angle": 0.3681829161344062, "survival_time": 10.966666666666638, "traveled_tiles": 8, "valid_direction": 0.466666666666665}, "ep003": {"nsteps": 56, "reward": -18.23833635702197, "good_angle": 0.02139515126107087, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.2012757088522776, "good_angle": 8.827879681561576, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.533333333333321}}
good_angle_max8.827879681561576
good_angle_mean1.87092495922388
good_angle_median0.1330432528398118
good_angle_min0.004123794322536422
reward_max-0.2012757088522776
reward_mean-13.383108281666065
reward_median-8.89257429624182
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean6.8599999999999905
survival_time_min0.9333333333333332
traveled_tiles_max8
traveled_tiles_mean4.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.533333333333321
valid_direction_mean0.8466666666666638
valid_direction_median0.2333333333333333
valid_direction_min0
8026983placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessno3320:04:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
8016981VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3320:10:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
8006978VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3320:10:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
8004977placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3320:01:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5617032380115112
deviation-center-line_median0.14308533804851947
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.769540697826587
deviation-center-line_mean0.24717872572231145
deviation-center-line_min0.08229304132893547
deviation-heading_max1.0474203473264154
deviation-heading_mean0.5589297051313892
deviation-heading_median0.5746229109495427
deviation-heading_min0.0638008653416417
driven_any_max2.221621798459929
driven_any_mean0.9336463312269558
driven_any_median0.7983162016184838
driven_any_min0.3399979234285063
driven_lanedir_max2.096862852800724
driven_lanedir_mean0.8285242118983527
driven_lanedir_min0.33872968824241
in-drivable-lane_max0.4666666666666681
in-drivable-lane_mean0.16666666666666682
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7983162016184838, "driven_lanedir": 0.6497025332567524, "in-drivable-lane": 0.2, "deviation-heading": 0.5746229109495427, "deviation-center-line": 0.14308533804851947}, "ep001": {"driven_any": 0.3399979234285063, "driven_lanedir": 0.33872968824241, "in-drivable-lane": 0, "deviation-heading": 0.0638008653416417, "deviation-center-line": 0.08229304132893547}, "ep002": {"driven_any": 0.4983265844759663, "driven_lanedir": 0.4956227471803656, "in-drivable-lane": 0, "deviation-heading": 0.0971725872124701, "deviation-center-line": 0.08844675530989567}, "ep003": {"driven_any": 2.221621798459929, "driven_lanedir": 2.096862852800724, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.0474203473264154, "deviation-center-line": 0.769540697826587}, "ep004": {"driven_any": 0.8099691481518935, "driven_lanedir": 0.5617032380115112, "in-drivable-lane": 0.4666666666666681, "deviation-heading": 1.011631814826876, "deviation-center-line": 0.15252779609761974}}
7994976placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3320:01:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.5472678870867416
deviation-center-line_median0.3359071713314118
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.46773144496088725
deviation-center-line_mean0.32517829066895737
deviation-center-line_min0.16866482502596974
deviation-heading_max1.6293053285312915
deviation-heading_mean1.0663511152258056
deviation-heading_median1.0755561144898615
deviation-heading_min0.4078274737159362
driven_any_max1.9999452675796772
driven_any_mean1.589298862446067
driven_any_median1.6232923958510668
driven_any_min1.0166496092576491
driven_lanedir_max1.7724508685709552
driven_lanedir_mean1.432386566731796
driven_lanedir_min0.8551238051906974
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.18666666666666615
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0166496092576491, "driven_lanedir": 0.8551238051906974, "in-drivable-lane": 0.2666666666666666, "deviation-heading": 0.616923463458322, "deviation-center-line": 0.2349479397681263}, "ep001": {"driven_any": 1.9999452675796772, "driven_lanedir": 1.685268598805122, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.6021431959336172, "deviation-center-line": 0.4186400722583914}, "ep002": {"driven_any": 1.3216422669515713, "driven_lanedir": 1.301821674005465, "in-drivable-lane": 0, "deviation-heading": 0.4078274737159362, "deviation-center-line": 0.16866482502596974}, "ep003": {"driven_any": 1.6232923958510668, "driven_lanedir": 1.5472678870867416, "in-drivable-lane": 0, "deviation-heading": 1.0755561144898615, "deviation-center-line": 0.46773144496088725}, "ep004": {"driven_any": 1.984964772590372, "driven_lanedir": 1.7724508685709552, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.6293053285312915, "deviation-center-line": 0.3359071713314118}}
7985976placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.533333333333327


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -12.52588034088996, "good_angle": 0.17952429330929992, "survival_time": 2.7333333333333334, "traveled_tiles": 3, "valid_direction": 0.6666666666666665}, "ep001": {"nsteps": 172, "reward": -6.511317504494083, "good_angle": 5.578101579727321, "survival_time": 5.733333333333323, "traveled_tiles": 3, "valid_direction": 1.7666666666666644}, "ep002": {"nsteps": 107, "reward": -9.778149597277151, "good_angle": 0.03286934148681326, "survival_time": 3.566666666666664, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 136, "reward": -7.620555359009065, "good_angle": 0.4826043130813186, "survival_time": 4.533333333333327, "traveled_tiles": 3, "valid_direction": 1.1333333333333313}, "ep004": {"nsteps": 162, "reward": -6.687916881631899, "good_angle": 5.260282393500154, "survival_time": 5.399999999999991, "traveled_tiles": 3, "valid_direction": 2.5333333333333243}}
good_angle_max5.578101579727321
good_angle_mean2.306676384220981
good_angle_median0.4826043130813186
good_angle_min0.03286934148681326
reward_max-6.511317504494083
reward_mean-8.624763936660433
reward_median-7.620555359009065
reward_min-12.52588034088996
survival_time_max5.733333333333323
survival_time_mean4.393333333333328
survival_time_min2.7333333333333334
traveled_tiles_max3
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max2.5333333333333243
valid_direction_mean1.2199999999999973
valid_direction_median1.1333333333333313
valid_direction_min0
7980975placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.566666666666653


other stats
episodes
details{"ep000": {"nsteps": 179, "reward": -6.143844588318912, "good_angle": 0.20726566058568413, "survival_time": 5.966666666666655, "traveled_tiles": 4, "valid_direction": 0.6666666666666665}, "ep001": {"nsteps": 311, "reward": -3.7829405356683674, "good_angle": 7.451692345729561, "survival_time": 10.36666666666664, "traveled_tiles": 5, "valid_direction": 3.5999999999999917}, "ep002": {"nsteps": 58, "reward": -18.3334619030517, "good_angle": 1.1586740658805823, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 1.8666666666666691}, "ep003": {"nsteps": 197, "reward": -5.360624333171098, "good_angle": 0.3756824015196448, "survival_time": 6.566666666666653, "traveled_tiles": 5, "valid_direction": 1.099999999999996}, "ep004": {"nsteps": 203, "reward": -5.274989076942811, "good_angle": 10.522511174400554, "survival_time": 6.766666666666652, "traveled_tiles": 5, "valid_direction": 2.0666666666666593}}
good_angle_max10.522511174400554
good_angle_mean3.9431651296232055
good_angle_median1.1586740658805823
good_angle_min0.20726566058568413
reward_max-3.7829405356683674
reward_mean-7.779172087430576
reward_median-5.360624333171098
reward_min-18.3334619030517
survival_time_max10.36666666666664
survival_time_mean6.319999999999988
survival_time_min1.933333333333336
traveled_tiles_max5
traveled_tiles_mean4.2
traveled_tiles_median5
traveled_tiles_min2
valid_direction_max3.5999999999999917
valid_direction_mean1.8599999999999963
valid_direction_median1.8666666666666691
valid_direction_min0.6666666666666665
7975974VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:02:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6265215747606048
deviation-center-line_median0.607494048957489
in-drivable-lane_median0


other stats
deviation-center-line_max0.6495016046287412
deviation-center-line_mean0.5309295980722656
deviation-center-line_min0.33273595264346006
deviation-heading_max1.546889597996067
deviation-heading_mean0.6466674829044743
deviation-heading_median0.4233646963244864
deviation-heading_min0.2887009286973376
driven_any_max1.1250794556315609
driven_any_mean0.6536182871501773
driven_any_median0.6286179118526486
driven_any_min0.31430732071544254
driven_lanedir_max0.9001668163287937
driven_lanedir_mean0.6067702335617516
driven_lanedir_min0.31267344503052197
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1250794556315609, "driven_lanedir": 0.9001668163287937, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.546889597996067, "deviation-center-line": 0.6495016046287412}, "ep001": {"driven_any": 0.31430732071544254, "driven_lanedir": 0.31267344503052197, "in-drivable-lane": 0, "deviation-heading": 0.2887009286973376, "deviation-center-line": 0.33273595264346006}, "ep002": {"driven_any": 0.6286179118526486, "driven_lanedir": 0.6265215747606048, "in-drivable-lane": 0, "deviation-heading": 0.4233646963244864, "deviation-center-line": 0.607494048957489}, "ep003": {"driven_any": 0.7250534689028811, "driven_lanedir": 0.7214747889992279, "in-drivable-lane": 0, "deviation-heading": 0.5927178567152452, "deviation-center-line": 0.6202123184120287}, "ep004": {"driven_any": 0.4750332786483535, "driven_lanedir": 0.4730145426896099, "in-drivable-lane": 0, "deviation-heading": 0.38166433478923545, "deviation-center-line": 0.4447040657196087}}
7966974VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:04:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7961973placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7961-8727', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7961-8727', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7961-8727_evaluation" with the default driver
stderr | Creating job7961-8727_visualization_1 ...
stderr | 
Creating job7961-8727_visualization_1 ... error

stderr | ERROR: for job7961-8727_visualization_1  Cannot start service visualization: network job7961-8727_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7961-8727_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7955973placailleDolores' Awakeningaido1_LF1_r3-v3step3-videosabortedyes3320:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7955-5343', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7955-5343', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7955-5343_evaluation" with the default driver
stderr | Creating job7955-5343_videos_1 ...
stderr | 
Creating job7955-5343_videos_1 ... error

stderr | ERROR: for job7955-5343_videos_1  Cannot start service videos: network job7955-5343_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7955-5343_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7946972VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.59999999999999


other stats
episodes
details{"ep000": {"nsteps": 296, "reward": -3.628842842188582, "good_angle": 0.4356846692781252, "survival_time": 9.866666666666642, "traveled_tiles": 3, "valid_direction": 0.5666666666666647}, "ep001": {"nsteps": 90, "reward": -11.68606679737568, "good_angle": 0.028330695728713044, "survival_time": 2.999999999999999, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 168, "reward": -6.463999826638472, "good_angle": 0.041381101125815146, "survival_time": 5.59999999999999, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 179, "reward": -6.031105510307757, "good_angle": 0.06975922636736046, "survival_time": 5.966666666666655, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 130, "reward": -8.196698459524375, "good_angle": 0.0407869192725632, "survival_time": 4.333333333333328, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.4356846692781252
good_angle_mean0.1231885223545154
good_angle_median0.041381101125815146
good_angle_min0.028330695728713044
reward_max-3.628842842188582
reward_mean-7.201342687206973
reward_median-6.463999826638472
reward_min-11.68606679737568
survival_time_max9.866666666666642
survival_time_mean5.753333333333323
survival_time_min2.999999999999999
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.5666666666666647
valid_direction_mean0.11333333333333293
valid_direction_median0
valid_direction_min0
7941971placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.2666666666666673


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -13.484948247149587, "good_angle": 0.13954338063071806, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 0.2}, "ep001": {"nsteps": 38, "reward": -26.94825208892948, "good_angle": 0.06463267336017275, "survival_time": 1.2666666666666673, "traveled_tiles": 1, "valid_direction": 0.16666666666666718}, "ep002": {"nsteps": 27, "reward": -37.52524646012871, "good_angle": 0.02194590727608487, "survival_time": 0.8999999999999999, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 35, "reward": -28.98305263114827, "good_angle": 0.03146406749930893, "survival_time": 1.166666666666667, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 159, "reward": -6.669146281716841, "good_angle": 8.113867881145456, "survival_time": 5.299999999999991, "traveled_tiles": 4, "valid_direction": 2.3999999999999924}}
good_angle_max8.113867881145456
good_angle_mean1.6742907819823485
good_angle_median0.06463267336017275
good_angle_min0.02194590727608487
reward_max-6.669146281716841
reward_mean-22.722129141814577
reward_median-26.94825208892948
reward_min-37.52524646012871
survival_time_max5.299999999999991
survival_time_mean2.2266666666666652
survival_time_min0.8999999999999999
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.3999999999999924
valid_direction_mean0.5533333333333319
valid_direction_median0.16666666666666718
valid_direction_min0
7931969VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.56666666666666


other stats
episodes
details{"ep000": {"nsteps": 320, "reward": -3.381913361936313, "good_angle": 0.40924222842854624, "survival_time": 10.66666666666664, "traveled_tiles": 3, "valid_direction": 0.033333333333333215}, "ep001": {"nsteps": 88, "reward": -11.945536375045776, "good_angle": 0.03079516501183432, "survival_time": 2.9333333333333327, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 137, "reward": -7.804261677021528, "good_angle": 0.040477326450326694, "survival_time": 4.56666666666666, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 177, "reward": -6.0954075103341525, "good_angle": 0.07120488514549578, "survival_time": 5.899999999999989, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 137, "reward": -7.807459540610766, "good_angle": 0.04590786371962807, "survival_time": 4.56666666666666, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.40924222842854624
good_angle_mean0.1195254937511662
good_angle_median0.04590786371962807
good_angle_min0.03079516501183432
reward_max-3.381913361936313
reward_mean-7.406915692989708
reward_median-7.804261677021528
reward_min-11.945536375045776
survival_time_max10.66666666666664
survival_time_mean5.726666666666656
survival_time_min2.9333333333333327
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.033333333333333215
valid_direction_mean0.006666666666666643
valid_direction_median0
valid_direction_min0
7924968daredevilPyTorch templateaido1_LF1_r3-v3step1-simulationabortedno3320:00:15
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7924-4341', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7924-4341', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7924-4341_evaluation" with the default driver
stderr | Creating job7924-4341_evaluator_1 ...
stderr | Creating job7924-4341_solution_1  ...
stderr | 
Creating job7924-4341_solution_1  ... error

stderr | ERROR: for job7924-4341_solution_1  Cannot start service solution: network job7924-4341_evaluation not found
stderr | 
Creating job7924-4341_evaluator_1 ... error

stderr | ERROR: for job7924-4341_evaluator_1  Cannot start service evaluator: network job7924-4341_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job7924-4341_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job7924-4341_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7921966daredevilPyTorch templateaido1_LF1_r3-v3step1-simulationfailedno3320:00:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 105, in run
    solve(params, cis)
  File "solution.py", line 51, in solve
    from my_model import model
ImportError: No module named my_model


Hidden. If you are the author, please login using the top-right link or use the dashboard.
7911962DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3320:02:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7901963DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3320:02:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.5363410616090654
deviation-center-line_median0.258547780526638
in-drivable-lane_median2.2999999999999936


other stats
deviation-center-line_max0.32177005014843696
deviation-center-line_mean0.2202031385757365
deviation-center-line_min0.07160077419813012
deviation-heading_max1.1178132151825142
deviation-heading_mean0.7005201767843652
deviation-heading_median0.6308925141883387
deviation-heading_min0.4611253689713301
driven_any_max4.1480562027164325
driven_any_mean3.00425011241635
driven_any_median2.6479037066680062
driven_any_min1.7593442339110628
driven_lanedir_max1.744262977934787
driven_lanedir_mean1.3730600644439357
driven_lanedir_min0.8012262244375457
in-drivable-lane_max5.499999999999981
in-drivable-lane_mean3.339999999999989
in-drivable-lane_min1.8333333333333273
per-episodes
details{"ep000": {"driven_any": 2.6479037066680062, "driven_lanedir": 1.5363410616090654, "in-drivable-lane": 2.2999999999999936, "deviation-heading": 0.5903842382618648, "deviation-center-line": 0.32177005014843696}, "ep001": {"driven_any": 2.514900936695146, "driven_lanedir": 1.5400447240323631, "in-drivable-lane": 1.9666666666666597, "deviation-heading": 1.1178132151825142, "deviation-center-line": 0.258547780526638}, "ep002": {"driven_any": 1.7593442339110628, "driven_lanedir": 0.8012262244375457, "in-drivable-lane": 1.8333333333333273, "deviation-heading": 0.4611253689713301, "deviation-center-line": 0.07160077419813012}, "ep003": {"driven_any": 4.1480562027164325, "driven_lanedir": 1.744262977934787, "in-drivable-lane": 5.499999999999981, "deviation-heading": 0.6308925141883387, "deviation-center-line": 0.310108466363997}, "ep004": {"driven_any": 3.951045482091102, "driven_lanedir": 1.2434253342059156, "in-drivable-lane": 5.099999999999983, "deviation-heading": 0.7023855473177776, "deviation-center-line": 0.13898862164148065}}
7894963DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.099999999999988


other stats
episodes
details{"ep000": {"nsteps": 183, "reward": -5.8955085768664635, "good_angle": 0.7615583839230401, "survival_time": 6.099999999999988, "traveled_tiles": 5, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 181, "reward": -6.376901165129442, "good_angle": 14.742659996572415, "survival_time": 6.033333333333322, "traveled_tiles": 5, "valid_direction": 2.4999999999999956}, "ep002": {"nsteps": 116, "reward": -9.467982978355804, "good_angle": 0.8004198030576292, "survival_time": 3.8666666666666623, "traveled_tiles": 4, "valid_direction": 1.3333333333333306}, "ep003": {"nsteps": 292, "reward": -4.333883521407014, "good_angle": 0.8823959790426957, "survival_time": 9.73333333333331, "traveled_tiles": 8, "valid_direction": 1.5999999999999943}, "ep004": {"nsteps": 251, "reward": -4.9879272358925215, "good_angle": 2.853382106126485, "survival_time": 8.366666666666648, "traveled_tiles": 5, "valid_direction": 1.866666666666661}}
good_angle_max14.742659996572415
good_angle_mean4.008083253744453
good_angle_median0.8823959790426957
good_angle_min0.7615583839230401
reward_max-4.333883521407014
reward_mean-6.2124406955302485
reward_median-5.8955085768664635
reward_min-9.467982978355804
survival_time_max9.73333333333331
survival_time_mean6.819999999999986
survival_time_min3.8666666666666623
traveled_tiles_max8
traveled_tiles_mean5.4
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max2.4999999999999956
valid_direction_mean1.7533333333333283
valid_direction_median1.5999999999999943
valid_direction_min1.3333333333333306
7887961BenjaminMy ROS solution - param 3aido1_LF1_r3-v3step3-videossuccessyes3320:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7884961BenjaminMy ROS solution - param 3aido1_LF1_r3-v3step2-scoringabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7884-6023', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7884-6023', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7884-6023_evaluation" with the default driver
stderr | Creating job7884-6023_scorer_1 ...
stderr | 
Creating job7884-6023_scorer_1 ... error

stderr | ERROR: for job7884-6023_scorer_1  Cannot start service scorer: network job7884-6023_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7884-6023_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7878960BenjaminMy ROS solution - param 2aido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.799999999999986


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.3782469593286517, "good_angle": 61.498383165397186, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.49999999999999}, "ep001": {"nsteps": 46, "reward": -23.636921107769012, "good_angle": 1.2895578387386075, "survival_time": 1.5333333333333348, "traveled_tiles": 1, "valid_direction": 1.266666666666668}, "ep002": {"nsteps": 204, "reward": -6.664026419029517, "good_angle": 6.085305751547996, "survival_time": 6.799999999999986, "traveled_tiles": 1, "valid_direction": 5.466666666666655}, "ep003": {"nsteps": 128, "reward": -9.746005860157313, "good_angle": 3.7725710847708, "survival_time": 4.266666666666661, "traveled_tiles": 1, "valid_direction": 3.43333333333333}, "ep004": {"nsteps": 204, "reward": -6.589301447292753, "good_angle": 6.088844783555193, "survival_time": 6.799999999999986, "traveled_tiles": 1, "valid_direction": 5.266666666666655}}
good_angle_max61.498383165397186
good_angle_mean15.746932524801958
good_angle_median6.085305751547996
good_angle_min1.2895578387386075
reward_max-1.3782469593286517
reward_mean-9.602900358715448
reward_median-6.664026419029517
reward_min-23.636921107769012
survival_time_max16.666666666666654
survival_time_mean7.213333333333324
survival_time_min1.5333333333333348
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.49999999999999
valid_direction_mean6.186666666666659
valid_direction_median5.266666666666655
valid_direction_min1.266666666666668
7868958VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3320:10:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7864957BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3320:01:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7855956jasonlclPyTorch templateaido1_LF1_r3-v3step4-vizabortedyes3320:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7855-9582', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7855-9582', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7855-9582_evaluation" with the default driver
stderr | Creating job7855-9582_visualization_1 ...
stderr | 
Creating job7855-9582_visualization_1 ... error

stderr | ERROR: for job7855-9582_visualization_1  Cannot start service visualization: network job7855-9582_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7855-9582_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7851956jasonlclPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3320:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7846956jasonlclPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.966810409963131, "good_angle": 47.08330822850749, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.233333333333322}, "ep001": {"nsteps": 500, "reward": -1.300191262960434, "good_angle": 13.8317262841996, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}, "ep002": {"nsteps": 500, "reward": -1.117795492440462, "good_angle": 13.808909540839275, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.9294596527849426, "good_angle": 13.819737231108473, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}, "ep004": {"nsteps": 500, "reward": -1.163820459574461, "good_angle": 13.824014957850544, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}}
good_angle_max47.08330822850749
good_angle_mean20.473539248501076
good_angle_median13.824014957850544
good_angle_min13.808909540839275
reward_max-0.9294596527849426
reward_mean-1.0956154555446862
reward_median-1.117795492440462
reward_min-1.300191262960434
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.233333333333322
valid_direction_mean13.266666666666657
valid_direction_median13.09999999999999
valid_direction_min12.933333333333326
7841955pravishsainathPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3320:04:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-1.05985247177248
deviation-center-line_median0.32463013910329175
in-drivable-lane_median8.23333333333332


other stats
deviation-center-line_max1.2229848197846576
deviation-center-line_mean0.5013585011463242
deviation-center-line_min0.18421462158296809
deviation-heading_max6.639256027638261
deviation-heading_mean6.130316773672168
deviation-heading_median6.587348625790274
deviation-heading_min4.253182461720226
driven_any_max3.317636741607105
driven_any_mean3.31763674160709
driven_any_median3.317636741607098
driven_any_min3.3176367416070653
driven_lanedir_max-0.8727849850798894
driven_lanedir_mean-1.0237415377242507
driven_lanedir_min-1.0652501105207834
in-drivable-lane_max10.466666666666663
in-drivable-lane_mean8.686666666666657
in-drivable-lane_min8.233333333333318
per-episodes
details{"ep000": {"driven_any": 3.317636741607105, "driven_lanedir": -0.8727849850798894, "in-drivable-lane": 10.466666666666663, "deviation-heading": 4.253182461720226, "deviation-center-line": 1.2229848197846576}, "ep001": {"driven_any": 3.3176367416070653, "driven_lanedir": -1.0585760658647092, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.639256027638261, "deviation-center-line": 0.4939995088117161}, "ep002": {"driven_any": 3.317636741607098, "driven_lanedir": -1.0622440553833916, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.60795448532735, "deviation-center-line": 0.28096341644898776}, "ep003": {"driven_any": 3.317636741607083, "driven_lanedir": -1.05985247177248, "in-drivable-lane": 8.266666666666653, "deviation-heading": 6.563842267884727, "deviation-center-line": 0.18421462158296809}, "ep004": {"driven_any": 3.3176367416071, "driven_lanedir": -1.0652501105207834, "in-drivable-lane": 8.233333333333318, "deviation-heading": 6.587348625790274, "deviation-center-line": 0.32463013910329175}}
7830954pravishsainathPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3320:02:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7825952heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyes3320:02:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7791945Claudio RuchPython templateaido1_amod_fleet_size_r1-v3step2-scoringsuccessyes3320:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
fleet_size-1000000000


other stats
efficiency-63.39357988341456
service_quality-32.53305497085425
7787944Claudio RuchPython templateaido1_amod_efficiency_r1-v3step2-scoringsuccessyes3320:00:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency-64.1497490894183


other stats
fleet_size-1000000000
service_quality-33.01488727235483
7780944Claudio RuchPython templateaido1_amod_efficiency_r1-v3step1-simulationsuccessno3320:04:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
7771941DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3320:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7768941DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3320:02:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7763940DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3320:01:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7757940DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3320:02:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7750938hvrigazovROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.333333333333335


other stats
episodes
details{"ep000": {"nsteps": 224, "reward": -4.621182094348375, "good_angle": 0.7706784765932334, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 0.8999999999999968}, "ep001": {"nsteps": 92, "reward": -11.484535440478636, "good_angle": 0.19582252450820103, "survival_time": 3.0666666666666655, "traveled_tiles": 1, "valid_direction": 0.3999999999999986}, "ep002": {"nsteps": 53, "reward": -19.31181934138514, "good_angle": 0.45340019768764384, "survival_time": 1.7666666666666688, "traveled_tiles": 2, "valid_direction": 0.4666666666666681}, "ep003": {"nsteps": 57, "reward": -17.88823687298256, "good_angle": 0.6787207341248404, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.7000000000000022}, "ep004": {"nsteps": 70, "reward": -14.757806219799178, "good_angle": 0.4106352195159575, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 0.6333333333333329}}
good_angle_max0.7706784765932334
good_angle_mean0.5018514304859752
good_angle_median0.45340019768764384
good_angle_min0.19582252450820103
reward_max-4.621182094348375
reward_mean-13.612715993798778
reward_median-14.757806219799178
reward_min-19.31181934138514
survival_time_max7.46666666666665
survival_time_mean3.306666666666664
survival_time_min1.7666666666666688
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.8999999999999968
valid_direction_mean0.6199999999999998
valid_direction_median0.6333333333333329
valid_direction_min0.3999999999999986
7745938hvrigazovROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:03:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7740935DavidPytorch ILaido1_LF1_r3-v3step1-simulationfailedno3320:00:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 27, in solve
    from pytorch_model import TensorflowModel
  File "/workspace/pytorch_model.py", line 5, in <module>
    import cv2
  File "/usr/local/lib/python2.7/dist-packages/cv2/__init__.py", line 3, in <module>
    from .cv2 import *
ImportError: libSM.so.6: cannot open shared object file: No such file or directory


Hidden. If you are the author, please login using the top-right link or use the dashboard.
7739933hvrigazovROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22221550842802396
deviation-center-line_median0.2023538515966744
in-drivable-lane_median0


other stats
deviation-center-line_max0.3360222046530333
deviation-center-line_mean0.2014039112119076
deviation-center-line_min0.12693372622565502
deviation-heading_max1.8471076157828488
deviation-heading_mean0.8225705372370274
deviation-heading_median0.602493534020359
deviation-heading_min0.28827268058804667
driven_any_max0.5643086911704672
driven_any_mean0.29714627283767914
driven_any_median0.2392895892393561
driven_any_min0.1642729237505062
driven_lanedir_max0.31251412177048676
driven_lanedir_mean0.23070167007902737
driven_lanedir_min0.14611751550314245
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5643086911704672, "driven_lanedir": 0.2953112769607642, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8471076157828488, "deviation-center-line": 0.21194736341760004}, "ep001": {"driven_any": 0.314300946953836, "driven_lanedir": 0.31251412177048676, "in-drivable-lane": 0, "deviation-heading": 0.28827268058804667, "deviation-center-line": 0.3360222046530333}, "ep002": {"driven_any": 0.1642729237505062, "driven_lanedir": 0.14611751550314245, "in-drivable-lane": 0, "deviation-heading": 0.5861917417773357, "deviation-center-line": 0.1297624101665753}, "ep003": {"driven_any": 0.20355921307423008, "driven_lanedir": 0.17734992773271951, "in-drivable-lane": 0, "deviation-heading": 0.788787114016547, "deviation-center-line": 0.12693372622565502}, "ep004": {"driven_any": 0.2392895892393561, "driven_lanedir": 0.22221550842802396, "in-drivable-lane": 0, "deviation-heading": 0.602493534020359, "deviation-center-line": 0.2023538515966744}}
7733934DavidPytorch ILaido1_LF1_r3-v3step1-simulationfailedno3320:02:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 27, in solve
    from pytorch_model import TensorflowModel
  File "/workspace/pytorch_model.py", line 5, in <module>
    import cv2
  File "/usr/local/lib/python2.7/dist-packages/cv2/__init__.py", line 3, in <module>
    from .cv2 import *
ImportError: libSM.so.6: cannot open shared object file: No such file or directory


Hidden. If you are the author, please login using the top-right link or use the dashboard.
7724931DavidILaido1_LF1_r3-v3step1-simulationfailedno3320:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 27, in solve
    from pytorch_model import TensorflowModel
ImportError: No module named pytorch_model


Hidden. If you are the author, please login using the top-right link or use the dashboard.
7718930orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 260, "reward": -6.752510609448207, "good_angle": 42.92021802476832, "survival_time": 8.666666666666647, "traveled_tiles": 2, "valid_direction": 6.099999999999987}, "ep001": {"nsteps": 40, "reward": -25.697613123059273, "good_angle": 0.2937814696214476, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.9666666666666676}, "ep002": {"nsteps": 65, "reward": -15.83846127803509, "good_angle": 0.13852018012693493, "survival_time": 2.1666666666666687, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 98, "reward": -10.525552019020733, "good_angle": 0.17390602753482923, "survival_time": 3.266666666666665, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 93, "reward": -11.237194858571534, "good_angle": 0.3196046574410625, "survival_time": 3.0999999999999988, "traveled_tiles": 1, "valid_direction": 0.866666666666664}}
good_angle_max42.92021802476832
good_angle_mean8.769206071898518
good_angle_median0.2937814696214476
good_angle_min0.13852018012693493
reward_max-6.752510609448207
reward_mean-14.010266377626966
reward_median-11.237194858571534
reward_min-25.697613123059273
survival_time_max8.666666666666647
survival_time_mean3.7066666666666626
survival_time_min1.333333333333334
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max6.099999999999987
valid_direction_mean1.5866666666666638
valid_direction_median0.866666666666664
valid_direction_min0
7712929orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step3-videossuccessyes3320:00:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7697928orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step2-scoringsuccessyes3320:01:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.233333333333328


other stats
episodes
details{"ep000": {"nsteps": 127, "reward": -8.732497676209672, "good_angle": 10.16705125943511, "survival_time": 4.233333333333328, "traveled_tiles": 2, "valid_direction": 3.6666666666666625}, "ep001": {"nsteps": 127, "reward": -9.425542902524075, "good_angle": 3.032774080206049, "survival_time": 4.233333333333328, "traveled_tiles": 2, "valid_direction": 3.3999999999999946}, "ep002": {"nsteps": 116, "reward": -10.493885487703414, "good_angle": 2.6956512817375344, "survival_time": 3.8666666666666623, "traveled_tiles": 2, "valid_direction": 3.233333333333328}, "ep003": {"nsteps": 223, "reward": -5.786677241284039, "good_angle": 5.886687525193363, "survival_time": 7.433333333333317, "traveled_tiles": 1, "valid_direction": 6.2666666666666515}, "ep004": {"nsteps": 106, "reward": -11.233966233033057, "good_angle": 3.2792087050308294, "survival_time": 3.5333333333333306, "traveled_tiles": 1, "valid_direction": 3.066666666666663}}
good_angle_max10.16705125943511
good_angle_mean5.012274570320577
good_angle_median3.2792087050308294
good_angle_min2.6956512817375344
reward_max-5.786677241284039
reward_mean-9.13451390815085
reward_median-9.425542902524075
reward_min-11.233966233033057
survival_time_max7.433333333333317
survival_time_mean4.659999999999993
survival_time_min3.5333333333333306
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max6.2666666666666515
valid_direction_mean3.92666666666666
valid_direction_median3.3999999999999946
valid_direction_min3.066666666666663
7695927orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step1-simulationerrorno3320:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7688926orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step4-vizsuccessyes3320:02:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.08995210883203586
deviation-center-line_median0.13999283732729784
in-drivable-lane_median0


other stats
deviation-center-line_max0.5967702926810171
deviation-center-line_mean0.22107473955257056
deviation-center-line_min0.09553931818728711
deviation-heading_max5.561174620118044
deviation-heading_mean2.052529886458908
deviation-heading_median1.2003638965457502
deviation-heading_min0.8821821364432593
driven_any_max2.72233971937701
driven_any_mean0.7572215383759043
driven_any_median0.25726582444831586
driven_any_min0.1327951737101693
driven_lanedir_max0.2016102188459316
driven_lanedir_mean0.08463395806118029
driven_lanedir_min-0.015412842586705278
in-drivable-lane_max5.9999999999999805
in-drivable-lane_mean1.1999999999999962
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.72233971937701, "driven_lanedir": 0.2016102188459316, "in-drivable-lane": 5.9999999999999805, "deviation-heading": 5.561174620118044, "deviation-center-line": 0.5967702926810171}, "ep001": {"driven_any": 0.25726582444831586, "driven_lanedir": 0.03969031674007928, "in-drivable-lane": 0, "deviation-heading": 0.8821821364432593, "deviation-center-line": 0.13999283732729784}, "ep002": {"driven_any": 0.2353800698745608, "driven_lanedir": 0.08995210883203586, "in-drivable-lane": 0, "deviation-heading": 1.0206839946950763, "deviation-center-line": 0.15601821040973946}, "ep003": {"driven_any": 0.4383269044694661, "driven_lanedir": 0.10732998847456, "in-drivable-lane": 0, "deviation-heading": 1.5982447844924086, "deviation-center-line": 0.117053039157511}, "ep004": {"driven_any": 0.1327951737101693, "driven_lanedir": -0.015412842586705278, "in-drivable-lane": 0, "deviation-heading": 1.2003638965457502, "deviation-center-line": 0.09553931818728711}}
7684926orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step3-videossuccessyes3320:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7676926orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7665923BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3320:01:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7662923BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7662-3736', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7662-3736', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7662-3736_evaluation" with the default driver
stderr | Creating job7662-3736_scorer_1 ...
stderr | 
Creating job7662-3736_scorer_1 ... error

stderr | ERROR: for job7662-3736_scorer_1  Cannot start service scorer: network job7662-3736_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7662-3736_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7654921placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3320:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7649921placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessno3320:05:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7639920Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessno3320:02:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7635919pravishsainathPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3320:01:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7633919pravishsainathPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3320:03:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7624918BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationfailedno3320:10:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7618916placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessno3320:05:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7615915sodabetastay simpleaido1_LF1_r3-v3step4-vizsuccessyes3320:05:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.014829571611556512
deviation-center-line_median0.5158599622317641
in-drivable-lane_median7.499999999999974


other stats
deviation-center-line_max0.7894100851017714
deviation-center-line_mean0.42262990487268154
deviation-center-line_min0
deviation-heading_max6.565470517960321
deviation-heading_mean5.168740437815556
deviation-heading_median6.446194478982502
deviation-heading_min0
driven_any_max0.0429485049528903
driven_any_mean0.04014220449186804
driven_any_median0.03944062937661494
driven_any_min0.03944062937660776
driven_lanedir_max0.014926061784539256
driven_lanedir_mean0.011877589188947811
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean9.326666666666643
in-drivable-lane_min7.499999999999974
per-episodes
details{"ep000": {"driven_any": 0.0429485049528903, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.03944062937661494, "driven_lanedir": 0.014926061784539256, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.35137730604979, "deviation-center-line": 0.7894100851017714}, "ep002": {"driven_any": 0.039440629376609325, "driven_lanedir": 0.014829571611556512, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.480659886085168, "deviation-center-line": 0.5158599622317641}, "ep003": {"driven_any": 0.03944062937660776, "driven_lanedir": 0.014883158723475898, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.446194478982502, "deviation-center-line": 0.22611076456390253}, "ep004": {"driven_any": 0.03944062937661789, "driven_lanedir": 0.014749153825167394, "in-drivable-lane": 7.499999999999974, "deviation-heading": 6.565470517960321, "deviation-center-line": 0.58176871246597}}
7606914Manfred DiazTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3320:05:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.992468761476724
deviation-center-line_median0.6972622730664987
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.9008921652485434
deviation-center-line_mean0.6745505335631848
deviation-center-line_min0.32062786569173557
deviation-heading_max2.7495979913439865
deviation-heading_mean2.1170669624782383
deviation-heading_median2.460817383756992
deviation-heading_min1.21993034050232
driven_any_max5.496788900325122
driven_any_mean4.551286930889951
driven_any_median5.1587489504322654
driven_any_min1.51567855004027
driven_lanedir_max5.1766735171540805
driven_lanedir_mean4.323558621259602
driven_lanedir_min1.3714743878852935
in-drivable-lane_max0.8666666666666654
in-drivable-lane_mean0.27999999999999936
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.496788900325122, "driven_lanedir": 4.992468761476724, "in-drivable-lane": 0.8666666666666654, "deviation-heading": 2.7495979913439865, "deviation-center-line": 0.8781617758575586}, "ep001": {"driven_any": 5.1587489504322654, "driven_lanedir": 4.9820201302259335, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 2.567406093405443, "deviation-center-line": 0.6972622730664987}, "ep002": {"driven_any": 1.51567855004027, "driven_lanedir": 1.3714743878852935, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.21993034050232, "deviation-center-line": 0.32062786569173557}, "ep003": {"driven_any": 5.439032905533301, "driven_lanedir": 5.1766735171540805, "in-drivable-lane": 0.2333333333333325, "deviation-heading": 2.460817383756992, "deviation-center-line": 0.9008921652485434}, "ep004": {"driven_any": 5.146185348118799, "driven_lanedir": 5.095156309555976, "in-drivable-lane": 0, "deviation-heading": 1.5875830033824527, "deviation-center-line": 0.5758085879515876}}
7595913BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationfailedno3320:10:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7591912Manfred DiazTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3320:07:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.203296246412247
deviation-center-line_median0.8714455390206434
in-drivable-lane_median1.9333333333333265


other stats
deviation-center-line_max1.1733643756551762
deviation-center-line_mean0.8266962597868538
deviation-center-line_min0.4220635332945388
deviation-heading_max2.852431783207723
deviation-heading_mean2.0966689842833177
deviation-heading_median2.437752553442055
deviation-heading_min1.1647916972938075
driven_any_max2.686616755333192
driven_any_mean2.6357107675239533
driven_any_median2.6408307148548595
driven_any_min2.534695383275761
driven_lanedir_max2.5104306917023145
driven_lanedir_mean2.214306920895284
driven_lanedir_min2.0089914678742615
in-drivable-lane_max3.600000000000021
in-drivable-lane_mean2.026666666666667
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.6810629252479177, "driven_lanedir": 2.061775145947308, "in-drivable-lane": 2.7333333333333267, "deviation-heading": 2.437752553442055, "deviation-center-line": 0.8714455390206434}, "ep001": {"driven_any": 2.6353480589080367, "driven_lanedir": 2.203296246412247, "in-drivable-lane": 1.86666666666666, "deviation-heading": 2.6748641944731264, "deviation-center-line": 1.079858790563677}, "ep002": {"driven_any": 2.686616755333192, "driven_lanedir": 2.0089914678742615, "in-drivable-lane": 3.600000000000021, "deviation-heading": 2.852431783207723, "deviation-center-line": 1.1733643756551762}, "ep003": {"driven_any": 2.6408307148548595, "driven_lanedir": 2.287041052540289, "in-drivable-lane": 1.9333333333333265, "deviation-heading": 1.1647916972938075, "deviation-center-line": 0.5867490604002333}, "ep004": {"driven_any": 2.534695383275761, "driven_lanedir": 2.5104306917023145, "in-drivable-lane": 0, "deviation-heading": 1.3535046929998764, "deviation-center-line": 0.4220635332945388}}
7587912Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessno3320:03:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7582910orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step3-videossuccessyes3320:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7579910orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step2-scoringabortedyes3320:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7579-2033', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7579-2033', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7579-2033_evaluation" with the default driver
stderr | Creating job7579-2033_scorer_1 ...
stderr | 
Creating job7579-2033_scorer_1 ... error

stderr | ERROR: for job7579-2033_scorer_1  Cannot start service scorer: network job7579-2033_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7579-2033_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7574909JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3320:01:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7572909JonJP pipelineaido1_LF1_r3-v3step2-scoringabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7572-3130', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7572-3130', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7572-3130_evaluation" with the default driver
stderr | Creating job7572-3130_scorer_1 ...
stderr | 
Creating job7572-3130_scorer_1 ... error

stderr | ERROR: for job7572-3130_scorer_1  Cannot start service scorer: network job7572-3130_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7572-3130_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7567908pravishsainathPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3320:01:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7562908pravishsainathPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.233333333333321


other stats
episodes
details{"ep000": {"nsteps": 77, "reward": -13.25760446571104, "good_angle": 1.2102786325198769, "survival_time": 2.5666666666666673, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 54, "reward": -19.086375530119295, "good_angle": 0.06435254244870461, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 226, "reward": -4.901912556033977, "good_angle": 2.5406340061787915, "survival_time": 7.533333333333316, "traveled_tiles": 3, "valid_direction": 4.966666666666653}, "ep003": {"nsteps": 221, "reward": -5.707385117474657, "good_angle": 1.0355929673408153, "survival_time": 7.36666666666665, "traveled_tiles": 3, "valid_direction": 4.999999999999986}, "ep004": {"nsteps": 187, "reward": -6.5791364537432475, "good_angle": 1.5165908226878455, "survival_time": 6.233333333333321, "traveled_tiles": 2, "valid_direction": 5.099999999999987}}
good_angle_max2.5406340061787915
good_angle_mean1.2734897942352066
good_angle_median1.2102786325198769
good_angle_min0.06435254244870461
reward_max-4.901912556033977
reward_mean-9.906482824616443
reward_median-6.5791364537432475
reward_min-19.086375530119295
survival_time_max7.533333333333316
survival_time_mean5.099999999999992
survival_time_min1.8000000000000025
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.099999999999987
valid_direction_mean3.439999999999992
valid_direction_median4.966666666666653
valid_direction_min0
7552906heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7552-6225', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7552-6225', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7552-6225_evaluation" with the default driver
stderr | Creating job7552-6225_visualization_1 ...
stderr | 
Creating job7552-6225_visualization_1 ... error

stderr | ERROR: for job7552-6225_visualization_1  Cannot start service visualization: network job7552-6225_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7552-6225_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7537904sodabetastay simpleaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9621531757116316, "good_angle": 46.42717754437712, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.16666666666665}, "ep001": {"nsteps": 500, "reward": -1.3020373888611794, "good_angle": 13.82404463718111, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}, "ep002": {"nsteps": 500, "reward": -1.1174760079681874, "good_angle": 13.82628678256673, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333326}, "ep003": {"nsteps": 500, "reward": -0.9247168089353216, "good_angle": 13.813277564508354, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.899999999999991}, "ep004": {"nsteps": 500, "reward": -1.161978100210428, "good_angle": 13.831768282780049, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}}
good_angle_max46.42717754437712
good_angle_mean20.344510962282673
good_angle_median13.82628678256673
good_angle_min13.813277564508354
reward_max-0.9247168089353216
reward_mean-1.0936722963373495
reward_median-1.1174760079681874
reward_min-1.3020373888611794
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.16666666666665
valid_direction_mean13.259999999999993
valid_direction_median13.09999999999999
valid_direction_min12.899999999999991
7528903sodabetaPyTorch DDPG templateaido1_LF1_r3-v3step3-videosabortedyes3320:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7528-2480', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7528-2480', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7528-2480_evaluation" with the default driver
stderr | Creating job7528-2480_videos_1 ...
stderr | 
Creating job7528-2480_videos_1 ... error

stderr | ERROR: for job7528-2480_videos_1  Cannot start service videos: network job7528-2480_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7528-2480_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7526903sodabetaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3320:06:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7521902sodabetaPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes3320:01:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7517902sodabetaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.29999999999997


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.2184969825148582, "good_angle": 52.71936463311338, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.43333333333332}, "ep001": {"nsteps": 53, "reward": -20.819052375150175, "good_angle": 1.5776341378385166, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 1.4333333333333351}, "ep002": {"nsteps": 500, "reward": -1.080979475753382, "good_angle": 13.597076501817195, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999986}, "ep003": {"nsteps": 489, "reward": -3.5198926632940113, "good_angle": 13.543907954886944, "survival_time": 16.29999999999997, "traveled_tiles": 1, "valid_direction": 12.566666666666649}, "ep004": {"nsteps": 139, "reward": -9.007249958223577, "good_angle": 3.8703731850782774, "survival_time": 4.633333333333327, "traveled_tiles": 1, "valid_direction": 3.6666666666666607}}
good_angle_max52.71936463311338
good_angle_mean17.06167128254686
good_angle_median13.543907954886944
good_angle_min1.5776341378385166
reward_max-1.080979475753382
reward_mean-7.1291342909872
reward_median-3.5198926632940113
reward_min-20.819052375150175
survival_time_max16.666666666666654
survival_time_mean11.206666666666656
survival_time_min1.7666666666666688
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.43333333333332
valid_direction_mean9.01999999999999
valid_direction_median12.566666666666649
valid_direction_min1.4333333333333351
7493894daredevilPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3320:02:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.966810409963131, "good_angle": 47.123441495230765, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.233333333333322}, "ep001": {"nsteps": 500, "reward": -1.300191262960434, "good_angle": 13.8317262841996, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}, "ep002": {"nsteps": 500, "reward": -1.117795492440462, "good_angle": 13.808909540839275, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.9294596527849426, "good_angle": 13.819737231108473, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}, "ep004": {"nsteps": 500, "reward": -1.163820459574461, "good_angle": 13.824014957850544, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}}
good_angle_max47.123441495230765
good_angle_mean20.481565901845737
good_angle_median13.824014957850544
good_angle_min13.808909540839275
reward_max-0.9294596527849426
reward_mean-1.0956154555446862
reward_median-1.117795492440462
reward_min-1.300191262960434
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.233333333333322
valid_direction_mean13.266666666666657
valid_direction_median13.09999999999999
valid_direction_min12.933333333333326
7479893orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step1-simulationsuccessno3320:00:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7471890MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8333333333333357


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -4.683637329318502, "good_angle": 0.744421646619748, "survival_time": 7.399999999999984, "traveled_tiles": 2, "valid_direction": 1.3999999999999957}, "ep001": {"nsteps": 53, "reward": -19.430292591171444, "good_angle": 0.030405851512300547, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 47, "reward": -21.72853136062622, "good_angle": 0.4343294930246788, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.7000000000000014}, "ep003": {"nsteps": 55, "reward": -18.549041661484676, "good_angle": 0.5337228428655871, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0.9333333333333358}, "ep004": {"nsteps": 66, "reward": -15.637235263983408, "good_angle": 0.4003952823990975, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6000000000000003}}
good_angle_max0.744421646619748
good_angle_mean0.4286550232842824
good_angle_median0.4343294930246788
good_angle_min0.030405851512300547
reward_max-4.683637329318502
reward_mean-16.00574764131685
reward_median-18.549041661484676
reward_min-21.72853136062622
survival_time_max7.399999999999984
survival_time_mean2.953333333333332
survival_time_min1.5666666666666682
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3999999999999957
valid_direction_mean0.7266666666666666
valid_direction_median0.7000000000000014
valid_direction_min0
7466889MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationerrorno3320:00:29
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7460887heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyes3320:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7455887heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessno3320:04:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7452886BenjaminROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.25751103414270027
deviation-center-line_median0.2316766280237925
in-drivable-lane_median0


other stats
deviation-center-line_max0.353851215952034
deviation-center-line_mean0.2491435731069917
deviation-center-line_min0.12859740325554045
deviation-heading_max1.786421122268535
deviation-heading_mean0.7913033785668815
deviation-heading_median0.6072484431772607
deviation-heading_min0.217993163684858
driven_any_max0.7964697703754341
driven_any_mean0.3771525772806887
driven_any_median0.27142160418020644
driven_any_min0.16070296388132274
driven_lanedir_max0.5556348189361362
driven_lanedir_mean0.3191292478835238
driven_lanedir_min0.14057228504037322
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7964697703754341, "driven_lanedir": 0.5556348189361362, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.786421122268535, "deviation-center-line": 0.33782433590773453}, "ep001": {"driven_any": 0.18929400406129007, "driven_lanedir": 0.187596066353239, "in-drivable-lane": 0, "deviation-heading": 0.217993163684858, "deviation-center-line": 0.19376828239585708}, "ep002": {"driven_any": 0.16070296388132274, "driven_lanedir": 0.14057228504037322, "in-drivable-lane": 0, "deviation-heading": 0.6072484431772607, "deviation-center-line": 0.12859740325554045}, "ep003": {"driven_any": 0.46787454390519007, "driven_lanedir": 0.4543320349451702, "in-drivable-lane": 0, "deviation-heading": 0.7592086640997087, "deviation-center-line": 0.353851215952034}, "ep004": {"driven_any": 0.27142160418020644, "driven_lanedir": 0.25751103414270027, "in-drivable-lane": 0, "deviation-heading": 0.5856454996040452, "deviation-center-line": 0.2316766280237925}}
7448886BenjaminROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.6000000000000005


other stats
episodes
details{"ep000": {"nsteps": 225, "reward": -4.590134723995709, "good_angle": 0.8405459994213966, "survival_time": 7.499999999999983, "traveled_tiles": 2, "valid_direction": 1.099999999999996}, "ep001": {"nsteps": 55, "reward": -18.73675962632353, "good_angle": 0.03200280580458946, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 47, "reward": -21.73491486399732, "good_angle": 0.46624630751072377, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.7666666666666682}, "ep003": {"nsteps": 133, "reward": -7.923567282470097, "good_angle": 0.3191354903227399, "survival_time": 4.433333333333327, "traveled_tiles": 2, "valid_direction": 0.4666666666666651}, "ep004": {"nsteps": 78, "reward": -13.29155761614824, "good_angle": 0.3267562772030972, "survival_time": 2.6000000000000005, "traveled_tiles": 1, "valid_direction": 0.6333333333333317}}
good_angle_max0.8405459994213966
good_angle_mean0.3969373760525094
good_angle_median0.3267562772030972
good_angle_min0.03200280580458946
reward_max-4.590134723995709
reward_mean-13.25538682258698
reward_median-13.29155761614824
reward_min-21.73491486399732
survival_time_max7.499999999999983
survival_time_mean3.5866666666666633
survival_time_min1.5666666666666682
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.099999999999996
valid_direction_mean0.5933333333333323
valid_direction_median0.6333333333333317
valid_direction_min0
7445885MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.19067044317038873
deviation-center-line_median0.1975053554290627
in-drivable-lane_median0


other stats
deviation-center-line_max0.3464975618381498
deviation-center-line_mean0.20608513284545457
deviation-center-line_min0.1396710484266761
deviation-heading_max1.7446623394845244
deviation-heading_mean0.7849257087101806
deviation-heading_median0.5956204355185006
deviation-heading_min0.25658833170928613
driven_any_max0.7928836391050039
driven_any_mean0.3235722180214992
driven_any_median0.207125524773235
driven_any_min0.18569943013237425
driven_lanedir_max0.556610441998824
driven_lanedir_mean0.2650342457604525
driven_lanedir_min0.16859920840503406
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7928836391050039, "driven_lanedir": 0.556610441998824, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7446623394845244, "deviation-center-line": 0.3464975618381498}, "ep001": {"driven_any": 0.19286658935199097, "driven_lanedir": 0.19067044317038873, "in-drivable-lane": 0, "deviation-heading": 0.25658833170928613, "deviation-center-line": 0.1975053554290627}, "ep002": {"driven_any": 0.18569943013237425, "driven_lanedir": 0.16859920840503406, "in-drivable-lane": 0, "deviation-heading": 0.5859409592402759, "deviation-center-line": 0.14387047548726098}, "ep003": {"driven_any": 0.207125524773235, "driven_lanedir": 0.18659799758009, "in-drivable-lane": 0, "deviation-heading": 0.7418164775983159, "deviation-center-line": 0.1396710484266761}, "ep004": {"driven_any": 0.23928590674489192, "driven_lanedir": 0.22269313764792553, "in-drivable-lane": 0, "deviation-heading": 0.5956204355185006, "deviation-center-line": 0.20288122304612305}}
7438884heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyes3320:03:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.422982674920641
deviation-center-line_median0.8505527918433278
in-drivable-lane_median0.8333333333333304


other stats
deviation-center-line_max1.7417672032958655
deviation-center-line_mean0.9513460013571776
deviation-center-line_min0.43504621053141007
deviation-heading_max3.144160614329157
deviation-heading_mean2.437358833954327
deviation-heading_median2.787311660735885
deviation-heading_min0.7857529283477824
driven_any_max4.56726118501361
driven_any_mean2.9668741296556305
driven_any_median4.050258445416032
driven_any_min0.3838597371153447
driven_lanedir_max4.502757749578887
driven_lanedir_mean2.283971626191801
driven_lanedir_min0.37402920769348946
in-drivable-lane_max6.966666666666686
in-drivable-lane_mean2.513333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.050258445416032, "driven_lanedir": 2.422982674920641, "in-drivable-lane": 6.966666666666686, "deviation-heading": 2.787311660735885, "deviation-center-line": 0.8505527918433278}, "ep001": {"driven_any": 0.3838597371153447, "driven_lanedir": 0.37402920769348946, "in-drivable-lane": 0, "deviation-heading": 0.7857529283477824, "deviation-center-line": 0.43504621053141007}, "ep002": {"driven_any": 1.4424280740950552, "driven_lanedir": 1.2255587500378566, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 2.511960214931568, "deviation-center-line": 0.5278815926739738}, "ep003": {"driven_any": 4.39056320663811, "driven_lanedir": 2.8945297487281283, "in-drivable-lane": 4.766666666666651, "deviation-heading": 3.144160614329157, "deviation-center-line": 1.2014822084413108}, "ep004": {"driven_any": 4.56726118501361, "driven_lanedir": 4.502757749578887, "in-drivable-lane": 0, "deviation-heading": 2.957608751427242, "deviation-center-line": 1.7417672032958655}}
7435884heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5594651458710432, "good_angle": 1.9877803082613077, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 5.266666666666648}, "ep001": {"nsteps": 111, "reward": -9.64766034269118, "good_angle": 0.31150333423805066, "survival_time": 3.6999999999999966, "traveled_tiles": 1, "valid_direction": 0.7999999999999972}, "ep002": {"nsteps": 203, "reward": -5.031536213631553, "good_angle": 0.9028345141941596, "survival_time": 6.766666666666652, "traveled_tiles": 4, "valid_direction": 1.999999999999993}, "ep003": {"nsteps": 500, "reward": -0.4913692384962924, "good_angle": 3.0780545811724904, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 6.266666666666644}, "ep004": {"nsteps": 500, "reward": -0.28377321450412274, "good_angle": 31.474832509995675, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 4.599999999999984}}
good_angle_max31.474832509995675
good_angle_mean7.551001049572337
good_angle_median1.9877803082613077
good_angle_min0.31150333423805066
reward_max-0.28377321450412274
reward_mean-3.2027608310388382
reward_median-0.5594651458710432
reward_min-9.64766034269118
survival_time_max16.666666666666654
survival_time_mean12.093333333333325
survival_time_min3.6999999999999966
traveled_tiles_max9
traveled_tiles_mean6.2
traveled_tiles_median8
traveled_tiles_min1
valid_direction_max6.266666666666644
valid_direction_mean3.7866666666666537
valid_direction_median4.599999999999984
valid_direction_min0.7999999999999972
7418878MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringabortedyes3320:01:26
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7418-773', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7418-773', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7418-773_evaluation" with the default driver
stderr | Creating job7418-773_scorer_1 ...
stderr | 
Creating job7418-773_scorer_1 ... error

stderr | ERROR: for job7418-773_scorer_1  Cannot start service scorer: network job7418-773_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7418-773_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7405875placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 227, "reward": -4.5744455482416875, "good_angle": 0.7937623130473065, "survival_time": 7.5666666666666496, "traveled_tiles": 2, "valid_direction": 1.2333333333333298}, "ep001": {"nsteps": 99, "reward": -10.711396231193737, "good_angle": 0.19533482846247435, "survival_time": 3.299999999999998, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 54, "reward": -18.98695876918457, "good_angle": 0.34666212011073927, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 0.6666666666666685}, "ep003": {"nsteps": 53, "reward": -19.22507929984691, "good_angle": 0.5550129967406443, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 0.9000000000000022}, "ep004": {"nsteps": 69, "reward": -14.967612463063087, "good_angle": 0.3386407174472176, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.7}}
good_angle_max0.7937623130473065
good_angle_mean0.4458825951616764
good_angle_median0.34666212011073927
good_angle_min0.19533482846247435
reward_max-4.5744455482416875
reward_mean-13.693098462306
reward_median-14.967612463063087
reward_min-19.22507929984691
survival_time_max7.5666666666666496
survival_time_mean3.346666666666664
survival_time_min1.7666666666666688
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.2333333333333298
valid_direction_mean0.7533333333333333
valid_direction_median0.7
valid_direction_min0.2666666666666657
7398873tgemiciogluSolution templateaido1_luck-v3step1successyes3320:00:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
score191.77722424229196


7391872patripfrAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videosabortedyes3320:01:46
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7391-182', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7391-182', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7391-182_evaluation" with the default driver
stderr | Creating job7391-182_videos_1 ...
stderr | 
Creating job7391-182_videos_1 ... error

stderr | ERROR: for job7391-182_videos_1  Cannot start service videos: network job7391-182_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7391-182_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7383871MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4333333333333345


other stats
episodes
details{"ep000": {"nsteps": 220, "reward": -4.698083330817859, "good_angle": 0.9106337442639992, "survival_time": 7.333333333333317, "traveled_tiles": 2, "valid_direction": 0.93333333333333}, "ep001": {"nsteps": 21, "reward": -48.22276366608484, "good_angle": 0.34065971059215233, "survival_time": 0.7, "traveled_tiles": 1, "valid_direction": 0.4}, "ep002": {"nsteps": 119, "reward": -8.887199665318017, "good_angle": 0.30638758098273255, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep003": {"nsteps": 60, "reward": -17.02001993606488, "good_angle": 0.6191863292532468, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 0.7333333333333354}, "ep004": {"nsteps": 73, "reward": -14.155796652787352, "good_angle": 0.3780736774876348, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 0.466666666666665}}
good_angle_max0.9106337442639992
good_angle_mean0.5109882085159532
good_angle_median0.3780736774876348
good_angle_min0.30638758098273255
reward_max-4.698083330817859
reward_mean-18.596772650214582
reward_median-14.155796652787352
reward_min-48.22276366608484
survival_time_max7.333333333333317
survival_time_mean3.286666666666663
survival_time_min0.7
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.93333333333333
valid_direction_mean0.5933333333333325
valid_direction_median0.466666666666665
valid_direction_min0.4
7379870placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3320:01:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2146237349560498
deviation-center-line_median0.19419659835008488
in-drivable-lane_median0


other stats
deviation-center-line_max0.3374143381891188
deviation-center-line_mean0.21011394475273987
deviation-center-line_min0.11483402578422228
deviation-heading_max1.8111200947874369
deviation-heading_mean0.7785108433478245
deviation-heading_median0.5996662798992847
deviation-heading_min0.2716548684033488
driven_any_max0.5750134774837923
driven_any_mean0.31357881019871603
driven_any_median0.2321447639660318
driven_any_min0.1821385355822093
driven_lanedir_max0.3927962315349984
driven_lanedir_mean0.2515355920464669
driven_lanedir_min0.15580178984191795
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5750134774837923, "driven_lanedir": 0.31499547522126403, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.8111200947874369, "deviation-center-line": 0.21740257812149957}, "ep001": {"driven_any": 0.18215101346931745, "driven_lanedir": 0.17946072867810425, "in-drivable-lane": 0, "deviation-heading": 0.2716548684033488, "deviation-center-line": 0.1867221833187737}, "ep002": {"driven_any": 0.3964462604922293, "driven_lanedir": 0.3927962315349984, "in-drivable-lane": 0, "deviation-heading": 0.4346582812893121, "deviation-center-line": 0.3374143381891188}, "ep003": {"driven_any": 0.1821385355822093, "driven_lanedir": 0.15580178984191795, "in-drivable-lane": 0, "deviation-heading": 0.7754546923597402, "deviation-center-line": 0.11483402578422228}, "ep004": {"driven_any": 0.2321447639660318, "driven_lanedir": 0.2146237349560498, "in-drivable-lane": 0, "deviation-heading": 0.5996662798992847, "deviation-center-line": 0.19419659835008488}}
7376870placailleDolores' Awakeningaido1_LF1_r3-v3step3-videosabortedyes3320:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7376-9346', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7376-9346', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7376-9346_evaluation" with the default driver
stderr | Creating job7376-9346_videos_1 ...
stderr | 
Creating job7376-9346_videos_1 ... error

stderr | ERROR: for job7376-9346_videos_1  Cannot start service videos: network job7376-9346_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7376-9346_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7370870placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessno3320:02:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7363868Bhairav MehtaDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3320:01:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3423574133823939
deviation-center-line_median0.32126084473187155
in-drivable-lane_median0


other stats
deviation-center-line_max0.38149728232914
deviation-center-line_mean0.27778117243131456
deviation-center-line_min0.13439871537228848
deviation-heading_max1.80081196516076
deviation-heading_mean0.8617607492166407
deviation-heading_median0.6400615189615299
deviation-heading_min0.4532910920992052
driven_any_max0.8036138998900113
driven_any_mean0.3964416058555008
driven_any_median0.3500083292063926
driven_any_min0.15355728330032262
driven_lanedir_max0.5605137556048336
driven_lanedir_mean0.3354332455532562
driven_lanedir_min0.13563483370629426
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8036138998900113, "driven_lanedir": 0.5605137556048336, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.80081196516076, "deviation-center-line": 0.3486536209949582}, "ep001": {"driven_any": 0.3500083292063926, "driven_lanedir": 0.3423574133823939, "in-drivable-lane": 0, "deviation-heading": 0.4532910920992052, "deviation-center-line": 0.38149728232914}, "ep002": {"driven_any": 0.15355728330032262, "driven_lanedir": 0.13563483370629426, "in-drivable-lane": 0, "deviation-heading": 0.6041874210991599, "deviation-center-line": 0.13439871537228848}, "ep003": {"driven_any": 0.4393066668967861, "driven_lanedir": 0.4229105679823882, "in-drivable-lane": 0, "deviation-heading": 0.810451748762549, "deviation-center-line": 0.32126084473187155}, "ep004": {"driven_any": 0.23572184998399112, "driven_lanedir": 0.2157496570903712, "in-drivable-lane": 0, "deviation-heading": 0.6400615189615299, "deviation-center-line": 0.2030953987283143}}
7359868Bhairav MehtaDolores' Awakeningaido1_LF1_r3-v3step2-scoringabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7359-8790', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7359-8790', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7359-8790_evaluation" with the default driver
stderr | Creating job7359-8790_scorer_1 ...
stderr | 
Creating job7359-8790_scorer_1 ... error

stderr | ERROR: for job7359-8790_scorer_1  Cannot start service scorer: network job7359-8790_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7359-8790_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7341866MandanaSamieiImproved ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7338866MandanaSamieiImproved ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7333864placailleROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7328864placailleROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:03:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7327863placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationfailedno3320:10:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7317857heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3320:10:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7297853heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.366666666666657


other stats
episodes
details{"ep000": {"nsteps": 288, "reward": -3.641058176822197, "good_angle": 0.504815426236077, "survival_time": 9.599999999999977, "traveled_tiles": 4, "valid_direction": 0.7333333333333307}, "ep001": {"nsteps": 29, "reward": -35.031422510229305, "good_angle": 0.013708599184171211, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 161, "reward": -6.359810015043498, "good_angle": 0.3901540835820118, "survival_time": 5.366666666666657, "traveled_tiles": 3, "valid_direction": 0.7999999999999972}, "ep003": {"nsteps": 500, "reward": -2.210993104908848, "good_angle": 0.7451144779839413, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 1.7333333333333627}, "ep004": {"nsteps": 114, "reward": -9.057214901570166, "good_angle": 0.07631486728121534, "survival_time": 3.799999999999996, "traveled_tiles": 2, "valid_direction": 0.033333333333333215}}
good_angle_max0.7451144779839413
good_angle_mean0.34602149085348327
good_angle_median0.3901540835820118
good_angle_min0.013708599184171211
reward_max-2.210993104908848
reward_mean-11.260099741714802
reward_median-6.359810015043498
reward_min-35.031422510229305
survival_time_max16.666666666666654
survival_time_mean7.27999999999999
survival_time_min0.9666666666666666
traveled_tiles_max7
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.7333333333333627
valid_direction_mean0.6600000000000048
valid_direction_median0.7333333333333307
valid_direction_min0
7294852heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3320:10:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7291850heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3320:10:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7284849heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringabortedyes3320:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7284-2195', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7284-2195', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7284-2195_evaluation" with the default driver
stderr | Creating job7284-2195_scorer_1 ...
stderr | 
Creating job7284-2195_scorer_1 ... error

stderr | ERROR: for job7284-2195_scorer_1  Cannot start service scorer: network job7284-2195_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7284-2195_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7280849heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessno3320:09:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7275847heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7275-9542', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7275-9542', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7275-9542_evaluation" with the default driver
stderr | Creating job7275-9542_visualization_1 ...
stderr | 
Creating job7275-9542_visualization_1 ... error

stderr | ERROR: for job7275-9542_visualization_1  Cannot start service visualization: network job7275-9542_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7275-9542_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7272847heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.133333333333332


other stats
episodes
details{"ep000": {"nsteps": 91, "reward": -11.133975536662287, "good_angle": 0.3514170286521865, "survival_time": 3.0333333333333323, "traveled_tiles": 2, "valid_direction": 1.5666666666666689}, "ep001": {"nsteps": 42, "reward": -24.354641834185237, "good_angle": 0.010658120455247468, "survival_time": 1.400000000000001, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 161, "reward": -6.566677953238073, "good_angle": 0.08521069523088277, "survival_time": 5.366666666666657, "traveled_tiles": 3, "valid_direction": 0.1999999999999993}, "ep003": {"nsteps": 94, "reward": -10.92018834564914, "good_angle": 0.015010823644457265, "survival_time": 3.133333333333332, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.10944171024032402, "good_angle": 15.476339074918, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.76666666666665}}
good_angle_max15.476339074918
good_angle_mean3.1877271485801546
good_angle_median0.08521069523088277
good_angle_min0.010658120455247468
reward_max-0.10944171024032402
reward_mean-10.61698507599501
reward_median-10.92018834564914
reward_min-24.354641834185237
survival_time_max16.666666666666654
survival_time_mean5.9199999999999955
survival_time_min1.400000000000001
traveled_tiles_max10
traveled_tiles_mean3.8
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.76666666666665
valid_direction_mean1.3066666666666635
valid_direction_median0.1999999999999993
valid_direction_min0
7266845heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedno3320:10:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7265844orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step4-vizsuccessyes3320:03:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1314269717058074
deviation-center-line_median0.5813102795653945
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.8318073362698775
deviation-center-line_mean0.5282089568497466
deviation-center-line_min0.25983970914502263
deviation-heading_max4.16826922233794
deviation-heading_mean1.6450824421508792
deviation-heading_median1.0426196322852967
deviation-heading_min0.2217039640085142
driven_any_max1.93337991823903
driven_any_mean1.07539403334284
driven_any_median1.1802158531236375
driven_any_min0.2872893822401655
driven_lanedir_max1.931771955318411
driven_lanedir_mean0.9542381720624638
driven_lanedir_min0.15913915801793432
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.39999999999999913
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3765819473110307, "driven_lanedir": 0.15913915801793432, "in-drivable-lane": 0.8333333333333329, "deviation-heading": 2.348508487116988, "deviation-center-line": 0.25983970914502263}, "ep001": {"driven_any": 0.2872893822401655, "driven_lanedir": 0.28613778999603623, "in-drivable-lane": 0, "deviation-heading": 0.2217039640085142, "deviation-center-line": 0.2729106554978187}, "ep002": {"driven_any": 1.1802158531236375, "driven_lanedir": 1.1314269717058074, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.0426196322852967, "deviation-center-line": 0.69517680377062}, "ep003": {"driven_any": 1.93337991823903, "driven_lanedir": 1.931771955318411, "in-drivable-lane": 0, "deviation-heading": 0.44431090500565745, "deviation-center-line": 0.8318073362698775}, "ep004": {"driven_any": 1.599503065800336, "driven_lanedir": 1.26271498527413, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 4.16826922233794, "deviation-center-line": 0.5813102795653945}}
7261844orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step3-videosabortedyes3320:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7261-1410', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7261-1410', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7261-1410_evaluation" with the default driver
stderr | Creating job7261-1410_videos_1 ...
stderr | 
Creating job7261-1410_videos_1 ... error

stderr | ERROR: for job7261-1410_videos_1  Cannot start service videos: network job7261-1410_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7261-1410_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7258844orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7256843orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step4-vizsuccessyes3320:03:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1334002070910218
deviation-center-line_median0.4769969513039974
in-drivable-lane_median0.13333333333333286


other stats
deviation-center-line_max1.0445636675840984
deviation-center-line_mean0.5559782024940929
deviation-center-line_min0.24270590326204855
deviation-heading_max3.6560128066760536
deviation-heading_mean1.578869415829056
deviation-heading_median1.055493987447958
deviation-heading_min0.21554163794861217
driven_any_max1.9333799184818008
driven_any_mean1.082382171288414
driven_any_median1.1802158539779026
driven_any_min0.34164143148619897
driven_lanedir_max1.9317723933220692
driven_lanedir_mean0.9620222872803948
driven_lanedir_min0.145213403619873
in-drivable-lane_max1.233333333333329
in-drivable-lane_mean0.41999999999999904
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3610528764251814, "driven_lanedir": 0.145213403619873, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 2.4383237313164408, "deviation-center-line": 0.24270590326204855}, "ep001": {"driven_any": 0.34164143148619897, "driven_lanedir": 0.3407319473159087, "in-drivable-lane": 0, "deviation-heading": 0.21554163794861217, "deviation-center-line": 0.32516568274283286}, "ep002": {"driven_any": 1.1802158539779026, "driven_lanedir": 1.1334002070910218, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.055493987447958, "deviation-center-line": 0.6904588075774868}, "ep003": {"driven_any": 1.9333799184818008, "driven_lanedir": 1.9317723933220692, "in-drivable-lane": 0, "deviation-heading": 0.5289749157562148, "deviation-center-line": 1.0445636675840984}, "ep004": {"driven_any": 1.5956207760709862, "driven_lanedir": 1.2589934850531015, "in-drivable-lane": 1.233333333333329, "deviation-heading": 3.6560128066760536, "deviation-center-line": 0.4769969513039974}}
7252843orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step2-scoringsuccessyes3320:02:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.199999999999974


other stats
episodes
details{"ep000": {"nsteps": 95, "reward": -10.781536498239362, "good_angle": 1.49666587060377, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.666666666666665}, "ep001": {"nsteps": 90, "reward": -11.679380984107654, "good_angle": 0.01572243865648299, "survival_time": 2.999999999999999, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 306, "reward": -3.838494162982195, "good_angle": 1.1705377735998244, "survival_time": 10.199999999999974, "traveled_tiles": 3, "valid_direction": 2.5999999999999917}, "ep003": {"nsteps": 500, "reward": -0.33937937901914117, "good_angle": 0.3143868799971964, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 1.0333333333333652}, "ep004": {"nsteps": 413, "reward": -3.0206985883762862, "good_angle": 23.68327713673608, "survival_time": 13.766666666666628, "traveled_tiles": 3, "valid_direction": 4.699999999999983}}
good_angle_max23.68327713673608
good_angle_mean5.33611801991867
good_angle_median1.1705377735998244
good_angle_min0.01572243865648299
reward_max-0.33937937901914117
reward_mean-5.931897922544928
reward_median-3.838494162982195
reward_min-11.679380984107654
survival_time_max16.666666666666654
survival_time_mean9.359999999999983
survival_time_min2.999999999999999
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.699999999999983
valid_direction_mean2.200000000000001
valid_direction_median2.5999999999999917
valid_direction_min0
7238646Julian ZillyROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22314677952336393
deviation-center-line_median0.20103975714762165
in-drivable-lane_median0


other stats
deviation-center-line_max0.3516216984482968
deviation-center-line_mean0.23806215808098496
deviation-center-line_min0.13905956265520614
deviation-heading_max1.7602652484256691
deviation-heading_mean0.7745989853156303
deviation-heading_median0.5898118502612003
deviation-heading_min0.21717624725924584
driven_any_max0.7786138011702203
driven_any_mean0.3635821762769181
driven_any_median0.2357157086089037
driven_any_min0.16426673648448958
driven_lanedir_max0.5344344841372923
driven_lanedir_mean0.30603830643630037
driven_lanedir_min0.14827117076994445
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7786138011702203, "driven_lanedir": 0.5344344841372923, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7602652484256691, "deviation-center-line": 0.3183742804553118}, "ep001": {"driven_any": 0.17500876627313106, "driven_lanedir": 0.1732402364437835, "in-drivable-lane": 0, "deviation-heading": 0.21717624725924584, "deviation-center-line": 0.1802154916984885}, "ep002": {"driven_any": 0.16426673648448958, "driven_lanedir": 0.14827117076994445, "in-drivable-lane": 0, "deviation-heading": 0.5898118502612003, "deviation-center-line": 0.13905956265520614}, "ep003": {"driven_any": 0.4643058688478457, "driven_lanedir": 0.4510988613071176, "in-drivable-lane": 0, "deviation-heading": 0.7667185959126711, "deviation-center-line": 0.3516216984482968}, "ep004": {"driven_any": 0.2357157086089037, "driven_lanedir": 0.22314677952336393, "in-drivable-lane": 0, "deviation-heading": 0.5390229847193653, "deviation-center-line": 0.20103975714762165}}
7236646Julian ZillyROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7234646Julian ZillyROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2666666666666684


other stats
episodes
details{"ep000": {"nsteps": 220, "reward": -4.687066858830671, "good_angle": 0.8546841214593761, "survival_time": 7.333333333333317, "traveled_tiles": 2, "valid_direction": 0.8666666666666643}, "ep001": {"nsteps": 51, "reward": -20.16528066875888, "good_angle": 0.03321886899864684, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 48, "reward": -21.309790646036465, "good_angle": 0.363160557788163, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.8666666666666684}, "ep003": {"nsteps": 132, "reward": -7.980923174570004, "good_angle": 0.3103557994605326, "survival_time": 4.399999999999994, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep004": {"nsteps": 68, "reward": -15.175564424956546, "good_angle": 0.30161779555481794, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.533333333333333}}
good_angle_max0.8546841214593761
good_angle_mean0.3726074286523072
good_angle_median0.3103557994605326
good_angle_min0.03321886899864684
reward_max-4.687066858830671
reward_mean-13.863725154630512
reward_median-15.175564424956546
reward_min-21.309790646036465
survival_time_max7.333333333333317
survival_time_mean3.4599999999999964
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.8666666666666684
valid_direction_mean0.5399999999999995
valid_direction_median0.533333333333333
valid_direction_min0
7230646Julian ZillyROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:03:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7204659aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailedno3320:10:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7200667JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3320:03:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.947692221762
deviation-center-line_median0.601770937400157
in-drivable-lane_median3.533333333333321


other stats
deviation-center-line_max1.717034221377104
deviation-center-line_mean0.6764445540480157
deviation-center-line_min0
deviation-heading_max3.358087145435135
deviation-heading_mean1.634981426818814
deviation-heading_median1.2565884392653988
deviation-heading_min0
driven_any_max2.6993108844429012
driven_any_mean1.7356464490466563
driven_any_median1.6689590739026523
driven_any_min0.908515202240608
driven_lanedir_max2.218913328783092
driven_lanedir_mean0.9500789932608408
driven_lanedir_min0
in-drivable-lane_max10.16666666666664
in-drivable-lane_mean4.826666666666659
in-drivable-lane_min2.1666666666666945
per-episodes
details{"ep000": {"driven_any": 1.643782411427607, "driven_lanedir": 0, "in-drivable-lane": 10.16666666666664, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.6689590739026523, "driven_lanedir": 1.115359681210446, "in-drivable-lane": 3.533333333333321, "deviation-heading": 2.4812969040212463, "deviation-center-line": 0.601770937400157}, "ep002": {"driven_any": 0.908515202240608, "driven_lanedir": 0.46842973454866654, "in-drivable-lane": 2.8666666666666565, "deviation-heading": 1.2565884392653988, "deviation-center-line": 0.289991214190812}, "ep003": {"driven_any": 1.7576646732195136, "driven_lanedir": 0.947692221762, "in-drivable-lane": 5.399999999999982, "deviation-heading": 1.078934645372291, "deviation-center-line": 0.7734263972720052}, "ep004": {"driven_any": 2.6993108844429012, "driven_lanedir": 2.218913328783092, "in-drivable-lane": 2.1666666666666945, "deviation-heading": 3.358087145435135, "deviation-center-line": 1.717034221377104}}
7196668JonJP pipelineaido1_LFV_r1-v3step3-videossuccessyes3320:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7194668JonJP pipelineaido1_LFV_r1-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -2.0466494324207307, "good_angle": 2.323609270543785, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.366666666666693}, "ep001": {"nsteps": 500, "reward": -1.0490540527164702, "good_angle": 30.70600074272348, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 9.966666666666669}, "ep002": {"nsteps": 96, "reward": -11.651025777564428, "good_angle": 3.0556533610905294, "survival_time": 3.1999999999999984, "traveled_tiles": 1, "valid_direction": 2.8999999999999986}, "ep003": {"nsteps": 423, "reward": -3.626880042292354, "good_angle": 29.294166818874302, "survival_time": 14.09999999999996, "traveled_tiles": 5, "valid_direction": 5.299999999999983}, "ep004": {"nsteps": 500, "reward": -0.727226340314839, "good_angle": 27.298355430647096, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 5.399999999999982}}
good_angle_max30.70600074272348
good_angle_mean18.53555712477584
good_angle_median27.298355430647096
good_angle_min2.323609270543785
reward_max-0.727226340314839
reward_mean-3.820167129061764
reward_median-2.0466494324207307
reward_min-11.651025777564428
survival_time_max16.666666666666654
survival_time_mean13.459999999999985
survival_time_min3.1999999999999984
traveled_tiles_max6
traveled_tiles_mean4.6
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max9.966666666666669
valid_direction_mean5.386666666666665
valid_direction_median5.299999999999983
valid_direction_min2.8999999999999986
7177668JonJP pipelineaido1_LFV_r1-v3step1-simulationsuccessno3320:05:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7171679MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1745480261201093
deviation-center-line_median0.14587207211529046
in-drivable-lane_median0


other stats
deviation-center-line_max0.36576529107010086
deviation-center-line_mean0.17957611540873292
deviation-center-line_min0.06767002863101401
deviation-heading_max1.7278559627959122
deviation-heading_mean0.8247727535366535
deviation-heading_median0.6077205202033108
deviation-heading_min0.41822924086779306
driven_any_max0.8036004404259893
driven_any_mean0.295718517919679
driven_any_median0.20357374273957013
driven_any_min0.06070675329705992
driven_lanedir_max0.566221486139983
driven_lanedir_mean0.23198101407835803
driven_lanedir_min0.04347572875082806
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8036004404259893, "driven_lanedir": 0.566221486139983, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7278559627959122, "deviation-center-line": 0.36576529107010086}, "ep001": {"driven_any": 0.06070675329705992, "driven_lanedir": 0.04347572875082806, "in-drivable-lane": 0, "deviation-heading": 0.41822924086779306, "deviation-center-line": 0.06767002863101401}, "ep002": {"driven_any": 0.18213253336417248, "driven_lanedir": 0.16515727889026555, "in-drivable-lane": 0, "deviation-heading": 0.5692809850390634, "deviation-center-line": 0.14587207211529046}, "ep003": {"driven_any": 0.20357374273957013, "driven_lanedir": 0.1745480261201093, "in-drivable-lane": 0, "deviation-heading": 0.8007770587771882, "deviation-center-line": 0.12236115880544486}, "ep004": {"driven_any": 0.2285791197716033, "driven_lanedir": 0.21050255049060415, "in-drivable-lane": 0, "deviation-heading": 0.6077205202033108, "deviation-center-line": 0.19621202642181432}}
7168679MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7164679MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9666666666666697


other stats
episodes
details{"ep000": {"nsteps": 227, "reward": -4.574096439211395, "good_angle": 0.7021897423047548, "survival_time": 7.5666666666666496, "traveled_tiles": 2, "valid_direction": 1.066666666666663}, "ep001": {"nsteps": 19, "reward": -53.3014649560577, "good_angle": 0.4170764204286568, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 53, "reward": -19.31670369910744, "good_angle": 0.4083481070600648, "survival_time": 1.7666666666666688, "traveled_tiles": 2, "valid_direction": 0.6333333333333352}, "ep003": {"nsteps": 59, "reward": -17.292475939807247, "good_angle": 0.6557665581004721, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.7000000000000022}, "ep004": {"nsteps": 66, "reward": -15.634002978603045, "good_angle": 0.4012416893032255, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6000000000000003}}
good_angle_max0.7021897423047548
good_angle_mean0.5169245034394347
good_angle_median0.4170764204286568
good_angle_min0.4012416893032255
reward_max-4.574096439211395
reward_mean-22.023748802557368
reward_median-17.292475939807247
reward_min-53.3014649560577
survival_time_max7.5666666666666496
survival_time_mean2.8266666666666653
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.066666666666663
valid_direction_mean0.6933333333333336
valid_direction_median0.6333333333333352
valid_direction_min0.4666666666666666
7155679MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7149685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22209094376713656
deviation-center-line_median0.20246095331595268
in-drivable-lane_median0


other stats
deviation-center-line_max0.30168878333512433
deviation-center-line_mean0.19548067373584185
deviation-center-line_min0.12302038102308972
deviation-heading_max1.834003606005921
deviation-heading_mean0.8394426455087283
deviation-heading_median0.6444174952344611
deviation-heading_min0.33000713745724486
driven_any_max0.5464472271487393
driven_any_mean0.28786004034431517
driven_any_median0.2428624910475559
driven_any_min0.15713873927101343
driven_lanedir_max0.28180618199899854
driven_lanedir_mean0.22010122620050213
driven_lanedir_min0.13526246201468006
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5464472271487393, "driven_lanedir": 0.2772630491130057, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.834003606005921, "deviation-center-line": 0.212833855154674}, "ep001": {"driven_any": 0.2857225358668876, "driven_lanedir": 0.28180618199899854, "in-drivable-lane": 0, "deviation-heading": 0.33000713745724486, "deviation-center-line": 0.30168878333512433}, "ep002": {"driven_any": 0.15713873927101343, "driven_lanedir": 0.13526246201468006, "in-drivable-lane": 0, "deviation-heading": 0.619266515803785, "deviation-center-line": 0.12302038102308972}, "ep003": {"driven_any": 0.2071292083873798, "driven_lanedir": 0.18408349410868977, "in-drivable-lane": 0, "deviation-heading": 0.769518473042229, "deviation-center-line": 0.13739939585036856}, "ep004": {"driven_any": 0.2428624910475559, "driven_lanedir": 0.22209094376713656, "in-drivable-lane": 0, "deviation-heading": 0.6444174952344611, "deviation-center-line": 0.20246095331595268}}
7145685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7143685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.333333333333335


other stats
episodes
details{"ep000": {"nsteps": 155, "reward": -6.582495219678047, "good_angle": 1.397675751928089, "survival_time": 5.166666666666658, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 82, "reward": -12.780102875174546, "good_angle": 0.07893720372985005, "survival_time": 2.7333333333333334, "traveled_tiles": 1, "valid_direction": 0.1999999999999993}, "ep002": {"nsteps": 46, "reward": -22.191317722849224, "good_angle": 0.49699080504771087, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.6666666666666682}, "ep003": {"nsteps": 60, "reward": -17.037552816669145, "good_angle": 0.5307481795458672, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 0.700000000000002}, "ep004": {"nsteps": 70, "reward": -14.755798952920095, "good_angle": 0.45785588849117737, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 0.6666666666666663}}
good_angle_max1.397675751928089
good_angle_mean0.5924415657485389
good_angle_median0.49699080504771087
good_angle_min0.07893720372985005
reward_max-6.582495219678047
reward_mean-14.669453517458214
reward_median-14.755798952920095
reward_min-22.191317722849224
survival_time_max5.166666666666658
survival_time_mean2.753333333333333
survival_time_min1.5333333333333348
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.7399999999999995
valid_direction_median0.6666666666666682
valid_direction_min0.1999999999999993
7133685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7126692MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.23522011492202077
deviation-center-line_median0.20785624117286944
in-drivable-lane_median0


other stats
deviation-center-line_max0.35866322139679335
deviation-center-line_mean0.2235690297272545
deviation-center-line_min0.06613027353172862
deviation-heading_max1.761014502490812
deviation-heading_mean0.817921066754522
deviation-heading_median0.5847088195482865
deviation-heading_min0.3863866449680335
driven_any_max0.8036031465550602
driven_any_mean0.3485778438102048
driven_any_median0.24999551928571273
driven_any_min0.06070605373291465
driven_lanedir_max0.5678673871675848
driven_lanedir_mean0.28853769492244746
driven_lanedir_min0.04541133303923717
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8036031465550602, "driven_lanedir": 0.5678673871675848, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.761014502490812, "deviation-center-line": 0.35866322139679335}, "ep001": {"driven_any": 0.06070605373291465, "driven_lanedir": 0.04541133303923717, "in-drivable-lane": 0, "deviation-heading": 0.3863866449680335, "deviation-center-line": 0.06613027353172862}, "ep002": {"driven_any": 0.16428051524747136, "driven_lanedir": 0.14435846325250412, "in-drivable-lane": 0, "deviation-heading": 0.5847088195482865, "deviation-center-line": 0.13077805030673528}, "ep003": {"driven_any": 0.46430398422986474, "driven_lanedir": 0.4498311762308904, "in-drivable-lane": 0, "deviation-heading": 0.7913531458281071, "deviation-center-line": 0.3544173622281459}, "ep004": {"driven_any": 0.24999551928571273, "driven_lanedir": 0.23522011492202077, "in-drivable-lane": 0, "deviation-heading": 0.5661422209373712, "deviation-center-line": 0.20785624117286944}}
7121692MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7108691MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:02:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7100693BenjaminROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3320:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7094698BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.42228917733577376
deviation-center-line_median0.21549312967928197
in-drivable-lane_median0


other stats
deviation-center-line_max0.467471914531472
deviation-center-line_mean0.22801874102871125
deviation-center-line_min0.0998522947571148
deviation-heading_max0.825645828695938
deviation-heading_mean0.46498077036872265
deviation-heading_median0.45083165247988866
deviation-heading_min0.0838480463220005
driven_any_max1.3382377280285622
driven_any_mean0.5551185792628492
driven_any_median0.43341137414369574
driven_any_min0.2511811821630917
driven_lanedir_max1.116924209824502
driven_lanedir_mean0.5029962277236194
driven_lanedir_min0.25000013049196834
in-drivable-lane_max1.166666666666667
in-drivable-lane_mean0.2333333333333334
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.3382377280285622, "driven_lanedir": 1.116924209824502, "in-drivable-lane": 1.166666666666667, "deviation-heading": 0.825645828695938, "deviation-center-line": 0.467471914531472}, "ep001": {"driven_any": 0.2511811821630917, "driven_lanedir": 0.25000013049196834, "in-drivable-lane": 0, "deviation-heading": 0.0838480463220005, "deviation-center-line": 0.0998522947571148}, "ep002": {"driven_any": 0.43341137414369574, "driven_lanedir": 0.42228917733577376, "in-drivable-lane": 0, "deviation-heading": 0.45083165247988866, "deviation-center-line": 0.21549312967928197}, "ep003": {"driven_any": 0.46847262346870205, "driven_lanedir": 0.4533992192437779, "in-drivable-lane": 0, "deviation-heading": 0.5797623666878884, "deviation-center-line": 0.21981292231683144}, "ep004": {"driven_any": 0.28428998851019427, "driven_lanedir": 0.2723684017220753, "in-drivable-lane": 0, "deviation-heading": 0.3848159576578976, "deviation-center-line": 0.13746344385885592}}
7089698BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3320:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7073701BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3320:04:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
7070703JonRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3320:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.133333333333318


other stats
episodes
details{"ep000": {"nsteps": 80, "reward": -12.752392666199013, "good_angle": 1.2364707521695928, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 2.2}, "ep001": {"nsteps": 67, "reward": -15.488459856652502, "good_angle": 0.0164428055587007, "survival_time": 2.233333333333335, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 255, "reward": -4.470891792926134, "good_angle": 1.0883239617161118, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.2999999999999927}, "ep003": {"nsteps": 214, "reward": -5.0253216128483, "good_angle": 0.031199632742098776, "survival_time": 7.133333333333318, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 344, "reward": -3.49443882171621, "good_angle": 19.984361257399495, "survival_time": 11.466666666666637, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}
good_angle_max19.984361257399495
good_angle_mean4.4713596819172
good_angle_median1.0883239617161118
good_angle_min0.0164428055587007
reward_max-3.49443882171621
reward_mean-8.24630095006843
reward_median-5.0253216128483
reward_min-15.488459856652502
survival_time_max11.466666666666637
survival_time_mean6.399999999999987
survival_time_min2.233333333333335
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.93333333333332
valid_direction_mean1.6866666666666623
valid_direction_median2.2
valid_direction_min0
7065703JonRandom executionaido1_LF1_r3-v3step1-simulationsuccessno3320:01:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7062711BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3320:01:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.44849057621284927
deviation-center-line_median0.3385367418943803
in-drivable-lane_median0


other stats
deviation-center-line_max0.3631494708869909
deviation-center-line_mean0.28933223342807673
deviation-center-line_min0.06251192944290052
deviation-heading_max1.4554560952872648
deviation-heading_mean0.8736004979884358
deviation-heading_median0.9981356281509272
deviation-heading_min0.05419851128747748
driven_any_max1.2279336654917663
driven_any_mean0.5333199513671703
driven_any_median0.46074255174295187
driven_any_min0.23537370395611312
driven_lanedir_max1.004201928553276
driven_lanedir_mean0.480259299051273
driven_lanedir_min0.23417973596072583
in-drivable-lane_max2.6333333333333337
in-drivable-lane_mean0.5266666666666667
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.2279336654917663, "driven_lanedir"