Duckietown Challenges Home Challenges Submissions

Evaluator 365

ID365
evaluatornutonomy-P50-2210
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-2210
versionDC:3.1.58;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success55 11405
# timeout
# failed8 11463
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11764778Alessandro MorraAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.2666666666666673


other stats
episodes
details{"ep000": {"nsteps": 38, "reward": -26.918777009864385, "good_angle": 0.5152898093589164, "survival_time": 1.2666666666666673, "traveled_tiles": 2, "valid_direction": 0.5000000000000007}, "ep001": {"nsteps": 14, "reward": -71.07715241451349, "good_angle": 0.013447461209428926, "survival_time": 0.4666666666666666, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 28, "reward": -35.51434066705406, "good_angle": 0.21241149172426904, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.3999999999999999}, "ep003": {"nsteps": 39, "reward": -25.453721204915873, "good_angle": 0.12993703657275624, "survival_time": 1.3000000000000007, "traveled_tiles": 2, "valid_direction": 0.33333333333333415}, "ep004": {"nsteps": 40, "reward": -24.67824831921607, "good_angle": 0.20708345243040352, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0.3666666666666676}}
good_angle_max0.5152898093589164
good_angle_mean0.21563385025915488
good_angle_median0.20708345243040352
good_angle_min0.013447461209428926
reward_max-24.67824831921607
reward_mean-36.728447923112775
reward_median-26.918777009864385
reward_min-71.07715241451349
survival_time_max1.333333333333334
survival_time_mean1.0600000000000005
survival_time_min0.4666666666666666
traveled_tiles_max2
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.5000000000000007
valid_direction_mean0.32000000000000045
valid_direction_median0.3666666666666676
valid_direction_min0
No reset possible
11758768Dzenan LapandicRandom executionaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.7666666666666666


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -13.052108487091315, "good_angle": 1.140091443855956, "survival_time": 2.7, "traveled_tiles": 2, "valid_direction": 1.066666666666665}, "ep001": {"nsteps": 97, "reward": -10.286879926401468, "good_angle": 0.27066732739238114, "survival_time": 3.2333333333333316, "traveled_tiles": 3, "valid_direction": 0.6333333333333311}, "ep002": {"nsteps": 57, "reward": -17.321272734013434, "good_angle": 0.32420104507168324, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0.766666666666669}, "ep003": {"nsteps": 83, "reward": -11.765453411041792, "good_angle": 0.27882306789839373, "survival_time": 2.7666666666666666, "traveled_tiles": 2, "valid_direction": 0.5999999999999979}, "ep004": {"nsteps": 84, "reward": -11.793988459943128, "good_angle": 0.390760193812883, "survival_time": 2.8, "traveled_tiles": 3, "valid_direction": 0.7666666666666639}}
good_angle_max1.140091443855956
good_angle_mean0.48090861560625936
good_angle_median0.32420104507168324
good_angle_min0.27066732739238114
reward_max-10.286879926401468
reward_mean-12.843940603698226
reward_median-11.793988459943128
reward_min-17.321272734013434
survival_time_max3.2333333333333316
survival_time_mean2.6800000000000006
survival_time_min1.9000000000000024
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max1.066666666666665
valid_direction_mean0.7666666666666654
valid_direction_median0.7666666666666639
valid_direction_min0.5999999999999979
No reset possible
11757777Yannick BerdouAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7583624342945385
deviation-center-line_median0.05856940306194948
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.0848318451919554
deviation-center-line_mean0.046692309596965104
deviation-center-line_min0.00493459316827017
deviation-heading_max0.17871954277822616
deviation-heading_mean0.12290238968183878
deviation-heading_median0.1404921816205833
deviation-heading_min0.043767648089746966
driven_any_max1.12
driven_any_mean0.9520000000000014
driven_any_median1.0400000000000025
driven_any_min0.7599999999999976
driven_lanedir_max1.0891907711875215
driven_lanedir_mean0.7157737741226108
driven_lanedir_min0.00431907202387416
in-drivable-lane_max0.7999999999999999
in-drivable-lane_mean0.1733333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0400000000000025, "driven_lanedir": 0.00431907202387416, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 0.1516782451032673, "deviation-center-line": 0.00493459316827017}, "ep001": {"driven_any": 0.760000000000006, "driven_lanedir": 0.7583624342945385, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.05856940306194948}, "ep002": {"driven_any": 0.7599999999999976, "driven_lanedir": 0.6711343097180644, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.17871954277822616, "deviation-center-line": 0.02298492709392346}, "ep003": {"driven_any": 1.0800000000000007, "driven_lanedir": 1.0558622833890554, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.09985433081737012, "deviation-center-line": 0.0848318451919554}, "ep004": {"driven_any": 1.12, "driven_lanedir": 1.0891907711875215, "in-drivable-lane": 0, "deviation-heading": 0.1404921816205833, "deviation-center-line": 0.062140779468727016}}
No reset possible
11755777Yannick BerdouAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11754777Yannick BerdouAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9333333333333332


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -36.6421162430197, "good_angle": 0.5231223188267838, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 21, "reward": -47.253679474549635, "good_angle": 0.15423356340546784, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.26666666666666666}, "ep003": {"nsteps": 29, "reward": -34.48776989465515, "good_angle": 0.13377976232358335, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0.29999999999999993}, "ep004": {"nsteps": 30, "reward": -33.12740348378817, "good_angle": 0.13484239023230782, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.2666666666666666}}
good_angle_max0.5231223188267838
good_angle_mean0.18979987683516303
good_angle_median0.13484239023230782
good_angle_min0.0030213493876724944
reward_max-33.12740348378817
reward_mean-39.758097890022654
reward_median-36.6421162430197
reward_min-47.27952035410063
survival_time_max1
survival_time_mean0.86
survival_time_min0.7
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.3666666666666666
valid_direction_mean0.2399999999999999
valid_direction_median0.26666666666666666
valid_direction_min0
No reset possible
11745777Yannick BerdouAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessyesnutonomy-P50-22100:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
11743776Alessandro MorraAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7264367293719264
deviation-center-line_median0.05408064751023453
in-drivable-lane_median0


other stats
deviation-center-line_max0.0962695857004829
deviation-center-line_mean0.054790126542747675
deviation-center-line_min0.009945603852153158
deviation-heading_max0.24999531766940689
deviation-heading_mean0.1499510907592431
deviation-heading_median0.15761377032474155
deviation-heading_min0.0631755407513959
driven_any_max1.1330171295333382
driven_any_mean0.8834808930175562
driven_any_median0.9241449955170936
driven_any_min0.5275006272735693
driven_lanedir_max1.0975890039448584
driven_lanedir_mean0.6559004093625984
driven_lanedir_min0.0082971910814571
in-drivable-lane_max1.0666666666666669
in-drivable-lane_mean0.22000000000000003
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0614974764245615, "driven_lanedir": 0.0082971910814571, "in-drivable-lane": 1.0666666666666669, "deviation-heading": 0.24999531766940689, "deviation-center-line": 0.009945603852153158}, "ep001": {"driven_any": 0.5275006272735693, "driven_lanedir": 0.5247590495995889, "in-drivable-lane": 0, "deviation-heading": 0.06364165732035774, "deviation-center-line": 0.05408064751023453}, "ep002": {"driven_any": 0.7712442363392181, "driven_lanedir": 0.7264367293719264, "in-drivable-lane": 0, "deviation-heading": 0.21532916773031335, "deviation-center-line": 0.028639538300609262}, "ep003": {"driven_any": 0.9241449955170936, "driven_lanedir": 0.9224200728151614, "in-drivable-lane": 0, "deviation-heading": 0.0631755407513959, "deviation-center-line": 0.0962695857004829}, "ep004": {"driven_any": 1.1330171295333382, "driven_lanedir": 1.0975890039448584, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.15761377032474155, "deviation-center-line": 0.08501525735025853}}
No reset possible
11741776Alessandro MorraAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11738776Alessandro MorraAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.1


other stats
episodes
details{"ep000": {"nsteps": 38, "reward": -27.077157789547194, "good_angle": 0.5895413362845523, "survival_time": 1.2666666666666673, "traveled_tiles": 2, "valid_direction": 0.46666666666666734}, "ep001": {"nsteps": 20, "reward": -49.650675524026155, "good_angle": 0.007631721779919197, "survival_time": 0.6666666666666666, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 28, "reward": -35.36085553959544, "good_angle": 0.18193967654645057, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep003": {"nsteps": 33, "reward": -30.096779570435032, "good_angle": 0.06545609489873849, "survival_time": 1.1, "traveled_tiles": 2, "valid_direction": 0.2333333333333335}, "ep004": {"nsteps": 40, "reward": -24.840510986559092, "good_angle": 0.19286640716349307, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0.3666666666666676}}
good_angle_max0.5895413362845523
good_angle_mean0.20748704733463072
good_angle_median0.18193967654645057
good_angle_min0.007631721779919197
reward_max-24.840510986559092
reward_mean-33.40519588203258
reward_median-30.096779570435032
reward_min-49.650675524026155
survival_time_max1.333333333333334
survival_time_mean1.0600000000000005
survival_time_min0.6666666666666666
traveled_tiles_max2
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.46666666666666734
valid_direction_mean0.28666666666666696
valid_direction_median0.3666666666666666
valid_direction_min0
No reset possible
11736770Simon Schaefer 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7783192106360408
deviation-center-line_median0.11570483192692992
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.16670357033941505
deviation-center-line_mean0.09180087418015584
deviation-center-line_min0.010960488606122868
deviation-heading_max0.34166970533598884
deviation-heading_mean0.23686400729408288
deviation-heading_median0.26451178551660837
deviation-heading_min0.08753529617949395
driven_any_max1.1400000000000017
driven_any_mean0.9760000000000012
driven_any_median1.0799999999999996
driven_any_min0.7799999999999967
driven_lanedir_max1.1054561923632351
driven_lanedir_mean0.7307584818240866
driven_lanedir_min0.005399048963769193
in-drivable-lane_max1.633333333333335
in-drivable-lane_mean0.346666666666667
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0799999999999996, "driven_lanedir": 0.005399048963769193, "in-drivable-lane": 1.633333333333335, "deviation-heading": 0.30335649020653566, "deviation-center-line": 0.010960488606122868}, "ep001": {"driven_any": 0.7800000000000074, "driven_lanedir": 0.7783192106360408, "in-drivable-lane": 0, "deviation-heading": 0.08753529617949395, "deviation-center-line": 0.11570483192692992}, "ep002": {"driven_any": 0.7799999999999967, "driven_lanedir": 0.706093028267093, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.34166970533598884, "deviation-center-line": 0.04371207325047091}, "ep003": {"driven_any": 1.100000000000001, "driven_lanedir": 1.0585249288902947, "in-drivable-lane": 0.06666666666666687, "deviation-heading": 0.18724675923178744, "deviation-center-line": 0.16670357033941505}, "ep004": {"driven_any": 1.1400000000000017, "driven_lanedir": 1.1054561923632351, "in-drivable-lane": 0, "deviation-heading": 0.26451178551660837, "deviation-center-line": 0.12192340677784048}}
No reset possible
11735770Simon Schaefer 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:00:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11734770Simon Schaefer 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8666666666666691


other stats
episodes
details{"ep000": {"nsteps": 56, "reward": -18.801444864565777, "good_angle": 1.0163992328464693, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0.7000000000000022}, "ep001": {"nsteps": 41, "reward": -24.03603506269978, "good_angle": 0.00579980220315226, "survival_time": 1.3666666666666676, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 41, "reward": -23.988571963023123, "good_angle": 0.2649658884005068, "survival_time": 1.3666666666666676, "traveled_tiles": 2, "valid_direction": 0.500000000000001}, "ep003": {"nsteps": 57, "reward": -17.52574976100668, "good_angle": 0.229551202468404, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0.533333333333335}, "ep004": {"nsteps": 59, "reward": -16.72157261646905, "good_angle": 0.229542941296041, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 0.5000000000000016}}
good_angle_max1.0163992328464693
good_angle_mean0.34925181344291467
good_angle_median0.229551202468404
good_angle_min0.00579980220315226
reward_max-16.72157261646905
reward_mean-20.21467485355288
reward_median-18.801444864565777
reward_min-24.03603506269978
survival_time_max1.9666666666666697
survival_time_mean1.6933333333333351
survival_time_min1.3666666666666676
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.7000000000000022
valid_direction_mean0.44666666666666793
valid_direction_median0.5000000000000016
valid_direction_min0
No reset possible
11727770Simon Schaefer 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessyesnutonomy-P50-22100:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
117241031Laurent MandrileTensorflow templateaido1_LF1_r3-v3step1-simulationfailedyesnutonomy-P50-22100:00:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 86, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 29, in solve
    from model import TensorflowModel
  File "/workspace/model.py", line 55
    return vels
SyntaxError: 'return' outside function


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11722771Maximilien PicquetAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationfailedyesnutonomy-P50-22100:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 105, in step
    assert len(action) == 2
AssertionError


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
117211286Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedyesnutonomy-P50-22100:00:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    solve(params, cis)
  File "solution.py", line 68, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 37, in make_env
    env = FrameStackWrappper(env=env, k=3, config=config)
  File "/workspace/wrappers.py", line 89, in __init__
    self.seg_model.load_state_dict(torch.load(config['use_segmentation_weight'])['state_dict'],
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 508, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 104, in default_restore_location
    result = fn(storage, location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 75, in _cuda_deserialize
    raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location='cpu' to map your storages to the CPU.


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
117161029Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11715774Gianmarco BernasconiNot Random executionaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.7333333333333334


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -12.868081667437783, "good_angle": 1.1171031102117968, "survival_time": 2.7333333333333334, "traveled_tiles": 2, "valid_direction": 1.0666666666666649}, "ep001": {"nsteps": 97, "reward": -10.117215783786529, "good_angle": 0.3259394518205559, "survival_time": 3.2333333333333316, "traveled_tiles": 3, "valid_direction": 0.6999999999999975}, "ep002": {"nsteps": 59, "reward": -16.290646575328154, "good_angle": 0.41991990967540144, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 0.7333333333333356}, "ep003": {"nsteps": 82, "reward": -12.227163290400512, "good_angle": 0.21944928303043176, "survival_time": 2.7333333333333334, "traveled_tiles": 2, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 74, "reward": -13.423640946977192, "good_angle": 0.11946724776219377, "survival_time": 2.4666666666666677, "traveled_tiles": 3, "valid_direction": 0.36666666666666536}}
good_angle_max1.1171031102117968
good_angle_mean0.44037580050007585
good_angle_median0.3259394518205559
good_angle_min0.11946724776219377
reward_max-10.117215783786529
reward_mean-12.985349652786033
reward_median-12.868081667437783
reward_min-16.290646575328154
survival_time_max3.2333333333333316
survival_time_mean2.6266666666666674
survival_time_min1.9666666666666697
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max1.0666666666666649
valid_direction_mean0.7066666666666656
valid_direction_median0.6999999999999975
valid_direction_min0.36666666666666536
No reset possible
11713774Gianmarco BernasconiNot Random executionaido1_LF1_r3-v3step1-simulationsuccessyesnutonomy-P50-22100:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
117121285Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedyesnutonomy-P50-22100:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    solve(params, cis)
  File "solution.py", line 68, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 37, in make_env
    env = FrameStackWrappper(env=env, k=3, config=config)
  File "/workspace/wrappers.py", line 89, in __init__
    self.seg_model.load_state_dict(torch.load(config['use_segmentation_weight'])['state_dict'])
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 508, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 104, in default_restore_location
    result = fn(storage, location)
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 75, in _cuda_deserialize
    raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location='cpu' to map your storages to the CPU.


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11711773Amaury Camus 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4894326591386844
deviation-center-line_median0.10159491874534542
in-drivable-lane_median0.2666666666666667


other stats
deviation-center-line_max0.11559937270810716
deviation-center-line_mean0.08282191850267559
deviation-center-line_min0.02743801479716522
deviation-heading_max0.770108248316512
deviation-heading_mean0.4503493147067932
deviation-heading_median0.41209290450046726
deviation-heading_min0.0948856061765822
driven_any_max1.1983820471401816
driven_any_mean0.7767767072516831
driven_any_median0.846413340904546
driven_any_min0.16272225453819997
driven_lanedir_max0.7220398668396617
driven_lanedir_mean0.5091146229978228
driven_lanedir_min0.1532558876545953
in-drivable-lane_max0.6666666666666666
in-drivable-lane_mean0.28666666666666696
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.9499640131782666, "driven_lanedir": 0.47091672106597704, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 0.41209290450046726, "deviation-center-line": 0.10159491874534542}, "ep001": {"driven_any": 0.16272225453819997, "driven_lanedir": 0.1532558876545953, "in-drivable-lane": 0, "deviation-heading": 0.0948856061765822, "deviation-center-line": 0.02743801479716522}, "ep002": {"driven_any": 0.846413340904546, "driven_lanedir": 0.4894326591386844, "in-drivable-lane": 0.2666666666666667, "deviation-heading": 0.7386266900232743, "deviation-center-line": 0.1048251255779308}, "ep003": {"driven_any": 1.1983820471401816, "driven_lanedir": 0.7220398668396617, "in-drivable-lane": 0.5000000000000013, "deviation-heading": 0.770108248316512, "deviation-center-line": 0.11559937270810716}, "ep004": {"driven_any": 0.726401880497221, "driven_lanedir": 0.7099279802901961, "in-drivable-lane": 0, "deviation-heading": 0.23603312451712977, "deviation-center-line": 0.0646521606848293}}
No reset possible
11709773Amaury Camus 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11707773Amaury Camus 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.466666666666668


other stats
episodes
details{"ep000": {"nsteps": 49, "reward": -20.629765765104747, "good_angle": 0.4483085155065757, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 1.133333333333335}, "ep001": {"nsteps": 10, "reward": -99.75981116220356, "good_angle": 0.03589697696020486, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.1}, "ep002": {"nsteps": 44, "reward": -22.20786445858804, "good_angle": 0.4891297095591765, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0.7333333333333347}, "ep003": {"nsteps": 64, "reward": -15.322045463937684, "good_angle": 0.8550957756948183, "survival_time": 2.1333333333333355, "traveled_tiles": 2, "valid_direction": 1.0333333333333352}, "ep004": {"nsteps": 40, "reward": -24.44970727339387, "good_angle": 0.06481757410176862, "survival_time": 1.333333333333334, "traveled_tiles": 3, "valid_direction": 0.16666666666666674}}
good_angle_max0.8550957756948183
good_angle_mean0.3786497103645088
good_angle_median0.4483085155065757
good_angle_min0.03589697696020486
reward_max-15.322045463937684
reward_mean-36.473838824645576
reward_median-22.20786445858804
reward_min-99.75981116220356
survival_time_max2.1333333333333355
survival_time_mean1.3800000000000012
survival_time_min0.3333333333333333
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.133333333333335
valid_direction_mean0.6333333333333344
valid_direction_median0.7333333333333347
valid_direction_min0.1
No reset possible
11704773Amaury Camus 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessyesnutonomy-P50-22100:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
117021284Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailedyesnutonomy-P50-22100:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    solve(params, cis)
  File "solution.py", line 68, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 37, in make_env
    env = FrameStackWrappper(env=env, k=3, config=config)
  File "/workspace/wrappers.py", line 88, in __init__
    self.seg_model = linknet.LinkNet()
  File "/workspace/segmentation/models/linknet.py", line 60, in __init__
    super().__init__()
TypeError: super() takes at least 1 argument (0 given)


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
117011028Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailedyesnutonomy-P50-22100:00:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    num_stack=1)
  File "/workspace/model.py", line 246, in __init__
    self._current_obs = self._current_obs.cuda()
RuntimeError: cuda runtime error (35) : CUDA driver version is insufficient for CUDA runtime version at /tmp/pip-req-build-vRRdPa/aten/src/THC/THCGeneral.cpp:74


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116991025Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailedyesnutonomy-P50-22100:03:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 89, in solve
    observation, reward, done, info = env.step(action)
  File "/workspace/wrappers.py", line 252, in step
    return self.step_wait()
  File "/workspace/wrappers.py", line 271, in step_wait
    results = [env.step(a) for (a,env) in zip(self.actions, self.envs)]
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116981282Yun Chen 🇨🇦PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-3.0873258081766037
deviation-center-line_median0.2559979593285622
in-drivable-lane_median8.266666666666657


other stats
deviation-center-line_max0.4187552875322475
deviation-center-line_mean0.2851332970209016
deviation-center-line_min0.1852004166493986
deviation-heading_max6.573357371435327
deviation-heading_mean6.542204551597655
deviation-heading_median6.563169314377175
deviation-heading_min6.4836601307190005
driven_any_max9.896300967351102
driven_any_mean9.896300967351092
driven_any_median9.896300967351092
driven_any_min9.896300967351078
driven_lanedir_max-3.072776909304628
driven_lanedir_mean-3.09110955947329
driven_lanedir_min-3.12409729724638
in-drivable-lane_max8.366666666666664
in-drivable-lane_mean8.293333333333326
in-drivable-lane_min8.266666666666657
per-episodes
details{"ep000": {"driven_any": 9.896300967351095, "driven_lanedir": -3.0873258081766037, "in-drivable-lane": 8.366666666666664, "deviation-heading": 6.4836601307190005, "deviation-center-line": 0.35365429900431805}, "ep001": {"driven_any": 9.896300967351078, "driven_lanedir": -3.0764319574382175, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.523145373077551, "deviation-center-line": 0.2120585225899818}, "ep002": {"driven_any": 9.896300967351085, "driven_lanedir": -3.12409729724638, "in-drivable-lane": 8.266666666666657, "deviation-heading": 6.563169314377175, "deviation-center-line": 0.1852004166493986}, "ep003": {"driven_any": 9.896300967351092, "driven_lanedir": -3.072776909304628, "in-drivable-lane": 8.266666666666657, "deviation-heading": 6.573357371435327, "deviation-center-line": 0.2559979593285622}, "ep004": {"driven_any": 9.896300967351102, "driven_lanedir": -3.09491582520062, "in-drivable-lane": 8.266666666666657, "deviation-heading": 6.56769056837922, "deviation-center-line": 0.4187552875322475}}
No reset possible
116971282Yun Chen 🇨🇦PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
116951282Yun Chen 🇨🇦PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6983216043077409, "good_angle": 13.58506949141596, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.49999999999999}, "ep001": {"nsteps": 500, "reward": -0.5112751125763171, "good_angle": 13.767542808672555, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.166666666666654}, "ep002": {"nsteps": 500, "reward": -0.4195024176388979, "good_angle": 13.58530633245476, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.49999999999999}, "ep003": {"nsteps": 500, "reward": -0.5754952735861589, "good_angle": 13.722125077143692, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.066666666666656}, "ep004": {"nsteps": 500, "reward": -0.7304737878008746, "good_angle": 13.60018518200081, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.566666666666656}}
good_angle_max13.767542808672555
good_angle_mean13.652045778337556
good_angle_median13.60018518200081
good_angle_min13.58506949141596
reward_max-0.4195024176388979
reward_mean-0.5870136391819979
reward_median-0.5754952735861589
reward_min-0.7304737878008746
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max13.166666666666654
valid_direction_mean12.759999999999987
valid_direction_median12.566666666666656
valid_direction_min12.49999999999999
No reset possible
116891282Yun Chen 🇨🇦PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessyesnutonomy-P50-22100:08:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
116871180Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median8.126557886163765
deviation-center-line_median0.7883360164610101
in-drivable-lane_median2.033333333333328


other stats
deviation-center-line_max1.5417914549186893
deviation-center-line_mean0.8098481194443664
deviation-center-line_min0.07686296986761443
deviation-heading_max2.697947154642488
deviation-heading_mean1.4543503680947456
deviation-heading_median1.2668446066065062
deviation-heading_min0.2584633955642743
driven_any_max18.58118331019892
driven_any_mean10.900512333468166
driven_any_median10.548837277182646
driven_any_min1.0979515031328426
driven_lanedir_max14.122464502421249
driven_lanedir_mean8.155270918243295
driven_lanedir_min0.4163935318673986
in-drivable-lane_max3.799999999999991
in-drivable-lane_mean2.239999999999995
in-drivable-lane_min0.5333333333333333
per-episodes
details{"ep000": {"driven_any": 1.0979515031328426, "driven_lanedir": 0.4163935318673986, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 0.2584633955642743, "deviation-center-line": 0.07686296986761443}, "ep001": {"driven_any": 8.742484719831069, "driven_lanedir": 7.120545193878538, "in-drivable-lane": 1.2666666666666628, "deviation-heading": 1.0741399671164944, "deviation-center-line": 0.67062704874802}, "ep002": {"driven_any": 10.548837277182646, "driven_lanedir": 8.126557886163765, "in-drivable-lane": 2.033333333333328, "deviation-heading": 1.2668446066065062, "deviation-center-line": 0.7883360164610101}, "ep003": {"driven_any": 18.58118331019892, "driven_lanedir": 14.122464502421249, "in-drivable-lane": 3.56666666666666, "deviation-heading": 2.697947154642488, "deviation-center-line": 1.5417914549186893}, "ep004": {"driven_any": 15.532104856995344, "driven_lanedir": 10.990393476885528, "in-drivable-lane": 3.799999999999991, "deviation-heading": 1.9743567165439655, "deviation-center-line": 0.9716231072264976}}
No reset possible
116841180Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
116831180Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.43333333333331


other stats
episodes
details{"ep000": {"nsteps": 32, "reward": -31.531618369277567, "good_angle": 0.2766559011995716, "survival_time": 1.0666666666666669, "traveled_tiles": 2, "valid_direction": 0.5666666666666667}, "ep001": {"nsteps": 233, "reward": -3.783740613957299, "good_angle": 0.4240725134069262, "survival_time": 7.766666666666649, "traveled_tiles": 15, "valid_direction": 1.399999999999998}, "ep002": {"nsteps": 283, "reward": -3.1029536656817536, "good_angle": 0.4804332100576902, "survival_time": 9.43333333333331, "traveled_tiles": 18, "valid_direction": 1.5666666666666622}, "ep003": {"nsteps": 500, "reward": 0.4483896334087476, "good_angle": 1.1325425724697211, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.266666666666662}, "ep004": {"nsteps": 418, "reward": -1.92648140349705, "good_angle": 0.9783552336236568, "survival_time": 13.933333333333294, "traveled_tiles": 18, "valid_direction": 3.0666666666666584}}
good_angle_max1.1325425724697211
good_angle_mean0.6584118861515131
good_angle_median0.4804332100576902
good_angle_min0.2766559011995716
reward_max0.4483896334087476
reward_mean-7.979280883800984
reward_median-3.1029536656817536
reward_min-31.531618369277567
survival_time_max16.666666666666654
survival_time_mean9.773333333333316
survival_time_min1.0666666666666669
traveled_tiles_max18
traveled_tiles_mean14.2
traveled_tiles_median18
traveled_tiles_min2
valid_direction_max3.266666666666662
valid_direction_mean1.9733333333333296
valid_direction_median1.5666666666666622
valid_direction_min0.5666666666666667
No reset possible
116811180Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessyesnutonomy-P50-22100:09:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
11677708Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.649988991193347
deviation-center-line_median0.25885925674725396
in-drivable-lane_median0.6


other stats
deviation-center-line_max1.175794641886225
deviation-center-line_mean0.5230699865225239
deviation-center-line_min0
deviation-heading_max2.489380928085302
deviation-heading_mean1.178186429740027
deviation-heading_median0.7754795488782122
deviation-heading_min0
driven_any_max18.921651398145855
driven_any_mean8.63105437776872
driven_any_median4.040599427269344
driven_any_min0.6217772310150077
driven_lanedir_max16.12492677856342
driven_lanedir_mean7.435370408745679
driven_lanedir_min0
in-drivable-lane_max1.9999999999999931
in-drivable-lane_mean0.8266666666666644
in-drivable-lane_min0.06666666666666665
per-episodes
details{"ep000": {"driven_any": 0.6217772310150077, "driven_lanedir": 0, "in-drivable-lane": 0.6, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 16.279061300915988, "driven_lanedir": 14.258794058475912, "in-drivable-lane": 1.2999999999999965, "deviation-heading": 2.2930639287703705, "deviation-center-line": 0.9911332338990656}, "ep002": {"driven_any": 3.2921825314974056, "driven_lanedir": 3.1431422154957183, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 0.33300774296625085, "deviation-center-line": 0.18956280008007445}, "ep003": {"driven_any": 18.921651398145855, "driven_lanedir": 16.12492677856342, "in-drivable-lane": 1.9999999999999931, "deviation-heading": 2.489380928085302, "deviation-center-line": 1.175794641886225}, "ep004": {"driven_any": 4.040599427269344, "driven_lanedir": 3.649988991193347, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 0.7754795488782122, "deviation-center-line": 0.25885925674725396}}
No reset possible
11676708Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11675708Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.6666666666666634


other stats
episodes
details{"ep000": {"nsteps": 19, "reward": -54.16429551965312, "good_angle": 0.11800398015075755, "survival_time": 0.6333333333333333, "traveled_tiles": 3, "valid_direction": 0.23333333333333336}, "ep001": {"nsteps": 428, "reward": -1.7122301900689707, "good_angle": 0.6424104013051718, "survival_time": 14.266666666666628, "traveled_tiles": 18, "valid_direction": 1.699999999999996}, "ep002": {"nsteps": 87, "reward": -10.858472139178508, "good_angle": 0.04742749797514355, "survival_time": 2.8999999999999995, "traveled_tiles": 6, "valid_direction": 0.06666666666666671}, "ep003": {"nsteps": 500, "reward": 0.5446357050433289, "good_angle": 0.9721534581785936, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.4999999999999916}, "ep004": {"nsteps": 110, "reward": -8.4004887890621, "good_angle": 0.21131172421336805, "survival_time": 3.6666666666666634, "traveled_tiles": 8, "valid_direction": 0.5666666666666672}}
good_angle_max0.9721534581785936
good_angle_mean0.3982614123646069
good_angle_median0.21131172421336805
good_angle_min0.04742749797514355
reward_max0.5446357050433289
reward_mean-14.91817018658387
reward_median-8.4004887890621
reward_min-54.16429551965312
survival_time_max16.666666666666654
survival_time_mean7.626666666666655
survival_time_min0.6333333333333333
traveled_tiles_max18
traveled_tiles_mean10.6
traveled_tiles_median8
traveled_tiles_min3
valid_direction_max2.4999999999999916
valid_direction_mean1.013333333333331
valid_direction_median0.5666666666666672
valid_direction_min0.06666666666666671
No reset possible
11673708Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessyesnutonomy-P50-22100:06:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
116691063Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:04:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median14.04681817848216
deviation-center-line_median0.9076722698563474
in-drivable-lane_median0.5666666666666667


other stats
deviation-center-line_max1.0092880930537125
deviation-center-line_mean0.8069963870672325
deviation-center-line_min0.31431125075729577
deviation-heading_max1.5421563039631427
deviation-heading_mean1.0955971593327614
deviation-heading_median1.0837921528528982
deviation-heading_min0.6350371956923369
driven_any_max15.376558162844647
driven_any_mean12.720925107711068
driven_any_median14.997470487176995
driven_any_min3.438707478495325
driven_lanedir_max15.006699411525512
driven_lanedir_mean11.995991922453449
driven_lanedir_min3.127159260241255
in-drivable-lane_max1.566666666666666
in-drivable-lane_mean0.7133333333333324
in-drivable-lane_min0.2666666666666657
per-episodes
details{"ep000": {"driven_any": 14.997470487176995, "driven_lanedir": 13.557562248509369, "in-drivable-lane": 1.566666666666666, "deviation-heading": 1.1358582288981394, "deviation-center-line": 0.9076722698563474}, "ep001": {"driven_any": 14.701674168138112, "driven_lanedir": 14.04681817848216, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 1.5421563039631427, "deviation-center-line": 1.0092880930537125}, "ep002": {"driven_any": 15.09021524190026, "driven_lanedir": 14.241720513508945, "in-drivable-lane": 0.8666666666666636, "deviation-heading": 1.0811419152572896, "deviation-center-line": 0.878326468557804}, "ep003": {"driven_any": 15.376558162844647, "driven_lanedir": 15.006699411525512, "in-drivable-lane": 0.2999999999999998, "deviation-heading": 1.0837921528528982, "deviation-center-line": 0.9253838531110026}, "ep004": {"driven_any": 3.438707478495325, "driven_lanedir": 3.127159260241255, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 0.6350371956923369, "deviation-center-line": 0.31431125075729577}}
No reset possible
116681063Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
116671063Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.4347895565838553, "good_angle": 0.4443466338917107, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.666666666666665}, "ep001": {"nsteps": 500, "reward": 0.5072826606929303, "good_angle": 0.43817474015522945, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.8333333333333325}, "ep002": {"nsteps": 500, "reward": 0.45172220971575006, "good_angle": 0.3697103496019338, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.5999999999999979}, "ep003": {"nsteps": 500, "reward": 0.4634158202065155, "good_angle": 0.397207218229095, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.5666666666666647}, "ep004": {"nsteps": 121, "reward": -7.769647268928618, "good_angle": 0.21632262274245953, "survival_time": 4.033333333333329, "traveled_tiles": 6, "valid_direction": 0.4333333333333328}}
good_angle_max0.4443466338917107
good_angle_mean0.3731523129240857
good_angle_median0.397207218229095
good_angle_min0.21632262274245953
reward_max0.5072826606929303
reward_mean-1.1824874043459133
reward_median0.45172220971575006
reward_min-7.769647268928618
survival_time_max16.666666666666654
survival_time_mean14.13999999999999
survival_time_min4.033333333333329
traveled_tiles_max18
traveled_tiles_mean15.6
traveled_tiles_median18
traveled_tiles_min6
valid_direction_max0.8333333333333325
valid_direction_mean0.6199999999999986
valid_direction_median0.5999999999999979
valid_direction_min0.4333333333333328
No reset possible
116621063Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessyesnutonomy-P50-22100:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
11660993Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median10.005756087170866
deviation-center-line_median1.6081000154013436
in-drivable-lane_median7.400000000000001


other stats
deviation-center-line_max1.677726933808819
deviation-center-line_mean1.511384373097996
deviation-center-line_min1.127779847219842
deviation-heading_max2.4552742622393233
deviation-heading_mean1.6165951931750382
deviation-heading_median1.3632869473297118
deviation-heading_min0.9427627669163456
driven_any_max18.394460909582325
driven_any_mean17.996589088527646
driven_any_median18.22814420331683
driven_any_min17.14091161080204
driven_lanedir_max10.809916884797635
driven_lanedir_mean9.452281257844978
driven_lanedir_min7.121474762285747
in-drivable-lane_max9.999999999999996
in-drivable-lane_mean7.619999999999996
in-drivable-lane_min5.766666666666675
per-episodes
details{"ep000": {"driven_any": 18.39299655060013, "driven_lanedir": 10.005756087170866, "in-drivable-lane": 7.400000000000001, "deviation-heading": 1.3632869473297118, "deviation-center-line": 1.6369580848903955}, "ep001": {"driven_any": 17.14091161080204, "driven_lanedir": 10.809916884797635, "in-drivable-lane": 5.766666666666675, "deviation-heading": 2.4552742622393233, "deviation-center-line": 1.677726933808819}, "ep002": {"driven_any": 17.8264321683369, "driven_lanedir": 8.62553595095264, "in-drivable-lane": 8.433333333333328, "deviation-heading": 1.3550181562609462, "deviation-center-line": 1.6081000154013436}, "ep003": {"driven_any": 18.22814420331683, "driven_lanedir": 10.698722604018007, "in-drivable-lane": 6.499999999999988, "deviation-heading": 1.9666338331288644, "deviation-center-line": 1.5063569841695787}, "ep004": {"driven_any": 18.394460909582325, "driven_lanedir": 7.121474762285747, "in-drivable-lane": 9.999999999999996, "deviation-heading": 0.9427627669163456, "deviation-center-line": 1.127779847219842}}
No reset possible
11656993Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11655993Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.0661554240634432, "good_angle": 1.0918952658500023, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.2333333333333263}, "ep001": {"nsteps": 500, "reward": 0.008517267697956413, "good_angle": 9.607523376674427, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.56666666666667}, "ep002": {"nsteps": 500, "reward": 0.02649219364207238, "good_angle": 1.2381685037071395, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.933333333333326}, "ep003": {"nsteps": 500, "reward": 0.14323420162848197, "good_angle": 1.3783144769196234, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.2333333333333276}, "ep004": {"nsteps": 497, "reward": -2.02058232727194, "good_angle": 1.258508671232151, "survival_time": 16.56666666666665, "traveled_tiles": 18, "valid_direction": 2.633333333333358}}
good_angle_max9.607523376674427
good_angle_mean2.9148820588766693
good_angle_median1.258508671232151
good_angle_min1.0918952658500023
reward_max0.14323420162848197
reward_mean-0.3552366480479972
reward_median0.02649219364207238
reward_min-2.02058232727194
survival_time_max16.666666666666654
survival_time_mean16.646666666666654
survival_time_min16.56666666666665
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max4.56666666666667
valid_direction_mean3.1200000000000014
valid_direction_median2.933333333333326
valid_direction_min2.2333333333333263
No reset possible
11653993Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessyesnutonomy-P50-22100:12:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
116501230Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median8.595365768214046
deviation-center-line_median0.6370556018831585
in-drivable-lane_median0.8666666666666638


other stats
deviation-center-line_max1.183996685872265
deviation-center-line_mean0.636318502981476
deviation-center-line_min0.1850088590535753
deviation-heading_max2.83484736798613
deviation-heading_mean1.5030751731511458
deviation-heading_median1.3884872114409543
deviation-heading_min0.3858858070178766
driven_any_max18.941215905863785
driven_any_mean10.453235911479773
driven_any_median10.63083668712228
driven_any_min2.8314755006912917
driven_lanedir_max16.49764953509191
driven_lanedir_mean9.0718025662003
driven_lanedir_min2.5103833261282427
in-drivable-lane_max1.6333333333333293
in-drivable-lane_mean0.926666666666664
in-drivable-lane_min0.2000000000000005
per-episodes
details{"ep000": {"driven_any": 10.63083668712228, "driven_lanedir": 8.595365768214046, "in-drivable-lane": 1.6333333333333293, "deviation-heading": 1.3884872114409543, "deviation-center-line": 0.6370556018831585}, "ep001": {"driven_any": 2.8314755006912917, "driven_lanedir": 2.5103833261282427, "in-drivable-lane": 0.2000000000000005, "deviation-heading": 0.3858858070178766, "deviation-center-line": 0.1850088590535753}, "ep002": {"driven_any": 14.44854344507617, "driven_lanedir": 12.996832639225907, "in-drivable-lane": 0.8666666666666638, "deviation-heading": 1.9339500582463804, "deviation-center-line": 0.8569148276208011}, "ep003": {"driven_any": 18.941215905863785, "driven_lanedir": 16.49764953509191, "in-drivable-lane": 1.566666666666661, "deviation-heading": 2.83484736798613, "deviation-center-line": 1.183996685872265}, "ep004": {"driven_any": 5.414108018645329, "driven_lanedir": 4.758781562341394, "in-drivable-lane": 0.3666666666666658, "deviation-heading": 0.972205421064388, "deviation-center-line": 0.31861654047757987}}
No reset possible
116471230Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
116451230Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:04:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.43333333333331


other stats
episodes
details{"ep000": {"nsteps": 283, "reward": -2.915378145004751, "good_angle": 0.4826002875371561, "survival_time": 9.43333333333331, "traveled_tiles": 18, "valid_direction": 1.1666666666666634}, "ep001": {"nsteps": 76, "reward": -12.5520231558108, "good_angle": 0.0912671905640154, "survival_time": 2.533333333333334, "traveled_tiles": 6, "valid_direction": 0.2666666666666666}, "ep002": {"nsteps": 379, "reward": -1.9871136692394369, "good_angle": 0.4523153475328166, "survival_time": 12.6333333333333, "traveled_tiles": 18, "valid_direction": 1.199999999999996}, "ep003": {"nsteps": 500, "reward": 0.6010044494001194, "good_angle": 0.92725251733234, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.2999999999999927}, "ep004": {"nsteps": 146, "reward": -6.197705786126628, "good_angle": 0.27483451760132255, "survival_time": 4.866666666666659, "traveled_tiles": 10, "valid_direction": 0.7666666666666673}}
good_angle_max0.92725251733234
good_angle_mean0.4456539721135301
good_angle_median0.4523153475328166
good_angle_min0.0912671905640154
reward_max0.6010044494001194
reward_mean-4.6102432613563
reward_median-2.915378145004751
reward_min-12.5520231558108
survival_time_max16.666666666666654
survival_time_mean9.22666666666665
survival_time_min2.533333333333334
traveled_tiles_max18
traveled_tiles_mean14
traveled_tiles_median18
traveled_tiles_min6
valid_direction_max2.2999999999999927
valid_direction_mean1.1399999999999972
valid_direction_median1.1666666666666634
valid_direction_min0.2666666666666666
No reset possible
116431130Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.663409162314039
deviation-center-line_median1.0612472343933563
in-drivable-lane_median8.833333333333318


other stats
deviation-center-line_max1.401269739969896
deviation-center-line_mean0.7884589010907086
deviation-center-line_min0.007856314885005013
deviation-heading_max1.1848705836617026
deviation-heading_mean0.7840153797271846
deviation-heading_median0.8411558732319876
deviation-heading_min0.13181425539914898
driven_any_max18.124192822728176
driven_any_mean11.924071464682562
driven_any_median17.629920240170325
driven_any_min0.3911771269756336
driven_lanedir_max8.371565852974433
driven_lanedir_mean4.732890916645016
driven_lanedir_min0.01999778637541394
in-drivable-lane_max11.366666666666656
in-drivable-lane_mean6.599999999999994
in-drivable-lane_min0.3333333333333333
per-episodes
details{"ep000": {"driven_any": 0.3911771269756336, "driven_lanedir": 0.01999778637541394, "in-drivable-lane": 0.3333333333333333, "deviation-heading": 0.13181425539914898, "deviation-center-line": 0.007856314885005013}, "ep001": {"driven_any": 18.124192822728176, "driven_lanedir": 8.371565852974433, "in-drivable-lane": 8.833333333333318, "deviation-heading": 1.1848705836617026, "deviation-center-line": 1.401269739969896}, "ep002": {"driven_any": 18.091447701556945, "driven_lanedir": 5.663409162314039, "in-drivable-lane": 11.366666666666656, "deviation-heading": 0.6645769191251764, "deviation-center-line": 1.0612472343933563}, "ep003": {"driven_any": 17.629920240170325, "driven_lanedir": 7.093068501592293, "in-drivable-lane": 9.966666666666672, "deviation-heading": 1.0976592672179073, "deviation-center-line": 1.1126017854830113}, "ep004": {"driven_any": 5.383619431981734, "driven_lanedir": 2.5164132799688996, "in-drivable-lane": 2.499999999999993, "deviation-heading": 0.8411558732319876, "deviation-center-line": 0.3593194307222744}}
No reset possible
116411130Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
116381130Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 14, "reward": -72.51461522706917, "good_angle": 0.28368331814076037, "survival_time": 0.4666666666666666, "traveled_tiles": 1, "valid_direction": 0.16666666666666663}, "ep001": {"nsteps": 500, "reward": -0.08438617479684762, "good_angle": 7.628796397301995, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 3.0999999999999943}, "ep002": {"nsteps": 500, "reward": -0.08525809818215202, "good_angle": 0.9848975443345735, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.3666666666666787}, "ep003": {"nsteps": 500, "reward": -0.024619236998260022, "good_angle": 1.4658703775027382, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.366666666666658}, "ep004": {"nsteps": 160, "reward": -6.239929569553351, "good_angle": 1.8274793817079649, "survival_time": 5.333333333333324, "traveled_tiles": 9, "valid_direction": 1.7333333333333305}}
good_angle_max7.628796397301995
good_angle_mean2.4381454037976065
good_angle_median1.4658703775027382
good_angle_min0.28368331814076037
reward_max-0.024619236998260022
reward_mean-15.789761661319956
reward_median-0.08525809818215202
reward_min-72.51461522706917
survival_time_max16.666666666666654
survival_time_mean11.15999999999999
survival_time_min0.4666666666666666
traveled_tiles_max18
traveled_tiles_mean12.6
traveled_tiles_median17
traveled_tiles_min1
valid_direction_max3.366666666666658
valid_direction_mean2.1466666666666656
valid_direction_median2.3666666666666787
valid_direction_min0.16666666666666663
No reset possible
116351198Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:05:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.6339321558474529
deviation-center-line_median0.08832090382040693
in-drivable-lane_median0.03333333333333344


other stats
deviation-center-line_max0.23189092556536417
deviation-center-line_mean0.11113467855551488
deviation-center-line_min0.0493324175266581
deviation-heading_max0.664734358006609
deviation-heading_mean0.33438028671918996
deviation-heading_median0.2005531147089086
deviation-heading_min0.14781140011884525
driven_any_max3.960418039899692
driven_any_mean2.1461611773439966
driven_any_median1.7629023822304646
driven_any_min1.332905952132023
driven_lanedir_max3.494532077430746
driven_lanedir_mean1.814299016798802
driven_lanedir_min0.9775004353847286
in-drivable-lane_max0.6
in-drivable-lane_mean0.2266666666666664
in-drivable-lane_min0.033333333333333326
per-episodes
details{"ep000": {"driven_any": 1.7004617882567308, "driven_lanedir": 0.9775004353847286, "in-drivable-lane": 0.6, "deviation-heading": 0.1996741317897834, "deviation-center-line": 0.08179572771024624}, "ep001": {"driven_any": 3.960418039899692, "driven_lanedir": 3.494532077430746, "in-drivable-lane": 0.433333333333332, "deviation-heading": 0.4591284289718035, "deviation-center-line": 0.23189092556536417}, "ep002": {"driven_any": 1.332905952132023, "driven_lanedir": 1.2788972652322586, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.14781140011884525, "deviation-center-line": 0.0493324175266581}, "ep003": {"driven_any": 1.7629023822304646, "driven_lanedir": 1.6866331500988256, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.2005531147089086, "deviation-center-line": 0.08832090382040693}, "ep004": {"driven_any": 1.974117724201072, "driven_lanedir": 1.6339321558474529, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.664734358006609, "deviation-center-line": 0.10433341815489884}}
No reset possible
115021305Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessyesnutonomy-P50-22100:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
114911315Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step4-vizsuccessnonutonomy-P50-22100:03:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.3378890650867185
in-drivable-lane_median1.8999999999999932


other stats
deviation-center-line_max0.6249893652488475
deviation-center-line_mean0.3790846662487543
deviation-center-line_min0
deviation-heading_max3.6562203588904807
deviation-heading_mean1.4428103732926094
deviation-heading_median1.415395960196689
deviation-heading_min0
driven_any_max1.9703705492982295
driven_any_mean1.3360169203542234
driven_any_median1.7108580662901212
driven_any_min0.5188179320442029
driven_lanedir_max1.6365359355436335
driven_lanedir_mean1.0286685967752154
driven_lanedir_median1.3646177896194496
driven_lanedir_min0
in-drivable-lane_max3.766666666666663
in-drivable-lane_mean1.6866666666666623
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5188179320442029, "driven_lanedir": 0, "in-drivable-lane": 3.766666666666663, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.5749945831073451, "driven_lanedir": 0.5720228115990373, "in-drivable-lane": 0, "deviation-heading": 0.41342655124167904, "deviation-center-line": 0.336848352064663}, "ep002": {"driven_any": 1.7108580662901212, "driven_lanedir": 1.3646177896194496, "in-drivable-lane": 1.8999999999999932, "deviation-heading": 1.7290089961341986, "deviation-center-line": 0.6249893652488475}, "ep003": {"driven_any": 1.9703705492982295, "driven_lanedir": 1.6365359355436335, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.6562203588904807, "deviation-center-line": 0.5956965488435425}, "ep004": {"driven_any": 1.9050434710312183, "driven_lanedir": 1.5701664471139567, "in-drivable-lane": 2.033333333333326, "deviation-heading": 1.415395960196689, "deviation-center-line": 0.3378890650867185}}
No reset possible
114751314Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videossuccessyesnutonomy-P50-22100:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
114651314Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-22100:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
114631312Dzenan LapandicLFV bd testaido1_LFV_r1-v3step1-simulationfailednonutonomy-P50-22100:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 135, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Cannot feed value of shape (69120,) for Tensor u'prefix/x:0', which has shape '(?, 69120)'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
114501311Eric LuBaseline solution using imitation learning from logsaido1_LF1_r3-v3step4-vizsuccessyesnutonomy-P50-22100:03:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9416561670905276
deviation-center-line_median0.540761310128989
in-drivable-lane_median0


other stats
deviation-center-line_max0.6389587328499635
deviation-center-line_mean0.4480637209085062
deviation-center-line_min0.2400532719566701
deviation-heading_max2.465432973056526
deviation-heading_mean1.1269488446963405
deviation-heading_median0.5589910206302408
deviation-heading_min0.22625715490875273
driven_any_max1.5995030543304736
driven_any_mean0.839350760798073
driven_any_median0.9433962123243518
driven_any_min0.2872888293531643
driven_lanedir_max1.2558915250969411
driven_lanedir_mean0.725457608248637
driven_lanedir_min0.13714237385733197
in-drivable-lane_max2.2666666666666586
in-drivable-lane_mean0.5999999999999984
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3571705831808648, "driven_lanedir": 0.13714237385733197, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 2.465432973056526, "deviation-center-line": 0.2400532719566701}, "ep001": {"driven_any": 0.2872888293531643, "driven_lanedir": 0.2860649316355759, "in-drivable-lane": 0, "deviation-heading": 0.22625715490875273, "deviation-center-line": 0.27297608848005095}, "ep002": {"driven_any": 0.9433962123243518, "driven_lanedir": 0.9416561670905276, "in-drivable-lane": 0, "deviation-heading": 0.4000488034460432, "deviation-center-line": 0.6389587328499635}, "ep003": {"driven_any": 1.0093951248015105, "driven_lanedir": 1.006533043562809, "in-drivable-lane": 0, "deviation-heading": 0.5589910206302408, "deviation-center-line": 0.540761310128989}, "ep004": {"driven_any": 1.5995030543304736, "driven_lanedir": 1.2558915250969411, "in-drivable-lane": 2.2666666666666586, "deviation-heading": 1.9840142714401383, "deviation-center-line": 0.5475692011268571}}
No reset possible
114381311Eric LuBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessyesnutonomy-P50-22100:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.166666666666648


other stats
episodes
details{"ep000": {"nsteps": 94, "reward": -10.901446696190025, "good_angle": 1.5535384000988208, "survival_time": 3.133333333333332, "traveled_tiles": 1, "valid_direction": 2.633333333333332}, "ep001": {"nsteps": 76, "reward": -13.723119527101517, "good_angle": 0.021566788071447456, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 245, "reward": -4.524834315630854, "good_angle": 0.2689719162688768, "survival_time": 8.166666666666648, "traveled_tiles": 3, "valid_direction": 0.9333333333333308}, "ep003": {"nsteps": 262, "reward": -4.10099546995213, "good_angle": 0.05018420306392457, "survival_time": 8.733333333333313, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 414, "reward": -3.058105362804183, "good_angle": 22.692844975675257, "survival_time": 13.799999999999962, "traveled_tiles": 3, "valid_direction": 4.7333333333333165}}
good_angle_max22.692844975675257
good_angle_mean4.917421256635665
good_angle_median0.2689719162688768
good_angle_min0.021566788071447456
reward_max-3.058105362804183
reward_mean-7.261700274335742
reward_median-4.524834315630854
reward_min-13.723119527101517
survival_time_max13.799999999999962
survival_time_mean7.273333333333317
survival_time_min2.533333333333334
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.7333333333333165
valid_direction_mean1.659999999999996
valid_direction_median0.9333333333333308
valid_direction_min0
No reset possible
114211310Dzenan LapandicLFV bd testaido1_LFV_r1-v3step4-vizsuccessnonutonomy-P50-22100:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.4860439055104576
in-drivable-lane_median0.6666666666666643


other stats
deviation-center-line_max0.7352790073919259
deviation-center-line_mean0.4132899075804614
deviation-center-line_min0
deviation-heading_max3.6712254670665954
deviation-heading_mean1.5493618297080047
deviation-heading_median0.4275030063573503
deviation-heading_min0
driven_any_max1.968001720249298
driven_any_mean1.1297984485989332
driven_any_median0.6776698547049419
driven_any_min0.5164112085905408
driven_lanedir_max1.6137602025986817
driven_lanedir_mean0.8897962606655522
driven_lanedir_median0.6768511403526383
driven_lanedir_min0
in-drivable-lane_max3.73333333333333
in-drivable-lane_mean1.0399999999999985
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5164112085905408, "driven_lanedir": 0, "in-drivable-lane": 3.73333333333333, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.5733910692659218, "driven_lanedir": 0.5699561142457155, "in-drivable-lane": 0, "deviation-heading": 0.4275030063573503, "deviation-center-line": 0.318983432802134}, "ep002": {"driven_any": 0.6776698547049419, "driven_lanedir": 0.6768511403526383, "in-drivable-lane": 0, "deviation-heading": 0.22805911468263593, "deviation-center-line": 0.4860439055104576}, "ep003": {"driven_any": 1.968001720249298, "driven_lanedir": 1.6137602025986817, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 3.420021560433443, "deviation-center-line": 0.7352790073919259}, "ep004": {"driven_any": 1.913518390183964, "driven_lanedir": 1.5884138461307251, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 3.6712254670665954, "deviation-center-line": 0.5261431921977897}}
No reset possible
114051310Dzenan LapandicLFV bd testaido1_LFV_r1-v3step1-simulationsuccessnonutonomy-P50-22100:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible