Duckietown Challenges Home Challenges Submissions

Evaluator 321

ID321
evaluatorrudolf-8
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processrudolf-8
versionDC:3.1.56;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success452 5983
# timeout3 6191
# failed58 6014
# error22 6738
# aborted49 5974
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
10650195Florian GolemoPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornorudolf-80:10:46
Timeout: Waited 602 [...]
Timeout:

Waited 602.447764158 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
106427Andrea Censi 🇨🇭nullaido1_LF1-v3step2-scoringsuccessyesrudolf-80:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-19.653960217009168


other stats
ep000
details{"nsteps": 78, "reward": -13.883831298935451}
ep001
details{"nsteps": 104, "reward": -10.162069983522928}
ep002
details{"nsteps": 16, "reward": -63.68936010450125}
ep003
details{"nsteps": 191, "reward": -5.522420469842149}
ep004
details{"nsteps": 231, "reward": -5.01211922824407}
No reset possible
10640144Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:14
Error while running [...]

Creating job10640-4781_solution_1  ... error
stderr | ERROR: for job10640-4781_solution_1  Cannot start service solution: network job10640-4781_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job10640-4781_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job10640-4781_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10636220Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10624210Andrea Censi 🇨🇭Python templateaido1_amod_service_quality_r1-v3step2-scoringsuccessyesrudolf-80:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-32.518643881660594


other stats
efficiency-63.427135526639645
fleet_size-1000000000
No reset possible
10621274Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10616276Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:32
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10614277Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:31
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10613278Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:41
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10610267Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationfailednorudolf-80:02:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10604298Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10600314Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10595318Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10591323Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:35
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10585307Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationfailednorudolf-80:02:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10581310Andrea Censi 🇨🇭Tensorflow templateaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:31
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10575346Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.1999999999999984


other stats
episodes
details{"ep000": {"nsteps": 167, "reward": -6.515347850733454, "good_angle": 2.532258188954429, "survival_time": 5.566666666666657, "traveled_tiles": 2, "valid_direction": 3.199999999999992}, "ep001": {"nsteps": 103, "reward": -10.640297905523871, "good_angle": 2.650111377593275, "survival_time": 3.433333333333331, "traveled_tiles": 1, "valid_direction": 2.599999999999998}, "ep002": {"nsteps": 96, "reward": -11.343306209426371, "good_angle": 2.520034595090713, "survival_time": 3.1999999999999984, "traveled_tiles": 2, "valid_direction": 2.533333333333331}, "ep003": {"nsteps": 95, "reward": -11.461269298437248, "good_angle": 2.2344889091875815, "survival_time": 3.166666666666665, "traveled_tiles": 2, "valid_direction": 2.466666666666665}, "ep004": {"nsteps": 95, "reward": -11.476688610899606, "good_angle": 2.4523413910134386, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.5999999999999988}}
good_angle_max2.650111377593275
good_angle_mean2.4778468923678876
good_angle_median2.520034595090713
good_angle_min2.2344889091875815
reward_max-6.515347850733454
reward_mean-10.287381975004111
reward_median-11.343306209426371
reward_min-11.476688610899606
survival_time_max5.566666666666657
survival_time_mean3.7066666666666626
survival_time_min3.166666666666665
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.199999999999992
valid_direction_mean2.679999999999997
valid_direction_median2.599999999999998
valid_direction_min2.466666666666665
No reset possible
10539352Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornorudolf-80:10:39
Timeout: Waited 603 [...]
Timeout:

Waited 603.38222599 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10523372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:04:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.90146014334538
deviation-center-line_median0.7051719247045396
in-drivable-lane_median0.5666666666666647


other stats
deviation-center-line_max0.73525265652992
deviation-center-line_mean0.4934778291428813
deviation-center-line_min0.154475459914071
deviation-heading_max2.5808584629362796
deviation-heading_mean1.7025688076349863
deviation-heading_median2.280715200941565
deviation-heading_min0.4298536718342264
driven_any_max5.567882768422871
driven_any_mean3.640816551748074
driven_any_median5.501103322955828
driven_any_min0.5194813241888642
driven_lanedir_max5.140171956805595
driven_lanedir_mean3.335695621153274
driven_lanedir_min0.4894174580961612
in-drivable-lane_max1.2333333333333307
in-drivable-lane_mean0.4733333333333327
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.567882768422871, "driven_lanedir": 4.90146014334538, "in-drivable-lane": 1.2333333333333307, "deviation-heading": 2.543258458850417, "deviation-center-line": 0.73525265652992}, "ep001": {"driven_any": 0.5194813241888642, "driven_lanedir": 0.4894174580961612, "in-drivable-lane": 0, "deviation-heading": 0.4298536718342264, "deviation-center-line": 0.154475459914071}, "ep002": {"driven_any": 5.527212308344548, "driven_lanedir": 5.140171956805595, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 2.5808584629362796, "deviation-center-line": 0.7051719247045396}, "ep003": {"driven_any": 5.501103322955828, "driven_lanedir": 5.109747883104452, "in-drivable-lane": 0.5666666666666682, "deviation-heading": 2.280715200941565, "deviation-center-line": 0.705362902111649}, "ep004": {"driven_any": 1.0884030348282592, "driven_lanedir": 1.0376806644147825, "in-drivable-lane": 0, "deviation-heading": 0.678158243612445, "deviation-center-line": 0.1671262024542268}}
No reset possible
10501358Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:04:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10496361Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 96, in run
    solve(params, cis)
  File "solution.py", line 28, in solve
    env = gym.make(params['env'])
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
    return registry.make(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
    spec = self.spec(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
    raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10467396Anna Tsalapova 🇷🇺simple submitionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:06:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7199114328934264
deviation-center-line_median0.725651349029092
in-drivable-lane_median0


other stats
deviation-center-line_max1.610356179034906
deviation-center-line_mean0.8676533233647288
deviation-center-line_min0.4922185378333373
deviation-heading_max4.100867133286692
deviation-heading_mean1.339475690890793
deviation-heading_median1.1240165941114446
deviation-heading_min0.07942104943374231
driven_any_max6.6400000000001045
driven_any_mean6.640000000000072
driven_any_median6.640000000000084
driven_any_min6.640000000000005
driven_lanedir_max1.4933261824878092
driven_lanedir_mean0.6576413857612371
driven_lanedir_min0.0905657460899354
in-drivable-lane_max9.266666666666666
in-drivable-lane_mean1.853333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.6400000000001045, "driven_lanedir": 0.0905657460899354, "in-drivable-lane": 9.266666666666666, "deviation-heading": 4.100867133286692, "deviation-center-line": 0.8693818689862097}, "ep001": {"driven_any": 6.640000000000089, "driven_lanedir": 0.15960164900917606, "in-drivable-lane": 0, "deviation-heading": 1.1259174092607342, "deviation-center-line": 1.610356179034906}, "ep002": {"driven_any": 6.640000000000005, "driven_lanedir": 0.7199114328934264, "in-drivable-lane": 0, "deviation-heading": 0.2671562683613517, "deviation-center-line": 0.725651349029092}, "ep003": {"driven_any": 6.640000000000079, "driven_lanedir": 1.4933261824878092, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374231, "deviation-center-line": 0.6406586819400985}, "ep004": {"driven_any": 6.640000000000084, "driven_lanedir": 0.8248019183258386, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4922185378333373}}
No reset possible
10461394Maxim Kuzmin 🇷🇺Random executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10460389Liam Paull 🇨🇦Random executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.033333333333322


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -12.447351276707018, "good_angle": 1.1967750039344058, "survival_time": 2.7333333333333334, "traveled_tiles": 1, "valid_direction": 2.2666666666666666}, "ep001": {"nsteps": 71, "reward": -14.639062543570155, "good_angle": 0.017324975166457812, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 254, "reward": -4.4034986792234925, "good_angle": 0.8565531852118433, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 2.133333333333326}, "ep003": {"nsteps": 181, "reward": -5.833100949655909, "good_angle": 0.04835601409665441, "survival_time": 6.033333333333322, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 349, "reward": -3.627784583200387, "good_angle": 20.93582839974029, "survival_time": 11.633333333333304, "traveled_tiles": 3, "valid_direction": 4.066666666666653}}
good_angle_max20.93582839974029
good_angle_mean4.61096751562993
good_angle_median0.8565531852118433
good_angle_min0.017324975166457812
reward_max-3.627784583200387
reward_mean-8.190159606471394
reward_median-5.833100949655909
reward_min-14.639062543570155
survival_time_max11.633333333333304
survival_time_mean6.246666666666654
survival_time_min2.366666666666668
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.066666666666653
valid_direction_mean1.6933333333333294
valid_direction_median2.133333333333326
valid_direction_min0
No reset possible
10442389Liam Paull 🇨🇦Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10439390Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 89, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: error loading <rosparam> tag: 
	'param' attribute must be set for non-dictionary values
XML is <rosparam command="load" file="$(find duckietown)/config/$(arg config)/$(arg pkg_name)/$(arg node_name)/$(arg param_file_name).yaml"/>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10430408Liam Paull 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.44925438365391246
deviation-center-line_median0.19184260551389337
in-drivable-lane_median0.93333333333333


other stats
deviation-center-line_max0.21499427070334703
deviation-center-line_mean0.19105452781037696
deviation-center-line_min0.16161244156915627
deviation-heading_max1.80467274352445
deviation-heading_mean1.0577189586038267
deviation-heading_median0.8885177028568302
deviation-heading_min0.7888337227186529
driven_any_max1.3144558820753884
driven_any_mean0.8219965215009255
driven_any_median0.8179743971939148
driven_any_min0.3651265696119332
driven_lanedir_max0.5123629236493137
driven_lanedir_mean0.4001899550982008
driven_lanedir_min0.13432825859850617
in-drivable-lane_max2.5333333333333243
in-drivable-lane_mean1.3199999999999958
in-drivable-lane_min0.7
per-episodes
details{"ep000": {"driven_any": 0.3651265696119332, "driven_lanedir": 0.13432825859850617, "in-drivable-lane": 0.7, "deviation-heading": 1.80467274352445, "deviation-center-line": 0.18105332681358047}, "ep001": {"driven_any": 0.8179743971939148, "driven_lanedir": 0.49597082701145534, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 0.7888337227186529, "deviation-center-line": 0.16161244156915627}, "ep002": {"driven_any": 1.3144558820753884, "driven_lanedir": 0.5123629236493137, "in-drivable-lane": 2.5333333333333243, "deviation-heading": 0.8885177028568302, "deviation-center-line": 0.2057699944519077}, "ep003": {"driven_any": 0.8453787226807243, "driven_lanedir": 0.44925438365391246, "in-drivable-lane": 1.6666666666666607, "deviation-heading": 0.8242202630294022, "deviation-center-line": 0.19184260551389337}, "ep004": {"driven_any": 0.7670470359426664, "driven_lanedir": 0.4090333825778161, "in-drivable-lane": 0.93333333333333, "deviation-heading": 0.9823503608897984, "deviation-center-line": 0.21499427070334703}}
No reset possible
10423408Liam Paull 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10414398Maxim Kuzmin 🇷🇺Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10407413Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3235387812428736
deviation-center-line_median0.2947037840571556
in-drivable-lane_median0


other stats
deviation-center-line_max0.38084959575902566
deviation-center-line_mean0.28695588281313233
deviation-center-line_min0.19749271513518848
deviation-heading_max1.8182135539902105
deviation-heading_mean0.7834754480568994
deviation-heading_median0.6058671143521374
deviation-heading_min0.2780384131493271
driven_any_max0.5571531470232228
driven_any_mean0.3892984658640638
driven_any_median0.4035879721763577
driven_any_min0.22857405338614237
driven_lanedir_max0.42261960561619616
driven_lanedir_mean0.3294932122933532
driven_lanedir_min0.21248677610692912
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5571531470232228, "driven_lanedir": 0.29218391847235714, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8182135539902105, "deviation-center-line": 0.21336596779236425}, "ep001": {"driven_any": 0.32502330805147445, "driven_lanedir": 0.3235387812428736, "in-drivable-lane": 0, "deviation-heading": 0.2780384131493271, "deviation-center-line": 0.34836735132192787}, "ep002": {"driven_any": 0.4321538486831214, "driven_lanedir": 0.42261960561619616, "in-drivable-lane": 0, "deviation-heading": 0.595309395154838, "deviation-center-line": 0.38084959575902566}, "ep003": {"driven_any": 0.4035879721763577, "driven_lanedir": 0.39663698002841, "in-drivable-lane": 0, "deviation-heading": 0.619948763637984, "deviation-center-line": 0.2947037840571556}, "ep004": {"driven_any": 0.22857405338614237, "driven_lanedir": 0.21248677610692912, "in-drivable-lane": 0, "deviation-heading": 0.6058671143521374, "deviation-center-line": 0.19749271513518848}}
No reset possible
10400413Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10395415Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3769760892911904
deviation-center-line_median0.16380911777651364
in-drivable-lane_median0.4333333333333333


other stats
deviation-center-line_max0.810331400315488
deviation-center-line_mean0.3320160186454652
deviation-center-line_min0.11698729227224706
deviation-heading_max3.192352564791687
deviation-heading_mean1.5023797276008062
deviation-heading_median1.415071203092385
deviation-heading_min0.31129214846929393
driven_any_max1.6427952027360038
driven_any_mean0.7748467672309275
driven_any_median0.3877749658377253
driven_any_min0.3474199409904621
driven_lanedir_max1.1056482081282408
driven_lanedir_mean0.5362622784665524
driven_lanedir_min0.1084568394842671
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean0.6399999999999981
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3474199409904621, "driven_lanedir": 0.1084568394842671, "in-drivable-lane": 0.4333333333333333, "deviation-heading": 1.415071203092385, "deviation-center-line": 0.12220814824528124}, "ep001": {"driven_any": 1.1180869487871548, "driven_lanedir": 0.7197986081831711, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 3.192352564791687, "deviation-center-line": 0.4467441346177961}, "ep002": {"driven_any": 0.3781567778032916, "driven_lanedir": 0.37043164724589217, "in-drivable-lane": 0, "deviation-heading": 0.31129214846929393, "deviation-center-line": 0.16380911777651364}, "ep003": {"driven_any": 0.3877749658377253, "driven_lanedir": 0.3769760892911904, "in-drivable-lane": 0, "deviation-heading": 0.3620734415833803, "deviation-center-line": 0.11698729227224706}, "ep004": {"driven_any": 1.6427952027360038, "driven_lanedir": 1.1056482081282408, "in-drivable-lane": 1.999999999999993, "deviation-heading": 2.231109280067286, "deviation-center-line": 0.810331400315488}}
No reset possible
10392415Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10390415Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.0000000000000027


other stats
episodes
details{"ep000": {"nsteps": 52, "reward": -19.492186276425716, "good_angle": 1.0732540086690283, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 1.3666666666666687}, "ep001": {"nsteps": 179, "reward": -6.9835600735562435, "good_angle": 14.77415585075768, "survival_time": 5.966666666666655, "traveled_tiles": 2, "valid_direction": 3.699999999999987}, "ep002": {"nsteps": 60, "reward": -17.080987996359667, "good_angle": 0.08539281996571596, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 0.16666666666666718}, "ep003": {"nsteps": 60, "reward": -16.940115308078628, "good_angle": 0.10383977011306968, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 0.2666666666666675}, "ep004": {"nsteps": 252, "reward": -4.84021424375371, "good_angle": 18.04912107860404, "survival_time": 8.39999999999998, "traveled_tiles": 3, "valid_direction": 3.533333333333323}}
good_angle_max18.04912107860404
good_angle_mean6.817152705621908
good_angle_median1.0732540086690283
good_angle_min0.08539281996571596
reward_max-4.84021424375371
reward_mean-13.067412779634791
reward_median-16.940115308078628
reward_min-19.492186276425716
survival_time_max8.39999999999998
survival_time_mean4.019999999999995
survival_time_min1.7333333333333354
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.699999999999987
valid_direction_mean1.8066666666666624
valid_direction_median1.3666666666666687
valid_direction_min0.16666666666666718
No reset possible
10380415Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10373423Mandana Samiei 🇨🇦PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6333987002445782
deviation-center-line_median0.3033553220229705
in-drivable-lane_median3.133333333333322


other stats
deviation-center-line_max0.4765605666657709
deviation-center-line_mean0.30541213049809846
deviation-center-line_min0.160181595525173
deviation-heading_max3.121451308738927
deviation-heading_mean1.6407500107201838
deviation-heading_median1.2548610621885627
deviation-heading_min0.9268585954133246
driven_any_max1.28661647740315
driven_any_mean1.0439989343002518
driven_any_median1.1582934069035022
driven_any_min0.37376718399202497
driven_lanedir_max0.6672206730251327
driven_lanedir_mean0.5332215693001757
driven_lanedir_min0.15499945497572354
in-drivable-lane_max4.7333333333333165
in-drivable-lane_mean2.933333333333324
in-drivable-lane_min0.6333333333333335
per-episodes
details{"ep000": {"driven_any": 0.37376718399202497, "driven_lanedir": 0.15499945497572354, "in-drivable-lane": 0.6333333333333335, "deviation-heading": 1.8956137175387109, "deviation-center-line": 0.160181595525173}, "ep001": {"driven_any": 1.1323043144199048, "driven_lanedir": 0.6398056136455954, "in-drivable-lane": 3.133333333333322, "deviation-heading": 1.2548610621885627, "deviation-center-line": 0.3084348267549812}, "ep002": {"driven_any": 1.2690132887826768, "driven_lanedir": 0.6672206730251327, "in-drivable-lane": 2.8333333333333233, "deviation-heading": 3.121451308738927, "deviation-center-line": 0.4765605666657709}, "ep003": {"driven_any": 1.28661647740315, "driven_lanedir": 0.570683404609849, "in-drivable-lane": 4.7333333333333165, "deviation-heading": 0.9268585954133246, "deviation-center-line": 0.3033553220229705}, "ep004": {"driven_any": 1.1582934069035022, "driven_lanedir": 0.6333987002445782, "in-drivable-lane": 3.3333333333333215, "deviation-heading": 1.004965369721394, "deviation-center-line": 0.278528341521597}}
No reset possible
10365423Mandana Samiei 🇨🇦PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10362423Mandana Samiei 🇨🇦PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.899999999999985


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.918751453025903, "good_angle": 1.3018314886569209, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 200, "reward": -6.687302901349031, "good_angle": 18.738705303944315, "survival_time": 6.666666666666653, "traveled_tiles": 2, "valid_direction": 4.799999999999984}, "ep002": {"nsteps": 243, "reward": -4.599489883993035, "good_angle": 2.936930452820176, "survival_time": 8.099999999999982, "traveled_tiles": 3, "valid_direction": 4.999999999999988}, "ep003": {"nsteps": 239, "reward": -5.388512962860168, "good_angle": 0.9911362133047612, "survival_time": 7.966666666666648, "traveled_tiles": 3, "valid_direction": 5.399999999999984}, "ep004": {"nsteps": 207, "reward": -5.90643233768327, "good_angle": 1.5652349115929982, "survival_time": 6.899999999999985, "traveled_tiles": 3, "valid_direction": 4.633333333333317}}
good_angle_max18.738705303944315
good_angle_mean5.106767674063834
good_angle_median1.5652349115929982
good_angle_min0.9911362133047612
reward_max-4.599489883993035
reward_mean-7.100097907782282
reward_median-5.90643233768327
reward_min-12.918751453025903
survival_time_max8.099999999999982
survival_time_mean6.453333333333321
survival_time_min2.6333333333333337
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max5.399999999999984
valid_direction_mean4.413333333333322
valid_direction_median4.799999999999984
valid_direction_min2.2333333333333334
No reset possible
10357426Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10354426Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.133333333333315


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -13.619904056129355, "good_angle": 1.296344350450928, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.000000000000001}, "ep001": {"nsteps": 200, "reward": -6.67220719177858, "good_angle": 19.33263181642809, "survival_time": 6.666666666666653, "traveled_tiles": 2, "valid_direction": 5.499999999999986}, "ep002": {"nsteps": 248, "reward": -4.533551920119921, "good_angle": 3.2297073074693565, "survival_time": 8.266666666666648, "traveled_tiles": 4, "valid_direction": 5.233333333333316}, "ep003": {"nsteps": 244, "reward": -5.259607985593783, "good_angle": 0.9615504649098168, "survival_time": 8.133333333333315, "traveled_tiles": 3, "valid_direction": 5.166666666666651}, "ep004": {"nsteps": 259, "reward": -4.950044048173375, "good_angle": 11.964128500622458, "survival_time": 8.633333333333313, "traveled_tiles": 3, "valid_direction": 2.6999999999999913}}
good_angle_max19.33263181642809
good_angle_mean7.356872487976131
good_angle_median3.2297073074693565
good_angle_min0.9615504649098168
reward_max-4.533551920119921
reward_mean-7.007063040359003
reward_median-5.259607985593783
reward_min-13.619904056129355
survival_time_max8.633333333333313
survival_time_mean6.8399999999999865
survival_time_min2.500000000000001
traveled_tiles_max4
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max5.499999999999986
valid_direction_mean4.119999999999989
valid_direction_median5.166666666666651
valid_direction_min2.000000000000001
No reset possible
10337426Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10336427Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    solve(params, cis)
  File "solution.py", line 28, in solve
    env = gym.make(params['env'])
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
    return registry.make(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
    spec = self.spec(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
    raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10333429Orlando Marquez 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10320438Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:04:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10307464Orlando Marquez 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:06:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.100249689175728
deviation-center-line_median1.3449474516272864
in-drivable-lane_median1.6999999999999946


other stats
deviation-center-line_max1.3768982623538213
deviation-center-line_mean1.1562875543915694
deviation-center-line_min0.3685860053560791
deviation-heading_max11.68388141943642
deviation-heading_mean9.352449839692795
deviation-heading_median10.618271797823088
deviation-heading_min3.660740042655455
driven_any_max4.979113636122271
driven_any_mean4.852610389758444
driven_any_median4.979031772314665
driven_any_min4.346832205322924
driven_lanedir_max3.167659217109948
driven_lanedir_mean2.624352949811872
driven_lanedir_min0.676559070177116
in-drivable-lane_max10.433333333333302
in-drivable-lane_mean3.339999999999989
in-drivable-lane_min0.8666666666666638
per-episodes
details{"ep000": {"driven_any": 4.346832205322924, "driven_lanedir": 0.676559070177116, "in-drivable-lane": 10.433333333333302, "deviation-heading": 3.660740042655455, "deviation-center-line": 0.3685860053560791}, "ep001": {"driven_any": 4.979113636122251, "driven_lanedir": 3.05494506528675, "in-drivable-lane": 2.199999999999993, "deviation-heading": 9.953043798180028, "deviation-center-line": 1.3768982623538213}, "ep002": {"driven_any": 4.979031772314665, "driven_lanedir": 3.1223517073098175, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 10.846312140368983, "deviation-center-line": 1.3449474516272864}, "ep003": {"driven_any": 4.978960698910106, "driven_lanedir": 3.167659217109948, "in-drivable-lane": 0.8666666666666638, "deviation-heading": 11.68388141943642, "deviation-center-line": 1.342293455826984}, "ep004": {"driven_any": 4.979113636122271, "driven_lanedir": 3.100249689175728, "in-drivable-lane": 1.6999999999999946, "deviation-heading": 10.618271797823088, "deviation-center-line": 1.3487125967936766}}
No reset possible
10299448Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.49999999999998


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.9202653874372, "good_angle": 1.2975780443330118, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 57, "reward": -18.11250969610716, "good_angle": 0.019117156169288555, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 255, "reward": -4.346743478604727, "good_angle": 1.1469560769598393, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.2333333333333263}, "ep003": {"nsteps": 456, "reward": -2.6288366692402123, "good_angle": 0.8679691996427865, "survival_time": 15.199999999999957, "traveled_tiles": 4, "valid_direction": 1.86666666666666}, "ep004": {"nsteps": 343, "reward": -3.562969451490688, "good_angle": 19.52009844208365, "survival_time": 11.433333333333303, "traveled_tiles": 3, "valid_direction": 3.899999999999987}}
good_angle_max19.52009844208365
good_angle_mean4.570343783837716
good_angle_median1.1469560769598393
good_angle_min0.019117156169288555
reward_max-2.6288366692402123
reward_mean-8.314264936575999
reward_median-4.346743478604727
reward_min-18.11250969610716
survival_time_max15.199999999999957
survival_time_mean7.933333333333316
survival_time_min1.9000000000000024
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.899999999999987
valid_direction_mean2.046666666666661
valid_direction_median2.2333333333333263
valid_direction_min0
No reset possible
10292445Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 58, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10285456Hristo Vrigazov 🇧🇬ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2189290335726386
deviation-center-line_median0.2038882399907023
in-drivable-lane_median0


other stats
deviation-center-line_max0.3573803580419819
deviation-center-line_mean0.2215347331820308
deviation-center-line_min0.12359570994705874
deviation-heading_max1.7663392550978383
deviation-heading_mean0.815266768917453
deviation-heading_median0.6330173453035197
deviation-heading_min0.2409650353605524
driven_any_max0.803598637128457
driven_any_mean0.3285768279773935
driven_any_median0.2357228041694507
driven_any_min0.1785712063148076
driven_lanedir_max0.5636647108331085
driven_lanedir_mean0.2677382427652724
driven_lanedir_min0.14867051208623483
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.803598637128457, "driven_lanedir": 0.5636647108331085, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7663392550978383, "deviation-center-line": 0.3573803580419819}, "ep001": {"driven_any": 0.23929850275036552, "driven_lanedir": 0.23777138906053397, "in-drivable-lane": 0, "deviation-heading": 0.2409650353605524, "deviation-center-line": 0.2551355476887906}, "ep002": {"driven_any": 0.1856929895238865, "driven_lanedir": 0.1696555682738461, "in-drivable-lane": 0, "deviation-heading": 0.6330173453035197, "deviation-center-line": 0.16767381024162037}, "ep003": {"driven_any": 0.1785712063148076, "driven_lanedir": 0.14867051208623483, "in-drivable-lane": 0, "deviation-heading": 0.8393451573452846, "deviation-center-line": 0.12359570994705874}, "ep004": {"driven_any": 0.2357228041694507, "driven_lanedir": 0.2189290335726386, "in-drivable-lane": 0, "deviation-heading": 0.5966670514800698, "deviation-center-line": 0.2038882399907023}}
No reset possible
10275456Hristo Vrigazov 🇧🇬ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10271456Hristo Vrigazov 🇧🇬ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2666666666666684


other stats
episodes
details{"ep000": {"nsteps": 227, "reward": -4.569030268535239, "good_angle": 0.7473963295510502, "survival_time": 7.5666666666666496, "traveled_tiles": 2, "valid_direction": 1.3666666666666618}, "ep001": {"nsteps": 69, "reward": -15.078329285417778, "good_angle": 0.029106036615152892, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 54, "reward": -19.02807673204828, "good_angle": 0.34585586215104747, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 1.0333333333333357}, "ep003": {"nsteps": 52, "reward": -19.6388714072796, "good_angle": 0.6492531751890471, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0.8666666666666688}, "ep004": {"nsteps": 68, "reward": -15.189852873630384, "good_angle": 0.37596720763363056, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.533333333333333}}
good_angle_max0.7473963295510502
good_angle_mean0.4295157222279856
good_angle_median0.37596720763363056
good_angle_min0.029106036615152892
reward_max-4.569030268535239
reward_mean-14.700832113382257
reward_median-15.189852873630384
reward_min-19.6388714072796
survival_time_max7.5666666666666496
survival_time_mean3.1333333333333315
survival_time_min1.7333333333333354
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3666666666666618
valid_direction_mean0.76
valid_direction_median0.8666666666666688
valid_direction_min0
No reset possible
10262456Hristo Vrigazov 🇧🇬ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:04:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10258458Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:37
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10255462Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:16
Error while running [...]

Creating job10255-54_evaluator_1 ... error
stderr | ERROR: for job10255-54_evaluator_1  Cannot start service evaluator: network job10255-54_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job10255-54_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job10255-54_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10243479Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3143855010633223
deviation-center-line_median0.14709453095890548
in-drivable-lane_median13.36666666666662


other stats
deviation-center-line_max0.20762858195819092
deviation-center-line_mean0.14618581991587334
deviation-center-line_min0.05805242341066197
deviation-heading_max1.0342945271318067
deviation-heading_mean0.7991210663519178
deviation-heading_median0.9433568496091662
deviation-heading_min0.19154913286138767
driven_any_max1.3142242371276414
driven_any_mean0.8169040764939842
driven_any_median0.7981214917420629
driven_any_min0.41325712939466286
driven_lanedir_max0.4217906671598224
driven_lanedir_mean0.2847960783970781
driven_lanedir_min0.03179017915486693
in-drivable-lane_max14.899999999999984
in-drivable-lane_mean13.199999999999967
in-drivable-lane_min10.233333333333306
per-episodes
details{"ep000": {"driven_any": 0.41325712939466286, "driven_lanedir": 0.03179017915486693, "in-drivable-lane": 10.233333333333306, "deviation-heading": 0.19154913286138767, "deviation-center-line": 0.05805242341066197}, "ep001": {"driven_any": 1.3142242371276414, "driven_lanedir": 0.4217906671598224, "in-drivable-lane": 14.266666666666652, "deviation-heading": 1.0342945271318067, "deviation-center-line": 0.20762858195819092}, "ep002": {"driven_any": 0.7082173885402527, "driven_lanedir": 0.3576641860676455, "in-drivable-lane": 13.36666666666662, "deviation-heading": 0.9433568496091662, "deviation-center-line": 0.1720680310518174}, "ep003": {"driven_any": 0.7981214917420629, "driven_lanedir": 0.2983498585397335, "in-drivable-lane": 14.899999999999984, "deviation-heading": 0.8518391764407385, "deviation-center-line": 0.14608553219979098}, "ep004": {"driven_any": 0.8507001356653012, "driven_lanedir": 0.3143855010633223, "in-drivable-lane": 13.233333333333288, "deviation-heading": 0.9745656457164904, "deviation-center-line": 0.14709453095890548}}
No reset possible
10232479Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10213478Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:10:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10207490Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10205490Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2666666666666684


other stats
episodes
details{"ep000": {"nsteps": 158, "reward": -6.463997234976437, "good_angle": 1.4158090936869352, "survival_time": 5.266666666666658, "traveled_tiles": 2, "valid_direction": 1.533333333333329}, "ep001": {"nsteps": 20, "reward": -50.65947676151991, "good_angle": 0.4232438603461446, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 125, "reward": -8.485364887952805, "good_angle": 0.251427840090364, "survival_time": 4.166666666666662, "traveled_tiles": 2, "valid_direction": 0.3999999999999986}, "ep003": {"nsteps": 58, "reward": -17.626405495636423, "good_angle": 0.5080269829624556, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 0.800000000000002}, "ep004": {"nsteps": 68, "reward": -15.18669922956649, "good_angle": 0.3998111200052081, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.5666666666666664}}
good_angle_max1.4158090936869352
good_angle_mean0.5996637794182215
good_angle_median0.4232438603461446
good_angle_min0.251427840090364
reward_max-6.463997234976437
reward_mean-19.68438872193041
reward_median-15.18669922956649
reward_min-50.65947676151991
survival_time_max5.266666666666658
survival_time_mean2.859999999999998
survival_time_min0.6666666666666666
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.533333333333329
valid_direction_mean0.7533333333333325
valid_direction_median0.5666666666666664
valid_direction_min0.3999999999999986
No reset possible
10198495Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.04411107874427467
deviation-center-line_median0.03382312812944439
in-drivable-lane_median0


other stats
deviation-center-line_max0.036932541750262865
deviation-center-line_mean0.025155405677972437
deviation-center-line_min0
deviation-heading_max0.33344468140579925
deviation-heading_mean0.22039329655951928
deviation-heading_median0.26280377843412867
deviation-heading_min0
driven_any_max3.3176367416071093
driven_any_mean0.7248170230659711
driven_any_median0.07328113284674392
driven_any_min0.05329536934308598
driven_lanedir_max0.04675978410254445
driven_lanedir_mean0.034855625077198346
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.3733333333333304
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 3.3176367416071093, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.05329536934308598, "driven_lanedir": 0.03825011064919037, "in-drivable-lane": 0, "deviation-heading": 0.21638555899448664, "deviation-center-line": 0.034025485829071465}, "ep002": {"driven_any": 0.07328113284674392, "driven_lanedir": 0.04515715188998226, "in-drivable-lane": 0, "deviation-heading": 0.33344468140579925, "deviation-center-line": 0.036932541750262865}, "ep003": {"driven_any": 0.11325265985405814, "driven_lanedir": 0.04411107874427467, "in-drivable-lane": 0.23333333333333336, "deviation-heading": 0.28933246396318174, "deviation-center-line": 0.020995872681083456}, "ep004": {"driven_any": 0.0666192116788584, "driven_lanedir": 0.04675978410254445, "in-drivable-lane": 0, "deviation-heading": 0.26280377843412867, "deviation-center-line": 0.03382312812944439}}
No reset possible
10191495Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10171501Manfred DiazTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1802755024585134
deviation-center-line_median0.5754096123679283
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max1.1831827320618895
deviation-center-line_mean0.6341360178813958
deviation-center-line_min0.22474959476747397
deviation-heading_max2.6463413950694106
deviation-heading_mean1.4716556367984308
deviation-heading_median1.655338948591104
deviation-heading_min0.24402069512793112
driven_any_max2.888481976798732
driven_any_mean1.5185948664746167
driven_any_median1.3336938584292013
driven_any_min0.3169846704443646
driven_lanedir_max2.5715150173412997
driven_lanedir_mean1.34575575171303
driven_lanedir_min0.30535009450292927
in-drivable-lane_max0.7999999999999972
in-drivable-lane_mean0.3133333333333327
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.267982984756009, "driven_lanedir": 1.8912094979622496, "in-drivable-lane": 0.7333333333333332, "deviation-heading": 2.6463413950694106, "deviation-center-line": 0.7006105605048246}, "ep001": {"driven_any": 0.3169846704443646, "driven_lanedir": 0.30535009450292927, "in-drivable-lane": 0, "deviation-heading": 0.24402069512793112, "deviation-center-line": 0.22474959476747397}, "ep002": {"driven_any": 1.3336938584292013, "driven_lanedir": 1.1802755024585134, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.4607810007432205, "deviation-center-line": 0.5754096123679283}, "ep003": {"driven_any": 2.888481976798732, "driven_lanedir": 2.5715150173412997, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 1.655338948591104, "deviation-center-line": 1.1831827320618895}, "ep004": {"driven_any": 0.7858308419447766, "driven_lanedir": 0.7804286463001577, "in-drivable-lane": 0, "deviation-heading": 0.35179614446048796, "deviation-center-line": 0.4867275897048623}}
No reset possible
10167501Manfred DiazTensorflow templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10163497Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    solve(params, cis)
  File "solution.py", line 32, in solve
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 76, in __init__
    self.undistort = UndistortWrapper(env)
  File "/workspace/wrappers.py", line 185, in __init__
    self.env.unwrapped.undistort = True
AttributeError: 'UndistortWrapper' object has no attribute 'env'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10157499Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 94, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    cis.info(observation.shape)
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 121, in info
    dclogger.info('solution:%s' % s)
TypeError: not all arguments converted during string formatting


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10147514Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9209879724108954
deviation-center-line_median0.4689912177548896
in-drivable-lane_median9.533333333333337


other stats
deviation-center-line_max1.853337884235602
deviation-center-line_mean0.6717788293026569
deviation-center-line_min0
deviation-heading_max3.628030980806938
deviation-heading_mean1.6089473489951018
deviation-heading_median1.1427723730712696
deviation-heading_min0
driven_any_max2.55283094392624
driven_any_mean1.6340265218192087
driven_any_median1.6539033337745674
driven_any_min0.82963842770936
driven_lanedir_max2.1486038204142033
driven_lanedir_mean0.9051091953072266
driven_lanedir_min0
in-drivable-lane_max13.566666666666656
in-drivable-lane_mean8.259999999999994
in-drivable-lane_min1.8666666666666956
per-episodes
details{"ep000": {"driven_any": 1.6539033337745674, "driven_lanedir": 0, "in-drivable-lane": 10.56666666666664, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.3783988617625167, "driven_lanedir": 0.989226704837072, "in-drivable-lane": 9.533333333333337, "deviation-heading": 2.240846655608999, "deviation-center-line": 0.4689912177548896}, "ep002": {"driven_any": 0.82963842770936, "driven_lanedir": 0.4667274788739617, "in-drivable-lane": 13.566666666666656, "deviation-heading": 1.1427723730712696, "deviation-center-line": 0.26274387752554856}, "ep003": {"driven_any": 1.755361041923359, "driven_lanedir": 0.9209879724108954, "in-drivable-lane": 5.766666666666647, "deviation-heading": 1.033086735488301, "deviation-center-line": 0.7738211669972446}, "ep004": {"driven_any": 2.55283094392624, "driven_lanedir": 2.1486038204142033, "in-drivable-lane": 1.8666666666666956, "deviation-heading": 3.628030980806938, "deviation-center-line": 1.853337884235602}}
No reset possible
10139514Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10137514Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 318, "reward": -4.613173085376152, "good_angle": 1.4914677637536329, "survival_time": 10.599999999999971, "traveled_tiles": 4, "valid_direction": 3.166666666666658}, "ep001": {"nsteps": 500, "reward": -1.7696727788299322, "good_angle": 33.320255146932425, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 13.933333333333325}, "ep002": {"nsteps": 500, "reward": -2.3688311167489737, "good_angle": 18.4088431117771, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 15.666666666666652}, "ep003": {"nsteps": 348, "reward": -3.8478188502505937, "good_angle": 1.8661239948196051, "survival_time": 11.59999999999997, "traveled_tiles": 4, "valid_direction": 3.1666666666666563}, "ep004": {"nsteps": 500, "reward": -0.357737303284579, "good_angle": 15.672619836096708, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.866666666666657}}
good_angle_max33.320255146932425
good_angle_mean14.151861970675895
good_angle_median15.672619836096708
good_angle_min1.4914677637536329
reward_max-0.357737303284579
reward_mean-2.5914466268980463
reward_median-2.3688311167489737
reward_min-4.613173085376152
survival_time_max16.666666666666654
survival_time_mean14.43999999999998
survival_time_min10.599999999999971
traveled_tiles_max5
traveled_tiles_mean3.8
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max15.666666666666652
valid_direction_mean7.959999999999991
valid_direction_median3.866666666666657
valid_direction_min3.1666666666666563
No reset possible
10117514Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:06:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10108524Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.28977579066348724
deviation-center-line_median0.2596306626838413
in-drivable-lane_median0.8999999999999968


other stats
deviation-center-line_max0.3495269439274484
deviation-center-line_mean0.2816719556808085
deviation-center-line_min0.23084578070496203
deviation-heading_max3.140638799446339
deviation-heading_mean2.412886947725279
deviation-heading_median2.769138296409296
deviation-heading_min0.834297520530139
driven_any_max0.7873202975740567
driven_any_mean0.6419688580219205
driven_any_median0.6009722981482444
driven_any_min0.5823374982056604
driven_lanedir_max0.34105884308565093
driven_lanedir_mean0.3003442252313668
driven_lanedir_min0.28535129762116584
in-drivable-lane_max3.3333333333333277
in-drivable-lane_mean1.3666666666666631
in-drivable-lane_min0.7333333333333307
per-episodes
details{"ep000": {"driven_any": 0.7873202975740567, "driven_lanedir": 0.28977579066348724, "in-drivable-lane": 3.3333333333333277, "deviation-heading": 0.834297520530139, "deviation-center-line": 0.3495269439274484}, "ep001": {"driven_any": 0.647559298004693, "driven_lanedir": 0.34105884308565093, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.140638799446339, "deviation-center-line": 0.3138973423502348}, "ep002": {"driven_any": 0.6009722981482444, "driven_lanedir": 0.2978870322519669, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 2.769138296409296, "deviation-center-line": 0.254459048737556}, "ep003": {"driven_any": 0.5823374982056604, "driven_lanedir": 0.28535129762116584, "in-drivable-lane": 1.0333333333333297, "deviation-heading": 2.4218935945541102, "deviation-center-line": 0.23084578070496203}, "ep004": {"driven_any": 0.5916548981769478, "driven_lanedir": 0.28764816253456305, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 2.89846652768651, "deviation-center-line": 0.2596306626838413}}
No reset possible
10101524Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10096524Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.366666666666661


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -6.709294177134309, "good_angle": 3.212081557270962, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.79999999999999}, "ep001": {"nsteps": 141, "reward": -7.600244003372822, "good_angle": 4.804851725848225, "survival_time": 4.699999999999993, "traveled_tiles": 1, "valid_direction": 3.833333333333327}, "ep002": {"nsteps": 131, "reward": -8.178489692882414, "good_angle": 4.636373361798506, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 3.6666666666666607}, "ep003": {"nsteps": 127, "reward": -8.459673733430305, "good_angle": 4.4107527352806075, "survival_time": 4.233333333333328, "traveled_tiles": 1, "valid_direction": 3.4999999999999947}, "ep004": {"nsteps": 129, "reward": -8.281368599211898, "good_angle": 4.686365787635289, "survival_time": 4.2999999999999945, "traveled_tiles": 1, "valid_direction": 3.699999999999995}}
good_angle_max4.804851725848225
good_angle_mean4.350085033566717
good_angle_median4.636373361798506
good_angle_min3.212081557270962
reward_max-6.709294177134309
reward_mean-7.84581404120635
reward_median-8.178489692882414
reward_min-8.459673733430305
survival_time_max5.6999999999999895
survival_time_mean4.659999999999993
survival_time_min4.233333333333328
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max3.833333333333327
valid_direction_mean3.499999999999994
valid_direction_median3.6666666666666607
valid_direction_min2.79999999999999
No reset possible
10093525Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:12
Error while running [...]

Creating job10093-9275_videos_1 ... error
stderr | ERROR: for job10093-9275_videos_1  Cannot start service videos: network job10093-9275_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job10093-9275_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10082526Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.28977579066348724
deviation-center-line_median0.2596306626838413
in-drivable-lane_median0.8999999999999968


other stats
deviation-center-line_max0.3495269439274484
deviation-center-line_mean0.2816719556808085
deviation-center-line_min0.23084578070496203
deviation-heading_max3.140638799446339
deviation-heading_mean2.412886947725279
deviation-heading_median2.769138296409296
deviation-heading_min0.834297520530139
driven_any_max0.7873202975740567
driven_any_mean0.6419688580219205
driven_any_median0.6009722981482444
driven_any_min0.5823374982056604
driven_lanedir_max0.34105884308565093
driven_lanedir_mean0.3003442252313668
driven_lanedir_min0.28535129762116584
in-drivable-lane_max3.3333333333333277
in-drivable-lane_mean1.3666666666666631
in-drivable-lane_min0.7333333333333307
per-episodes
details{"ep000": {"driven_any": 0.7873202975740567, "driven_lanedir": 0.28977579066348724, "in-drivable-lane": 3.3333333333333277, "deviation-heading": 0.834297520530139, "deviation-center-line": 0.3495269439274484}, "ep001": {"driven_any": 0.647559298004693, "driven_lanedir": 0.34105884308565093, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.140638799446339, "deviation-center-line": 0.3138973423502348}, "ep002": {"driven_any": 0.6009722981482444, "driven_lanedir": 0.2978870322519669, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 2.769138296409296, "deviation-center-line": 0.254459048737556}, "ep003": {"driven_any": 0.5823374982056604, "driven_lanedir": 0.28535129762116584, "in-drivable-lane": 1.0333333333333297, "deviation-heading": 2.4218935945541102, "deviation-center-line": 0.23084578070496203}, "ep004": {"driven_any": 0.5916548981769478, "driven_lanedir": 0.28764816253456305, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 2.89846652768651, "deviation-center-line": 0.2596306626838413}}
No reset possible
10074526Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10070526Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.366666666666661


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -6.709294177134309, "good_angle": 3.212081557270962, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.79999999999999}, "ep001": {"nsteps": 141, "reward": -7.600244003372822, "good_angle": 4.804851725848225, "survival_time": 4.699999999999993, "traveled_tiles": 1, "valid_direction": 3.833333333333327}, "ep002": {"nsteps": 131, "reward": -8.178489692882414, "good_angle": 4.636373361798506, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 3.6666666666666607}, "ep003": {"nsteps": 127, "reward": -8.459673733430305, "good_angle": 4.4107527352806075, "survival_time": 4.233333333333328, "traveled_tiles": 1, "valid_direction": 3.4999999999999947}, "ep004": {"nsteps": 129, "reward": -8.281368599211898, "good_angle": 4.686365787635289, "survival_time": 4.2999999999999945, "traveled_tiles": 1, "valid_direction": 3.699999999999995}}
good_angle_max4.804851725848225
good_angle_mean4.350085033566717
good_angle_median4.636373361798506
good_angle_min3.212081557270962
reward_max-6.709294177134309
reward_mean-7.84581404120635
reward_median-8.178489692882414
reward_min-8.459673733430305
survival_time_max5.6999999999999895
survival_time_mean4.659999999999993
survival_time_min4.233333333333328
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max3.833333333333327
valid_direction_mean3.499999999999994
valid_direction_median3.6666666666666607
valid_direction_min2.79999999999999
No reset possible
10066530Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 271, "reward": -4.996563631450118, "good_angle": 1.1005898013252264, "survival_time": 9.033333333333312, "traveled_tiles": 4, "valid_direction": 2.2999999999999936}, "ep001": {"nsteps": 284, "reward": -4.302450111462131, "good_angle": 16.31835594891589, "survival_time": 9.466666666666644, "traveled_tiles": 5, "valid_direction": 5.933333333333316}, "ep002": {"nsteps": 149, "reward": -7.720443555126169, "good_angle": 1.9595474474189016, "survival_time": 4.966666666666659, "traveled_tiles": 4, "valid_direction": 3.6333333333333258}, "ep003": {"nsteps": 183, "reward": -6.0104711054572375, "good_angle": 1.28250587874637, "survival_time": 6.099999999999988, "traveled_tiles": 3, "valid_direction": 1.4999999999999951}, "ep004": {"nsteps": 500, "reward": -0.4445230919736205, "good_angle": 11.891637649787322, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 2.8999999999999915}}
good_angle_max16.31835594891589
good_angle_mean6.510527345238742
good_angle_median1.9595474474189016
good_angle_min1.1005898013252264
reward_max-0.4445230919736205
reward_mean-4.6948902990938555
reward_median-4.996563631450118
reward_min-7.720443555126169
survival_time_max16.666666666666654
survival_time_mean9.246666666666652
survival_time_min4.966666666666659
traveled_tiles_max6
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max5.933333333333316
valid_direction_mean3.2533333333333245
valid_direction_median2.8999999999999915
valid_direction_min1.4999999999999951
No reset possible
10049530Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:08:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10047531Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:15
Error while running [...]

Creating job10047-216_solution_1  ... error
stderr | ERROR: for job10047-216_solution_1  Cannot start service solution: network job10047-216_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job10047-216_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job10047-216_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10044537Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.19839021629551645
deviation-center-line_median0.026892949624649044
in-drivable-lane_median0.6333333333333332


other stats
deviation-center-line_max0.03470304301881854
deviation-center-line_mean0.029098229282228133
deviation-center-line_min0.02425751862089922
deviation-heading_max0.2502811076721805
deviation-heading_mean0.2216207237983671
deviation-heading_median0.2174546153073063
deviation-heading_min0.20367890538449185
driven_any_max0.7934332474149146
driven_any_mean0.6203470772963854
driven_any_median0.5940892873700189
driven_any_min0.5268005768593016
driven_lanedir_max0.24838713693963585
driven_lanedir_mean0.21495470955382895
driven_lanedir_min0.1878690715124578
in-drivable-lane_max1.0000000000000009
in-drivable-lane_mean0.6666666666666669
in-drivable-lane_min0.4666666666666666
per-episodes
details{"ep000": {"driven_any": 0.7934332474149146, "driven_lanedir": 0.24838713693963585, "in-drivable-lane": 1.0000000000000009, "deviation-heading": 0.2203377148725361, "deviation-center-line": 0.03431462664200679}, "ep001": {"driven_any": 0.6320560624194703, "driven_lanedir": 0.24748320916279457, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 0.2502811076721805, "deviation-center-line": 0.03470304301881854}, "ep002": {"driven_any": 0.5553562124182219, "driven_lanedir": 0.1878690715124578, "in-drivable-lane": 0.4666666666666666, "deviation-heading": 0.2174546153073063, "deviation-center-line": 0.025323008504767073}, "ep003": {"driven_any": 0.5268005768593016, "driven_lanedir": 0.19839021629551645, "in-drivable-lane": 0.5999999999999999, "deviation-heading": 0.20367890538449185, "deviation-center-line": 0.026892949624649044}, "ep004": {"driven_any": 0.5940892873700189, "driven_lanedir": 0.1926439138587401, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 0.21635127575532087, "deviation-center-line": 0.02425751862089922}}
No reset possible
10041537Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10037537Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9666666666666666


other stats
episodes
details{"ep000": {"nsteps": 41, "reward": -26.03552148472972, "good_angle": 3.0844503624032997, "survival_time": 1.3666666666666676, "traveled_tiles": 2, "valid_direction": 1.233333333333334}, "ep001": {"nsteps": 31, "reward": -34.00843090960576, "good_angle": 0.9595897654984332, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0.9666666666666665}, "ep002": {"nsteps": 24, "reward": -43.26566152833402, "good_angle": 0.991599544622662, "survival_time": 0.7999999999999999, "traveled_tiles": 2, "valid_direction": 0.7333333333333332}, "ep003": {"nsteps": 28, "reward": -37.53936479277244, "good_angle": 1.156671689445627, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.8666666666666665}, "ep004": {"nsteps": 29, "reward": -36.280787767778186, "good_angle": 0.8047930596681112, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0.8999999999999998}}
good_angle_max3.0844503624032997
good_angle_mean1.3994208843276268
good_angle_median0.991599544622662
good_angle_min0.8047930596681112
reward_max-26.03552148472972
reward_mean-35.425953296644025
reward_median-36.280787767778186
reward_min-43.26566152833402
survival_time_max1.3666666666666676
survival_time_mean1.02
survival_time_min0.7999999999999999
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.233333333333334
valid_direction_mean0.9399999999999998
valid_direction_median0.8999999999999998
valid_direction_min0.7333333333333332
No reset possible
10030537Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10024543Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.556511482949603
deviation-center-line_median0.27999622831039583
in-drivable-lane_median1.8999999999999948


other stats
deviation-center-line_max1.0923573999517773
deviation-center-line_mean0.3724609376105471
deviation-center-line_min0
deviation-heading_max2.812228279935465
deviation-heading_mean1.1241329388970351
deviation-heading_median0.7236008447660953
deviation-heading_min0
driven_any_max4.014281751451181
driven_any_mean1.7513904822053277
driven_any_median1.3053964573512806
driven_any_min0.8694291840591771
driven_lanedir_max1.9536100225069195
driven_lanedir_mean0.7747287187844668
driven_lanedir_min0
in-drivable-lane_max7.899999999999973
in-drivable-lane_mean3.393333333333324
in-drivable-lane_min0.6333333333333311
per-episodes
details{"ep000": {"driven_any": 1.3706023338601256, "driven_lanedir": 0, "in-drivable-lane": 4.66666666666666, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.3053964573512806, "driven_lanedir": 0.9462014920882916, "in-drivable-lane": 0.6333333333333311, "deviation-heading": 1.4360808982249993, "deviation-center-line": 0.3276055880041256}, "ep002": {"driven_any": 0.8694291840591771, "driven_lanedir": 0.4173205963775197, "in-drivable-lane": 1.8999999999999948, "deviation-heading": 0.7236008447660953, "deviation-center-line": 0.16234547178643677}, "ep003": {"driven_any": 1.1972426843048751, "driven_lanedir": 0.556511482949603, "in-drivable-lane": 1.86666666666666, "deviation-heading": 0.6487546715586159, "deviation-center-line": 0.27999622831039583}, "ep004": {"driven_any": 4.014281751451181, "driven_lanedir": 1.9536100225069195, "in-drivable-lane": 7.899999999999973, "deviation-heading": 2.812228279935465, "deviation-center-line": 1.0923573999517773}}
No reset possible
10017543Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10011539Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10006538Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.533333333333314


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -12.599803917334173, "good_angle": 1.2168698932012934, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2666666666666666}, "ep001": {"nsteps": 67, "reward": -15.494970175757336, "good_angle": 0.015370751626921204, "survival_time": 2.233333333333335, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 256, "reward": -4.298813579778653, "good_angle": 0.8173969927394401, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.899999999999994}, "ep003": {"nsteps": 457, "reward": -2.284644445640043, "good_angle": 0.987714664667402, "survival_time": 15.23333333333329, "traveled_tiles": 4, "valid_direction": 2.1333333333333258}, "ep004": {"nsteps": 346, "reward": -3.5534400804361295, "good_angle": 20.330672958382294, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}
good_angle_max20.330672958382294
good_angle_mean4.673605052123471
good_angle_median0.987714664667402
good_angle_min0.015370751626921204
reward_max-2.284644445640043
reward_mean-7.646334439789267
reward_median-4.298813579778653
reward_min-15.494970175757336
survival_time_max15.23333333333329
survival_time_mean8.046666666666649
survival_time_min2.233333333333335
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.9666666666666535
valid_direction_mean2.0533333333333283
valid_direction_median2.1333333333333258
valid_direction_min0
No reset possible
9993538Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9990540Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: local variable 'a' referenced before assignment

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9985544Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: invalid syntax (LF_JP.py, line 239)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9977553Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.909890575742774
deviation-center-line_median0.3803581868695006
in-drivable-lane_median2.166666666666659


other stats
deviation-center-line_max1.414303483901305
deviation-center-line_mean0.46980740746543653
deviation-center-line_min0
deviation-heading_max2.755869287889536
deviation-heading_mean1.393897991671126
deviation-heading_median1.5344374245807617
deviation-heading_min0
driven_any_max4.463436961674864
driven_any_mean1.976668032771186
driven_any_median1.4836725658370318
driven_any_min0.8992502642742731
driven_lanedir_max2.776114630655107
driven_lanedir_mean1.069775706631748
driven_lanedir_min0
in-drivable-lane_max5.200000000000017
in-drivable-lane_mean2.793333333333332
in-drivable-lane_min0.4999999999999982
per-episodes
details{"ep000": {"driven_any": 1.452516574052377, "driven_lanedir": 0, "in-drivable-lane": 5.133333333333325, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.4836725658370318, "driven_lanedir": 1.0746707198677572, "in-drivable-lane": 0.9666666666666632, "deviation-heading": 1.9567254941699448, "deviation-center-line": 0.39018269222656576}, "ep002": {"driven_any": 0.8992502642742731, "driven_lanedir": 0.5882026068931021, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.5344374245807617, "deviation-center-line": 0.16419267432981136}, "ep003": {"driven_any": 1.5844637980173832, "driven_lanedir": 0.909890575742774, "in-drivable-lane": 2.166666666666659, "deviation-heading": 0.7224577517153887, "deviation-center-line": 0.3803581868695006}, "ep004": {"driven_any": 4.463436961674864, "driven_lanedir": 2.776114630655107, "in-drivable-lane": 5.200000000000017, "deviation-heading": 2.755869287889536, "deviation-center-line": 1.414303483901305}}
No reset possible
9969553Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9956552Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9948561Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednorudolf-80:02:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9945564Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednorudolf-80:01:08
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9935571Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednorudolf-80:02:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9932574Tri Cao 🇺🇸PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9916579Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7269360772684326
deviation-center-line_median0.1516173576083181
in-drivable-lane_median4.166666666666662


other stats
deviation-center-line_max0.9881219990698914
deviation-center-line_mean0.3312545331594837
deviation-center-line_min0
deviation-heading_max2.068416631849293
deviation-heading_mean0.7127590478890345
deviation-heading_median0.5041212178199654
deviation-heading_min0
driven_any_max5.493661028781503
driven_any_mean2.4421884894852224
driven_any_median2.41771245363674
driven_any_min0.4532403897677328
driven_lanedir_max3.4900572754102406
driven_lanedir_mean1.2732421827198832
driven_lanedir_min0
in-drivable-lane_max6.233333333333312
in-drivable-lane_mean3.826666666666656
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.3512198939463251, "driven_lanedir": 0, "in-drivable-lane": 4.166666666666662, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.4532403897677328, "driven_lanedir": 0.4398509475923922, "in-drivable-lane": 0, "deviation-heading": 0.2902265382403343, "deviation-center-line": 0.14138744642802734}, "ep002": {"driven_any": 2.41771245363674, "driven_lanedir": 0.7269360772684326, "in-drivable-lane": 6.233333333333312, "deviation-heading": 0.7010308515355802, "deviation-center-line": 0.1516173576083181}, "ep003": {"driven_any": 2.495108681293811, "driven_lanedir": 1.7093666133283512, "in-drivable-lane": 2.8999999999999906, "deviation-heading": 0.5041212178199654, "deviation-center-line": 0.37514586269118166}, "ep004": {"driven_any": 5.493661028781503, "driven_lanedir": 3.4900572754102406, "in-drivable-lane": 5.8333333333333135, "deviation-heading": 2.068416631849293, "deviation-center-line": 0.9881219990698914}}
No reset possible
9914578Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.133333333333318


other stats
episodes
details{"ep000": {"nsteps": 133, "reward": -9.295114409206503, "good_angle": 0.2683233133444956, "survival_time": 4.433333333333327, "traveled_tiles": 3, "valid_direction": 0.5333333333333321}, "ep001": {"nsteps": 214, "reward": -5.248618875987062, "good_angle": 13.911662783167214, "survival_time": 7.133333333333318, "traveled_tiles": 3, "valid_direction": 4.899999999999984}, "ep002": {"nsteps": 270, "reward": -5.490727392326247, "good_angle": 2.678304789673275, "survival_time": 8.999999999999979, "traveled_tiles": 5, "valid_direction": 3.499999999999991}, "ep003": {"nsteps": 205, "reward": -5.82651951649885, "good_angle": 1.689196953018172, "survival_time": 6.833333333333319, "traveled_tiles": 5, "valid_direction": 1.4333333333333282}, "ep004": {"nsteps": 500, "reward": -0.6237473046593368, "good_angle": 26.92640075400222, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.033333333333319}}
good_angle_max26.92640075400222
good_angle_mean9.094777718641074
good_angle_median2.678304789673275
good_angle_min0.2683233133444956
reward_max-0.6237473046593368
reward_mean-5.2969454997356005
reward_median-5.490727392326247
reward_min-9.295114409206503
survival_time_max16.666666666666654
survival_time_mean8.813333333333318
survival_time_min4.433333333333327
traveled_tiles_max10
traveled_tiles_mean5.2
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max4.899999999999984
valid_direction_mean2.879999999999991
valid_direction_median3.499999999999991
valid_direction_min0.5333333333333321
No reset possible
9908581Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.319254078534398
deviation-center-line_median0.19016329281170613
in-drivable-lane_median4.433333333333327


other stats
deviation-center-line_max0.25131252142916316
deviation-center-line_mean0.168440103924812
deviation-center-line_min0
deviation-heading_max1.1654921576357449
deviation-heading_mean0.8506994668858475
deviation-heading_median1.04749861772543
deviation-heading_min0
driven_any_max1.6112347236995423
driven_any_mean1.1158211237390647
driven_any_median1.1459706353246322
driven_any_min0.7226367661922337
driven_lanedir_max0.4319739981733759
driven_lanedir_mean0.28974095061401195
driven_lanedir_min0
in-drivable-lane_max6.399999999999978
in-drivable-lane_mean4.41333333333332
in-drivable-lane_min1.6333333333333275
per-episodes
details{"ep000": {"driven_any": 0.7806333256550928, "driven_lanedir": 0, "in-drivable-lane": 4.433333333333327, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.6112347236995423, "driven_lanedir": 0.4319739981733759, "in-drivable-lane": 6.399999999999978, "deviation-heading": 1.1654921576357449, "deviation-center-line": 0.25131252142916316}, "ep002": {"driven_any": 0.7226367661922337, "driven_lanedir": 0.37839966496610167, "in-drivable-lane": 1.6333333333333275, "deviation-heading": 1.04749861772543, "deviation-center-line": 0.21487704610852257}, "ep003": {"driven_any": 1.1459706353246322, "driven_lanedir": 0.31907701139618405, "in-drivable-lane": 4.366666666666651, "deviation-heading": 0.96185136530265, "deviation-center-line": 0.19016329281170613}, "ep004": {"driven_any": 1.318630167823822, "driven_lanedir": 0.319254078534398, "in-drivable-lane": 5.233333333333315, "deviation-heading": 1.0786551937654127, "deviation-center-line": 0.18584765927466823}}
No reset possible
9901581Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9898581Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.43333333333332


other stats
episodes
details{"ep000": {"nsteps": 134, "reward": -9.344874039737146, "good_angle": 0.8023069579586344, "survival_time": 4.466666666666661, "traveled_tiles": 2, "valid_direction": 1.7999999999999987}, "ep001": {"nsteps": 273, "reward": -5.165189140936831, "good_angle": 27.75069004496402, "survival_time": 9.099999999999978, "traveled_tiles": 3, "valid_direction": 6.833333333333317}, "ep002": {"nsteps": 120, "reward": -9.240329373717152, "good_angle": 2.3276738845226137, "survival_time": 3.999999999999995, "traveled_tiles": 2, "valid_direction": 3.6666666666666625}, "ep003": {"nsteps": 193, "reward": -6.619685373483756, "good_angle": 1.0658416960270862, "survival_time": 6.43333333333332, "traveled_tiles": 3, "valid_direction": 3.0666666666666647}, "ep004": {"nsteps": 220, "reward": -6.147496095917781, "good_angle": 8.032379398725, "survival_time": 7.333333333333317, "traveled_tiles": 3, "valid_direction": 3.3666666666666636}}
good_angle_max27.75069004496402
good_angle_mean7.995778396439471
good_angle_median2.3276738845226137
good_angle_min0.8023069579586344
reward_max-5.165189140936831
reward_mean-7.303514804758533
reward_median-6.619685373483756
reward_min-9.344874039737146
survival_time_max9.099999999999978
survival_time_mean6.266666666666654
survival_time_min3.999999999999995
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max6.833333333333317
valid_direction_mean3.7466666666666617
valid_direction_median3.3666666666666636
valid_direction_min1.7999999999999987
No reset possible
9886581Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9882592Liu Sam 🇹🇼PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.481908909421612
deviation-center-line_median0.2153708231582688
in-drivable-lane_median3.066666666666656


other stats
deviation-center-line_max0.4151551653200044
deviation-center-line_mean0.2573722417236254
deviation-center-line_min0.18052572861804275
deviation-heading_max2.044266991114248
deviation-heading_mean1.1828766346561757
deviation-heading_median0.933295596074975
deviation-heading_min0.3279159232264233
driven_any_max1.264968883573376
driven_any_mean0.8117663032532356
driven_any_median1.0171026348729133
driven_any_min0.1675608855713762
driven_lanedir_max0.7095853903713445
driven_lanedir_mean0.424149869341767
driven_lanedir_min0.1260804186162422
in-drivable-lane_max4.133333333333319
in-drivable-lane_mean2.2199999999999926
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.35182702084422285, "driven_lanedir": 0.1260804186162422, "in-drivable-lane": 0.6, "deviation-heading": 2.044266991114248, "deviation-center-line": 0.18954452965182048}, "ep001": {"driven_any": 0.1675608855713762, "driven_lanedir": 0.16193713249999275, "in-drivable-lane": 0, "deviation-heading": 0.3279159232264233, "deviation-center-line": 0.18052572861804275}, "ep002": {"driven_any": 1.2573720914042898, "driven_lanedir": 0.7095853903713445, "in-drivable-lane": 3.066666666666656, "deviation-heading": 1.7086550492240589, "deviation-center-line": 0.4151551653200044}, "ep003": {"driven_any": 1.264968883573376, "driven_lanedir": 0.6412374957996438, "in-drivable-lane": 4.133333333333319, "deviation-heading": 0.9002496136411728, "deviation-center-line": 0.28626496186999034}, "ep004": {"driven_any": 1.0171026348729133, "driven_lanedir": 0.481908909421612, "in-drivable-lane": 3.2999999999999883, "deviation-heading": 0.933295596074975, "deviation-center-line": 0.2153708231582688}}
No reset possible
9878589Allen OuRandom executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.466666666666647


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.917865107599292, "good_angle": 1.2665959209841362, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.266666666666667}, "ep001": {"nsteps": 93, "reward": -11.319515011964306, "good_angle": 0.01006519377990352, "survival_time": 3.0999999999999988, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 254, "reward": -4.557979249168099, "good_angle": 0.8832699341304495, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 2.466666666666659}, "ep003": {"nsteps": 458, "reward": -2.408329269569291, "good_angle": 1.018960498133482, "survival_time": 15.266666666666625, "traveled_tiles": 4, "valid_direction": 2.033333333333326}, "ep004": {"nsteps": 347, "reward": -3.651588009812961, "good_angle": 20.929676201772473, "survival_time": 11.566666666666636, "traveled_tiles": 3, "valid_direction": 3.9999999999999862}}
good_angle_max20.929676201772473
good_angle_mean4.821713549760089
good_angle_median1.018960498133482
good_angle_min0.01006519377990352
reward_max-2.408329269569291
reward_mean-6.971055329622788
reward_median-4.557979249168099
reward_min-12.917865107599292
survival_time_max15.266666666666625
survival_time_mean8.206666666666647
survival_time_min2.6333333333333337
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.9999999999999862
valid_direction_mean2.1533333333333275
valid_direction_median2.266666666666667
valid_direction_min0
No reset possible
9875590Allen OuTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.533333333333314


other stats
episodes
details{"ep000": {"nsteps": 355, "reward": -2.9481367096754156, "good_angle": 0.8206651183447821, "survival_time": 11.833333333333302, "traveled_tiles": 4, "valid_direction": 1.2666666666666622}, "ep001": {"nsteps": 65, "reward": -15.93245312479826, "good_angle": 0.12829365307601664, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 0.1999999999999993}, "ep002": {"nsteps": 256, "reward": -4.076980934218227, "good_angle": 0.8928199947802034, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.4999999999999956}, "ep003": {"nsteps": 500, "reward": -0.28626655193418266, "good_angle": 0.33400722083424306, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 170, "reward": -6.313724986419958, "good_angle": 0.060537386068120175, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 0.09999999999999964}}
good_angle_max0.8928199947802034
good_angle_mean0.44726467462067304
good_angle_median0.33400722083424306
good_angle_min0.060537386068120175
reward_max-0.28626655193418266
reward_mean-5.91151246140921
reward_median-4.076980934218227
reward_min-15.93245312479826
survival_time_max16.666666666666654
survival_time_mean8.973333333333319
survival_time_min2.1666666666666687
traveled_tiles_max6
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.4999999999999956
valid_direction_mean0.7466666666666641
valid_direction_median0.6666666666666643
valid_direction_min0.09999999999999964
No reset possible
9862590Allen OuTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9856596Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 102, in run
    solve(params, cis)
  File "solution.py", line 42, in solve
    env = make_env(config)
  File "solution.py", line 23, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9851598Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 18, in make_env
    env.__init__(frame_skip=config['frame_skip'])
TypeError: __init__() got an unexpected keyword argument 'frame_skip'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9837607Samuel LavoiePyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5817518146270011
deviation-center-line_median0.2952502921419843
in-drivable-lane_median3.1666666666666554


other stats
deviation-center-line_max0.40892985328262493
deviation-center-line_mean0.2831911426505906
deviation-center-line_min0.1620247894347336
deviation-heading_max2.2040069966368883
deviation-heading_mean1.4148422019341882
deviation-heading_median1.218375420877054
deviation-heading_min0.9167759611460088
driven_any_max1.2827445223589422
driven_any_mean1.014736166443874
driven_any_median1.1350606441335214
driven_any_min0.3480125711176469
driven_lanedir_max0.7202788624391077
driven_lanedir_mean0.5167791411482727
driven_lanedir_min0.11591417145156856
in-drivable-lane_max4.466666666666651
in-drivable-lane_mean2.9266666666666565
in-drivable-lane_min0.8666666666666666
per-episodes
details{"ep000": {"driven_any": 0.3480125711176469, "driven_lanedir": 0.11591417145156856, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 1.733778638085675, "deviation-center-line": 0.1620247894347336}, "ep001": {"driven_any": 1.1350606441335214, "driven_lanedir": 0.6361723258818657, "in-drivable-lane": 3.1666666666666554, "deviation-heading": 1.218375420877054, "deviation-center-line": 0.2952502921419843}, "ep002": {"driven_any": 1.2827445223589422, "driven_lanedir": 0.7202788624391077, "in-drivable-lane": 2.7333333333333236, "deviation-heading": 2.2040069966368883, "deviation-center-line": 0.40892985328262493}, "ep003": {"driven_any": 1.2646460275940734, "driven_lanedir": 0.5817518146270011, "in-drivable-lane": 4.466666666666651, "deviation-heading": 0.9167759611460088, "deviation-center-line": 0.2999117410895583}, "ep004": {"driven_any": 1.0432170670151864, "driven_lanedir": 0.5297785313418206, "in-drivable-lane": 3.399999999999988, "deviation-heading": 1.0012739929253152, "deviation-center-line": 0.249839037304052}}
No reset possible
9832607Samuel LavoiePyTorch templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9821609David AbrahamRandom executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9810607Samuel LavoiePyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9808615David AbrahamPyTorch templateaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:12
Error while running [...]

Creating job9808-6339_visualization_1 ... error
stderr | ERROR: for job9808-6339_visualization_1  Cannot start service visualization: network job9808-6339_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9808-6339_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9799615David AbrahamPyTorch templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9796615David AbrahamPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.433333333333317


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.964819115303646, "good_angle": 1.3887589327794136, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.2}, "ep001": {"nsteps": 51, "reward": -20.172274533440085, "good_angle": 0.06639180550117507, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 233, "reward": -4.806144984634873, "good_angle": 2.659793622525141, "survival_time": 7.766666666666649, "traveled_tiles": 3, "valid_direction": 4.73333333333332}, "ep003": {"nsteps": 235, "reward": -5.393563101096252, "good_angle": 0.9412856968364084, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 4.066666666666656}, "ep004": {"nsteps": 223, "reward": -5.552561751343394, "good_angle": 7.11694324077688, "survival_time": 7.433333333333317, "traveled_tiles": 3, "valid_direction": 4.533333333333317}}
good_angle_max7.11694324077688
good_angle_mean2.434634659683804
good_angle_median1.3887589327794136
good_angle_min0.06639180550117507
reward_max-4.806144984634873
reward_mean-9.777872697163648
reward_median-5.552561751343394
reward_min-20.172274533440085
survival_time_max7.833333333333315
survival_time_mean5.473333333333323
survival_time_min1.700000000000002
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.73333333333332
valid_direction_mean3.1066666666666585
valid_direction_median4.066666666666656
valid_direction_min0
No reset possible
9787636Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9380054565078636
deviation-center-line_median0.7126907630680461
in-drivable-lane_median3.7999999999999865


other stats
deviation-center-line_max1.8349013072161051
deviation-center-line_mean0.7606140342655762
deviation-center-line_min0
deviation-heading_max4.000095424782763
deviation-heading_mean1.9140955172511205
deviation-heading_median1.4637106130961894
deviation-heading_min0
driven_any_max2.143457414751776
driven_any_mean1.6274561666558576
driven_any_median1.674387223358706
driven_any_min0.9118688115095994
driven_lanedir_max2.0579906909896306
driven_lanedir_mean0.9170277469547744
driven_lanedir_min0
in-drivable-lane_max11.39999999999997
in-drivable-lane_mean4.799999999999985
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.6498457175258825, "driven_lanedir": 0, "in-drivable-lane": 11.39999999999997, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.674387223358706, "driven_lanedir": 1.115572352760403, "in-drivable-lane": 3.7999999999999865, "deviation-heading": 2.8712499206109667, "deviation-center-line": 0.7126907630680461}, "ep002": {"driven_any": 0.9118688115095994, "driven_lanedir": 0.4735702345159749, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 1.4637106130961894, "deviation-center-line": 0.33682364155623246}, "ep003": {"driven_any": 1.7577216661333237, "driven_lanedir": 0.9380054565078636, "in-drivable-lane": 5.89999999999998, "deviation-heading": 1.235421627765684, "deviation-center-line": 0.9186544594874968}, "ep004": {"driven_any": 2.143457414751776, "driven_lanedir": 2.0579906909896306, "in-drivable-lane": 0, "deviation-heading": 4.000095424782763, "deviation-center-line": 1.8349013072161051}}
No reset possible
9779636Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9773619Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 20, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9761637Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.923596377492214
deviation-center-line_median0.598222072263049
in-drivable-lane_median4.199999999999986


other stats
deviation-center-line_max1.8296004243788897
deviation-center-line_mean0.7096570701453979
deviation-center-line_min0
deviation-heading_max3.3879538281528547
deviation-heading_mean1.6694373172776165
deviation-heading_median1.3166820421954897
deviation-heading_min0
driven_any_max2.560955350405715
driven_any_mean1.7108638105992384
driven_any_median1.6924691197374462
driven_any_min0.8985776781788103
driven_lanedir_max2.1597206855478968
driven_lanedir_mean0.9213689605600937
driven_lanedir_min0
in-drivable-lane_max11.166666666666638
in-drivable-lane_mean5.206666666666658
in-drivable-lane_min1.8666666666666956
per-episodes
details{"ep000": {"driven_any": 1.651185248502013, "driven_lanedir": 0, "in-drivable-lane": 11.166666666666638, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.6924691197374462, "driven_lanedir": 1.0657936461337636, "in-drivable-lane": 4.199999999999986, "deviation-heading": 2.4635652113902147, "deviation-center-line": 0.598222072263049}, "ep002": {"driven_any": 0.8985776781788103, "driven_lanedir": 0.45773409362659434, "in-drivable-lane": 3.0333333333333226, "deviation-heading": 1.3166820421954897, "deviation-center-line": 0.30870873186510744}, "ep003": {"driven_any": 1.751131656172208, "driven_lanedir": 0.923596377492214, "in-drivable-lane": 5.766666666666647, "deviation-heading": 1.1789855046495232, "deviation-center-line": 0.8117541222199431}, "ep004": {"driven_any": 2.560955350405715, "driven_lanedir": 2.1597206855478968, "in-drivable-lane": 1.8666666666666956, "deviation-heading": 3.3879538281528547, "deviation-center-line": 1.8296004243788897}}
No reset possible
9756627Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9755627Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 123, "reward": -9.773487484073115, "good_angle": 9.474373070331897, "survival_time": 4.099999999999995, "traveled_tiles": 1, "valid_direction": 3.766666666666662}, "ep001": {"nsteps": 44, "reward": -23.395633467896417, "good_angle": 0.31195740639460756, "survival_time": 1.466666666666668, "traveled_tiles": 1, "valid_direction": 0.8666666666666679}, "ep002": {"nsteps": 56, "reward": -18.387873925800836, "good_angle": 0.4571849239074888, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 1.1000000000000023}, "ep003": {"nsteps": 61, "reward": -16.80588266216829, "good_angle": 0.6326124406147391, "survival_time": 2.033333333333336, "traveled_tiles": 1, "valid_direction": 1.3000000000000027}, "ep004": {"nsteps": 58, "reward": -17.784264986885006, "good_angle": 0.42543708518604945, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 1.0666666666666695}}
good_angle_max9.474373070331897
good_angle_mean2.260312985286956
good_angle_median0.4571849239074888
good_angle_min0.31195740639460756
reward_max-9.773487484073115
reward_mean-17.22942850536473
reward_median-17.784264986885006
reward_min-23.395633467896417
survival_time_max4.099999999999995
survival_time_mean2.2800000000000007
survival_time_min1.466666666666668
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max3.766666666666662
valid_direction_mean1.620000000000001
valid_direction_median1.1000000000000023
valid_direction_min0.8666666666666679
No reset possible
9745627Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9742639Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.16799560628334254
deviation-center-line_median0.1275921687394478
in-drivable-lane_median0


other stats
deviation-center-line_max0.35813023851971626
deviation-center-line_mean0.176560935095985
deviation-center-line_min0.07330868470999617
deviation-heading_max1.7672140317213352
deviation-heading_mean0.8311316576700758
deviation-heading_median0.6260601702187025
deviation-heading_min0.3859880512018404
driven_any_max0.8000221769146993
driven_any_mean0.2885697391878303
driven_any_median0.1928443036573294
driven_any_min0.06784622374448418
driven_lanedir_max0.5609233720191817
driven_lanedir_mean0.225130537047932
driven_lanedir_min0.05361157595817767
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8000221769146993, "driven_lanedir": 0.5609233720191817, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7672140317213352, "deviation-center-line": 0.35813023851971626}, "ep001": {"driven_any": 0.06784622374448418, "driven_lanedir": 0.05361157595817767, "in-drivable-lane": 0, "deviation-heading": 0.3859880512018404, "deviation-center-line": 0.07330868470999617}, "ep002": {"driven_any": 0.14641600889079004, "driven_lanedir": 0.1273081104619345, "in-drivable-lane": 0, "deviation-heading": 0.5975079876452586, "deviation-center-line": 0.12568851090570932}, "ep003": {"driven_any": 0.1928443036573294, "driven_lanedir": 0.16799560628334254, "in-drivable-lane": 0, "deviation-heading": 0.7788880475632417, "deviation-center-line": 0.1275921687394478}, "ep004": {"driven_any": 0.2357199827318486, "driven_lanedir": 0.2158140205170236, "in-drivable-lane": 0, "deviation-heading": 0.6260601702187025, "deviation-center-line": 0.1980850726050555}}
No reset possible
9736639Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9733639Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8666666666666691


other stats
episodes
details{"ep000": {"nsteps": 226, "reward": -4.587674556481364, "good_angle": 0.7247360444588931, "survival_time": 7.533333333333316, "traveled_tiles": 2, "valid_direction": 1.1666666666666634}, "ep001": {"nsteps": 21, "reward": -48.25001384956496, "good_angle": 0.363537578698307, "survival_time": 0.7, "traveled_tiles": 1, "valid_direction": 0.4}, "ep002": {"nsteps": 43, "reward": -23.750238817791605, "good_angle": 0.4337188393019458, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 0.8333333333333346}, "ep003": {"nsteps": 56, "reward": -18.23269922831761, "good_angle": 0.5607386589909049, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0.9000000000000019}, "ep004": {"nsteps": 68, "reward": -15.179431705790408, "good_angle": 0.4410155394133939, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.6333333333333333}}
good_angle_max0.7247360444588931
good_angle_mean0.504749332172689
good_angle_median0.4410155394133939
good_angle_min0.363537578698307
reward_max-4.587674556481364
reward_mean-22.000011631589192
reward_median-18.23269922831761
reward_min-48.25001384956496
survival_time_max7.533333333333316
survival_time_mean2.759999999999997
survival_time_min0.7
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.1666666666666634
valid_direction_mean0.7866666666666666
valid_direction_median0.8333333333333346
valid_direction_min0.4
No reset possible
9725639Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
97181266Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
97121265Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
97091265Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyesrudolf-80:00:12
Error while running [...]

Creating job9709-4107_scorer_1 ... error
stderr | ERROR: for job9709-4107_scorer_1  Cannot start service scorer: network job9709-4107_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9709-4107_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
97051264Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.24387304408119936
deviation-center-line_median0.25546789708289697
in-drivable-lane_median0


other stats
deviation-center-line_max0.5283987381208114
deviation-center-line_mean0.298708602091256
deviation-center-line_min0.12210515588581627
deviation-heading_max1.5881511399112795
deviation-heading_mean0.7618736592050787
deviation-heading_median0.6265296549947024
deviation-heading_min0.22875765319475755
driven_any_max0.8643115416717705
driven_any_mean0.3935810619565459
driven_any_median0.25713495150002047
driven_any_min0.15714393369378651
driven_lanedir_max0.6256937734265529
driven_lanedir_mean0.3353789592065308
driven_lanedir_min0.1332456494325296
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8643115416717705, "driven_lanedir": 0.6256937734265529, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.5881511399112795, "deviation-center-line": 0.5283987381208114}, "ep001": {"driven_any": 0.2428713449468751, "driven_lanedir": 0.24142658708782697, "in-drivable-lane": 0, "deviation-heading": 0.22875765319475755, "deviation-center-line": 0.25546789708289697}, "ep002": {"driven_any": 0.15714393369378651, "driven_lanedir": 0.1332456494325296, "in-drivable-lane": 0, "deviation-heading": 0.6265296549947024, "deviation-center-line": 0.12210515588581627}, "ep003": {"driven_any": 0.4464435379702769, "driven_lanedir": 0.4326557420045454, "in-drivable-lane": 0, "deviation-heading": 0.7689204157247529, "deviation-center-line": 0.35776525515722396}, "ep004": {"driven_any": 0.25713495150002047, "driven_lanedir": 0.24387304408119936, "in-drivable-lane": 0, "deviation-heading": 0.5970094321999011, "deviation-center-line": 0.22980596420953128}}
No reset possible
97021264Gunshi Gupta 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:11
Error while running [...]

Creating job9702-3000_videos_1 ... error
stderr | ERROR: for job9702-3000_videos_1  Cannot start service videos: network job9702-3000_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9702-3000_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96021222Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
95991222Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9666666666666697


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -4.719582723466226, "good_angle": 0.827690981535544, "survival_time": 7.399999999999984, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 18, "reward": -56.20794405208694, "good_angle": 0.3910074945079643, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 49, "reward": -20.86513386332259, "good_angle": 0.4576640242189694, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.6666666666666685}, "ep003": {"nsteps": 59, "reward": -17.31513208580219, "good_angle": 0.5169655128458458, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.9000000000000025}, "ep004": {"nsteps": 68, "reward": -15.1840578650727, "good_angle": 0.3522119257447155, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.5666666666666664}}
good_angle_max0.827690981535544
good_angle_mean0.5091079877706078
good_angle_median0.4576640242189694
good_angle_min0.3522119257447155
reward_max-4.719582723466226
reward_mean-22.85837011795013
reward_median-17.31513208580219
reward_min-56.20794405208694
survival_time_max7.399999999999984
survival_time_mean2.773333333333331
survival_time_min0.6
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.8066666666666664
valid_direction_median0.6666666666666685
valid_direction_min0.4333333333333333
No reset possible
95931221Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22096312176243016
deviation-center-line_median0.19880498818659031
in-drivable-lane_median0


other stats
deviation-center-line_max0.6293552507428882
deviation-center-line_mean0.3202451642558324
deviation-center-line_min0.06352079267785976
deviation-heading_max1.788585017682982
deviation-heading_mean0.7994264028128917
deviation-heading_median0.6057069933900288
deviation-heading_min0.3982876917588236
driven_any_max1.0786314197900957
driven_any_mean0.4400159348473123
driven_any_median0.23928782003618104
driven_any_min0.05713532940008824
driven_lanedir_max0.8483114758933026
driven_lanedir_mean0.3831246381751648
driven_lanedir_min0.040915222436129994
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0786314197900957, "driven_lanedir": 0.8483114758933026, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.788585017682982, "deviation-center-line": 0.6293552507428882}, "ep001": {"driven_any": 0.05713532940008824, "driven_lanedir": 0.040915222436129994, "in-drivable-lane": 0, "deviation-heading": 0.3982876917588236, "deviation-center-line": 0.06352079267785976}, "ep002": {"driven_any": 0.18569565058563897, "driven_lanedir": 0.17032416721624788, "in-drivable-lane": 0, "deviation-heading": 0.6057069933900288, "deviation-center-line": 0.16088041312670429}, "ep003": {"driven_any": 0.6393294544245576, "driven_lanedir": 0.6351092035677133, "in-drivable-lane": 0, "deviation-heading": 0.5675983396169617, "deviation-center-line": 0.5486643765451195}, "ep004": {"driven_any": 0.23928782003618104, "driven_lanedir": 0.22096312176243016, "in-drivable-lane": 0, "deviation-heading": 0.6369539716156623, "deviation-center-line": 0.19880498818659031}}
No reset possible
95871221Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
95831220Mandana Samiei 🇨🇦Improved ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 219, "reward": -4.711433204928574, "good_angle": 0.8593331353981082, "survival_time": 7.299999999999984, "traveled_tiles": 2, "valid_direction": 0.8999999999999968}, "ep001": {"nsteps": 108, "reward": -9.843404257463083, "good_angle": 0.03543433536997532, "survival_time": 3.599999999999997, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 49, "reward": -20.87239823323123, "good_angle": 0.4476014846146789, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.8000000000000015}, "ep003": {"nsteps": 57, "reward": -17.92643308273533, "good_angle": 0.48546858928437353, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.933333333333336}, "ep004": {"nsteps": 72, "reward": -14.369250705258716, "good_angle": 0.39009567649755905, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.49999999999999867}}
good_angle_max0.8593331353981082
good_angle_mean0.443586644232939
good_angle_median0.4476014846146789
good_angle_min0.03543433536997532
reward_max-4.711433204928574
reward_mean-13.54458389672339
reward_median-14.369250705258716
reward_min-20.87239823323123
survival_time_max7.299999999999984
survival_time_mean3.3666666666666636
survival_time_min1.633333333333335
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.933333333333336
valid_direction_mean0.6266666666666667
valid_direction_median0.8000000000000015
valid_direction_min0
No reset possible
95751219Mandana Samiei 🇨🇦Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.319983455359965
deviation-center-line_median0.33174953750978914
in-drivable-lane_median0


other stats
deviation-center-line_max0.6509099876476642
deviation-center-line_mean0.33511713874589744
deviation-center-line_min0.1301864645305511
deviation-heading_max1.5797604979275617
deviation-heading_mean0.7649196786586597
deviation-heading_median0.6099670625891219
deviation-heading_min0.26011274137512863
driven_any_max1.1000741042066198
driven_any_mean0.4528758592856047
driven_any_median0.3214479430386286
driven_any_min0.15713599716398322
driven_lanedir_max0.8768350771073734
driven_lanedir_mean0.39849736172116934
driven_lanedir_min0.13699082192683787
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1000741042066198, "driven_lanedir": 0.8768350771073734, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.5797604979275617, "deviation-center-line": 0.6509099876476642}, "ep001": {"driven_any": 0.3214479430386286, "driven_lanedir": 0.319983455359965, "in-drivable-lane": 0, "deviation-heading": 0.26011274137512863, "deviation-center-line": 0.33174953750978914}, "ep002": {"driven_any": 0.15713599716398322, "driven_lanedir": 0.13699082192683787, "in-drivable-lane": 0, "deviation-heading": 0.6099670625891219, "deviation-center-line": 0.1301864645305511}, "ep003": {"driven_any": 0.45358418885246193, "driven_lanedir": 0.43892107953366954, "in-drivable-lane": 0, "deviation-heading": 0.7984988043681084, "deviation-center-line": 0.35299897661705215}, "ep004": {"driven_any": 0.23213706316633032, "driven_lanedir": 0.2197563746780009, "in-drivable-lane": 0, "deviation-heading": 0.5762592870333781, "deviation-center-line": 0.2097407274244307}}
No reset possible
95691219Mandana Samiei 🇨🇦Improved ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0666666666666655


other stats
episodes
details{"ep000": {"nsteps": 310, "reward": -3.4877520964229327, "good_angle": 0.4337545578195331, "survival_time": 10.333333333333307, "traveled_tiles": 3, "valid_direction": 0.7666666666666639}, "ep001": {"nsteps": 92, "reward": -11.437303474091966, "good_angle": 0.028099747606272065, "survival_time": 3.0666666666666655, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 46, "reward": -22.215619474001553, "good_angle": 0.46054995613055394, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.7333333333333348}, "ep003": {"nsteps": 129, "reward": -8.17187888290762, "good_angle": 0.33196345155076035, "survival_time": 4.2999999999999945, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep004": {"nsteps": 67, "reward": -15.426527907599263, "good_angle": 0.28042737289660535, "survival_time": 2.233333333333335, "traveled_tiles": 1, "valid_direction": 0.6333333333333335}}
good_angle_max0.46054995613055394
good_angle_mean0.3069590172007449
good_angle_median0.33196345155076035
good_angle_min0.028099747606272065
reward_max-3.4877520964229327
reward_mean-12.147816367004667
reward_median-11.437303474091966
reward_min-22.215619474001553
survival_time_max10.333333333333307
survival_time_mean4.293333333333328
survival_time_min1.5333333333333348
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.7666666666666639
valid_direction_mean0.5133333333333328
valid_direction_median0.6333333333333335
valid_direction_min0
No reset possible
95591218Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
95491218Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
95371217Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
95341217Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step2-scoringabortedyesrudolf-80:00:11
Error while running [...]

Creating job9534-666_scorer_1 ... error
stderr | ERROR: for job9534-666_scorer_1  Cannot start service scorer: network job9534-666_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9534-666_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95241215Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:12
Error while running [...]

Creating job9524-1916_visualization_1 ... error
stderr | ERROR: for job9524-1916_visualization_1  Cannot start service visualization: network job9524-1916_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9524-1916_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95201215Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5497224612673745, "good_angle": 0.5439216145491801, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.4666666666666714}, "ep001": {"nsteps": 500, "reward": -0.3210465839970857, "good_angle": 21.22155437720925, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.666666666666668}, "ep002": {"nsteps": 500, "reward": -0.6283954581220169, "good_angle": 0.5428892749021961, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.266666666666663}, "ep003": {"nsteps": 500, "reward": -0.3240200620025862, "good_angle": 0.6178064113300014, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.8333333333333268}, "ep004": {"nsteps": 500, "reward": -0.2921708645388717, "good_angle": 13.532035740296866, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 2.566666666666661}}
good_angle_max21.22155437720925
good_angle_mean7.2916414836575
good_angle_median0.6178064113300014
good_angle_min0.5428892749021961
reward_max-0.2921708645388717
reward_mean-0.42307108598558696
reward_median-0.3240200620025862
reward_min-0.6283954581220169
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean17.4
traveled_tiles_median18
traveled_tiles_min15
valid_direction_max3.666666666666668
valid_direction_mean2.1599999999999984
valid_direction_median1.8333333333333268
valid_direction_min1.266666666666663
No reset possible
95141214Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
95111214Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5630718003562651, "good_angle": 0.8280733763807488, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.2666666666666586}, "ep001": {"nsteps": 500, "reward": -0.33669511875876923, "good_angle": 16.193088908095046, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.8333333333333255}, "ep002": {"nsteps": 500, "reward": -0.4914418018744327, "good_angle": 0.8988409791019193, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.366666666666663}, "ep003": {"nsteps": 500, "reward": -0.3387374090035446, "good_angle": 0.848640220116467, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.9666666666666668}, "ep004": {"nsteps": 500, "reward": -0.394331519811818, "good_angle": 21.28040776776547, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.466666666666673}}
good_angle_max21.28040776776547
good_angle_mean8.009810250291931
good_angle_median0.8988409791019193
good_angle_min0.8280733763807488
reward_max-0.33669511875876923
reward_mean-0.4248555299609659
reward_median-0.394331519811818
reward_min-0.5630718003562651
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean16.8
traveled_tiles_median18
traveled_tiles_min12
valid_direction_max3.466666666666673
valid_direction_mean2.5799999999999974
valid_direction_median2.366666666666663
valid_direction_min1.9666666666666668
No reset possible
95041214Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:07:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
94931212Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
94821198Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:04:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median6.723869879395805
deviation-center-line_median1.3426808725237764
in-drivable-lane_median5.800000000000009


other stats
deviation-center-line_max2.6641212570827584
deviation-center-line_mean1.666525148777703
deviation-center-line_min1.1312975209181315
deviation-heading_max2.350815751718024
deviation-heading_mean1.8359602803207635
deviation-heading_median1.9192223500186265
deviation-heading_min1.1508286799004086
driven_any_max10.669880657404462
driven_any_mean10.669611898050016
driven_any_median10.669567404877816
driven_any_min10.66931069339274
driven_lanedir_max10.061272023774444
driven_lanedir_mean7.417589505454768
driven_lanedir_min6.070426244378978
in-drivable-lane_max7.033333333333326
in-drivable-lane_mean4.7266666666666595
in-drivable-lane_min0.6333333333333311
per-episodes
details{"ep000": {"driven_any": 10.669738706006036, "driven_lanedir": 6.723869879395805, "in-drivable-lane": 5.800000000000009, "deviation-heading": 1.5128509438397513, "deviation-center-line": 1.3426808725237764}, "ep001": {"driven_any": 10.66931069339274, "driven_lanedir": 6.347630867600807, "in-drivable-lane": 6.333333333333311, "deviation-heading": 1.9192223500186265, "deviation-center-line": 1.3402180546984168}, "ep002": {"driven_any": 10.669562028569024, "driven_lanedir": 6.070426244378978, "in-drivable-lane": 7.033333333333326, "deviation-heading": 1.1508286799004086, "deviation-center-line": 1.854308038665432}, "ep003": {"driven_any": 10.669567404877816, "driven_lanedir": 7.884748512123808, "in-drivable-lane": 3.833333333333324, "deviation-heading": 2.350815751718024, "deviation-center-line": 1.1312975209181315}, "ep004": {"driven_any": 10.669880657404462, "driven_lanedir": 10.061272023774444, "in-drivable-lane": 0.6333333333333311, "deviation-heading": 2.2460836761270073, "deviation-center-line": 2.6641212570827584}}
No reset possible
94611209Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:07:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
94381205Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:07:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
94321201Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.9481850444094272
deviation-center-line_median0.32550056241262193
in-drivable-lane_median8.333333333333329


other stats
deviation-center-line_max1.2153478135504625
deviation-center-line_mean0.5013748879986238
deviation-center-line_min0.1836695230091552
deviation-heading_max6.589855691489218
deviation-heading_mean6.042797634356681
deviation-heading_median6.496699690885762
deviation-heading_min4.0636220927726505
driven_any_max2.996874232173031
driven_any_mean2.993616762079564
driven_any_median2.9926748839663193
driven_any_min2.991757319703342
driven_lanedir_max-0.8008001232404311
driven_lanedir_mean-0.9192185952416204
driven_lanedir_min-0.9525014373938534
in-drivable-lane_max10.499999999999988
in-drivable-lane_mean8.759999999999994
in-drivable-lane_min8.299999999999997
per-episodes
details{"ep000": {"driven_any": 2.9920549928535545, "driven_lanedir": -0.8008001232404311, "in-drivable-lane": 10.499999999999988, "deviation-heading": 4.0636220927726505, "deviation-center-line": 1.2153478135504625}, "ep001": {"driven_any": 2.9926748839663193, "driven_lanedir": -0.94482519851542, "in-drivable-lane": 8.366666666666664, "deviation-heading": 6.496699690885762, "deviation-center-line": 0.507176031247422}, "ep002": {"driven_any": 2.994722381701575, "driven_lanedir": -0.94978117264897, "in-drivable-lane": 8.299999999999997, "deviation-heading": 6.576357487989261, "deviation-center-line": 0.2751805097734573}, "ep003": {"driven_any": 2.996874232173031, "driven_lanedir": -0.9481850444094272, "in-drivable-lane": 8.299999999999997, "deviation-heading": 6.589855691489218, "deviation-center-line": 0.1836695230091552}, "ep004": {"driven_any": 2.991757319703342, "driven_lanedir": -0.9525014373938534, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.487453208646515, "deviation-center-line": 0.32550056241262193}}
No reset possible
94251201Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
94161201Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9740260388851166, "good_angle": 48.18570431826448, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.199999999999994}, "ep001": {"nsteps": 500, "reward": -1.3310678120851516, "good_angle": 13.696020621438183, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999991}, "ep002": {"nsteps": 500, "reward": -1.1231515201330184, "good_angle": 13.694909529387774, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.966666666666658}, "ep003": {"nsteps": 500, "reward": -0.934308636363945, "good_angle": 13.67484107418178, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.933333333333325}, "ep004": {"nsteps": 500, "reward": -1.1827638384401795, "good_angle": 13.717910197460723, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.86666666666666}}
good_angle_max48.18570431826448
good_angle_mean20.59387714814659
good_angle_median13.696020621438183
good_angle_min13.67484107418178
reward_max-0.934308636363945
reward_mean-1.1090635691814823
reward_median-1.1231515201330184
reward_min-1.3310678120851516
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.199999999999994
valid_direction_mean13.193333333333324
valid_direction_median12.966666666666658
valid_direction_min12.86666666666666
No reset possible
94081200Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
94051200Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 97, "reward": -10.544655245320737, "good_angle": 0.11173963995897508, "survival_time": 3.2333333333333316, "traveled_tiles": 3, "valid_direction": 0}, "ep001": {"nsteps": 30, "reward": -33.87644365131855, "good_angle": 0.023909317209167814, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.033333333333333326}, "ep002": {"nsteps": 500, "reward": -0.7842021786547266, "good_angle": 2.100840251866724, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.699999999999985}, "ep003": {"nsteps": 69, "reward": -14.911100610010866, "good_angle": 0.020366536763589224, "survival_time": 2.3000000000000016, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 27, "reward": -37.48049445395117, "good_angle": 0.15041063828894063, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.23333333333333328}}
good_angle_max2.100840251866724
good_angle_mean0.4814532768174794
good_angle_median0.11173963995897508
good_angle_min0.020366536763589224
reward_max-0.7842021786547266
reward_mean-19.51937922785121
reward_median-14.911100610010866
reward_min-37.48049445395117
survival_time_max16.666666666666654
survival_time_mean4.819999999999997
survival_time_min0.8999999999999999
traveled_tiles_max12
traveled_tiles_mean3.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.699999999999985
valid_direction_mean0.9933333333333304
valid_direction_median0.033333333333333326
valid_direction_min0
No reset possible
94001197Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.25465120905314587
deviation-center-line_median0.22362701193655557
in-drivable-lane_median0


other stats
deviation-center-line_max0.3816283054975945
deviation-center-line_mean0.2371699373728283
deviation-center-line_min0.07662469363190846
deviation-heading_max1.742425682608599
deviation-heading_mean0.8135716681414447
deviation-heading_median0.6025591232774422
deviation-heading_min0.3730724766130892
driven_any_max0.7928850378970975
driven_any_mean0.3550011540382195
driven_any_median0.27142712565474747
driven_any_min0.07141612631846139
driven_lanedir_max0.5574718931641964
driven_lanedir_mean0.29665635884972563
driven_lanedir_min0.05867089624808841
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7928850378970975, "driven_lanedir": 0.5574718931641964, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.742425682608599, "deviation-center-line": 0.3481980975540748}, "ep001": {"driven_any": 0.07141612631846139, "driven_lanedir": 0.05867089624808841, "in-drivable-lane": 0, "deviation-heading": 0.3730724766130892, "deviation-center-line": 0.07662469363190846}, "ep002": {"driven_any": 0.17855447609770914, "driven_lanedir": 0.1645693621812654, "in-drivable-lane": 0, "deviation-heading": 0.5691995566841367, "deviation-center-line": 0.155771578244008}, "ep003": {"driven_any": 0.460723004223082, "driven_lanedir": 0.4479184336019322, "in-drivable-lane": 0, "deviation-heading": 0.7806015015239566, "deviation-center-line": 0.3816283054975945}, "ep004": {"driven_any": 0.27142712565474747, "driven_lanedir": 0.25465120905314587, "in-drivable-lane": 0, "deviation-heading": 0.6025591232774422, "deviation-center-line": 0.22362701193655557}}
No reset possible
93961197Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
93921195Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3350724137359278
deviation-center-line_median0.08460717324955565
in-drivable-lane_median0


other stats
deviation-center-line_max0.1311571309456492
deviation-center-line_mean0.09637389741862892
deviation-center-line_min0.07062442080167732
deviation-heading_max0.48994196193550665
deviation-heading_mean0.2389070045973487
deviation-heading_median0.21370711723795985
deviation-heading_min0.07117180655786653
driven_any_max0.85992269574158
driven_any_mean0.4200386582881703
driven_any_median0.3383936202769923
driven_any_min0.2386265608769872
driven_lanedir_max0.6408817870177377
driven_lanedir_mean0.37037729485707827
driven_lanedir_min0.2369018599959687
in-drivable-lane_max0.5666666666666667
in-drivable-lane_mean0.11333333333333331
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.85992269574158, "driven_lanedir": 0.6408817870177377, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0.48994196193550665, "deviation-center-line": 0.1311571309456492}, "ep001": {"driven_any": 0.2386265608769872, "driven_lanedir": 0.2369018599959687, "in-drivable-lane": 0, "deviation-heading": 0.07117180655786653, "deviation-center-line": 0.07062442080167732}, "ep002": {"driven_any": 0.3383936202769923, "driven_lanedir": 0.3350724137359278, "in-drivable-lane": 0, "deviation-heading": 0.12082806983930684, "deviation-center-line": 0.08396881896014677}, "ep003": {"driven_any": 0.4125618032251772, "driven_lanedir": 0.39868397729394367, "in-drivable-lane": 0, "deviation-heading": 0.2988860674161038, "deviation-center-line": 0.11151194313611554}, "ep004": {"driven_any": 0.2506886113201149, "driven_lanedir": 0.2403464362418135, "in-drivable-lane": 0, "deviation-heading": 0.21370711723795985, "deviation-center-line": 0.08460717324955565}}
No reset possible
93891195Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
93791196Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 482, in wrap_evaluator
    raise InvalidEnvironment(out[SPECIAL_INVALID_ENVIRONMENT])
InvalidEnvironment: InvalidEnvironment:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution_ddpg.py", line 140, in run
    solve(params, cis)
  File "solution_ddpg.py", line 90, in solve
    check_valid_observations(observation)
  File "solution_ddpg.py", line 18, in check_valid_observations
    raise InvalidEnvironment(msg)
InvalidEnvironment: I expected size (480, 640, 3), while I got size (3, 120, 160)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93731194Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution_ddpg.py", line 140, in run
    solve(params, cis)
  File "solution_ddpg.py", line 82, in solve
    model.load("model", "models")
  File "/workspace/model.py", line 232, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 719, in load_state_dict
    self.__class__.__name__, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for ActorCNN:
	Missing key(s) in state_dict: "bn1.running_var", "bn1.bias", "bn1.weight", "bn1.running_mean", "bn2.running_var", "bn2.bias", "bn2.weight", "bn2.running_mean", "bn3.running_var", "bn3.bias", "bn3.weight", "bn3.running_mean", "bn4.running_var", "bn4.bias", "bn4.weight", "bn4.running_mean". 


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93681193Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.5333333333333348


other stats
episodes
details{"ep000": {"nsteps": 71, "reward": -14.22417149125946, "good_angle": 0.3338534572823311, "survival_time": 2.366666666666668, "traveled_tiles": 2, "valid_direction": 0.33333333333333215}, "ep001": {"nsteps": 28, "reward": -36.29263753443957, "good_angle": 0.0069164988446014765, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 42, "reward": -24.26853745324271, "good_angle": 0.13949759890818414, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.2333333333333341}, "ep003": {"nsteps": 46, "reward": -22.1674320626518, "good_angle": 0.019680242706311565, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 61, "reward": -16.83373046116751, "good_angle": 0.010555403823120408, "survival_time": 2.033333333333336, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.3338534572823311
good_angle_mean0.10210064031290976
good_angle_median0.019680242706311565
good_angle_min0.0069164988446014765
reward_max-14.22417149125946
reward_mean-22.75730180055221
reward_median-22.1674320626518
reward_min-36.29263753443957
survival_time_max2.366666666666668
survival_time_mean1.6533333333333349
survival_time_min0.9333333333333332
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.33333333333333215
valid_direction_mean0.11333333333333324
valid_direction_median0
valid_direction_min0
No reset possible
93651193Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:16
Error while running [...]

Creating job9365-4127_solution_1  ... error
stderr | ERROR: for job9365-4127_solution_1  Cannot start service solution: network job9365-4127_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9365-4127_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9365-4127_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93581190Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:04:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.984151000697771
deviation-center-line_median0.6893753521204821
in-drivable-lane_median3.200000000000024


other stats
deviation-center-line_max2.626477136716715
deviation-center-line_mean1.3433504990270713
deviation-center-line_min0.47395804848601863
deviation-heading_max2.0915769727992854
deviation-heading_mean1.6561532476546184
deviation-heading_median1.5009651979141128
deviation-heading_min1.3373728323140583
driven_any_max6.338709442005975
driven_any_mean6.241504701899715
driven_any_median6.2507791125124665
driven_any_min6.160823335985373
driven_lanedir_max6.285016317436751
driven_lanedir_mean4.3646513275512815
driven_lanedir_min2.1551422477187554
in-drivable-lane_max10.6
in-drivable-lane_mean4.833333333333338
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.190868387153463, "driven_lanedir": 2.8985258526718285, "in-drivable-lane": 8.700000000000006, "deviation-heading": 1.5009651979141128, "deviation-center-line": 0.5135610546891989}, "ep001": {"driven_any": 6.160823335985373, "driven_lanedir": 5.500421219231302, "in-drivable-lane": 1.6666666666666607, "deviation-heading": 2.0915769727992854, "deviation-center-line": 2.4133809031229423}, "ep002": {"driven_any": 6.2507791125124665, "driven_lanedir": 2.1551422477187554, "in-drivable-lane": 10.6, "deviation-heading": 1.3373728323140583, "deviation-center-line": 0.47395804848601863}, "ep003": {"driven_any": 6.266343231841298, "driven_lanedir": 4.984151000697771, "in-drivable-lane": 3.200000000000024, "deviation-heading": 1.924641661815529, "deviation-center-line": 0.6893753521204821}, "ep004": {"driven_any": 6.338709442005975, "driven_lanedir": 6.285016317436751, "in-drivable-lane": 0, "deviation-heading": 1.4262095734301063, "deviation-center-line": 2.626477136716715}}
No reset possible
93511190Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
93471190Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6048743495787494, "good_angle": 0.8846231554803591, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.1333333333333258}, "ep001": {"nsteps": 500, "reward": -0.6484833833500743, "good_angle": 32.0327640143225, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.833333333333334}, "ep002": {"nsteps": 500, "reward": -0.7368488358687609, "good_angle": 0.7951790339256591, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.166666666666659}, "ep003": {"nsteps": 500, "reward": -0.28837004880889433, "good_angle": 0.7430058403559094, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.699999999999994}, "ep004": {"nsteps": 500, "reward": -0.5163634683582932, "good_angle": 23.348413220397077, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.9000000000000163}}
good_angle_max32.0327640143225
good_angle_mean11.560797052896302
good_angle_median0.8846231554803591
good_angle_min0.7430058403559094
reward_max-0.28837004880889433
reward_mean-0.5589880171929544
reward_median-0.6048743495787494
reward_min-0.7368488358687609
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max13
traveled_tiles_mean12.6
traveled_tiles_median13
traveled_tiles_min12
valid_direction_max4.833333333333334
valid_direction_mean2.7466666666666657
valid_direction_median2.166666666666659
valid_direction_min1.699999999999994
No reset possible
93381189Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednorudolf-80:07:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93321183Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.572094622720567
deviation-center-line_median1.0268326650454336
in-drivable-lane_median2.9000000000000252


other stats
deviation-center-line_max2.4722919320783845
deviation-center-line_mean1.1883245653497636
deviation-center-line_min0.12547869475003498
deviation-heading_max2.001039106664222
deviation-heading_mean1.3843315777054772
deviation-heading_median1.5516034705839648
deviation-heading_min0.06150333227412977
driven_any_max6.29911149925698
driven_any_mean5.098661940666561
driven_any_median6.282667364114203
driven_any_min0.4376161423520308
driven_lanedir_max6.237488834148862
driven_lanedir_mean3.759713838351967
driven_lanedir_min0.4368002742591542
in-drivable-lane_max7.066666666666675
in-drivable-lane_mean3.3800000000000026
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.189798211292995, "driven_lanedir": 3.4514667299345216, "in-drivable-lane": 7.066666666666675, "deviation-heading": 1.804691978191281, "deviation-center-line": 0.9945927606481}, "ep001": {"driven_any": 0.4376161423520308, "driven_lanedir": 0.4368002742591542, "in-drivable-lane": 0, "deviation-heading": 0.06150333227412977, "deviation-center-line": 0.12547869475003498}, "ep002": {"driven_any": 6.284116486316595, "driven_lanedir": 3.572094622720567, "in-drivable-lane": 6.93333333333331, "deviation-heading": 1.5028200008137895, "deviation-center-line": 1.3224267742268647}, "ep003": {"driven_any": 6.282667364114203, "driven_lanedir": 5.100718730696729, "in-drivable-lane": 2.9000000000000252, "deviation-heading": 2.001039106664222, "deviation-center-line": 1.0268326650454336}, "ep004": {"driven_any": 6.29911149925698, "driven_lanedir": 6.237488834148862, "in-drivable-lane": 0, "deviation-heading": 1.5516034705839648, "deviation-center-line": 2.4722919320783845}}
No reset possible
93251183Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
93201183Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6577665891668876, "good_angle": 0.9337697894955168, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.2333333333333254}, "ep001": {"nsteps": 36, "reward": -28.324007783499027, "good_angle": 0.00434334770210872, "survival_time": 1.2000000000000004, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.7150965188799892, "good_angle": 0.8009578206121651, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.0666666666666593}, "ep003": {"nsteps": 500, "reward": -0.45919114929344507, "good_angle": 0.5955313596451927, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.4333333333333282}, "ep004": {"nsteps": 500, "reward": -0.45975916462694294, "good_angle": 22.276000348281308, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.7666666666666835}}
good_angle_max22.276000348281308
good_angle_mean4.922120533147258
good_angle_median0.8009578206121651
good_angle_min0.00434334770210872
reward_max-0.45919114929344507
reward_mean-6.123164241093258
reward_median-0.6577665891668876
reward_min-28.324007783499027
survival_time_max16.666666666666654
survival_time_mean13.573333333333323
survival_time_min1.2000000000000004
traveled_tiles_max13
traveled_tiles_mean10.2
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max2.7666666666666835
valid_direction_mean1.6999999999999993
valid_direction_median2.0666666666666593
valid_direction_min0
No reset possible
93151184Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
93081180Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.624752186943482
deviation-center-line_median1.1295785831204983
in-drivable-lane_median2.933333333333323


other stats
deviation-center-line_max1.379343147692024
deviation-center-line_mean0.9007972237204894
deviation-center-line_min0.24741031396476473
deviation-heading_max3.1245182549161745
deviation-heading_mean2.07937344325996
deviation-heading_median2.44663621824183
deviation-heading_min0.5745931443622132
driven_any_max6.299996698962813
driven_any_mean4.328887643847964
driven_any_median6.215093919458589
driven_any_min1.201349522780205
driven_lanedir_max5.060471613390751
driven_lanedir_mean3.397957481084819
driven_lanedir_min0.9599442971508084
in-drivable-lane_max3.8666666666666543
in-drivable-lane_mean2.1999999999999926
in-drivable-lane_min0.3999999999999986
per-episodes
details{"ep000": {"driven_any": 6.215093919458589, "driven_lanedir": 4.624752186943482, "in-drivable-lane": 3.8666666666666543, "deviation-heading": 3.020428063423033, "deviation-center-line": 1.1295785831204983}, "ep001": {"driven_any": 1.201349522780205, "driven_lanedir": 0.9599442971508084, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 1.2306915353565488, "deviation-center-line": 0.24741031396476473}, "ep002": {"driven_any": 6.257336093288788, "driven_lanedir": 4.984035375238558, "in-drivable-lane": 2.933333333333323, "deviation-heading": 3.1245182549161745, "deviation-center-line": 1.379343147692024}, "ep003": {"driven_any": 6.299996698962813, "driven_lanedir": 5.060471613390751, "in-drivable-lane": 2.9999999999999893, "deviation-heading": 2.44663621824183, "deviation-center-line": 1.240540064820694}, "ep004": {"driven_any": 1.6706619847494255, "driven_lanedir": 1.3605839327004934, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.5745931443622132, "deviation-center-line": 0.5071140090044659}}
No reset possible
92981180Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.2873053438300849, "good_angle": 1.3414091196782951, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.899999999999986}, "ep001": {"nsteps": 103, "reward": -10.591722322211972, "good_angle": 8.236018385735145, "survival_time": 3.433333333333331, "traveled_tiles": 2, "valid_direction": 2.333333333333331}, "ep002": {"nsteps": 500, "reward": -0.2954915684715379, "good_angle": 1.4333918973833295, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.566666666666654}, "ep003": {"nsteps": 500, "reward": -0.23761464420356787, "good_angle": 1.121569714476965, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.599999999999987}, "ep004": {"nsteps": 135, "reward": -8.226718127812017, "good_angle": 11.429720028085429, "survival_time": 4.499999999999994, "traveled_tiles": 3, "valid_direction": 2.099999999999994}}
good_angle_max11.429720028085429
good_angle_mean4.712421829071832
good_angle_median1.4333918973833295
good_angle_min1.121569714476965
reward_max-0.23761464420356787
reward_mean-3.927770401305835
reward_median-0.2954915684715379
reward_min-10.591722322211972
survival_time_max16.666666666666654
survival_time_mean11.586666666666655
survival_time_min3.433333333333331
traveled_tiles_max12
traveled_tiles_mean8.2
traveled_tiles_median12
traveled_tiles_min2
valid_direction_max4.566666666666654
valid_direction_mean3.29999999999999
valid_direction_median3.599999999999987
valid_direction_min2.099999999999994
No reset possible
92901181Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 217, "reward": -4.842466158233905, "good_angle": 0.948393067959257, "survival_time": 7.233333333333317, "traveled_tiles": 2, "valid_direction": 1.999999999999993}, "ep001": {"nsteps": 54, "reward": -19.071285682143987, "good_angle": 0.02955953031078824, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 188, "reward": -5.826680191178271, "good_angle": 0.04020312858748907, "survival_time": 6.266666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 56, "reward": -18.223405375810607, "good_angle": 0.5759211627899659, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0.9333333333333358}, "ep004": {"nsteps": 69, "reward": -14.968534817298254, "good_angle": 0.4190348981693709, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.5666666666666662}}
good_angle_max0.948393067959257
good_angle_mean0.4026223575633742
good_angle_median0.4190348981693709
good_angle_min0.02955953031078824
reward_max-4.842466158233905
reward_mean-12.586474444933003
reward_median-14.968534817298254
reward_min-19.071285682143987
survival_time_max7.233333333333317
survival_time_mean3.8933333333333286
survival_time_min1.8000000000000025
traveled_tiles_max3
traveled_tiles_mean1.6
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.999999999999993
valid_direction_mean0.699999999999999
valid_direction_median0.5666666666666662
valid_direction_min0
No reset possible
92871179Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1649437824260569
deviation-center-line_median0.13243503971563902
in-drivable-lane_median0


other stats
deviation-center-line_max0.610442361111327
deviation-center-line_mean0.227160963172995
deviation-center-line_min0.06414326745356295
deviation-heading_max1.7944749721836863
deviation-heading_mean0.8394922938263457
deviation-heading_median0.6120882921659977
deviation-heading_min0.4147969600862146
driven_any_max1.0500541667754486
driven_any_mean0.3407215514586022
driven_any_median0.19285276555405975
driven_any_min0.057135127241617914
driven_lanedir_max0.8152570058007609
driven_lanedir_mean0.27738538643979316
driven_lanedir_min0.03979046898309191
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0500541667754486, "driven_lanedir": 0.8152570058007609, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7944749721836863, "deviation-center-line": 0.610442361111327}, "ep001": {"driven_any": 0.057135127241617914, "driven_lanedir": 0.03979046898309191, "in-drivable-lane": 0, "deviation-heading": 0.4147969600862146, "deviation-center-line": 0.06414326745356295}, "ep002": {"driven_any": 0.1571315237053625, "driven_lanedir": 0.13729903188722825, "in-drivable-lane": 0, "deviation-heading": 0.6120882921659977, "deviation-center-line": 0.13243503971563902}, "ep003": {"driven_any": 0.19285276555405975, "driven_lanedir": 0.1649437824260569, "in-drivable-lane": 0, "deviation-heading": 0.7980399760079753, "deviation-center-line": 0.12009194215469315}, "ep004": {"driven_any": 0.2464341740165223, "driven_lanedir": 0.22963664310182796, "in-drivable-lane": 0, "deviation-heading": 0.578061268687855, "deviation-center-line": 0.2086922054297528}}
No reset possible
92801178Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.28060777012340976
deviation-center-line_median0.22721196650330475
in-drivable-lane_median0


other stats
deviation-center-line_max0.397387598231267
deviation-center-line_mean0.25293935350159086
deviation-center-line_min0.13210976538295569
deviation-heading_max1.7444564974638874
deviation-heading_mean0.7954867340184384
deviation-heading_median0.6045070411462525
deviation-heading_min0.2618915420632834
driven_any_max0.5678510646493321
driven_any_mean0.3450032324283415
driven_any_median0.2821608403404374
driven_any_min0.19998585583219508
driven_lanedir_max0.42669405448571496
driven_lanedir_mean0.2838617218300153
driven_lanedir_min0.1775901034723475
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5678510646493321, "driven_lanedir": 0.3130090110394963, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7444564974638874, "deviation-center-line": 0.22721196650330475}, "ep001": {"driven_any": 0.2821608403404374, "driven_lanedir": 0.28060777012340976, "in-drivable-lane": 0, "deviation-heading": 0.2618915420632834, "deviation-center-line": 0.30221720153425513}, "ep002": {"driven_any": 0.43572704749065816, "driven_lanedir": 0.42669405448571496, "in-drivable-lane": 0, "deviation-heading": 0.5989330467566464, "deviation-center-line": 0.397387598231267}, "ep003": {"driven_any": 0.19998585583219508, "driven_lanedir": 0.1775901034723475, "in-drivable-lane": 0, "deviation-heading": 0.7676455426621223, "deviation-center-line": 0.13210976538295569}, "ep004": {"driven_any": 0.2392913538290846, "driven_lanedir": 0.22140767002910788, "in-drivable-lane": 0, "deviation-heading": 0.6045070411462525, "deviation-center-line": 0.20577023585617177}}
No reset possible
92691178Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
92631177Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3140615527405992
deviation-center-line_median0.2120344929627202
in-drivable-lane_median0


other stats
deviation-center-line_max0.3825504647991373
deviation-center-line_mean0.2555782149297515
deviation-center-line_min0.13299211806624614
deviation-heading_max1.8124373524520645
deviation-heading_mean0.8371617918782187
deviation-heading_median0.6068979230123304
deviation-heading_min0.43067669951320775
driven_any_max0.5857327986545419
driven_any_mean0.3564370675813312
driven_any_median0.3214398113505129
driven_any_min0.20355954308580224
driven_lanedir_max0.41144029184237896
driven_lanedir_mean0.29196390143672385
driven_lanedir_min0.1819474087964288
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5857327986545419, "driven_lanedir": 0.32097209404557536, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8124373524520645, "deviation-center-line": 0.2120344929627202}, "ep001": {"driven_any": 0.3214398113505129, "driven_lanedir": 0.3140615527405992, "in-drivable-lane": 0, "deviation-heading": 0.43067669951320775, "deviation-center-line": 0.34423621628418904}, "ep002": {"driven_any": 0.4214477505013758, "driven_lanedir": 0.41144029184237896, "in-drivable-lane": 0, "deviation-heading": 0.6068979230123304, "deviation-center-line": 0.3825504647991373}, "ep003": {"driven_any": 0.20355954308580224, "driven_lanedir": 0.1819474087964288, "in-drivable-lane": 0, "deviation-heading": 0.739481192030715, "deviation-center-line": 0.13299211806624614}, "ep004": {"driven_any": 0.25000543431442346, "driven_lanedir": 0.23139815975863695, "in-drivable-lane": 0, "deviation-heading": 0.5963157923827757, "deviation-center-line": 0.2060777825364651}}
No reset possible
92561177Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
92511176Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2897700948456188
deviation-center-line_median0.21325377575604887
in-drivable-lane_median0


other stats
deviation-center-line_max0.3839568997326553
deviation-center-line_mean0.26090764562259866
deviation-center-line_min0.125734762295888
deviation-heading_max1.8553375980302735
deviation-heading_mean0.8580896591975599
deviation-heading_median0.5903936570676821
deviation-heading_min0.4743116047801178
driven_any_max0.5607378452704351
driven_any_mean0.35572159647264345
driven_any_median0.3535794096134567
driven_any_min0.19642466917282783
driven_lanedir_max0.40935666493497447
driven_lanedir_mean0.28993617177336456
driven_lanedir_min0.16896276576503633
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5607378452704351, "driven_lanedir": 0.2897700948456188, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8553375980302735, "deviation-center-line": 0.20787567150415448}, "ep001": {"driven_any": 0.3535794096134567, "driven_lanedir": 0.3464077223005848, "in-drivable-lane": 0, "deviation-heading": 0.4743116047801178, "deviation-center-line": 0.37371711882424674}, "ep002": {"driven_any": 0.41787113051790353, "driven_lanedir": 0.40935666493497447, "in-drivable-lane": 0, "deviation-heading": 0.5903936570676821, "deviation-center-line": 0.3839568997326553}, "ep003": {"driven_any": 0.19642466917282783, "driven_lanedir": 0.16896276576503633, "in-drivable-lane": 0, "deviation-heading": 0.7825890900920623, "deviation-center-line": 0.125734762295888}, "ep004": {"driven_any": 0.24999492778859425, "driven_lanedir": 0.23518361102060847, "in-drivable-lane": 0, "deviation-heading": 0.5878163460176635, "deviation-center-line": 0.21325377575604887}}
No reset possible
92421176Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
92381176Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.3666666666666645


other stats
episodes
details{"ep000": {"nsteps": 159, "reward": -6.4198667989727465, "good_angle": 1.4492498835654923, "survival_time": 5.299999999999991, "traveled_tiles": 2, "valid_direction": 1.7999999999999945}, "ep001": {"nsteps": 101, "reward": -10.492905078252944, "good_angle": 0.1911827441975591, "survival_time": 3.3666666666666645, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 119, "reward": -8.908292793927073, "good_angle": 0.20649372294072615, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 0.36666666666666536}, "ep003": {"nsteps": 57, "reward": -17.91029588159239, "good_angle": 0.6202963302408272, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.800000000000002}, "ep004": {"nsteps": 72, "reward": -14.361503334922922, "good_angle": 0.3358323416537987, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.6999999999999993}}
good_angle_max1.4492498835654923
good_angle_mean0.5606110045196807
good_angle_median0.3358323416537987
good_angle_min0.1911827441975591
reward_max-6.4198667989727465
reward_mean-11.618572777533617
reward_median-10.492905078252944
reward_min-17.91029588159239
survival_time_max5.299999999999991
survival_time_mean3.3866666666666645
survival_time_min1.9000000000000024
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.7999999999999945
valid_direction_mean0.7866666666666654
valid_direction_median0.6999999999999993
valid_direction_min0.2666666666666657
No reset possible
92321176Tien NguyenROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
92261175Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
92211175Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.899999999999996


other stats
episodes
details{"ep000": {"nsteps": 153, "reward": -6.688718417593205, "good_angle": 1.3498627460913, "survival_time": 5.099999999999992, "traveled_tiles": 2, "valid_direction": 2.2333333333333254}, "ep001": {"nsteps": 92, "reward": -11.46228821089734, "good_angle": 0.030996602946483435, "survival_time": 3.0666666666666655, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 117, "reward": -9.020670182939268, "good_angle": 0.09301724975869884, "survival_time": 3.899999999999996, "traveled_tiles": 2, "valid_direction": 0.2666666666666657}, "ep003": {"nsteps": 169, "reward": -6.3763778808818765, "good_angle": 0.08570572926321202, "survival_time": 5.633333333333323, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 71, "reward": -14.53416777622532, "good_angle": 0.3426253908019395, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0.6666666666666663}}
good_angle_max1.3498627460913
good_angle_mean0.3804415437723267
good_angle_median0.09301724975869884
good_angle_min0.030996602946483435
reward_max-6.3763778808818765
reward_mean-9.616444493707402
reward_median-9.020670182939268
reward_min-14.53416777622532
survival_time_max5.633333333333323
survival_time_mean4.013333333333328
survival_time_min2.366666666666668
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.2333333333333254
valid_direction_mean0.6333333333333314
valid_direction_median0.2666666666666657
valid_direction_min0
No reset possible
92161175Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
92051174Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:07:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
91991172Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 221, "reward": -4.680065435220433, "good_angle": 0.8143340540122375, "survival_time": 7.36666666666665, "traveled_tiles": 2, "valid_direction": 1.03333333333333}, "ep001": {"nsteps": 88, "reward": -11.970444464548068, "good_angle": 0.09934511537248952, "survival_time": 2.9333333333333327, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 48, "reward": -21.25994161920001, "good_angle": 0.5257756234168345, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.7000000000000017}, "ep003": {"nsteps": 61, "reward": -16.74233506925282, "good_angle": 0.4446579903733168, "survival_time": 2.033333333333336, "traveled_tiles": 1, "valid_direction": 0.8333333333333355}, "ep004": {"nsteps": 72, "reward": -14.358987438182035, "good_angle": 0.3486535214226296, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.599999999999999}}
good_angle_max0.8143340540122375
good_angle_mean0.4465532609195016
good_angle_median0.4446579903733168
good_angle_min0.09934511537248952
reward_max-4.680065435220433
reward_mean-13.802354805280675
reward_median-14.358987438182035
reward_min-21.25994161920001
survival_time_max7.36666666666665
survival_time_mean3.2666666666666644
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.03333333333333
valid_direction_mean0.693333333333333
valid_direction_median0.7000000000000017
valid_direction_min0.29999999999999893
No reset possible
91921172Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
91841171Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91751170Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91721167Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
91671167Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
91521164Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.20552955460650055
deviation-center-line_median0.147201300169161
in-drivable-lane_median0


other stats
deviation-center-line_max0.35753048570357787
deviation-center-line_mean0.1907781397534624
deviation-center-line_min0.09263278175679672
deviation-heading_max1.7183292422352954
deviation-heading_mean0.7984177229793936
deviation-heading_median0.5858313015455301
deviation-heading_min0.38730041512189434
driven_any_max0.7928873277300456
driven_any_mean0.3064261243806684
driven_any_median0.22498124254441865
driven_any_min0.08927605174825964
driven_lanedir_max0.5510805099921994
driven_lanedir_mean0.24507277155126625
driven_lanedir_min0.07586780200910015
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7928873277300456, "driven_lanedir": 0.5510805099921994, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7183292422352954, "deviation-center-line": 0.35753048570357787}, "ep001": {"driven_any": 0.08927605174825964, "driven_lanedir": 0.07586780200910015, "in-drivable-lane": 0, "deviation-heading": 0.38730041512189434, "deviation-center-line": 0.09263278175679672}, "ep002": {"driven_any": 0.17141768242842462, "driven_lanedir": 0.15359552259448783, "in-drivable-lane": 0, "deviation-heading": 0.5858313015455301, "deviation-center-line": 0.1407064486409552}, "ep003": {"driven_any": 0.22498124254441865, "driven_lanedir": 0.20552955460650055, "in-drivable-lane": 0, "deviation-heading": 0.7449872273121362, "deviation-center-line": 0.147201300169161}, "ep004": {"driven_any": 0.2535683174521935, "driven_lanedir": 0.23929046855404312, "in-drivable-lane": 0, "deviation-heading": 0.5556404286821123, "deviation-center-line": 0.2158196824968214}}
No reset possible
91471164Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1666666666666687


other stats
episodes
details{"ep000": {"nsteps": 224, "reward": -4.631782300203538, "good_angle": 0.8131950448457954, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 1.1333333333333309}, "ep001": {"nsteps": 27, "reward": -37.63428637495747, "good_angle": 0.35136522426430206, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 50, "reward": -20.46433407068253, "good_angle": 0.4230690672846215, "survival_time": 1.6666666666666683, "traveled_tiles": 2, "valid_direction": 0.7000000000000018}, "ep003": {"nsteps": 65, "reward": -15.740901627334264, "good_angle": 0.44774358190267566, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 0.8333333333333346}, "ep004": {"nsteps": 73, "reward": -14.169405204384294, "good_angle": 0.34434156301095536, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 0.4999999999999989}}
good_angle_max0.8131950448457954
good_angle_mean0.47594289626167
good_angle_median0.4230690672846215
good_angle_min0.34434156301095536
reward_max-4.631782300203538
reward_mean-18.528141915512418
reward_median-15.740901627334264
reward_min-37.63428637495747
survival_time_max7.46666666666665
survival_time_mean2.9266666666666636
survival_time_min0.8999999999999999
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.1333333333333309
valid_direction_mean0.7266666666666666
valid_direction_median0.7000000000000018
valid_direction_min0.4666666666666666
No reset possible
91431165Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
91401163Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:11
Error while running [...]

Creating job9140-9975_videos_1 ... error
stderr | ERROR: for job9140-9975_videos_1  Cannot start service videos: network job9140-9975_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9140-9975_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91291162Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2185485074612008
deviation-center-line_median0.19974128076328243
in-drivable-lane_median0


other stats
deviation-center-line_max0.3887759641752293
deviation-center-line_mean0.23340816860059344
deviation-center-line_min0.12020102693688917
deviation-heading_max1.749687922801705
deviation-heading_mean0.8362686123408803
deviation-heading_median0.5987280401906994
deviation-heading_min0.4947769158387082
driven_any_max0.7821820610895577
driven_any_mean0.3457229945267223
driven_any_median0.23572337181203143
driven_any_min0.15356456150477713
driven_lanedir_max0.5383451271517545
driven_lanedir_mean0.28368299284687526
driven_lanedir_min0.13569835873012037
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7821820610895577, "driven_lanedir": 0.5383451271517545, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.749687922801705, "deviation-center-line": 0.32919661184900934}, "ep001": {"driven_any": 0.3642963592732329, "driven_lanedir": 0.35690061102931536, "in-drivable-lane": 0, "deviation-heading": 0.4947769158387082, "deviation-center-line": 0.3887759641752293}, "ep002": {"driven_any": 0.15356456150477713, "driven_lanedir": 0.13569835873012037, "in-drivable-lane": 0, "deviation-heading": 0.5803227444945604, "deviation-center-line": 0.12912595927855722}, "ep003": {"driven_any": 0.1928486189540123, "driven_lanedir": 0.16892235986198534, "in-drivable-lane": 0, "deviation-heading": 0.7578274383787285, "deviation-center-line": 0.12020102693688917}, "ep004": {"driven_any": 0.23572337181203143, "driven_lanedir": 0.2185485074612008, "in-drivable-lane": 0, "deviation-heading": 0.5987280401906994, "deviation-center-line": 0.19974128076328243}}
No reset possible
91261162Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2666666666666684


other stats
episodes
details{"ep000": {"nsteps": 221, "reward": -4.675565453111976, "good_angle": 0.8451160438016592, "survival_time": 7.36666666666665, "traveled_tiles": 2, "valid_direction": 1.2666666666666622}, "ep001": {"nsteps": 104, "reward": -10.214234543247866, "good_angle": 0.19508200108448556, "survival_time": 3.466666666666664, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 45, "reward": -22.701366038454903, "good_angle": 0.41322570403495035, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 0.6666666666666681}, "ep003": {"nsteps": 56, "reward": -18.206758076724196, "good_angle": 0.5410262900731403, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0.8666666666666692}, "ep004": {"nsteps": 68, "reward": -15.179301152334494, "good_angle": 0.38262783592459754, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.5666666666666664}}
good_angle_max0.8451160438016592
good_angle_mean0.4754155749837666
good_angle_median0.41322570403495035
good_angle_min0.19508200108448556
reward_max-4.675565453111976
reward_mean-14.195445052774687
reward_median-15.179301152334494
reward_min-22.701366038454903
survival_time_max7.36666666666665
survival_time_mean3.293333333333331
survival_time_min1.500000000000001
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.2666666666666622
valid_direction_mean0.7266666666666663
valid_direction_median0.6666666666666681
valid_direction_min0.2666666666666657
No reset possible
91221161Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.207501904724555
deviation-center-line_median0.199117543008356
in-drivable-lane_median0


other stats
deviation-center-line_max0.36013014379892433
deviation-center-line_mean0.21890563089739185
deviation-center-line_min0.06610701022197295
deviation-heading_max1.8220352535204696
deviation-heading_mean0.8418700647081033
deviation-heading_median0.6176041495564573
deviation-heading_min0.3793079412520295
driven_any_max0.7750332700063921
driven_any_mean0.3300067493966062
driven_any_median0.22142968999939713
driven_any_min0.06070246001438254
driven_lanedir_max0.5276151666340869
driven_lanedir_mean0.26774277386120654
driven_lanedir_min0.04620417581966674
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7750332700063921, "driven_lanedir": 0.5276151666340869, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8220352535204696, "deviation-center-line": 0.36013014379892433}, "ep001": {"driven_any": 0.06070246001438254, "driven_lanedir": 0.04620417581966674, "in-drivable-lane": 0, "deviation-heading": 0.3793079412520295, "deviation-center-line": 0.06610701022197295}, "ep002": {"driven_any": 0.14641926940265107, "driven_lanedir": 0.12549941503869144, "in-drivable-lane": 0, "deviation-heading": 0.6176041495564573, "deviation-center-line": 0.12449797931105276}, "ep003": {"driven_any": 0.446449057560208, "driven_lanedir": 0.4318932070890326, "in-drivable-lane": 0, "deviation-heading": 0.7968429744010335, "deviation-center-line": 0.34467547814665306}, "ep004": {"driven_any": 0.22142968999939713, "driven_lanedir": 0.207501904724555, "in-drivable-lane": 0, "deviation-heading": 0.5935600048105273, "deviation-center-line": 0.199117543008356}}
No reset possible
91101161Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
90981159Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:05:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
90881158David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
90851156Mandana Samiei 🇨🇦My Improved ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.333333333333335


other stats
episodes
details{"ep000": {"nsteps": 221, "reward": -4.669979619494654, "good_angle": 0.854506904324985, "survival_time": 7.36666666666665, "traveled_tiles": 2, "valid_direction": 1.1333333333333293}, "ep001": {"nsteps": 93, "reward": -11.33756122505793, "good_angle": 0.03361800838719996, "survival_time": 3.0999999999999988, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 47, "reward": -21.753391784556367, "good_angle": 0.4597435137438536, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.7333333333333348}, "ep003": {"nsteps": 59, "reward": -17.308526529220202, "good_angle": 0.48544786970937487, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.9000000000000027}, "ep004": {"nsteps": 70, "reward": -14.75984545179776, "good_angle": 0.36665932241402327, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 0.4999999999999991}}
good_angle_max0.854506904324985
good_angle_mean0.43999512371588734
good_angle_median0.4597435137438536
good_angle_min0.03361800838719996
reward_max-4.669979619494654
reward_mean-13.965860922025382
reward_median-14.75984545179776
reward_min-21.753391784556367
survival_time_max7.36666666666665
survival_time_mean3.2666666666666644
survival_time_min1.5666666666666682
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.1333333333333293
valid_direction_mean0.6533333333333331
valid_direction_median0.7333333333333348
valid_direction_min0
No reset possible
90781155Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4191263213086181
deviation-center-line_median0.2133955691172394
in-drivable-lane_median3.6666666666666545


other stats
deviation-center-line_max0.7682024224971145
deviation-center-line_mean0.3092106397749039
deviation-center-line_min0.15544187546761248
deviation-heading_max2.397510274589595
deviation-heading_mean1.113178311662657
deviation-heading_median0.7793339123628685
deviation-heading_min0.15887850311444007
driven_any_max2.408529749764473
driven_any_mean1.2845537752179077
driven_any_median1.228346145363989
driven_any_min0.4223898486973128
driven_lanedir_max1.4297714032332258
driven_lanedir_mean0.5790803142850239
driven_lanedir_min0.301418228117613
in-drivable-lane_max8.333333333333306
in-drivable-lane_mean3.459999999999989
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.408529749764473, "driven_lanedir": 1.4297714032332258, "in-drivable-lane": 5.299999999999986, "deviation-heading": 2.397510274589595, "deviation-center-line": 0.7682024224971145}, "ep001": {"driven_any": 0.4223898486973128, "driven_lanedir": 0.4191263213086181, "in-drivable-lane": 0, "deviation-heading": 0.17155827029918472, "deviation-center-line": 0.2133955691172394}, "ep002": {"driven_any": 1.9395586908599585, "driven_lanedir": 0.301418228117613, "in-drivable-lane": 8.333333333333306, "deviation-heading": 2.058610597947196, "deviation-center-line": 0.25111311904332145}, "ep003": {"driven_any": 1.228346145363989, "driven_lanedir": 0.3233598066385248, "in-drivable-lane": 3.6666666666666545, "deviation-heading": 0.7793339123628685, "deviation-center-line": 0.15790021274923174}, "ep004": {"driven_any": 0.4239444414038046, "driven_lanedir": 0.4217258121271379, "in-drivable-lane": 0, "deviation-heading": 0.15887850311444007, "deviation-center-line": 0.15544187546761248}}
No reset possible
90751154Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.166666666666658


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95937299894701, "good_angle": 0.45624464688028465, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 100, "reward": -10.782525892797857, "good_angle": 7.017349892348781, "survival_time": 3.3333333333333313, "traveled_tiles": 2, "valid_direction": 2.533333333333331}, "ep002": {"nsteps": 155, "reward": -7.493776775208572, "good_angle": 0.8385536772694037, "survival_time": 5.166666666666658, "traveled_tiles": 5, "valid_direction": 2.499999999999995}, "ep003": {"nsteps": 500, "reward": -1.1449057160997764, "good_angle": 0.6622174033785106, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.4999999999999982}, "ep004": {"nsteps": 500, "reward": -0.9144761494565756, "good_angle": 10.374621110428253, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.0333333333333257}}
good_angle_max10.374621110428253
good_angle_mean3.869797346061047
good_angle_median0.8385536772694037
good_angle_min0.45624464688028465
reward_max-0.9144761494565756
reward_mean-11.25901150650196
reward_median-7.493776775208572
reward_min-35.95937299894701
survival_time_max16.666666666666654
survival_time_mean8.553333333333326
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean5.8
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max3.0333333333333257
valid_direction_mean2.07333333333333
valid_direction_median2.499999999999995
valid_direction_min0.7999999999999998
No reset possible
90651155Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
90621152Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.21550830194289936
deviation-center-line_median0.1974449326223282
in-drivable-lane_median0


other stats
deviation-center-line_max0.3690873456467426
deviation-center-line_mean0.2078889573124032
deviation-center-line_min0.12092993453408477
deviation-heading_max1.7970104457675162
deviation-heading_mean0.8396734311074644
deviation-heading_median0.5742535466768622
deviation-heading_min0.4532730876630539
driven_any_max0.5821560714738756
driven_any_mean0.298573489973921
driven_any_median0.22857351321845176
driven_any_min0.15712762241796052
driven_lanedir_max0.33229831008042865
driven_lanedir_mean0.23298634447059424
driven_lanedir_min0.1415705305787589
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5821560714738756, "driven_lanedir": 0.31933203541348143, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7970104457675162, "deviation-center-line": 0.2147581086569874}, "ep001": {"driven_any": 0.33929497550514376, "driven_lanedir": 0.33229831008042865, "in-drivable-lane": 0, "deviation-heading": 0.4532730876630539, "deviation-center-line": 0.3690873456467426}, "ep002": {"driven_any": 0.15712762241796052, "driven_lanedir": 0.1415705305787589, "in-drivable-lane": 0, "deviation-heading": 0.5742535466768622, "deviation-center-line": 0.13722446510187275}, "ep003": {"driven_any": 0.18571526725417337, "driven_lanedir": 0.1562225443374028, "in-drivable-lane": 0, "deviation-heading": 0.8203411438161585, "deviation-center-line": 0.12092993453408477}, "ep004": {"driven_any": 0.22857351321845176, "driven_lanedir": 0.21550830194289936, "in-drivable-lane": 0, "deviation-heading": 0.5534889316137311, "deviation-center-line": 0.1974449326223282}}
No reset possible
90551152Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
90501152Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.200000000000002


other stats
episodes
details{"ep000": {"nsteps": 165, "reward": -6.174903824806891, "good_angle": 1.283565821367642, "survival_time": 5.49999999999999, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 97, "reward": -10.920560585469314, "good_angle": 0.18588145102361045, "survival_time": 3.2333333333333316, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 46, "reward": -22.23213052360908, "good_angle": 0.3563900941668696, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.8333333333333347}, "ep003": {"nsteps": 54, "reward": -18.898264500278017, "good_angle": 0.6519035773051937, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0.7000000000000022}, "ep004": {"nsteps": 66, "reward": -15.628937987215592, "good_angle": 0.3027082238358728, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6333333333333337}}
good_angle_max1.283565821367642
good_angle_mean0.5560898335398378
good_angle_median0.3563900941668696
good_angle_min0.18588145102361045
reward_max-6.174903824806891
reward_mean-14.770959484275778
reward_median-15.628937987215592
reward_min-22.23213052360908
survival_time_max5.49999999999999
survival_time_mean2.8533333333333326
survival_time_min1.5333333333333348
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.7866666666666662
valid_direction_median0.7000000000000022
valid_direction_min0.29999999999999893
No reset possible
90391147Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.993725116598154
deviation-center-line_median0.5250077714219962
in-drivable-lane_median0


other stats
deviation-center-line_max0.7726126305172341
deviation-center-line_mean0.5861487639610925
deviation-center-line_min0.4784991881634035
deviation-heading_max4.8001563106600385
deviation-heading_mean1.3576437708747016
deviation-heading_median0.4129115949793908
deviation-heading_min0.07942104943374341
driven_any_max0.9960000000000088
driven_any_mean0.7437333333333104
driven_any_median0.9959999999999054
driven_any_min0.36399999999998744
driven_lanedir_max0.9959758860580704
driven_lanedir_mean0.6994308115403024
driven_lanedir_min0.14899922016337996
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3666666666666991, "driven_lanedir": 0.14899922016337996, "in-drivable-lane": 1.500000000000001, "deviation-heading": 4.8001563106600385, "deviation-center-line": 0.4856116643692014}, "ep001": {"driven_any": 0.36399999999998744, "driven_lanedir": 0.3631534149294058, "in-drivable-lane": 0, "deviation-heading": 0.4129115949793908, "deviation-center-line": 0.6690125653336273}, "ep002": {"driven_any": 0.9959999999999518, "driven_lanedir": 0.9953004199525022, "in-drivable-lane": 0, "deviation-heading": 0.37171330518889034, "deviation-center-line": 0.7726126305172341}, "ep003": {"driven_any": 0.9959999999999054, "driven_lanedir": 0.9959758860580704, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374341, "deviation-center-line": 0.5250077714219962}, "ep004": {"driven_any": 0.9960000000000088, "driven_lanedir": 0.993725116598154, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4784991881634035}}
No reset possible
90291149Martin Weiss 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1244940250770317
deviation-center-line_median0.1702985030340966
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.2291035934160819
deviation-center-line_mean0.15104091265992872
deviation-center-line_min0.07084844041760953
deviation-heading_max1.2760765640740437
deviation-heading_mean0.5466497354728592
deviation-heading_median0.35171107009370006
deviation-heading_min0.06092138286581164
driven_any_max2.1066666666666567
driven_any_mean1.1093333333333295
driven_any_median1.1599999999999824
driven_any_min0.3466666666666718
driven_lanedir_max2.066698089009994
driven_lanedir_mean0.9871748479623343
driven_lanedir_min0.14089729353622693
in-drivable-lane_max0.2666666666666657
in-drivable-lane_mean0.09999999999999978
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 1.1599999999999824, "driven_lanedir": 1.1244940250770317, "in-drivable-lane": 0, "deviation-heading": 0.35171107009370006, "deviation-center-line": 0.1702985030340966}, "ep003": {"driven_any": 2.1066666666666567, "driven_lanedir": 2.066698089009994, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.33465738903594666, "deviation-center-line": 0.2291035934160819}, "ep004": {"driven_any": 1.5866666666666656, "driven_lanedir": 1.2579129547459444, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.2760765640740437, "deviation-center-line": 0.1859811348549165}}
No reset possible
90151148Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
90051146Martin Weiss 🇨🇦PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1244940250770317
deviation-center-line_median0.1702985030340966
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.2291035934160819
deviation-center-line_mean0.15104091265992872
deviation-center-line_min0.07084844041760953
deviation-heading_max1.2760765640740437
deviation-heading_mean0.5466497354728592
deviation-heading_median0.35171107009370006
deviation-heading_min0.06092138286581164
driven_any_max2.1066666666666567
driven_any_mean1.1093333333333295
driven_any_median1.1599999999999824
driven_any_min0.3466666666666718
driven_lanedir_max2.066698089009994
driven_lanedir_mean0.9871748479623343
driven_lanedir_min0.14089729353622693
in-drivable-lane_max0.2666666666666657
in-drivable-lane_mean0.09999999999999978
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 1.1599999999999824, "driven_lanedir": 1.1244940250770317, "in-drivable-lane": 0, "deviation-heading": 0.35171107009370006, "deviation-center-line": 0.1702985030340966}, "ep003": {"driven_any": 2.1066666666666567, "driven_lanedir": 2.066698089009994, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.33465738903594666, "deviation-center-line": 0.2291035934160819}, "ep004": {"driven_any": 1.5866666666666656, "driven_lanedir": 1.2579129547459444, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.2760765640740437, "deviation-center-line": 0.1859811348549165}}
No reset possible
90001146Martin Weiss 🇨🇦PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.966666666666666


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95936848815264, "good_angle": 0.4523226398291993, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 89, "reward": -11.722060765275794, "good_angle": 0.3368368393753734, "survival_time": 2.966666666666666, "traveled_tiles": 3, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 160, "reward": -6.5603199020959435, "good_angle": 0.375168348060673, "survival_time": 5.333333333333324, "traveled_tiles": 4, "valid_direction": 0.7999999999999972}, "ep004": {"nsteps": 121, "reward": -8.859963449884267, "good_angle": 7.247168345248417, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 1.399999999999995}}
good_angle_max7.247168345248417
good_angle_mean1.68312399336724
good_angle_median0.375168348060673
good_angle_min0.004123794322536422
reward_max-6.5603199020959435
reward_mean-19.874426403141097
reward_median-11.722060765275794
reward_min-36.270419410296846
survival_time_max5.333333333333324
survival_time_mean2.839999999999997
survival_time_min0.9333333333333332
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.399999999999995
valid_direction_mean0.7466666666666646
valid_direction_median0.7999999999999972
valid_direction_min0
No reset possible
89971144Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.790566131234169, "good_angle": 1.2903118912353084, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.166666666666656}, "ep001": {"nsteps": 500, "reward": -0.5960932991057635, "good_angle": 24.443253885152547, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.699999999999984}, "ep002": {"nsteps": 500, "reward": -0.7611904352903366, "good_angle": 1.258449643740138, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.699999999999995}, "ep003": {"nsteps": 500, "reward": -0.8476087856493104, "good_angle": 1.2553266018277809, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.7666666666666577}, "ep004": {"nsteps": 500, "reward": -0.6190339300409542, "good_angle": 9.26235383088953, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.099999999999988}}
good_angle_max24.443253885152547
good_angle_mean7.501939170569061
good_angle_median1.2903118912353084
good_angle_min1.2553266018277809
reward_max-0.5960932991057635
reward_mean-0.7228985162641068
reward_median-0.7611904352903366
reward_min-0.8476087856493104
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean16
traveled_tiles_median18
traveled_tiles_min13
valid_direction_max5.699999999999984
valid_direction_mean3.686666666666656
valid_direction_median3.166666666666656
valid_direction_min2.699999999999995
No reset possible
89921145Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:12
Error while running [...]

Creating job8992-3573_videos_1 ... error
stderr | ERROR: for job8992-3573_videos_1  Cannot start service videos: network job8992-3573_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8992-3573_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89851142Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.17469981055834038
deviation-center-line_median0.13577437340228202
in-drivable-lane_median0


other stats
deviation-center-line_max0.3690261368130126
deviation-center-line_mean0.1868215134398486
deviation-center-line_min0.07742017826699252
deviation-heading_max1.7622351185600351
deviation-heading_mean0.805162110156789
deviation-heading_median0.5661175936839794
deviation-heading_min0.3811426567753047
driven_any_max0.8035976574395374
driven_any_mean0.29785529355345186
driven_any_median0.19641445731278603
driven_any_min0.07141667097160712
driven_lanedir_max0.56415417370584
driven_lanedir_mean0.23691111615687072
driven_lanedir_min0.05841435526867045
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8035976574395374, "driven_lanedir": 0.56415417370584, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7622351185600351, "deviation-center-line": 0.3690261368130126}, "ep001": {"driven_any": 0.07141667097160712, "driven_lanedir": 0.05841435526867045, "in-drivable-lane": 0, "deviation-heading": 0.3811426567753047, "deviation-center-line": 0.07742017826699252}, "ep002": {"driven_any": 0.1678525632081945, "driven_lanedir": 0.1503847723538092, "in-drivable-lane": 0, "deviation-heading": 0.5634473783805408, "deviation-center-line": 0.13577437340228202}, "ep003": {"driven_any": 0.19641445731278603, "driven_lanedir": 0.17469981055834038, "in-drivable-lane": 0, "deviation-heading": 0.7528678033840843, "deviation-center-line": 0.13152109401252535}, "ep004": {"driven_any": 0.24999511883513437, "driven_lanedir": 0.23690246889769373, "in-drivable-lane": 0, "deviation-heading": 0.5661175936839794, "deviation-center-line": 0.2203657847044305}}
No reset possible
89781143Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:16
Error while running [...]

Creating job8978-8642_solution_1  ... error
stderr | ERROR: for job8978-8642_solution_1  Cannot start service solution: network job8978-8642_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8978-8642_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8978-8642_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89741142Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9000000000000024


other stats
episodes
details{"ep000": {"nsteps": 227, "reward": -4.583543770364998, "good_angle": 0.738769635694076, "survival_time": 7.5666666666666496, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 22, "reward": -46.080067251216285, "good_angle": 0.334784063353372, "survival_time": 0.7333333333333333, "traveled_tiles": 1, "valid_direction": 0.49999999999999994}, "ep002": {"nsteps": 49, "reward": -20.86456341098766, "good_angle": 0.415166648643947, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.6000000000000018}, "ep003": {"nsteps": 57, "reward": -17.917557120715315, "good_angle": 0.49385780909770777, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.8666666666666687}, "ep004": {"nsteps": 72, "reward": -14.377016751716534, "good_angle": 0.3078218672480584, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.5999999999999992}}
good_angle_max0.738769635694076
good_angle_mean0.4580800048074322
good_angle_median0.415166648643947
good_angle_min0.3078218672480584
reward_max-4.583543770364998
reward_mean-20.76454966100016
reward_median-17.917557120715315
reward_min-46.080067251216285
survival_time_max7.5666666666666496
survival_time_mean2.846666666666664
survival_time_min0.7333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.8066666666666663
valid_direction_median0.6000000000000018
valid_direction_min0.49999999999999994
No reset possible
89711141Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:14
Error while running [...]

Creating job8971-4054_videos_1 ... error
stderr | ERROR: for job8971-4054_videos_1  Cannot start service videos: network job8971-4054_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8971-4054_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89661141Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationfailednorudolf-80:05:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89481137Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
89331134Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationfailednorudolf-80:07:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89311130Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:11
Error while running [...]

Creating job8931-1075_videos_1 ... error
stderr | ERROR: for job8931-1075_videos_1  Cannot start service videos: network job8931-1075_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8931-1075_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89281130Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.4113415893963538, "good_angle": 19.06962243445834, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 7.099999999999991}, "ep001": {"nsteps": 500, "reward": -0.6925540633785422, "good_angle": 18.838783869434256, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 8.73333333333331}, "ep002": {"nsteps": 500, "reward": -0.6287973698335699, "good_angle": 10.655513539373889, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 8.533333333333324}, "ep003": {"nsteps": 500, "reward": -0.6568375078709796, "good_angle": 24.487153225253113, "survival_time": 16.666666666666654, "traveled_tiles": 14, "valid_direction": 8.333333333333329}, "ep004": {"nsteps": 500, "reward": -0.7802424084413797, "good_angle": 11.178209550610358, "survival_time": 16.666666666666654, "traveled_tiles": 14, "valid_direction": 8.033333333333331}}
good_angle_max24.487153225253113
good_angle_mean16.84585652382599
good_angle_median18.838783869434256
good_angle_min10.655513539373889
reward_max-0.4113415893963538
reward_mean-0.6339545877841651
reward_median-0.6568375078709796
reward_min-0.7802424084413797
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max15
traveled_tiles_mean12.8
traveled_tiles_median14
traveled_tiles_min10
valid_direction_max8.73333333333331
valid_direction_mean8.146666666666658
valid_direction_median8.333333333333329
valid_direction_min7.099999999999991
No reset possible
89201122Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.678212511525196
deviation-center-line_median1.2997313490048656
in-drivable-lane_median6.033333333333313


other stats
deviation-center-line_max1.736512708556383
deviation-center-line_mean1.1764950766601203
deviation-center-line_min0.09897289157693905
deviation-heading_max1.9700452643517208
deviation-heading_mean1.3321225607422804
deviation-heading_median1.4969092646465725
deviation-heading_min0.06092138286581164
driven_any_max6.309491514219117
driven_any_mean5.048893796867289
driven_any_median6.243119859646946
driven_any_min0.34666666666667245
driven_lanedir_max4.226387937939422
driven_lanedir_mean3.013138328024679
driven_lanedir_min0.3458718774424743
in-drivable-lane_max8.600000000000005
in-drivable-lane_mean5.239999999999997
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.243119859646946, "driven_lanedir": 4.226387937939422, "in-drivable-lane": 5.066666666666651, "deviation-heading": 1.9700452643517208, "deviation-center-line": 1.736512708556383}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.301491506532981, "driven_lanedir": 3.9727114300752353, "in-drivable-lane": 6.033333333333313, "deviation-heading": 1.2017291443692388, "deviation-center-line": 1.6761658860727855}, "ep003": {"driven_any": 6.309491514219117, "driven_lanedir": 3.678212511525196, "in-drivable-lane": 6.500000000000013, "deviation-heading": 1.9310077474780585, "deviation-center-line": 1.07109254808963}, "ep004": {"driven_any": 6.043699437270728, "driven_lanedir": 2.8425078831410695, "in-drivable-lane": 8.600000000000005, "deviation-heading": 1.4969092646465725, "deviation-center-line": 1.2997313490048656}}
No reset possible
89151122Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
89091128Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:13
Error while running [...]

Creating job8909-7581_visualization_1 ... error
stderr | ERROR: for job8909-7581_visualization_1  Cannot start service visualization: network job8909-7581_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8909-7581_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89041128Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
89001128Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.433333333333331


other stats
episodes
details{"ep000": {"nsteps": 103, "reward": -10.738487651906183, "good_angle": 6.623001189913441, "survival_time": 3.433333333333331, "traveled_tiles": 3, "valid_direction": 2.899999999999998}, "ep001": {"nsteps": 398, "reward": -3.573834209098602, "good_angle": 22.17096518362927, "survival_time": 13.26666666666663, "traveled_tiles": 5, "valid_direction": 10.399999999999972}, "ep002": {"nsteps": 70, "reward": -14.945861303220902, "good_angle": 2.0756036777075386, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.800000000000001}, "ep003": {"nsteps": 235, "reward": -5.1351538396351275, "good_angle": 6.174899015840222, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 5.999999999999986}, "ep004": {"nsteps": 103, "reward": -10.579931350063209, "good_angle": 3.1213364923864, "survival_time": 3.433333333333331, "traveled_tiles": 2, "valid_direction": 2.766666666666665}}
good_angle_max22.17096518362927
good_angle_mean8.033161111895375
good_angle_median6.174899015840222
good_angle_min2.0756036777075386
reward_max-3.573834209098602
reward_mean-8.994653670784803
reward_median-10.579931350063209
reward_min-14.945861303220902
survival_time_max13.26666666666663
survival_time_mean6.059999999999988
survival_time_min2.333333333333335
traveled_tiles_max5
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max10.399999999999972
valid_direction_mean4.7733333333333245
valid_direction_median2.899999999999998
valid_direction_min1.800000000000001
No reset possible
88921125Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.401254793145835
deviation-center-line_median1.004071813202574
in-drivable-lane_median4.33333333333333


other stats
deviation-center-line_max1.6334991892077222
deviation-center-line_mean0.9257475435667752
deviation-center-line_min0.2525232676315132
deviation-heading_max2.9157783785804554
deviation-heading_mean1.8953560060396344
deviation-heading_median2.365965541896246
deviation-heading_min0.6930252417034689
driven_any_max5.46833029907314
driven_any_mean3.721113633643469
driven_any_median5.082566143627928
driven_any_min1.17078703020304
driven_lanedir_max3.9701898953282138
driven_lanedir_mean2.621207248845344
driven_lanedir_min0.7800845802918484
in-drivable-lane_max5.399999999999982
in-drivable-lane_mean3.406666666666659
in-drivable-lane_min0.8999999999999968
per-episodes
details{"ep000": {"driven_any": 5.082566143627928, "driven_lanedir": 3.5870343062156578, "in-drivable-lane": 5.033333333333323, "deviation-heading": 2.9157783785804554, "deviation-center-line": 1.1483376901396964}, "ep001": {"driven_any": 1.17078703020304, "driven_lanedir": 0.7800845802918484, "in-drivable-lane": 1.3666666666666618, "deviation-heading": 0.6930252417034689, "deviation-center-line": 0.2525232676315132}, "ep002": {"driven_any": 5.212069701613519, "driven_lanedir": 3.401254793145835, "in-drivable-lane": 5.399999999999982, "deviation-heading": 2.803529358749528, "deviation-center-line": 1.004071813202574}, "ep003": {"driven_any": 5.46833029907314, "driven_lanedir": 3.9701898953282138, "in-drivable-lane": 4.33333333333333, "deviation-heading": 2.365965541896246, "deviation-center-line": 1.6334991892077222}, "ep004": {"driven_any": 1.6718149936997175, "driven_lanedir": 1.3674726692451653, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 0.6984815092684744, "deviation-center-line": 0.5903057576523699}}
No reset possible
88821127Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
88791126Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3482643110874504
deviation-center-line_median0.11769469505431077
in-drivable-lane_median0.9999999999999992


other stats
deviation-center-line_max0.14324716545739985
deviation-center-line_mean0.1246804837925131
deviation-center-line_min0.11013026428779606
deviation-heading_max0.7916512827033291
deviation-heading_mean0.7334917727444747
deviation-heading_median0.7461705071785165
deviation-heading_min0.640055765062307
driven_any_max1.106982828376045
driven_any_mean0.7613879151977517
driven_any_median0.6659893310778022
driven_any_min0.6479896194270549
driven_lanedir_max0.5607387889676518
driven_lanedir_mean0.397940258142721
driven_lanedir_min0.3333690496174959
in-drivable-lane_max1.9666666666666628
in-drivable-lane_mean1.1866666666666652
in-drivable-lane_min0.9666666666666665
per-episodes
details{"ep000": {"driven_any": 1.106982828376045, "driven_lanedir": 0.5607387889676518, "in-drivable-lane": 1.9666666666666628, "deviation-heading": 0.7916512827033291, "deviation-center-line": 0.13970155341270693}, "ep001": {"driven_any": 0.728988321855431, "driven_lanedir": 0.4010751607941592, "in-drivable-lane": 0.9999999999999978, "deviation-heading": 0.7890184718931031, "deviation-center-line": 0.14324716545739985}, "ep002": {"driven_any": 0.6659893310778022, "driven_lanedir": 0.3482643110874504, "in-drivable-lane": 0.9999999999999992, "deviation-heading": 0.7005628368851173, "deviation-center-line": 0.112628740750352}, "ep003": {"driven_any": 0.6569894752524257, "driven_lanedir": 0.3462539802468476, "in-drivable-lane": 0.9999999999999996, "deviation-heading": 0.640055765062307, "deviation-center-line": 0.11013026428779606}, "ep004": {"driven_any": 0.6479896194270549, "driven_lanedir": 0.3333690496174959, "in-drivable-lane": 0.9666666666666665, "deviation-heading": 0.7461705071785165, "deviation-center-line": 0.11769469505431077}}
No reset possible
88751126Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.533333333333334


other stats
episodes
details{"ep000": {"nsteps": 128, "reward": -8.331383397015088, "good_angle": 1.8172293384627989, "survival_time": 4.266666666666661, "traveled_tiles": 2, "valid_direction": 2.16666666666666}, "ep001": {"nsteps": 83, "reward": -12.986788551917815, "good_angle": 2.191059095980004, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 2.0666666666666664}, "ep002": {"nsteps": 76, "reward": -14.077185579330513, "good_angle": 1.974462028658612, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 2.000000000000001}, "ep003": {"nsteps": 75, "reward": -14.233828892667468, "good_angle": 1.8206566345462152, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 1.900000000000001}, "ep004": {"nsteps": 74, "reward": -14.461316556141185, "good_angle": 2.0224477477182456, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 2.000000000000001}}
good_angle_max2.191059095980004
good_angle_mean1.965170969073175
good_angle_median1.974462028658612
good_angle_min1.8172293384627989
reward_max-8.331383397015088
reward_mean-12.818100595414412
reward_median-14.077185579330513
reward_min-14.461316556141185
survival_time_max4.266666666666661
survival_time_mean2.9066666666666663
survival_time_min2.4666666666666677
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.16666666666666
valid_direction_mean2.026666666666666
valid_direction_median2.000000000000001
valid_direction_min1.900000000000001
No reset possible
88721124Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:11
Error while running [...]

Creating job8872-2480_visualization_1 ... error
stderr | ERROR: for job8872-2480_visualization_1  Cannot start service visualization: network job8872-2480_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8872-2480_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88691124Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
88591124Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:26
Error while running [...]

Creating job8859-7757_solution_1  ... done
stderr | ERROR: for evaluator  Cannot create container for service evaluator: device or resource busy
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88531123Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
88461121Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.773811521603105
deviation-center-line_median1.1525824328314664
in-drivable-lane_median6.2000000000000135


other stats
deviation-center-line_max1.54284737673533
deviation-center-line_mean0.9338462590361664
deviation-center-line_min0.16240523894655876
deviation-heading_max1.786770470808945
deviation-heading_mean1.210919513877175
deviation-heading_median1.34912830290192
deviation-heading_min0.43927931974536977
driven_any_max6.284736760390857
driven_any_mean4.440489223773457
driven_any_median5.901880146403633
driven_any_min1.0298625667734442
driven_lanedir_max3.886427488599245
driven_lanedir_mean2.695093808408512
driven_lanedir_min0.8032600454873398
in-drivable-lane_max9.233333333333306
in-drivable-lane_mean4.6066666666666665
in-drivable-lane_min0.06666666666666643
per-episodes
details{"ep000": {"driven_any": 1.0298625667734442, "driven_lanedir": 0.8032600454873398, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0.43927931974536977, "deviation-center-line": 0.16240523894655876}, "ep001": {"driven_any": 5.901880146403633, "driven_lanedir": 3.444590585672085, "in-drivable-lane": 6.966666666666678, "deviation-heading": 1.6111082569568158, "deviation-center-line": 1.43398125306032}, "ep002": {"driven_any": 6.284736760390857, "driven_lanedir": 3.886427488599245, "in-drivable-lane": 6.2000000000000135, "deviation-heading": 1.34912830290192, "deviation-center-line": 1.54284737673533}, "ep003": {"driven_any": 2.87021550318557, "driven_lanedir": 2.773811521603105, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 0.8683112189728236, "deviation-center-line": 0.37741499360715774}, "ep004": {"driven_any": 6.115751142113785, "driven_lanedir": 2.5673794006807875, "in-drivable-lane": 9.233333333333306, "deviation-heading": 1.786770470808945, "deviation-center-line": 1.1525824328314664}}
No reset possible
88401121Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 83, "reward": -12.304816724653971, "good_angle": 0.13793213476806754, "survival_time": 2.7666666666666666, "traveled_tiles": 3, "valid_direction": 0.6}, "ep001": {"nsteps": 500, "reward": -0.7498277629148216, "good_angle": 28.914988620001136, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 4.966666666666667}, "ep002": {"nsteps": 500, "reward": -0.5397272510193288, "good_angle": 0.6579434241500421, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 0.9999999999999964}, "ep003": {"nsteps": 223, "reward": -4.641575453055379, "good_angle": 0.108023278724155, "survival_time": 7.433333333333317, "traveled_tiles": 5, "valid_direction": 0.16666666666666607}, "ep004": {"nsteps": 500, "reward": -0.8635362735013478, "good_angle": 24.44952204091469, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.733333333333319}}
good_angle_max28.914988620001136
good_angle_mean10.853681899711615
good_angle_median0.6579434241500421
good_angle_min0.108023278724155
reward_max-0.5397272510193288
reward_mean-3.8198966930289706
reward_median-0.8635362735013478
reward_min-12.304816724653971
survival_time_max16.666666666666654
survival_time_mean12.039999999999988
survival_time_min2.7666666666666666
traveled_tiles_max12
traveled_tiles_mean7.8
traveled_tiles_median8
traveled_tiles_min3
valid_direction_max4.966666666666667
valid_direction_mean2.2933333333333294
valid_direction_median0.9999999999999964
valid_direction_min0.16666666666666607
No reset possible
88341118Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.0800191384151985
deviation-center-line_median1.4537620998520973
in-drivable-lane_median5.69999999999998


other stats
deviation-center-line_max1.7204669087765312
deviation-center-line_mean1.1874341263981512
deviation-center-line_min0.08414725295459423
deviation-heading_max1.7831337144331194
deviation-heading_mean1.1771825303886414
deviation-heading_median1.4718526205875515
deviation-heading_min0.06090207335592236
driven_any_max6.32998801859085
driven_any_mean5.07141095797302
driven_any_median6.268505372753538
driven_any_min0.29270692151363087
driven_lanedir_max4.772752515201063
driven_lanedir_mean3.340705977205901
driven_lanedir_min0.29177575401793865
in-drivable-lane_max7.56666666666667
in-drivable-lane_mean4.586666666666663
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.268505372753538, "driven_lanedir": 3.4774979430591326, "in-drivable-lane": 7.56666666666667, "deviation-heading": 0.911682657700122, "deviation-center-line": 1.657779837791391}, "ep001": {"driven_any": 0.29270692151363087, "driven_lanedir": 0.29177575401793865, "in-drivable-lane": 0, "deviation-heading": 0.06090207335592236, "deviation-center-line": 0.08414725295459423}, "ep002": {"driven_any": 6.322367338240872, "driven_lanedir": 4.0814845353361715, "in-drivable-lane": 5.700000000000015, "deviation-heading": 1.7831337144331194, "deviation-center-line": 1.4537620998520973}, "ep003": {"driven_any": 6.32998801859085, "driven_lanedir": 4.772752515201063, "in-drivable-lane": 3.966666666666653, "deviation-heading": 1.6583415858664925, "deviation-center-line": 1.0210145326161415}, "ep004": {"driven_any": 6.143487138766211, "driven_lanedir": 4.0800191384151985, "in-drivable-lane": 5.69999999999998, "deviation-heading": 1.4718526205875515, "deviation-center-line": 1.7204669087765312}}
No reset possible
88311118Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
88281118Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyesrudolf-80:00:11
Error while running [...]

Creating job8828-3992_scorer_1 ... error
stderr | ERROR: for job8828-3992_scorer_1  Cannot start service scorer: network job8828-3992_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8828-3992_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88241119Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
88181119Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
88041116Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7121228661422502, "good_angle": 0.6289510252872001, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.3666666666666625}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.497267006195616, "good_angle": 0.4817720498773324, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.1999999999999955}, "ep003": {"nsteps": 226, "reward": -4.5931772413951775, "good_angle": 0.080180669304443, "survival_time": 7.533333333333316, "traveled_tiles": 5, "valid_direction": 0.033333333333333215}, "ep004": {"nsteps": 500, "reward": -0.7465832089912147, "good_angle": 22.31499710031131, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 4.299999999999988}}
good_angle_max22.31499710031131
good_angle_mean4.702004927820564
good_angle_median0.4817720498773324
good_angle_min0.004123794322536422
reward_max-0.497267006195616
reward_mean-8.56391394660422
reward_median-0.7465832089912147
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean11.693333333333324
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean7.4
traveled_tiles_median7
traveled_tiles_min1
valid_direction_max4.299999999999988
valid_direction_mean1.379999999999996
valid_direction_median1.1999999999999955
valid_direction_min0
No reset possible
88001115Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
87951114Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
87891114Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:07:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
87861113Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:12
Error while running [...]

Creating job8786-1057_visualization_1 ... error
stderr | ERROR: for job8786-1057_visualization_1  Cannot start service visualization: network job8786-1057_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8786-1057_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
87761112Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
87621111Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.23337893423961376
deviation-center-line_median0.21274103692942703
in-drivable-lane_median0


other stats
deviation-center-line_max0.3573781939235156
deviation-center-line_mean0.23424649301877648
deviation-center-line_min0.11427212772104156
deviation-heading_max1.8131134446897523
deviation-heading_mean0.8549234120678835
deviation-heading_median0.6120039815709682
deviation-heading_min0.4941840774354186
driven_any_max0.7750266874769531
driven_any_mean0.3357175816313672
driven_any_median0.24642464810236747
driven_any_min0.15356510244405283
driven_lanedir_max0.5332045711640991
driven_lanedir_mean0.2735857130035904
driven_lanedir_min0.13383424307683667
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7750266874769531, "driven_lanedir": 0.5332045711640991, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.8131134446897523, "deviation-center-line": 0.3573781939235156}, "ep001": {"driven_any": 0.33214757875007084, "driven_lanedir": 0.3242557324569133, "in-drivable-lane": 0, "deviation-heading": 0.4941840774354186, "deviation-center-line": 0.3549146209582231}, "ep002": {"driven_any": 0.15356510244405283, "driven_lanedir": 0.13383424307683667, "in-drivable-lane": 0, "deviation-heading": 0.6120039815709682, "deviation-center-line": 0.13192648556167505}, "ep003": {"driven_any": 0.17142389138339187, "driven_lanedir": 0.14325508408048915, "in-drivable-lane": 0, "deviation-heading": 0.8101125566989754, "deviation-center-line": 0.11427212772104156}, "ep004": {"driven_any": 0.24642464810236747, "driven_lanedir": 0.23337893423961376, "in-drivable-lane": 0, "deviation-heading": 0.545202999944303, "deviation-center-line": 0.21274103692942703}}
No reset possible
87501109Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
87461110Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5791254116164055, "good_angle": 1.002345972771127, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.333333333333327}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.5446162701342255, "good_angle": 0.6180470214168222, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 1.233333333333329}, "ep003": {"nsteps": 236, "reward": -4.484584414348858, "good_angle": 0.11172196749994193, "survival_time": 7.866666666666648, "traveled_tiles": 6, "valid_direction": 0.2333333333333325}, "ep004": {"nsteps": 500, "reward": -0.6642434570374899, "good_angle": 10.271174867832356, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.933333333333326}}
good_angle_max10.271174867832356
good_angle_mean2.401482724768557
good_angle_median0.6180470214168222
good_angle_min0.004123794322536422
reward_max-0.5446162701342255
reward_mean-8.508597792686766
reward_median-0.6642434570374899
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean11.759999999999987
survival_time_min0.9333333333333332
traveled_tiles_max13
traveled_tiles_mean8.2
traveled_tiles_median9
traveled_tiles_min1
valid_direction_max2.933333333333326
valid_direction_mean1.346666666666663
valid_direction_median1.233333333333329
valid_direction_min0
No reset possible
87411109Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.266666666666661


other stats
episodes
details{"ep000": {"nsteps": 40, "reward": -25.25177037610556, "good_angle": 0.6402653252392663, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1333333333333342}, "ep001": {"nsteps": 40, "reward": -25.562104041129352, "good_angle": 0.005956591799219283, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 128, "reward": -8.312191555043682, "good_angle": 0.4929748188962192, "survival_time": 4.266666666666661, "traveled_tiles": 3, "valid_direction": 1.0666666666666629}, "ep003": {"nsteps": 228, "reward": -4.689726662446271, "good_angle": 0.5025668708841372, "survival_time": 7.599999999999983, "traveled_tiles": 4, "valid_direction": 1.099999999999996}, "ep004": {"nsteps": 173, "reward": -6.3794289034955485, "good_angle": 10.402549052319154, "survival_time": 5.766666666666656, "traveled_tiles": 3, "valid_direction": 1.999999999999993}}
good_angle_max10.402549052319154
good_angle_mean2.408862531827599
good_angle_median0.5025668708841372
good_angle_min0.005956591799219283
reward_max-4.689726662446271
reward_mean-14.03904430764408
reward_median-8.312191555043682
reward_min-25.562104041129352
survival_time_max7.599999999999983
survival_time_mean4.059999999999993
survival_time_min1.333333333333334
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.999999999999993
valid_direction_mean1.0599999999999974
valid_direction_median1.099999999999996
valid_direction_min0
No reset possible
87341108Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
87301108Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.15644692612317157, "good_angle": 1.1850549188777757, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.333333333333326}, "ep001": {"nsteps": 500, "reward": -0.4832332623641705, "good_angle": 26.90511062716362, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.166666666666655}, "ep002": {"nsteps": 289, "reward": -3.6313355645461622, "good_angle": 0.8995114903146415, "survival_time": 9.63333333333331, "traveled_tiles": 7, "valid_direction": 2.5666666666666584}, "ep003": {"nsteps": 500, "reward": -0.15980873936373974, "good_angle": 0.7956928799808193, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.0999999999999925}, "ep004": {"nsteps": 500, "reward": -0.43849080500460696, "good_angle": 21.48062272864873, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.3999999999999915}}
good_angle_max26.90511062716362
good_angle_mean10.253198528997116
good_angle_median1.1850549188777757
good_angle_min0.7956928799808193
reward_max-0.15644692612317157
reward_mean-0.9738630594803704
reward_median-0.43849080500460696
reward_min-3.6313355645461622
survival_time_max16.666666666666654
survival_time_mean15.259999999999986
survival_time_min9.63333333333331
traveled_tiles_max11
traveled_tiles_mean9.8
traveled_tiles_median10
traveled_tiles_min7
valid_direction_max4.166666666666655
valid_direction_mean2.9133333333333247
valid_direction_median2.5666666666666584
valid_direction_min2.0999999999999925
No reset possible
87251108Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:06:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
87221107Martin Weiss 🇨🇦PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
87191107Martin Weiss 🇨🇦PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
87131104Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
87091105David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:05:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
86991102Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 551, in run
    solve(params, cis)
  File "solution.py", line 469, in solve
    if len(lines) == 0:
TypeError: object of type 'NoneType' has no len()


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86971101Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:46
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86851090Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.2443177081020105
deviation-center-line_median1.468895706763266
in-drivable-lane_median1.7333333333333272


other stats
deviation-center-line_max1.6416152015667174
deviation-center-line_mean1.0635312395466738
deviation-center-line_min0.15509262102742907
deviation-heading_max2.972965933705839
deviation-heading_mean1.697586805986226
deviation-heading_median1.736084547319517
deviation-heading_min0.4075496263975797
driven_any_max6.3193201507175125
driven_any_mean4.283563726339994
driven_any_median5.043399877804154
driven_any_min1.0171949539778953
driven_lanedir_max4.615926455310623
driven_lanedir_mean3.4046979161550297
driven_lanedir_min0.7823523469251827
in-drivable-lane_max4.766666666666685
in-drivable-lane_mean2.1133333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0171949539778953, "driven_lanedir": 0.7823523469251827, "in-drivable-lane": 0.6, "deviation-heading": 0.4075496263975797, "deviation-center-line": 0.15509262102742907}, "ep001": {"driven_any": 6.062890511546869, "driven_lanedir": 4.615926455310623, "in-drivable-lane": 3.4666666666666544, "deviation-heading": 2.972965933705839, "deviation-center-line": 1.637867056079924}, "ep002": {"driven_any": 6.3193201507175125, "driven_lanedir": 4.471527342080007, "in-drivable-lane": 4.766666666666685, "deviation-heading": 1.736084547319517, "deviation-center-line": 1.6416152015667174}, "ep003": {"driven_any": 2.97501313765354, "driven_lanedir": 2.909365728357324, "in-drivable-lane": 0, "deviation-heading": 0.8377016895050535, "deviation-center-line": 0.4141856122960321}, "ep004": {"driven_any": 5.043399877804154, "driven_lanedir": 4.2443177081020105, "in-drivable-lane": 1.7333333333333272, "deviation-heading": 2.5336322330031407, "deviation-center-line": 1.468895706763266}}
No reset possible
86801087Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.5987188584299385
deviation-center-line_median1.8416151292724297
in-drivable-lane_median1.4333333333333442


other stats
deviation-center-line_max2.746436279588349
deviation-center-line_mean1.753310582875055
deviation-center-line_min0.9243765168994036
deviation-heading_max3.299741976835285
deviation-heading_mean2.4093418963344275
deviation-heading_median2.521168234028518
deviation-heading_min1.0786789834874522
driven_any_max5.6992452923144175
driven_any_mean4.8956603988036465
driven_any_median5.261910475343271
driven_any_min3.0012519774993613
driven_lanedir_max5.598366737779154
driven_lanedir_mean4.401905506185358
driven_lanedir_min2.7846382858558973
in-drivable-lane_max2.099999999999996
in-drivable-lane_mean1.16
in-drivable-lane_min0.1999999999999993
per-episodes
details{"ep000": {"driven_any": 5.16044354177468, "driven_lanedir": 4.357360699317013, "in-drivable-lane": 2.099999999999996, "deviation-heading": 2.9603234097169464, "deviation-center-line": 1.1177859827449028}, "ep001": {"driven_any": 5.355450707086503, "driven_lanedir": 4.670442949544786, "in-drivable-lane": 1.7666666666666604, "deviation-heading": 2.521168234028518, "deviation-center-line": 2.1363390058701883}, "ep002": {"driven_any": 3.0012519774993613, "driven_lanedir": 2.7846382858558973, "in-drivable-lane": 0.2999999999999998, "deviation-heading": 2.186796877603935, "deviation-center-line": 0.9243765168994036}, "ep003": {"driven_any": 5.261910475343271, "driven_lanedir": 4.5987188584299385, "in-drivable-lane": 1.4333333333333442, "deviation-heading": 3.299741976835285, "deviation-center-line": 1.8416151292724297}, "ep004": {"driven_any": 5.6992452923144175, "driven_lanedir": 5.598366737779154, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 1.0786789834874522, "deviation-center-line": 2.746436279588349}}
No reset possible
86741096Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.6333333333333195


other stats
episodes
details{"ep000": {"nsteps": 60, "reward": -16.865910876806204, "good_angle": 0.2896990896494988, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 1.1333333333333342}, "ep001": {"nsteps": 199, "reward": -5.429833906819698, "good_angle": 5.315397125495176, "survival_time": 6.6333333333333195, "traveled_tiles": 4, "valid_direction": 1.9999999999999944}, "ep002": {"nsteps": 75, "reward": -13.669770122170448, "good_angle": 0.18447094675901832, "survival_time": 2.500000000000001, "traveled_tiles": 3, "valid_direction": 0.3999999999999986}, "ep003": {"nsteps": 220, "reward": -5.051060502569784, "good_angle": 0.07977824888282141, "survival_time": 7.333333333333317, "traveled_tiles": 4, "valid_direction": 0.09999999999999964}, "ep004": {"nsteps": 500, "reward": -0.23833501202985644, "good_angle": 16.386329728642597, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.0999999999999925}}
good_angle_max16.386329728642597
good_angle_mean4.451135027885822
good_angle_median0.2896990896494988
good_angle_min0.07977824888282141
reward_max-0.23833501202985644
reward_mean-8.2509820840792
reward_median-5.429833906819698
reward_min-16.865910876806204
survival_time_max16.666666666666654
survival_time_mean7.026666666666659
survival_time_min2.0000000000000027
traveled_tiles_max11
traveled_tiles_mean4.8
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max2.0999999999999925
valid_direction_mean1.1466666666666638
valid_direction_median1.1333333333333342
valid_direction_min0.09999999999999964
No reset possible
86691095Krishna Murthy Jatavallabhula 🇨🇦gym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 538, in run
    solve(params, cis)
  File "solution.py", line 465, in solve
    color_classes = [0 for i in range(lines.shape[0])]
AttributeError: 'NoneType' object has no attribute 'shape'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86621093Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.066666666666651


other stats
episodes
details{"ep000": {"nsteps": 71, "reward": -14.309208415986472, "good_angle": 0.1365987800113235, "survival_time": 2.366666666666668, "traveled_tiles": 2, "valid_direction": 0.29999999999999993}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 286, "reward": -3.684961961026175, "good_angle": 0.6782947521232003, "survival_time": 9.53333333333331, "traveled_tiles": 7, "valid_direction": 1.9999999999999936}, "ep003": {"nsteps": 212, "reward": -4.866575889678162, "good_angle": 0.11116941822204177, "survival_time": 7.066666666666651, "traveled_tiles": 5, "valid_direction": 0.2333333333333325}, "ep004": {"nsteps": 500, "reward": -0.18805094578454737, "good_angle": 24.320267684743087, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 3.1666666666666856}}
good_angle_max24.320267684743087
good_angle_mean5.050090885884438
good_angle_median0.1365987800113235
good_angle_min0.004123794322536422
reward_max-0.18805094578454737
reward_mean-11.86384332455444
reward_median-4.866575889678162
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean7.313333333333324
survival_time_min0.9333333333333332
traveled_tiles_max13
traveled_tiles_mean5.6
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max3.1666666666666856
valid_direction_mean1.1400000000000023
valid_direction_median0.29999999999999993
valid_direction_min0
No reset possible
86541091Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3479984180247596
deviation-center-line_median0.15444496851588396
in-drivable-lane_median0.26666666666666716


other stats
deviation-center-line_max0.16309804709975628
deviation-center-line_mean0.1396709127029548
deviation-center-line_min0.1108007403933787
deviation-heading_max1.521600167399942
deviation-heading_mean1.2206720749466835
deviation-heading_median1.238748819297116
deviation-heading_min0.6301946876993587
driven_any_max0.844378638407504
driven_any_mean0.654625786504307
driven_any_median0.6255576444601703
driven_any_min0.5702735171084232
driven_lanedir_max0.37297763840015286
driven_lanedir_mean0.33570829904849464
driven_lanedir_min0.2892670777243107
in-drivable-lane_max1.2666666666666662
in-drivable-lane_mean0.42000000000000026
in-drivable-lane_min0.13333333333333364
per-episodes
details{"ep000": {"driven_any": 0.844378638407504, "driven_lanedir": 0.3479984180247596, "in-drivable-lane": 1.2666666666666662, "deviation-heading": 0.6301946876993587, "deviation-center-line": 0.15444496851588396}, "ep001": {"driven_any": 0.6394190526828136, "driven_lanedir": 0.37297763840015286, "in-drivable-lane": 0.13333333333333375, "deviation-heading": 1.521600167399942, "deviation-center-line": 0.16309804709975628}, "ep002": {"driven_any": 0.6255576444601703, "driven_lanedir": 0.3649768296424461, "in-drivable-lane": 0.13333333333333364, "deviation-heading": 1.48715675254528, "deviation-center-line": 0.15706452249071284}, "ep003": {"driven_any": 0.5702735171084232, "driven_lanedir": 0.2892670777243107, "in-drivable-lane": 0.26666666666666716, "deviation-heading": 1.238748819297116, "deviation-center-line": 0.1108007403933787}, "ep004": {"driven_any": 0.5935000798626245, "driven_lanedir": 0.3033215314508042, "in-drivable-lane": 0.30000000000000093, "deviation-heading": 1.2256599477917216, "deviation-center-line": 0.11294628501504228}}
No reset possible
86431088Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.050757583513121
deviation-center-line_median1.2994125499262943
in-drivable-lane_median2.033333333333326


other stats
deviation-center-line_max1.9993221263501044
deviation-center-line_mean1.1369861220422568
deviation-center-line_min0.09897289157693905
deviation-heading_max2.5472271240189612
deviation-heading_mean1.4902215688941052
deviation-heading_median1.8055175325629285
deviation-heading_min0.06092138286581164
driven_any_max6.273227779451769
driven_any_mean4.200189455821631
driven_any_median5.950123558240415
driven_any_min0.34666666666667245
driven_lanedir_max5.240250528782286
driven_lanedir_mean3.121772270637142
driven_lanedir_min0.3458718774424743
in-drivable-lane_max5.033333333333319
in-drivable-lane_mean2.613333333333325
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.950123558240415, "driven_lanedir": 4.050757583513121, "in-drivable-lane": 5.033333333333319, "deviation-heading": 2.1148164814004757, "deviation-center-line": 1.9993221263501044}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.222005883634688, "driven_lanedir": 4.237402110410632, "in-drivable-lane": 4.8999999999999835, "deviation-heading": 1.8055175325629285, "deviation-center-line": 1.8198826995902624}, "ep003": {"driven_any": 6.273227779451769, "driven_lanedir": 5.240250528782286, "in-drivable-lane": 2.033333333333326, "deviation-heading": 2.5472271240189612, "deviation-center-line": 1.2994125499262943}, "ep004": {"driven_any": 2.2089233911146127, "driven_lanedir": 1.7345792530371982, "in-drivable-lane": 1.099999999999996, "deviation-heading": 0.9226253236223484, "deviation-center-line": 0.46734034276768266}}
No reset possible
86381088Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5540914144273847, "good_angle": 1.484022447141399, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.166666666666656}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.5821161119379104, "good_angle": 1.2782456982199806, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.79999999999999}, "ep003": {"nsteps": 500, "reward": -0.3116508691784984, "good_angle": 1.0475033959502589, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.299999999999992}, "ep004": {"nsteps": 188, "reward": -6.052206913767224, "good_angle": 7.696683818787072, "survival_time": 6.266666666666654, "traveled_tiles": 5, "valid_direction": 2.499999999999991}}
good_angle_max7.696683818787072
good_angle_mean2.3021158308842495
good_angle_median1.2782456982199806
good_angle_min0.004123794322536422
reward_max-0.3116508691784984
reward_mean-8.75409694392157
reward_median-0.5821161119379104
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean11.439999999999989
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean8.2
traveled_tiles_median11
traveled_tiles_min1
valid_direction_max3.166666666666656
valid_direction_mean2.1533333333333258
valid_direction_median2.499999999999991
valid_direction_min0
No reset possible
86311088Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
86231085Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9640057209730148, "good_angle": 46.66296274251999, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.166666666666652}, "ep001": {"nsteps": 500, "reward": -1.3020373888611794, "good_angle": 13.824044637181125, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}, "ep002": {"nsteps": 500, "reward": -1.1174760079681874, "good_angle": 13.82628678256675, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333326}, "ep003": {"nsteps": 500, "reward": -0.9247168089353216, "good_angle": 13.81327756450836, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.899999999999991}, "ep004": {"nsteps": 500, "reward": -1.161978100210428, "good_angle": 13.83176828278006, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}}
good_angle_max46.66296274251999
good_angle_mean20.391668001911256
good_angle_median13.82628678256675
good_angle_min13.81327756450836
reward_max-0.9247168089353216
reward_mean-1.0940428053896265
reward_median-1.1174760079681874
reward_min-1.3020373888611794
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.166666666666652
valid_direction_mean13.259999999999993
valid_direction_median13.09999999999999
valid_direction_min12.899999999999991
No reset possible
86161084Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 384, "reward": -2.8542698179462604, "good_angle": 1.1485083237515734, "survival_time": 12.799999999999963, "traveled_tiles": 7, "valid_direction": 2.499999999999994}, "ep001": {"nsteps": 500, "reward": -0.48986030906392264, "good_angle": 23.249960382087124, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 3.8666666666666543}, "ep002": {"nsteps": 500, "reward": -0.24118176720687187, "good_angle": 1.0989151172194476, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.8999999999999932}, "ep003": {"nsteps": 222, "reward": -4.579979553003271, "good_angle": 0.13607555120908302, "survival_time": 7.399999999999984, "traveled_tiles": 4, "valid_direction": 0.2666666666666657}, "ep004": {"nsteps": 500, "reward": -0.4455374931555707, "good_angle": 22.340756351027164, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.466666666666658}}
good_angle_max23.249960382087124
good_angle_mean9.594843145058878
good_angle_median1.1485083237515734
good_angle_min0.13607555120908302
reward_max-0.24118176720687187
reward_mean-1.7221657880751795
reward_median-0.48986030906392264
reward_min-4.579979553003271
survival_time_max16.666666666666654
survival_time_mean14.03999999999998
survival_time_min7.399999999999984
traveled_tiles_max11
traveled_tiles_mean8.6
traveled_tiles_median10
traveled_tiles_min4
valid_direction_max3.8666666666666543
valid_direction_mean2.199999999999993
valid_direction_median2.466666666666658
valid_direction_min0.2666666666666657
No reset possible
86081083Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.833333333333307


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.2706090895058587, "good_angle": 1.0463232627429253, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.9999999999999956}, "ep001": {"nsteps": 219, "reward": -5.045470407160348, "good_angle": 9.418936431059748, "survival_time": 7.299999999999984, "traveled_tiles": 4, "valid_direction": 1.9333333333333271}, "ep002": {"nsteps": 295, "reward": -3.723782868795413, "good_angle": 0.8967775962128568, "survival_time": 9.833333333333307, "traveled_tiles": 7, "valid_direction": 1.899999999999994}, "ep003": {"nsteps": 221, "reward": -4.8211422439209475, "good_angle": 0.08513647553084386, "survival_time": 7.36666666666665, "traveled_tiles": 4, "valid_direction": 0.06666666666666643}, "ep004": {"nsteps": 500, "reward": -0.4882887771707028, "good_angle": 22.451953030925186, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.8333333333333246}}
good_angle_max22.451953030925186
good_angle_mean6.779825359294312
good_angle_median1.0463232627429253
good_angle_min0.08513647553084386
reward_max-0.2706090895058587
reward_mean-2.869858677310654
reward_median-3.723782868795413
reward_min-5.045470407160348
survival_time_max16.666666666666654
survival_time_mean11.566666666666652
survival_time_min7.299999999999984
traveled_tiles_max11
traveled_tiles_mean7.2
traveled_tiles_median7
traveled_tiles_min4
valid_direction_max2.8333333333333246
valid_direction_mean1.7466666666666617
valid_direction_median1.9333333333333271
valid_direction_min0.06666666666666643
No reset possible
86051081Samuel LavoieFast Dukeaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.026502901894182
deviation-center-line_median0.29609876542896774
in-drivable-lane_median0.29999999999999977


other stats
deviation-center-line_max0.3881679462765726
deviation-center-line_mean0.256009892841337
deviation-center-line_min0.09787105195906504
deviation-heading_max1.2582883465122523
deviation-heading_mean0.8164403444433781
deviation-heading_median0.715757844928046
deviation-heading_min0.4619409384167616
driven_any_max4.851083690340034
driven_any_mean2.809838600737188
driven_any_median2.333012060010903
driven_any_min1.107061441768452
driven_lanedir_max4.233987097596685
driven_lanedir_mean2.3892392162612115
driven_lanedir_min0.7446460531440169
in-drivable-lane_max0.7333333333333325
in-drivable-lane_mean0.3533333333333329
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.333012060010903, "driven_lanedir": 2.026502901894182, "in-drivable-lane": 0.29999999999999977, "deviation-heading": 0.5546790906108472, "deviation-center-line": 0.29609876542896774}, "ep001": {"driven_any": 1.107061441768452, "driven_lanedir": 0.7446460531440169, "in-drivable-lane": 0.23333333333333384, "deviation-heading": 0.715757844928046, "deviation-center-line": 0.09787105195906504}, "ep002": {"driven_any": 1.413184619768975, "driven_lanedir": 1.3337674686937264, "in-drivable-lane": 0, "deviation-heading": 0.4619409384167616, "deviation-center-line": 0.1205768150315524}, "ep003": {"driven_any": 4.851083690340034, "driven_lanedir": 4.233987097596685, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.0915355017489827, "deviation-center-line": 0.3881679462765726}, "ep004": {"driven_any": 4.344851191797576, "driven_lanedir": 3.607292559977447, "in-drivable-lane": 0.7333333333333325, "deviation-heading": 1.2582883465122523, "deviation-center-line": 0.37733488551052735}}
No reset possible
85981081Samuel LavoieFast Dukeaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
85931080Samuel LavoieFast Dukeaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:12
Error while running [...]

Creating job8593-4948_visualization_1 ... error
stderr | ERROR: for job8593-4948_visualization_1  Cannot start service visualization: network job8593-4948_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8593-4948_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
85901080Samuel LavoieFast Dukeaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0666666666666655


other stats
episodes
details{"ep000": {"nsteps": 92, "reward": -10.782693317014491, "good_angle": 0.12766480640373673, "survival_time": 3.0666666666666655, "traveled_tiles": 5, "valid_direction": 0.29999999999999893}, "ep001": {"nsteps": 47, "reward": -21.90334716144989, "good_angle": 3.351868628763018, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.9000000000000016}, "ep002": {"nsteps": 120, "reward": -8.640254929141763, "good_angle": 2.7916961082282334, "survival_time": 3.999999999999995, "traveled_tiles": 4, "valid_direction": 1.533333333333328}, "ep003": {"nsteps": 198, "reward": -5.092859296265735, "good_angle": 0.8291319682189233, "survival_time": 6.599999999999986, "traveled_tiles": 9, "valid_direction": 1.2666666666666622}, "ep004": {"nsteps": 64, "reward": -16.372132954900735, "good_angle": 3.5773773714614463, "survival_time": 2.1333333333333355, "traveled_tiles": 3, "valid_direction": 0.8333333333333348}}
good_angle_max3.5773773714614463
good_angle_mean2.1355477766150717
good_angle_median2.7916961082282334
good_angle_min0.12766480640373673
reward_max-5.092859296265735
reward_mean-12.558257531754522
reward_median-10.782693317014491
reward_min-21.90334716144989
survival_time_max6.599999999999986
survival_time_mean3.4733333333333305
survival_time_min1.5666666666666682
traveled_tiles_max9
traveled_tiles_mean4.6
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max1.533333333333328
valid_direction_mean0.966666666666665
valid_direction_median0.9000000000000016
valid_direction_min0.29999999999999893
No reset possible
85861079Samuel LavoieFast Dukeaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.252833438320186
deviation-center-line_median0.10372198050665878
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.22403008129403695
deviation-center-line_mean0.1264496591130352
deviation-center-line_min0.04765361446297067
deviation-heading_max0.7145430064531405
deviation-heading_mean0.4669587985097531
deviation-heading_median0.5265691527390206
deviation-heading_min0.02933251767613155
driven_any_max4.2409847170951345
driven_any_mean2.4370845090085025
driven_any_median2.358951625122108
driven_any_min0.3200000000000016
driven_lanedir_max4.085053952230958
driven_lanedir_mean1.8039434104870304
driven_lanedir_min0.3192668560249463
in-drivable-lane_max3.399999999999989
in-drivable-lane_mean0.7266666666666645
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.358951625122108, "driven_lanedir": 2.113336850739005, "in-drivable-lane": 0.2, "deviation-heading": 0.6136574929497309, "deviation-center-line": 0.17337748445457074}, "ep001": {"driven_any": 0.3200000000000016, "driven_lanedir": 0.3192668560249463, "in-drivable-lane": 0, "deviation-heading": 0.02933251767613155, "deviation-center-line": 0.04765361446297067}, "ep002": {"driven_any": 1.3331086082691668, "driven_lanedir": 1.2492259551200564, "in-drivable-lane": 0, "deviation-heading": 0.4506918227307421, "deviation-center-line": 0.10372198050665878}, "ep003": {"driven_any": 4.2409847170951345, "driven_lanedir": 4.085053952230958, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.7145430064531405, "deviation-center-line": 0.22403008129403695}, "ep004": {"driven_any": 3.932377594556103, "driven_lanedir": 1.252833438320186, "in-drivable-lane": 3.399999999999989, "deviation-heading": 0.5265691527390206, "deviation-center-line": 0.08346513484693885}}
No reset possible
85821079Samuel LavoieFast Dukeaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.166666666666665


other stats
episodes
details{"ep000": {"nsteps": 95, "reward": -10.388415717764904, "good_angle": 0.1676625913873271, "survival_time": 3.166666666666665, "traveled_tiles": 5, "valid_direction": 0.5333333333333322}, "ep001": {"nsteps": 14, "reward": -71.9641075794186, "good_angle": 0.001985530599739759, "survival_time": 0.4666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 55, "reward": -18.34352572114969, "good_angle": 0.14590320046700028, "survival_time": 1.8333333333333357, "traveled_tiles": 3, "valid_direction": 0.20000000000000065}, "ep003": {"nsteps": 168, "reward": -5.935221807808072, "good_angle": 0.16630150162784318, "survival_time": 5.59999999999999, "traveled_tiles": 7, "valid_direction": 0.2333333333333325}, "ep004": {"nsteps": 157, "reward": -7.799302455429344, "good_angle": 8.425794942866164, "survival_time": 5.2333333333333245, "traveled_tiles": 7, "valid_direction": 1.533333333333332}}
good_angle_max8.425794942866164
good_angle_mean1.7815295533896147
good_angle_median0.16630150162784318
good_angle_min0.001985530599739759
reward_max-5.935221807808072
reward_mean-22.88611465631412
reward_median-10.388415717764904
reward_min-71.9641075794186
survival_time_max5.59999999999999
survival_time_mean3.2599999999999967
survival_time_min0.4666666666666666
traveled_tiles_max7
traveled_tiles_mean4.6
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max1.533333333333332
valid_direction_mean0.49999999999999944
valid_direction_median0.2333333333333325
valid_direction_min0
No reset possible
85701078Claudio RuchBig Fleet Controlleraido1_amod_fleet_size_r1-v3step1-simulationerrornorudolf-80:10:35
Timeout: Waited 601 [...]
Timeout:

Waited 601.668540001 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
85661075Claudio RuchBig Fleet Controlleraido1_amod_service_quality_r1-v3step2-scoringsuccessyesrudolf-80:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-34.43219128592712


other stats
efficiency-71.83220514370853
fleet_size-1000000000
No reset possible
85431069Claudio RuchWebinar Algorithmaido1_amod_fleet_size_r1-v3step1-simulationerrornorudolf-80:10:45
Timeout: Waited 603 [...]
Timeout:

Waited 603.033930063 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
85371066Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:04:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.989895791384896
deviation-center-line_median1.1553302918063904
in-drivable-lane_median1.1666666666666623


other stats
deviation-center-line_max2.3388961235533343
deviation-center-line_mean1.4609581191301255
deviation-center-line_min0.7844919613514744
deviation-heading_max2.4107762450679044
deviation-heading_mean1.807309896459126
deviation-heading_median1.9019886565358148
deviation-heading_min1.0937762649705445
driven_any_max5.615088377625264
driven_any_mean4.77235309113726
driven_any_median5.149049260363286
driven_any_min3.381530696392794
driven_lanedir_max5.572551454160816
driven_lanedir_mean4.4589456845011375
driven_lanedir_min2.961707707303685
in-drivable-lane_max1.7666666666666626
in-drivable-lane_mean0.8266666666666644
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.309930784496025, "driven_lanedir": 3.700232848313673, "in-drivable-lane": 1.7666666666666626, "deviation-heading": 2.4107762450679044, "deviation-center-line": 0.9759199581671592}, "ep001": {"driven_any": 5.406166336808935, "driven_lanedir": 4.989895791384896, "in-drivable-lane": 1.1666666666666623, "deviation-heading": 2.00735785023558, "deviation-center-line": 2.05015226077227}, "ep002": {"driven_any": 3.381530696392794, "driven_lanedir": 2.961707707303685, "in-drivable-lane": 1.1999999999999966, "deviation-heading": 1.622650465485788, "deviation-center-line": 0.7844919613514744}, "ep003": {"driven_any": 5.149049260363286, "driven_lanedir": 5.070340621342618, "in-drivable-lane": 0, "deviation-heading": 1.9019886565358148, "deviation-center-line": 1.1553302918063904}, "ep004": {"driven_any": 5.615088377625264, "driven_lanedir": 5.572551454160816, "in-drivable-lane": 0, "deviation-heading": 1.0937762649705445, "deviation-center-line": 2.3388961235533343}}
No reset possible
85341066Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 415, "reward": -2.7206936829117496, "good_angle": 0.921574371754029, "survival_time": 13.833333333333297, "traveled_tiles": 8, "valid_direction": 2.16666666666666}, "ep001": {"nsteps": 500, "reward": -0.3831099150273949, "good_angle": 23.09646275853081, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 3.7666666666666537}, "ep002": {"nsteps": 330, "reward": -3.3639149017589673, "good_angle": 0.6939439195535657, "survival_time": 10.999999999999972, "traveled_tiles": 7, "valid_direction": 1.9666666666666597}, "ep003": {"nsteps": 500, "reward": -0.3618731841999106, "good_angle": 0.4412599956600789, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 0.7666666666666639}, "ep004": {"nsteps": 500, "reward": -0.39206344360706863, "good_angle": 14.647800602340755, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.0666666666666593}}
good_angle_max23.09646275853081
good_angle_mean7.960208329567848
good_angle_median0.921574371754029
good_angle_min0.4412599956600789
reward_max-0.3618731841999106
reward_mean-1.4443310255010182
reward_median-0.39206344360706863
reward_min-3.3639149017589673
survival_time_max16.666666666666654
survival_time_mean14.966666666666644
survival_time_min10.999999999999972
traveled_tiles_max11
traveled_tiles_mean9.2
traveled_tiles_median9
traveled_tiles_min7
valid_direction_max3.7666666666666537
valid_direction_mean2.146666666666659
valid_direction_median2.0666666666666593
valid_direction_min0.7666666666666639
No reset possible
85281065Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.8140952124698827
deviation-center-line_median0.2874404898251744
in-drivable-lane_median0.3999999999999986


other stats
deviation-center-line_max0.7043908907436521
deviation-center-line_mean0.3755826744380205
deviation-center-line_min0.09446512545928508
deviation-heading_max1.7017221611406226
deviation-heading_mean1.1388624039620745
deviation-heading_median1.24129178914597
deviation-heading_min0.6315848785724153
driven_any_max2.1338761202291217
driven_any_mean1.297228563227727
driven_any_median1.191449652706252
driven_any_min0.4300074700579597
driven_lanedir_max2.016314575179443
driven_lanedir_mean0.9995426543174636
driven_lanedir_min0.23110894173291197
in-drivable-lane_max1.3333333333333286
in-drivable-lane_mean0.5533333333333317
in-drivable-lane_min0.16666666666666607
per-episodes
details{"ep000": {"driven_any": 0.4300074700579597, "driven_lanedir": 0.23110894173291197, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 0.6315848785724153, "deviation-center-line": 0.09446512545928508}, "ep001": {"driven_any": 1.0737288111046677, "driven_lanedir": 0.696594063639485, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 1.7017221611406226, "deviation-center-line": 0.25882612724089177}, "ep002": {"driven_any": 1.191449652706252, "driven_lanedir": 0.8140952124698827, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.473328955836251, "deviation-center-line": 0.2874404898251744}, "ep003": {"driven_any": 2.1338761202291217, "driven_lanedir": 2.016314575179443, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.24129178914597, "deviation-center-line": 0.7043908907436521}, "ep004": {"driven_any": 1.6570807620406336, "driven_lanedir": 1.2396004785655954, "in-drivable-lane": 1.3333333333333286, "deviation-heading": 0.6463842351151142, "deviation-center-line": 0.5327907389210992}}
No reset possible
85221064Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0590440806517516
deviation-center-line_median0.2637422261190158
in-drivable-lane_median0.5666666666666647


other stats
deviation-center-line_max0.7628121360012217
deviation-center-line_mean0.38754589109934817
deviation-center-line_min0.12704882810600265
deviation-heading_max1.3280439238986048
deviation-heading_mean0.9421237692750722
deviation-heading_median0.7964074892790874
deviation-heading_min0.6650259823486462
driven_any_max2.1915976498068215
driven_any_mean1.36794514928551
driven_any_median1.349237260941852
driven_any_min0.5381565589027774
driven_lanedir_max2.0194683781171605
driven_lanedir_mean1.09785491824817
driven_lanedir_min0.35384885649291253
in-drivable-lane_max1.0666666666666629
in-drivable-lane_mean0.6133333333333314
in-drivable-lane_min0.1999999999999993
per-episodes
details{"ep000": {"driven_any": 0.5381565589027774, "driven_lanedir": 0.35384885649291253, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 0.6650259823486462, "deviation-center-line": 0.12704882810600265}, "ep001": {"driven_any": 1.0752521242876074, "driven_lanedir": 0.7278180553603566, "in-drivable-lane": 0.8666666666666636, "deviation-heading": 0.7964074892790874, "deviation-center-line": 0.255267466699048}, "ep002": {"driven_any": 1.349237260941852, "driven_lanedir": 1.0590440806517516, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 1.2046458184420228, "deviation-center-line": 0.2637422261190158}, "ep003": {"driven_any": 2.1915976498068215, "driven_lanedir": 2.0194683781171605, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 1.3280439238986048, "deviation-center-line": 0.7628121360012217}, "ep004": {"driven_any": 1.6854821524884926, "driven_lanedir": 1.3290952206186686, "in-drivable-lane": 1.0666666666666629, "deviation-heading": 0.7164956324069998, "deviation-center-line": 0.5288587985714528}}
No reset possible
85101063Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
85051063Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.25416273124999134, "good_angle": 0.7444893646124573, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 500, "reward": -0.44939830574346706, "good_angle": 23.524621673805804, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.166666666666655}, "ep002": {"nsteps": 500, "reward": -0.3045769970673136, "good_angle": 0.7257529187394196, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.5666666666666649}, "ep003": {"nsteps": 500, "reward": -0.2888979723546654, "good_angle": 0.4591799947974504, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 0.6999999999999975}, "ep004": {"nsteps": 500, "reward": -0.39088739768415687, "good_angle": 17.242621474406523, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.166666666666659}}
good_angle_max23.524621673805804
good_angle_mean8.539333085272329
good_angle_median0.7444893646124573
good_angle_min0.4591799947974504
reward_max-0.25416273124999134
reward_mean-0.3375846808199189
reward_median-0.3045769970673136
reward_min-0.44939830574346706
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max11
traveled_tiles_mean10.2
traveled_tiles_median10
traveled_tiles_min9
valid_direction_max4.166666666666655
valid_direction_mean2.013333333333327
valid_direction_median1.5666666666666649
valid_direction_min0.6999999999999975
No reset possible
84941061Mandana Samiei 🇨🇦bazinga!!!aido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9666666666666697


other stats
episodes
details{"ep000": {"nsteps": 220, "reward": -4.685009788676557, "good_angle": 0.8076957338944025, "survival_time": 7.333333333333317, "traveled_tiles": 2, "valid_direction": 0.9999999999999964}, "ep001": {"nsteps": 53, "reward": -19.414937066582013, "good_angle": 0.03280049822537973, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 48, "reward": -21.27974657838543, "good_angle": 0.4468633402845622, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.7000000000000014}, "ep003": {"nsteps": 59, "reward": -17.301283067692136, "good_angle": 0.5392666859174008, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.8000000000000019}, "ep004": {"nsteps": 68, "reward": -15.174569403862252, "good_angle": 0.3832377575607332, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.6333333333333333}}
good_angle_max0.8076957338944025
good_angle_mean0.4419728031764957
good_angle_median0.4468633402845622
good_angle_min0.03280049822537973
reward_max-4.685009788676557
reward_mean-15.571109181039676
reward_median-17.301283067692136
reward_min-21.27974657838543
survival_time_max7.333333333333317
survival_time_mean2.9866666666666655
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.9999999999999964
valid_direction_mean0.6266666666666667
valid_direction_median0.7000000000000014
valid_direction_min0
No reset possible
84921061Mandana Samiei 🇨🇦bazinga!!!aido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
84861059Mandana Samiei 🇨🇦bazinga!!!aido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.18432958645266373
deviation-center-line_median0.1903067388339497
in-drivable-lane_median0


other stats
deviation-center-line_max0.3638369144072225
deviation-center-line_mean0.20281651861136468
deviation-center-line_min0.12969935361256285
deviation-heading_max1.764454269158792
deviation-heading_mean0.7934173788539537
deviation-heading_median0.6420676885644672
deviation-heading_min0.21000204087185195
driven_any_max0.8143193326557515
driven_any_mean0.31857438282486134
driven_any_median0.1999837410490108
driven_any_min0.15712882070308834
driven_lanedir_max0.5781194172899131
driven_lanedir_mean0.2592283223446602
driven_lanedir_min0.1361674384288447
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8143193326557515, "driven_lanedir": 0.5781194172899131, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.764454269158792, "deviation-center-line": 0.3638369144072225}, "ep001": {"driven_any": 0.18572532904378736, "driven_lanedir": 0.18432958645266373, "in-drivable-lane": 0, "deviation-heading": 0.21000204087185195, "deviation-center-line": 0.1903067388339497}, "ep002": {"driven_any": 0.15712882070308834, "driven_lanedir": 0.1361674384288447, "in-drivable-lane": 0, "deviation-heading": 0.6420676885644672, "deviation-center-line": 0.12969935361256285}, "ep003": {"driven_any": 0.1999837410490108, "driven_lanedir": 0.17974964386648518, "in-drivable-lane": 0, "deviation-heading": 0.7291853471865158, "deviation-center-line": 0.1320024695877375}, "ep004": {"driven_any": 0.2357146906726685, "driven_lanedir": 0.2177755256853944, "in-drivable-lane": 0, "deviation-heading": 0.6213775484881418, "deviation-center-line": 0.1982371166153506}}
No reset possible
84811059Mandana Samiei 🇨🇦bazinga!!!aido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
84771057Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
84681056Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
84641056Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.6666666666666634


other stats
episodes
details{"ep000": {"nsteps": 34, "reward": -29.653921192765292, "good_angle": 0.5432750363228189, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep001": {"nsteps": 34, "reward": -29.970305812709473, "good_angle": 0.0050401930608778515, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 110, "reward": -9.593723950873722, "good_angle": 0.43242677581517874, "survival_time": 3.6666666666666634, "traveled_tiles": 3, "valid_direction": 0.93333333333333}, "ep003": {"nsteps": 196, "reward": -5.411052850930362, "good_angle": 0.4479678779418729, "survival_time": 6.53333333333332, "traveled_tiles": 4, "valid_direction": 0.9666666666666632}, "ep004": {"nsteps": 148, "reward": -7.345814647617108, "good_angle": 8.8217135095513, "survival_time": 4.933333333333326, "traveled_tiles": 3, "valid_direction": 1.699999999999994}}
good_angle_max8.8217135095513
good_angle_mean2.05008467853841
good_angle_median0.4479678779418729
good_angle_min0.0050401930608778515
reward_max-5.411052850930362
reward_mean-16.39496369097919
reward_median-9.593723950873722
reward_min-29.970305812709473
survival_time_max6.53333333333332
survival_time_mean3.4799999999999955
survival_time_min1.1333333333333335
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.699999999999994
valid_direction_mean0.9133333333333308
valid_direction_median0.9666666666666632
valid_direction_min0
No reset possible
84541055Benjamin Ramtoula 🇨🇦My ROS solution - param 3aido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.3771748235225678, "good_angle": 1.0277198501197526, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.366666666666659}, "ep001": {"nsteps": 500, "reward": -1.3083202472282571, "good_angle": 44.456263798940945, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 7.599999999999982}, "ep002": {"nsteps": 500, "reward": -1.1992063284544274, "good_angle": 1.568864095112673, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.9333333333333274}, "ep003": {"nsteps": 500, "reward": -1.2368925113058649, "good_angle": 1.4365797579696458, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.7666666666666617}, "ep004": {"nsteps": 500, "reward": -1.218028003601357, "good_angle": 45.29305904817017, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 6.533333333333354}}
good_angle_max45.29305904817017
good_angle_mean18.75649731006264
good_angle_median1.568864095112673
good_angle_min1.0277198501197526
reward_max-1.1992063284544274
reward_mean-1.267924382822495
reward_median-1.2368925113058649
reward_min-1.3771748235225678
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max8
traveled_tiles_mean7.6
traveled_tiles_median8
traveled_tiles_min7
valid_direction_max7.599999999999982
valid_direction_mean4.839999999999996
valid_direction_median3.9333333333333274
valid_direction_min2.366666666666659
No reset possible
84521055Benjamin Ramtoula 🇨🇦My ROS solution - param 3aido1_LF1_r3-v3step1-simulationfailednorudolf-80:07:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84451054David AbrahamPytorch ILaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:26
Error while running [...]

Creating job8445-6173_videos_1 ... error
stderr | ERROR: for job8445-6173_videos_1  Cannot start service videos: network job8445-6173_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8445-6173_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84391053Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1335426343607509
deviation-center-line_median0.2163994710606635
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.28180888308880353
deviation-center-line_mean0.1868670999277449
deviation-center-line_min0.08957428132230419
deviation-heading_max1.5426025300799389
deviation-heading_mean0.6740741984343177
deviation-heading_median0.4611700117329748
deviation-heading_min0.07445946794710315
driven_any_max2.1088593834937095
driven_any_mean1.1131299013905018
driven_any_median1.174004192872781
driven_any_min0.347853094184539
driven_lanedir_max2.0685111737018964
driven_lanedir_mean0.990226087953578
driven_lanedir_min0.14358789111971848
in-drivable-lane_max0.33333333333333215
in-drivable-lane_mean0.11999999999999976
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3478530941845396, "driven_lanedir": 0.14358789111971848, "in-drivable-lane": 0.23333333333333336, "deviation-heading": 0.8789018596983168, "deviation-center-line": 0.08957428132230419}, "ep001": {"driven_any": 0.347853094184539, "driven_lanedir": 0.3470542158569685, "in-drivable-lane": 0, "deviation-heading": 0.07445946794710315, "deviation-center-line": 0.12073881609793594}, "ep002": {"driven_any": 1.174004192872781, "driven_lanedir": 1.1335426343607509, "in-drivable-lane": 0, "deviation-heading": 0.4611700117329748, "deviation-center-line": 0.2163994710606635}, "ep003": {"driven_any": 2.1088593834937095, "driven_lanedir": 2.0685111737018964, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.4132371227132552, "deviation-center-line": 0.28180888308880353}, "ep004": {"driven_any": 1.58707974221694, "driven_lanedir": 1.2584345247285562, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 1.5426025300799389, "deviation-center-line": 0.22581404806901717}}
No reset possible
84311052Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9000000000000024


other stats
episodes
details{"ep000": {"nsteps": 228, "reward": -4.544706287524222, "good_angle": 0.7055388557312879, "survival_time": 7.599999999999983, "traveled_tiles": 2, "valid_direction": 0.7999999999999974}, "ep001": {"nsteps": 18, "reward": -56.22312803235319, "good_angle": 0.4065845464531816, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 45, "reward": -22.69302364322874, "good_angle": 0.4408105114032268, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 0.7333333333333347}, "ep003": {"nsteps": 57, "reward": -17.89524257875848, "good_angle": 0.5804233306775364, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.8000000000000024}, "ep004": {"nsteps": 69, "reward": -14.968996045382127, "good_angle": 0.3457390421344991, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.8000000000000003}}
good_angle_max0.7055388557312879
good_angle_mean0.4958192572799464
good_angle_median0.4408105114032268
good_angle_min0.3457390421344991
reward_max-4.544706287524222
reward_mean-23.26501931744935
reward_median-17.89524257875848
reward_min-56.22312803235319
survival_time_max7.599999999999983
survival_time_mean2.7799999999999976
survival_time_min0.6
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.8000000000000024
valid_direction_mean0.7200000000000003
valid_direction_median0.7999999999999974
valid_direction_min0.4666666666666666
No reset possible
84211051David AbrahamPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.666666666666649


other stats
episodes
details{"ep000": {"nsteps": 37, "reward": -27.294602750913818, "good_angle": 0.8483111658711615, "survival_time": 1.2333333333333338, "traveled_tiles": 1, "valid_direction": 1.033333333333334}, "ep001": {"nsteps": 500, "reward": -0.4528968470962718, "good_angle": 21.56866975144795, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.233333333333319}, "ep002": {"nsteps": 129, "reward": -7.944797620781907, "good_angle": 0.5179636696946632, "survival_time": 4.2999999999999945, "traveled_tiles": 3, "valid_direction": 0.7666666666666639}, "ep003": {"nsteps": 230, "reward": -4.314899835234973, "good_angle": 0.54671284450962, "survival_time": 7.666666666666649, "traveled_tiles": 4, "valid_direction": 0.7666666666666639}, "ep004": {"nsteps": 500, "reward": -0.5305628583235666, "good_angle": 17.07359450863618, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.3333333333333215}}
good_angle_max21.56866975144795
good_angle_mean8.111050388031916
good_angle_median0.8483111658711615
good_angle_min0.5179636696946632
reward_max-0.4528968470962718
reward_mean-8.107551982470108
reward_median-4.314899835234973
reward_min-27.294602750913818
survival_time_max16.666666666666654
survival_time_mean9.306666666666658
survival_time_min1.2333333333333338
traveled_tiles_max10
traveled_tiles_mean5.4
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max4.233333333333319
valid_direction_mean2.0266666666666606
valid_direction_median1.033333333333334
valid_direction_min0.7666666666666639
No reset possible
84161050David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:13
Error while running [...]

Creating job8416-1668_visualization_1 ... error
stderr | ERROR: for job8416-1668_visualization_1  Cannot start service visualization: network job8416-1668_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8416-1668_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
84081049Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.14353239706145726
deviation-center-line_median0.2611249267004372
in-drivable-lane_median8.166666666666654


other stats
deviation-center-line_max0.48868500565471173
deviation-center-line_mean0.3070331243774142
deviation-center-line_min0.1340678952733617
deviation-heading_max6.643668630970864
deviation-heading_mean3.821496343273332
deviation-heading_median2.675464152341786
deviation-heading_min1.0454401062248788
driven_any_max1.1116828683255884
driven_any_mean0.7501320866951738
driven_any_median1.0598125943360273
driven_any_min0.14340491274231532
driven_lanedir_max-0.04060430073660149
driven_lanedir_mean-0.19841643353470348
driven_lanedir_min-0.3726552663841538
in-drivable-lane_max13.066666666666643
in-drivable-lane_mean6.7466666666666555
in-drivable-lane_min1.3999999999999997
per-episodes
details{"ep000": {"driven_any": 1.1116828683255884, "driven_lanedir": -0.14353239706145726, "in-drivable-lane": 13.066666666666643, "deviation-heading": 2.675464152341786, "deviation-center-line": 0.48868500565471173}, "ep001": {"driven_any": 0.14340491274231532, "driven_lanedir": -0.04060430073660149, "in-drivable-lane": 1.3999999999999997, "deviation-heading": 1.0454401062248788, "deviation-center-line": 0.1340678952733617}, "ep002": {"driven_any": 1.0598125943360273, "driven_lanedir": -0.3726552663841538, "in-drivable-lane": 8.166666666666654, "deviation-heading": 6.643668630970864, "deviation-center-line": 0.4247018404398309}, "ep003": {"driven_any": 1.111274571625996, "driven_lanedir": -0.35278280525851313, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.589442248739042, "deviation-center-line": 0.2611249267004372}, "ep004": {"driven_any": 0.32448548644594255, "driven_lanedir": -0.08250739823279174, "in-drivable-lane": 2.866666666666661, "deviation-heading": 2.15346657809009, "deviation-center-line": 0.2265859538187296}}
No reset possible
83981042Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
83911047Pravish Sainath 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
83871045David AbrahamPytorch ILaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
83821045David AbrahamPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.07831167613854632, "good_angle": 0.10488373112954916, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep001": {"nsteps": 43, "reward": -23.9106015902619, "good_angle": 0.2431965522977674, "survival_time": 1.4333333333333345, "traveled_tiles": 1, "valid_direction": 0.9333333333333343}, "ep002": {"nsteps": 500, "reward": -0.08896892983990255, "good_angle": 1.587610648010474, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.666666666666657}, "ep003": {"nsteps": 500, "reward": 0.2634899687754514, "good_angle": 0.04892622029136081, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.06862925032433122, "good_angle": 19.198202560906974, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 2.2333333333333254}}
good_angle_max19.198202560906974
good_angle_mean4.236563942527225
good_angle_median0.2431965522977674
good_angle_min0.04892622029136081
reward_max0.2634899687754514
reward_mean-4.745279625102428
reward_median-0.06862925032433122
reward_min-23.9106015902619
survival_time_max16.666666666666654
survival_time_mean13.61999999999999
survival_time_min1.4333333333333345
traveled_tiles_max5
traveled_tiles_mean3.4
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max2.666666666666657
valid_direction_mean1.1666666666666634
valid_direction_median0.9333333333333343
valid_direction_min0
No reset possible
83701045David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
83651043David AbrahamPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.5666666666666667


other stats
episodes
details{"ep000": {"nsteps": 185, "reward": -6.03524352693301, "good_angle": 11.250887989586364, "survival_time": 6.1666666666666545, "traveled_tiles": 3, "valid_direction": 2.9333333333333327}, "ep001": {"nsteps": 13, "reward": -77.5785642174574, "good_angle": 0.5140917436326742, "survival_time": 0.4333333333333333, "traveled_tiles": 1, "valid_direction": 0.4}, "ep002": {"nsteps": 17, "reward": -59.382281224517264, "good_angle": 0.6173464502154664, "survival_time": 0.5666666666666667, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep003": {"nsteps": 27, "reward": -38.671836453731416, "good_angle": 1.0569637651764685, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.6999999999999998}, "ep004": {"nsteps": 17, "reward": -59.5370080611285, "good_angle": 0.7895112503640007, "survival_time": 0.5666666666666667, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}}
good_angle_max11.250887989586364
good_angle_mean2.845760239794995
good_angle_median0.7895112503640007
good_angle_min0.5140917436326742
reward_max-6.03524352693301
reward_mean-48.24098669675352
reward_median-59.382281224517264
reward_min-77.5785642174574
survival_time_max6.1666666666666545
survival_time_mean1.726666666666664
survival_time_min0.4333333333333333
traveled_tiles_max3
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max2.9333333333333327
valid_direction_mean0.9933333333333332
valid_direction_median0.4666666666666666
valid_direction_min0.4
No reset possible
83591042Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:11
Error while running [...]

Creating job8359-4213_videos_1 ... error
stderr | ERROR: for job8359-4213_videos_1  Cannot start service videos: network job8359-4213_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8359-4213_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
83461040Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.46666666666665


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -13.368606731862345, "good_angle": 0.12579438509513446, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 0.16666666666666663}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 277, "reward": -3.839482358106688, "good_angle": 0.4756246841482495, "survival_time": 9.233333333333311, "traveled_tiles": 7, "valid_direction": 0.8666666666666636}, "ep003": {"nsteps": 224, "reward": -4.596634012518085, "good_angle": 0.14758094880083045, "survival_time": 7.46666666666665, "traveled_tiles": 5, "valid_direction": 0.29999999999999893}, "ep004": {"nsteps": 302, "reward": -3.629076436019559, "good_angle": 9.480099014909849, "survival_time": 10.066666666666642, "traveled_tiles": 4, "valid_direction": 3.0333333333333248}}
good_angle_max9.480099014909849
good_angle_mean2.0466445654553196
good_angle_median0.14758094880083045
good_angle_min0.004123794322536422
reward_max-3.629076436019559
reward_mean-12.340843789760704
reward_median-4.596634012518085
reward_min-36.270419410296846
survival_time_max10.066666666666642
survival_time_mean6.046666666666654
survival_time_min0.9333333333333332
traveled_tiles_max7
traveled_tiles_mean3.8
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max3.0333333333333248
valid_direction_mean0.8733333333333307
valid_direction_median0.29999999999999893
valid_direction_min0
No reset possible
83431039Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
83351038Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.13806526205428948
deviation-center-line_median0.102009000895267
in-drivable-lane_median0


other stats
deviation-center-line_max0.3628429863650274
deviation-center-line_mean0.1469315378158457
deviation-center-line_min0.06440998989810495
deviation-heading_max2.610674736500284
deviation-heading_mean0.8993390544048525
deviation-heading_median0.4974425787034586
deviation-heading_min0.3916093126081396
driven_any_max2.074558617600871
driven_any_mean0.5391343537461835
driven_any_median0.19255580990632737
driven_any_min0.052784877179512885
driven_lanedir_max0.1797688277475031
driven_lanedir_mean0.12055276914839869
driven_lanedir_min0.039230050910547654
in-drivable-lane_max14.466666666666637
in-drivable-lane_mean2.979999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.074558617600871, "driven_lanedir": 0.08456578465685204, "in-drivable-lane": 14.466666666666637, "deviation-heading": 2.610674736500284, "deviation-center-line": 0.3628429863650274}, "ep001": {"driven_any": 0.052784877179512885, "driven_lanedir": 0.039230050910547654, "in-drivable-lane": 0, "deviation-heading": 0.3916093126081396, "deviation-center-line": 0.06440998989810495}, "ep002": {"driven_any": 0.15528572315447434, "driven_lanedir": 0.13806526205428948, "in-drivable-lane": 0, "deviation-heading": 0.4974425787034586, "deviation-center-line": 0.102009000895267}, "ep003": {"driven_any": 0.22048674088973164, "driven_lanedir": 0.16113392037280105, "in-drivable-lane": 0.4333333333333347, "deviation-heading": 0.545639049940578, "deviation-center-line": 0.07069787421195953}, "ep004": {"driven_any": 0.19255580990632737, "driven_lanedir": 0.1797688277475031, "in-drivable-lane": 0, "deviation-heading": 0.4513295942718027, "deviation-center-line": 0.13469783770886962}}
No reset possible
83321038Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.333333333333334


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.832102973788977, "good_angle": 54.156244798882895, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.76666666666666}, "ep001": {"nsteps": 19, "reward": -53.26256277843525, "good_angle": 0.42333542507995897, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 32, "reward": -31.799377603456374, "good_angle": 0.3633398703679105, "survival_time": 1.0666666666666669, "traveled_tiles": 2, "valid_direction": 0.6666666666666666}, "ep003": {"nsteps": 51, "reward": -20.714474983805538, "good_angle": 0.9750023813461068, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 1.000000000000002}, "ep004": {"nsteps": 40, "reward": -25.556856862455607, "good_angle": 0.2605409742406928, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.43333333333333424}}
good_angle_max54.156244798882895
good_angle_mean11.235692689983512
good_angle_median0.42333542507995897
good_angle_min0.2605409742406928
reward_max-1.832102973788977
reward_mean-26.63307504038835
reward_median-25.556856862455607
reward_min-53.26256277843525
survival_time_max16.666666666666654
survival_time_mean4.2799999999999985
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.76666666666666
valid_direction_mean3.459999999999998
valid_direction_median0.6666666666666666
valid_direction_min0.4333333333333333
No reset possible
83241036Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:13
Error while running [...]

Creating job8324-4499_solution_1  ... error
stderr | ERROR: for job8324-4499_solution_1  Cannot start service solution: network job8324-4499_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8324-4499_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8324-4499_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
83151034Samuel LavoieYoung Dukeaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.8341183952516875
deviation-center-line_median0.1358348793072531
in-drivable-lane_median0.8333333333333304


other stats
deviation-center-line_max0.6382228311645498
deviation-center-line_mean0.2245195044722196
deviation-center-line_min0
deviation-heading_max1.9602035414083736
deviation-heading_mean0.7779025626180096
deviation-heading_median0.26837434244431935
deviation-heading_min0
driven_any_max4.013385758739609
driven_any_mean1.5186964751910996
driven_any_median1.0537632787052789
driven_any_min0.5266524301703258
driven_lanedir_max2.6815313575984794
driven_lanedir_mean1.0169025785818993
driven_lanedir_min0
in-drivable-lane_max2.7333333333333236
in-drivable-lane_mean1.1133333333333313
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6130818994328824, "driven_lanedir": 0, "in-drivable-lane": 2.0000000000000027, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.5266524301703258, "driven_lanedir": 0.5218129970084366, "in-drivable-lane": 0, "deviation-heading": 0.16141368104811712, "deviation-center-line": 0.1214156436616722}, "ep002": {"driven_any": 1.386599008907402, "driven_lanedir": 0.8341183952516875, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 1.4995212481892382, "deviation-center-line": 0.227124168227623}, "ep003": {"driven_any": 4.013385758739609, "driven_lanedir": 2.6815313575984794, "in-drivable-lane": 2.7333333333333236, "deviation-heading": 1.9602035414083736, "deviation-center-line": 0.6382228311645498}, "ep004": {"driven_any": 1.0537632787052789, "driven_lanedir": 1.047050143050892, "in-drivable-lane": 0, "deviation-heading": 0.26837434244431935, "deviation-center-line": 0.1358348793072531}}
No reset possible
83121034Samuel LavoieYoung Dukeaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:12
Error while running [...]

Creating job8312-7436_videos_1 ... error
stderr | ERROR: for job8312-7436_videos_1  Cannot start service videos: network job8312-7436_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8312-7436_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
83081030Samuel LavoieCrazy Dukeaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9032319426229398
deviation-center-line_median0.1464104540769772
in-drivable-lane_median0.6000000000000019


other stats
deviation-center-line_max0.919731238283779
deviation-center-line_mean0.31017499650272506
deviation-center-line_min0.05317101375295892
deviation-heading_max2.2024442559199833
deviation-heading_mean0.9186176709363169
deviation-heading_median0.9650400517096028
deviation-heading_min0.11391134655719032
driven_any_max8.426207682698962
driven_any_mean3.015279712432189
driven_any_median1.3702440045636812
driven_any_min0.4130677556371271
driven_lanedir_max6.559354487173541
driven_lanedir_mean2.216682394104033
driven_lanedir_min0.4051189510808457
in-drivable-lane_max3.233333333333336
in-drivable-lane_mean1.1799999999999993
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 8.426207682698962, "driven_lanedir": 6.559354487173541, "in-drivable-lane": 3.233333333333336, "deviation-heading": 2.2024442559199833, "deviation-center-line": 0.919731238283779}, "ep001": {"driven_any": 0.4130677556371271, "driven_lanedir": 0.4051189510808457, "in-drivable-lane": 0, "deviation-heading": 0.11391134655719032, "deviation-center-line": 0.05317101375295892}, "ep002": {"driven_any": 1.3702440045636812, "driven_lanedir": 0.7821423191224717, "in-drivable-lane": 0.6000000000000019, "deviation-heading": 0.9650400517096028, "deviation-center-line": 0.1464104540769772}, "ep003": {"driven_any": 3.930791375383907, "driven_lanedir": 2.4335642705203657, "in-drivable-lane": 2.0666666666666593, "deviation-heading": 1.035361986522154, "deviation-center-line": 0.3726846930168407}, "ep004": {"driven_any": 0.9360877438772685, "driven_lanedir": 0.9032319426229398, "in-drivable-lane": 0, "deviation-heading": 0.27633071397265274, "deviation-center-line": 0.058877583383069455}}
No reset possible
83041030Samuel LavoieCrazy Dukeaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
82951030Samuel LavoieCrazy Dukeaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:06:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
82901027Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
82871027Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.933333333333315


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.3701488013258204, "good_angle": 0.6058817932506364, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.2333333333333292}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.4321476400345564, "good_angle": 0.6623218333699774, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.1333333333333293}, "ep003": {"nsteps": 224, "reward": -4.642331055026651, "good_angle": 0.1130436329615555, "survival_time": 7.46666666666665, "traveled_tiles": 5, "valid_direction": 0.16666666666666607}, "ep004": {"nsteps": 238, "reward": -4.661016504452446, "good_angle": 10.885551075653066, "survival_time": 7.933333333333315, "traveled_tiles": 6, "valid_direction": 2.1333333333333258}}
good_angle_max10.885551075653066
good_angle_mean2.454184425911554
good_angle_median0.6058817932506364
good_angle_min0.004123794322536422
reward_max-0.3701488013258204
reward_mean-9.275212682227265
reward_median-4.642331055026651
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean9.93333333333332
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean7.2
traveled_tiles_median6
traveled_tiles_min1
valid_direction_max2.1333333333333258
valid_direction_mean0.93333333333333
valid_direction_median1.1333333333333293
valid_direction_min0
No reset possible
82861028Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    num_stack=1)
  File "/workspace/model.py", line 246, in __init__
    self._current_obs = self._current_obs.cuda()
RuntimeError: cuda runtime error (35) : CUDA driver version is insufficient for CUDA runtime version at /tmp/pip-req-build-vRRdPa/aten/src/THC/THCGeneral.cpp:74


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82771025Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:14
Error while running [...]

Creating job8277-7253_evaluator_1 ... error
stderr | ERROR: for job8277-7253_evaluator_1  Cannot start service evaluator: network job8277-7253_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8277-7253_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8277-7253_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82691024Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:14
Error while running [...]

Creating job8269-8968_evaluator_1 ... error
stderr | ERROR: for job8269-8968_evaluator_1  Cannot start service evaluator: network job8269-8968_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8269-8968_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8269-8968_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82651021Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:49
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82621019Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 286, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
ModuleNotFoundError: No module named 'duckietown_rl'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 286, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
ModuleNotFoundError: No module named 'duckietown_rl'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82491016Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0420704966136085
deviation-center-line_median0.450762725966435
in-drivable-lane_median1.4333333333333282


other stats
deviation-center-line_max0.6883340509228337
deviation-center-line_mean0.4338478802433427
deviation-center-line_min0.20320804757303057
deviation-heading_max2.472742851242546
deviation-heading_mean1.6272956424260854
deviation-heading_median1.779711963877342
deviation-heading_min0.3847169219113941
driven_any_max3.3232179923540857
driven_any_mean1.4969973296695418
driven_any_median1.434880110160263
driven_any_min0.3975416116703704
driven_lanedir_max2.9516039212976346
driven_lanedir_mean1.1778170860958144
driven_lanedir_min0.19414959063454773
in-drivable-lane_max2.633333333333325
in-drivable-lane_mean1.3266666666666622
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3975416116703704, "driven_lanedir": 0.19414959063454773, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 1.938830071623383, "deviation-center-line": 0.20320804757303057}, "ep001": {"driven_any": 0.5652526814066909, "driven_lanedir": 0.5544790059832945, "in-drivable-lane": 0, "deviation-heading": 0.3847169219113941, "deviation-center-line": 0.3704325753311614}, "ep002": {"driven_any": 1.434880110160263, "driven_lanedir": 1.0420704966136085, "in-drivable-lane": 1.4333333333333282, "deviation-heading": 2.472742851242546, "deviation-center-line": 0.450762725966435}, "ep003": {"driven_any": 3.3232179923540857, "driven_lanedir": 2.9516039212976346, "in-drivable-lane": 2.199999999999992, "deviation-heading": 1.5604764034757617, "deviation-center-line": 0.6883340509228337}, "ep004": {"driven_any": 1.7640942527562995, "driven_lanedir": 1.1467824159499866, "in-drivable-lane": 2.633333333333325, "deviation-heading": 1.779711963877342, "deviation-center-line": 0.456502001423253}}
No reset possible
82451016Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:11
Error while running [...]

Creating job8245-4456_videos_1 ... error
stderr | ERROR: for job8245-4456_videos_1  Cannot start service videos: network job8245-4456_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8245-4456_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
82391016Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.533333333333316


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -13.416412785493058, "good_angle": 0.9723576108709706, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.333333333333334}, "ep001": {"nsteps": 108, "reward": -9.848042460503402, "good_angle": 2.041641545621004, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5666666666666647}, "ep002": {"nsteps": 226, "reward": -4.574839447271614, "good_angle": 1.5760425170941503, "survival_time": 7.533333333333316, "traveled_tiles": 5, "valid_direction": 2.5999999999999908}, "ep003": {"nsteps": 500, "reward": -0.13448444758018013, "good_angle": 0.6536031283623902, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 2.06666666666666}, "ep004": {"nsteps": 282, "reward": -4.769903202343019, "good_angle": 16.060156931528677, "survival_time": 9.399999999999975, "traveled_tiles": 3, "valid_direction": 4.166666666666653}}
good_angle_max16.060156931528677
good_angle_mean4.260760346695439
good_angle_median1.5760425170941503
good_angle_min0.6536031283623902
reward_max-0.13448444758018013
reward_mean-6.548736468638255
reward_median-4.769903202343019
reward_min-13.416412785493058
survival_time_max16.666666666666654
survival_time_mean7.946666666666656
survival_time_min2.533333333333334
traveled_tiles_max6
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.166666666666653
valid_direction_mean2.3466666666666605
valid_direction_median2.333333333333334
valid_direction_min0.5666666666666647
No reset possible
82341014David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-1.142932900873518
deviation-center-line_median0.09445373383741563
in-drivable-lane_median3.466666666666659


other stats
deviation-center-line_max1.9299136185950747
deviation-center-line_mean0.5804304621848139
deviation-center-line_min0.06413906384876124
deviation-heading_max8.940075694114796
deviation-heading_mean3.974036419562649
deviation-heading_median3.547062736196972
deviation-heading_min0.8197794159335278
driven_any_max10.671631259582044
driven_any_mean4.2744956927806825
driven_any_median3.4200635012389142
driven_any_min0.7040695364676268
driven_lanedir_max-0.1931532907991844
driven_lanedir_mean-1.0243465951862576
driven_lanedir_min-1.8271531863367925
in-drivable-lane_max10.599999999999993
in-drivable-lane_mean4.213333333333329
in-drivable-lane_min0.6666666666666673
per-episodes
details{"ep000": {"driven_any": 10.671631259582044, "driven_lanedir": -1.8271531863367925, "in-drivable-lane": 10.599999999999993, "deviation-heading": 5.371108920122465, "deviation-center-line": 0.7422640533223187}, "ep001": {"driven_any": 0.7040695364676268, "driven_lanedir": -0.1931532907991844, "in-drivable-lane": 0.6666666666666673, "deviation-heading": 0.8197794159335278, "deviation-center-line": 0.06413906384876124}, "ep002": {"driven_any": 1.2063823407005771, "driven_lanedir": -0.36058939151099034, "in-drivable-lane": 1.0333333333333337, "deviation-heading": 1.1921553314454785, "deviation-center-line": 0.071381841320499}, "ep003": {"driven_any": 3.4200635012389142, "driven_lanedir": -1.142932900873518, "in-drivable-lane": 3.466666666666659, "deviation-heading": 3.547062736196972, "deviation-center-line": 0.09445373383741563}, "ep004": {"driven_any": 5.370331825914249, "driven_lanedir": -1.597904206410803, "in-drivable-lane": 5.299999999999996, "deviation-heading": 8.940075694114796, "deviation-center-line": 1.9299136185950747}}
No reset possible
82301014David AbrahamPytorch ILaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
82231015David AbrahamPytorch ILaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
82191015David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
82111012David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.361710864104449
deviation-center-line_median0.2783072659197908
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.6050064686595661
deviation-center-line_mean0.31461217400608266
deviation-center-line_min0.17005166211675882
deviation-heading_max1.9169169762749656
deviation-heading_mean1.3761961901678326
deviation-heading_median1.2759200934769432
deviation-heading_min0.9383173707596384
driven_any_max4.252547344324386
driven_any_mean2.1598055194999795
driven_any_median1.595991497331806
driven_any_min1.1641876080390487
driven_lanedir_max4.024505797728752
driven_lanedir_mean1.923334501859577
driven_lanedir_min0.8874632716964423
in-drivable-lane_max0.5999999999999999
in-drivable-lane_mean0.2333333333333329
in-drivable-lane_min0.033333333333333215
per-episodes
details{"ep000": {"driven_any": 2.3423219042750647, "driven_lanedir": 2.039163406184771, "in-drivable-lane": 0.5999999999999999, "deviation-heading": 1.2641576047306058, "deviation-center-line": 0.2783072659197908}, "ep001": {"driven_any": 1.1641876080390487, "driven_lanedir": 0.8874632716964423, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.4856689055970107, "deviation-center-line": 0.29214794376015657}, "ep002": {"driven_any": 1.443979243529592, "driven_lanedir": 1.361710864104449, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.9383173707596384, "deviation-center-line": 0.227547529574141}, "ep003": {"driven_any": 4.252547344324386, "driven_lanedir": 4.024505797728752, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.9169169762749656, "deviation-center-line": 0.6050064686595661}, "ep004": {"driven_any": 1.595991497331806, "driven_lanedir": 1.3038291695834712, "in-drivable-lane": 0.2333333333333325, "deviation-heading": 1.2759200934769432, "deviation-center-line": 0.17005166211675882}}
No reset possible
82041013David AbrahamPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8666666666666623


other stats
episodes
details{"ep000": {"nsteps": 190, "reward": -5.205830141776977, "good_angle": 1.396838191834734, "survival_time": 6.333333333333321, "traveled_tiles": 4, "valid_direction": 0.7333333333333308}, "ep001": {"nsteps": 46, "reward": -22.44177474923756, "good_angle": 0.6096318451873292, "survival_time": 1.5333333333333348, "traveled_tiles": 1, "valid_direction": 0.33333333333333437}, "ep002": {"nsteps": 116, "reward": -8.61695077078987, "good_angle": 1.3546548994691416, "survival_time": 3.8666666666666623, "traveled_tiles": 3, "valid_direction": 0.6666666666666643}, "ep003": {"nsteps": 339, "reward": -2.86965735018072, "good_angle": 1.3466075416605623, "survival_time": 11.29999999999997, "traveled_tiles": 7, "valid_direction": 0.7999999999999983}, "ep004": {"nsteps": 87, "reward": -11.927641337501932, "good_angle": 0.7192143058080895, "survival_time": 2.8999999999999995, "traveled_tiles": 2, "valid_direction": 0.466666666666665}}
good_angle_max1.396838191834734
good_angle_mean1.0853893567919712
good_angle_median1.3466075416605623
good_angle_min0.6096318451873292
reward_max-2.86965735018072
reward_mean-10.212370869897413
reward_median-8.61695077078987
reward_min-22.44177474923756
survival_time_max11.29999999999997
survival_time_mean5.186666666666658
survival_time_min1.5333333333333348
traveled_tiles_max7
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max0.7999999999999983
valid_direction_mean0.5999999999999985
valid_direction_median0.6666666666666643
valid_direction_min0.33333333333333437
No reset possible
81971012David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
81911010Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 45, in solve
    env = DummyVecEnv([make_env(params)])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'NoneType' object is not callable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 45, in solve
    env = DummyVecEnv([make_env(params)])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'NoneType' object is not callable


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81811008Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:13
Error while running [...]

Creating job8181-2316_solution_1  ... error
stderr | ERROR: for job8181-2316_solution_1  Cannot start service solution: network job8181-2316_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8181-2316_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8181-2316_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81691004Laurent MandrileTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.13312858444658682
deviation-center-line_median0.08744010848352336
in-drivable-lane_median8.366666666666639


other stats
deviation-center-line_max0.2951251593343002
deviation-center-line_mean0.12729673166499883
deviation-center-line_min0.047860468716545944
deviation-heading_max1.2058790583016687
deviation-heading_mean0.7178061254891885
deviation-heading_median0.7905924332634966
deviation-heading_min0.1745193388357215
driven_any_max4.454184189442348
driven_any_mean2.5257450968093726
driven_any_median2.3537329967677016
driven_any_min1.0662869877338133
driven_lanedir_max0.4531051551321528
driven_lanedir_mean0.193667880939661
driven_lanedir_min0.07969926819667117
in-drivable-lane_max15.999999999999988
in-drivable-lane_mean9.086666666666648
in-drivable-lane_min3.766666666666661
per-episodes
details{"ep000": {"driven_any": 1.995026722965619, "driven_lanedir": 0.07969926819667117, "in-drivable-lane": 7.866666666666648, "deviation-heading": 0.1745193388357215, "deviation-center-line": 0.047860468716545944}, "ep001": {"driven_any": 2.3537329967677016, "driven_lanedir": 0.13312858444658682, "in-drivable-lane": 9.433333333333303, "deviation-heading": 1.2058790583016687, "deviation-center-line": 0.1298299749331926}, "ep002": {"driven_any": 4.454184189442348, "driven_lanedir": 0.18029873261228624, "in-drivable-lane": 15.999999999999988, "deviation-heading": 0.47847911565363, "deviation-center-line": 0.07622794685743216}, "ep003": {"driven_any": 1.0662869877338133, "driven_lanedir": 0.12210766431060804, "in-drivable-lane": 3.766666666666661, "deviation-heading": 0.7905924332634966, "deviation-center-line": 0.08744010848352336}, "ep004": {"driven_any": 2.7594945871373833, "driven_lanedir": 0.4531051551321528, "in-drivable-lane": 8.366666666666639, "deviation-heading": 0.9395606813914256, "deviation-center-line": 0.2951251593343002}}
No reset possible
81611005Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:31
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81531002Laurent MandrileTensorflow templateaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:26
Error while running [...]

Creating job8153-6043_videos_1 ... error
stderr | ERROR: for job8153-6043_videos_1  Cannot start service videos: network job8153-6043_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8153-6043_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81461002Laurent MandrileTensorflow templateaido1_LF1_r3-v3step2-scoringabortedyesrudolf-80:00:11
Error while running [...]

Creating job8146-3831_scorer_1 ... error
stderr | ERROR: for job8146-3831_scorer_1  Cannot start service scorer: network job8146-3831_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8146-3831_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81421001Ruixiang Zhang 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:35
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
81331000Ruixiang Zhang 🇨🇦stay simpleaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8130998Laurent MandrileTensorflow templateaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 86, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 29, in solve
    from model import TfInference
  File "/workspace/model.py", line 5, in <module>
    from _layers import one_residual
ImportError: No module named _layers


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8123997Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.033333333333318


other stats
episodes
details{"ep000": {"nsteps": 239, "reward": -4.242474540087071, "good_angle": 0.7376290935237234, "survival_time": 7.966666666666648, "traveled_tiles": 9, "valid_direction": 2.033333333333327}, "ep001": {"nsteps": 182, "reward": -6.025205468514916, "good_angle": 14.05828564655136, "survival_time": 6.066666666666655, "traveled_tiles": 6, "valid_direction": 3.133333333333328}, "ep002": {"nsteps": 211, "reward": -5.041387968665757, "good_angle": 0.40104802004664575, "survival_time": 7.033333333333318, "traveled_tiles": 7, "valid_direction": 1.0666666666666629}, "ep003": {"nsteps": 247, "reward": -4.259314230150215, "good_angle": 1.126885887792093, "survival_time": 8.233333333333315, "traveled_tiles": 9, "valid_direction": 1.799999999999995}, "ep004": {"nsteps": 86, "reward": -12.251422303685445, "good_angle": 6.0966390643710415, "survival_time": 2.8666666666666663, "traveled_tiles": 4, "valid_direction": 1.2333333333333312}}
good_angle_max14.05828564655136
good_angle_mean4.484097542456974
good_angle_median1.126885887792093
good_angle_min0.40104802004664575
reward_max-4.242474540087071
reward_mean-6.363960902220681
reward_median-5.041387968665757
reward_min-12.251422303685445
survival_time_max8.233333333333315
survival_time_mean6.43333333333332
survival_time_min2.8666666666666663
traveled_tiles_max9
traveled_tiles_mean7
traveled_tiles_median7
traveled_tiles_min4
valid_direction_max3.133333333333328
valid_direction_mean1.8533333333333288
valid_direction_median1.799999999999995
valid_direction_min1.0666666666666629
No reset possible
8111993Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:04:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.018178118009569
deviation-center-line_median1.965294419475176
in-drivable-lane_median3.3333333333333215


other stats
deviation-center-line_max2.5142959541530927
deviation-center-line_mean1.921574347693932
deviation-center-line_min1.179912219027208
deviation-heading_max2.113493649906563
deviation-heading_mean1.4029373450137657
deviation-heading_median1.5650509357643805
deviation-heading_min0.7646317340288142
driven_any_max6.347814373442964
driven_any_mean6.300181880076241
driven_any_median6.28249514506833
driven_any_min6.252555601809628
driven_lanedir_max5.624356289833099
driven_lanedir_mean4.701019617389227
driven_lanedir_min3.718552525972793
in-drivable-lane_max6.866666666666645
in-drivable-lane_mean4.133333333333321
in-drivable-lane_min1.6333333333333275
per-episodes
details{"ep000": {"driven_any": 6.278256029765172, "driven_lanedir": 3.7387916547240905, "in-drivable-lane": 6.866666666666645, "deviation-heading": 0.7646317340288142, "deviation-center-line": 1.965294419475176}, "ep001": {"driven_any": 6.252555601809628, "driven_lanedir": 3.718552525972793, "in-drivable-lane": 6.833333333333319, "deviation-heading": 0.9646217044708942, "deviation-center-line": 1.902382838906595}, "ep002": {"driven_any": 6.3397882502951095, "driven_lanedir": 5.018178118009569, "in-drivable-lane": 3.3333333333333215, "deviation-heading": 1.5650509357643805, "deviation-center-line": 2.045986306907588}, "ep003": {"driven_any": 6.28249514506833, "driven_lanedir": 5.405219498406585, "in-drivable-lane": 1.999999999999993, "deviation-heading": 2.113493649906563, "deviation-center-line": 1.179912219027208}, "ep004": {"driven_any": 6.347814373442964, "driven_lanedir": 5.624356289833099, "in-drivable-lane": 1.6333333333333275, "deviation-heading": 1.6068887008981765, "deviation-center-line": 2.5142959541530927}}
No reset possible
8103993Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8093989Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median5.134341320879944
deviation-center-line_median1.9231104123180216
in-drivable-lane_median2.6666666666666785


other stats
deviation-center-line_max2.4672838847978604
deviation-center-line_mean1.8802017935178892
deviation-center-line_min1.1510608107169331
deviation-heading_max2.122160942008872
deviation-heading_mean1.8617177696464784
deviation-heading_median1.9368236681807245
deviation-heading_min1.4598171163237277
driven_any_max6.296294432793152
driven_any_mean6.268011031189323
driven_any_median6.283075427615398
driven_any_min6.20626247640538
driven_lanedir_max5.590448107063559
driven_lanedir_mean5.034148207982884
driven_lanedir_min4.486003737617959
in-drivable-lane_max4.633333333333319
in-drivable-lane_mean3.026666666666661
in-drivable-lane_min1.4666666666666617
per-episodes
details{"ep000": {"driven_any": 6.295741885769301, "driven_lanedir": 4.486003737617959, "in-drivable-lane": 4.633333333333319, "deviation-heading": 1.836166422163057, "deviation-center-line": 1.546790168179425}, "ep001": {"driven_any": 6.20626247640538, "driven_lanedir": 5.36376955621475, "in-drivable-lane": 2.033333333333327, "deviation-heading": 2.122160942008872, "deviation-center-line": 2.312763691577205}, "ep002": {"driven_any": 6.283075427615398, "driven_lanedir": 4.59617831813821, "in-drivable-lane": 4.333333333333319, "deviation-heading": 1.4598171163237277, "deviation-center-line": 1.9231104123180216}, "ep003": {"driven_any": 6.296294432793152, "driven_lanedir": 5.134341320879944, "in-drivable-lane": 2.6666666666666785, "deviation-heading": 1.953620699556012, "deviation-center-line": 1.1510608107169331}, "ep004": {"driven_any": 6.258680933363384, "driven_lanedir": 5.590448107063559, "in-drivable-lane": 1.4666666666666617, "deviation-heading": 1.9368236681807245, "deviation-center-line": 2.4672838847978604}}
No reset possible
8091992Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:11
Error while running [...]

Creating job8091-9516_visualization_1 ... error
stderr | ERROR: for job8091-9516_visualization_1  Cannot start service visualization: network job8091-9516_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8091-9516_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8089992Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.666666666666629


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.22673331679950937, "good_angle": 1.90894326936474, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 3.299999999999991}, "ep001": {"nsteps": 401, "reward": -2.871319786628053, "good_angle": 17.643732214836394, "survival_time": 13.36666666666663, "traveled_tiles": 12, "valid_direction": 4.6666666666666545}, "ep002": {"nsteps": 500, "reward": -0.2260611813031137, "good_angle": 0.8192803501258634, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 1.7666666666666604}, "ep003": {"nsteps": 410, "reward": -2.595359713087006, "good_angle": 1.0750927141060265, "survival_time": 13.666666666666629, "traveled_tiles": 15, "valid_direction": 2.333333333333325}, "ep004": {"nsteps": 74, "reward": -14.101662720869786, "good_angle": 5.464725685996857, "survival_time": 2.4666666666666677, "traveled_tiles": 4, "valid_direction": 1.0333333333333332}}
good_angle_max17.643732214836394
good_angle_mean5.382354846885976
good_angle_median1.90894326936474
good_angle_min0.8192803501258634
reward_max-0.2260611813031137
reward_mean-4.004227343737494
reward_median-2.595359713087006
reward_min-14.101662720869786
survival_time_max16.666666666666654
survival_time_mean12.566666666666643
survival_time_min2.4666666666666677
traveled_tiles_max15
traveled_tiles_mean11.8
traveled_tiles_median13
traveled_tiles_min4
valid_direction_max4.6666666666666545
valid_direction_mean2.619999999999993
valid_direction_median2.333333333333325
valid_direction_min1.0333333333333332
No reset possible
8082991Manfred DiazTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.517105693606512
deviation-center-line_median0.6355912112352694
in-drivable-lane_median2.1000000000000245


other stats
deviation-center-line_max0.7476435665431079
deviation-center-line_mean0.5987995221101953
deviation-center-line_min0.41586918016826147
deviation-heading_max2.8505180605180915
deviation-heading_mean2.2185220069208618
deviation-heading_median2.436481640534582
deviation-heading_min1.322783267972331
driven_any_max5.49839981330844
driven_any_mean5.4070139122528085
driven_any_median5.460563515261315
driven_any_min5.144973942703612
driven_lanedir_max5.058313252521398
driven_lanedir_mean4.48948115127667
driven_lanedir_min3.8241028438701257
in-drivable-lane_max4.499999999999993
in-drivable-lane_mean2.180000000000006
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.49839981330844, "driven_lanedir": 4.408039270294842, "in-drivable-lane": 2.5000000000000178, "deviation-heading": 2.681352282317517, "deviation-center-line": 0.7285107648400324}, "ep001": {"driven_any": 5.484881015383155, "driven_lanedir": 3.8241028438701257, "in-drivable-lane": 4.499999999999993, "deviation-heading": 1.322783267972331, "deviation-center-line": 0.4663828877643049}, "ep002": {"driven_any": 5.460563515261315, "driven_lanedir": 4.639844696090474, "in-drivable-lane": 1.7999999999999945, "deviation-heading": 2.8505180605180915, "deviation-center-line": 0.7476435665431079}, "ep003": {"driven_any": 5.446251274607517, "driven_lanedir": 4.517105693606512, "in-drivable-lane": 2.1000000000000245, "deviation-heading": 2.436481640534582, "deviation-center-line": 0.6355912112352694}, "ep004": {"driven_any": 5.144973942703612, "driven_lanedir": 5.058313252521398, "in-drivable-lane": 0, "deviation-heading": 1.8014747832617872, "deviation-center-line": 0.41586918016826147}}
No reset possible
8079991Manfred DiazTensorflow templateaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:11
Error while running [...]

Creating job8079-3990_videos_1 ... error
stderr | ERROR: for job8079-3990_videos_1  Cannot start service videos: network job8079-3990_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8079-3990_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8067991Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8057988Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8052986Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.23856238748156464, "good_angle": 1.4068220147804162, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.6999999999999957}, "ep001": {"nsteps": 500, "reward": -0.5167542472870554, "good_angle": 28.70045024032352, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 6.966666666666654}, "ep002": {"nsteps": 500, "reward": -0.33377704420301596, "good_angle": 1.6530959563639591, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.366666666666669}, "ep003": {"nsteps": 500, "reward": -0.7408947333386168, "good_angle": 1.4974812018483985, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.4000000000000155}, "ep004": {"nsteps": 500, "reward": -0.29585880628740413, "good_angle": 16.871200755350564, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 5.133333333333347}}
good_angle_max28.70045024032352
good_angle_mean10.025810033733372
good_angle_median1.6530959563639591
good_angle_min1.4068220147804162
reward_max-0.23856238748156464
reward_mean-0.42516944371953136
reward_median-0.33377704420301596
reward_min-0.7408947333386168
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max10
traveled_tiles_mean9.4
traveled_tiles_median10
traveled_tiles_min8
valid_direction_max6.966666666666654
valid_direction_mean4.513333333333336
valid_direction_median4.366666666666669
valid_direction_min2.6999999999999957
No reset possible
8040985Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:05:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8036984Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5933083943328821, "good_angle": 1.3142779938637892, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.766666666666655}, "ep001": {"nsteps": 500, "reward": -0.6878863608606626, "good_angle": 9.96153965201236, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 3.8333333333333233}, "ep002": {"nsteps": 500, "reward": -0.6394640733152628, "good_angle": 1.455422230306047, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.9666666666666552}, "ep003": {"nsteps": 500, "reward": -0.7588395650137681, "good_angle": 0.7369878185864341, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 2.133333333333352}, "ep004": {"nsteps": 500, "reward": -0.722406002654694, "good_angle": 9.152423372860108, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 5.36666666666669}}
good_angle_max9.96153965201236
good_angle_mean4.524130213525747
good_angle_median1.455422230306047
good_angle_min0.7369878185864341
reward_max-0.5933083943328821
reward_mean-0.680380879235454
reward_median-0.6878863608606626
reward_min-0.7588395650137681
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max8
traveled_tiles_mean7
traveled_tiles_median7
traveled_tiles_min6
valid_direction_max5.36666666666669
valid_direction_mean3.8133333333333352
valid_direction_median3.8333333333333233
valid_direction_min2.133333333333352
No reset possible
8034983Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.228741778142639
deviation-center-line_median0.30506772722187425
in-drivable-lane_median0


other stats
deviation-center-line_max1.087025347336387
deviation-center-line_mean0.4541629398859808
deviation-center-line_min0.09897289157693905
deviation-heading_max3.6298243579817777
deviation-heading_mean1.2718673471697268
deviation-heading_median0.6016292291735804
deviation-heading_min0.06092138286581164
driven_any_max5.932991602681686
driven_any_mean2.461870783097347
driven_any_median1.4099412650442484
driven_any_min0.34666666666667245
driven_lanedir_max5.314782765095934
driven_lanedir_mean2.28243176079863
driven_lanedir_min0.3458718774424743
in-drivable-lane_max1.0666666666666629
in-drivable-lane_mean0.29333333333333256
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.4099412650442484, "driven_lanedir": 1.228741778142639, "in-drivable-lane": 0.4, "deviation-heading": 0.6016292291735804, "deviation-center-line": 0.30506772722187425}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 3.936440626079375, "driven_lanedir": 3.8431515548311914, "in-drivable-lane": 0, "deviation-heading": 1.8969878991706015, "deviation-center-line": 0.6352420298677336}, "ep003": {"driven_any": 0.6833137550147517, "driven_lanedir": 0.6796108284809113, "in-drivable-lane": 0, "deviation-heading": 0.16997386665686398, "deviation-center-line": 0.14450670342696997}, "ep004": {"driven_any": 5.932991602681686, "driven_lanedir": 5.314782765095934, "in-drivable-lane": 1.0666666666666629, "deviation-heading": 3.6298243579817777, "deviation-center-line": 1.087025347336387}}
No reset possible
8030983Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8666666666666623


other stats
episodes
details{"ep000": {"nsteps": 116, "reward": -8.89257429624182, "good_angle": 0.1330432528398118, "survival_time": 3.8666666666666623, "traveled_tiles": 3, "valid_direction": 0.2333333333333333}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 329, "reward": -3.31293563591741, "good_angle": 0.3681829161344062, "survival_time": 10.966666666666638, "traveled_tiles": 8, "valid_direction": 0.466666666666665}, "ep003": {"nsteps": 56, "reward": -18.23833635702197, "good_angle": 0.02139515126107087, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.2012757088522776, "good_angle": 8.827879681561576, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.533333333333321}}
good_angle_max8.827879681561576
good_angle_mean1.87092495922388
good_angle_median0.1330432528398118
good_angle_min0.004123794322536422
reward_max-0.2012757088522776
reward_mean-13.383108281666065
reward_median-8.89257429624182
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean6.8599999999999905
survival_time_min0.9333333333333332
traveled_tiles_max8
traveled_tiles_mean4.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.533333333333321
valid_direction_mean0.8466666666666638
valid_direction_median0.2333333333333333
valid_direction_min0
No reset possible
8025983Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8019982Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringabortedyesrudolf-80:00:12
Error while running [...]

Creating job8019-6781_scorer_1 ... error
stderr | ERROR: for job8019-6781_scorer_1  Cannot start service scorer: network job8019-6781_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8019-6781_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8014979Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8012979Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.366666666666661


other stats
episodes
details{"ep000": {"nsteps": 57, "reward": -17.785601778331685, "good_angle": 0.19950555588807145, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0.6999999999999998}, "ep001": {"nsteps": 110, "reward": -9.449643527597866, "good_angle": 9.04993396115443, "survival_time": 3.6666666666666634, "traveled_tiles": 3, "valid_direction": 1.4}, "ep002": {"nsteps": 144, "reward": -7.615141619857038, "good_angle": 1.5027235636445966, "survival_time": 4.799999999999993, "traveled_tiles": 3, "valid_direction": 2.0999999999999988}, "ep003": {"nsteps": 131, "reward": -7.995223770046052, "good_angle": 0.01099952450036967, "survival_time": 4.366666666666661, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 149, "reward": -7.0422420749853325, "good_angle": 10.472384526098582, "survival_time": 4.966666666666659, "traveled_tiles": 4, "valid_direction": 1.4666666666666617}}
good_angle_max10.472384526098582
good_angle_mean4.24710942625721
good_angle_median1.5027235636445966
good_angle_min0.01099952450036967
reward_max-7.0422420749853325
reward_mean-9.977570554163597
reward_median-7.995223770046052
reward_min-17.785601778331685
survival_time_max4.966666666666659
survival_time_mean3.939999999999995
survival_time_min1.9000000000000024
traveled_tiles_max4
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max2.0999999999999988
valid_direction_mean1.133333333333332
valid_direction_median1.4
valid_direction_min0
No reset possible
8011979Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8002977Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7998977Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8000000000000025


other stats
episodes
details{"ep000": {"nsteps": 54, "reward": -18.739795033500908, "good_angle": 0.17111099844596908, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 0.6666666666666665}, "ep001": {"nsteps": 23, "reward": -44.04389274120331, "good_angle": 0.007825117906309196, "survival_time": 0.7666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 31, "reward": -32.69075833405218, "good_angle": 0.013064824326917994, "survival_time": 1.0333333333333332, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 169, "reward": -6.273822177544556, "good_angle": 0.4380316878030926, "survival_time": 5.633333333333323, "traveled_tiles": 4, "valid_direction": 1.2999999999999965}, "ep004": {"nsteps": 70, "reward": -14.708262841722794, "good_angle": 1.2340384580676431, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.7000000000000015}}
good_angle_max1.2340384580676431
good_angle_mean0.3728142173099864
good_angle_median0.17111099844596908
good_angle_min0.007825117906309196
reward_max-6.273822177544556
reward_mean-23.29130622560475
reward_median-18.739795033500908
reward_min-44.04389274120331
survival_time_max5.633333333333323
survival_time_mean2.3133333333333317
survival_time_min0.7666666666666666
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.7000000000000015
valid_direction_mean0.7333333333333328
valid_direction_median0.6666666666666665
valid_direction_min0
No reset possible
7992976Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:11
Error while running [...]

Creating job7992-3457_visualization_1 ... error
stderr | ERROR: for job7992-3457_visualization_1  Cannot start service visualization: network job7992-3457_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7992-3457_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7987976Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.533333333333327


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -12.52588034088996, "good_angle": 0.17952429330929992, "survival_time": 2.7333333333333334, "traveled_tiles": 3, "valid_direction": 0.6666666666666665}, "ep001": {"nsteps": 172, "reward": -6.511317504494083, "good_angle": 5.578101579727321, "survival_time": 5.733333333333323, "traveled_tiles": 3, "valid_direction": 1.7666666666666644}, "ep002": {"nsteps": 107, "reward": -9.778149597277151, "good_angle": 0.03286934148681326, "survival_time": 3.566666666666664, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 136, "reward": -7.620555359009065, "good_angle": 0.4826043130813186, "survival_time": 4.533333333333327, "traveled_tiles": 3, "valid_direction": 1.1333333333333313}, "ep004": {"nsteps": 162, "reward": -6.687916881631899, "good_angle": 5.260282393500154, "survival_time": 5.399999999999991, "traveled_tiles": 3, "valid_direction": 2.5333333333333243}}
good_angle_max5.578101579727321
good_angle_mean2.306676384220981
good_angle_median0.4826043130813186
good_angle_min0.03286934148681326
reward_max-6.511317504494083
reward_mean-8.624763936660433
reward_median-7.620555359009065
reward_min-12.52588034088996
survival_time_max5.733333333333323
survival_time_mean4.393333333333328
survival_time_min2.7333333333333334
traveled_tiles_max3
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max2.5333333333333243
valid_direction_mean1.2199999999999973
valid_direction_median1.1333333333333313
valid_direction_min0
No reset possible
7978975Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.566666666666653


other stats
episodes
details{"ep000": {"nsteps": 179, "reward": -6.143844588318912, "good_angle": 0.20726566058568413, "survival_time": 5.966666666666655, "traveled_tiles": 4, "valid_direction": 0.6666666666666665}, "ep001": {"nsteps": 311, "reward": -3.7829405356683674, "good_angle": 7.451692345729561, "survival_time": 10.36666666666664, "traveled_tiles": 5, "valid_direction": 3.5999999999999917}, "ep002": {"nsteps": 58, "reward": -18.3334619030517, "good_angle": 1.1586740658805823, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 1.8666666666666691}, "ep003": {"nsteps": 197, "reward": -5.360624333171098, "good_angle": 0.3756824015196448, "survival_time": 6.566666666666653, "traveled_tiles": 5, "valid_direction": 1.099999999999996}, "ep004": {"nsteps": 203, "reward": -5.274989076942811, "good_angle": 10.522511174400554, "survival_time": 6.766666666666652, "traveled_tiles": 5, "valid_direction": 2.0666666666666593}}
good_angle_max10.522511174400554
good_angle_mean3.9431651296232055
good_angle_median1.1586740658805823
good_angle_min0.20726566058568413
reward_max-3.7829405356683674
reward_mean-7.779172087430576
reward_median-5.360624333171098
reward_min-18.3334619030517
survival_time_max10.36666666666664
survival_time_mean6.319999999999988
survival_time_min1.933333333333336
traveled_tiles_max5
traveled_tiles_mean4.2
traveled_tiles_median5
traveled_tiles_min2
valid_direction_max3.5999999999999917
valid_direction_mean1.8599999999999963
valid_direction_median1.8666666666666691
valid_direction_min0.6666666666666665
No reset possible
7973974Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6265215747606048
deviation-center-line_median0.607494048957489
in-drivable-lane_median0


other stats
deviation-center-line_max0.6495016046287412
deviation-center-line_mean0.5309295980722656
deviation-center-line_min0.33273595264346006
deviation-heading_max1.546889597996067
deviation-heading_mean0.6466674829044743
deviation-heading_median0.4233646963244864
deviation-heading_min0.2887009286973376
driven_any_max1.1250794556315609
driven_any_mean0.6536182871501773
driven_any_median0.6286179118526486
driven_any_min0.31430732071544254
driven_lanedir_max0.9001668163287937
driven_lanedir_mean0.6067702335617516
driven_lanedir_min0.31267344503052197
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1250794556315609, "driven_lanedir": 0.9001668163287937, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.546889597996067, "deviation-center-line": 0.6495016046287412}, "ep001": {"driven_any": 0.31430732071544254, "driven_lanedir": 0.31267344503052197, "in-drivable-lane": 0, "deviation-heading": 0.2887009286973376, "deviation-center-line": 0.33273595264346006}, "ep002": {"driven_any": 0.6286179118526486, "driven_lanedir": 0.6265215747606048, "in-drivable-lane": 0, "deviation-heading": 0.4233646963244864, "deviation-center-line": 0.607494048957489}, "ep003": {"driven_any": 0.7250534689028811, "driven_lanedir": 0.7214747889992279, "in-drivable-lane": 0, "deviation-heading": 0.5927178567152452, "deviation-center-line": 0.6202123184120287}, "ep004": {"driven_any": 0.4750332786483535, "driven_lanedir": 0.4730145426896099, "in-drivable-lane": 0, "deviation-heading": 0.38166433478923545, "deviation-center-line": 0.4447040657196087}}
No reset possible
7968974Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.933333333333322


other stats
episodes
details{"ep000": {"nsteps": 317, "reward": -3.4067001120335707, "good_angle": 0.4132891545223995, "survival_time": 10.56666666666664, "traveled_tiles": 3, "valid_direction": 0.23333333333333384}, "ep001": {"nsteps": 90, "reward": -11.695789532528984, "good_angle": 0.03133423412779454, "survival_time": 2.999999999999999, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 178, "reward": -6.149401087941748, "good_angle": 0.03952672239717586, "survival_time": 5.933333333333322, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 205, "reward": -5.339123558852731, "good_angle": 0.06708729955869008, "survival_time": 6.833333333333319, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 135, "reward": -7.9176162147963485, "good_angle": 0.03796219700942285, "survival_time": 4.499999999999994, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.4132891545223995
good_angle_mean0.11783992152309657
good_angle_median0.03952672239717586
good_angle_min0.03133423412779454
reward_max-3.4067001120335707
reward_mean-6.901726101230676
reward_median-6.149401087941748
reward_min-11.695789532528984
survival_time_max10.56666666666664
survival_time_mean6.1666666666666545
survival_time_min2.999999999999999
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.23333333333333384
valid_direction_mean0.046666666666666766
valid_direction_median0
valid_direction_min0
No reset possible
7963973Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6505766153109622
deviation-center-line_median0.16014963851655162
in-drivable-lane_median0


other stats
deviation-center-line_max0.7603053620165483
deviation-center-line_mean0.2564637341640809
deviation-center-line_min0.09210699726460604
deviation-heading_max0.9642614812629324
deviation-heading_mean0.3996068763062016
deviation-heading_median0.1951626949882956
deviation-heading_min0.08068462255521815
driven_any_max2.9665349579780176
driven_any_mean1.03460971155806
driven_any_median0.6566328495709304
driven_any_min0.3366328495709288
driven_lanedir_max2.923355747095626
driven_lanedir_mean0.9885477295561832
driven_lanedir_min0.3321162244136633
in-drivable-lane_max0.3666666666666667
in-drivable-lane_mean0.07333333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8532550200589977, "driven_lanedir": 0.6787448401236269, "in-drivable-lane": 0.3666666666666667, "deviation-heading": 0.6046620566532065, "deviation-center-line": 0.1704259240979422}, "ep001": {"driven_any": 0.3599928806114263, "driven_lanedir": 0.3579452208370377, "in-drivable-lane": 0, "deviation-heading": 0.08068462255521815, "deviation-center-line": 0.09933074892475642}, "ep002": {"driven_any": 0.3366328495709288, "driven_lanedir": 0.3321162244136633, "in-drivable-lane": 0, "deviation-heading": 0.15326352607135502, "deviation-center-line": 0.09210699726460604}, "ep003": {"driven_any": 0.6566328495709304, "driven_lanedir": 0.6505766153109622, "in-drivable-lane": 0, "deviation-heading": 0.1951626949882956, "deviation-center-line": 0.16014963851655162}, "ep004": {"driven_any": 2.9665349579780176, "driven_lanedir": 2.923355747095626, "in-drivable-lane": 0, "deviation-heading": 0.9642614812629324, "deviation-center-line": 0.7603053620165483}}
No reset possible
7950973Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7947972Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:12
Error while running [...]

Creating job7947-330_videos_1 ... error
stderr | ERROR: for job7947-330_videos_1  Cannot start service videos: network job7947-330_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7947-330_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7944971Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4215571535808358
deviation-center-line_median0.14891535883491963
in-drivable-lane_median0


other stats
deviation-center-line_max0.33513384218680903
deviation-center-line_mean0.167510353493167
deviation-center-line_min0.08481578970490194
deviation-heading_max1.5676183756560225
deviation-heading_mean0.524382947707912
deviation-heading_median0.1677208224617552
deviation-heading_min0.12551358531169376
driven_any_max1.8148588729327408
driven_any_mean0.7616139683300348
driven_any_median0.4283068580446981
driven_any_min0.28830967617758474
driven_lanedir_max1.5279258801008595
driven_lanedir_mean0.6668931895777604
driven_lanedir_min0.2846481611082692
in-drivable-lane_max0.4333333333333318
in-drivable-lane_mean0.1599999999999997
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8666097115580556, "driven_lanedir": 0.6961797944046832, "in-drivable-lane": 0.3666666666666667, "deviation-heading": 0.6002350491785079, "deviation-center-line": 0.1733329727782846}, "ep001": {"driven_any": 0.4283068580446981, "driven_lanedir": 0.4215571535808358, "in-drivable-lane": 0, "deviation-heading": 0.16082690593158072, "deviation-center-line": 0.14891535883491963}, "ep002": {"driven_any": 0.28830967617758474, "driven_lanedir": 0.2846481611082692, "in-drivable-lane": 0, "deviation-heading": 0.12551358531169376, "deviation-center-line": 0.08481578970490194}, "ep003": {"driven_any": 0.409984722937095, "driven_lanedir": 0.4041549586941544, "in-drivable-lane": 0, "deviation-heading": 0.1677208224617552, "deviation-center-line": 0.09535380396091991}, "ep004": {"driven_any": 1.8148588729327408, "driven_lanedir": 1.5279258801008595, "in-drivable-lane": 0.4333333333333318, "deviation-heading": 1.5676183756560225, "deviation-center-line": 0.33513384218680903}}
No reset possible
7942971Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.2666666666666673


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -13.484948247149587, "good_angle": 0.13954338063071806, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 0.2}, "ep001": {"nsteps": 38, "reward": -26.94825208892948, "good_angle": 0.06463267336017275, "survival_time": 1.2666666666666673, "traveled_tiles": 1, "valid_direction": 0.16666666666666718}, "ep002": {"nsteps": 27, "reward": -37.52524646012871, "good_angle": 0.02194590727608487, "survival_time": 0.8999999999999999, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 35, "reward": -28.98305263114827, "good_angle": 0.03146406749930893, "survival_time": 1.166666666666667, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 159, "reward": -6.669146281716841, "good_angle": 8.113867881145456, "survival_time": 5.299999999999991, "traveled_tiles": 4, "valid_direction": 2.3999999999999924}}
good_angle_max8.113867881145456
good_angle_mean1.6742907819823485
good_angle_median0.06463267336017275
good_angle_min0.02194590727608487
reward_max-6.669146281716841
reward_mean-22.722129141814577
reward_median-26.94825208892948
reward_min-37.52524646012871
survival_time_max5.299999999999991
survival_time_mean2.2266666666666652
survival_time_min0.8999999999999999
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.3999999999999924
valid_direction_mean0.5533333333333319
valid_direction_median0.16666666666666718
valid_direction_min0
No reset possible
7938969Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.48002489967466366
deviation-center-line_median0.44953434650307456
in-drivable-lane_median0


other stats
deviation-center-line_max0.6756217955980963
deviation-center-line_mean0.4833167647192167
deviation-center-line_min0.323985028575557
deviation-heading_max1.5605662884765823
deviation-heading_mean0.6458602657996781
deviation-heading_median0.4177354672861499
deviation-heading_min0.28266642664419916
driven_any_max1.1357953095799675
driven_any_mean0.6064721685498519
driven_any_median0.48217925094209535
driven_any_min0.3071639224382481
driven_lanedir_max0.9110541729309414
driven_lanedir_mean0.5595193937183736
driven_lanedir_min0.3055487827497947
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1357953095799675, "driven_lanedir": 0.9110541729309414, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.5605662884765823, "deviation-center-line": 0.6756217955980963}, "ep001": {"driven_any": 0.3071639224382481, "driven_lanedir": 0.3055487827497947, "in-drivable-lane": 0, "deviation-heading": 0.28266642664419916, "deviation-center-line": 0.323985028575557}, "ep002": {"driven_any": 0.48217925094209535, "driven_lanedir": 0.48002489967466366, "in-drivable-lane": 0, "deviation-heading": 0.3954137312242298, "deviation-center-line": 0.4473292486088852}, "ep003": {"driven_any": 0.6250467479521936, "driven_lanedir": 0.6212443458493215, "in-drivable-lane": 0, "deviation-heading": 0.5729194153672296, "deviation-center-line": 0.5201134043104702}, "ep004": {"driven_any": 0.4821756118367546, "driven_lanedir": 0.4797247673871461, "in-drivable-lane": 0, "deviation-heading": 0.4177354672861499, "deviation-center-line": 0.44953434650307456}}
No reset possible
7930970Martin Weiss 🇨🇦PyTorch templateaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 105, in run
    solve(params, cis)
  File "solution.py", line 51, in solve
    import model
  File "/workspace/model.py", line 107
SyntaxError: Non-ASCII character '\xce' in file /workspace/model.py on line 107, but no encoding declared; see http://python.org/dev/peps/pep-0263/ for details


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7923967Martin Weiss 🇨🇦PyTorch templateaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 105, in run
    solve(params, cis)
  File "solution.py", line 51, in solve
    import model
  File "/workspace/model.py", line 107
SyntaxError: Non-ASCII character '\xce' in file /workspace/model.py on line 107, but no encoding declared; see http://python.org/dev/peps/pep-0263/ for details


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7920962David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.5213628232546526
deviation-center-line_median0.2412728604365449
in-drivable-lane_median2.3999999999999932


other stats
deviation-center-line_max0.3352269764965524
deviation-center-line_mean0.22302184911826725
deviation-center-line_min0.07599347211203596
deviation-heading_max1.0470614434365
deviation-heading_mean0.6848003302372442
deviation-heading_median0.6037027541447946
deviation-heading_min0.4777593410735995
driven_any_max4.156902532844726
driven_any_mean3.0318292461613416
driven_any_median2.668966578713818
driven_any_min1.764745901570722
driven_lanedir_max1.7162312518398872
driven_lanedir_mean1.3756719574557237
driven_lanedir_min0.8161665628406019
in-drivable-lane_max5.499999999999981
in-drivable-lane_mean3.3933333333333215
in-drivable-lane_min1.7999999999999938
per-episodes
details{"ep000": {"driven_any": 2.668966578713818, "driven_lanedir": 1.5541795721625058, "in-drivable-lane": 2.3999999999999932, "deviation-heading": 0.5851040026037428, "deviation-center-line": 0.3352269764965524}, "ep001": {"driven_any": 2.59548994179726, "driven_lanedir": 1.5213628232546526, "in-drivable-lane": 1.999999999999993, "deviation-heading": 1.0470614434365, "deviation-center-line": 0.2412728604365449}, "ep002": {"driven_any": 1.764745901570722, "driven_lanedir": 0.8161665628406019, "in-drivable-lane": 1.7999999999999938, "deviation-heading": 0.4777593410735995, "deviation-center-line": 0.07599347211203596}, "ep003": {"driven_any": 4.156902532844726, "driven_lanedir": 1.7162312518398872, "in-drivable-lane": 5.499999999999981, "deviation-heading": 0.6037027541447946, "deviation-center-line": 0.3193511373066153}, "ep004": {"driven_any": 3.973041275880182, "driven_lanedir": 1.2704195771809723, "in-drivable-lane": 5.266666666666649, "deviation-heading": 0.710374109927584, "deviation-center-line": 0.14326479923958765}}
No reset possible
7915962David AbrahamPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.233333333333321


other stats
episodes
details{"ep000": {"nsteps": 187, "reward": -5.833620665826521, "good_angle": 0.8981375848270108, "survival_time": 6.233333333333321, "traveled_tiles": 5, "valid_direction": 1.6333333333333278}, "ep001": {"nsteps": 179, "reward": -6.429220556692537, "good_angle": 14.179928641774527, "survival_time": 5.966666666666655, "traveled_tiles": 5, "valid_direction": 2.566666666666662}, "ep002": {"nsteps": 116, "reward": -9.44270258876174, "good_angle": 0.7685056990419334, "survival_time": 3.8666666666666623, "traveled_tiles": 4, "valid_direction": 1.2999999999999972}, "ep003": {"nsteps": 290, "reward": -4.334383817579083, "good_angle": 0.8615672221112353, "survival_time": 9.666666666666645, "traveled_tiles": 8, "valid_direction": 1.5999999999999943}, "ep004": {"nsteps": 256, "reward": -4.888118612805101, "good_angle": 3.3804286710774933, "survival_time": 8.533333333333314, "traveled_tiles": 5, "valid_direction": 1.866666666666661}}
good_angle_max14.179928641774527
good_angle_mean4.01771356376644
good_angle_median0.8981375848270108
good_angle_min0.7685056990419334
reward_max-4.334383817579083
reward_mean-6.185609248332996
reward_median-5.833620665826521
reward_min-9.44270258876174
survival_time_max9.666666666666645
survival_time_mean6.853333333333319
survival_time_min3.8666666666666623
traveled_tiles_max8
traveled_tiles_mean5.4
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max2.566666666666662
valid_direction_mean1.7933333333333283
valid_direction_median1.6333333333333278
valid_direction_min1.2999999999999972
No reset possible
7912965Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:12
Error while running [...]

Creating job7912-7864_visualization_1 ... error
stderr | ERROR: for job7912-7864_visualization_1  Cannot start service visualization: network job7912-7864_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7912-7864_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7908965Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.966666666666659


other stats
episodes
details{"ep000": {"nsteps": 322, "reward": -3.3689105807653896, "good_angle": 0.4158051282769746, "survival_time": 10.733333333333306, "traveled_tiles": 3, "valid_direction": 0.23333333333333384}, "ep001": {"nsteps": 98, "reward": -10.78961853348479, "good_angle": 0.037890664302627955, "survival_time": 3.266666666666665, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 140, "reward": -7.640387647279671, "good_angle": 0.03925619430490579, "survival_time": 4.66666666666666, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 178, "reward": -6.060037685160556, "good_angle": 0.06836727761007144, "survival_time": 5.933333333333322, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 149, "reward": -7.213572439531352, "good_angle": 0.03612614493768082, "survival_time": 4.966666666666659, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.4158051282769746
good_angle_mean0.1194890818864521
good_angle_median0.03925619430490579
good_angle_min0.03612614493768082
reward_max-3.3689105807653896
reward_mean-7.014505377244352
reward_median-7.213572439531352
reward_min-10.78961853348479
survival_time_max10.733333333333306
survival_time_mean5.9133333333333225
survival_time_min3.266666666666665
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.23333333333333384
valid_direction_mean0.046666666666666766
valid_direction_median0
valid_direction_min0
No reset possible
7904964David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.4229202302773345
deviation-center-line_median0.3991784270030842
in-drivable-lane_median0.2666666666666657


other stats
deviation-center-line_max0.6970202772991712
deviation-center-line_mean0.4755834021827066
deviation-center-line_min0.274519814312897
deviation-heading_max2.4303420837300536
deviation-heading_mean1.8777674415001453
deviation-heading_median1.7505933494329204
deviation-heading_min1.3180767600632233
driven_any_max4.318943552080329
driven_any_mean2.89891009392853
driven_any_median2.723862296759587
driven_any_min1.195859378478331
driven_lanedir_max4.16927040622497
driven_lanedir_mean2.6413786486126067
driven_lanedir_min0.9148462704183864
in-drivable-lane_max0.4333333333333318
in-drivable-lane_mean0.266666666666666
in-drivable-lane_min0.13333333333333286
per-episodes
details{"ep000": {"driven_any": 2.372831533814433, "driven_lanedir": 2.1589377488012396, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 1.3180767600632233, "deviation-center-line": 0.3991784270030842}, "ep001": {"driven_any": 1.195859378478331, "driven_lanedir": 0.9148462704183864, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.7505933494329204, "deviation-center-line": 0.274519814312897}, "ep002": {"driven_any": 2.723862296759587, "driven_lanedir": 2.4229202302773345, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.2846295931413945, "deviation-center-line": 0.382376891779987}, "ep003": {"driven_any": 4.318943552080329, "driven_lanedir": 4.16927040622497, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.6051954211331343, "deviation-center-line": 0.6248216005183936}, "ep004": {"driven_any": 3.88305370850997, "driven_lanedir": 3.5409185873411033, "in-drivable-lane": 0.4333333333333318, "deviation-heading": 2.4303420837300536, "deviation-center-line": 0.6970202772991712}}
No reset possible
7898963David AbrahamPytorch ILaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7892964David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7888961Benjamin Ramtoula 🇨🇦My ROS solution - param 3aido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.0196946772831752
deviation-center-line_median0.03342743548187272
in-drivable-lane_median0.8333333333333339


other stats
deviation-center-line_max0.07407297343790746
deviation-center-line_mean0.03739803529381719
deviation-center-line_min0
deviation-heading_max1.2591936377912198
deviation-heading_mean0.5076960053369486
deviation-heading_median0.2911588342319564
deviation-heading_min0
driven_any_max1.3944182879618496
driven_any_mean0.3937760178431842
driven_any_median0.17198786646948844
driven_any_min0.04757860401669066
driven_lanedir_max0
driven_lanedir_mean-0.03568657753558444
driven_lanedir_min-0.08888324073276088
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.826666666666664
in-drivable-lane_min0.06666666666666665
per-episodes
details{"ep000": {"driven_any": 1.3944182879618496, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.050315962957557935, "driven_lanedir": -0.0196946772831752, "in-drivable-lane": 0.16666666666666669, "deviation-heading": 0.24835155636272777, "deviation-center-line": 0.03342743548187272}, "ep002": {"driven_any": 0.17198786646948844, "driven_lanedir": -0.05408385209443489, "in-drivable-lane": 0.8333333333333339, "deviation-heading": 0.7397759982988392, "deviation-center-line": 0.05333224628738267}, "ep003": {"driven_any": 0.3045793678103343, "driven_lanedir": -0.08888324073276088, "in-drivable-lane": 1.4333333333333342, "deviation-heading": 1.2591936377912198, "deviation-center-line": 0.07407297343790746}, "ep004": {"driven_any": 0.04757860401669066, "driven_lanedir": -0.01577111756755123, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 0.2911588342319564, "deviation-center-line": 0.02615752126192311}}
No reset possible
7885961Benjamin Ramtoula 🇨🇦My ROS solution - param 3aido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7333333333333354


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.4624892975091934, "good_angle": 61.29866473955287, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.433333333333325}, "ep001": {"nsteps": 16, "reward": -64.0070656966418, "good_angle": 0.5385652891676465, "survival_time": 0.5333333333333333, "traveled_tiles": 1, "valid_direction": 0.5}, "ep002": {"nsteps": 52, "reward": -20.95295720662062, "good_angle": 1.5545408229611977, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 1.4666666666666686}, "ep003": {"nsteps": 86, "reward": -13.359189618725416, "good_angle": 2.514732245125978, "survival_time": 2.8666666666666663, "traveled_tiles": 1, "valid_direction": 2.433333333333332}, "ep004": {"nsteps": 12, "reward": -84.3719012538592, "good_angle": 0.45159185224177034, "survival_time": 0.4, "traveled_tiles": 1, "valid_direction": 0.36666666666666664}}
good_angle_max61.29866473955287
good_angle_mean13.271618989809896
good_angle_median1.5545408229611977
good_angle_min0.45159185224177034
reward_max-1.4624892975091934
reward_mean-36.83072061467125
reward_median-20.95295720662062
reward_min-84.3719012538592
survival_time_max16.666666666666654
survival_time_mean4.439999999999998
survival_time_min0.4
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.433333333333325
valid_direction_mean4.039999999999998
valid_direction_median1.4666666666666686
valid_direction_min0.36666666666666664
No reset possible
7876959Benjamin Ramtoula 🇨🇦My ROS solution - param 1aido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7875959Benjamin Ramtoula 🇨🇦My ROS solution - param 1aido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.39999999999998


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.1731000127196312, "good_angle": 57.76609519813871, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.033333333333308}, "ep001": {"nsteps": 88, "reward": -13.129247199743986, "good_angle": 2.638895305029247, "survival_time": 2.9333333333333327, "traveled_tiles": 1, "valid_direction": 2.1999999999999975}, "ep002": {"nsteps": 70, "reward": -16.101403069496154, "good_angle": 2.1620623369409993, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 1.4999999999999996}, "ep003": {"nsteps": 500, "reward": -0.8547458763372852, "good_angle": 11.600130951708472, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.066666666666652}, "ep004": {"nsteps": 252, "reward": -5.73448797829804, "good_angle": 15.011336964562966, "survival_time": 8.39999999999998, "traveled_tiles": 3, "valid_direction": 6.266666666666651}}
good_angle_max57.76609519813871
good_angle_mean17.83570415127608
good_angle_median11.600130951708472
good_angle_min2.1620623369409993
reward_max-0.8547458763372852
reward_mean-7.39859682731902
reward_median-5.73448797829804
reward_min-16.101403069496154
survival_time_max16.666666666666654
survival_time_mean9.399999999999991
survival_time_min2.333333333333335
traveled_tiles_max3
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.033333333333308
valid_direction_mean7.413333333333322
valid_direction_median6.266666666666651
valid_direction_min1.4999999999999996
No reset possible
7870959Benjamin Ramtoula 🇨🇦My ROS solution - param 1aido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7865957Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.816868425184561
deviation-center-line_median1.0763712325446984
in-drivable-lane_median0


other stats
deviation-center-line_max1.5500931747914883
deviation-center-line_mean0.8840287202289556
deviation-center-line_min0.10314050793996536
deviation-heading_max3.1158708257068968
deviation-heading_mean1.5113135435402714
deviation-heading_median1.6660642039579012
deviation-heading_min0.2321940958034451
driven_any_max4.429213328198922
driven_any_mean2.7217933296671575
driven_any_median4.012049662549058
driven_any_min0.5501129703623945
driven_lanedir_max4.372799009902561
driven_lanedir_mean2.6068784517728423
driven_lanedir_min0.30665132186475763
in-drivable-lane_max1.0000000000000002
in-drivable-lane_mean0.2866666666666664
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5501129703623945, "driven_lanedir": 0.30665132186475763, "in-drivable-lane": 1.0000000000000002, "deviation-heading": 0.793487193401993, "deviation-center-line": 0.10314050793996536}, "ep001": {"driven_any": 0.5792783507749473, "driven_lanedir": 0.5757257316395121, "in-drivable-lane": 0, "deviation-heading": 0.2321940958034451, "deviation-center-line": 0.3122624605297995}, "ep002": {"driven_any": 4.038312336450465, "driven_lanedir": 3.816868425184561, "in-drivable-lane": 0.4333333333333318, "deviation-heading": 3.1158708257068968, "deviation-center-line": 1.378276225338826}, "ep003": {"driven_any": 4.012049662549058, "driven_lanedir": 3.962347770272822, "in-drivable-lane": 0, "deviation-heading": 1.6660642039579012, "deviation-center-line": 1.0763712325446984}, "ep004": {"driven_any": 4.429213328198922, "driven_lanedir": 4.372799009902561, "in-drivable-lane": 0, "deviation-heading": 1.7489513988311205, "deviation-center-line": 1.5500931747914883}}
No reset possible
7860957Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -13.472630231287331, "good_angle": 0.5650858384191995, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 0.8666666666666656}, "ep001": {"nsteps": 86, "reward": -12.291817300541457, "good_angle": 3.096612917709483, "survival_time": 2.8666666666666663, "traveled_tiles": 2, "valid_direction": 0.3999999999999986}, "ep002": {"nsteps": 500, "reward": -0.2399373869235278, "good_angle": 0.7272814547114197, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 1.533333333333328}, "ep003": {"nsteps": 500, "reward": -0.3687578693628311, "good_angle": 0.11293968960795968, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.1858477357146476, "good_angle": 14.809956130802265, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.5999999999999908}}
good_angle_max14.809956130802265
good_angle_mean3.8623752062500656
good_angle_median0.7272814547114197
good_angle_min0.11293968960795968
reward_max-0.1858477357146476
reward_mean-5.311798104765959
reward_median-0.3687578693628311
reward_min-13.472630231287331
survival_time_max16.666666666666654
survival_time_mean11.073333333333329
survival_time_min2.500000000000001
traveled_tiles_max9
traveled_tiles_mean5.6
traveled_tiles_median7
traveled_tiles_min2
valid_direction_max2.5999999999999908
valid_direction_mean1.0799999999999963
valid_direction_median0.8666666666666656
valid_direction_min0
No reset possible
7831954Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.666666666666653


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.924853685960365, "good_angle": 1.3672555479350184, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.166666666666667}, "ep001": {"nsteps": 65, "reward": -15.939298686155906, "good_angle": 0.02569525987420666, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 227, "reward": -4.873405801163605, "good_angle": 2.6577827219327275, "survival_time": 7.5666666666666496, "traveled_tiles": 3, "valid_direction": 4.166666666666654}, "ep003": {"nsteps": 232, "reward": -5.568020966634604, "good_angle": 0.9794789773784786, "survival_time": 7.733333333333316, "traveled_tiles": 3, "valid_direction": 5.099999999999985}, "ep004": {"nsteps": 200, "reward": -6.055539807474706, "good_angle": 1.3632510398951314, "survival_time": 6.666666666666653, "traveled_tiles": 2, "valid_direction": 4.699999999999983}}
good_angle_max2.6577827219327275
good_angle_mean1.2786927094031126
good_angle_median1.3632510398951314
good_angle_min0.02569525987420666
reward_max-4.873405801163605
reward_mean-9.072223789477835
reward_median-6.055539807474706
reward_min-15.939298686155906
survival_time_max7.733333333333316
survival_time_mean5.353333333333325
survival_time_min2.1666666666666687
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.099999999999985
valid_direction_mean3.226666666666658
valid_direction_median4.166666666666654
valid_direction_min0
No reset possible
7819953Claudio RuchFunky Controller 1aido1_amod_fleet_size_r1-v3step2-scoringsuccessyesrudolf-80:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
fleet_size-1000000000


other stats
efficiency-63.89231136588219
service_quality-32.640257841471076
No reset possible
7811952Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:05:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7809951Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:06:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.95806685359063
deviation-center-line_median0.8229586821678466
in-drivable-lane_median1.7999999999999936


other stats
deviation-center-line_max1.2178174872322198
deviation-center-line_mean0.8570354312606204
deviation-center-line_min0.4614272679950055
deviation-heading_max6.299073364900543
deviation-heading_mean3.988919607703714
deviation-heading_median3.4254359889357633
deviation-heading_min2.678582496270513
driven_any_max4.384777253768588
driven_any_mean3.0599646230133075
driven_any_median3.9161897556702505
driven_any_min1.209814646378925
driven_lanedir_max3.878313403791397
driven_lanedir_mean2.508606696808085
driven_lanedir_min0.8623461482676087
in-drivable-lane_max4.533333333333324
in-drivable-lane_mean2.1266666666666607
in-drivable-lane_min1.099999999999996
per-episodes
details{"ep000": {"driven_any": 3.9161897556702505, "driven_lanedir": 2.95806685359063, "in-drivable-lane": 4.533333333333324, "deviation-heading": 3.153968132790692, "deviation-center-line": 1.05564604009203}, "ep001": {"driven_any": 1.209814646378925, "driven_lanedir": 0.8623461482676087, "in-drivable-lane": 1.3333333333333286, "deviation-heading": 6.299073364900543, "deviation-center-line": 0.727327678816}, "ep002": {"driven_any": 4.076256359067669, "driven_lanedir": 3.5683430262872036, "in-drivable-lane": 1.099999999999996, "deviation-heading": 4.387538055621058, "deviation-center-line": 1.2178174872322198}, "ep003": {"driven_any": 4.384777253768588, "driven_lanedir": 3.878313403791397, "in-drivable-lane": 1.86666666666666, "deviation-heading": 3.4254359889357633, "deviation-center-line": 0.8229586821678466}, "ep004": {"driven_any": 1.712785100181106, "driven_lanedir": 1.2759640521035855, "in-drivable-lane": 1.7999999999999936, "deviation-heading": 2.678582496270513, "deviation-center-line": 0.4614272679950055}}
No reset possible
7794945Claudio RuchPython templateaido1_amod_fleet_size_r1-v3step2-scoringabortedyesrudolf-80:01:17
Error while running [...]

Creating job7794-3268_aido-scorer_1 ... error
stderr | ERROR: for job7794-3268_aido-scorer_1  Cannot start service aido-scorer: network job7794-3268_evaluation not found
stderr | 
stderr | ERROR: for aido-scorer  Cannot start service aido-scorer: network job7794-3268_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7783945Claudio RuchPython templateaido1_amod_fleet_size_r1-v3step1-simulationsuccessnorudolf-80:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
7775941David AbrahamPytorch ILaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4524595137794645
deviation-center-line_median0.12839941939762656
in-drivable-lane_median0


other stats
deviation-center-line_max0.7983372443672196
deviation-center-line_mean0.3380569545926784
deviation-center-line_min0.07408682132034992
deviation-heading_max5.279562013364543
deviation-heading_mean2.036813170556792
deviation-heading_median0.3199694854199965
deviation-heading_min0.1808021473176744
driven_any_max9.64812532793395
driven_any_mean3.716725938501999
driven_any_median0.7942371126606618
driven_any_min0.4879643179665967
driven_lanedir_max4.224767646159132
driven_lanedir_mean1.4928239510861143
driven_lanedir_min0.2364698935657361
in-drivable-lane_max6.1000000000000085
in-drivable-lane_mean1.4600000000000009
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.869135875499666, "driven_lanedir": 2.2877849291825276, "in-drivable-lane": 6.1000000000000085, "deviation-heading": 5.279562013364543, "deviation-center-line": 0.6012225514085052}, "ep001": {"driven_any": 0.7942371126606618, "driven_lanedir": 0.26263777274371103, "in-drivable-lane": 0, "deviation-heading": 0.3199694854199965, "deviation-center-line": 0.08823873646969087}, "ep002": {"driven_any": 0.7841670584491253, "driven_lanedir": 0.4524595137794645, "in-drivable-lane": 0, "deviation-heading": 0.29175076592833826, "deviation-center-line": 0.12839941939762656}, "ep003": {"driven_any": 9.64812532793395, "driven_lanedir": 4.224767646159132, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 4.111981440753408, "deviation-center-line": 0.7983372443672196}, "ep004": {"driven_any": 0.4879643179665967, "driven_lanedir": 0.2364698935657361, "in-drivable-lane": 0, "deviation-heading": 0.1808021473176744, "deviation-center-line": 0.07408682132034992}}
No reset possible
7737933Hristo Vrigazov 🇧🇬ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7734933Hristo Vrigazov 🇧🇬ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 160, "reward": -6.377801977355193, "good_angle": 1.4073869060810242, "survival_time": 5.333333333333324, "traveled_tiles": 2, "valid_direction": 1.5999999999999948}, "ep001": {"nsteps": 90, "reward": -11.70273331238164, "good_angle": 0.035954910378391304, "survival_time": 2.999999999999999, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 48, "reward": -21.280009833474953, "good_angle": 0.4255411910209924, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.7666666666666684}, "ep003": {"nsteps": 59, "reward": -17.301385109328617, "good_angle": 0.5926403818493755, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.8666666666666694}, "ep004": {"nsteps": 69, "reward": -14.964852625909058, "good_angle": 0.3844143147042716, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.6333333333333331}}
good_angle_max1.4073869060810242
good_angle_mean0.569187540806811
good_angle_median0.4255411910209924
good_angle_min0.035954910378391304
reward_max-6.377801977355193
reward_mean-14.325356571689891
reward_median-14.964852625909058
reward_min-21.280009833474953
survival_time_max5.333333333333324
survival_time_mean2.839999999999999
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.5999999999999948
valid_direction_mean0.7733333333333331
valid_direction_median0.7666666666666684
valid_direction_min0
No reset possible
7728932David AbrahamPytorch ILaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 27, in solve
    from pytorch_model import TensorflowModel
  File "/workspace/pytorch_model.py", line 1, in <module>
    import torch
ImportError: No module named torch


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7723931David AbrahamILaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 85, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 27, in solve
    from pytorch_model import TensorflowModel
ImportError: No module named pytorch_model


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7721930Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:12
Error while running [...]

Creating job7721-7298_visualization_1 ... error
stderr | ERROR: for job7721-7298_visualization_1  Cannot start service visualization: network job7721-7298_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7721-7298_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7716929Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.15452735404053652
deviation-center-line_median0.2678767736384
in-drivable-lane_median0.4000000000000008


other stats
deviation-center-line_max0.31082345672843653
deviation-center-line_mean0.23635870772679252
deviation-center-line_min0.11648018064560534
deviation-heading_max2.5372186668491503
deviation-heading_mean1.6780024160940694
deviation-heading_median1.729976996227318
deviation-heading_min0.8733144887328745
driven_any_max1.9561262793008625
driven_any_mean1.1234495227446186
driven_any_median0.9265852125600964
driven_any_min0.26993116944546164
driven_lanedir_max0.3939344103988932
driven_lanedir_mean0.15505554608366856
driven_lanedir_min-0.006124570623144088
in-drivable-lane_max4.19999999999999
in-drivable-lane_mean1.5199999999999982
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.9561262793008625, "driven_lanedir": 0.3939344103988932, "in-drivable-lane": 2.999999999999999, "deviation-heading": 2.0063800547895867, "deviation-center-line": 0.31082345672843653}, "ep001": {"driven_any": 0.26993116944546164, "driven_lanedir": -0.006124570623144088, "in-drivable-lane": 0, "deviation-heading": 0.8733144887328745, "deviation-center-line": 0.11648018064560534}, "ep002": {"driven_any": 1.8539052586165647, "driven_lanedir": 0.15452735404053652, "in-drivable-lane": 4.19999999999999, "deviation-heading": 2.5372186668491503, "deviation-center-line": 0.2678767736384}, "ep003": {"driven_any": 0.9265852125600964, "driven_lanedir": 0.20110015817026072, "in-drivable-lane": 0, "deviation-heading": 1.243121873871418, "deviation-center-line": 0.2956628607939545}, "ep004": {"driven_any": 0.6106996938001087, "driven_lanedir": 0.031840378431796434, "in-drivable-lane": 0.4000000000000008, "deviation-heading": 1.729976996227318, "deviation-center-line": 0.19095026682756633}}
No reset possible
7711929Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step3-videosabortedyesrudolf-80:00:11
Error while running [...]

Creating job7711-2454_videos_1 ... error
stderr | ERROR: for job7711-2454_videos_1  Cannot start service videos: network job7711-2454_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7711-2454_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7702928Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7691926Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.08995210883203586
deviation-center-line_median0.13999283732729784
in-drivable-lane_median0


other stats
deviation-center-line_max0.5967702926810171
deviation-center-line_mean0.22107473955257056
deviation-center-line_min0.09553931818728711
deviation-heading_max5.561174620118044
deviation-heading_mean2.052529886458908
deviation-heading_median1.2003638965457502
deviation-heading_min0.8821821364432593
driven_any_max2.72233971937701
driven_any_mean0.7572215383759043
driven_any_median0.25726582444831586
driven_any_min0.1327951737101693
driven_lanedir_max0.2016102188459316
driven_lanedir_mean0.08463395806118029
driven_lanedir_min-0.015412842586705278
in-drivable-lane_max5.9999999999999805
in-drivable-lane_mean1.1999999999999962
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.72233971937701, "driven_lanedir": 0.2016102188459316, "in-drivable-lane": 5.9999999999999805, "deviation-heading": 5.561174620118044, "deviation-center-line": 0.5967702926810171}, "ep001": {"driven_any": 0.25726582444831586, "driven_lanedir": 0.03969031674007928, "in-drivable-lane": 0, "deviation-heading": 0.8821821364432593, "deviation-center-line": 0.13999283732729784}, "ep002": {"driven_any": 0.2353800698745608, "driven_lanedir": 0.08995210883203586, "in-drivable-lane": 0, "deviation-heading": 1.0206839946950763, "deviation-center-line": 0.15601821040973946}, "ep003": {"driven_any": 0.4383269044694661, "driven_lanedir": 0.10732998847456, "in-drivable-lane": 0, "deviation-heading": 1.5982447844924086, "deviation-center-line": 0.117053039157511}, "ep004": {"driven_any": 0.1327951737101693, "driven_lanedir": -0.015412842586705278, "in-drivable-lane": 0, "deviation-heading": 1.2003638965457502, "deviation-center-line": 0.09553931818728711}}
No reset possible
7678926Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8000000000000025


other stats
episodes
details{"ep000": {"nsteps": 451, "reward": -3.295074574168185, "good_angle": 48.3203018919845, "survival_time": 15.03333333333329, "traveled_tiles": 2, "valid_direction": 13.233333333333295}, "ep001": {"nsteps": 42, "reward": -24.428654516736668, "good_angle": 0.8192767652127333, "survival_time": 1.400000000000001, "traveled_tiles": 1, "valid_direction": 1.0333333333333343}, "ep002": {"nsteps": 54, "reward": -19.038479293110193, "good_angle": 0.8276324192569418, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 1.2000000000000024}, "ep003": {"nsteps": 77, "reward": -13.297868670968269, "good_angle": 1.9163194509546355, "survival_time": 2.5666666666666673, "traveled_tiles": 1, "valid_direction": 1.1999999999999995}, "ep004": {"nsteps": 35, "reward": -29.190741378920418, "good_angle": 1.4683660501392677, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 1.0333333333333334}}
good_angle_max48.3203018919845
good_angle_mean10.670379315509615
good_angle_median1.4683660501392677
good_angle_min0.8192767652127333
reward_max-3.295074574168185
reward_mean-17.850163686780746
reward_median-19.038479293110193
reward_min-29.190741378920418
survival_time_max15.03333333333329
survival_time_mean4.3933333333333255
survival_time_min1.166666666666667
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.233333333333295
valid_direction_mean3.539999999999994
valid_direction_median1.1999999999999995
valid_direction_min1.0333333333333334
No reset possible
7672925Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 92, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 50, in solve
    if np.abs(action) > 0.8:
ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7671924Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 92, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 27, in solve
    from model import TensorflowModel
  File "/workspace/model.py", line 4, in <module>
    from _layers import one_residual
ImportError: No module named _layers


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7667923Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:12
Error while running [...]

Creating job7667-2101_visualization_1 ... error
stderr | ERROR: for job7667-2101_visualization_1  Cannot start service visualization: network job7667-2101_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7667-2101_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7661923Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.066666666666642


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.17557190913974774, "good_angle": 0.8943709976783593, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 1.7666666666666613}, "ep001": {"nsteps": 91, "reward": -11.61865196450726, "good_angle": 3.791116237822393, "survival_time": 3.0333333333333323, "traveled_tiles": 2, "valid_direction": 0.4999999999999982}, "ep002": {"nsteps": 425, "reward": -2.5472737694276937, "good_angle": 1.0748055250624209, "survival_time": 14.166666666666629, "traveled_tiles": 7, "valid_direction": 2.633333333333325}, "ep003": {"nsteps": 302, "reward": -3.7052194447262794, "good_angle": 0.24922146327571912, "survival_time": 10.066666666666642, "traveled_tiles": 5, "valid_direction": 0.36666666666666536}, "ep004": {"nsteps": 150, "reward": -7.135533663431803, "good_angle": 4.30283155309352, "survival_time": 4.999999999999992, "traveled_tiles": 3, "valid_direction": 0.5666666666666647}}
good_angle_max4.30283155309352
good_angle_mean2.0624691553864825
good_angle_median1.0748055250624209
good_angle_min0.24922146327571912
reward_max-0.17557190913974774
reward_mean-5.036450150246557
reward_median-3.7052194447262794
reward_min-11.61865196450726
survival_time_max16.666666666666654
survival_time_mean9.78666666666665
survival_time_min3.0333333333333323
traveled_tiles_max7
traveled_tiles_mean4.8
traveled_tiles_median5
traveled_tiles_min2
valid_direction_max2.633333333333325
valid_direction_mean1.166666666666663
valid_direction_median0.5666666666666647
valid_direction_min0.36666666666666536
No reset possible
7657921Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5410938643573726
deviation-center-line_median0.5043600939102477
in-drivable-lane_median0


other stats
deviation-center-line_max0.7030387617590902
deviation-center-line_mean0.5184596914539525
deviation-center-line_min0.35139910745657726
deviation-heading_max1.5578497384654708
deviation-heading_mean0.6358722084615681
deviation-heading_median0.40073250582101255
deviation-heading_min0.26880125542756383
driven_any_max1.146511578095727
driven_any_mean0.63861779653149
driven_any_median0.5428956245631891
driven_any_min0.34288054777757204
driven_lanedir_max0.9202670350895938
driven_lanedir_mean0.5915631103596073
driven_lanedir_min0.34149017201602394
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.146511578095727, "driven_lanedir": 0.9202670350895938, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.5578497384654708, "deviation-center-line": 0.7030387617590902}, "ep001": {"driven_any": 0.34288054777757204, "driven_lanedir": 0.34149017201602394, "in-drivable-lane": 0, "deviation-heading": 0.26880125542756383, "deviation-center-line": 0.35139910745657726}, "ep002": {"driven_any": 0.517895835336798, "driven_lanedir": 0.5158682528069163, "in-drivable-lane": 0, "deviation-heading": 0.40073250582101255, "deviation-center-line": 0.4841616075338382}, "ep003": {"driven_any": 0.6429053968841646, "driven_lanedir": 0.63909622752813, "in-drivable-lane": 0, "deviation-heading": 0.5751297797392467, "deviation-center-line": 0.5493388866100095}, "ep004": {"driven_any": 0.5428956245631891, "driven_lanedir": 0.5410938643573726, "in-drivable-lane": 0, "deviation-heading": 0.37684776285454674, "deviation-center-line": 0.5043600939102477}}
No reset possible
7650921Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:05:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7646920Manfred DiazTensorflow templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7643920Manfred DiazTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.466666666666626


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.15423863659892958, "good_angle": 0.4357973211464265, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 0.33333333333333215}, "ep001": {"nsteps": 434, "reward": -2.55035256082581, "good_angle": 14.408324500717573, "survival_time": 14.466666666666626, "traveled_tiles": 12, "valid_direction": 2.433333333333329}, "ep002": {"nsteps": 112, "reward": -9.13167920045089, "good_angle": 0.4244389336872031, "survival_time": 3.73333333333333, "traveled_tiles": 4, "valid_direction": 0.5333333333333314}, "ep003": {"nsteps": 500, "reward": -0.1675045478786342, "good_angle": 0.28052233622904055, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 0.2666666666666657}, "ep004": {"nsteps": 241, "reward": -4.376776966674029, "good_angle": 4.8572073110175795, "survival_time": 8.033333333333315, "traveled_tiles": 7, "valid_direction": 0.966666666666664}}
good_angle_max14.408324500717573
good_angle_mean4.081258080559564
good_angle_median0.4357973211464265
good_angle_min0.28052233622904055
reward_max-0.15423863659892958
reward_mean-3.2761103824856592
reward_median-2.55035256082581
reward_min-9.13167920045089
survival_time_max16.666666666666654
survival_time_mean11.913333333333316
survival_time_min3.73333333333333
traveled_tiles_max12
traveled_tiles_mean9.4
traveled_tiles_median12
traveled_tiles_min4
valid_direction_max2.433333333333329
valid_direction_mean0.9066666666666644
valid_direction_median0.5333333333333314
valid_direction_min0.2666666666666657
No reset possible
7634919Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.999999999999985


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -13.436042144575987, "good_angle": 1.3221352438428684, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.1666666666666674}, "ep001": {"nsteps": 52, "reward": -19.80081008833188, "good_angle": 0.01915294283845057, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 235, "reward": -4.7624472324112235, "good_angle": 2.5993360789422204, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 4.666666666666655}, "ep003": {"nsteps": 232, "reward": -5.446854568494018, "good_angle": 1.028994334985729, "survival_time": 7.733333333333316, "traveled_tiles": 3, "valid_direction": 4.633333333333317}, "ep004": {"nsteps": 210, "reward": -5.82402530523139, "good_angle": 3.322565684789915, "survival_time": 6.999999999999985, "traveled_tiles": 3, "valid_direction": 4.199999999999985}}
good_angle_max3.322565684789915
good_angle_mean1.658436857079837
good_angle_median1.3221352438428684
good_angle_min0.01915294283845057
reward_max-4.7624472324112235
reward_mean-9.8540358678089
reward_median-5.82402530523139
reward_min-19.80081008833188
survival_time_max7.833333333333315
survival_time_mean5.366666666666657
survival_time_min1.7333333333333354
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.666666666666655
valid_direction_mean3.133333333333325
valid_direction_median4.199999999999985
valid_direction_min0
No reset possible
7627917Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7623917Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7608915Ruixiang Zhang 🇨🇦stay simpleaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7604914Manfred DiazTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.992468761476724
deviation-center-line_median0.6972622730664987
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.9008921652485434
deviation-center-line_mean0.6745505335631848
deviation-center-line_min0.32062786569173557
deviation-heading_max2.7495979913439865
deviation-heading_mean2.1170669624782383
deviation-heading_median2.460817383756992
deviation-heading_min1.21993034050232
driven_any_max5.496788900325122
driven_any_mean4.551286930889951
driven_any_median5.1587489504322654
driven_any_min1.51567855004027
driven_lanedir_max5.1766735171540805
driven_lanedir_mean4.323558621259602
driven_lanedir_min1.3714743878852935
in-drivable-lane_max0.8666666666666654
in-drivable-lane_mean0.27999999999999936
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.496788900325122, "driven_lanedir": 4.992468761476724, "in-drivable-lane": 0.8666666666666654, "deviation-heading": 2.7495979913439865, "deviation-center-line": 0.8781617758575586}, "ep001": {"driven_any": 5.1587489504322654, "driven_lanedir": 4.9820201302259335, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 2.567406093405443, "deviation-center-line": 0.6972622730664987}, "ep002": {"driven_any": 1.51567855004027, "driven_lanedir": 1.3714743878852935, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.21993034050232, "deviation-center-line": 0.32062786569173557}, "ep003": {"driven_any": 5.439032905533301, "driven_lanedir": 5.1766735171540805, "in-drivable-lane": 0.2333333333333325, "deviation-heading": 2.460817383756992, "deviation-center-line": 0.9008921652485434}, "ep004": {"driven_any": 5.146185348118799, "driven_lanedir": 5.095156309555976, "in-drivable-lane": 0, "deviation-heading": 1.5875830033824527, "deviation-center-line": 0.5758085879515876}}
No reset possible
7599914Manfred DiazTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.029069309427868575, "good_angle": 0.46192808812795494, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 0.3999999999999986}, "ep001": {"nsteps": 500, "reward": -0.1518198684505187, "good_angle": 21.01924327415478, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.8666666666666587}, "ep002": {"nsteps": 143, "reward": -7.1027851600014325, "good_angle": 0.551182759857747, "survival_time": 4.7666666666666595, "traveled_tiles": 5, "valid_direction": 0.5333333333333314}, "ep003": {"nsteps": 500, "reward": -0.065350006764289, "good_angle": 0.5044974229999086, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 0.4333333333333318}, "ep004": {"nsteps": 500, "reward": -0.14075596853683237, "good_angle": 12.428711570170702, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 1.999999999999993}}
good_angle_max21.01924327415478
good_angle_mean6.993112623062217
good_angle_median0.551182759857747
good_angle_min0.46192808812795494
reward_max-0.029069309427868575
reward_mean-1.4979560626361883
reward_median-0.14075596853683237
reward_min-7.1027851600014325
survival_time_max16.666666666666654
survival_time_mean14.286666666666656
survival_time_min4.7666666666666595
traveled_tiles_max11
traveled_tiles_mean9.4
traveled_tiles_median10
traveled_tiles_min5
valid_direction_max2.8666666666666587
valid_direction_mean1.2466666666666626
valid_direction_median0.5333333333333314
valid_direction_min0.3999999999999986
No reset possible
7578911Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationfailednorudolf-80:10:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7570909Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:04:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7566908Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7560908Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.233333333333321


other stats
episodes
details{"ep000": {"nsteps": 77, "reward": -13.25760446571104, "good_angle": 1.2102786325198769, "survival_time": 2.5666666666666673, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 54, "reward": -19.086375530119295, "good_angle": 0.06435254244870461, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 226, "reward": -4.901912556033977, "good_angle": 2.5406340061787915, "survival_time": 7.533333333333316, "traveled_tiles": 3, "valid_direction": 4.966666666666653}, "ep003": {"nsteps": 221, "reward": -5.707385117474657, "good_angle": 1.0355929673408153, "survival_time": 7.36666666666665, "traveled_tiles": 3, "valid_direction": 4.999999999999986}, "ep004": {"nsteps": 187, "reward": -6.5791364537432475, "good_angle": 1.5165908226878455, "survival_time": 6.233333333333321, "traveled_tiles": 2, "valid_direction": 5.099999999999987}}
good_angle_max2.5406340061787915
good_angle_mean1.2734897942352066
good_angle_median1.2102786325198769
good_angle_min0.06435254244870461
reward_max-4.901912556033977
reward_mean-9.906482824616443
reward_median-6.5791364537432475
reward_min-19.086375530119295
survival_time_max7.533333333333316
survival_time_mean5.099999999999992
survival_time_min1.8000000000000025
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.099999999999987
valid_direction_mean3.439999999999992
valid_direction_median4.966666666666653
valid_direction_min0
No reset possible
7551906Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7545907Laurent MandrileTensorflow templateaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 86, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 29, in solve
    from model import TfInference
ImportError: cannot import name TfInference


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7533905Laurent MandrileTensorflow templateaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 86, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 29, in solve
    from model import TfInference
  File "/workspace/model.py", line 4, in <module>
    from _layers import one_residual
ImportError: No module named _layers


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7520902Ruixiang Zhang 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.29999999999997


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.2184969825148582, "good_angle": 52.71936463311338, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.43333333333332}, "ep001": {"nsteps": 53, "reward": -20.819052375150175, "good_angle": 1.5776341378385166, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 1.4333333333333351}, "ep002": {"nsteps": 500, "reward": -1.080979475753382, "good_angle": 13.597076501817195, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999986}, "ep003": {"nsteps": 489, "reward": -3.5198926632940113, "good_angle": 13.543907954886944, "survival_time": 16.29999999999997, "traveled_tiles": 1, "valid_direction": 12.566666666666649}, "ep004": {"nsteps": 139, "reward": -9.007249958223577, "good_angle": 3.8703731850782774, "survival_time": 4.633333333333327, "traveled_tiles": 1, "valid_direction": 3.6666666666666607}}
good_angle_max52.71936463311338
good_angle_mean17.06167128254686
good_angle_median13.543907954886944
good_angle_min1.5776341378385166
reward_max-1.080979475753382
reward_mean-7.1291342909872
reward_median-3.5198926632940113
reward_min-20.819052375150175
survival_time_max16.666666666666654
survival_time_mean11.206666666666656
survival_time_min1.7666666666666688
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.43333333333332
valid_direction_mean9.01999999999999
valid_direction_median12.566666666666649
valid_direction_min1.4333333333333351
No reset possible
7513900Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:13
Error while running [...]

Creating job7513-6799_solution_1  ... error
stderr | ERROR: for job7513-6799_solution_1  Cannot start service solution: network job7513-6799_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job7513-6799_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job7513-6799_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7506897Tina ChuRandom executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.49999999999998


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.906806614692028, "good_angle": 1.206596619466091, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.2}, "ep001": {"nsteps": 52, "reward": -19.798845812105217, "good_angle": 0.022232550041338405, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 255, "reward": -4.361661687580979, "good_angle": 1.0254094521962789, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.06666666666666}, "ep003": {"nsteps": 454, "reward": -2.5249498644343675, "good_angle": 1.1321616272684134, "survival_time": 15.13333333333329, "traveled_tiles": 4, "valid_direction": 2.033333333333326}, "ep004": {"nsteps": 346, "reward": -3.5893528192083526, "good_angle": 21.869471523969636, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}
good_angle_max21.869471523969636
good_angle_mean5.051174354588352
good_angle_median1.1321616272684134
good_angle_min0.022232550041338405
reward_max-2.5249498644343675
reward_mean-8.636323359604187
reward_median-4.361661687580979
reward_min-19.798845812105217
survival_time_max15.13333333333329
survival_time_mean7.906666666666649
survival_time_min1.7333333333333354
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.93333333333332
valid_direction_mean2.046666666666661
valid_direction_median2.06666666666666
valid_direction_min0
No reset possible
7490894Martin Weiss 🇨🇦PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.966810409963131, "good_angle": 47.123441495230765, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.233333333333322}, "ep001": {"nsteps": 500, "reward": -1.300191262960434, "good_angle": 13.8317262841996, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}, "ep002": {"nsteps": 500, "reward": -1.117795492440462, "good_angle": 13.808909540839275, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.9294596527849426, "good_angle": 13.819737231108473, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}, "ep004": {"nsteps": 500, "reward": -1.163820459574461, "good_angle": 13.824014957850544, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}}
good_angle_max47.123441495230765
good_angle_mean20.481565901845737
good_angle_median13.824014957850544
good_angle_min13.808909540839275
reward_max-0.9294596527849426
reward_mean-1.0956154555446862
reward_median-1.117795492440462
reward_min-1.300191262960434
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.233333333333322
valid_direction_mean13.266666666666657
valid_direction_median13.09999999999999
valid_direction_min12.933333333333326
No reset possible
7488893Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.06257495026613702
deviation-center-line_median0.012357567416924956
in-drivable-lane_median0.2333333333333333


other stats
deviation-center-line_max0.0452794510797439
deviation-center-line_mean0.019076733881271873
deviation-center-line_min0.009149382540741378
deviation-heading_max0.48880046920520354
deviation-heading_mean0.2624820822111712
deviation-heading_median0.20745991226757915
deviation-heading_min0.1948487905837682
driven_any_max1.161328127002193
driven_any_mean0.460199627478643
driven_any_median0.2903245158166041
driven_any_min0.26183844987327803
driven_lanedir_max-0.04671932648868449
driven_lanedir_mean-0.08287070022951838
driven_lanedir_min-0.1875474620709579
in-drivable-lane_max1.0333333333333343
in-drivable-lane_mean0.39333333333333353
in-drivable-lane_min0.2
per-episodes
details{"ep000": {"driven_any": 1.161328127002193, "driven_lanedir": -0.1875474620709579, "in-drivable-lane": 1.0333333333333343, "deviation-heading": 0.48880046920520354, "deviation-center-line": 0.0452794510797439}, "ep001": {"driven_any": 0.2903245158166041, "driven_lanedir": -0.0534892020839699, "in-drivable-lane": 0.2333333333333333, "deviation-heading": 0.19518621780211112, "deviation-center-line": 0.016277814523180563}, "ep002": {"driven_any": 0.26183844987327803, "driven_lanedir": -0.06402256023784259, "in-drivable-lane": 0.2, "deviation-heading": 0.20745991226757915, "deviation-center-line": 0.01231945384576857}, "ep003": {"driven_any": 0.30668764759030986, "driven_lanedir": -0.06257495026613702, "in-drivable-lane": 0.2333333333333333, "deviation-heading": 0.22611502119719393, "deviation-center-line": 0.009149382540741378}, "ep004": {"driven_any": 0.2808193971108304, "driven_lanedir": -0.04671932648868449, "in-drivable-lane": 0.2666666666666666, "deviation-heading": 0.1948487905837682, "deviation-center-line": 0.012357567416924956}}
No reset possible
7478893Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7475890Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.18053272615462612
deviation-center-line_median0.1888582869140098
in-drivable-lane_median0


other stats
deviation-center-line_max0.3709672068048819
deviation-center-line_mean0.20165342854522988
deviation-center-line_min0.1231117401706144
deviation-heading_max1.744035613392213
deviation-heading_mean0.7847348106787032
deviation-heading_median0.6008032226837184
deviation-heading_min0.2234643819131907
driven_any_max0.7857308823168943
driven_any_mean0.3092877569841216
driven_any_median0.1892712323431065
driven_any_min0.16070534844219078
driven_lanedir_max0.5461339343495566
driven_lanedir_mean0.24892124610906344
driven_lanedir_min0.14224724341586503
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7857308823168943, "driven_lanedir": 0.5461339343495566, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.744035613392213, "deviation-center-line": 0.3709672068048819}, "ep001": {"driven_any": 0.18215268956511688, "driven_lanedir": 0.18053272615462612, "in-drivable-lane": 0, "deviation-heading": 0.2234643819131907, "deviation-center-line": 0.1888582869140098}, "ep002": {"driven_any": 0.16070534844219078, "driven_lanedir": 0.14224724341586503, "in-drivable-lane": 0, "deviation-heading": 0.5868885229152438, "deviation-center-line": 0.12797137863818}, "ep003": {"driven_any": 0.1892712323431065, "driven_lanedir": 0.1653174264917503, "in-drivable-lane": 0, "deviation-heading": 0.7684823124891497, "deviation-center-line": 0.1231117401706144}, "ep004": {"driven_any": 0.2285786322532994, "driven_lanedir": 0.21037490013351912, "in-drivable-lane": 0, "deviation-heading": 0.6008032226837184, "deviation-center-line": 0.19735853019846325}}
No reset possible
7459887Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7453886Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.25751103414270027
deviation-center-line_median0.2316766280237925
in-drivable-lane_median0


other stats
deviation-center-line_max0.353851215952034
deviation-center-line_mean0.2491435731069917
deviation-center-line_min0.12859740325554045
deviation-heading_max1.786421122268535
deviation-heading_mean0.7913033785668815
deviation-heading_median0.6072484431772607
deviation-heading_min0.217993163684858
driven_any_max0.7964697703754341
driven_any_mean0.3771525772806887
driven_any_median0.27142160418020644
driven_any_min0.16070296388132274
driven_lanedir_max0.5556348189361362
driven_lanedir_mean0.3191292478835238
driven_lanedir_min0.14057228504037322
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7964697703754341, "driven_lanedir": 0.5556348189361362, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.786421122268535, "deviation-center-line": 0.33782433590773453}, "ep001": {"driven_any": 0.18929400406129007, "driven_lanedir": 0.187596066353239, "in-drivable-lane": 0, "deviation-heading": 0.217993163684858, "deviation-center-line": 0.19376828239585708}, "ep002": {"driven_any": 0.16070296388132274, "driven_lanedir": 0.14057228504037322, "in-drivable-lane": 0, "deviation-heading": 0.6072484431772607, "deviation-center-line": 0.12859740325554045}, "ep003": {"driven_any": 0.46787454390519007, "driven_lanedir": 0.4543320349451702, "in-drivable-lane": 0, "deviation-heading": 0.7592086640997087, "deviation-center-line": 0.353851215952034}, "ep004": {"driven_any": 0.27142160418020644, "driven_lanedir": 0.25751103414270027, "in-drivable-lane": 0, "deviation-heading": 0.5856454996040452, "deviation-center-line": 0.2316766280237925}}
No reset possible
7443885Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7441885Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7439884Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.422982674920641
deviation-center-line_median0.8505527918433278
in-drivable-lane_median0.8333333333333304


other stats
deviation-center-line_max1.7417672032958655
deviation-center-line_mean0.9513460013571776
deviation-center-line_min0.43504621053141007
deviation-heading_max3.144160614329157
deviation-heading_mean2.437358833954327
deviation-heading_median2.787311660735885
deviation-heading_min0.7857529283477824
driven_any_max4.56726118501361
driven_any_mean2.9668741296556305
driven_any_median4.050258445416032
driven_any_min0.3838597371153447
driven_lanedir_max4.502757749578887
driven_lanedir_mean2.283971626191801
driven_lanedir_min0.37402920769348946
in-drivable-lane_max6.966666666666686
in-drivable-lane_mean2.513333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.050258445416032, "driven_lanedir": 2.422982674920641, "in-drivable-lane": 6.966666666666686, "deviation-heading": 2.787311660735885, "deviation-center-line": 0.8505527918433278}, "ep001": {"driven_any": 0.3838597371153447, "driven_lanedir": 0.37402920769348946, "in-drivable-lane": 0, "deviation-heading": 0.7857529283477824, "deviation-center-line": 0.43504621053141007}, "ep002": {"driven_any": 1.4424280740950552, "driven_lanedir": 1.2255587500378566, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 2.511960214931568, "deviation-center-line": 0.5278815926739738}, "ep003": {"driven_any": 4.39056320663811, "driven_lanedir": 2.8945297487281283, "in-drivable-lane": 4.766666666666651, "deviation-heading": 3.144160614329157, "deviation-center-line": 1.2014822084413108}, "ep004": {"driven_any": 4.56726118501361, "driven_lanedir": 4.502757749578887, "in-drivable-lane": 0, "deviation-heading": 2.957608751427242, "deviation-center-line": 1.7417672032958655}}
No reset possible
7436884Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5594651458710432, "good_angle": 1.9877803082613077, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 5.266666666666648}, "ep001": {"nsteps": 111, "reward": -9.64766034269118, "good_angle": 0.31150333423805066, "survival_time": 3.6999999999999966, "traveled_tiles": 1, "valid_direction": 0.7999999999999972}, "ep002": {"nsteps": 203, "reward": -5.031536213631553, "good_angle": 0.9028345141941596, "survival_time": 6.766666666666652, "traveled_tiles": 4, "valid_direction": 1.999999999999993}, "ep003": {"nsteps": 500, "reward": -0.4913692384962924, "good_angle": 3.0780545811724904, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 6.266666666666644}, "ep004": {"nsteps": 500, "reward": -0.28377321450412274, "good_angle": 31.474832509995675, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 4.599999999999984}}
good_angle_max31.474832509995675
good_angle_mean7.551001049572337
good_angle_median1.9877803082613077
good_angle_min0.31150333423805066
reward_max-0.28377321450412274
reward_mean-3.2027608310388382
reward_median-0.5594651458710432
reward_min-9.64766034269118
survival_time_max16.666666666666654
survival_time_mean12.093333333333325
survival_time_min3.6999999999999966
traveled_tiles_max9
traveled_tiles_mean6.2
traveled_tiles_median8
traveled_tiles_min1
valid_direction_max6.266666666666644
valid_direction_mean3.7866666666666537
valid_direction_median4.599999999999984
valid_direction_min0.7999999999999972
No reset possible
7430881Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7426881Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7417878Mandana Samiei 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.2333333333333316


other stats
episodes
details{"ep000": {"nsteps": 71, "reward": -14.38939671668316, "good_angle": 0.7496343144478863, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 1.8333333333333344}, "ep001": {"nsteps": 116, "reward": -8.956627277789861, "good_angle": 5.476824528401408, "survival_time": 3.8666666666666623, "traveled_tiles": 2, "valid_direction": 2.6999999999999957}, "ep002": {"nsteps": 110, "reward": -10.047834566732954, "good_angle": 1.5761100266806696, "survival_time": 3.6666666666666634, "traveled_tiles": 4, "valid_direction": 2.766666666666664}, "ep003": {"nsteps": 97, "reward": -10.94542623118056, "good_angle": 1.261777326348147, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.466666666666665}, "ep004": {"nsteps": 58, "reward": -18.156620403141552, "good_angle": 1.5198559032862808, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 1.5000000000000029}}
good_angle_max5.476824528401408
good_angle_mean2.1168404198328785
good_angle_median1.5198559032862808
good_angle_min0.7496343144478863
reward_max-8.956627277789861
reward_mean-12.499181039105618
reward_median-10.94542623118056
reward_min-18.156620403141552
survival_time_max3.8666666666666623
survival_time_mean3.0133333333333323
survival_time_min1.933333333333336
traveled_tiles_max4
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.766666666666664
valid_direction_mean2.2533333333333325
valid_direction_median2.466666666666665
valid_direction_min1.5000000000000029
No reset possible
7410878Mandana Samiei 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7406875Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 227, "reward": -4.5744455482416875, "good_angle": 0.7937623130473065, "survival_time": 7.5666666666666496, "traveled_tiles": 2, "valid_direction": 1.2333333333333298}, "ep001": {"nsteps": 99, "reward": -10.711396231193737, "good_angle": 0.19533482846247435, "survival_time": 3.299999999999998, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 54, "reward": -18.98695876918457, "good_angle": 0.34666212011073927, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 0.6666666666666685}, "ep003": {"nsteps": 53, "reward": -19.22507929984691, "good_angle": 0.5550129967406443, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 0.9000000000000022}, "ep004": {"nsteps": 69, "reward": -14.967612463063087, "good_angle": 0.3386407174472176, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.7}}
good_angle_max0.7937623130473065
good_angle_mean0.4458825951616764
good_angle_median0.34666212011073927
good_angle_min0.19533482846247435
reward_max-4.5744455482416875
reward_mean-13.693098462306
reward_median-14.967612463063087
reward_min-19.22507929984691
survival_time_max7.5666666666666496
survival_time_mean3.346666666666664
survival_time_min1.7666666666666688
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.2333333333333298
valid_direction_mean0.7533333333333333
valid_direction_median0.7
valid_direction_min0.2666666666666657
No reset possible
7400875Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7393872Patrick Pfreundschuh 🇨🇭AMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7386871Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.23766019838384
deviation-center-line_median0.20939199953968393
in-drivable-lane_median0


other stats
deviation-center-line_max0.3673387434865545
deviation-center-line_mean0.22330403436488028
deviation-center-line_min0.07100643459917544
deviation-heading_max1.845510662470747
deviation-heading_mean0.8340145269688559
deviation-heading_median0.6209219560243193
deviation-heading_min0.35253142045663965
driven_any_max0.7786140825280139
driven_any_mean0.34501206506483967
driven_any_median0.25357792469697216
driven_any_min0.06784729218171177
driven_lanedir_max0.533872444381291
driven_lanedir_mean0.2822025884894799
driven_lanedir_min0.054958073205297
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7786140825280139, "driven_lanedir": 0.533872444381291, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.845510662470747, "deviation-center-line": 0.33969154841071586}, "ep001": {"driven_any": 0.06784729218171177, "driven_lanedir": 0.054958073205297, "in-drivable-lane": 0, "deviation-heading": 0.35253142045663965, "deviation-center-line": 0.07100643459917544}, "ep002": {"driven_any": 0.4178791636981945, "driven_lanedir": 0.40472153448919834, "in-drivable-lane": 0, "deviation-heading": 0.6209219560243193, "deviation-center-line": 0.3673387434865545}, "ep003": {"driven_any": 0.2071418622193059, "driven_lanedir": 0.17980069198777304, "in-drivable-lane": 0, "deviation-heading": 0.7991377474530755, "deviation-center-line": 0.1290914457882716}, "ep004": {"driven_any": 0.25357792469697216, "driven_lanedir": 0.23766019838384, "in-drivable-lane": 0, "deviation-heading": 0.5519708484394977, "deviation-center-line": 0.20939199953968393}}
No reset possible
7380871Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7375870Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7369869Bhairav MehtaDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.15853155651776518
deviation-center-line_median0.12257998665904676
in-drivable-lane_median0


other stats
deviation-center-line_max0.35930398442203687
deviation-center-line_mean0.1746914793680183
deviation-center-line_min0.06265818245724168
deviation-heading_max1.7452895256014618
deviation-heading_mean0.8245579979926234
deviation-heading_median0.6083889750085985
deviation-heading_min0.3816631270157232
driven_any_max0.8071729299414795
driven_any_mean0.2871454276221734
driven_any_median0.18570541233263693
driven_any_min0.057134721676808
driven_lanedir_max0.5685754779264094
driven_lanedir_mean0.2236035483862599
driven_lanedir_min0.04184921826141519
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8071729299414795, "driven_lanedir": 0.5685754779264094, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7452895256014618, "deviation-center-line": 0.35930398442203687}, "ep001": {"driven_any": 0.057134721676808, "driven_lanedir": 0.04184921826141519, "in-drivable-lane": 0, "deviation-heading": 0.3816631270157232, "deviation-center-line": 0.06265818245724168}, "ep002": {"driven_any": 0.15000031589493798, "driven_lanedir": 0.12732125646470105, "in-drivable-lane": 0, "deviation-heading": 0.6083889750085985, "deviation-center-line": 0.12202033279064292}, "ep003": {"driven_any": 0.18570541233263693, "driven_lanedir": 0.15853155651776518, "in-drivable-lane": 0, "deviation-heading": 0.8049386919464118, "deviation-center-line": 0.12257998665904676}, "ep004": {"driven_any": 0.23571375826500457, "driven_lanedir": 0.2217402327610087, "in-drivable-lane": 0, "deviation-heading": 0.582509670390922, "deviation-center-line": 0.2068949105111232}}
No reset possible
7364869Bhairav MehtaDolores' Awakeningaido1_LF1_r3-v3step2-scoringabortedyesrudolf-80:00:12
Error while running [...]

Creating job7364-5250_scorer_1 ... error
stderr | ERROR: for job7364-5250_scorer_1  Cannot start service scorer: network job7364-5250_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7364-5250_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7355867Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyesrudolf-80:00:11
Error while running [...]

Creating job7355-9889_visualization_1 ... error
stderr | ERROR: for job7355-9889_visualization_1  Cannot start service visualization: network job7355-9889_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7355-9889_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7351867Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7348867Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.066666666666662


other stats
episodes
details{"ep000": {"nsteps": 161, "reward": -6.35078162470831, "good_angle": 1.2521548382104863, "survival_time": 5.366666666666657, "traveled_tiles": 2, "valid_direction": 2.033333333333326}, "ep001": {"nsteps": 81, "reward": -12.914622850992062, "good_angle": 0.024286599688448696, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 122, "reward": -8.679057562204658, "good_angle": 0.33868252929960646, "survival_time": 4.066666666666662, "traveled_tiles": 2, "valid_direction": 0.466666666666665}, "ep003": {"nsteps": 135, "reward": -7.831729016370243, "good_angle": 0.28476983585199045, "survival_time": 4.499999999999994, "traveled_tiles": 2, "valid_direction": 0.5666666666666647}, "ep004": {"nsteps": 79, "reward": -13.112276503934137, "good_angle": 0.4252208988274074, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 0.5666666666666647}}
good_angle_max1.2521548382104863
good_angle_mean0.4650229403755879
good_angle_median0.33868252929960646
good_angle_min0.024286599688448696
reward_max-6.35078162470831
reward_mean-9.777693511641882
reward_median-8.679057562204658
reward_min-13.112276503934137
survival_time_max5.366666666666657
survival_time_mean3.853333333333329
survival_time_min2.6333333333333337
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.033333333333326
valid_direction_mean0.7266666666666641
valid_direction_median0.5666666666666647
valid_direction_min0
No reset possible
7342866Mandana Samiei 🇨🇦Improved ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7334865Philippe LacailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationfailednorudolf-80:10:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7324861Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:14
Error while running [...]

Creating job7324-5816_solution_1  ... error
stderr | ERROR: for job7324-5816_solution_1  Cannot start service solution: network job7324-5816_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job7324-5816_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job7324-5816_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7321859Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-80:10:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7312855Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-80:10:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7308854Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7304854Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.333333333333334


other stats
episodes
details{"ep000": {"nsteps": 36, "reward": -28.044976969818688, "good_angle": 0.7666464469069899, "survival_time": 1.2000000000000004, "traveled_tiles": 1, "valid_direction": 1.0333333333333337}, "ep001": {"nsteps": 22, "reward": -46.008810850706965, "good_angle": 0.019661774370933752, "survival_time": 0.7333333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 40, "reward": -25.42171614915133, "good_angle": 0.03801718555044795, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 45, "reward": -22.546772726045713, "good_angle": 0.06567918563705034, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 0.03333333333333344}, "ep004": {"nsteps": 46, "reward": -22.152781161925063, "good_angle": 0.03641383012341944, "survival_time": 1.5333333333333348, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max0.7666464469069899
good_angle_mean0.18528368451776828
good_angle_median0.03801718555044795
good_angle_min0.019661774370933752
reward_max-22.152781161925063
reward_mean-28.835011571529556
reward_median-25.42171614915133
reward_min-46.008810850706965
survival_time_max1.5333333333333348
survival_time_mean1.260000000000001
survival_time_min0.7333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.0333333333333337
valid_direction_mean0.21333333333333343
valid_direction_median0
valid_direction_min0
No reset possible
7299853Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7290850Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-80:10:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7286849Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7279849Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7244843Orlando Marquez 🇨🇦Imitatingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7224649Aleksandar Petrov 🇨🇭Tuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailednorudolf-80:10:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7219655Mikita Sazanovich 🇷🇺DDPGaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6436419231648096
deviation-center-line_median0.33458111728525397
in-drivable-lane_median2.9999999999999893


other stats
deviation-center-line_max0.5058789089531943
deviation-center-line_mean0.3153026589653094
deviation-center-line_min0.1743252994369005
deviation-heading_max3.005819047707316
deviation-heading_mean1.628774187780328
deviation-heading_median1.4754289643701537
deviation-heading_min0.8441907766280857
driven_any_max1.3410025964316756
driven_any_mean1.050426502730612
driven_any_median1.1315678087633612
driven_any_min0.3524627061429181
driven_lanedir_max0.7275975357089262
driven_lanedir_mean0.5432019078727981
driven_lanedir_min0.12943915872550615
in-drivable-lane_max4.333333333333319
in-drivable-lane_mean2.8533333333333237
in-drivable-lane_min0.7666666666666666
per-episodes
details{"ep000": {"driven_any": 0.3524627061429181, "driven_lanedir": 0.12943915872550615, "in-drivable-lane": 0.7666666666666666, "deviation-heading": 1.8791634249037052, "deviation-center-line": 0.1743252994369005}, "ep001": {"driven_any": 1.1315678087633612, "driven_lanedir": 0.6436419231648096, "in-drivable-lane": 2.5666666666666575, "deviation-heading": 1.4754289643701537, "deviation-center-line": 0.36620988303629687}, "ep002": {"driven_any": 1.3410025964316756, "driven_lanedir": 0.7275975357089262, "in-drivable-lane": 2.9999999999999893, "deviation-heading": 3.005819047707316, "deviation-center-line": 0.5058789089531943}, "ep003": {"driven_any": 1.3373065269255355, "driven_lanedir": 0.6544854441158634, "in-drivable-lane": 4.333333333333319, "deviation-heading": 0.9392687252923798, "deviation-center-line": 0.33458111728525397}, "ep004": {"driven_any": 1.089792875389571, "driven_lanedir": 0.5608454776488854, "in-drivable-lane": 3.599999999999987, "deviation-heading": 0.8441907766280857, "deviation-center-line": 0.1955180861149013}}
No reset possible
7217655Mikita Sazanovich 🇷🇺DDPGaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7215655Mikita Sazanovich 🇷🇺DDPGaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.53333333333332


other stats
episodes
details{"ep000": {"nsteps": 77, "reward": -13.250922825622869, "good_angle": 1.2139331386560182, "survival_time": 2.5666666666666673, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 196, "reward": -6.633178264515626, "good_angle": 17.60379911011849, "survival_time": 6.53333333333332, "traveled_tiles": 2, "valid_direction": 4.666666666666654}, "ep002": {"nsteps": 240, "reward": -4.816027134394972, "good_angle": 3.3301007903996416, "survival_time": 7.999999999999981, "traveled_tiles": 4, "valid_direction": 5.966666666666651}, "ep003": {"nsteps": 243, "reward": -5.2307322457884995, "good_angle": 0.9841244584997356, "survival_time": 8.099999999999982, "traveled_tiles": 3, "valid_direction": 4.299999999999986}, "ep004": {"nsteps": 192, "reward": -6.388810449042164, "good_angle": 1.5154367036429208, "survival_time": 6.399999999999987, "traveled_tiles": 2, "valid_direction": 4.7666666666666515}}
good_angle_max17.60379911011849
good_angle_mean4.929478840263361
good_angle_median1.5154367036429208
good_angle_min0.9841244584997356
reward_max-4.816027134394972
reward_mean-7.263934183872825
reward_median-6.388810449042164
reward_min-13.250922825622869
survival_time_max8.099999999999982
survival_time_mean6.319999999999988
survival_time_min2.5666666666666673
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.966666666666651
valid_direction_mean4.366666666666655
valid_direction_median4.666666666666654
valid_direction_min2.1333333333333337
No reset possible
7208655Mikita Sazanovich 🇷🇺DDPGaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7206657Aleksandar Petrov 🇨🇭ROS-based Lane Following (STest)aido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:35
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7188666Manish PrajapatTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailednorudolf-80:10:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7180678Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.277265991745407
deviation-center-line_median0.2936260994934386
in-drivable-lane_median0


other stats
deviation-center-line_max0.3691403305480279
deviation-center-line_mean0.273356271487626
deviation-center-line_min0.13598130745242462
deviation-heading_max1.7603371492658582
deviation-heading_mean0.7498470982047403
deviation-heading_median0.5811950134637281
deviation-heading_min0.24310937205908192
driven_any_max0.7857427245351707
driven_any_mean0.3800095980346498
driven_any_median0.27859073929303557
driven_any_min0.16427680300617853
driven_lanedir_max0.5424843212358612
driven_lanedir_mean0.3229705737844261
driven_lanedir_min0.14764726762286462
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7857427245351707, "driven_lanedir": 0.5424843212358612, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7603371492658582, "deviation-center-line": 0.34894908319999995}, "ep001": {"driven_any": 0.27859073929303557, "driven_lanedir": 0.277265991745407, "in-drivable-lane": 0, "deviation-heading": 0.24310937205908192, "deviation-center-line": 0.2936260994934386}, "ep002": {"driven_any": 0.16427680300617853, "driven_lanedir": 0.14764726762286462, "in-drivable-lane": 0, "deviation-heading": 0.5697573102082113, "deviation-center-line": 0.13598130745242462}, "ep003": {"driven_any": 0.41429775627852866, "driven_lanedir": 0.4049519753762154, "in-drivable-lane": 0, "deviation-heading": 0.5811950134637281, "deviation-center-line": 0.3691403305480279}, "ep004": {"driven_any": 0.25713996706033526, "driven_lanedir": 0.2425033129417824, "in-drivable-lane": 0, "deviation-heading": 0.5948366460268221, "deviation-center-line": 0.21908453674423892}}
No reset possible
7174678Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7165682Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2947164849694768
deviation-center-line_median0.3177777172601363
in-drivable-lane_median0


other stats
deviation-center-line_max2.5225122078542856
deviation-center-line_mean0.713452507582164
deviation-center-line_min0.12137529223058054
deviation-heading_max0.7780304126506045
deviation-heading_mean0.5738805979754095
deviation-heading_median0.6164308786648545
deviation-heading_min0.25308344122102144
driven_any_max1.778693955806478
driven_any_mean0.5878854761102923
driven_any_median0.29644412309687707
driven_any_min0.18570803887587417
driven_lanedir_max1.3561037699806358
driven_lanedir_mean0.493271603741094
driven_lanedir_min0.1605528432369332
in-drivable-lane_max3.9333333333333647
in-drivable-lane_mean0.786666666666673
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.778693955806478, "driven_lanedir": 1.3561037699806358, "in-drivable-lane": 3.9333333333333647, "deviation-heading": 0.658067922688946, "deviation-center-line": 2.5225122078542856}, "ep001": {"driven_any": 0.29644412309687707, "driven_lanedir": 0.2947164849694768, "in-drivable-lane": 0, "deviation-heading": 0.25308344122102144, "deviation-center-line": 0.3177777172601363}, "ep002": {"driven_any": 0.4357300422811418, "driven_lanedir": 0.4264082690608777, "in-drivable-lane": 0, "deviation-heading": 0.6164308786648545, "deviation-center-line": 0.4006920974819611}, "ep003": {"driven_any": 0.18570803887587417, "driven_lanedir": 0.1605528432369332, "in-drivable-lane": 0, "deviation-heading": 0.7780304126506045, "deviation-center-line": 0.12137529223058054}, "ep004": {"driven_any": 0.24285122049109056, "driven_lanedir": 0.2285766514575469, "in-drivable-lane": 0, "deviation-heading": 0.5637903346516211, "deviation-center-line": 0.2049052230838569}}
No reset possible
7159682Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7157682Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.833333333333333


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5939525257349014, "good_angle": 0.615478488556749, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 1.500000000000016}, "ep001": {"nsteps": 85, "reward": -12.357295900583267, "good_angle": 0.03322396223274997, "survival_time": 2.833333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 124, "reward": -8.570713878639284, "good_angle": 0.224007437589271, "survival_time": 4.133333333333328, "traveled_tiles": 2, "valid_direction": 0.36666666666666536}, "ep003": {"nsteps": 54, "reward": -18.89097767861353, "good_angle": 0.563921526478995, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0.8000000000000023}, "ep004": {"nsteps": 70, "reward": -14.751952981948852, "good_angle": 0.3286160683365631, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 0.6666666666666665}}
good_angle_max0.615478488556749
good_angle_mean0.3530494966388656
good_angle_median0.3286160683365631
good_angle_min0.03322396223274997
reward_max-0.5939525257349014
reward_mean-11.032978593103966
reward_median-12.357295900583267
reward_min-18.89097767861353
survival_time_max16.666666666666654
survival_time_mean5.55333333333333
survival_time_min1.8000000000000025
traveled_tiles_max4
traveled_tiles_mean1.8
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.500000000000016
valid_direction_mean0.6666666666666701
valid_direction_median0.6666666666666665
valid_direction_min0
No reset possible
7144682Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7138689Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.163587505423334
deviation-center-line_median0.14090614756679057
in-drivable-lane_median0


other stats
deviation-center-line_max0.361985590230278
deviation-center-line_mean0.18275758894104777
deviation-center-line_min0.0730502489089567
deviation-heading_max1.7721669502942847
deviation-heading_mean0.8405589602830114
deviation-heading_median0.6095677373580766
deviation-heading_min0.395649211909228
driven_any_max0.7857352523890606
driven_any_mean0.2950026166379576
driven_any_median0.19285406594748625
driven_any_min0.06784959615308007
driven_lanedir_max0.5485313658051105
driven_lanedir_mean0.23069338720056196
driven_lanedir_min0.0524430454333471
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7857352523890606, "driven_lanedir": 0.5485313658051105, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7721669502942847, "deviation-center-line": 0.361985590230278}, "ep001": {"driven_any": 0.06784959615308007, "driven_lanedir": 0.0524430454333471, "in-drivable-lane": 0, "deviation-heading": 0.395649211909228, "deviation-center-line": 0.0730502489089567}, "ep002": {"driven_any": 0.1785716907122184, "driven_lanedir": 0.1564801120218069, "in-drivable-lane": 0, "deviation-heading": 0.6095677373580766, "deviation-center-line": 0.14090614756679057}, "ep003": {"driven_any": 0.19285406594748625, "driven_lanedir": 0.163587505423334, "in-drivable-lane": 0, "deviation-heading": 0.8219507291376054, "deviation-center-line": 0.1232526807136534}, "ep004": {"driven_any": 0.2500024779879429, "driven_lanedir": 0.23242490731921128, "in-drivable-lane": 0, "deviation-heading": 0.6034601727158618, "deviation-center-line": 0.2145932772855602}}
No reset possible
7134689Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7132689Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8666666666666691


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -4.6725652776417315, "good_angle": 0.7619739059953089, "survival_time": 7.399999999999984, "traveled_tiles": 2, "valid_direction": 1.3666666666666618}, "ep001": {"nsteps": 21, "reward": -48.25360845384144, "good_angle": 0.38521134577333366, "survival_time": 0.7, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 52, "reward": -19.68344509372344, "good_angle": 0.5169259604290245, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.5666666666666684}, "ep003": {"nsteps": 56, "reward": -18.227136365803226, "good_angle": 0.6489835124272907, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0.7333333333333356}, "ep004": {"nsteps": 72, "reward": -14.369265000439352, "good_angle": 0.39804197168283767, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.599999999999999}}
good_angle_max0.7619739059953089
good_angle_mean0.5422273392615591
good_angle_median0.5169259604290245
good_angle_min0.38521134577333366
reward_max-4.6725652776417315
reward_mean-21.04120403828984
reward_median-18.227136365803226
reward_min-48.25360845384144
survival_time_max7.399999999999984
survival_time_mean2.819999999999998
survival_time_min0.7
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3666666666666618
valid_direction_mean0.7399999999999997
valid_direction_median0.599999999999999
valid_direction_min0.4333333333333333
No reset possible
7120689Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7113695Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.29524522277208565
deviation-center-line_median0.1848095601439613
in-drivable-lane_median0


other stats
deviation-center-line_max0.4110298391741658
deviation-center-line_mean0.22409485179398336
deviation-center-line_min0.10574469146039256
deviation-heading_max1.1341335449947438
deviation-heading_mean0.5977848748016709
deviation-heading_median0.5891914592550149
deviation-heading_min0.1393797818288173
driven_any_max1.025063760013572
driven_any_mean0.4357361667644354
driven_any_median0.29645051209047596
driven_any_min0.14285636669850438
driven_lanedir_max0.8018453280693016
driven_lanedir_mean0.3801331280542667
driven_lanedir_min0.12042650417479071
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.025063760013572, "driven_lanedir": 0.8018453280693016, "in-drivable-lane": 1.500000000000001, "deviation-heading": 1.1341335449947438, "deviation-center-line": 0.4110298391741658}, "ep001": {"driven_any": 0.29645051209047596, "driven_lanedir": 0.29524522277208565, "in-drivable-lane": 0, "deviation-heading": 0.1393797818288173, "deviation-center-line": 0.1848095601439613}, "ep002": {"driven_any": 0.14285636669850438, "driven_lanedir": 0.12042650417479071, "in-drivable-lane": 0, "deviation-heading": 0.5891914592550149, "deviation-center-line": 0.10574469146039256}, "ep003": {"driven_any": 0.482161513147997, "driven_lanedir": 0.4685692089832316, "in-drivable-lane": 0, "deviation-heading": 0.5992186839983429, "deviation-center-line": 0.2486050637996677}, "ep004": {"driven_any": 0.2321486818716274, "driven_lanedir": 0.21457937627192392, "in-drivable-lane": 0, "deviation-heading": 0.5270009039314352, "deviation-center-line": 0.1702851043917295}}
No reset possible
7112694Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.400000000000001


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.48319603606825695, "good_angle": 1.4119498186482389, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.233333333333327}, "ep001": {"nsteps": 29, "reward": -35.03180562011127, "good_angle": 0.007880591980383921, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 42, "reward": -24.295917061822756, "good_angle": 0.07999821600488236, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.16666666666666718}, "ep003": {"nsteps": 66, "reward": -15.575189439664513, "good_angle": 0.03826683887484416, "survival_time": 2.200000000000002, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 28, "reward": -36.179680433656486, "good_angle": 0.13842899248240975, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.23333333333333328}}
good_angle_max1.4119498186482389
good_angle_mean0.33530489159815186
good_angle_median0.07999821600488236
good_angle_min0.007880591980383921
reward_max-0.48319603606825695
reward_mean-22.313157718264655
reward_median-24.295917061822756
reward_min-36.179680433656486
survival_time_max16.666666666666654
survival_time_mean4.433333333333332
survival_time_min0.9333333333333332
traveled_tiles_max10
traveled_tiles_mean3.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.233333333333327
valid_direction_mean0.7266666666666655
valid_direction_median0.16666666666666718
valid_direction_min0
No reset possible
7098694Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7095697Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1666666666666687


other stats
episodes
details{"ep000": {"nsteps": 172, "reward": -6.092071584022474, "good_angle": 0.18851398635273453, "survival_time": 5.733333333333323, "traveled_tiles": 3, "valid_direction": 0}, "ep001": {"nsteps": 39, "reward": -26.21613383063903, "good_angle": 0.012542517714167254, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 65, "reward": -15.86377522303508, "good_angle": 0.192939174592615, "survival_time": 2.1666666666666687, "traveled_tiles": 2, "valid_direction": 0.3999999999999999}, "ep003": {"nsteps": 105, "reward": -9.993720197961444, "good_angle": 0.043165188415483766, "survival_time": 3.4999999999999973, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 52, "reward": -19.70059992086429, "good_angle": 0.3871663866309762, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0.6666666666666687}}
good_angle_max0.3871663866309762
good_angle_mean0.16486545074119535
good_angle_median0.18851398635273453
good_angle_min0.012542517714167254
reward_max-6.092071584022474
reward_mean-15.573260151304462
reward_median-15.86377522303508
reward_min-26.21613383063903
survival_time_max5.733333333333323
survival_time_mean2.886666666666665
survival_time_min1.3000000000000007
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.6666666666666687
valid_direction_mean0.21333333333333376
valid_direction_median0
valid_direction_min0
No reset possible
7085708Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.951199566048288
deviation-center-line_median1.0894585203856173
in-drivable-lane_median2.166666666666659


other stats
deviation-center-line_max1.1758201897522276
deviation-center-line_mean0.7441698510511787
deviation-center-line_min0.11728302102959842
deviation-heading_max2.722069331262558
deviation-heading_mean1.5935172104060755
deviation-heading_median2.2724266992306936
deviation-heading_min0.06145004089386224
driven_any_max6.35685444100951
driven_any_mean4.077004970027146
driven_any_median6.298493252647102
driven_any_min0.37766101434568056
driven_lanedir_max5.333388927436764
driven_lanedir_mean3.358545139662863
driven_lanedir_min0.3766482521395565
in-drivable-lane_max3.266666666666657
in-drivable-lane_mean1.6733333333333278
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.298493252647102, "driven_lanedir": 4.951199566048288, "in-drivable-lane": 3.266666666666657, "deviation-heading": 2.722069331262558, "deviation-center-line": 1.0894585203856173}, "ep001": {"driven_any": 0.37766101434568056, "driven_lanedir": 0.3766482521395565, "in-drivable-lane": 0, "deviation-heading": 0.06145004089386224, "deviation-center-line": 0.11728302102959842}, "ep002": {"driven_any": 6.328164883343014, "driven_lanedir": 5.333388927436764, "in-drivable-lane": 2.166666666666659, "deviation-heading": 2.612073961245019, "deviation-center-line": 1.1758201897522276}, "ep003": {"driven_any": 6.35685444100951, "driven_lanedir": 5.1247220476482855, "in-drivable-lane": 2.933333333333323, "deviation-heading": 2.2724266992306936, "deviation-center-line": 1.150690064596101}, "ep004": {"driven_any": 1.0238512587904254, "driven_lanedir": 1.006766905041418, "in-drivable-lane": 0, "deviation-heading": 0.2995660193982453, "deviation-center-line": 0.1875974594923498}}
No reset possible
7077708Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7069704Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1244940250770317
deviation-center-line_median0.1702985030340966
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.2291035934160819
deviation-center-line_mean0.15104091265992872
deviation-center-line_min0.07084844041760953
deviation-heading_max1.2760765640740437
deviation-heading_mean0.5466497354728592
deviation-heading_median0.35171107009370006
deviation-heading_min0.06092138286581164
driven_any_max2.1066666666666567
driven_any_mean1.1093333333333295
driven_any_median1.1599999999999824
driven_any_min0.3466666666666718
driven_lanedir_max2.066698089009994
driven_lanedir_mean0.9871748479623343
driven_lanedir_min0.14089729353622693
in-drivable-lane_max0.2666666666666657
in-drivable-lane_mean0.09999999999999978
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 1.1599999999999824, "driven_lanedir": 1.1244940250770317, "in-drivable-lane": 0, "deviation-heading": 0.35171107009370006, "deviation-center-line": 0.1702985030340966}, "ep003": {"driven_any": 2.1066666666666567, "driven_lanedir": 2.066698089009994, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.33465738903594666, "deviation-center-line": 0.2291035934160819}, "ep004": {"driven_any": 1.5866666666666656, "driven_lanedir": 1.2579129547459444, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.2760765640740437, "deviation-center-line": 0.1859811348549165}}
No reset possible
7068704Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7067704Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.966666666666666


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95936848815264, "good_angle": 0.4523226398291993, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 89, "reward": -11.722060765275794, "good_angle": 0.3368368393753734, "survival_time": 2.966666666666666, "traveled_tiles": 3, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 160, "reward": -6.5603199020959435, "good_angle": 0.375168348060673, "survival_time": 5.333333333333324, "traveled_tiles": 4, "valid_direction": 0.7999999999999972}, "ep004": {"nsteps": 121, "reward": -8.859963449884267, "good_angle": 7.247168345248417, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 1.399999999999995}}
good_angle_max7.247168345248417
good_angle_mean1.68312399336724
good_angle_median0.375168348060673
good_angle_min0.004123794322536422
reward_max-6.5603199020959435
reward_mean-19.874426403141097
reward_median-11.722060765275794
reward_min-36.270419410296846
survival_time_max5.333333333333324
survival_time_mean2.839999999999997
survival_time_min0.9333333333333332
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.399999999999995
valid_direction_mean0.7466666666666646
valid_direction_median0.7999999999999972
valid_direction_min0
No reset possible
7064704Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7061706Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 79, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: local variable 'action' referenced before assignment

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7054714Vadim Volodin 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22230190378393463
deviation-center-line_median0.20550193191255467
in-drivable-lane_median0


other stats
deviation-center-line_max0.3674808904741593
deviation-center-line_mean0.2368105938994547
deviation-center-line_min0.07928141370849737
deviation-heading_max1.779918725117325
deviation-heading_mean0.8340017231380548
deviation-heading_median0.6155734452060518
deviation-heading_min0.386972934534872
driven_any_max0.8000355344743159
driven_any_mean0.3500060988167584
driven_any_median0.23928834009472053
driven_any_min0.07499159645212874
driven_lanedir_max0.5563575035734103
driven_lanedir_mean0.28928375755733077
driven_lanedir_min0.06060252305097036
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8000355344743159, "driven_lanedir": 0.5563575035734103, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.779918725117325, "deviation-center-line": 0.3674808904741593}, "ep001": {"driven_any": 0.07499159645212874, "driven_lanedir": 0.06060252305097036, "in-drivable-lane": 0, "deviation-heading": 0.386972934534872, "deviation-center-line": 0.07928141370849737}, "ep002": {"driven_any": 0.18926958570458952, "driven_lanedir": 0.1735512790707323, "in-drivable-lane": 0, "deviation-heading": 0.6155734452060518, "deviation-center-line": 0.167376600942193}, "ep003": {"driven_any": 0.4464454373580374, "driven_lanedir": 0.43360557830760627, "in-drivable-lane": 0, "deviation-heading": 0.7901795431930647, "deviation-center-line": 0.3644121324598691}, "ep004": {"driven_any": 0.23928834009472053, "driven_lanedir": 0.22230190378393463, "in-drivable-lane": 0, "deviation-heading": 0.5973639676389605, "deviation-center-line": 0.20550193191255467}}
No reset possible
7048714Vadim Volodin 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7045714Vadim Volodin 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 226, "reward": -4.599070001321956, "good_angle": 0.8387713890318219, "survival_time": 7.533333333333316, "traveled_tiles": 2, "valid_direction": 1.433333333333329}, "ep001": {"nsteps": 23, "reward": -44.09404873588811, "good_angle": 0.36656121567265376, "survival_time": 0.7666666666666666, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 55, "reward": -18.679257821494883, "good_angle": 0.36009621163275546, "survival_time": 1.8333333333333357, "traveled_tiles": 2, "valid_direction": 0.8333333333333354}, "ep003": {"nsteps": 127, "reward": -8.31686728635407, "good_angle": 0.29376789929622527, "survival_time": 4.233333333333328, "traveled_tiles": 2, "valid_direction": 0.49999999999999833}, "ep004": {"nsteps": 69, "reward": -14.97304172101228, "good_angle": 0.3833871329602769, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.5999999999999996}}
good_angle_max0.8387713890318219
good_angle_mean0.44851676971874666
good_angle_median0.36656121567265376
good_angle_min0.29376789929622527
reward_max-4.599070001321956
reward_mean-18.132457113214254
reward_median-14.97304172101228
reward_min-44.09404873588811
survival_time_max7.533333333333316
survival_time_mean3.3333333333333295
survival_time_min0.7666666666666666
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.433333333333329
valid_direction_mean0.7599999999999991
valid_direction_median0.5999999999999996
valid_direction_min0.4333333333333333
No reset possible
7034714Vadim Volodin 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7018732Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.90641008028906
deviation-center-line_median1.2882019587015774
in-drivable-lane_median5.73333333333332


other stats
deviation-center-line_max2.190052040727978
deviation-center-line_mean1.5232521300890665
deviation-center-line_min1.1891376866801786
deviation-heading_max3.0601323205622717
deviation-heading_mean2.028622306699436
deviation-heading_median2.1311029620614073
deviation-heading_min0.8733778942052034
driven_any_max2.8573508070121787
driven_any_mean2.6349730139236067
driven_any_median2.5467672971119404
driven_any_min2.428745563349815
driven_lanedir_max2.7963784567630405
driven_lanedir_mean1.9132538298201909
driven_lanedir_min1.426222830170517
in-drivable-lane_max9.233333333333338
in-drivable-lane_mean5.159999999999998
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.8573508070121787, "driven_lanedir": 2.0071497498801176, "in-drivable-lane": 5.73333333333332, "deviation-heading": 1.7920169962290518, "deviation-center-line": 1.710528324519316}, "ep001": {"driven_any": 2.5467672971119404, "driven_lanedir": 1.90641008028906, "in-drivable-lane": 3.7666666666666537, "deviation-heading": 3.0601323205622717, "deviation-center-line": 1.2383406398162833}, "ep002": {"driven_any": 2.428745563349815, "driven_lanedir": 1.430108031998219, "in-drivable-lane": 7.066666666666678, "deviation-heading": 2.286481360439246, "deviation-center-line": 1.2882019587015774}, "ep003": {"driven_any": 2.509497275923924, "driven_lanedir": 1.426222830170517, "in-drivable-lane": 9.233333333333338, "deviation-heading": 0.8733778942052034, "deviation-center-line": 1.1891376866801786}, "ep004": {"driven_any": 2.8325041262201736, "driven_lanedir": 2.7963784567630405, "in-drivable-lane": 0, "deviation-heading": 2.1311029620614073, "deviation-center-line": 2.190052040727978}}
No reset possible
7004732Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7001731Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5649119922104292, "good_angle": 1.9381702406152483, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 4.033333333333319}, "ep001": {"nsteps": 500, "reward": -0.6191147002829239, "good_angle": 45.78272960885372, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 9.56666666666664}, "ep002": {"nsteps": 500, "reward": -0.8012105578642804, "good_angle": 3.3855708305790393, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 7.79999999999998}, "ep003": {"nsteps": 500, "reward": -1.1088480304984842, "good_angle": 1.409857480609967, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.799999999999995}, "ep004": {"nsteps": 500, "reward": -0.38843892331700774, "good_angle": 27.55288356620694, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 4.366666666666652}}
good_angle_max45.78272960885372
good_angle_mean16.013842345372986
good_angle_median3.3855708305790393
good_angle_min1.409857480609967
reward_max-0.38843892331700774
reward_mean-0.696504840834625
reward_median-0.6191147002829239
reward_min-1.1088480304984842
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max6
traveled_tiles_mean5.8
traveled_tiles_median6
traveled_tiles_min5
valid_direction_max9.56666666666664
valid_direction_mean5.713333333333317
valid_direction_median4.366666666666652
valid_direction_min2.799999999999995
No reset possible
6986730Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6972842Jonathan Plante 🇨🇦JP Pipelineaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:05:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-4.702521193777898e-06
deviation-center-line_median0.9848476324401684
in-drivable-lane_median0


other stats
deviation-center-line_max1.497206049567651
deviation-center-line_mean0.8077087177300241
deviation-center-line_min0
deviation-heading_max1.1259174092607342
deviation-heading_mean0.5193022642334547
deviation-heading_median0.26715626836135115
deviation-heading_min0
driven_any_max6.640000000000221
driven_any_mean6.640000000000103
driven_any_median6.640000000000101
driven_any_min6.64000000000002
driven_lanedir_max3.4910283019051747e-05
driven_lanedir_mean-1.861619920284774e-05
driven_lanedir_min-8.253189279994189e-05
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.3266666666666636
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.640000000000101, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 6.640000000000221, "driven_lanedir": -8.253189279994189e-05, "in-drivable-lane": 0, "deviation-heading": 1.1259174092607342, "deviation-center-line": 1.497206049567651}, "ep002": {"driven_any": 6.640000000000153, "driven_lanedir": -4.0756865039570656e-05, "in-drivable-lane": 0, "deviation-heading": 0.26715626836135115, "deviation-center-line": 0.9848476324401684}, "ep003": {"driven_any": 6.64000000000002, "driven_lanedir": 3.4910283019051747e-05, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374341, "deviation-center-line": 0.4607785255408404}, "ep004": {"driven_any": 6.64000000000002, "driven_lanedir": -4.702521193777898e-06, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 1.0957113811014605}}
No reset possible
6970842Jonathan Plante 🇨🇦JP Pipelineaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6967842Jonathan Plante 🇨🇦JP Pipelineaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.39035146683454514, "good_angle": 0.7326341666608083, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}, "ep001": {"nsteps": 500, "reward": -0.4549815058708191, "good_angle": 0.07621382840539564, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.26623012125492096, "good_angle": 0.004290930163812643, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.07398661226034164, "good_angle": 0.00037922062684382017, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.30775633454322815, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max0.7326341666608083
good_angle_mean0.1778949715020885
good_angle_median0.07595671165358207
good_angle_min0.00037922062684382017
reward_max-0.07398661226034164
reward_mean-0.298661208152771
reward_median-0.30775633454322815
reward_min-0.4549815058708191
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0
valid_direction_mean0
valid_direction_median0
valid_direction_min0
No reset possible
6960842Jonathan Plante 🇨🇦JP Pipelineaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6957841Yun Chen 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6953841Yun Chen 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.200000000000002


other stats
episodes
details{"ep000": {"nsteps": 161, "reward": -6.3366512591492885, "good_angle": 1.431965613446931, "survival_time": 5.366666666666657, "traveled_tiles": 2, "valid_direction": 1.6666666666666607}, "ep001": {"nsteps": 98, "reward": -10.796505676240336, "good_angle": 0.2002026267258306, "survival_time": 3.266666666666665, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 47, "reward": -21.76382921287354, "good_angle": 0.3564300186337092, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.7333333333333348}, "ep003": {"nsteps": 59, "reward": -17.30805952948029, "good_angle": 0.4764891418712454, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.8000000000000025}, "ep004": {"nsteps": 66, "reward": -15.63450666945992, "good_angle": 0.3912094516293645, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6000000000000003}}
good_angle_max1.431965613446931
good_angle_mean0.5712593704614162
good_angle_median0.3912094516293645
good_angle_min0.2002026267258306
reward_max-6.3366512591492885
reward_mean-14.367910469440677
reward_median-15.63450666945992
reward_min-21.76382921287354
survival_time_max5.366666666666657
survival_time_mean2.8733333333333326
survival_time_min1.5666666666666682
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.6666666666666607
valid_direction_mean0.8133333333333328
valid_direction_median0.7333333333333348
valid_direction_min0.2666666666666657
No reset possible
6951752Mikita Sazanovich 🇷🇺PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 104, in run
    solve(params, cis)
  File "solution.py", line 29, in solve
    from wrappers import NormalizeWrapper, ImgWrapper, ActionWrapper, ResizeWrapper
ImportError: cannot import name NormalizeWrapper


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6948753Mikita Sazanovich 🇷🇺PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 100, in run
    solve(params, cis)
  File "solution.py", line 57, in solve
    observation = env.reset()
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 335, in reset
    return self.env.reset()
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 335, in reset
    return self.env.reset()
  File "/workspace/wrappers.py", line 76, in reset
    return super(ImgStacker, self).reset()
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 308, in reset
    observation = self.env.reset(**kwargs)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 308, in reset
    observation = self.env.reset(**kwargs)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 309, in reset
    return self.observation(observation)
  File "/workspace/wrappers.py", line 35, in observation
    from skimage import color
ImportError: No module named skimage


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6934758Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:04:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7646748473290494
deviation-center-line_median0.9557616538349722
in-drivable-lane_median1.266666666666663


other stats
deviation-center-line_max1.1780090866543973
deviation-center-line_mean0.7639387483626014
deviation-center-line_min0
deviation-heading_max3.631234950233003
deviation-heading_mean2.196237080380991
deviation-heading_median3.3220706292370146
deviation-heading_min0
driven_any_max1.151548704048866
driven_any_mean0.6983747368412818
driven_any_median0.8026159247165372
driven_any_min0.29815159029736504
driven_lanedir_max1.0249721934763198
driven_lanedir_mean0.5735761033723248
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean4.260000000000008
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3634335028836993, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.29815159029736504, "driven_lanedir": 0.23542648067524352, "in-drivable-lane": 1.266666666666663, "deviation-heading": 3.631234950233003, "deviation-center-line": 0.6743732228322314}, "ep002": {"driven_any": 1.151548704048866, "driven_lanedir": 1.0249721934763198, "in-drivable-lane": 2.400000000000027, "deviation-heading": 3.3220706292370146, "deviation-center-line": 1.0115497784914065}, "ep003": {"driven_any": 0.8761239622599416, "driven_lanedir": 0.8428069953810111, "in-drivable-lane": 0, "deviation-heading": 0.6656405778094074, "deviation-center-line": 0.9557616538349722}, "ep004": {"driven_any": 0.8026159247165372, "driven_lanedir": 0.7646748473290494, "in-drivable-lane": 1.000000000000032, "deviation-heading": 3.3622392446255303, "deviation-center-line": 1.1780090866543973}}
No reset possible
6929758Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6927758Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.4924392077567754, "good_angle": 61.7491639290038, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.899999999999988}, "ep001": {"nsteps": 272, "reward": -4.584082405137665, "good_angle": 5.915891952369874, "survival_time": 9.066666666666643, "traveled_tiles": 1, "valid_direction": 4.366666666666652}, "ep002": {"nsteps": 500, "reward": -0.6976347112506628, "good_angle": 9.518064793348945, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 5.300000000000017}, "ep003": {"nsteps": 500, "reward": -0.25616112391650675, "good_angle": 0.03569247604076642, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.5721855382919312, "good_angle": 5.083397169397297, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 4.200000000000021}}
good_angle_max61.7491639290038
good_angle_mean16.460442064032136
good_angle_median5.915891952369874
good_angle_min0.03569247604076642
reward_max-0.25616112391650675
reward_mean-1.5205005972707082
reward_median-0.6976347112506628
reward_min-4.584082405137665
survival_time_max16.666666666666654
survival_time_mean15.146666666666652
survival_time_min9.066666666666643
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max15.899999999999988
valid_direction_mean5.953333333333335
valid_direction_median4.366666666666652
valid_direction_min0
No reset possible
6910758Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6898764Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6894769Benson KuanAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6886775Tim Franzmeyer 🇨🇭AMOD18-AIDO not tht random executionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.04742661482216626
deviation-center-line_median0.06706775368664313
in-drivable-lane_median0


other stats
deviation-center-line_max0.07245094460723446
deviation-center-line_mean0.05097903643968239
deviation-center-line_min0
deviation-heading_max0.6407455719619255
deviation-heading_mean0.44170466270342457
deviation-heading_median0.5496465875077392
deviation-heading_min0
driven_any_max1.6597045453740809
driven_any_mean0.3972626140734745
driven_any_median0.07665302117189599
driven_any_min0.05665658086618131
driven_lanedir_max0.05064672641817136
driven_lanedir_mean0.037617725773334554
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.4199999999999973
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.6597045453740809, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.05665658086618131, "driven_lanedir": 0.041536281827109445, "in-drivable-lane": 0, "deviation-heading": 0.41316327485171694, "deviation-center-line": 0.06706775368664313}, "ep002": {"driven_any": 0.07665302117189599, "driven_lanedir": 0.048479005799225705, "in-drivable-lane": 0, "deviation-heading": 0.6407455719619255, "deviation-center-line": 0.07245094460723446}, "ep003": {"driven_any": 0.1199786418342722, "driven_lanedir": 0.04742661482216626, "in-drivable-lane": 0.46666666666666734, "deviation-heading": 0.6049678791957415, "deviation-center-line": 0.044265128307991175}, "ep004": {"driven_any": 0.07332028112094219, "driven_lanedir": 0.05064672641817136, "in-drivable-lane": 0, "deviation-heading": 0.5496465875077392, "deviation-center-line": 0.0711113555965432}}
No reset possible
6884774Gianmarco BernasconiNot Random executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.533333333333314


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.902897448143392, "good_angle": 1.2029815125693242, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 68, "reward": -15.270550788325425, "good_angle": 0.014336397158337283, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 256, "reward": -4.130121304151089, "good_angle": 1.047966790106173, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.9999999999999936}, "ep003": {"nsteps": 454, "reward": -2.448813609781702, "good_angle": 1.0083838917367975, "survival_time": 15.13333333333329, "traveled_tiles": 4, "valid_direction": 2.033333333333326}, "ep004": {"nsteps": 343, "reward": -3.5418006023808273, "good_angle": 19.25072275759261, "survival_time": 11.433333333333303, "traveled_tiles": 3, "valid_direction": 3.899999999999987}}
good_angle_max19.25072275759261
good_angle_mean4.504878269832648
good_angle_median1.047966790106173
good_angle_min0.014336397158337283
reward_max-2.448813609781702
reward_mean-7.658836750556486
reward_median-4.130121304151089
reward_min-15.270550788325425
survival_time_max15.13333333333329
survival_time_mean7.999999999999981
survival_time_min2.2666666666666684
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.899999999999987
valid_direction_mean2.033333333333328
valid_direction_median2.033333333333326
valid_direction_min0
No reset possible
6873774Gianmarco BernasconiNot Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6866776Alessandro MorraAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6861777Yannick BerdouAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6856779Aleksandar Petrov 🇨🇭Random executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6852779Aleksandar Petrov 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.466666666666647


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -12.449639258520088, "good_angle": 1.1801589697548391, "survival_time": 2.7333333333333334, "traveled_tiles": 1, "valid_direction": 2.333333333333333}, "ep001": {"nsteps": 230, "reward": -5.431815045748068, "good_angle": 15.897949064453114, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 3.966666666666653}, "ep002": {"nsteps": 254, "reward": -4.500410245276812, "good_angle": 0.906719874535348, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 1.9999999999999936}, "ep003": {"nsteps": 455, "reward": -2.223380082617207, "good_angle": 1.240048771639816, "survival_time": 15.166666666666623, "traveled_tiles": 4, "valid_direction": 2.199999999999992}, "ep004": {"nsteps": 345, "reward": -3.555371841572333, "good_angle": 17.960079314431788, "survival_time": 11.49999999999997, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}
good_angle_max17.960079314431788
good_angle_mean7.436991198962981
good_angle_median1.240048771639816
good_angle_min0.906719874535348
reward_max-2.223380082617207
reward_mean-5.6321232947469015
reward_median-4.500410245276812
reward_min-12.449639258520088
survival_time_max15.166666666666623
survival_time_mean9.106666666666644
survival_time_min2.7333333333333334
traveled_tiles_max4
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.966666666666653
valid_direction_mean2.8866666666666583
valid_direction_median2.333333333333333
valid_direction_min1.9999999999999936
No reset possible
6846778Alessandro MorraAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6836782Zijian Dong 🇨🇳AMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1320263254134415
deviation-center-line_median0.5435899606876103
in-drivable-lane_median0.13333333333333286


other stats
deviation-center-line_max0.6684930283589156
deviation-center-line_mean0.46166423309748505
deviation-center-line_min0.2129976357969407
deviation-heading_max2.2135601097875965
deviation-heading_mean1.1579308374414947
deviation-heading_median0.8928348186696404
deviation-heading_min0.18952494100093853
driven_any_max1.5962191928055611
driven_any_mean0.9702732023870344
driven_any_median1.1774296840426126
driven_any_min0.31517863326502804
driven_lanedir_max1.3927196412522496
driven_lanedir_mean0.8487062130610361
driven_lanedir_min0.1567597263544035
in-drivable-lane_max1.566666666666661
in-drivable-lane_mean0.4599999999999988
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3678682146705705, "driven_lanedir": 0.1567597263544035, "in-drivable-lane": 0.6, "deviation-heading": 2.041005044359979, "deviation-center-line": 0.2129976357969407}, "ep001": {"driven_any": 0.31517863326502804, "driven_lanedir": 0.31403659328951283, "in-drivable-lane": 0, "deviation-heading": 0.18952494100093853, "deviation-center-line": 0.24980657776692025}, "ep002": {"driven_any": 1.1774296840426126, "driven_lanedir": 1.1320263254134415, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 0.8928348186696404, "deviation-center-line": 0.6334339628770389}, "ep003": {"driven_any": 1.3946702871514, "driven_lanedir": 1.3927196412522496, "in-drivable-lane": 0, "deviation-heading": 0.45272927338931857, "deviation-center-line": 0.6684930283589156}, "ep004": {"driven_any": 1.5962191928055611, "driven_lanedir": 1.2479887789955737, "in-drivable-lane": 1.566666666666661, "deviation-heading": 2.2135601097875965, "deviation-center-line": 0.5435899606876103}}
No reset possible
6834782Zijian Dong 🇨🇳AMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6823789Mikita Sazanovich 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.32048056811515613
deviation-center-line_median0.3534125102093246
in-drivable-lane_median0


other stats
deviation-center-line_max2.3802408587162636
deviation-center-line_mean0.68865238519746
deviation-center-line_min0.12426824950721906
deviation-heading_max0.7700941015094857
deviation-heading_mean0.610477739311196
deviation-heading_median0.59840480241335
deviation-heading_min0.48024412490612367
driven_any_max1.7786931942164834
driven_any_mean0.5928831073542515
driven_any_median0.3285771157502649
driven_any_min0.1928440575586332
driven_lanedir_max1.271067938801898
driven_lanedir_mean0.4798203918120793
driven_lanedir_min0.1685424408795564
in-drivable-lane_max4.733333333333362
in-drivable-lane_mean0.9466666666666724
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.7786931942164834, "driven_lanedir": 1.271067938801898, "in-drivable-lane": 4.733333333333362, "deviation-heading": 0.6179807679673132, "deviation-center-line": 2.3802408587162636}, "ep001": {"driven_any": 0.3285771157502649, "driven_lanedir": 0.32048056811515613, "in-drivable-lane": 0, "deviation-heading": 0.48024412490612367, "deviation-center-line": 0.3534125102093246}, "ep002": {"driven_any": 0.4107355344143305, "driven_lanedir": 0.400400049282593, "in-drivable-lane": 0, "deviation-heading": 0.59840480241335, "deviation-center-line": 0.369533668170854}, "ep003": {"driven_any": 0.1928440575586332, "driven_lanedir": 0.1685424408795564, "in-drivable-lane": 0, "deviation-heading": 0.7700941015094857, "deviation-center-line": 0.12426824950721906}, "ep004": {"driven_any": 0.2535656348315458, "driven_lanedir": 0.23861096198119292, "in-drivable-lane": 0, "deviation-heading": 0.5856648997597077, "deviation-center-line": 0.21580663938363848}}
No reset possible
6816789Mikita Sazanovich 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6807789Mikita Sazanovich 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.133333333333332


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6231444718837738, "good_angle": 0.6172578962674334, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 1.3000000000000205}, "ep001": {"nsteps": 94, "reward": -11.242963763310554, "good_angle": 0.20890580932142916, "survival_time": 3.133333333333332, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 117, "reward": -9.041428529553944, "good_angle": 0.24571313538673015, "survival_time": 3.899999999999996, "traveled_tiles": 2, "valid_direction": 0.36666666666666536}, "ep003": {"nsteps": 56, "reward": -18.22078833542764, "good_angle": 0.5492659417296902, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0.9666666666666692}, "ep004": {"nsteps": 73, "reward": -14.170171234705675, "good_angle": 0.34157015531634766, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 0.6999999999999991}}
good_angle_max0.6172578962674334
good_angle_mean0.39254258760432614
good_angle_median0.34157015531634766
good_angle_min0.20890580932142916
reward_max-0.6231444718837738
reward_mean-10.659699266976318
reward_median-11.242963763310554
reward_min-18.22078833542764
survival_time_max16.666666666666654
survival_time_mean5.599999999999997
survival_time_min1.8666666666666691
traveled_tiles_max4
traveled_tiles_mean1.8
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.3000000000000205
valid_direction_mean0.7266666666666705
valid_direction_median0.6999999999999991
valid_direction_min0.29999999999999893
No reset possible
6798797Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-80:04:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 118, in run
    solve(params, cis)
  File "solution.py", line 83, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 86, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6792812Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1083133999257062
deviation-center-line_median0.26193177690187186
in-drivable-lane_median6.566666666666663


other stats
deviation-center-line_max1.459563558232137
deviation-center-line_mean0.477031735520102
deviation-center-line_min0.00689353744255581
deviation-heading_max7.3529798435663425
deviation-heading_mean3.30482660895136
deviation-heading_median2.481734038738831
deviation-heading_min0.07844071682584033
driven_any_max22.991451579322693
driven_any_mean13.323045616860176
driven_any_median21.013749597224955
driven_any_min0.41387808387579816
driven_lanedir_max1.449453095242103
driven_lanedir_mean0.5461968394991965
driven_lanedir_min0.0236675100560082
in-drivable-lane_max12.999999999999975
in-drivable-lane_mean5.753333333333324
in-drivable-lane_min0.5666666666666667
per-episodes
details{"ep000": {"driven_any": 22.991451579322693, "driven_lanedir": 1.055645172238337, "in-drivable-lane": 12.999999999999975, "deviation-heading": 2.481734038738831, "deviation-center-line": 0.26193177690187186}, "ep001": {"driven_any": 1.1634291533411067, "driven_lanedir": 0.1083133999257062, "in-drivable-lane": 0.6333333333333335, "deviation-heading": 0.3473745052130815, "deviation-center-line": 0.03912260355067344}, "ep002": {"driven_any": 21.03271967053632, "driven_lanedir": 1.449453095242103, "in-drivable-lane": 7.999999999999984, "deviation-heading": 6.263603940412701, "deviation-center-line": 0.6176472014732722}, "ep003": {"driven_any": 21.013749597224955, "driven_lanedir": 0.09390502003382784, "in-drivable-lane": 6.566666666666663, "deviation-heading": 7.3529798435663425, "deviation-center-line": 1.459563558232137}, "ep004": {"driven_any": 0.41387808387579816, "driven_lanedir": 0.0236675100560082, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0.07844071682584033, "deviation-center-line": 0.00689353744255581}}
No reset possible
6786812Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6770814Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:03:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5465134182652658
deviation-center-line_median0.0859301561289945
in-drivable-lane_median0


other stats
deviation-center-line_max0.45683733267295895
deviation-center-line_mean0.14490681590908122
deviation-center-line_min0.035972954900497976
deviation-heading_max1.2995870652674055
deviation-heading_mean0.4406796488322215
deviation-heading_median0.1829795955184807
deviation-heading_min0.13456287375748183
driven_any_max2.585747047174866
driven_any_mean0.8657814231025907
driven_any_median0.5569598722488184
driven_any_min0.1850438401127921
driven_lanedir_max2.397505503830412
driven_lanedir_mean0.7846748762569636
driven_lanedir_min0.1738731453033644
in-drivable-lane_max0.2
in-drivable-lane_mean0.04666666666666665
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7669972896515003, "driven_lanedir": 0.5832165228849819, "in-drivable-lane": 0.2, "deviation-heading": 0.4401823867416389, "deviation-center-line": 0.0859301561289945}, "ep001": {"driven_any": 0.5569598722488184, "driven_lanedir": 0.5465134182652658, "in-drivable-lane": 0, "deviation-heading": 0.1829795955184807, "deviation-center-line": 0.0972394037307188}, "ep002": {"driven_any": 2.585747047174866, "driven_lanedir": 2.397505503830412, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.2995870652674055, "deviation-center-line": 0.45683733267295895}, "ep003": {"driven_any": 0.2341590663249764, "driven_lanedir": 0.22226579100079435, "in-drivable-lane": 0, "deviation-heading": 0.1460863228761008, "deviation-center-line": 0.04855423211223576}, "ep004": {"driven_any": 0.1850438401127921, "driven_lanedir": 0.1738731453033644, "in-drivable-lane": 0, "deviation-heading": 0.13456287375748183, "deviation-center-line": 0.035972954900497976}}
No reset possible
6761816Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-80:04:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 82, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 79, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6744828Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-80:13:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6738835Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationerrornorudolf-80:00:30
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6636727Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutnorudolf-80:31:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6576782Zijian Dong 🇨🇳AMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.466666666666647


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -12.5966731637952, "good_angle": 1.2152941427437298, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2666666666666666}, "ep001": {"nsteps": 69, "reward": -15.063088524168815, "good_angle": 0.016746099589234648, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 254, "reward": -4.552803257729594, "good_angle": 0.9315985697171436, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 2.16666666666666}, "ep003": {"nsteps": 301, "reward": -3.634558620964768, "good_angle": 0.02827126357697655, "survival_time": 10.033333333333308, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 342, "reward": -3.5994072107718007, "good_angle": 17.866107146621943, "survival_time": 11.39999999999997, "traveled_tiles": 3, "valid_direction": 3.899999999999987}}
good_angle_max17.866107146621943
good_angle_mean4.011603444449806
good_angle_median0.9315985697171436
good_angle_min0.016746099589234648
reward_max-3.5994072107718007
reward_mean-7.889306155486035
reward_median-4.552803257729594
reward_min-15.063088524168815
survival_time_max11.39999999999997
survival_time_mean6.979999999999985
survival_time_min2.3000000000000016
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.899999999999987
valid_direction_mean1.666666666666663
valid_direction_median2.16666666666666
valid_direction_min0
No reset possible
6558811Samuel LavoieBaby Dukeaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 111, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    model.load("DDPG_2_2", "pytorch_models")
  File "/workspace/ddpg.py", line 199, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 303, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 469, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 437, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 323, in restore_location
    result = map_location(storage, location)
TypeError: 'torch.Device' object is not callable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 111, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    model.load("DDPG_2_2", "pytorch_models")
  File "/workspace/ddpg.py", line 199, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 303, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 469, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 437, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 323, in restore_location
    result = map_location(storage, location)
TypeError: 'torch.Device' object is not callable


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6501662Aleksandar Petrov 🇨🇭Tuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailednorudolf-80:10:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6466696Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6433810Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesrudolf-80:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.36692091393036463
deviation-center-line_median0.0649119283377492
in-drivable-lane_median0


other stats
deviation-center-line_max0.7341733449824113
deviation-center-line_mean0.18737903067000736
deviation-center-line_min0.03406978725000513
deviation-heading_max1.54061311382172
deviation-heading_mean0.44784239242094454
deviation-heading_median0.15110388537303357
deviation-heading_min0.11263752735013902
driven_any_max3.473110112883701
driven_any_mean1.021684692721441
driven_any_median0.3748156971032066
driven_any_min0.1842386905479108
driven_lanedir_max3.267789026209879
driven_lanedir_mean0.9286958189781548
driven_lanedir_min0.17210484799610382
in-drivable-lane_max0.3333333333333333
in-drivable-lane_mean0.06666666666666667
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8268182538109046, "driven_lanedir": 0.596740864282904, "in-drivable-lane": 0.3333333333333333, "deviation-heading": 0.3063456527801521, "deviation-center-line": 0.06653453790687869}, "ep001": {"driven_any": 0.1842386905479108, "driven_lanedir": 0.17210484799610382, "in-drivable-lane": 0, "deviation-heading": 0.15110388537303357, "deviation-center-line": 0.03720555487299269}, "ep002": {"driven_any": 0.2494407092614805, "driven_lanedir": 0.23992344247152175, "in-drivable-lane": 0, "deviation-heading": 0.11263752735013902, "deviation-center-line": 0.03406978725000513}, "ep003": {"driven_any": 3.473110112883701, "driven_lanedir": 3.267789026209879, "in-drivable-lane": 0, "deviation-heading": 1.54061311382172, "deviation-center-line": 0.7341733449824113}, "ep004": {"driven_any": 0.3748156971032066, "driven_lanedir": 0.36692091393036463, "in-drivable-lane": 0, "deviation-heading": 0.1285117827796779, "deviation-center-line": 0.0649119283377492}}
No reset possible
6333789Mikita Sazanovich 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6327798Luca BonaminiRandom executionaido1_LF1_r3-v3step4-vizsuccessnorudolf-80:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9654873254053034
deviation-center-line_median0.41289189532906545
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max0.6135569189582012
deviation-center-line_mean0.4056492664483418
deviation-center-line_min0.2061794883302597
deviation-heading_max2.90974275700166
deviation-heading_mean1.315832326018135
deviation-heading_median0.9626486735309404
deviation-heading_min0.16870163130240173
driven_any_max1.596777574949506
driven_any_mean0.9233582566609092
driven_any_median0.9686290551073296
driven_any_min0.35859851566372447
driven_lanedir_max1.260193031629722
driven_lanedir_mean0.8021399053746914
driven_lanedir_min0.13956835691080005
in-drivable-lane_max1.0666666666666629
in-drivable-lane_mean0.3533333333333325
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.35859851566372447, "driven_lanedir": 0.13956835691080005, "in-drivable-lane": 0.6, "deviation-heading": 2.077502532796642, "deviation-center-line": 0.2061794883302597}, "ep001": {"driven_any": 0.5134500013124798, "driven_lanedir": 0.5127504927612125, "in-drivable-lane": 0, "deviation-heading": 0.16870163130240173, "deviation-center-line": 0.41289189532906545}, "ep002": {"driven_any": 1.1793361362715051, "driven_lanedir": 1.1327003201664188, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 0.9626486735309404, "deviation-center-line": 0.6135569189582012}, "ep003": {"driven_any": 0.9686290551073296, "driven_lanedir": 0.9654873254053034, "in-drivable-lane": 0, "deviation-heading": 0.4605660354590315, "deviation-center-line": 0.4281874376946226}, "ep004": {"driven_any": 1.596777574949506, "driven_lanedir": 1.260193031629722, "in-drivable-lane": 1.0666666666666629, "deviation-heading": 2.90974275700166, "deviation-center-line": 0.36743059192956007}}
No reset possible
6299804Philippe LacailleDolores' awakeningaido1_LF1_r3-v3step1-simulationfailednorudolf-80:10:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6295808Samuel LavoiePyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessnorudolf-80:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3546989266093319
deviation-center-line_median0.20188571192329355
in-drivable-lane_median1.233333333333335


other stats
deviation-center-line_max1.5497200794964847
deviation-center-line_mean0.4747745886807187
deviation-center-line_min0.12447731241740112
deviation-heading_max10.329820642720891
deviation-heading_mean3.1313935765108387
deviation-heading_median1.3382899722010269
deviation-heading_min0.9026629964820808
driven_any_max4.781693860650664
driven_any_mean1.6657062253945971
driven_any_median0.9415109517437912
driven_any_min0.6591562110643138
driven_lanedir_max3.0302019354858167
driven_lanedir_mean0.8796670959713101
driven_lanedir_min0.17639297691232247
in-drivable-lane_max2.5999999999999943
in-drivable-lane_mean1.399999999999998
in-drivable-lane_min0.46666666666666545
per-episodes
details{"ep000": {"driven_any": 1.1884608126079723, "driven_lanedir": 0.27240047128387024, "in-drivable-lane": 2.5999999999999943, "deviation-heading": 1.3382899722010269, "deviation-center-line": 0.20188571192329355}, "ep001": {"driven_any": 0.6591562110643138, "driven_lanedir": 0.17639297691232247, "in-drivable-lane": 1.233333333333335, "deviation-heading": 0.9026629964820808, "deviation-center-line": 0.12447731241740112}, "ep002": {"driven_any": 0.9415109517437912, "driven_lanedir": 0.564641169565208, "in-drivable-lane": 0.46666666666666545, "deviation-heading": 1.9492760345985696, "deviation-center-line": 0.3051571377529765}, "ep003": {"driven_any": 4.781693860650664, "driven_lanedir": 3.0302019354858167, "in-drivable-lane": 1.7666666666666608, "deviation-heading": 10.329820642720891, "deviation-center-line": 1.5497200794964847}, "ep004": {"driven_any": 0.7577092909062455, "driven_lanedir": 0.3546989266093319, "in-drivable-lane": 0.9333333333333336, "deviation-heading": 1.1369182365516248, "deviation-center-line": 0.1926327018134379}}
No reset possible
6292808Samuel LavoiePyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6285813Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesrudolf-80:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6283813Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesrudolf-80:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.2999999999999945


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.005366155053489, "good_angle": 37.02934483153639, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.96666666666665}, "ep001": {"nsteps": 30, "reward": -34.761982696255046, "good_angle": 0.8948257653217995, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.7333333333333332}, "ep002": {"nsteps": 500, "reward": -0.8437798766004853, "good_angle": 13.99850092891147, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.099999999999987}, "ep003": {"nsteps": 129, "reward": -8.728219291439835, "good_angle": 3.5973777153580553, "survival_time": 4.2999999999999945, "traveled_tiles": 1, "valid_direction": 3.1333333333333293}, "ep004": {"nsteps": 31, "reward": -33.94724298388727, "good_angle": 0.7002393496770367, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0.5666666666666665}}
good_angle_max37.02934483153639
good_angle_mean11.24405771816095
good_angle_median3.5973777153580553
good_angle_min0.7002393496770367
reward_max-0.8437798766004853
reward_mean-15.857318200647224
reward_median-8.728219291439835
reward_min-34.761982696255046
survival_time_max16.666666666666654
survival_time_mean7.933333333333327
survival_time_min1
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.96666666666665
valid_direction_mean6.299999999999994
valid_direction_median3.1333333333333293
valid_direction_min0.5666666666666665
No reset possible
6268813Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6207826Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationtimeoutnorudolf-80:34:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6191827Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationtimeoutnorudolf-80:53:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6176834Samuel LavoieYoung Dukeaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6164836Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationabortednorudolf-80:00:30
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6155839Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6122834Samuel LavoieYoung Dukeaido1_LF1_r3-v3step2-scoringsuccessnorudolf-80:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.733333333333302


other stats
episodes
details{"ep000": {"nsteps": 168, "reward": -7.934439358700599, "good_angle": 19.888117786020445, "survival_time": 5.59999999999999, "traveled_tiles": 6, "valid_direction": 3.099999999999997}, "ep001": {"nsteps": 242, "reward": -5.63131987395858, "good_angle": 18.727965412663018, "survival_time": 8.066666666666649, "traveled_tiles": 7, "valid_direction": 3.4666666666666552}, "ep002": {"nsteps": 500, "reward": -0.5593890390801244, "good_angle": 2.5609619856563275, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.9666666666666455}, "ep003": {"nsteps": 352, "reward": -5.00258318618448, "good_angle": 36.28035911926448, "survival_time": 11.733333333333302, "traveled_tiles": 10, "valid_direction": 4.966666666666652}, "ep004": {"nsteps": 500, "reward": -0.8166006759773009, "good_angle": 2.5717428190104616, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.5333333333333155}}
good_angle_max36.28035911926448
good_angle_mean16.005829424522947
good_angle_median18.727965412663018
good_angle_min2.5609619856563275
reward_max-0.5593890390801244
reward_mean-3.988866426780217
reward_median-5.00258318618448
reward_min-7.934439358700599
survival_time_max16.666666666666654
survival_time_mean11.74666666666665
survival_time_min5.59999999999999
traveled_tiles_max13
traveled_tiles_mean9.8
traveled_tiles_median10
traveled_tiles_min6
valid_direction_max5.9666666666666455
valid_direction_mean4.606666666666653
valid_direction_median4.966666666666652
valid_direction_min3.099999999999997
No reset possible
6118833Orlando Marquez 🇨🇦Baseline solution using imitation learning from logsaido1_LF1_r3-v3step4-vizabortednorudolf-80:00:12
Error while running [...]

Creating job6118-4475_videos_1 ... error
stderr | ERROR: for job6118-4475_videos_1  Cannot start service videos: network job6118-4475_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job6118-4475_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6115833Orlando Marquez 🇨🇦Baseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessnorudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.833333333333306


other stats
episodes
details{"ep000": {"nsteps": 204, "reward": -6.806972599789208, "good_angle": 29.295953235105024, "survival_time": 6.799999999999986, "traveled_tiles": 2, "valid_direction": 4.699999999999983}, "ep001": {"nsteps": 454, "reward": -2.9128666053590724, "good_angle": 26.583267419570053, "survival_time": 15.13333333333329, "traveled_tiles": 3, "valid_direction": 4.7333333333333165}, "ep002": {"nsteps": 435, "reward": -2.3686694582060497, "good_angle": 0.13028082235550945, "survival_time": 14.49999999999996, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 310, "reward": -5.502394236672309, "good_angle": 31.415372396718254, "survival_time": 10.333333333333307, "traveled_tiles": 3, "valid_direction": 4.699999999999984}, "ep004": {"nsteps": 325, "reward": -4.9345840130345175, "good_angle": 5.88129958380946, "survival_time": 10.833333333333306, "traveled_tiles": 3, "valid_direction": 3.566666666666655}}
good_angle_max31.415372396718254
good_angle_mean18.661234691511662
good_angle_median26.583267419570053
good_angle_min0.13028082235550945
reward_max-2.3686694582060497
reward_mean-4.505097382612231
reward_median-4.9345840130345175
reward_min-6.806972599789208
survival_time_max15.13333333333329
survival_time_mean11.519999999999971
survival_time_min6.799999999999986
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.7333333333333165
valid_direction_mean3.5399999999999876
valid_direction_median4.699999999999983
valid_direction_min0
No reset possible
6105828Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step3-videossuccessnorudolf-80:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6098827Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-80:10:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6090825Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednorudolf-80:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 64, in solve
    model = Model(config_name=config_name, config=config)
  File "/workspace/model.py", line 15, in __init__
    self.init_model(config_name)
  File "/workspace/model.py", line 45, in init_model
    map_location=self.device))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 719, in load_state_dict
    self.__class__.__name__, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for NoisyDQN:
	size mismatch for cnn.conv1.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv1.weight: copying a param of torch.Size([256, 3, 7, 7]) from checkpoint, where the shape is torch.Size([64, 3, 7, 7]) in current model.
	size mismatch for cnn.bn1.running_var: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn1.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn1.weight: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn1.running_mean: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv2.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv2.weight: copying a param of torch.Size([256, 256, 5, 5]) from checkpoint, where the shape is torch.Size([64, 64, 5, 5]) in current model.
	size mismatch for cnn.bn2.running_var: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn2.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn2.weight: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn2.running_mean: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv3.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv3.weight: copying a param of torch.Size([256, 256, 3, 3]) from checkpoint, where the shape is torch.Size([64, 64, 3, 3]) in current model.
	size mismatch for cnn.bn3.running_var: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn3.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn3.weight: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn3.running_mean: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv4.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.conv4.weight: copying a param of torch.Size([256, 256, 3, 3]) from checkpoint, where the shape is torch.Size([64, 64, 3, 3]) in current model.
	size mismatch for cnn.bn4.running_var: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn4.bias: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn4.weight: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for cnn.bn4.running_mean: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for noisy2.weight_epsilon: copying a param of torch.Size([5, 256]) from checkpoint, where the shape is torch.Size([5, 64]) in current model.
	size mismatch for noisy2.weight_mu: copying a param of torch.Size([5, 256]) from checkpoint, where the shape is torch.Size([5, 64]) in current model.
	size mismatch for noisy2.weight_sigma: copying a param of torch.Size([5, 256]) from checkpoint, where the shape is torch.Size([5, 64]) in current model.
	size mismatch for noisy1.bias_sigma: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for noisy1.weight_epsilon: copying a param of torch.Size([256, 1024]) from checkpoint, where the shape is torch.Size([64, 256]) in current model.
	size mismatch for noisy1.weight_mu: copying a param of torch.Size([256, 1024]) from checkpoint, where the shape is torch.Size([64, 256]) in current model.
	size mismatch for noisy1.weight_sigma: copying a param of torch.Size([256, 1024]) from checkpoint, where the shape is torch.Size([64, 256]) in current model.
	size mismatch for noisy1.bias_mu: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.
	size mismatch for noisy1.bias_epsilon: copying a param of torch.Size([256]) from checkpoint, where the shape is torch.Size([64]) in current model.


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6045814Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessnorudolf-80:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.500000000000001


other stats
episodes
details{"ep000": {"nsteps": 59, "reward": -17.3284034263974, "good_angle": 3.0737480837633178, "survival_time": 1.9666666666666697, "traveled_tiles": 4, "valid_direction": 0.7666666666666677}, "ep001": {"nsteps": 90, "reward": -11.618200076454215, "good_angle": 3.601381792334771, "survival_time": 2.999999999999999, "traveled_tiles": 4, "valid_direction": 0.899999999999998}, "ep002": {"nsteps": 201, "reward": -5.61147553448227, "good_angle": 1.2199074165390482, "survival_time": 6.699999999999986, "traveled_tiles": 10, "valid_direction": 1.8333333333333277}, "ep003": {"nsteps": 75, "reward": -13.68042570564275, "good_angle": 4.766612093285456, "survival_time": 2.500000000000001, "traveled_tiles": 4, "valid_direction": 1.4000000000000006}, "ep004": {"nsteps": 16, "reward": -65.13710789382458, "good_angle": 0.1634371398540916, "survival_time": 0.5333333333333333, "traveled_tiles": 2, "valid_direction": 0.3333333333333333}}
good_angle_max4.766612093285456
good_angle_mean2.5650173051553367
good_angle_median3.0737480837633178
good_angle_min0.1634371398540916
reward_max-5.61147553448227
reward_mean-22.67512252736024
reward_median-13.68042570564275
reward_min-65.13710789382458
survival_time_max6.699999999999986
survival_time_mean2.9399999999999973
survival_time_min0.5333333333333333
traveled_tiles_max10
traveled_tiles_mean4.8
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max1.8333333333333277
valid_direction_mean1.0466666666666653
valid_direction_median0.899999999999998
valid_direction_min0.3333333333333333
No reset possible
6039813Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnorudolf-80:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6033813Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessnorudolf-80:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6029813Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessnorudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7321486445544287, "good_angle": 13.419330769993566, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.56666666666666}, "ep001": {"nsteps": 500, "reward": -0.7594260105721187, "good_angle": 16.014807149894818, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.16666666666666}, "ep002": {"nsteps": 500, "reward": -0.7870801762229385, "good_angle": 27.78893153241301, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.16666666666666}, "ep003": {"nsteps": 500, "reward": -0.7491207067267969, "good_angle": 13.452202517743508, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.09999999999999}, "ep004": {"nsteps": 33, "reward": -31.544355885549024, "good_angle": 0.8918487962219264, "survival_time": 1.1, "traveled_tiles": 1, "valid_direction": 0.7999999999999999}}
good_angle_max27.78893153241301
good_angle_mean14.31342415325336
good_angle_median13.452202517743508
good_angle_min0.8918487962219264
reward_max-0.7321486445544287
reward_mean-6.914426284725062
reward_median-0.7594260105721187
reward_min-31.544355885549024
survival_time_max16.666666666666654
survival_time_mean13.553333333333322
survival_time_min1.1
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max13.16666666666666
valid_direction_mean10.559999999999992
valid_direction_median13.09999999999999
valid_direction_min0.7999999999999999
No reset possible
6024812Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnorudolf-80:06:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6014811Samuel LavoieBaby Dukeaido1_LF1_r3-v3step1-simulationfailednorudolf-80:02:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 111, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    model.load("DDPG_2_2", "pytorch_models")
  File "/workspace/ddpg.py", line 199, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 303, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 469, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 437, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 323, in restore_location
    result = map_location(storage, location)
TypeError: 'torch.Device' object is not callable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 111, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    model.load("DDPG_2_2", "pytorch_models")
  File "/workspace/ddpg.py", line 199, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 303, in load
    return _load(f, map_location, pickle_module)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 469, in _load
    result = unpickler.load()
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 437, in persistent_load
    data_type(size), location)
  File "/opt/conda/lib/python3.6/site-packages/torch/serialization.py", line 323, in restore_location
    result = map_location(storage, location)
TypeError: 'torch.Device' object is not callable


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6009809Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessnorudolf-80:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5996808Samuel LavoiePyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessnorudolf-80:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.333333333333334


other stats
episodes
details{"ep000": {"nsteps": 38, "reward": -27.280840622163133, "good_angle": 1.2501197740227632, "survival_time": 1.2666666666666673, "traveled_tiles": 1, "valid_direction": 1.2000000000000004}, "ep001": {"nsteps": 73, "reward": -14.54535922928624, "good_angle": 1.060600005705412, "survival_time": 2.4333333333333345, "traveled_tiles": 2, "valid_direction": 1.1000000000000003}, "ep002": {"nsteps": 84, "reward": -13.463767963949412, "good_angle": 9.201288750239987, "survival_time": 2.8, "traveled_tiles": 2, "valid_direction": 2.733333333333333}, "ep003": {"nsteps": 40, "reward": -26.599520973861217, "good_angle": 0.9470534157369186, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0.8000000000000008}, "ep004": {"nsteps": 23, "reward": -45.96886561227881, "good_angle": 0.3545064930469495, "survival_time": 0.7666666666666666, "traveled_tiles": 2, "valid_direction": 0.4666666666666666}}
good_angle_max9.201288750239987
good_angle_mean2.5627136877504064
good_angle_median1.060600005705412
good_angle_min0.3545064930469495
reward_max-13.463767963949412
reward_mean-25.571670880307767
reward_median-26.599520973861217
reward_min-45.96886561227881
survival_time_max2.8
survival_time_mean1.7200000000000002
survival_time_min0.7666666666666666
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.733333333333333
valid_direction_mean1.2600000000000002
valid_direction_median1.1000000000000003
valid_direction_min0.4666666666666666
No reset possible
5992807Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessnorudolf-80:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5983806Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessnorudolf-80:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5974805Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortednorudolf-80:02:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 118, in run
    solve(params, cis)
  File "solution.py", line 83, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 89, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible