AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 322

evaluator322
ownerAndrea Censi
machineidsc-rudolf
processrudolf-7
versionDC:3.1.56;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success466
# timeout4
# failed59
# error12
# aborted35
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
10654179Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3220:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10608281heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno3220:10:36
Timeout: Waited 602 [...]
Timeout:

Waited 602.217674017 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10606286heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3220:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job10606-6012', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job10606-6012', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job10606-6012_evaluation" with the default driver
stderr | Creating job10606-6012_evaluator_1 ...
stderr | Creating job10606-6012_solution_1  ...
stderr | 
Creating job10606-6012_evaluator_1 ... error

stderr | ERROR: for job10606-6012_evaluator_1  Cannot start service evaluator: network job10606-6012_evaluation not found
stderr | 
Creating job10606-6012_solution_1  ... error

stderr | ERROR: for job10606-6012_solution_1  Cannot start service solution: network job10606-6012_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job10606-6012_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job10606-6012_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10602311Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailedno3220:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10598316Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno3220:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10593319Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno3220:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10588305Andrea CensiRandom executionaido1_LF1_r3-v3step1-simulationfailedno3220:02:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10582309Andrea CensiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3220:00:35
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10570350Manfred DiazTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3220:04:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.957104968155909
deviation-center-line_median0.7247238632408081
in-drivable-lane_median0.6666666666666643


other stats
deviation-center-line_max0.8558600659644088
deviation-center-line_mean0.5303206218884994
deviation-center-line_min0.14072291605953918
deviation-heading_max2.6783711227860767
deviation-heading_mean1.7398067848802503
deviation-heading_median2.427801074207694
deviation-heading_min0.3348345054110024
driven_any_max5.573678738813689
driven_any_mean3.6396075513152466
driven_any_median5.4776200803724135
driven_any_min0.5063193345377046
driven_lanedir_max5.1011520889022055
driven_lanedir_mean3.3258327113616835
driven_lanedir_min0.4868507497890653
in-drivable-lane_max1.166666666666666
in-drivable-lane_mean0.5000000000000007
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.573678738813689, "driven_lanedir": 4.957104968155909, "in-drivable-lane": 1.166666666666666, "deviation-heading": 2.5835160794424943, "deviation-center-line": 0.7589039731909486}, "ep001": {"driven_any": 0.5063193345377046, "driven_lanedir": 0.4868507497890653, "in-drivable-lane": 0, "deviation-heading": 0.3348345054110024, "deviation-center-line": 0.14072291605953918}, "ep002": {"driven_any": 5.556806530029744, "driven_lanedir": 5.1011520889022055, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 2.6783711227860767, "deviation-center-line": 0.7247238632408081}, "ep003": {"driven_any": 5.4776200803724135, "driven_lanedir": 5.050297849005792, "in-drivable-lane": 0.6666666666666732, "deviation-heading": 2.427801074207694, "deviation-center-line": 0.8558600659644088}, "ep004": {"driven_any": 1.0836130728226845, "driven_lanedir": 1.033757900955444, "in-drivable-lane": 0, "deviation-heading": 0.674511142553985, "deviation-center-line": 0.1713922909867925}}
10563350Manfred DiazTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes3220:01:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10558350Manfred DiazTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.13540369080926756, "good_angle": 0.3504677180529308, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 0.5333333333333314}, "ep001": {"nsteps": 52, "reward": -19.64949350976027, "good_angle": 0.1639949745956399, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0.3666666666666678}, "ep002": {"nsteps": 500, "reward": 0.12009331056353403, "good_angle": 0.37877485672607986, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 0.7999999999999972}, "ep003": {"nsteps": 500, "reward": 0.08043411693163216, "good_angle": 0.3783749453438577, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 0.6999999999999975}, "ep004": {"nsteps": 109, "reward": -9.390117586838132, "good_angle": 0.468805819152929, "survival_time": 3.63333333333333, "traveled_tiles": 2, "valid_direction": 0.6999999999999975}}
good_angle_max0.468805819152929
good_angle_mean0.34808366277428743
good_angle_median0.3783749453438577
good_angle_min0.1639949745956399
reward_max0.13540369080926756
reward_mean-5.7407359956587936
reward_median0.08043411693163216
reward_min-19.64949350976027
survival_time_max16.666666666666654
survival_time_mean11.073333333333323
survival_time_min1.7333333333333354
traveled_tiles_max11
traveled_tiles_mean6.8
traveled_tiles_median10
traveled_tiles_min1
valid_direction_max0.7999999999999972
valid_direction_mean0.6199999999999983
valid_direction_median0.6999999999999975
valid_direction_min0.3666666666666678
10557320Andrea CensiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailedno3220:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 87, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 176, in predict
    return self.actor(state).cpu().data.numpy().flatten()
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/workspace/model.py", line 72, in forward
    x = self.lr(self.lin1(x))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/linear.py", line 55, in forward
    return F.linear(input, self.weight, self.bias)
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/functional.py", line 1024, in linear
    return torch.addmm(bias, input, weight.t())
RuntimeError: size mismatch, m1: [1 x 127872], m2: [4032 x 512] at /tmp/pip-req-build-vRRdPa/aten/src/TH/generic/THTensorMath.cpp:2070


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10547350Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessno3220:03:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10536336Andrea CensiTensorflow templateaido1_LFV_r1-v3step4-vizsuccessno3220:01:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.16958028453105295
in-drivable-lane_median0


other stats
deviation-center-line_max0.22421030467466235
deviation-center-line_mean0.1634583834192209
deviation-center-line_min0.10995274174798784
deviation-heading_max0.6914924698329948
deviation-heading_mean0.5927453930596538
deviation-heading_median0.6785315163413053
deviation-heading_min0.45172830747555553
driven_any_max2.7320453507042295
driven_any_mean1.5137876234261718
driven_any_median1.386705344540306
driven_any_min0.7864654166530175
driven_lanedir_max2.1967731589892927
driven_lanedir_mean1.3757879534350568
driven_lanedir_median1.3638938451285922
driven_lanedir_min0.7541729987229193
in-drivable-lane_max1.3000000000000005
in-drivable-lane_mean0.2600000000000001
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.7320453507042295, "driven_lanedir": 2.1967731589892927, "in-drivable-lane": 1.3000000000000005, "deviation-heading": 0.6914924698329948, "deviation-center-line": 0.22421030467466235}, "ep001": {"driven_any": 0.7864654166530175, "driven_lanedir": 0.7541729987229193, "in-drivable-lane": 0, "deviation-heading": 0.4550438261437452, "deviation-center-line": 0.12152779068333867}, "ep002": {"driven_any": 1.1979477646195056, "driven_lanedir": 1.1509025865655182, "in-drivable-lane": 0, "deviation-heading": 0.6869308455046688, "deviation-center-line": 0.19202079545906273}, "ep003": {"driven_any": 1.4657742406137992, "driven_lanedir": 1.4131971777689611, "in-drivable-lane": 0, "deviation-heading": 0.6785315163413053, "deviation-center-line": 0.16958028453105295}, "ep004": {"driven_any": 1.386705344540306, "driven_lanedir": 1.3638938451285922, "in-drivable-lane": 0, "deviation-heading": 0.45172830747555553, "deviation-center-line": 0.10995274174798784}}
10529355pravishsainathPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3220:01:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.403527086874782
deviation-center-line_median0.22980839536946596
in-drivable-lane_median0.5333333333333333


other stats
deviation-center-line_max0.5328055738944637
deviation-center-line_mean0.2871930267166277
deviation-center-line_min0.19765848118254675
deviation-heading_max3.335706294754626
deviation-heading_mean1.4722058168177896
deviation-heading_median0.9466536358395984
deviation-heading_min0.31029717240497684
driven_any_max1.3505141470485609
driven_any_mean0.6956259698326235
driven_any_median0.4137235061279303
driven_any_min0.191011283774373
driven_lanedir_max0.7423125037694125
driven_lanedir_mean0.4197777101691081
driven_lanedir_min0.11216637166789324
in-drivable-lane_max3.1666666666666554
in-drivable-lane_mean1.2666666666666626
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3442667570659138, "driven_lanedir": 0.11216637166789324, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 2.20516172463923, "deviation-center-line": 0.22980839536946596}, "ep001": {"driven_any": 0.191011283774373, "driven_lanedir": 0.1857423026750018, "in-drivable-lane": 0, "deviation-heading": 0.31029717240497684, "deviation-center-line": 0.19765848118254675}, "ep002": {"driven_any": 1.3505141470485609, "driven_lanedir": 0.7423125037694125, "in-drivable-lane": 2.633333333333324, "deviation-heading": 3.335706294754626, "deviation-center-line": 0.5328055738944637}, "ep003": {"driven_any": 0.4137235061279303, "driven_lanedir": 0.403527086874782, "in-drivable-lane": 0, "deviation-heading": 0.563210256450517, "deviation-center-line": 0.2271440937508832}, "ep004": {"driven_any": 1.1786141551463398, "driven_lanedir": 0.655140285858451, "in-drivable-lane": 3.1666666666666554, "deviation-heading": 0.9466536358395984, "deviation-center-line": 0.24854858938577912}}
10521355pravishsainathPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3220:01:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10511369Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessyes3220:01:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10508369Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.233333333333335


other stats
episodes
details{"ep000": {"nsteps": 67, "reward": -15.204794604584936, "good_angle": 0.861166487487844, "survival_time": 2.233333333333335, "traveled_tiles": 1, "valid_direction": 1.8000000000000018}, "ep001": {"nsteps": 52, "reward": -19.72000525891781, "good_angle": 0.05950223190883772, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0.06666666666666687}, "ep002": {"nsteps": 42, "reward": -24.258716393794337, "good_angle": 0.11981879217282052, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.30000000000000093}, "ep003": {"nsteps": 250, "reward": -4.107545389413514, "good_angle": 0.6861974210156714, "survival_time": 8.333333333333314, "traveled_tiles": 4, "valid_direction": 1.6333333333333284}, "ep004": {"nsteps": 220, "reward": -5.5859204844255474, "good_angle": 9.749675787778116, "survival_time": 7.333333333333317, "traveled_tiles": 3, "valid_direction": 3.73333333333332}}
good_angle_max9.749675787778116
good_angle_mean2.295272144072658
good_angle_median0.6861974210156714
good_angle_min0.05950223190883772
reward_max-4.107545389413514
reward_mean-13.775396426227228
reward_median-15.204794604584936
reward_min-24.258716393794337
survival_time_max8.333333333333314
survival_time_mean4.206666666666661
survival_time_min1.400000000000001
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.73333333333332
valid_direction_mean1.5066666666666635
valid_direction_median1.6333333333333284
valid_direction_min0.06666666666666687
10489369Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessno3220:04:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10483375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3220:01:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10480378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3220:00:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 89, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: error loading <rosparam> tag: 
	'param' attribute must be set for non-dictionary values
XML is <rosparam command="load" file="$(find duckietown)/config/$(arg config)/line_detector/$(arg node_name)/$(arg param_file_name).yaml"/>

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10478386Bhairav MehtaPyTorch DDPG baselineaido1_LF1_r3-v3step4-vizsuccessyes3220:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4167989878598046
deviation-center-line_median0.15092422980334602
in-drivable-lane_median0.8000000000000014


other stats
deviation-center-line_max0.19117378469166543
deviation-center-line_mean0.146409162122338
deviation-center-line_min0.1028152109636438
deviation-heading_max0.9070690486106946
deviation-heading_mean0.7895582560128946
deviation-heading_median0.8145516818114438
deviation-heading_min0.6388901277398698
driven_any_max0.8623876471735321
driven_any_mean0.7007812842214362
driven_any_median0.7483180110058728
driven_any_min0.43230096974062554
driven_lanedir_max0.5315785584767863
driven_lanedir_mean0.3898245385914162
driven_lanedir_min0.231176093864376
in-drivable-lane_max1.4666666666666617
in-drivable-lane_mean0.9333333333333316
in-drivable-lane_min0.7000000000000002
per-episodes
details{"ep000": {"driven_any": 0.43230096974062554, "driven_lanedir": 0.231176093864376, "in-drivable-lane": 0.7000000000000002, "deviation-heading": 0.9070690486106946, "deviation-center-line": 0.12702634877386862}, "ep001": {"driven_any": 0.8623876471735321, "driven_lanedir": 0.5315785584767863, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.8760426176250733, "deviation-center-line": 0.19117378469166543}, "ep002": {"driven_any": 0.7483180110058728, "driven_lanedir": 0.4167989878598046, "in-drivable-lane": 0.899999999999997, "deviation-heading": 0.8145516818114438, "deviation-center-line": 0.16010623637916618}, "ep003": {"driven_any": 0.7916956668504316, "driven_lanedir": 0.4194267915542773, "in-drivable-lane": 1.4666666666666617, "deviation-heading": 0.7112378042773918, "deviation-center-line": 0.15092422980334602}, "ep004": {"driven_any": 0.669204126336719, "driven_lanedir": 0.350142261201837, "in-drivable-lane": 0.8000000000000014, "deviation-heading": 0.6388901277398698, "deviation-center-line": 0.1028152109636438}}
10470386Bhairav MehtaPyTorch DDPG baselineaido1_LF1_r3-v3step3-videossuccessyes3220:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10466386Bhairav MehtaPyTorch DDPG baselineaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.833333333333333


other stats
episodes
details{"ep000": {"nsteps": 57, "reward": -17.766305432234187, "good_angle": 0.40532095187961453, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.433333333333336}, "ep001": {"nsteps": 98, "reward": -10.53589698358686, "good_angle": 3.911131842113076, "survival_time": 3.266666666666665, "traveled_tiles": 2, "valid_direction": 2.1999999999999984}, "ep002": {"nsteps": 85, "reward": -12.485683704879792, "good_angle": 1.4326523737692003, "survival_time": 2.833333333333333, "traveled_tiles": 2, "valid_direction": 2.2333333333333334}, "ep003": {"nsteps": 102, "reward": -10.61333090197934, "good_angle": 1.4127517140661596, "survival_time": 3.3999999999999977, "traveled_tiles": 2, "valid_direction": 2.533333333333331}, "ep004": {"nsteps": 64, "reward": -16.495745062391507, "good_angle": 1.514201004882013, "survival_time": 2.1333333333333355, "traveled_tiles": 2, "valid_direction": 1.8000000000000025}}
good_angle_max3.911131842113076
good_angle_mean1.7352115773420127
good_angle_median1.4326523737692003
good_angle_min0.40532095187961453
reward_max-10.53589698358686
reward_mean-13.579392417014338
reward_median-12.485683704879792
reward_min-17.766305432234187
survival_time_max3.3999999999999977
survival_time_mean2.706666666666667
survival_time_min1.9000000000000024
traveled_tiles_max2
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max2.533333333333331
valid_direction_mean2.04
valid_direction_median2.1999999999999984
valid_direction_min1.433333333333336
10459385Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3220:02:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10449395Maxim KuzminRandom executionaido1_LF1_r3-v3step3-videossuccessyes3220:01:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10445395Maxim KuzminRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.466666666666647


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -12.59728134561468, "good_angle": 1.2398966961954525, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2666666666666666}, "ep001": {"nsteps": 109, "reward": -9.730809066000337, "good_angle": 0.008850572760630239, "survival_time": 3.63333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 254, "reward": -4.4375982951578195, "good_angle": 0.9318896597406168, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 1.9999999999999936}, "ep003": {"nsteps": 457, "reward": -2.71261982396408, "good_angle": 0.6839778908298664, "survival_time": 15.23333333333329, "traveled_tiles": 4, "valid_direction": 1.6666666666666607}, "ep004": {"nsteps": 346, "reward": -3.5770770021715173, "good_angle": 18.99679018263806, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}
good_angle_max18.99679018263806
good_angle_mean4.372281000432925
good_angle_median0.9318896597406168
good_angle_min0.008850572760630239
reward_max-2.71261982396408
reward_mean-6.6110771065816865
reward_median-4.4375982951578195
reward_min-12.59728134561468
survival_time_max15.23333333333329
survival_time_mean8.313333333333315
survival_time_min2.7
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.9666666666666535
valid_direction_mean1.9799999999999949
valid_direction_median1.9999999999999936
valid_direction_min0
10432395Maxim KuzminRandom executionaido1_LF1_r3-v3step1-simulationsuccessno3220:02:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10415397PolyProgrammistRandom executionaido1_LF1_r3-v3step1-simulationfailedno3220:03:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 73, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10409405Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3220:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 89, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: error loading <rosparam> tag: 
	'param' attribute must be set for non-dictionary values
XML is <rosparam command="load" file="$(find duckietown)/config/$(arg config)/line_detector/$(arg node_name)/$(arg param_file_name).yaml"/>

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10405407Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationerrorno3220:00:51
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10397414Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2205529708004259
deviation-center-line_median0.20924855428525296
in-drivable-lane_median0


other stats
deviation-center-line_max0.34487799786562473
deviation-center-line_mean0.22083174855656443
deviation-center-line_min0.0800814722844281
deviation-heading_max1.7837179077180825
deviation-heading_mean0.8372043824642704
deviation-heading_median0.6197318346864207
deviation-heading_min0.42335790067193135
driven_any_max0.7857491550405021
driven_any_mean0.34786611003372553
driven_any_median0.23929003915606892
driven_any_min0.07499169560682972
driven_lanedir_max0.5415140831679119
driven_lanedir_mean0.28533931934984386
driven_lanedir_min0.05759304641594776
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7857491550405021, "driven_lanedir": 0.5415140831679119, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7837179077180825, "deviation-center-line": 0.3332007209831216}, "ep001": {"driven_any": 0.07499169560682972, "driven_lanedir": 0.05759304641594776, "in-drivable-lane": 0, "deviation-heading": 0.42335790067193135, "deviation-center-line": 0.0800814722844281}, "ep002": {"driven_any": 0.16785351760841608, "driven_lanedir": 0.14937728494313807, "in-drivable-lane": 0, "deviation-heading": 0.5777431771900488, "deviation-center-line": 0.1367499973643948}, "ep003": {"driven_any": 0.4714461427568109, "driven_lanedir": 0.45765921142179566, "in-drivable-lane": 0, "deviation-heading": 0.7814710920548688, "deviation-center-line": 0.34487799786562473}, "ep004": {"driven_any": 0.23929003915606892, "driven_lanedir": 0.2205529708004259, "in-drivable-lane": 0, "deviation-heading": 0.6197318346864207, "deviation-center-line": 0.20924855428525296}}
10386413Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:03:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10369440orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes3220:05:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.0786607390399845
deviation-center-line_median1.3556511426038445
in-drivable-lane_median1.6999999999999946


other stats
deviation-center-line_max1.3908307461933556
deviation-center-line_mean1.169035604132801
deviation-center-line_min0.38390019037673695
deviation-heading_max11.686485350648164
deviation-heading_mean9.427982625495332
deviation-heading_median10.691319250448204
deviation-heading_min4.103973034163737
driven_any_max4.969465406728449
driven_any_mean4.967841435364298
driven_any_median4.968652413650665
driven_any_min4.965179079877877
driven_lanedir_max3.1500484150972476
driven_lanedir_mean2.6171002865692214
driven_lanedir_min0.7335569134262709
in-drivable-lane_max12.133333333333333
in-drivable-lane_mean3.726666666666663
in-drivable-lane_min0.8999999999999971
per-episodes
details{"ep000": {"driven_any": 4.965179079877877, "driven_lanedir": 0.7335569134262709, "in-drivable-lane": 12.133333333333333, "deviation-heading": 4.103973034163737, "deviation-center-line": 0.38390019037673695}, "ep001": {"driven_any": 4.968812841326389, "driven_lanedir": 3.017990410291395, "in-drivable-lane": 2.3999999999999924, "deviation-heading": 9.761078996683448, "deviation-center-line": 1.3908307461933556}, "ep002": {"driven_any": 4.967097435238112, "driven_lanedir": 3.1052449549912113, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 10.89705649553311, "deviation-center-line": 1.348431061805968}, "ep003": {"driven_any": 4.969465406728449, "driven_lanedir": 3.1500484150972476, "in-drivable-lane": 0.8999999999999971, "deviation-heading": 11.686485350648164, "deviation-center-line": 1.3556511426038445}, "ep004": {"driven_any": 4.968652413650665, "driven_lanedir": 3.0786607390399845, "in-drivable-lane": 1.6999999999999946, "deviation-heading": 10.691319250448204, "deviation-center-line": 1.3663648796841}}
10351440orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes3220:04:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10347440orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6382543184608221, "good_angle": 26.18110894363119, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.699999999999978}, "ep001": {"nsteps": 500, "reward": -0.4151158498296281, "good_angle": 13.553417258114488, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.89999999999999}, "ep002": {"nsteps": 500, "reward": -0.2500560587957734, "good_angle": 13.658932232202693, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333326}, "ep003": {"nsteps": 500, "reward": -0.17730202129750977, "good_angle": 13.64760310090124, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999991}, "ep004": {"nsteps": 500, "reward": -0.29369213936530286, "good_angle": 13.728997991349493, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}}
good_angle_max26.18110894363119
good_angle_mean16.15401190523982
good_angle_median13.658932232202693
good_angle_min13.553417258114488
reward_max-0.17730202129750977
reward_mean-0.3548840775498073
reward_median-0.29369213936530286
reward_min-0.6382543184608221
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.033333333333326
valid_direction_mean12.719999999999988
valid_direction_median12.96666666666666
valid_direction_min11.699999999999978
10316440orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3220:10:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10312448JonRandom executionaido1_LF1_r3-v3step4-vizsuccessyes3220:03:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1230687711996927
deviation-center-line_median0.3911620976748043
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.992230354643663
deviation-center-line_mean0.45809723138840897
deviation-center-line_min0.19968135890540023
deviation-heading_max3.3821210471788428
deviation-heading_mean1.7096509463095266
deviation-heading_median1.6046926250823808
deviation-heading_min0.18610627803688945
driven_any_max2.117460561739322
driven_any_mean1.1013845836684415
driven_any_median1.1775412629326731
driven_any_min0.26005531677612376
driven_lanedir_max2.0722990967682144
driven_lanedir_mean0.9709952399019868
driven_lanedir_min0.13724534215405926
in-drivable-lane_max0.8333333333333304
in-drivable-lane_mean0.2933333333333327
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3555757792021378, "driven_lanedir": 0.13724534215405926, "in-drivable-lane": 0.6, "deviation-heading": 2.081034561509321, "deviation-center-line": 0.19968135890540023}, "ep001": {"driven_any": 0.26005531677612376, "driven_lanedir": 0.25874126457466007, "in-drivable-lane": 0, "deviation-heading": 0.18610627803688945, "deviation-center-line": 0.20557463206519225}, "ep002": {"driven_any": 1.1775412629326731, "driven_lanedir": 1.1230687711996927, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.294300219740199, "deviation-center-line": 0.3911620976748043}, "ep003": {"driven_any": 2.117460561739322, "driven_lanedir": 2.0722990967682144, "in-drivable-lane": 0, "deviation-heading": 1.6046926250823808, "deviation-center-line": 0.992230354643663}, "ep004": {"driven_any": 1.5962899976919502, "driven_lanedir": 1.2636217248133073, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 3.3821210471788428, "deviation-center-line": 0.5018377136529847}}
10308448JonRandom executionaido1_LF1_r3-v3step3-videossuccessyes3220:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10300444JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3220:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 58, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10296454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringabortedyes3220:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job10296-4583', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job10296-4583', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job10296-4583_evaluation" with the default driver
stderr | Creating job10296-4583_scorer_1 ...
stderr | 
Creating job10296-4583_scorer_1 ... error

stderr | ERROR: for job10296-4583_scorer_1  Cannot start service scorer: network job10296-4583_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job10296-4583_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10282448JonRandom executionaido1_LF1_r3-v3step1-simulationsuccessno3220:03:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10279449JonRandom executionaido1_LF1_r3-v3step1-simulationfailedno3220:00:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10274451JonRandom executionaido1_LF1_r3-v3step1-simulationfailedno3220:00:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10270453JonRandom executionaido1_LF1_r3-v3step1-simulationfailedno3220:00:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10267465JonROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22097770629610647
deviation-center-line_median0.20581010071716324
in-drivable-lane_median0


other stats
deviation-center-line_max0.3896037329738158
deviation-center-line_mean0.2372344152199241
deviation-center-line_min0.11708470779953652
deviation-heading_max1.8476971230410533
deviation-heading_mean0.8128867277918135
deviation-heading_median0.6020378186859877
deviation-heading_min0.269325867671825
driven_any_max0.767879417770653
driven_any_mean0.331431654911842
driven_any_median0.2392904854673148
driven_any_min0.16426868736598496
driven_lanedir_max0.5218087456861773
driven_lanedir_mean0.27038163095207896
driven_lanedir_min0.14715266575374408
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.767879417770653, "driven_lanedir": 0.5218087456861773, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.8476971230410533, "deviation-center-line": 0.3896037329738158}, "ep001": {"driven_any": 0.314307587959686, "driven_lanedir": 0.3128877095766325, "in-drivable-lane": 0, "deviation-heading": 0.269325867671825, "deviation-center-line": 0.3327381084588153}, "ep002": {"driven_any": 0.16426868736598496, "driven_lanedir": 0.14715266575374408, "in-drivable-lane": 0, "deviation-heading": 0.5995910736208355, "deviation-center-line": 0.14093542615028976}, "ep003": {"driven_any": 0.1714120959955711, "driven_lanedir": 0.1490813274477345, "in-drivable-lane": 0, "deviation-heading": 0.7457817559393652, "deviation-center-line": 0.11708470779953652}, "ep004": {"driven_any": 0.2392904854673148, "driven_lanedir": 0.22097770629610647, "in-drivable-lane": 0, "deviation-heading": 0.6020378186859877, "deviation-center-line": 0.20581010071716324}}
10266465JonROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:01:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10265465JonROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 217, "reward": -4.806469961554499, "good_angle": 0.9293082419512864, "survival_time": 7.233333333333317, "traveled_tiles": 2, "valid_direction": 1.499999999999995}, "ep001": {"nsteps": 90, "reward": -11.695517864492205, "good_angle": 0.026849849031108142, "survival_time": 2.999999999999999, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 48, "reward": -21.319917902350426, "good_angle": 0.3969730138855312, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.8666666666666683}, "ep003": {"nsteps": 50, "reward": -20.387805932611226, "good_angle": 0.5039018045964171, "survival_time": 1.6666666666666683, "traveled_tiles": 1, "valid_direction": 0.9333333333333352}, "ep004": {"nsteps": 69, "reward": -14.97599471522414, "good_angle": 0.4082303838531521, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.5999999999999996}}
good_angle_max0.9293082419512864
good_angle_mean0.453052658663499
good_angle_median0.4082303838531521
good_angle_min0.026849849031108142
reward_max-4.806469961554499
reward_mean-14.6371412752465
reward_median-14.97599471522414
reward_min-21.319917902350426
survival_time_max7.233333333333317
survival_time_mean3.1599999999999975
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.499999999999995
valid_direction_mean0.7799999999999996
valid_direction_median0.8666666666666683
valid_direction_min0
10249465JonROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:04:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10236488JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3220:04:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9484799136944472
deviation-center-line_median0.5677877054113932
in-drivable-lane_median8.600000000000005


other stats
deviation-center-line_max2.028264730701824
deviation-center-line_mean0.7845677824160513
deviation-center-line_min0
deviation-heading_max3.855478019303108
deviation-heading_mean1.8401736616315607
deviation-heading_median1.2599816114188076
deviation-heading_min0
driven_any_max2.3498124000699914
driven_any_mean1.5674342795309453
driven_any_median1.6626210159854036
driven_any_min0.8266315486538579
driven_lanedir_max2.2167245049148843
driven_lanedir_mean0.9400170857578052
driven_lanedir_min0
in-drivable-lane_max13.233333333333324
in-drivable-lane_mean7.80666666666666
in-drivable-lane_min0.3333333333333499
per-episodes
details{"ep000": {"driven_any": 1.6626210159854036, "driven_lanedir": 0, "in-drivable-lane": 11.466666666666637, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.2304390214165508, "driven_lanedir": 0.9484799136944472, "in-drivable-lane": 8.600000000000005, "deviation-heading": 2.9701903473088436, "deviation-center-line": 0.5677877054113932}, "ep002": {"driven_any": 0.8266315486538579, "driven_lanedir": 0.4717396946818984, "in-drivable-lane": 13.233333333333324, "deviation-heading": 1.2599816114188076, "deviation-center-line": 0.2952874933258186}, "ep003": {"driven_any": 1.7676674115289226, "driven_lanedir": 1.0631413154977951, "in-drivable-lane": 5.399999999999982, "deviation-heading": 1.1152183301270446, "deviation-center-line": 1.0314989826412202}, "ep004": {"driven_any": 2.3498124000699914, "driven_lanedir": 2.2167245049148843, "in-drivable-lane": 0.3333333333333499, "deviation-heading": 3.855478019303108, "deviation-center-line": 2.028264730701824}}
10230476JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.63333333333333


other stats
episodes
details{"ep000": {"nsteps": 49, "reward": -20.677214410897268, "good_angle": 0.8728341263974224, "survival_time": 1.633333333333335, "traveled_tiles": 1, "valid_direction": 1.5000000000000016}, "ep001": {"nsteps": 33, "reward": -30.850890179475147, "good_angle": 0.012757392212964028, "survival_time": 1.1, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 142, "reward": -7.511475527580355, "good_angle": 0.5240574353954529, "survival_time": 4.733333333333326, "traveled_tiles": 3, "valid_direction": 1.0333333333333297}, "ep003": {"nsteps": 290, "reward": -3.6029660382753153, "good_angle": 0.6470540320185086, "survival_time": 9.666666666666645, "traveled_tiles": 4, "valid_direction": 1.1999999999999955}, "ep004": {"nsteps": 109, "reward": -9.520924713906892, "good_angle": 0.04961565002271178, "survival_time": 3.63333333333333, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max0.8728341263974224
good_angle_mean0.421263727209412
good_angle_median0.5240574353954529
good_angle_min0.012757392212964028
reward_max-3.6029660382753153
reward_mean-14.432694174026995
reward_median-9.520924713906892
reward_min-30.850890179475147
survival_time_max9.666666666666645
survival_time_mean4.153333333333327
survival_time_min1.1
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.5000000000000016
valid_direction_mean0.7466666666666655
valid_direction_median1.0333333333333297
valid_direction_min0
10221476JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3220:01:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10201486JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3220:10:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10196494heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes3220:00:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.19303217919505933
deviation-center-line_median0.13202001615408243
in-drivable-lane_median0


other stats
deviation-center-line_max0.16616409096751508
deviation-center-line_mean0.13574885345523155
deviation-center-line_min0.09937488280591132
deviation-heading_max0.8553840985009603
deviation-heading_mean0.5909122818509827
deviation-heading_median0.5349751117769646
deviation-heading_min0.36485468496866386
driven_any_max0.32145029900952454
driven_any_mean0.22641281930236035
driven_any_median0.22361759931097583
driven_any_min0.14907839954064755
driven_lanedir_max0.20733918868000736
driven_lanedir_mean0.15129694649143954
driven_lanedir_min0.011448408900461835
in-drivable-lane_max1.7333333333333345
in-drivable-lane_mean0.34666666666666685
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.32145029900952454, "driven_lanedir": 0.011448408900461835, "in-drivable-lane": 1.7333333333333345, "deviation-heading": 0.8553840985009603, "deviation-center-line": 0.09937488280591132}, "ep001": {"driven_any": 0.14907839954064755, "driven_lanedir": 0.13950665611047963, "in-drivable-lane": 0, "deviation-heading": 0.36485468496866386, "deviation-center-line": 0.13202001615408243}, "ep002": {"driven_any": 0.2096414993540364, "driven_lanedir": 0.19303217919505933, "in-drivable-lane": 0, "deviation-heading": 0.5349751117769646, "deviation-center-line": 0.151352932830969}, "ep003": {"driven_any": 0.2282762992966175, "driven_lanedir": 0.2051582995711896, "in-drivable-lane": 0, "deviation-heading": 0.6679471505798023, "deviation-center-line": 0.12983234451767997}, "ep004": {"driven_any": 0.22361759931097583, "driven_lanedir": 0.20733918868000736, "in-drivable-lane": 0, "deviation-heading": 0.5314003634285224, "deviation-center-line": 0.16616409096751508}}
10181498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes3220:01:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.28977579066348724
deviation-center-line_median0.2596306626838413
in-drivable-lane_median0.8999999999999968


other stats
deviation-center-line_max0.3495269439274484
deviation-center-line_mean0.2816719556808085
deviation-center-line_min0.23084578070496203
deviation-heading_max3.140638799446339
deviation-heading_mean2.412886947725279
deviation-heading_median2.769138296409296
deviation-heading_min0.834297520530139
driven_any_max0.7873202975740567
driven_any_mean0.6419688580219205
driven_any_median0.6009722981482444
driven_any_min0.5823374982056604
driven_lanedir_max0.34105884308565093
driven_lanedir_mean0.3003442252313668
driven_lanedir_min0.28535129762116584
in-drivable-lane_max3.3333333333333277
in-drivable-lane_mean1.3666666666666631
in-drivable-lane_min0.7333333333333307
per-episodes
details{"ep000": {"driven_any": 0.7873202975740567, "driven_lanedir": 0.28977579066348724, "in-drivable-lane": 3.3333333333333277, "deviation-heading": 0.834297520530139, "deviation-center-line": 0.3495269439274484}, "ep001": {"driven_any": 0.647559298004693, "driven_lanedir": 0.34105884308565093, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.140638799446339, "deviation-center-line": 0.3138973423502348}, "ep002": {"driven_any": 0.6009722981482444, "driven_lanedir": 0.2978870322519669, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 2.769138296409296, "deviation-center-line": 0.254459048737556}, "ep003": {"driven_any": 0.5823374982056604, "driven_lanedir": 0.28535129762116584, "in-drivable-lane": 1.0333333333333297, "deviation-heading": 2.4218935945541102, "deviation-center-line": 0.23084578070496203}, "ep004": {"driven_any": 0.5916548981769478, "driven_lanedir": 0.28764816253456305, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 2.89846652768651, "deviation-center-line": 0.2596306626838413}}
10176498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3220:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10160502Liam PaullTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3220:03:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.176965747776464
deviation-center-line_median0.5392367820639963
in-drivable-lane_median0


other stats
deviation-center-line_max1.178028140676327
deviation-center-line_mean0.6361231864346794
deviation-center-line_min0.24801466543439213
deviation-heading_max2.933357011087066
deviation-heading_mean1.5031939640182812
deviation-heading_median1.6784445577499594
deviation-heading_min0.3078096120600184
driven_any_max2.889379743962332
driven_any_mean1.5333652672511588
driven_any_median1.323416997902066
driven_any_min0.35252349840349056
driven_lanedir_max2.5840774511468547
driven_lanedir_mean1.3669448964654074
driven_lanedir_min0.3369860007938392
in-drivable-lane_max0.7666666666666639
in-drivable-lane_mean0.28666666666666607
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.2712292594336065, "driven_lanedir": 1.9166299693512645, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 2.933357011087066, "deviation-center-line": 0.7040900403146501}, "ep001": {"driven_any": 0.35252349840349056, "driven_lanedir": 0.3369860007938392, "in-drivable-lane": 0, "deviation-heading": 0.3078096120600184, "deviation-center-line": 0.24801466543439213}, "ep002": {"driven_any": 1.323416997902066, "driven_lanedir": 1.176965747776464, "in-drivable-lane": 0, "deviation-heading": 2.1538570627189197, "deviation-center-line": 0.5392367820639963}, "ep003": {"driven_any": 2.889379743962332, "driven_lanedir": 2.5840774511468547, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 1.6784445577499594, "deviation-center-line": 1.178028140676327}, "ep004": {"driven_any": 0.8302768365542986, "driven_lanedir": 0.8200653132586138, "in-drivable-lane": 0, "deviation-heading": 0.4425015764754437, "deviation-center-line": 0.5112463036840313}}
10150508JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3220:02:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2005994640918105
deviation-center-line_median0.0761142434169136
in-drivable-lane_median15.73333333333332


other stats
deviation-center-line_max0.08642467907412557
deviation-center-line_mean0.07212039878118862
deviation-center-line_min0.05161548383946319
deviation-heading_max0.6290743120119628
deviation-heading_mean0.5080386312465139
deviation-heading_median0.5725891745383844
deviation-heading_min0.26157352740934203
driven_any_max0.6342382605664992
driven_any_mean0.5659341047333325
driven_any_median0.6015440412398563
driven_any_min0.4122818561018603
driven_lanedir_max0.22449933853409387
driven_lanedir_mean0.17151051808185783
driven_lanedir_min0.0233533809484035
in-drivable-lane_max15.866666666666656
in-drivable-lane_mean12.086666666666654
in-drivable-lane_min1.2333333333333338
per-episodes
details{"ep000": {"driven_any": 0.4122818561018603, "driven_lanedir": 0.0233533809484035, "in-drivable-lane": 1.2333333333333338, "deviation-heading": 0.26157352740934203, "deviation-center-line": 0.05161548383946319}, "ep001": {"driven_any": 0.6342382605664992, "driven_lanedir": 0.22449933853409387, "in-drivable-lane": 15.73333333333332, "deviation-heading": 0.6290743120119628, "deviation-center-line": 0.08642467907412557}, "ep002": {"driven_any": 0.6015440412398563, "driven_lanedir": 0.2005994640918105, "in-drivable-lane": 11.8333333333333, "deviation-heading": 0.5725891745383844, "deviation-center-line": 0.0761142434169136}, "ep003": {"driven_any": 0.5616321359226008, "driven_lanedir": 0.19044436076430937, "in-drivable-lane": 15.866666666666656, "deviation-heading": 0.4977708462225249, "deviation-center-line": 0.06605111451638948}, "ep004": {"driven_any": 0.6199742298358458, "driven_lanedir": 0.2186560460706719, "in-drivable-lane": 15.766666666666657, "deviation-heading": 0.5791852960503553, "deviation-center-line": 0.08039647305905118}}
10146508JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3220:01:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10143508JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 46, "reward": -22.89030233349489, "good_angle": 2.374591976676323, "survival_time": 1.5333333333333348, "traveled_tiles": 1, "valid_direction": 1.366666666666668}, "ep001": {"nsteps": 500, "reward": -2.828535573657602, "good_angle": 17.08240173076721, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 16.599999999999984}, "ep002": {"nsteps": 381, "reward": -5.436100737414178, "good_angle": 19.811794049954475, "survival_time": 12.699999999999966, "traveled_tiles": 2, "valid_direction": 12.633333333333296}, "ep003": {"nsteps": 500, "reward": -2.8611773381936363, "good_angle": 17.637656044536502, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.599999999999984}, "ep004": {"nsteps": 500, "reward": -2.8609809123687446, "good_angle": 17.428966619126555, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 16.599999999999984}}
good_angle_max19.811794049954475
good_angle_mean14.867082084212214
good_angle_median17.428966619126555
good_angle_min2.374591976676323
reward_max-2.828535573657602
reward_mean-7.37541937902581
reward_median-2.8611773381936363
reward_min-22.89030233349489
survival_time_max16.666666666666654
survival_time_mean12.846666666666652
survival_time_min1.5333333333333348
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max16.599999999999984
valid_direction_mean12.759999999999982
valid_direction_median16.599999999999984
valid_direction_min1.366666666666668
10127508JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3220:05:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10123510Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno3220:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10120516heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes3220:00:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3493700966360873
deviation-center-line_median0.10064492309489552
in-drivable-lane_median0


other stats
deviation-center-line_max0.126236662901327
deviation-center-line_mean0.10006171036715011
deviation-center-line_min0.07694772270470739
deviation-heading_max1.030311130604008
deviation-heading_mean0.3532445703768824
deviation-heading_median0.1839193439669325
deviation-heading_min0.10717054834728
driven_any_max0.4099686882910525
driven_any_mean0.3335654327459031
driven_any_median0.3540638671604564
driven_any_min0.18634940376866105
driven_lanedir_max0.4054653003100581
driven_lanedir_mean0.2835800318814334
driven_lanedir_min0.08669111443694189
in-drivable-lane_max0.3
in-drivable-lane_mean0.06
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.316793986406723, "driven_lanedir": 0.08669111443694189, "in-drivable-lane": 0.3, "deviation-heading": 1.030311130604008, "deviation-center-line": 0.08520179175839271}, "ep001": {"driven_any": 0.18634940376866105, "driven_lanedir": 0.1839841973901657, "in-drivable-lane": 0, "deviation-heading": 0.10717054834728, "deviation-center-line": 0.07694772270470739}, "ep002": {"driven_any": 0.3540638671604564, "driven_lanedir": 0.3493700966360873, "in-drivable-lane": 0, "deviation-heading": 0.1815876966586882, "deviation-center-line": 0.11127745137642794}, "ep003": {"driven_any": 0.4006512181026224, "driven_lanedir": 0.39238945063391384, "in-drivable-lane": 0, "deviation-heading": 0.2632341323075033, "deviation-center-line": 0.10064492309489552}, "ep004": {"driven_any": 0.4099686882910525, "driven_lanedir": 0.4054653003100581, "in-drivable-lane": 0, "deviation-heading": 0.1839193439669325, "deviation-center-line": 0.126236662901327}}
10114516heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3220:00:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10110516heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.333333333333334


other stats
episodes
details{"ep000": {"nsteps": 36, "reward": -28.044976969818688, "good_angle": 0.7666464469069899, "survival_time": 1.2000000000000004, "traveled_tiles": 1, "valid_direction": 1.0333333333333337}, "ep001": {"nsteps": 22, "reward": -46.008810850706965, "good_angle": 0.019661774370933752, "survival_time": 0.7333333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 40, "reward": -25.42171614915133, "good_angle": 0.03801718555044795, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 45, "reward": -22.546772726045713, "good_angle": 0.06567918563705034, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 0.03333333333333344}, "ep004": {"nsteps": 46, "reward": -22.152781161925063, "good_angle": 0.03641383012341944, "survival_time": 1.5333333333333348, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max0.7666464469069899
good_angle_mean0.18528368451776828
good_angle_median0.03801718555044795
good_angle_min0.019661774370933752
reward_max-22.152781161925063
reward_mean-28.835011571529556
reward_median-25.42171614915133
reward_min-46.008810850706965
survival_time_max1.5333333333333348
survival_time_mean1.260000000000001
survival_time_min0.7333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.0333333333333337
valid_direction_mean0.21333333333333343
valid_direction_median0
valid_direction_min0
10102525heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes3220:01:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.28977579066348724
deviation-center-line_median0.2596306626838413
in-drivable-lane_median0.8999999999999968


other stats
deviation-center-line_max0.3495269439274484
deviation-center-line_mean0.2816719556808085
deviation-center-line_min0.23084578070496203
deviation-heading_max3.140638799446339
deviation-heading_mean2.412886947725279
deviation-heading_median2.769138296409296
deviation-heading_min0.834297520530139
driven_any_max0.7873202975740567
driven_any_mean0.6419688580219205
driven_any_median0.6009722981482444
driven_any_min0.5823374982056604
driven_lanedir_max0.34105884308565093
driven_lanedir_mean0.3003442252313668
driven_lanedir_min0.28535129762116584
in-drivable-lane_max3.3333333333333277
in-drivable-lane_mean1.3666666666666631
in-drivable-lane_min0.7333333333333307
per-episodes
details{"ep000": {"driven_any": 0.7873202975740567, "driven_lanedir": 0.28977579066348724, "in-drivable-lane": 3.3333333333333277, "deviation-heading": 0.834297520530139, "deviation-center-line": 0.3495269439274484}, "ep001": {"driven_any": 0.647559298004693, "driven_lanedir": 0.34105884308565093, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.140638799446339, "deviation-center-line": 0.3138973423502348}, "ep002": {"driven_any": 0.6009722981482444, "driven_lanedir": 0.2978870322519669, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 2.769138296409296, "deviation-center-line": 0.254459048737556}, "ep003": {"driven_any": 0.5823374982056604, "driven_lanedir": 0.28535129762116584, "in-drivable-lane": 1.0333333333333297, "deviation-heading": 2.4218935945541102, "deviation-center-line": 0.23084578070496203}, "ep004": {"driven_any": 0.5916548981769478, "driven_lanedir": 0.28764816253456305, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 2.89846652768651, "deviation-center-line": 0.2596306626838413}}
10094525heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3220:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10090525heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.366666666666661


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -6.709294177134309, "good_angle": 3.212081557270962, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.79999999999999}, "ep001": {"nsteps": 141, "reward": -7.600244003372822, "good_angle": 4.804851725848225, "survival_time": 4.699999999999993, "traveled_tiles": 1, "valid_direction": 3.833333333333327}, "ep002": {"nsteps": 131, "reward": -8.178489692882414, "good_angle": 4.636373361798506, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 3.6666666666666607}, "ep003": {"nsteps": 127, "reward": -8.459673733430305, "good_angle": 4.4107527352806075, "survival_time": 4.233333333333328, "traveled_tiles": 1, "valid_direction": 3.4999999999999947}, "ep004": {"nsteps": 129, "reward": -8.281368599211898, "good_angle": 4.686365787635289, "survival_time": 4.2999999999999945, "traveled_tiles": 1, "valid_direction": 3.699999999999995}}
good_angle_max4.804851725848225
good_angle_mean4.350085033566717
good_angle_median4.636373361798506
good_angle_min3.212081557270962
reward_max-6.709294177134309
reward_mean-7.84581404120635
reward_median-8.178489692882414
reward_min-8.459673733430305
survival_time_max5.6999999999999895
survival_time_mean4.659999999999993
survival_time_min4.233333333333328
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max3.833333333333327
valid_direction_mean3.499999999999994
valid_direction_median3.6666666666666607
valid_direction_min2.79999999999999
10062525heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno3220:05:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10039533heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3220:10:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10033535heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3220:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 102, in run
    solve(params, cis)
  File "solution.py", line 59, in solve
    observation = env.reset()
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 335, in reset
    return self.env.reset()
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 308, in reset
    observation = self.env.reset(**kwargs)
  File "/workspace/wrappers.py", line 89, in reset
    self.append_frame(ob)
  File "/workspace/wrappers.py", line 104, in append_frame
    ob = self.convert_img_to_gray(ob)
  File "/workspace/wrappers.py", line 108, in convert_img_to_gray
    if self.env.distortion:
AttributeError: 'TimeLimit' object has no attribute 'distortion'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10020550JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3220:03:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3576978746005717
deviation-center-line_median0.2233841557282331
in-drivable-lane_median0


other stats
deviation-center-line_max0.3503940953154788
deviation-center-line_mean0.19738717890852345
deviation-center-line_min0
deviation-heading_max12.77547708270898
deviation-heading_mean5.865458865467552
deviation-heading_median7.097049538801558
deviation-heading_min0
driven_any_max1.2739283137934605
driven_any_mean0.6107395487412631
driven_any_median0.5166434073868348
driven_any_min0.01531878084989824
driven_lanedir_max0.8619271176621262
driven_lanedir_mean0.3497392406430405
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.333333333333331
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.2739283137934605, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.3719349073541322, "driven_lanedir": 0.3576978746005717, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.2824915590704668, "deviation-center-line": 0.1192082148314856}, "ep002": {"driven_any": 0.5166434073868348, "driven_lanedir": 0.5149982021318316, "in-drivable-lane": 0, "deviation-heading": 12.77547708270898, "deviation-center-line": 0.3503940953154788}, "ep003": {"driven_any": 0.01531878084989824, "driven_lanedir": 0.014073008820673303, "in-drivable-lane": 0, "deviation-heading": 7.097049538801558, "deviation-center-line": 0.2939494286674196}, "ep004": {"driven_any": 0.8758723343219902, "driven_lanedir": 0.8619271176621262, "in-drivable-lane": 0, "deviation-heading": 9.17227614675676, "deviation-center-line": 0.2233841557282331}}
10001550JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3220:02:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9997550JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.9915735043883325, "good_angle": 2.953277850433357, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 7.033333333333329}, "ep001": {"nsteps": 41, "reward": -24.947025884215424, "good_angle": 0.3621553754560622, "survival_time": 1.3666666666666676, "traveled_tiles": 1, "valid_direction": 0.2666666666666675}, "ep002": {"nsteps": 500, "reward": -0.15607701748982072, "good_angle": 10.913104204852193, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 15.13333333333332}, "ep003": {"nsteps": 500, "reward": -0.05172294469177723, "good_angle": 3.312909787869147, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 8.36666666666666}, "ep004": {"nsteps": 500, "reward": -0.026097689567599447, "good_angle": 5.930381242691954, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.099999999999987}}
good_angle_max10.913104204852193
good_angle_mean4.694365692260542
good_angle_median3.312909787869147
good_angle_min0.3621553754560622
reward_max-0.026097689567599447
reward_mean-5.434499408070591
reward_median-0.15607701748982072
reward_min-24.947025884215424
survival_time_max16.666666666666654
survival_time_mean13.606666666666658
survival_time_min1.3666666666666676
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max15.13333333333332
valid_direction_mean8.979999999999993
valid_direction_median8.36666666666666
valid_direction_min0.2666666666666675
9961550JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3220:07:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9958560Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step2-scoringsuccessyes3220:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 205, "reward": -7.489281324060952, "good_angle": 19.307081894601037, "survival_time": 6.833333333333319, "traveled_tiles": 1, "valid_direction": 5.766666666666652}, "ep001": {"nsteps": 500, "reward": -0.986042351871729, "good_angle": 15.145414904556816, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 4.6000000000000165}, "ep002": {"nsteps": 500, "reward": -0.36160640047024933, "good_angle": 17.147016686952007, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 4.099999999999985}, "ep003": {"nsteps": 497, "reward": -2.5347018575284563, "good_angle": 16.613571805370707, "survival_time": 16.56666666666665, "traveled_tiles": 5, "valid_direction": 3.266666666666655}, "ep004": {"nsteps": 500, "reward": -0.38195983270555733, "good_angle": 16.475453322908056, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.566666666666654}}
good_angle_max19.307081894601037
good_angle_mean16.937707722877725
good_angle_median16.613571805370707
good_angle_min15.145414904556816
reward_max-0.36160640047024933
reward_mean-2.3507183533273888
reward_median-0.986042351871729
reward_min-7.489281324060952
survival_time_max16.666666666666654
survival_time_mean14.679999999999987
survival_time_min6.833333333333319
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max5.766666666666652
valid_direction_mean4.259999999999993
valid_direction_median4.099999999999985
valid_direction_min3.266666666666655
9949560Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step1-simulationsuccessno3220:03:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9939569JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3220:02:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
9925578JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3220:02:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1112780059021603
deviation-center-line_median0.14826000833213157
in-drivable-lane_median4.399999999999994


other stats
deviation-center-line_max0.932971221209534
deviation-center-line_mean0.3341223577953655
deviation-center-line_min0
deviation-heading_max2.824074396092524
deviation-heading_mean1.2458190664588202
deviation-heading_median0.6911087184990405
deviation-heading_min0
driven_any_max4.942355489727362
driven_any_mean2.5082233305496
driven_any_median2.338484933390528
driven_any_min1.3638335951679057
driven_lanedir_max2.7092869900977936
driven_lanedir_mean1.24084248250569
driven_lanedir_min0
in-drivable-lane_max6.7666666666666435
in-drivable-lane_mean4.073333333333329
in-drivable-lane_min1.1333333333333293
per-episodes
details{"ep000": {"driven_any": 1.3638335951679057, "driven_lanedir": 0, "in-drivable-lane": 4.399999999999994, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.50009968648738, "driven_lanedir": 1.1112780059021603, "in-drivable-lane": 1.1333333333333293, "deviation-heading": 2.228603310315176, "deviation-center-line": 0.44173951160764063}, "ep002": {"driven_any": 2.3963429479748264, "driven_lanedir": 0.7210890070690643, "in-drivable-lane": 6.7666666666666435, "deviation-heading": 0.6911087184990405, "deviation-center-line": 0.14826000833213157}, "ep003": {"driven_any": 2.338484933390528, "driven_lanedir": 1.6625584094594317, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 0.4853089073873599, "deviation-center-line": 0.1476410478275212}, "ep004": {"driven_any": 4.942355489727362, "driven_lanedir": 2.7092869900977936, "in-drivable-lane": 5.666666666666683, "deviation-heading": 2.824074396092524, "deviation-center-line": 0.932971221209534}}
9920578JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3220:01:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9906583JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3220:03:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9974379100572336
deviation-center-line_median0.6560590207850371
in-drivable-lane_median3.699999999999987


other stats
deviation-center-line_max1.8788618819421845
deviation-center-line_mean0.7440539779834248
deviation-center-line_min0
deviation-heading_max3.6541289260109022
deviation-heading_mean1.7614495500973806
deviation-heading_median1.3203671878871144
deviation-heading_min0
driven_any_max2.444226372077783
driven_any_mean1.6843065428712958
driven_any_median1.6572132165268052
driven_any_min0.9085628560098704
driven_lanedir_max2.2570891926315286
driven_lanedir_mean0.9682329297041452
driven_lanedir_min0
in-drivable-lane_max11.099999999999971
in-drivable-lane_mean4.733333333333325
in-drivable-lane_min0.6333333333333648
per-episodes
details{"ep000": {"driven_any": 1.6572132165268052, "driven_lanedir": 0, "in-drivable-lane": 11.099999999999971, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.6544189234489706, "driven_lanedir": 1.1038938191780283, "in-drivable-lane": 3.699999999999987, "deviation-heading": 2.7077627268438604, "deviation-center-line": 0.6560590207850371}, "ep002": {"driven_any": 0.9085628560098704, "driven_lanedir": 0.48274372665393583, "in-drivable-lane": 2.79999999999999, "deviation-heading": 1.3203671878871144, "deviation-center-line": 0.30032301321125654}, "ep003": {"driven_any": 1.75711134629305, "driven_lanedir": 0.9974379100572336, "in-drivable-lane": 5.433333333333315, "deviation-heading": 1.1249889097450263, "deviation-center-line": 0.885025973978646}, "ep004": {"driven_any": 2.444226372077783, "driven_lanedir": 2.2570891926315286, "in-drivable-lane": 0.6333333333333648, "deviation-heading": 3.6541289260109022, "deviation-center-line": 1.8788618819421845}}
9902580JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.43333333333332


other stats
episodes
details{"ep000": {"nsteps": 143, "reward": -9.055095615295263, "good_angle": 0.7570327326635212, "survival_time": 4.7666666666666595, "traveled_tiles": 2, "valid_direction": 2.533333333333333}, "ep001": {"nsteps": 246, "reward": -5.127750908272347, "good_angle": 18.73217636508801, "survival_time": 8.199999999999982, "traveled_tiles": 3, "valid_direction": 5.3666666666666485}, "ep002": {"nsteps": 146, "reward": -7.193721256096056, "good_angle": 2.880249098684444, "survival_time": 4.866666666666659, "traveled_tiles": 2, "valid_direction": 2.0666666666666593}, "ep003": {"nsteps": 193, "reward": -6.5783478357042595, "good_angle": 1.0920425770674187, "survival_time": 6.43333333333332, "traveled_tiles": 3, "valid_direction": 3.733333333333327}, "ep004": {"nsteps": 371, "reward": -4.00069258227079, "good_angle": 28.808419526324304, "survival_time": 12.366666666666632, "traveled_tiles": 4, "valid_direction": 5.599999999999981}}
good_angle_max28.808419526324304
good_angle_mean10.453984059965538
good_angle_median2.880249098684444
good_angle_min0.7570327326635212
reward_max-4.00069258227079
reward_mean-6.391121639527744
reward_median-6.5783478357042595
reward_min-9.055095615295263
survival_time_max12.366666666666632
survival_time_mean7.326666666666651
survival_time_min4.7666666666666595
traveled_tiles_max4
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max5.599999999999981
valid_direction_mean3.8599999999999897
valid_direction_median3.733333333333327
valid_direction_min2.0666666666666593
9888579JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3220:04:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9881595heyt0nyPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3220:01:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.55051472122708
deviation-center-line_median0.29477862850039127
in-drivable-lane_median3.266666666666655


other stats
deviation-center-line_max0.49802291989440306
deviation-center-line_mean0.30668333839910394
deviation-center-line_min0.177238888402093
deviation-heading_max2.6979462349680485
deviation-heading_mean1.5455686771252173
deviation-heading_median1.2045236421402643
deviation-heading_min0.9497524785792189
driven_any_max1.2625451582899918
driven_any_mean1.022041299359235
driven_any_median1.183412567333336
driven_any_min0.34650700511837895
driven_lanedir_max0.8808916705365143
driven_lanedir_mean0.5432996048703389
driven_lanedir_min0.12059746380215151
in-drivable-lane_max4.433333333333318
in-drivable-lane_mean2.6599999999999913
in-drivable-lane_min0.8666666666666666
per-episodes
details{"ep000": {"driven_any": 0.34650700511837895, "driven_lanedir": 0.12059746380215151, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 1.8972189002308293, "deviation-center-line": 0.177238888402093}, "ep001": {"driven_any": 1.183412567333336, "driven_lanedir": 0.6413769201476682, "in-drivable-lane": 3.266666666666655, "deviation-heading": 1.2045236421402643, "deviation-center-line": 0.29477862850039127}, "ep002": {"driven_any": 1.256240246954395, "driven_lanedir": 0.8808916705365143, "in-drivable-lane": 1.3666666666666618, "deviation-heading": 2.6979462349680485, "deviation-center-line": 0.49802291989440306}, "ep003": {"driven_any": 1.2625451582899918, "driven_lanedir": 0.55051472122708, "in-drivable-lane": 4.433333333333318, "deviation-heading": 0.9784021297077256, "deviation-center-line": 0.33306468964228786}, "ep004": {"driven_any": 1.0615015191000727, "driven_lanedir": 0.5231172486382809, "in-drivable-lane": 3.3666666666666547, "deviation-heading": 0.9497524785792189, "deviation-center-line": 0.23031156555634455}}
9870595heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3220:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9863589Allen OuRandom executionaido1_LF1_r3-v3step1-simulationsuccessno3220:02:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9858594heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3220:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 102, in run
    solve(params, cis)
  File "solution.py", line 42, in solve
    env = make_env(config)
  File "solution.py", line 23, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
9852598heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3220:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 18, in make_env
    env.__init__(frame_skip=config['frame_skip'])
TypeError: __init__() got an unexpected keyword argument 'frame_skip'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
9838607lavoiemsPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3220:01:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5817518146270011
deviation-center-line_median0.2952502921419843
in-drivable-lane_median3.1666666666666554


other stats
deviation-center-line_max0.40892985328262493
deviation-center-line_mean0.2831911426505906
deviation-center-line_min0.1620247894347336
deviation-heading_max2.2040069966368883
deviation-heading_mean1.4148422019341882
deviation-heading_median1.218375420877054
deviation-heading_min0.9167759611460088
driven_any_max1.2827445223589422
driven_any_mean1.014736166443874
driven_any_median1.1350606441335214
driven_any_min0.3480125711176469
driven_lanedir_max0.7202788624391077
driven_lanedir_mean0.5167791411482727
driven_lanedir_min0.11591417145156856
in-drivable-lane_max4.466666666666651
in-drivable-lane_mean2.9266666666666565
in-drivable-lane_min0.8666666666666666
per-episodes
details{"ep000": {"driven_any": 0.3480125711176469, "driven_lanedir": 0.11591417145156856, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 1.733778638085675, "deviation-center-line": 0.1620247894347336}, "ep001": {"driven_any": 1.1350606441335214, "driven_lanedir": 0.6361723258818657, "in-drivable-lane": 3.1666666666666554, "deviation-heading": 1.218375420877054, "deviation-center-line": 0.2952502921419843}, "ep002": {"driven_any": 1.2827445223589422, "driven_lanedir": 0.7202788624391077, "in-drivable-lane": 2.7333333333333236, "deviation-heading": 2.2040069966368883, "deviation-center-line": 0.40892985328262493}, "ep003": {"driven_any": 1.2646460275940734, "driven_lanedir": 0.5817518146270011, "in-drivable-lane": 4.466666666666651, "deviation-heading": 0.9167759611460088, "deviation-center-line": 0.2999117410895583}, "ep004": {"driven_any": 1.0432170670151864, "driven_lanedir": 0.5297785313418206, "in-drivable-lane": 3.399999999999988, "deviation-heading": 1.0012739929253152, "deviation-center-line": 0.249839037304052}}
9831607lavoiemsPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3220:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9822609DavidRandom executionaido1_LF1_r3-v3step3-videossuccessyes3220:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9819609DavidRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.533333333333314


other stats
episodes
details{"ep000": {"nsteps": 78, "reward": -13.078483520004038, "good_angle": 1.2777700951360833, "survival_time": 2.6000000000000005, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 230, "reward": -5.421979546611723, "good_angle": 16.62108258761784, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 256, "reward": -4.113732517773315, "good_angle": 1.090332932063625, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.9999999999999936}, "ep003": {"nsteps": 456, "reward": -2.176277954494684, "good_angle": 1.463557279882934, "survival_time": 15.199999999999957, "traveled_tiles": 4, "valid_direction": 2.2333333333333254}, "ep004": {"nsteps": 344, "reward": -3.632518819408582, "good_angle": 22.286394480671035, "survival_time": 11.466666666666637, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}
good_angle_max22.286394480671035
good_angle_mean8.547827475074303
good_angle_median1.463557279882934
good_angle_min1.090332932063625
reward_max-2.176277954494684
reward_mean-5.684598471658468
reward_median-4.113732517773315
reward_min-13.078483520004038
survival_time_max15.199999999999957
survival_time_mean9.09333333333331
survival_time_min2.6000000000000005
traveled_tiles_max4
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.93333333333332
valid_direction_mean2.8466666666666582
valid_direction_median2.2333333333333254
valid_direction_min1.9999999999999936
9809608DavidRandom executionaido1_LF1_r3-v3step1-simulationsuccessno3220:02:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9800615DavidPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3220:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9797615DavidPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.433333333333317


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.964819115303646, "good_angle": 1.3887589327794136, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.2}, "ep001": {"nsteps": 51, "reward": -20.172274533440085, "good_angle": 0.06639180550117507, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 233, "reward": -4.806144984634873, "good_angle": 2.659793622525141, "survival_time": 7.766666666666649, "traveled_tiles": 3, "valid_direction": 4.73333333333332}, "ep003": {"nsteps": 235, "reward": -5.393563101096252, "good_angle": 0.9412856968364084, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 4.066666666666656}, "ep004": {"nsteps": 223, "reward": -5.552561751343394, "good_angle": 7.11694324077688, "survival_time": 7.433333333333317, "traveled_tiles": 3, "valid_direction": 4.533333333333317}}
good_angle_max7.11694324077688
good_angle_mean2.434634659683804
good_angle_median1.3887589327794136
good_angle_min0.06639180550117507
reward_max-4.806144984634873
reward_mean-9.777872697163648
reward_median-5.552561751343394
reward_min-20.172274533440085
survival_time_max7.833333333333315
survival_time_mean5.473333333333323
survival_time_min1.700000000000002
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.73333333333332
valid_direction_mean3.1066666666666585
valid_direction_median4.066666666666656
valid_direction_min0
9788636JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3220:03:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9380054565078636
deviation-center-line_median0.7126907630680461
in-drivable-lane_median3.7999999999999865


other stats
deviation-center-line_max1.8349013072161051
deviation-center-line_mean0.7606140342655762
deviation-center-line_min0
deviation-heading_max4.000095424782763
deviation-heading_mean1.9140955172511205
deviation-heading_median1.4637106130961894
deviation-heading_min0
driven_any_max2.143457414751776
driven_any_mean1.6274561666558576
driven_any_median1.674387223358706
driven_any_min0.9118688115095994
driven_lanedir_max2.0579906909896306
driven_lanedir_mean0.9170277469547744
driven_lanedir_min0
in-drivable-lane_max11.39999999999997
in-drivable-lane_mean4.799999999999985
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.6498457175258825, "driven_lanedir": 0, "in-drivable-lane": 11.39999999999997, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.674387223358706, "driven_lanedir": 1.115572352760403, "in-drivable-lane": 3.7999999999999865, "deviation-heading": 2.8712499206109667, "deviation-center-line": 0.7126907630680461}, "ep002": {"driven_any": 0.9118688115095994, "driven_lanedir": 0.4735702345159749, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 1.4637106130961894, "deviation-center-line": 0.33682364155623246}, "ep003": {"driven_any": 1.7577216661333237, "driven_lanedir": 0.9380054565078636, "in-drivable-lane": 5.89999999999998, "deviation-heading": 1.235421627765684, "deviation-center-line": 0.9186544594874968}, "ep004": {"driven_any": 2.143457414751776, "driven_lanedir": 2.0579906909896306, "in-drivable-lane": 0, "deviation-heading": 4.000095424782763, "deviation-center-line": 1.8349013072161051}}
9780636JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3220:02:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9774636JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.133333333333296


other stats
episodes
details{"ep000": {"nsteps": 343, "reward": -4.326038247207858, "good_angle": 1.5071913824509586, "survival_time": 11.433333333333303, "traveled_tiles": 4, "valid_direction": 3.133333333333324}, "ep001": {"nsteps": 399, "reward": -3.2367494594840274, "good_angle": 23.079763548934057, "survival_time": 13.299999999999963, "traveled_tiles": 5, "valid_direction": 8.533333333333308}, "ep002": {"nsteps": 207, "reward": -5.7284160205230545, "good_angle": 2.5298394091002985, "survival_time": 6.899999999999985, "traveled_tiles": 4, "valid_direction": 5.033333333333319}, "ep003": {"nsteps": 394, "reward": -3.425427709232193, "good_angle": 1.971505700379977, "survival_time": 13.133333333333296, "traveled_tiles": 5, "valid_direction": 3.0333333333333226}, "ep004": {"nsteps": 500, "reward": -0.22137247162731363, "good_angle": 17.814062454108363, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.8333333333333233}}
good_angle_max23.079763548934057
good_angle_mean9.380472498994733
good_angle_median2.5298394091002985
good_angle_min1.5071913824509586
reward_max-0.22137247162731363
reward_mean-3.387600781614889
reward_median-3.425427709232193
reward_min-5.7284160205230545
survival_time_max16.666666666666654
survival_time_mean12.286666666666642
survival_time_min6.899999999999985
traveled_tiles_max5
traveled_tiles_mean4.6
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max8.533333333333308
valid_direction_mean4.71333333333332
valid_direction_median3.8333333333333233
valid_direction_min3.0333333333333226
9728636JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3220:13:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
97161266gunshiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:00:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
97141266gunshiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:03:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
97111265gunshiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7509590474963188, "good_angle": 0.7623275168979947, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 2.2000000000000153}, "ep001": {"nsteps": 19, "reward": -53.2929768640744, "good_angle": 0.4118633597471749, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 42, "reward": -24.31371263733932, "good_angle": 0.54212216252969, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.6333333333333344}, "ep003": {"nsteps": 58, "reward": -17.620822914715472, "good_angle": 0.4816578669497647, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 0.8666666666666691}, "ep004": {"nsteps": 69, "reward": -14.973187633614607, "good_angle": 0.3956302888124995, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.49999999999999933}}
good_angle_max0.7623275168979947
good_angle_mean0.5187202389874248
good_angle_median0.4816578669497647
good_angle_min0.3956302888124995
reward_max-0.7509590474963188
reward_mean-22.190331819448023
reward_median-17.620822914715472
reward_min-53.2929768640744
survival_time_max16.666666666666654
survival_time_mean4.586666666666665
survival_time_min0.6333333333333333
traveled_tiles_max4
traveled_tiles_mean1.8
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max2.2000000000000153
valid_direction_mean0.9333333333333368
valid_direction_median0.6333333333333344
valid_direction_min0.4666666666666666
97061264gunshiROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3220:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9706-4167', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9706-4167', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9706-4167_evaluation" with the default driver
stderr | Creating job9706-4167_visualization_1 ...
stderr | 
Creating job9706-4167_visualization_1 ... error

stderr | ERROR: for job9706-4167_visualization_1  Cannot start service visualization: network job9706-4167_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9706-4167_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
97031264gunshiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
97001264gunshiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4666666666666677


other stats
episodes
details{"ep000": {"nsteps": 244, "reward": -4.374022879227462, "good_angle": 0.6697246300368211, "survival_time": 8.133333333333315, "traveled_tiles": 2, "valid_direction": 1.5999999999999943}, "ep001": {"nsteps": 70, "reward": -14.862278394613949, "good_angle": 0.02721982411650538, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 46, "reward": -22.19249565705009, "good_angle": 0.5394539707593838, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.6333333333333349}, "ep003": {"nsteps": 127, "reward": -8.308228122143765, "good_angle": 0.31993870085218107, "survival_time": 4.233333333333328, "traveled_tiles": 2, "valid_direction": 0.4999999999999988}, "ep004": {"nsteps": 74, "reward": -14.009329262617472, "good_angle": 0.30200732283866505, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 0.7}}
good_angle_max0.6697246300368211
good_angle_mean0.37166888972071127
good_angle_median0.31993870085218107
good_angle_min0.02721982411650538
reward_max-4.374022879227462
reward_mean-12.749270863130548
reward_median-14.009329262617472
reward_min-22.19249565705009
survival_time_max8.133333333333315
survival_time_mean3.739999999999996
survival_time_min1.5333333333333348
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.5999999999999943
valid_direction_mean0.6866666666666656
valid_direction_median0.6333333333333349
valid_direction_min0
96181224tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.18593727052428743
deviation-center-line_median0.13545724334442524
in-drivable-lane_median0


other stats
deviation-center-line_max0.2121252201534077
deviation-center-line_mean0.15204467621031437
deviation-center-line_min0.0907236145497465
deviation-heading_max1.8103033288132035
deviation-heading_mean0.8249094550042821
deviation-heading_median0.619221007243969
deviation-heading_min0.3806880627276445
driven_any_max0.5535890739311885
driven_any_mean0.24785545912074977
driven_any_median0.20712862085625497
driven_any_min0.08927803999964294
driven_lanedir_max0.2864168380688654
driven_lanedir_mean0.1796007061408972
driven_lanedir_min0.07496946865388754
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5535890739311885, "driven_lanedir": 0.2864168380688654, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8103033288132035, "deviation-center-line": 0.2121252201534077}, "ep001": {"driven_any": 0.08927803999964294, "driven_lanedir": 0.07496946865388754, "in-drivable-lane": 0, "deviation-heading": 0.3806880627276445, "deviation-center-line": 0.0907236145497465}, "ep002": {"driven_any": 0.15356656289145348, "driven_lanedir": 0.13200096264385608, "in-drivable-lane": 0, "deviation-heading": 0.619221007243969, "deviation-center-line": 0.12749989711054877}, "ep003": {"driven_any": 0.20712862085625497, "driven_lanedir": 0.18593727052428743, "in-drivable-lane": 0, "deviation-heading": 0.7317863776228286, "deviation-center-line": 0.13545724334442524}, "ep004": {"driven_any": 0.23571499792520892, "driven_lanedir": 0.21867899081358955, "in-drivable-lane": 0, "deviation-heading": 0.5825484986137648, "deviation-center-line": 0.19441740589344356}}
96071224tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:02:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
96051222tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1807338873608093
deviation-center-line_median0.13452512547239487
in-drivable-lane_median0


other stats
deviation-center-line_max0.4124544142944212
deviation-center-line_mean0.18912194934377977
deviation-center-line_min0.06268266302842321
deviation-heading_max1.7871938259410494
deviation-heading_mean0.8226556950032606
deviation-heading_median0.5944441686133701
deviation-heading_min0.38613631001544
driven_any_max0.7857253580900156
driven_any_mean0.2899975734536556
driven_any_median0.2035598930350403
driven_any_min0.05713403004751415
driven_lanedir_max0.5414003755333896
driven_lanedir_mean0.2263753128558962
driven_lanedir_min0.04148445741543805
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7857253580900156, "driven_lanedir": 0.5414003755333896, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7871938259410494, "deviation-center-line": 0.4124544142944212}, "ep001": {"driven_any": 0.05713403004751415, "driven_lanedir": 0.04148445741543805, "in-drivable-lane": 0, "deviation-heading": 0.38613631001544, "deviation-center-line": 0.06268266302842321}, "ep002": {"driven_any": 0.16785200488169094, "driven_lanedir": 0.14806636739144352, "in-drivable-lane": 0, "deviation-heading": 0.5944441686133701, "deviation-center-line": 0.13452512547239487}, "ep003": {"driven_any": 0.2035598930350403, "driven_lanedir": 0.1807338873608093, "in-drivable-lane": 0, "deviation-heading": 0.7686117058905607, "deviation-center-line": 0.13346968114615476}, "ep004": {"driven_any": 0.23571658121401692, "driven_lanedir": 0.22019147657840055, "in-drivable-lane": 0, "deviation-heading": 0.5768924645558832, "deviation-center-line": 0.20247786277750465}}
95971222tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9666666666666697


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -4.719582723466226, "good_angle": 0.827690981535544, "survival_time": 7.399999999999984, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 18, "reward": -56.20794405208694, "good_angle": 0.3910074945079643, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 49, "reward": -20.86513386332259, "good_angle": 0.4576640242189694, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.6666666666666685}, "ep003": {"nsteps": 59, "reward": -17.31513208580219, "good_angle": 0.5169655128458458, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.9000000000000025}, "ep004": {"nsteps": 68, "reward": -15.1840578650727, "good_angle": 0.3522119257447155, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.5666666666666664}}
good_angle_max0.827690981535544
good_angle_mean0.5091079877706078
good_angle_median0.4576640242189694
good_angle_min0.3522119257447155
reward_max-4.719582723466226
reward_mean-22.85837011795013
reward_median-17.31513208580219
reward_min-56.20794405208694
survival_time_max7.399999999999984
survival_time_mean2.773333333333331
survival_time_min0.6
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.8066666666666664
valid_direction_median0.6666666666666685
valid_direction_min0.4333333333333333
95901221tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 304, "reward": -3.544891038253186, "good_angle": 0.6149347500527267, "survival_time": 10.133333333333308, "traveled_tiles": 3, "valid_direction": 1.0333333333333297}, "ep001": {"nsteps": 18, "reward": -56.21945972906219, "good_angle": 0.39524455375135303, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 54, "reward": -19.004341699458937, "good_angle": 0.35626957262112674, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 0.8666666666666689}, "ep003": {"nsteps": 181, "reward": -5.987739168766124, "good_angle": 0.07938019184648165, "survival_time": 6.033333333333322, "traveled_tiles": 2, "valid_direction": 0.06666666666666671}, "ep004": {"nsteps": 69, "reward": -14.957443509844769, "good_angle": 0.40783681279472545, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.7}}
good_angle_max0.6149347500527267
good_angle_mean0.37073317621328267
good_angle_median0.39524455375135303
good_angle_min0.07938019184648165
reward_max-3.544891038253186
reward_mean-19.942775029077037
reward_median-14.957443509844769
reward_min-56.21945972906219
survival_time_max10.133333333333308
survival_time_mean4.173333333333327
survival_time_min0.6
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.0333333333333297
valid_direction_mean0.6266666666666664
valid_direction_median0.7
valid_direction_min0.06666666666666671
95731219MandanaSamieiImproved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.319983455359965
deviation-center-line_median0.33174953750978914
in-drivable-lane_median0


other stats
deviation-center-line_max0.6509099876476642
deviation-center-line_mean0.33511713874589744
deviation-center-line_min0.1301864645305511
deviation-heading_max1.5797604979275617
deviation-heading_mean0.7649196786586597
deviation-heading_median0.6099670625891219
deviation-heading_min0.26011274137512863
driven_any_max1.1000741042066198
driven_any_mean0.4528758592856047
driven_any_median0.3214479430386286
driven_any_min0.15713599716398322
driven_lanedir_max0.8768350771073734
driven_lanedir_mean0.39849736172116934
driven_lanedir_min0.13699082192683787
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1000741042066198, "driven_lanedir": 0.8768350771073734, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.5797604979275617, "deviation-center-line": 0.6509099876476642}, "ep001": {"driven_any": 0.3214479430386286, "driven_lanedir": 0.319983455359965, "in-drivable-lane": 0, "deviation-heading": 0.26011274137512863, "deviation-center-line": 0.33174953750978914}, "ep002": {"driven_any": 0.15713599716398322, "driven_lanedir": 0.13699082192683787, "in-drivable-lane": 0, "deviation-heading": 0.6099670625891219, "deviation-center-line": 0.1301864645305511}, "ep003": {"driven_any": 0.45358418885246193, "driven_lanedir": 0.43892107953366954, "in-drivable-lane": 0, "deviation-heading": 0.7984988043681084, "deviation-center-line": 0.35299897661705215}, "ep004": {"driven_any": 0.23213706316633032, "driven_lanedir": 0.2197563746780009, "in-drivable-lane": 0, "deviation-heading": 0.5762592870333781, "deviation-center-line": 0.2097407274244307}}
95681219MandanaSamieiImproved ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0666666666666655


other stats
episodes
details{"ep000": {"nsteps": 310, "reward": -3.4877520964229327, "good_angle": 0.4337545578195331, "survival_time": 10.333333333333307, "traveled_tiles": 3, "valid_direction": 0.7666666666666639}, "ep001": {"nsteps": 92, "reward": -11.437303474091966, "good_angle": 0.028099747606272065, "survival_time": 3.0666666666666655, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 46, "reward": -22.215619474001553, "good_angle": 0.46054995613055394, "survival_time": 1.5333333333333348, "traveled_tiles": 2, "valid_direction": 0.7333333333333348}, "ep003": {"nsteps": 129, "reward": -8.17187888290762, "good_angle": 0.33196345155076035, "survival_time": 4.2999999999999945, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep004": {"nsteps": 67, "reward": -15.426527907599263, "good_angle": 0.28042737289660535, "survival_time": 2.233333333333335, "traveled_tiles": 1, "valid_direction": 0.6333333333333335}}
good_angle_max0.46054995613055394
good_angle_mean0.3069590172007449
good_angle_median0.33196345155076035
good_angle_min0.028099747606272065
reward_max-3.4877520964229327
reward_mean-12.147816367004667
reward_median-11.437303474091966
reward_min-22.215619474001553
survival_time_max10.333333333333307
survival_time_mean4.293333333333328
survival_time_min1.5333333333333348
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.7666666666666639
valid_direction_mean0.5133333333333328
valid_direction_median0.6333333333333335
valid_direction_min0
95641219MandanaSamieiImproved ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3220:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9564-1873', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9564-1873', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9564-1873_evaluation" with the default driver
stderr | Creating job9564-1873_evaluator_1 ...
stderr | Creating job9564-1873_solution_1  ...
stderr | 
Creating job9564-1873_evaluator_1 ... error

stderr | ERROR: for job9564-1873_evaluator_1  Cannot start service evaluator: network job9564-1873_evaluation not found
stderr | 
Creating job9564-1873_solution_1  ... error

stderr | ERROR: for job9564-1873_solution_1  Cannot start service solution: network job9564-1873_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9564-1873_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9564-1873_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
95601218JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3220:04:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.991915856330536
deviation-center-line_median0.9364838319971908
in-drivable-lane_median2.499999999999991


other stats
deviation-center-line_max1.0676711077521397
deviation-center-line_mean0.8130895808496119
deviation-center-line_min0.1229629401888518
deviation-heading_max2.8510293130096054
deviation-heading_mean2.058613300121737
deviation-heading_median2.4944146864875445
deviation-heading_min0.06335780452941518
driven_any_max6.340440794264879
driven_any_mean5.139007959420065
driven_any_median6.333250237577308
driven_any_min0.3930632008756537
driven_lanedir_max5.489389175380863
driven_lanedir_mean4.13773982673794
driven_lanedir_min0.3919959004281719
in-drivable-lane_max4.066666666666652
in-drivable-lane_mean2.3199999999999923
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.288365540766493, "driven_lanedir": 4.991915856330536, "in-drivable-lane": 3.166666666666657, "deviation-heading": 2.8510293130096054, "deviation-center-line": 0.921706054557795}, "ep001": {"driven_any": 0.3930632008756537, "driven_lanedir": 0.3919959004281719, "in-drivable-lane": 0, "deviation-heading": 0.06335780452941518, "deviation-center-line": 0.1229629401888518}, "ep002": {"driven_any": 6.340440794264879, "driven_lanedir": 5.489389175380863, "in-drivable-lane": 1.86666666666666, "deviation-heading": 2.4944146864875445, "deviation-center-line": 1.016623969752082}, "ep003": {"driven_any": 6.333250237577308, "driven_lanedir": 5.233205580663916, "in-drivable-lane": 2.499999999999991, "deviation-heading": 2.7190723206994707, "deviation-center-line": 0.9364838319971908}, "ep004": {"driven_any": 6.339920023615989, "driven_lanedir": 4.582192620886213, "in-drivable-lane": 4.066666666666652, "deviation-heading": 2.1651923758826483, "deviation-center-line": 1.0676711077521397}}
95531218JonJP pipelineaido1_LF1_r3-v3step2-scoringabortedyes3220:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9553-9012', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9553-9012', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9553-9012_evaluation" with the default driver
stderr | Creating job9553-9012_scorer_1 ...
stderr | 
Creating job9553-9012_scorer_1 ... error

stderr | ERROR: for job9553-9012_scorer_1  Cannot start service scorer: network job9553-9012_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9553-9012_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
95441216VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:04:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median8.612961693827268
deviation-center-line_median1.66985101080796
in-drivable-lane_median2.866666666666658


other stats
deviation-center-line_max1.8035219663301965
deviation-center-line_mean1.6672943452898472
deviation-center-line_min1.4702979645281968
deviation-heading_max2.241648152033716
deviation-heading_mean1.9336734107589677
deviation-heading_median1.922786813802037
deviation-heading_min1.631921368105764
driven_any_max10.671132227372407
driven_any_mean10.670566151885527
driven_any_median10.67072031050144
driven_any_min10.66985370366328
driven_lanedir_max10.311802660582206
driven_lanedir_mean9.103591402096644
driven_lanedir_min8.108706441916016
in-drivable-lane_max3.633333333333322
in-drivable-lane_mean2.09333333333333
in-drivable-lane_min0.13333333333333286
per-episodes
details{"ep000": {"driven_any": 10.67107143524292, "driven_lanedir": 8.108706441916016, "in-drivable-lane": 3.633333333333322, "deviation-heading": 1.922786813802037, "deviation-center-line": 1.6270418552733978}, "ep001": {"driven_any": 10.66985370366328, "driven_lanedir": 9.999863293554435, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 2.1745670886237196, "deviation-center-line": 1.8035219663301965}, "ep002": {"driven_any": 10.67072031050144, "driven_lanedir": 8.612961693827268, "in-drivable-lane": 2.866666666666658, "deviation-heading": 1.6974436312296035, "deviation-center-line": 1.7657589295094858}, "ep003": {"driven_any": 10.671132227372407, "driven_lanedir": 8.484622920603297, "in-drivable-lane": 3.13333333333334, "deviation-heading": 1.631921368105764, "deviation-center-line": 1.66985101080796}, "ep004": {"driven_any": 10.6700530826476, "driven_lanedir": 10.311802660582206, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.241648152033716, "deviation-center-line": 1.4702979645281968}}
95411216VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:02:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
95311217pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3220:01:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
95281216VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.47290116201527416, "good_angle": 0.620527758689177, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.4666666666666688}, "ep001": {"nsteps": 500, "reward": -0.3814245066232979, "good_angle": 20.941140955183226, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.2333333333333236}, "ep002": {"nsteps": 500, "reward": -0.4611001099124551, "good_angle": 0.6792900770956242, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.699999999999997}, "ep003": {"nsteps": 500, "reward": -0.49903926293135736, "good_angle": 0.5362987411971321, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.4333333333333318}, "ep004": {"nsteps": 500, "reward": -0.264232877929011, "good_angle": 6.46899920987801, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.433333333333334}}
good_angle_max20.941140955183226
good_angle_mean5.849251348408634
good_angle_median0.6792900770956242
good_angle_min0.5362987411971321
reward_max-0.264232877929011
reward_mean-0.4157395838822791
reward_median-0.4611001099124551
reward_min-0.49903926293135736
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean16.4
traveled_tiles_median18
traveled_tiles_min10
valid_direction_max3.2333333333333236
valid_direction_mean1.853333333333331
valid_direction_median1.4666666666666688
valid_direction_min1.4333333333333318
95171214VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:04:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median8.380031834700327
deviation-center-line_median1.8216344935051665
in-drivable-lane_median3.1000000000000085


other stats
deviation-center-line_max2.2186804288744444
deviation-center-line_mean1.7284263168741802
deviation-center-line_min1.1078363783146623
deviation-heading_max2.144995452064431
deviation-heading_mean1.9111625744718592
deviation-heading_median1.850258045639916
deviation-heading_min1.6309841184487237
driven_any_max10.670296672904689
driven_any_mean10.669979600445242
driven_any_median10.669957809919891
driven_any_min10.66961993359614
driven_lanedir_max10.026376589003922
driven_lanedir_mean8.74497308572596
driven_lanedir_min7.5908490443310335
in-drivable-lane_max4.566666666666688
in-drivable-lane_mean2.6333333333333364
in-drivable-lane_min0.6666666666666643
per-episodes
details{"ep000": {"driven_any": 10.67015207490375, "driven_lanedir": 7.5908490443310335, "in-drivable-lane": 4.566666666666688, "deviation-heading": 1.6309841184487237, "deviation-center-line": 1.8216344935051665}, "ep001": {"driven_any": 10.669871510901745, "driven_lanedir": 9.66555788844542, "in-drivable-lane": 1.133333333333331, "deviation-heading": 2.1443746360362512, "deviation-center-line": 1.59376126332873}, "ep002": {"driven_any": 10.66961993359614, "driven_lanedir": 8.062050072149091, "in-drivable-lane": 3.6999999999999913, "deviation-heading": 1.7852006201699744, "deviation-center-line": 1.9002190203478984}, "ep003": {"driven_any": 10.670296672904689, "driven_lanedir": 8.380031834700327, "in-drivable-lane": 3.1000000000000085, "deviation-heading": 1.850258045639916, "deviation-center-line": 1.1078363783146623}, "ep004": {"driven_any": 10.669957809919891, "driven_lanedir": 10.026376589003922, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 2.144995452064431, "deviation-center-line": 2.2186804288744444}}
95151214VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyes3220:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9515-52', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9515-52', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9515-52_evaluation" with the default driver
stderr | Creating job9515-52_videos_1 ...
stderr | 
Creating job9515-52_videos_1 ... error

stderr | ERROR: for job9515-52_videos_1  Cannot start service videos: network job9515-52_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9515-52_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
95121214VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5630718003562651, "good_angle": 0.8280733763807488, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.2666666666666586}, "ep001": {"nsteps": 500, "reward": -0.33669511875876923, "good_angle": 16.193088908095046, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.8333333333333255}, "ep002": {"nsteps": 500, "reward": -0.4914418018744327, "good_angle": 0.8988409791019193, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.366666666666663}, "ep003": {"nsteps": 500, "reward": -0.3387374090035446, "good_angle": 0.848640220116467, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.9666666666666668}, "ep004": {"nsteps": 500, "reward": -0.394331519811818, "good_angle": 21.28040776776547, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.466666666666673}}
good_angle_max21.28040776776547
good_angle_mean8.009810250291931
good_angle_median0.8988409791019193
good_angle_min0.8280733763807488
reward_max-0.33669511875876923
reward_mean-0.4248555299609659
reward_median-0.394331519811818
reward_min-0.5630718003562651
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean16.8
traveled_tiles_median18
traveled_tiles_min12
valid_direction_max3.466666666666673
valid_direction_mean2.5799999999999974
valid_direction_median2.366666666666663
valid_direction_min1.9666666666666668
95031214VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:07:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
94901211VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:02:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
94841212iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3220:00:16
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9484-4760', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9484-4760', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9484-4760_evaluation" with the default driver
stderr | Creating job9484-4760_evaluator_1 ...
stderr | Creating job9484-4760_solution_1  ...
stderr | 
Creating job9484-4760_evaluator_1 ... error

stderr | ERROR: for job9484-4760_evaluator_1  Cannot start service evaluator: network job9484-4760_evaluation not found
stderr | 
Creating job9484-4760_solution_1  ... error

stderr | ERROR: for job9484-4760_solution_1  Cannot start service solution: network job9484-4760_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9484-4760_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9484-4760_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
94791209BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3220:01:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
94731210iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.16192793063367894
deviation-center-line_median0.16712437590511792
in-drivable-lane_median0


other stats
deviation-center-line_max0.22126768041627895
deviation-center-line_mean0.16783232829321587
deviation-center-line_min0.11820557536251376
deviation-heading_max1.8189757893407377
deviation-heading_mean0.8163676046817996
deviation-heading_median0.6235372451412512
deviation-heading_min0.24125834371519225
driven_any_max0.5607239074667805
driven_any_mean0.26142832527599685
driven_any_median0.18928439438724204
driven_any_min0.15355884723205154
driven_lanedir_max0.295640154265449
driven_lanedir_mean0.19503859622849812
driven_lanedir_min0.13353693337170247
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5607239074667805, "driven_lanedir": 0.295640154265449, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8189757893407377, "deviation-center-line": 0.22126768041627895}, "ep001": {"driven_any": 0.16429082438795536, "driven_lanedir": 0.16192793063367894, "in-drivable-lane": 0, "deviation-heading": 0.24125834371519225, "deviation-center-line": 0.16712437590511792}, "ep002": {"driven_any": 0.15355884723205154, "driven_lanedir": 0.13353693337170247, "in-drivable-lane": 0, "deviation-heading": 0.6235372451412512, "deviation-center-line": 0.1298332656633387}, "ep003": {"driven_any": 0.18928439438724204, "driven_lanedir": 0.1615232745567865, "in-drivable-lane": 0, "deviation-heading": 0.7874587436114462, "deviation-center-line": 0.11820557536251376}, "ep004": {"driven_any": 0.2392836529059548, "driven_lanedir": 0.22256468831487375, "in-drivable-lane": 0, "deviation-heading": 0.610607901600371, "deviation-center-line": 0.20273074411883013}}
94701210iban_alexROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8333333333333357


other stats
episodes
details{"ep000": {"nsteps": 159, "reward": -6.4198306880982114, "good_angle": 1.314083990846676, "survival_time": 5.299999999999991, "traveled_tiles": 2, "valid_direction": 1.4333333333333282}, "ep001": {"nsteps": 48, "reward": -21.383061233907934, "good_angle": 0.04504303341914202, "survival_time": 1.6000000000000016, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 45, "reward": -22.709559181001453, "good_angle": 0.45126981268589783, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 0.8333333333333346}, "ep003": {"nsteps": 55, "reward": -18.540535766563632, "good_angle": 0.6241061881472154, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0.6666666666666687}, "ep004": {"nsteps": 69, "reward": -14.96533111256102, "good_angle": 0.3778306809308791, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.7333333333333334}}
good_angle_max1.314083990846676
good_angle_mean0.5624667412059621
good_angle_median0.45126981268589783
good_angle_min0.04504303341914202
reward_max-6.4198306880982114
reward_mean-16.803663596426453
reward_median-18.540535766563632
reward_min-22.709559181001453
survival_time_max5.299999999999991
survival_time_mean2.5066666666666664
survival_time_min1.500000000000001
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4333333333333282
valid_direction_mean0.7333333333333331
valid_direction_median0.7333333333333334
valid_direction_min0
94651207iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.18318233529540695
deviation-center-line_median0.18691992885787895
in-drivable-lane_median0


other stats
deviation-center-line_max0.34030456288402533
deviation-center-line_mean0.1969358583921653
deviation-center-line_min0.117870231217678
deviation-heading_max1.7107659285902748
deviation-heading_mean0.7997901717583005
deviation-heading_median0.6289658736225524
deviation-heading_min0.25461528664818234
driven_any_max0.7928878760630758
driven_any_mean0.31500766422246057
driven_any_median0.20713754888486433
driven_any_min0.1464298991441805
driven_lanedir_max0.5544566197314336
driven_lanedir_mean0.2534503731086428
driven_lanedir_min0.12278375685989572
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7928878760630758, "driven_lanedir": 0.5544566197314336, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7107659285902748, "deviation-center-line": 0.34030456288402533}, "ep001": {"driven_any": 0.182150684515529, "driven_lanedir": 0.17990064322085964, "in-drivable-lane": 0, "deviation-heading": 0.25461528664818234, "deviation-center-line": 0.18691992885787895}, "ep002": {"driven_any": 0.1464298991441805, "driven_lanedir": 0.12278375685989572, "in-drivable-lane": 0, "deviation-heading": 0.6289658736225524, "deviation-center-line": 0.117870231217678}, "ep003": {"driven_any": 0.20713754888486433, "driven_lanedir": 0.18318233529540695, "in-drivable-lane": 0, "deviation-heading": 0.7759417380597579, "deviation-center-line": 0.13521964489632826}, "ep004": {"driven_any": 0.2464323125046532, "driven_lanedir": 0.22692851043561824, "in-drivable-lane": 0, "deviation-heading": 0.628662031870735, "deviation-center-line": 0.20436492410491583}}
94591207iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:00:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
94391205VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3220:07:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
94361204VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:08:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
94281202BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3220:03:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.46095384773716064
deviation-center-line_median0.12610396956164066
in-drivable-lane_median0


other stats
deviation-center-line_max0.19133810365488343
deviation-center-line_mean0.12925630795310028
deviation-center-line_min0.07833872299177572
deviation-heading_max0.4670829692074258
deviation-heading_mean0.22603673647176145
deviation-heading_median0.1879787026513151
deviation-heading_min0.07097140326875177
driven_any_max1.147255703474784
driven_any_mean0.5859141715558219
driven_any_median0.470503846962939
driven_any_min0.24621799452040444
driven_lanedir_max0.932697737724064
driven_lanedir_mean0.5388349473048392
driven_lanedir_min0.2446267927416894
in-drivable-lane_max0.5666666666666667
in-drivable-lane_mean0.11333333333333331
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.147255703474784, "driven_lanedir": 0.932697737724064, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0.4670829692074258, "deviation-center-line": 0.19133810365488343}, "ep001": {"driven_any": 0.24621799452040444, "driven_lanedir": 0.2446267927416894, "in-drivable-lane": 0, "deviation-heading": 0.07097140326875177, "deviation-center-line": 0.07833872299177572}, "ep002": {"driven_any": 0.470503846962939, "driven_lanedir": 0.46095384773716064, "in-drivable-lane": 0, "deviation-heading": 0.22825098601487623, "deviation-center-line": 0.12610396956164066}, "ep003": {"driven_any": 0.45937419064828816, "driven_lanedir": 0.454346867323681, "in-drivable-lane": 0, "deviation-heading": 0.17589962121643807, "deviation-center-line": 0.10854790038115178}, "ep004": {"driven_any": 0.6062191221726941, "driven_lanedir": 0.6015494909976005, "in-drivable-lane": 0, "deviation-heading": 0.1879787026513151, "deviation-center-line": 0.14195284317604986}}
94151201sodabetastay youngaido1_LF1_r3-v3step2-scoringsuccessyes3220:02:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9740260388851166, "good_angle": 48.18570431826448, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.199999999999994}, "ep001": {"nsteps": 500, "reward": -1.3310678120851516, "good_angle": 13.696020621438183, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999991}, "ep002": {"nsteps": 500, "reward": -1.1231515201330184, "good_angle": 13.694909529387774, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.966666666666658}, "ep003": {"nsteps": 500, "reward": -0.934308636363945, "good_angle": 13.67484107418178, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.933333333333325}, "ep004": {"nsteps": 500, "reward": -1.1827638384401795, "good_angle": 13.717910197460723, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.86666666666666}}
good_angle_max48.18570431826448
good_angle_mean20.59387714814659
good_angle_median13.696020621438183
good_angle_min13.67484107418178
reward_max-0.934308636363945
reward_mean-1.1090635691814823
reward_median-1.1231515201330184
reward_min-1.3310678120851516
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.199999999999994
valid_direction_mean13.193333333333324
valid_direction_median12.966666666666658
valid_direction_min12.86666666666666
94101200BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videosabortedyes3220:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9410-9880', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9410-9880', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9410-9880_evaluation" with the default driver
stderr | Creating job9410-9880_videos_1 ...
stderr | 
Creating job9410-9880_videos_1 ... error

stderr | ERROR: for job9410-9880_videos_1  Cannot start service videos: network job9410-9880_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9410-9880_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
94031200BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 97, "reward": -10.544655245320737, "good_angle": 0.11173963995897508, "survival_time": 3.2333333333333316, "traveled_tiles": 3, "valid_direction": 0}, "ep001": {"nsteps": 30, "reward": -33.87644365131855, "good_angle": 0.023909317209167814, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.033333333333333326}, "ep002": {"nsteps": 500, "reward": -0.7842021786547266, "good_angle": 2.100840251866724, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.699999999999985}, "ep003": {"nsteps": 69, "reward": -14.911100610010866, "good_angle": 0.020366536763589224, "survival_time": 2.3000000000000016, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 27, "reward": -37.48049445395117, "good_angle": 0.15041063828894063, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.23333333333333328}}
good_angle_max2.100840251866724
good_angle_mean0.4814532768174794
good_angle_median0.11173963995897508
good_angle_min0.020366536763589224
reward_max-0.7842021786547266
reward_mean-19.51937922785121
reward_median-14.911100610010866
reward_min-37.48049445395117
survival_time_max16.666666666666654
survival_time_mean4.819999999999997
survival_time_min0.8999999999999999
traveled_tiles_max12
traveled_tiles_mean3.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.699999999999985
valid_direction_mean0.9933333333333304
valid_direction_median0.033333333333333326
valid_direction_min0
94011197iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.25465120905314587
deviation-center-line_median0.22362701193655557
in-drivable-lane_median0


other stats
deviation-center-line_max0.3816283054975945
deviation-center-line_mean0.2371699373728283
deviation-center-line_min0.07662469363190846
deviation-heading_max1.742425682608599
deviation-heading_mean0.8135716681414447
deviation-heading_median0.6025591232774422
deviation-heading_min0.3730724766130892
driven_any_max0.7928850378970975
driven_any_mean0.3550011540382195
driven_any_median0.27142712565474747
driven_any_min0.07141612631846139
driven_lanedir_max0.5574718931641964
driven_lanedir_mean0.29665635884972563
driven_lanedir_min0.05867089624808841
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7928850378970975, "driven_lanedir": 0.5574718931641964, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.742425682608599, "deviation-center-line": 0.3481980975540748}, "ep001": {"driven_any": 0.07141612631846139, "driven_lanedir": 0.05867089624808841, "in-drivable-lane": 0, "deviation-heading": 0.3730724766130892, "deviation-center-line": 0.07662469363190846}, "ep002": {"driven_any": 0.17855447609770914, "driven_lanedir": 0.1645693621812654, "in-drivable-lane": 0, "deviation-heading": 0.5691995566841367, "deviation-center-line": 0.155771578244008}, "ep003": {"driven_any": 0.460723004223082, "driven_lanedir": 0.4479184336019322, "in-drivable-lane": 0, "deviation-heading": 0.7806015015239566, "deviation-center-line": 0.3816283054975945}, "ep004": {"driven_any": 0.27142712565474747, "driven_lanedir": 0.25465120905314587, "in-drivable-lane": 0, "deviation-heading": 0.6025591232774422, "deviation-center-line": 0.22362701193655557}}
93931199sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3220:00:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution_ddpg.py", line 140, in run
    solve(params, cis)
  File "solution_ddpg.py", line 91, in solve
    model.update_current_obs(observation)
AttributeError: 'DDPG' object has no attribute 'update_current_obs'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
93831197iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:02:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
93761193BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3220:00:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5598243733213282
deviation-center-line_median0.12332001632932464
in-drivable-lane_median0


other stats
deviation-center-line_max0.17756076293333797
deviation-center-line_mean0.12824162570132977
deviation-center-line_min0.10227260513933506
deviation-heading_max0.5847213854360483
deviation-heading_mean0.23628737092953303
deviation-heading_median0.16147183434734158
deviation-heading_min0.07220500170940085
driven_any_max0.8038748441848417
driven_any_mean0.5795484889144831
driven_any_median0.5652992283161742
driven_any_min0.3216591617152469
driven_lanedir_max0.7331460490118606
driven_lanedir_mean0.5271346017129362
driven_lanedir_min0.32041467884021246
in-drivable-lane_max0.6
in-drivable-lane_mean0.12
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8038748441848417, "driven_lanedir": 0.5598243733213282, "in-drivable-lane": 0.6, "deviation-heading": 0.5847213854360483, "deviation-center-line": 0.10768663865388904}, "ep001": {"driven_any": 0.3216591617152469, "driven_lanedir": 0.32041467884021246, "in-drivable-lane": 0, "deviation-heading": 0.07220500170940085, "deviation-center-line": 0.10227260513933506}, "ep002": {"driven_any": 0.47181740794332816, "driven_lanedir": 0.4607553860396107, "in-drivable-lane": 0, "deviation-heading": 0.22965150033774584, "deviation-center-line": 0.12332001632932464}, "ep003": {"driven_any": 0.5652992283161742, "driven_lanedir": 0.5615325213516691, "in-drivable-lane": 0, "deviation-heading": 0.16147183434734158, "deviation-center-line": 0.1303681054507622}, "ep004": {"driven_any": 0.7350918024128249, "driven_lanedir": 0.7331460490118606, "in-drivable-lane": 0, "deviation-heading": 0.1333871328171288, "deviation-center-line": 0.17756076293333797}}
93631192sodabetastay youngaido1_LF1_r3-v3step1-simulationerrorno3220:00:47
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
93561190BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3220:04:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.984151000697771
deviation-center-line_median0.6893753521204821
in-drivable-lane_median3.200000000000024


other stats
deviation-center-line_max2.626477136716715
deviation-center-line_mean1.3433504990270713
deviation-center-line_min0.47395804848601863
deviation-heading_max2.0915769727992854
deviation-heading_mean1.6561532476546184
deviation-heading_median1.5009651979141128
deviation-heading_min1.3373728323140583
driven_any_max6.338709442005975
driven_any_mean6.241504701899715
driven_any_median6.2507791125124665
driven_any_min6.160823335985373
driven_lanedir_max6.285016317436751
driven_lanedir_mean4.3646513275512815
driven_lanedir_min2.1551422477187554
in-drivable-lane_max10.6
in-drivable-lane_mean4.833333333333338
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.190868387153463, "driven_lanedir": 2.8985258526718285, "in-drivable-lane": 8.700000000000006, "deviation-heading": 1.5009651979141128, "deviation-center-line": 0.5135610546891989}, "ep001": {"driven_any": 6.160823335985373, "driven_lanedir": 5.500421219231302, "in-drivable-lane": 1.6666666666666607, "deviation-heading": 2.0915769727992854, "deviation-center-line": 2.4133809031229423}, "ep002": {"driven_any": 6.2507791125124665, "driven_lanedir": 2.1551422477187554, "in-drivable-lane": 10.6, "deviation-heading": 1.3373728323140583, "deviation-center-line": 0.47395804848601863}, "ep003": {"driven_any": 6.266343231841298, "driven_lanedir": 4.984151000697771, "in-drivable-lane": 3.200000000000024, "deviation-heading": 1.924641661815529, "deviation-center-line": 0.6893753521204821}, "ep004": {"driven_any": 6.338709442005975, "driven_lanedir": 6.285016317436751, "in-drivable-lane": 0, "deviation-heading": 1.4262095734301063, "deviation-center-line": 2.626477136716715}}
93501190BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3220:02:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
93441188VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5517521831141785, "good_angle": 1.3940392531640815, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.466666666666659}, "ep001": {"nsteps": 500, "reward": -0.5873626086246222, "good_angle": 29.202632642123568, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.6333333333333515}, "ep002": {"nsteps": 500, "reward": -0.587249002658762, "good_angle": 1.2376569694641268, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.966666666666661}, "ep003": {"nsteps": 500, "reward": -0.790708413018845, "good_angle": 1.1750069721250749, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.6999999999999913}, "ep004": {"nsteps": 500, "reward": -0.5354723304156214, "good_angle": 23.129591305939392, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.7999999999999896}}
good_angle_max29.202632642123568
good_angle_mean11.227785428563248
good_angle_median1.3940392531640815
good_angle_min1.1750069721250749
reward_max-0.5354723304156214
reward_mean-0.6105089075664059
reward_median-0.587249002658762
reward_min-0.790708413018845
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max18
traveled_tiles_mean18
traveled_tiles_median18
traveled_tiles_min18
valid_direction_max4.6333333333333515
valid_direction_mean3.3133333333333304
valid_direction_median2.966666666666661
valid_direction_min2.466666666666659
93421187daredevilROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1244940250770317
deviation-center-line_median0.1702985030340966
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.2291035934160819
deviation-center-line_mean0.15104091265992872
deviation-center-line_min0.07084844041760953
deviation-heading_max1.2760765640740437
deviation-heading_mean0.5466497354728592
deviation-heading_median0.35171107009370006
deviation-heading_min0.06092138286581164
driven_any_max2.1066666666666567
driven_any_mean1.1093333333333295
driven_any_median1.1599999999999824
driven_any_min0.3466666666666718
driven_lanedir_max2.066698089009994
driven_lanedir_mean0.9871748479623343
driven_lanedir_min0.14089729353622693
in-drivable-lane_max0.2666666666666657
in-drivable-lane_mean0.09999999999999978
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 1.1599999999999824, "driven_lanedir": 1.1244940250770317, "in-drivable-lane": 0, "deviation-heading": 0.35171107009370006, "deviation-center-line": 0.1702985030340966}, "ep003": {"driven_any": 2.1066666666666567, "driven_lanedir": 2.066698089009994, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.33465738903594666, "deviation-center-line": 0.2291035934160819}, "ep004": {"driven_any": 1.5866666666666656, "driven_lanedir": 1.2579129547459444, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.2760765640740437, "deviation-center-line": 0.1859811348549165}}
93401187daredevilROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:00:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
93371187daredevilROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
93291183BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3220:03:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.572094622720567
deviation-center-line_median1.0268326650454336
in-drivable-lane_median2.9000000000000252


other stats
deviation-center-line_max2.4722919320783845
deviation-center-line_mean1.1883245653497636
deviation-center-line_min0.12547869475003498
deviation-heading_max2.001039106664222
deviation-heading_mean1.3843315777054772
deviation-heading_median1.5516034705839648
deviation-heading_min0.06150333227412977
driven_any_max6.29911149925698
driven_any_mean5.098661940666561
driven_any_median6.282667364114203
driven_any_min0.4376161423520308
driven_lanedir_max6.237488834148862
driven_lanedir_mean3.759713838351967
driven_lanedir_min0.4368002742591542
in-drivable-lane_max7.066666666666675
in-drivable-lane_mean3.3800000000000026
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.189798211292995, "driven_lanedir": 3.4514667299345216, "in-drivable-lane": 7.066666666666675, "deviation-heading": 1.804691978191281, "deviation-center-line": 0.9945927606481}, "ep001": {"driven_any": 0.4376161423520308, "driven_lanedir": 0.4368002742591542, "in-drivable-lane": 0, "deviation-heading": 0.06150333227412977, "deviation-center-line": 0.12547869475003498}, "ep002": {"driven_any": 6.284116486316595, "driven_lanedir": 3.572094622720567, "in-drivable-lane": 6.93333333333331, "deviation-heading": 1.5028200008137895, "deviation-center-line": 1.3224267742268647}, "ep003": {"driven_any": 6.282667364114203, "driven_lanedir": 5.100718730696729, "in-drivable-lane": 2.9000000000000252, "deviation-heading": 2.001039106664222, "deviation-center-line": 1.0268326650454336}, "ep004": {"driven_any": 6.29911149925698, "driven_lanedir": 6.237488834148862, "in-drivable-lane": 0, "deviation-heading": 1.5516034705839648, "deviation-center-line": 2.4722919320783845}}
93241183BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3220:01:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
93111183BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3220:07:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
93031180BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3220:03:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.624752186943482
deviation-center-line_median1.1295785831204983
in-drivable-lane_median2.933333333333323


other stats
deviation-center-line_max1.379343147692024
deviation-center-line_mean0.9007972237204894
deviation-center-line_min0.24741031396476473
deviation-heading_max3.1245182549161745
deviation-heading_mean2.07937344325996
deviation-heading_median2.44663621824183
deviation-heading_min0.5745931443622132
driven_any_max6.299996698962813
driven_any_mean4.328887643847964
driven_any_median6.215093919458589
driven_any_min1.201349522780205
driven_lanedir_max5.060471613390751
driven_lanedir_mean3.397957481084819
driven_lanedir_min0.9599442971508084
in-drivable-lane_max3.8666666666666543
in-drivable-lane_mean2.1999999999999926
in-drivable-lane_min0.3999999999999986
per-episodes
details{"ep000": {"driven_any": 6.215093919458589, "driven_lanedir": 4.624752186943482, "in-drivable-lane": 3.8666666666666543, "deviation-heading": 3.020428063423033, "deviation-center-line": 1.1295785831204983}, "ep001": {"driven_any": 1.201349522780205, "driven_lanedir": 0.9599442971508084, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 1.2306915353565488, "deviation-center-line": 0.24741031396476473}, "ep002": {"driven_any": 6.257336093288788, "driven_lanedir": 4.984035375238558, "in-drivable-lane": 2.933333333333323, "deviation-heading": 3.1245182549161745, "deviation-center-line": 1.379343147692024}, "ep003": {"driven_any": 6.299996698962813, "driven_lanedir": 5.060471613390751, "in-drivable-lane": 2.9999999999999893, "deviation-heading": 2.44663621824183, "deviation-center-line": 1.240540064820694}, "ep004": {"driven_any": 1.6706619847494255, "driven_lanedir": 1.3605839327004934, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.5745931443622132, "deviation-center-line": 0.5071140090044659}}
92991181tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22063538543918604
deviation-center-line_median0.20277270846504977
in-drivable-lane_median0


other stats
deviation-center-line_max0.6171226518096151
deviation-center-line_mean0.3109875124293243
deviation-center-line_min0.12423901964197331
deviation-heading_max1.8592949678117303
deviation-heading_mean0.7784862086779775
deviation-heading_median0.5996804875354138
deviation-heading_min0.2115007870530752
driven_any_max0.767871114225483
driven_any_mean0.4100120502507269
driven_any_median0.2392931239817974
driven_any_min0.1857224150004921
driven_lanedir_max0.6622456703814719
driven_lanedir_mean0.3509606805825811
driven_lanedir_min0.16715472113848007
in-drivable-lane_max1.8666666666666691
in-drivable-lane_mean0.37333333333333385
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.767871114225483, "driven_lanedir": 0.52061066676762, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.8592949678117303, "deviation-center-line": 0.4211514251220343}, "ep001": {"driven_any": 0.1857224150004921, "driven_lanedir": 0.1841569591861476, "in-drivable-lane": 0, "deviation-heading": 0.2115007870530752, "deviation-center-line": 0.18965175710794907}, "ep002": {"driven_any": 0.6643298980785627, "driven_lanedir": 0.6622456703814719, "in-drivable-lane": 0, "deviation-heading": 0.43599702157458536, "deviation-center-line": 0.6171226518096151}, "ep003": {"driven_any": 0.1928436999672996, "driven_lanedir": 0.16715472113848007, "in-drivable-lane": 0, "deviation-heading": 0.7859577794150824, "deviation-center-line": 0.12423901964197331}, "ep004": {"driven_any": 0.2392931239817974, "driven_lanedir": 0.22063538543918604, "in-drivable-lane": 0, "deviation-heading": 0.5996804875354138, "deviation-center-line": 0.20277270846504977}}
92941180BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.2873053438300849, "good_angle": 1.3414091196782951, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.899999999999986}, "ep001": {"nsteps": 103, "reward": -10.591722322211972, "good_angle": 8.236018385735145, "survival_time": 3.433333333333331, "traveled_tiles": 2, "valid_direction": 2.333333333333331}, "ep002": {"nsteps": 500, "reward": -0.2954915684715379, "good_angle": 1.4333918973833295, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.566666666666654}, "ep003": {"nsteps": 500, "reward": -0.23761464420356787, "good_angle": 1.121569714476965, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.599999999999987}, "ep004": {"nsteps": 135, "reward": -8.226718127812017, "good_angle": 11.429720028085429, "survival_time": 4.499999999999994, "traveled_tiles": 3, "valid_direction": 2.099999999999994}}
good_angle_max11.429720028085429
good_angle_mean4.712421829071832
good_angle_median1.4333918973833295
good_angle_min1.121569714476965
reward_max-0.23761464420356787
reward_mean-3.927770401305835
reward_median-0.2954915684715379
reward_min-10.591722322211972
survival_time_max16.666666666666654
survival_time_mean11.586666666666655
survival_time_min3.433333333333331
traveled_tiles_max12
traveled_tiles_mean8.2
traveled_tiles_median12
traveled_tiles_min2
valid_direction_max4.566666666666654
valid_direction_mean3.29999999999999
valid_direction_median3.599999999999987
valid_direction_min2.099999999999994
92881181tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 217, "reward": -4.842466158233905, "good_angle": 0.948393067959257, "survival_time": 7.233333333333317, "traveled_tiles": 2, "valid_direction": 1.999999999999993}, "ep001": {"nsteps": 54, "reward": -19.071285682143987, "good_angle": 0.02955953031078824, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 188, "reward": -5.826680191178271, "good_angle": 0.04020312858748907, "survival_time": 6.266666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 56, "reward": -18.223405375810607, "good_angle": 0.5759211627899659, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0.9333333333333358}, "ep004": {"nsteps": 69, "reward": -14.968534817298254, "good_angle": 0.4190348981693709, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.5666666666666662}}
good_angle_max0.948393067959257
good_angle_mean0.4026223575633742
good_angle_median0.4190348981693709
good_angle_min0.02955953031078824
reward_max-4.842466158233905
reward_mean-12.586474444933003
reward_median-14.968534817298254
reward_min-19.071285682143987
survival_time_max7.233333333333317
survival_time_mean3.8933333333333286
survival_time_min1.8000000000000025
traveled_tiles_max3
traveled_tiles_mean1.6
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.999999999999993
valid_direction_mean0.699999999999999
valid_direction_median0.5666666666666662
valid_direction_min0
92831179tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyes3220:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9283-9139', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9283-9139', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9283-9139_evaluation" with the default driver
stderr | Creating job9283-9139_videos_1 ...
stderr | 
Creating job9283-9139_videos_1 ... error

stderr | ERROR: for job9283-9139_videos_1  Cannot start service videos: network job9283-9139_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9283-9139_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
92791178tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.28060777012340976
deviation-center-line_median0.22721196650330475
in-drivable-lane_median0


other stats
deviation-center-line_max0.397387598231267
deviation-center-line_mean0.25293935350159086
deviation-center-line_min0.13210976538295569
deviation-heading_max1.7444564974638874
deviation-heading_mean0.7954867340184384
deviation-heading_median0.6045070411462525
deviation-heading_min0.2618915420632834
driven_any_max0.5678510646493321
driven_any_mean0.3450032324283415
driven_any_median0.2821608403404374
driven_any_min0.19998585583219508
driven_lanedir_max0.42669405448571496
driven_lanedir_mean0.2838617218300153
driven_lanedir_min0.1775901034723475
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5678510646493321, "driven_lanedir": 0.3130090110394963, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7444564974638874, "deviation-center-line": 0.22721196650330475}, "ep001": {"driven_any": 0.2821608403404374, "driven_lanedir": 0.28060777012340976, "in-drivable-lane": 0, "deviation-heading": 0.2618915420632834, "deviation-center-line": 0.30221720153425513}, "ep002": {"driven_any": 0.43572704749065816, "driven_lanedir": 0.42669405448571496, "in-drivable-lane": 0, "deviation-heading": 0.5989330467566464, "deviation-center-line": 0.397387598231267}, "ep003": {"driven_any": 0.19998585583219508, "driven_lanedir": 0.1775901034723475, "in-drivable-lane": 0, "deviation-heading": 0.7676455426621223, "deviation-center-line": 0.13210976538295569}, "ep004": {"driven_any": 0.2392913538290846, "driven_lanedir": 0.22140767002910788, "in-drivable-lane": 0, "deviation-heading": 0.6045070411462525, "deviation-center-line": 0.20577023585617177}}
92731178tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.7


other stats
episodes
details{"ep000": {"nsteps": 161, "reward": -6.347270734272666, "good_angle": 1.0985396853199512, "survival_time": 5.366666666666657, "traveled_tiles": 2, "valid_direction": 2.06666666666666}, "ep001": {"nsteps": 81, "reward": -12.93681447631047, "good_angle": 0.02926790529772029, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 124, "reward": -8.565655554254208, "good_angle": 0.226684440214113, "survival_time": 4.133333333333328, "traveled_tiles": 2, "valid_direction": 0.33333333333333215}, "ep003": {"nsteps": 58, "reward": -17.610239930579375, "good_angle": 0.5087837344309827, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 0.8666666666666691}, "ep004": {"nsteps": 69, "reward": -14.975191583667977, "good_angle": 0.4005178776614758, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.6333333333333331}}
good_angle_max1.0985396853199512
good_angle_mean0.45275872858484856
good_angle_median0.4005178776614758
good_angle_min0.02926790529772029
reward_max-6.347270734272666
reward_mean-12.08703445581694
reward_median-12.93681447631047
reward_min-17.610239930579375
survival_time_max5.366666666666657
survival_time_mean3.2866666666666644
survival_time_min1.933333333333336
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max2.06666666666666
valid_direction_mean0.7799999999999988
valid_direction_median0.6333333333333331
valid_direction_min0
92681178tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:02:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
92571177tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
92431176tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:00:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
92411176tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.3666666666666645


other stats
episodes
details{"ep000": {"nsteps": 159, "reward": -6.4198667989727465, "good_angle": 1.4492498835654923, "survival_time": 5.299999999999991, "traveled_tiles": 2, "valid_direction": 1.7999999999999945}, "ep001": {"nsteps": 101, "reward": -10.492905078252944, "good_angle": 0.1911827441975591, "survival_time": 3.3666666666666645, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 119, "reward": -8.908292793927073, "good_angle": 0.20649372294072615, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 0.36666666666666536}, "ep003": {"nsteps": 57, "reward": -17.91029588159239, "good_angle": 0.6202963302408272, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.800000000000002}, "ep004": {"nsteps": 72, "reward": -14.361503334922922, "good_angle": 0.3358323416537987, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.6999999999999993}}
good_angle_max1.4492498835654923
good_angle_mean0.5606110045196807
good_angle_median0.3358323416537987
good_angle_min0.1911827441975591
reward_max-6.4198667989727465
reward_mean-11.618572777533617
reward_median-10.492905078252944
reward_min-17.91029588159239
survival_time_max5.299999999999991
survival_time_mean3.3866666666666645
survival_time_min1.9000000000000024
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.7999999999999945
valid_direction_mean0.7866666666666654
valid_direction_median0.6999999999999993
valid_direction_min0.2666666666666657
92311176tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:02:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
92241175iban_alexROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.899999999999996


other stats
episodes
details{"ep000": {"nsteps": 153, "reward": -6.688718417593205, "good_angle": 1.3498627460913, "survival_time": 5.099999999999992, "traveled_tiles": 2, "valid_direction": 2.2333333333333254}, "ep001": {"nsteps": 92, "reward": -11.46228821089734, "good_angle": 0.030996602946483435, "survival_time": 3.0666666666666655, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 117, "reward": -9.020670182939268, "good_angle": 0.09301724975869884, "survival_time": 3.899999999999996, "traveled_tiles": 2, "valid_direction": 0.2666666666666657}, "ep003": {"nsteps": 169, "reward": -6.3763778808818765, "good_angle": 0.08570572926321202, "survival_time": 5.633333333333323, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 71, "reward": -14.53416777622532, "good_angle": 0.3426253908019395, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0.6666666666666663}}
good_angle_max1.3498627460913
good_angle_mean0.3804415437723267
good_angle_median0.09301724975869884
good_angle_min0.030996602946483435
reward_max-6.3763778808818765
reward_mean-9.616444493707402
reward_median-9.020670182939268
reward_min-14.53416777622532
survival_time_max5.633333333333323
survival_time_mean4.013333333333328
survival_time_min2.366666666666668
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.2333333333333254
valid_direction_mean0.6333333333333314
valid_direction_median0.2666666666666657
valid_direction_min0
92191174BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.21651326598832385, "good_angle": 1.295630365232546, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.499999999999988}, "ep001": {"nsteps": 500, "reward": -0.7536948121991008, "good_angle": 32.18334272524929, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.8666666666666885}, "ep002": {"nsteps": 500, "reward": -0.3881657581413165, "good_angle": 0.9713345121663314, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.0999999999999925}, "ep003": {"nsteps": 500, "reward": -0.29010085831501053, "good_angle": 1.2401183577910528, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.8333333333333206}, "ep004": {"nsteps": 500, "reward": -0.6829005034961738, "good_angle": 26.7516592384108, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.033333333333346}}
good_angle_max32.18334272524929
good_angle_mean12.488417039770004
good_angle_median1.295630365232546
good_angle_min0.9713345121663314
reward_max-0.21651326598832385
reward_mean-0.46627503962798506
reward_median-0.3881657581413165
reward_min-0.7536948121991008
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max12
traveled_tiles_mean12
traveled_tiles_median12
traveled_tiles_min12
valid_direction_max4.8666666666666885
valid_direction_mean3.4666666666666672
valid_direction_median3.499999999999988
valid_direction_min2.0999999999999925
92071174BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3220:08:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
92011172iban_alexROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 221, "reward": -4.680065435220433, "good_angle": 0.8143340540122375, "survival_time": 7.36666666666665, "traveled_tiles": 2, "valid_direction": 1.03333333333333}, "ep001": {"nsteps": 88, "reward": -11.970444464548068, "good_angle": 0.09934511537248952, "survival_time": 2.9333333333333327, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 48, "reward": -21.25994161920001, "good_angle": 0.5257756234168345, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.7000000000000017}, "ep003": {"nsteps": 61, "reward": -16.74233506925282, "good_angle": 0.4446579903733168, "survival_time": 2.033333333333336, "traveled_tiles": 1, "valid_direction": 0.8333333333333355}, "ep004": {"nsteps": 72, "reward": -14.358987438182035, "good_angle": 0.3486535214226296, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.599999999999999}}
good_angle_max0.8143340540122375
good_angle_mean0.4465532609195016
good_angle_median0.4446579903733168
good_angle_min0.09934511537248952
reward_max-4.680065435220433
reward_mean-13.802354805280675
reward_median-14.358987438182035
reward_min-21.25994161920001
survival_time_max7.36666666666665
survival_time_mean3.2666666666666644
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.03333333333333
valid_direction_mean0.693333333333333
valid_direction_median0.7000000000000017
valid_direction_min0.29999999999999893
91911172iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:02:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
91871171BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationerrorno3220:00:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Hidden. If you are the author, please login using the top-right link or use the dashboard.
91811170BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationerrorno3220:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Hidden. If you are the author, please login using the top-right link or use the dashboard.
91741169BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationerrorno3220:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Hidden. If you are the author, please login using the top-right link or use the dashboard.
91701167BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9333333333333332


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.960217820280896, "good_angle": 0.5172622946565719, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 18, "reward": -56.10176092551814, "good_angle": 0.006974093479631655, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 40, "reward": -25.454327197372912, "good_angle": 0.1153507237534932, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0.2333333333333341}, "ep003": {"nsteps": 34, "reward": -29.82234545534148, "good_angle": 0.026228276943251767, "survival_time": 1.1333333333333335, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 27, "reward": -37.4485928107191, "good_angle": 0.14894994285141094, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}}
good_angle_max0.5172622946565719
good_angle_mean0.1629530663368719
good_angle_median0.1153507237534932
good_angle_min0.006974093479631655
reward_max-25.454327197372912
reward_mean-36.95744884184651
reward_median-35.960217820280896
reward_min-56.10176092551814
survival_time_max1.333333333333334
survival_time_mean0.98
survival_time_min0.6
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.7999999999999998
valid_direction_mean0.2666666666666668
valid_direction_median0.2333333333333341
valid_direction_min0
91651166tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:01:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
91611166tnd_duck18ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.833333333333333


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6136273357272148, "good_angle": 0.5537070922558297, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 1.90000000000002}, "ep001": {"nsteps": 85, "reward": -12.354958914307987, "good_angle": 0.21080076316883192, "survival_time": 2.833333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 50, "reward": -20.48418119311333, "good_angle": 0.6347664704960587, "survival_time": 1.6666666666666683, "traveled_tiles": 2, "valid_direction": 0.633333333333335}, "ep003": {"nsteps": 62, "reward": -16.497841009209232, "good_angle": 0.7729083682194203, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 0.7000000000000013}, "ep004": {"nsteps": 361, "reward": -2.9291283473774916, "good_angle": 7.2072485876985635, "survival_time": 12.0333333333333, "traveled_tiles": 3, "valid_direction": 3.366666666666659}}
good_angle_max7.2072485876985635
good_angle_mean1.8758862563677408
good_angle_median0.6347664704960587
good_angle_min0.21080076316883192
reward_max-0.6136273357272148
reward_mean-10.575947359947053
reward_median-12.354958914307987
reward_min-20.48418119311333
survival_time_max16.666666666666654
survival_time_mean7.053333333333325
survival_time_min1.6666666666666683
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.366666666666659
valid_direction_mean1.3733333333333362
valid_direction_median0.7000000000000013
valid_direction_min0.2666666666666657
91511165BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3220:00:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22300266179002293
deviation-center-line_median0.07746572238052037
in-drivable-lane_median0


other stats
deviation-center-line_max0.19153336369931473
deviation-center-line_mean0.10251672717835374
deviation-center-line_min0.034173266911369266
deviation-heading_max0.6264180714381068
deviation-heading_mean0.32645832882932413
deviation-heading_median0.2984934128215809
deviation-heading_min0.1619411156979892
driven_any_max0.8291702729706932
driven_any_mean0.38704360961280343
driven_any_median0.2403800213728889
driven_any_min0.06906892653809396
driven_lanedir_max0.6068055099248102
driven_lanedir_mean0.3317627272200433
driven_lanedir_min0.05773359615421558
in-drivable-lane_max0.7
in-drivable-lane_mean0.14
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8291702729706932, "driven_lanedir": 0.6023863536486929, "in-drivable-lane": 0.7, "deviation-heading": 0.6264180714381068, "deviation-center-line": 0.13504632240128137}, "ep001": {"driven_any": 0.06906892653809396, "driven_lanedir": 0.05773359615421558, "in-drivable-lane": 0, "deviation-heading": 0.1619411156979892, "deviation-center-line": 0.034173266911369266}, "ep002": {"driven_any": 0.18523863925438744, "driven_lanedir": 0.16888551458247503, "in-drivable-lane": 0, "deviation-heading": 0.2984934128215809, "deviation-center-line": 0.07746572238052037}, "ep003": {"driven_any": 0.2403800213728889, "driven_lanedir": 0.22300266179002293, "in-drivable-lane": 0, "deviation-heading": 0.3242996256916726, "deviation-center-line": 0.07436496049928296}, "ep004": {"driven_any": 0.6113601879279534, "driven_lanedir": 0.6068055099248102, "in-drivable-lane": 0, "deviation-heading": 0.22113941849727128, "deviation-center-line": 0.19153336369931473}}
91451165BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9666666666666666


other stats
episodes
details{"ep000": {"nsteps": 84, "reward": -12.058300911437808, "good_angle": 0.2788331718599693, "survival_time": 2.8, "traveled_tiles": 2, "valid_direction": 0.2666666666666657}, "ep001": {"nsteps": 10, "reward": -100.599946346879, "good_angle": 0.13661536765279028, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666666}, "ep002": {"nsteps": 26, "reward": -38.95475086340537, "good_angle": 0.21794151576184345, "survival_time": 0.8666666666666666, "traveled_tiles": 2, "valid_direction": 0.33333333333333326}, "ep003": {"nsteps": 29, "reward": -34.89256798578747, "good_angle": 0.1993752076691728, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}, "ep004": {"nsteps": 62, "reward": -16.604999535987453, "good_angle": 0.04498997851252276, "survival_time": 2.066666666666669, "traveled_tiles": 2, "valid_direction": 0.10000000000000007}}
good_angle_max0.2788331718599693
good_angle_mean0.17555104829125973
good_angle_median0.1993752076691728
good_angle_min0.04498997851252276
reward_max-12.058300911437808
reward_mean-40.622113128699425
reward_median-34.89256798578747
reward_min-100.599946346879
survival_time_max2.8
survival_time_mean1.4066666666666672
survival_time_min0.3333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.33333333333333326
valid_direction_mean0.25333333333333313
valid_direction_median0.2666666666666666
valid_direction_min0.10000000000000007
91441163BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3220:00:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3070283213499705
deviation-center-line_median0.09702116052130282
in-drivable-lane_median0


other stats
deviation-center-line_max0.1334524996958888
deviation-center-line_mean0.09749151407689988
deviation-center-line_min0.055815900522894105
deviation-heading_max0.7110042756209249
deviation-heading_mean0.296793112575123
deviation-heading_median0.2182953031992732
deviation-heading_min0.06818726091822697
driven_any_max0.4940570536094428
driven_any_mean0.36368335909081895
driven_any_median0.3449494516498846
driven_any_min0.17765045729553103
driven_lanedir_max0.4823056849554743
driven_lanedir_mean0.3165662687498885
driven_lanedir_min0.13982312596231128
in-drivable-lane_max0.2
in-drivable-lane_mean0.039999999999999994
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3449494516498846, "driven_lanedir": 0.13982312596231128, "in-drivable-lane": 0.2, "deviation-heading": 0.7110042756209249, "deviation-center-line": 0.07077433954496597}, "ep001": {"driven_any": 0.17765045729553103, "driven_lanedir": 0.17595983449900254, "in-drivable-lane": 0, "deviation-heading": 0.06818726091822697, "deviation-center-line": 0.055815900522894105}, "ep002": {"driven_any": 0.4856599583480304, "driven_lanedir": 0.47771437698268393, "in-drivable-lane": 0, "deviation-heading": 0.2182953031992732, "deviation-center-line": 0.13039367009944774}, "ep003": {"driven_any": 0.4940570536094428, "driven_lanedir": 0.4823056849554743, "in-drivable-lane": 0, "deviation-heading": 0.2790574156926786, "deviation-center-line": 0.1334524996958888}, "ep004": {"driven_any": 0.3160998745512058, "driven_lanedir": 0.3070283213499705, "in-drivable-lane": 0, "deviation-heading": 0.20742130744451104, "deviation-center-line": 0.09702116052130282}}
91411163BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3220:00:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
91351163BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9666666666666666


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95931072273691, "good_angle": 0.4607011578049614, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 16, "reward": -63.05295382626355, "good_angle": 0.009460817280403743, "survival_time": 0.5333333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 42, "reward": -24.293739820520084, "good_angle": 0.08335812933400061, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.16666666666666718}, "ep003": {"nsteps": 44, "reward": -23.202110031450335, "good_angle": 0.12142468689602476, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0.20000000000000065}, "ep004": {"nsteps": 29, "reward": -35.01854748150398, "good_angle": 0.10026262007949992, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0.19999999999999996}}
good_angle_max0.4607011578049614
good_angle_mean0.15504148227897813
good_angle_median0.10026262007949992
good_angle_min0.009460817280403743
reward_max-23.202110031450335
reward_mean-36.305332376494974
reward_median-35.01854748150398
reward_min-63.05295382626355
survival_time_max1.466666666666668
survival_time_mean1.0600000000000005
survival_time_min0.5333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.7999999999999998
valid_direction_mean0.27333333333333354
valid_direction_median0.19999999999999996
valid_direction_min0
91281162iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2185485074612008
deviation-center-line_median0.19974128076328243
in-drivable-lane_median0


other stats
deviation-center-line_max0.3887759641752293
deviation-center-line_mean0.23340816860059344
deviation-center-line_min0.12020102693688917
deviation-heading_max1.749687922801705
deviation-heading_mean0.8362686123408803
deviation-heading_median0.5987280401906994
deviation-heading_min0.4947769158387082
driven_any_max0.7821820610895577
driven_any_mean0.3457229945267223
driven_any_median0.23572337181203143
driven_any_min0.15356456150477713
driven_lanedir_max0.5383451271517545
driven_lanedir_mean0.28368299284687526
driven_lanedir_min0.13569835873012037
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7821820610895577, "driven_lanedir": 0.5383451271517545, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.749687922801705, "deviation-center-line": 0.32919661184900934}, "ep001": {"driven_any": 0.3642963592732329, "driven_lanedir": 0.35690061102931536, "in-drivable-lane": 0, "deviation-heading": 0.4947769158387082, "deviation-center-line": 0.3887759641752293}, "ep002": {"driven_any": 0.15356456150477713, "driven_lanedir": 0.13569835873012037, "in-drivable-lane": 0, "deviation-heading": 0.5803227444945604, "deviation-center-line": 0.12912595927855722}, "ep003": {"driven_any": 0.1928486189540123, "driven_lanedir": 0.16892235986198534, "in-drivable-lane": 0, "deviation-heading": 0.7578274383787285, "deviation-center-line": 0.12020102693688917}, "ep004": {"driven_any": 0.23572337181203143, "driven_lanedir": 0.2185485074612008, "in-drivable-lane": 0, "deviation-heading": 0.5987280401906994, "deviation-center-line": 0.19974128076328243}}
91211161MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.207501904724555
deviation-center-line_median0.199117543008356
in-drivable-lane_median0


other stats
deviation-center-line_max0.36013014379892433
deviation-center-line_mean0.21890563089739185
deviation-center-line_min0.06610701022197295
deviation-heading_max1.8220352535204696
deviation-heading_mean0.8418700647081033
deviation-heading_median0.6176041495564573
deviation-heading_min0.3793079412520295
driven_any_max0.7750332700063921
driven_any_mean0.3300067493966062
driven_any_median0.22142968999939713
driven_any_min0.06070246001438254
driven_lanedir_max0.5276151666340869
driven_lanedir_mean0.26774277386120654
driven_lanedir_min0.04620417581966674
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7750332700063921, "driven_lanedir": 0.5276151666340869, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.8220352535204696, "deviation-center-line": 0.36013014379892433}, "ep001": {"driven_any": 0.06070246001438254, "driven_lanedir": 0.04620417581966674, "in-drivable-lane": 0, "deviation-heading": 0.3793079412520295, "deviation-center-line": 0.06610701022197295}, "ep002": {"driven_any": 0.14641926940265107, "driven_lanedir": 0.12549941503869144, "in-drivable-lane": 0, "deviation-heading": 0.6176041495564573, "deviation-center-line": 0.12449797931105276}, "ep003": {"driven_any": 0.446449057560208, "driven_lanedir": 0.4318932070890326, "in-drivable-lane": 0, "deviation-heading": 0.7968429744010335, "deviation-center-line": 0.34467547814665306}, "ep004": {"driven_any": 0.22142968999939713, "driven_lanedir": 0.207501904724555, "in-drivable-lane": 0, "deviation-heading": 0.5935600048105273, "deviation-center-line": 0.199117543008356}}
91171161MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1333333333333355


other stats
episodes
details{"ep000": {"nsteps": 219, "reward": -4.7510575335919345, "good_angle": 0.8986191357630842, "survival_time": 7.299999999999984, "traveled_tiles": 2, "valid_direction": 1.5999999999999943}, "ep001": {"nsteps": 19, "reward": -53.27107413505253, "good_angle": 0.3703072995457168, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}, "ep002": {"nsteps": 43, "reward": -23.749818135139552, "good_angle": 0.47029312863595, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 0.7666666666666678}, "ep003": {"nsteps": 127, "reward": -8.289938152892383, "good_angle": 0.32834234303263565, "survival_time": 4.233333333333328, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep004": {"nsteps": 64, "reward": -16.126517699100077, "good_angle": 0.31651250460437785, "survival_time": 2.1333333333333355, "traveled_tiles": 1, "valid_direction": 0.7333333333333345}}
good_angle_max0.8986191357630842
good_angle_mean0.4768148823163528
good_angle_median0.3703072995457168
good_angle_min0.31651250460437785
reward_max-4.7510575335919345
reward_mean-21.237681131155295
reward_median-16.126517699100077
reward_min-53.27107413505253
survival_time_max7.299999999999984
survival_time_mean3.1466666666666634
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.5999999999999943
valid_direction_mean0.7999999999999992
valid_direction_median0.7333333333333345
valid_direction_min0.4333333333333318
91141159BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3220:01:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
91081160daredevilROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:00:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
91041160daredevilROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
90971159BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationabortedno3220:00:15
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9097-6248', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9097-6248', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9097-6248_evaluation" with the default driver
stderr | Creating job9097-6248_solution_1 ...
stderr | Creating job9097-6248_evaluator_1 ...
stderr | 
Creating job9097-6248_evaluator_1 ... error

stderr | ERROR: for job9097-6248_evaluator_1  Cannot start service evaluator: network job9097-6248_evaluation not found
stderr | 
Creating job9097-6248_solution_1  ... error

stderr | ERROR: for job9097-6248_solution_1  Cannot start service solution: network job9097-6248_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9097-6248_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9097-6248_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
90951158DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 352, "reward": -4.317125492242419, "good_angle": 1.1334528996178082, "survival_time": 11.733333333333302, "traveled_tiles": 7, "valid_direction": 1.86666666666666}, "ep001": {"nsteps": 500, "reward": -1.743208881936967, "good_angle": 54.320166989853206, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 8.133333333333306}, "ep002": {"nsteps": 260, "reward": -5.603150567233276, "good_angle": 1.4366616036277229, "survival_time": 8.666666666666647, "traveled_tiles": 6, "valid_direction": 2.733333333333327}, "ep003": {"nsteps": 500, "reward": -1.6819405323853716, "good_angle": 1.3334504918077832, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.8333333333333535}, "ep004": {"nsteps": 500, "reward": -1.4770710468757895, "good_angle": 32.82108192969784, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 4.866666666666651}}
good_angle_max54.320166989853206
good_angle_mean18.20896278292087
good_angle_median1.4366616036277229
good_angle_min1.1334528996178082
reward_max-1.4770710468757895
reward_mean-2.9644993041347645
reward_median-1.743208881936967
reward_min-5.603150567233276
survival_time_max16.666666666666654
survival_time_mean14.079999999999984
survival_time_min8.666666666666647
traveled_tiles_max10
traveled_tiles_mean8.2
traveled_tiles_median9
traveled_tiles_min6
valid_direction_max8.133333333333306
valid_direction_mean4.08666666666666
valid_direction_median2.8333333333333535
valid_direction_min1.86666666666666
90901156MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.22682055208981788
deviation-center-line_median0.20685353724444192
in-drivable-lane_median0


other stats
deviation-center-line_max0.3438949881944418
deviation-center-line_mean0.2294897469542859
deviation-center-line_min0.1323368790450466
deviation-heading_max1.7864186449786736
deviation-heading_mean0.8023591431457182
deviation-heading_median0.6083608666568896
deviation-heading_min0.29682051317084346
driven_any_max0.7821807938875655
driven_any_mean0.34286537120578225
driven_any_median0.24285852419726375
driven_any_min0.16070829106403728
driven_lanedir_max0.5370958971833832
driven_lanedir_mean0.28205755526882526
driven_lanedir_min0.1407045553147912
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7821807938875655, "driven_lanedir": 0.5370958971833832, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7864186449786736, "deviation-center-line": 0.33088608079042314}, "ep001": {"driven_any": 0.3250206310927961, "driven_lanedir": 0.32325673184379067, "in-drivable-lane": 0, "deviation-heading": 0.29682051317084346, "deviation-center-line": 0.3438949881944418}, "ep002": {"driven_any": 0.16070829106403728, "driven_lanedir": 0.1407045553147912, "in-drivable-lane": 0, "deviation-heading": 0.6083608666568896, "deviation-center-line": 0.1334772494970759}, "ep003": {"driven_any": 0.2035586157872487, "driven_lanedir": 0.18241003991234317, "in-drivable-lane": 0, "deviation-heading": 0.7476984117581289, "deviation-center-line": 0.1323368790450466}, "ep004": {"driven_any": 0.24285852419726375, "driven_lanedir": 0.22682055208981788, "in-drivable-lane": 0, "deviation-heading": 0.5724972791640558, "deviation-center-line": 0.20685353724444192}}
90871156MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
90831156MandanaSamieiMy Improved ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.333333333333335


other stats
episodes
details{"ep000": {"nsteps": 221, "reward": -4.669979619494654, "good_angle": 0.854506904324985, "survival_time": 7.36666666666665, "traveled_tiles": 2, "valid_direction": 1.1333333333333293}, "ep001": {"nsteps": 93, "reward": -11.33756122505793, "good_angle": 0.03361800838719996, "survival_time": 3.0999999999999988, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 47, "reward": -21.753391784556367, "good_angle": 0.4597435137438536, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.7333333333333348}, "ep003": {"nsteps": 59, "reward": -17.308526529220202, "good_angle": 0.48544786970937487, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 0.9000000000000027}, "ep004": {"nsteps": 70, "reward": -14.75984545179776, "good_angle": 0.36665932241402327, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 0.4999999999999991}}
good_angle_max0.854506904324985
good_angle_mean0.43999512371588734
good_angle_median0.4597435137438536
good_angle_min0.03361800838719996
reward_max-4.669979619494654
reward_mean-13.965860922025382
reward_median-14.75984545179776
reward_min-21.753391784556367
survival_time_max7.36666666666665
survival_time_mean3.2666666666666644
survival_time_min1.5666666666666682
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.1333333333333293
valid_direction_mean0.6533333333333331
valid_direction_median0.7333333333333348
valid_direction_min0
90761154BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3220:01:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
90741154BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringabortedyes3220:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9074-6519', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9074-6519', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9074-6519_evaluation" with the default driver
stderr | Creating job9074-6519_scorer_1 ...
stderr | 
Creating job9074-6519_scorer_1 ... error

stderr | ERROR: for job9074-6519_scorer_1  Cannot start service scorer: network job9074-6519_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9074-6519_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
90701155orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.49999999999999


other stats
episodes
details{"ep000": {"nsteps": 405, "reward": -3.0253246738566775, "good_angle": 3.686269832724286, "survival_time": 13.499999999999964, "traveled_tiles": 5, "valid_direction": 5.79999999999998}, "ep001": {"nsteps": 63, "reward": -16.402814594999192, "good_angle": 0.03886629792191191, "survival_time": 2.1000000000000023, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 334, "reward": -4.357125898646079, "good_angle": 4.619266888418511, "survival_time": 11.133333333333304, "traveled_tiles": 5, "valid_direction": 7.333333333333316}, "ep003": {"nsteps": 165, "reward": -7.449461330192086, "good_angle": 0.8916389022939682, "survival_time": 5.49999999999999, "traveled_tiles": 3, "valid_direction": 2.8999999999999977}, "ep004": {"nsteps": 51, "reward": -20.07449903149231, "good_angle": 0.017789674217765197, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max4.619266888418511
good_angle_mean1.8507663191152883
good_angle_median0.8916389022939682
good_angle_min0.017789674217765197
reward_max-3.0253246738566775
reward_mean-10.261845105837269
reward_median-7.449461330192086
reward_min-20.07449903149231
survival_time_max13.499999999999964
survival_time_mean6.786666666666653
survival_time_min1.700000000000002
traveled_tiles_max5
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max7.333333333333316
valid_direction_mean3.206666666666659
valid_direction_median2.8999999999999977
valid_direction_min0
90601152iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.21550830194289936
deviation-center-line_median0.1974449326223282
in-drivable-lane_median0


other stats
deviation-center-line_max0.3690873456467426
deviation-center-line_mean0.2078889573124032
deviation-center-line_min0.12092993453408477
deviation-heading_max1.7970104457675162
deviation-heading_mean0.8396734311074644
deviation-heading_median0.5742535466768622
deviation-heading_min0.4532730876630539
driven_any_max0.5821560714738756
driven_any_mean0.298573489973921
driven_any_median0.22857351321845176
driven_any_min0.15712762241796052
driven_lanedir_max0.33229831008042865
driven_lanedir_mean0.23298634447059424
driven_lanedir_min0.1415705305787589
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5821560714738756, "driven_lanedir": 0.31933203541348143, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7970104457675162, "deviation-center-line": 0.2147581086569874}, "ep001": {"driven_any": 0.33929497550514376, "driven_lanedir": 0.33229831008042865, "in-drivable-lane": 0, "deviation-heading": 0.4532730876630539, "deviation-center-line": 0.3690873456467426}, "ep002": {"driven_any": 0.15712762241796052, "driven_lanedir": 0.1415705305787589, "in-drivable-lane": 0, "deviation-heading": 0.5742535466768622, "deviation-center-line": 0.13722446510187275}, "ep003": {"driven_any": 0.18571526725417337, "driven_lanedir": 0.1562225443374028, "in-drivable-lane": 0, "deviation-heading": 0.8203411438161585, "deviation-center-line": 0.12092993453408477}, "ep004": {"driven_any": 0.22857351321845176, "driven_lanedir": 0.21550830194289936, "in-drivable-lane": 0, "deviation-heading": 0.5534889316137311, "deviation-center-line": 0.1974449326223282}}
90491152iban_alexROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3220:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9049-1736', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9049-1736', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9049-1736_evaluation" with the default driver
stderr | Creating job9049-1736_scorer_1 ...
stderr | 
Creating job9049-1736_scorer_1 ... error

stderr | ERROR: for job9049-1736_scorer_1  Cannot start service scorer: network job9049-1736_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9049-1736_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
90451152iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:02:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
90381150iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
90311150iban_alexROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:02:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
90271149daredevilROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1244940250770317
deviation-center-line_median0.1702985030340966
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.2291035934160819
deviation-center-line_mean0.15104091265992872
deviation-center-line_min0.07084844041760953
deviation-heading_max1.2760765640740437
deviation-heading_mean0.5466497354728592
deviation-heading_median0.35171107009370006
deviation-heading_min0.06092138286581164
driven_any_max2.1066666666666567
driven_any_mean1.1093333333333295
driven_any_median1.1599999999999824
driven_any_min0.3466666666666718
driven_lanedir_max2.066698089009994
driven_lanedir_mean0.9871748479623343
driven_lanedir_min0.14089729353622693
in-drivable-lane_max0.2666666666666657
in-drivable-lane_mean0.09999999999999978
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 1.1599999999999824, "driven_lanedir": 1.1244940250770317, "in-drivable-lane": 0, "deviation-heading": 0.35171107009370006, "deviation-center-line": 0.1702985030340966}, "ep003": {"driven_any": 2.1066666666666567, "driven_lanedir": 2.066698089009994, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.33465738903594666, "deviation-center-line": 0.2291035934160819}, "ep004": {"driven_any": 1.5866666666666656, "driven_lanedir": 1.2579129547459444, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.2760765640740437, "deviation-center-line": 0.1859811348549165}}
90221148krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.3437076188921928, "good_angle": 55.135940055131385, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.666666666666654}, "ep001": {"nsteps": 500, "reward": -1.8242227222919465, "good_angle": 13.666679662354603, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.166666666666652}, "ep002": {"nsteps": 500, "reward": -1.641465624094009, "good_angle": 13.613143380984368, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.699999999999989}, "ep003": {"nsteps": 500, "reward": -1.4529106883704663, "good_angle": 13.631613664217934, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.866666666666656}, "ep004": {"nsteps": 500, "reward": -1.6807689650654791, "good_angle": 13.627327985051023, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.866666666666656}}
good_angle_max55.135940055131385
good_angle_mean21.934940949547865
good_angle_median13.631613664217934
good_angle_min13.613143380984368
reward_max-1.3437076188921928
reward_mean-1.588615123742819
reward_median-1.641465624094009
reward_min-1.8242227222919465
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.666666666666654
valid_direction_mean13.25333333333332
valid_direction_median12.866666666666656
valid_direction_min12.699999999999989
90141148krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessno3220:02:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
90101147krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationabortedno3220:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9010-8249', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9010-8249', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9010-8249_evaluation" with the default driver
stderr | Creating job9010-8249_evaluator_1 ...
stderr | Creating job9010-8249_solution_1  ...
stderr | 
Creating job9010-8249_evaluator_1 ... error

stderr | ERROR: for job9010-8249_evaluator_1  Cannot start service evaluator: network job9010-8249_evaluation not found
stderr | 
Creating job9010-8249_solution_1  ... error

stderr | ERROR: for job9010-8249_solution_1  Cannot start service solution: network job9010-8249_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9010-8249_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9010-8249_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
90021146daredevilPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3220:00:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
89941146daredevilPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3220:01:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
89891145BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95961666486359, "good_angle": 0.4676297712735876, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 89, "reward": -12.263873558365896, "good_angle": 7.498966939336872, "survival_time": 2.966666666666666, "traveled_tiles": 3, "valid_direction": 1.5999999999999983}, "ep002": {"nsteps": 500, "reward": -0.3112112492863089, "good_angle": 1.5308377195982088, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.266666666666655}, "ep003": {"nsteps": 500, "reward": -0.29453446156642166, "good_angle": 1.332032465099996, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.4999999999999885}, "ep004": {"nsteps": 500, "reward": -0.7535718389488757, "good_angle": 26.42721512159393, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.233333333333337}}
good_angle_max26.42721512159393
good_angle_mean7.451336403380519
good_angle_median1.5308377195982088
good_angle_min0.4676297712735876
reward_max-0.29453446156642166
reward_mean-9.916561554606218
reward_median-0.7535718389488757
reward_min-35.95961666486359
survival_time_max16.666666666666654
survival_time_mean10.779999999999992
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean8
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max4.266666666666655
valid_direction_mean2.679999999999996
valid_direction_median3.233333333333337
valid_direction_min0.7999999999999998
89841142iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.17469981055834038
deviation-center-line_median0.13577437340228202
in-drivable-lane_median0


other stats
deviation-center-line_max0.3690261368130126
deviation-center-line_mean0.1868215134398486
deviation-center-line_min0.07742017826699252
deviation-heading_max1.7622351185600351
deviation-heading_mean0.805162110156789
deviation-heading_median0.5661175936839794
deviation-heading_min0.3811426567753047
driven_any_max0.8035976574395374
driven_any_mean0.29785529355345186
driven_any_median0.19641445731278603
driven_any_min0.07141667097160712
driven_lanedir_max0.56415417370584
driven_lanedir_mean0.23691111615687072
driven_lanedir_min0.05841435526867045
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8035976574395374, "driven_lanedir": 0.56415417370584, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7622351185600351, "deviation-center-line": 0.3690261368130126}, "ep001": {"driven_any": 0.07141667097160712, "driven_lanedir": 0.05841435526867045, "in-drivable-lane": 0, "deviation-heading": 0.3811426567753047, "deviation-center-line": 0.07742017826699252}, "ep002": {"driven_any": 0.1678525632081945, "driven_lanedir": 0.1503847723538092, "in-drivable-lane": 0, "deviation-heading": 0.5634473783805408, "deviation-center-line": 0.13577437340228202}, "ep003": {"driven_any": 0.19641445731278603, "driven_lanedir": 0.17469981055834038, "in-drivable-lane": 0, "deviation-heading": 0.7528678033840843, "deviation-center-line": 0.13152109401252535}, "ep004": {"driven_any": 0.24999511883513437, "driven_lanedir": 0.23690246889769373, "in-drivable-lane": 0, "deviation-heading": 0.5661175936839794, "deviation-center-line": 0.2203657847044305}}
89791142iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
89751142iban_alexROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9000000000000024


other stats
episodes
details{"ep000": {"nsteps": 227, "reward": -4.583543770364998, "good_angle": 0.738769635694076, "survival_time": 7.5666666666666496, "traveled_tiles": 2, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 22, "reward": -46.080067251216285, "good_angle": 0.334784063353372, "survival_time": 0.7333333333333333, "traveled_tiles": 1, "valid_direction": 0.49999999999999994}, "ep002": {"nsteps": 49, "reward": -20.86456341098766, "good_angle": 0.415166648643947, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.6000000000000018}, "ep003": {"nsteps": 57, "reward": -17.917557120715315, "good_angle": 0.49385780909770777, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0.8666666666666687}, "ep004": {"nsteps": 72, "reward": -14.377016751716534, "good_angle": 0.3078218672480584, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.5999999999999992}}
good_angle_max0.738769635694076
good_angle_mean0.4580800048074322
good_angle_median0.415166648643947
good_angle_min0.3078218672480584
reward_max-4.583543770364998
reward_mean-20.76454966100016
reward_median-17.917557120715315
reward_min-46.080067251216285
survival_time_max7.5666666666666496
survival_time_mean2.846666666666664
survival_time_min0.7333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.8066666666666663
valid_direction_median0.6000000000000018
valid_direction_min0.49999999999999994
89691141BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95936848815264, "good_angle": 0.4523226398291993, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 101, "reward": -10.819673844514009, "good_angle": 7.714513458292558, "survival_time": 3.3666666666666645, "traveled_tiles": 2, "valid_direction": 1.999999999999997}, "ep002": {"nsteps": 500, "reward": -0.3054795398933347, "good_angle": 1.3359846328925622, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.999999999999989}, "ep003": {"nsteps": 500, "reward": -0.31178840207238684, "good_angle": 1.3089262724048485, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.4999999999999876}, "ep004": {"nsteps": 500, "reward": -0.7506958901379257, "good_angle": 25.777001434725097, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.3000000000000056}}
good_angle_max25.777001434725097
good_angle_mean7.317749687628853
good_angle_median1.3359846328925622
good_angle_min0.4523226398291993
reward_max-0.3054795398933347
reward_mean-9.62940123295406
reward_median-0.7506958901379257
reward_min-35.95936848815264
survival_time_max16.666666666666654
survival_time_mean10.85999999999999
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean7.8
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max3.999999999999989
valid_direction_mean2.719999999999996
valid_direction_median3.3000000000000056
valid_direction_min0.7999999999999998
89631141BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationfailedno3220:05:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
89521137BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationfailedno3220:07:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
89471135krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes3220:03:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-1.459027695860371e-05
deviation-center-line_median0.49091729138564655
in-drivable-lane_median8.366666666666664


other stats
deviation-center-line_max0.737979263618922
deviation-center-line_mean0.4018884109286329
deviation-center-line_min0
deviation-heading_max6.544125539331323
deviation-heading_mean5.206786466293215
deviation-heading_median6.505520855142042
deviation-heading_min0
driven_any_max1.7339648630396301e-13
driven_any_mean1.027506277237568e-13
driven_any_median1.0409553657687865e-13
driven_any_min5.5524604662784894e-14
driven_lanedir_max5.070866762935111e-06
driven_lanedir_mean-1.3121856045561486e-05
driven_lanedir_min-4.052127534492911e-05
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean10.019999999999992
in-drivable-lane_min8.333333333333329
per-episodes
details{"ep000": {"driven_any": 5.5524604662784894e-14, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.7339648630396301e-13, "driven_lanedir": -4.052127534492911e-05, "in-drivable-lane": 8.366666666666664, "deviation-heading": 6.5256554741854425, "deviation-center-line": 0.737979263618922}, "ep002": {"driven_any": 7.440333645941004e-14, "driven_lanedir": -1.5568594687209725e-05, "in-drivable-lane": 8.366666666666664, "deviation-heading": 6.505520855142042, "deviation-center-line": 0.49091729138564655}, "ep003": {"driven_any": 1.0633317461574733e-13, "driven_lanedir": 5.070866762935111e-06, "in-drivable-lane": 8.399999999999995, "deviation-heading": 6.458630462807267, "deviation-center-line": 0.22765024759692803}, "ep004": {"driven_any": 1.0409553657687865e-13, "driven_lanedir": -1.459027695860371e-05, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.544125539331323, "deviation-center-line": 0.5528952520416683}}
89421133krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes3220:01:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1312918096787703
deviation-center-line_median0.23118879291899472
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.3069284744835357
deviation-center-line_mean0.2022065893027006
deviation-center-line_min0.09451129197694964
deviation-heading_max1.667328512756064
deviation-heading_mean0.7261445186520348
deviation-heading_median0.484206019660693
deviation-heading_min0.0812285104877489
driven_any_max2.109999999999963
driven_any_mean1.1146668450163095
driven_any_median1.1699999993134371
driven_any_min0.3499966500248597
driven_lanedir_max2.0693686701288616
driven_lanedir_mean0.9906478118997776
driven_lanedir_min0.14135121728493227
in-drivable-lane_max0.36666666666666664
in-drivable-lane_mean0.15333333333333304
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3533375757432721, "driven_lanedir": 0.14135121728493227, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 0.9465096950597264, "deviation-center-line": 0.09451129197694964}, "ep001": {"driven_any": 0.3499966500248597, "driven_lanedir": 0.34919299415089955, "in-drivable-lane": 0, "deviation-heading": 0.0812285104877489, "deviation-center-line": 0.1317415834937284}, "ep002": {"driven_any": 1.1699999993134371, "driven_lanedir": 1.1312918096787703, "in-drivable-lane": 0, "deviation-heading": 0.484206019660693, "deviation-center-line": 0.23118879291899472}, "ep003": {"driven_any": 2.109999999999963, "driven_lanedir": 2.0693686701288616, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.4514498552959417, "deviation-center-line": 0.3069284744835357}, "ep004": {"driven_any": 1.5900000000000158, "driven_lanedir": 1.2620343682554234, "in-drivable-lane": 0.36666666666666536, "deviation-heading": 1.667328512756064, "deviation-center-line": 0.24666280364029444}}
89241132VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3220:07:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
89221129VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.199999999999974


other stats
episodes
details{"ep000": {"nsteps": 438, "reward": -3.215577644590484, "good_angle": 16.777023426358816, "survival_time": 14.59999999999996, "traveled_tiles": 4, "valid_direction": 11.399999999999968}, "ep001": {"nsteps": 40, "reward": -25.895756457746028, "good_angle": 1.0694924163607815, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.066666666666667}, "ep002": {"nsteps": 62, "reward": -17.060033229562723, "good_angle": 2.160704706002336, "survival_time": 2.066666666666669, "traveled_tiles": 2, "valid_direction": 1.800000000000002}, "ep003": {"nsteps": 306, "reward": -4.260875962363416, "good_angle": 13.580101157669583, "survival_time": 10.199999999999974, "traveled_tiles": 4, "valid_direction": 7.533333333333315}, "ep004": {"nsteps": 350, "reward": -3.677254168254024, "good_angle": 15.943773520653684, "survival_time": 11.666666666666636, "traveled_tiles": 5, "valid_direction": 8.833333333333309}}
good_angle_max16.777023426358816
good_angle_mean9.90621904540904
good_angle_median13.580101157669583
good_angle_min1.0694924163607815
reward_max-3.215577644590484
reward_mean-10.821899492503334
reward_median-4.260875962363416
reward_min-25.895756457746028
survival_time_max14.59999999999996
survival_time_mean7.973333333333315
survival_time_min1.333333333333334
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max11.399999999999968
valid_direction_mean6.126666666666653
valid_direction_median7.533333333333315
valid_direction_min1.066666666666667
89121129VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:04:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
89101128VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3220:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8910-6439', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8910-6439', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8910-6439_evaluation" with the default driver
stderr | Creating job8910-6439_visualization_1 ...
stderr | 
Creating job8910-6439_visualization_1 ... error

stderr | ERROR: for job8910-6439_visualization_1  Cannot start service visualization: network job8910-6439_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8910-6439_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
89031128VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:01:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
88951128VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:03:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
88851125BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3220:01:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
88641125BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3220:06:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
88561123krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.2000000000000004


other stats
episodes
details{"ep000": {"nsteps": 51, "reward": -20.406392364443153, "good_angle": 0.8873066630450479, "survival_time": 1.700000000000002, "traveled_tiles": 2, "valid_direction": 0.7666666666666687}, "ep001": {"nsteps": 39, "reward": -26.159672717301127, "good_angle": 1.3410479232581582, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 1.066666666666667}, "ep002": {"nsteps": 36, "reward": -28.36412795754667, "good_angle": 1.2829153421511568, "survival_time": 1.2000000000000004, "traveled_tiles": 2, "valid_direction": 1.0000000000000004}, "ep003": {"nsteps": 35, "reward": -29.18184625437217, "good_angle": 1.221215282160583, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep004": {"nsteps": 35, "reward": -29.14305215664208, "good_angle": 1.279732575911705, "survival_time": 1.166666666666667, "traveled_tiles": 1, "valid_direction": 1.0000000000000002}}
good_angle_max1.3410479232581582
good_angle_mean1.2024435573053305
good_angle_median1.279732575911705
good_angle_min0.8873066630450479
reward_max-20.406392364443153
reward_mean-26.65101829006104
reward_median-28.36412795754667
reward_min-29.18184625437217
survival_time_max1.700000000000002
survival_time_mean1.3066666666666673
survival_time_min1.166666666666667
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.066666666666667
valid_direction_mean0.9600000000000006
valid_direction_median1.0000000000000002
valid_direction_min0.7666666666666687
88501122VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5698862613681703, "good_angle": 0.9963698273791038, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.2666666666666595}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.6392612993963994, "good_angle": 1.242364603166347, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.3999999999999915}, "ep003": {"nsteps": 500, "reward": -0.5397877506660298, "good_angle": 1.4000165353279184, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.099999999999989}, "ep004": {"nsteps": 500, "reward": -0.8430571288096252, "good_angle": 22.86696775785127, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 3.833333333333332}}
good_angle_max22.86696775785127
good_angle_mean5.3019685036094355
good_angle_median1.242364603166347
good_angle_min0.004123794322536422
reward_max-0.5397877506660298
reward_mean-7.772482370107414
reward_median-0.6392612993963994
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean13.51999999999999
survival_time_min0.9333333333333332
traveled_tiles_max12
traveled_tiles_mean8.8
traveled_tiles_median12
traveled_tiles_min1
valid_direction_max3.833333333333332
valid_direction_mean2.3199999999999945
valid_direction_median2.3999999999999915
valid_direction_min0
88371118VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:03:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.0800191384151985
deviation-center-line_median1.4537620998520973
in-drivable-lane_median5.69999999999998


other stats
deviation-center-line_max1.7204669087765312
deviation-center-line_mean1.1874341263981512
deviation-center-line_min0.08414725295459423
deviation-heading_max1.7831337144331194
deviation-heading_mean1.1771825303886414
deviation-heading_median1.4718526205875515
deviation-heading_min0.06090207335592236
driven_any_max6.32998801859085
driven_any_mean5.07141095797302
driven_any_median6.268505372753538
driven_any_min0.29270692151363087
driven_lanedir_max4.772752515201063
driven_lanedir_mean3.340705977205901
driven_lanedir_min0.29177575401793865
in-drivable-lane_max7.56666666666667
in-drivable-lane_mean4.586666666666663
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.268505372753538, "driven_lanedir": 3.4774979430591326, "in-drivable-lane": 7.56666666666667, "deviation-heading": 0.911682657700122, "deviation-center-line": 1.657779837791391}, "ep001": {"driven_any": 0.29270692151363087, "driven_lanedir": 0.29177575401793865, "in-drivable-lane": 0, "deviation-heading": 0.06090207335592236, "deviation-center-line": 0.08414725295459423}, "ep002": {"driven_any": 6.322367338240872, "driven_lanedir": 4.0814845353361715, "in-drivable-lane": 5.700000000000015, "deviation-heading": 1.7831337144331194, "deviation-center-line": 1.4537620998520973}, "ep003": {"driven_any": 6.32998801859085, "driven_lanedir": 4.772752515201063, "in-drivable-lane": 3.966666666666653, "deviation-heading": 1.6583415858664925, "deviation-center-line": 1.0210145326161415}, "ep004": {"driven_any": 6.143487138766211, "driven_lanedir": 4.0800191384151985, "in-drivable-lane": 5.69999999999998, "deviation-heading": 1.4718526205875515, "deviation-center-line": 1.7204669087765312}}
88331118VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:01:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
88291118VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3220:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8829-9177', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8829-9177', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8829-9177_evaluation" with the default driver
stderr | Creating job8829-9177_scorer_1 ...
stderr | 
Creating job8829-9177_scorer_1 ... error

stderr | ERROR: for job8829-9177_scorer_1  Cannot start service scorer: network job8829-9177_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8829-9177_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
88151118VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:06:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
88101116VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:01:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
88031116VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3220:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8803-1261', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8803-1261', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8803-1261_evaluation" with the default driver
stderr | Creating job8803-1261_scorer_1 ...
stderr | 
Creating job8803-1261_scorer_1 ... error

stderr | ERROR: for job8803-1261_scorer_1  Cannot start service scorer: network job8803-1261_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8803-1261_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
87901115VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3220:07:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
87821113krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes3220:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
87751112krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes3220:01:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
87661112krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessno3220:03:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
87611111iban_alexROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3220:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8761-8208', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8761-8208', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8761-8208_evaluation" with the default driver
stderr | Creating job8761-8208_visualization_1 ...
stderr | 
Creating job8761-8208_visualization_1 ... error

stderr | ERROR: for job8761-8208_visualization_1  Cannot start service visualization: network job8761-8208_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8761-8208_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
87591111iban_alexROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyes3220:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8759-867', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8759-867', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8759-867_evaluation" with the default driver
stderr | Creating job8759-867_videos_1 ...
stderr | 
Creating job8759-867_videos_1 ... error

stderr | ERROR: for job8759-867_videos_1  Cannot start service videos: network job8759-867_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8759-867_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
87531110VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:03:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.4671741334926467
deviation-center-line_median1.2958101170355834
in-drivable-lane_median6.300000000000013


other stats
deviation-center-line_max1.6351280540821935
deviation-center-line_mean0.986355175052001
deviation-center-line_min0.09897289157693905
deviation-heading_max2.013916250570275
deviation-heading_mean1.2276586971395471
deviation-heading_median1.496818149580234
deviation-heading_min0.06092138286581164
driven_any_max6.300532347308807
driven_any_mean4.383603780695079
driven_any_median6.015722154991967
driven_any_min0.34666666666667245
driven_lanedir_max3.856705062202037
driven_lanedir_mean2.8568503518682036
driven_lanedir_min0.3458718774424743
in-drivable-lane_max6.9666666666666455
in-drivable-lane_mean3.9400000000000017
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.214405296996363, "driven_lanedir": 3.661117948394939, "in-drivable-lane": 6.4000000000000155, "deviation-heading": 2.013916250570275, "deviation-center-line": 1.4114794115316016}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.300532347308807, "driven_lanedir": 3.856705062202037, "in-drivable-lane": 6.300000000000013, "deviation-heading": 1.6193895682632025, "deviation-center-line": 1.2958101170355834}, "ep003": {"driven_any": 3.040692437511586, "driven_lanedir": 2.953382737808921, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.9472481344182136, "deviation-center-line": 0.4903854010336875}, "ep004": {"driven_any": 6.015722154991967, "driven_lanedir": 3.4671741334926467, "in-drivable-lane": 6.9666666666666455, "deviation-heading": 1.496818149580234, "deviation-center-line": 1.6351280540821935}}
87421109sodabetastay youngaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.266666666666661


other stats
episodes
details{"ep000": {"nsteps": 40, "reward": -25.25177037610556, "good_angle": 0.6402653252392663, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1333333333333342}, "ep001": {"nsteps": 40, "reward": -25.562104041129352, "good_angle": 0.005956591799219283, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 128, "reward": -8.312191555043682, "good_angle": 0.4929748188962192, "survival_time": 4.266666666666661, "traveled_tiles": 3, "valid_direction": 1.0666666666666629}, "ep003": {"nsteps": 228, "reward": -4.689726662446271, "good_angle": 0.5025668708841372, "survival_time": 7.599999999999983, "traveled_tiles": 4, "valid_direction": 1.099999999999996}, "ep004": {"nsteps": 173, "reward": -6.3794289034955485, "good_angle": 10.402549052319154, "survival_time": 5.766666666666656, "traveled_tiles": 3, "valid_direction": 1.999999999999993}}
good_angle_max10.402549052319154
good_angle_mean2.408862531827599
good_angle_median0.5025668708841372
good_angle_min0.005956591799219283
reward_max-4.689726662446271
reward_mean-14.03904430764408
reward_median-8.312191555043682
reward_min-25.562104041129352
survival_time_max7.599999999999983
survival_time_mean4.059999999999993
survival_time_min1.333333333333334
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.999999999999993
valid_direction_mean1.0599999999999974
valid_direction_median1.099999999999996
valid_direction_min0
87351109sodabetastay youngaido1_LF1_r3-v3step1-simulationsuccessno3220:05:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
87261108BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3220:08:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
87231107daredevilPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3220:01:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3488793237522416
deviation-center-line_median0.0889692481169104
in-drivable-lane_median0.7333333333333356


other stats
deviation-center-line_max0.10804224268701285
deviation-center-line_mean0.09487224786148496
deviation-center-line_min0.08348977239520798
deviation-heading_max0.608366051951121
deviation-heading_mean0.5574968980788961
deviation-heading_median0.5632226516257168
deviation-heading_min0.48363659503855955
driven_any_max1.1039685593698203
driven_any_mean0.758378401654052
driven_any_median0.6599812039710905
driven_any_min0.6479815457170728
driven_lanedir_max0.5716983112111842
driven_lanedir_mean0.39952468480261855
driven_lanedir_min0.33211979888331666
in-drivable-lane_max1.3666666666666638
in-drivable-lane_mean0.8666666666666678
in-drivable-lane_min0.733333333333335
per-episodes
details{"ep000": {"driven_any": 1.1039685593698203, "driven_lanedir": 0.5716983112111842, "in-drivable-lane": 1.3666666666666638, "deviation-heading": 0.608366051951121, "deviation-center-line": 0.10673177973707754}, "ep001": {"driven_any": 0.7199794952411871, "driven_lanedir": 0.39976300809979626, "in-drivable-lane": 0.733333333333335, "deviation-heading": 0.5955376409473666, "deviation-center-line": 0.10804224268701285}, "ep002": {"driven_any": 0.659981203971089, "driven_lanedir": 0.3488793237522416, "in-drivable-lane": 0.7333333333333356, "deviation-heading": 0.5367215508317167, "deviation-center-line": 0.08712819637121608}, "ep003": {"driven_any": 0.6599812039710905, "driven_lanedir": 0.34516298206655405, "in-drivable-lane": 0.766666666666669, "deviation-heading": 0.48363659503855955, "deviation-center-line": 0.08348977239520798}, "ep004": {"driven_any": 0.6479815457170728, "driven_lanedir": 0.33211979888331666, "in-drivable-lane": 0.7333333333333356, "deviation-heading": 0.5632226516257168, "deviation-center-line": 0.0889692481169104}}
87181107daredevilPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3220:02:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
87151105DavidPytorch ILaido1_LF1_r3-v3step4-vizabortedyes3220:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8715-2086', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8715-2086', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8715-2086_evaluation" with the default driver
stderr | Creating job8715-2086_visualization_1 ...
stderr | 
Creating job8715-2086_visualization_1 ... error

stderr | ERROR: for job8715-2086_visualization_1  Cannot start service visualization: network job8715-2086_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8715-2086_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
87071104VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:06:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
86931100krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes3220:03:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.15741338591251397
deviation-center-line_median0.4650944282204903
in-drivable-lane_median8.299999999999994


other stats
deviation-center-line_max0.7159918628482274
deviation-center-line_mean0.3821124886057812
deviation-center-line_min0
deviation-heading_max6.540131967240777
deviation-heading_mean5.221082427757779
deviation-heading_median6.537669075338772
deviation-heading_min0
driven_any_max0.49735405772776664
driven_any_mean0.49675584668913847
driven_any_median0.4973540577277655
driven_any_min0.4943630025346415
driven_lanedir_max0
driven_lanedir_mean-0.125929382017318
driven_lanedir_min-0.15748677407321887
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean9.973333333333326
in-drivable-lane_min8.299999999999994
per-episodes
details{"ep000": {"driven_any": 0.4943630025346415, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.49735405772775193, "driven_lanedir": -0.15748677407321887, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.540131967240777, "deviation-center-line": 0.7159918628482274}, "ep002": {"driven_any": 0.49735405772776664, "driven_lanedir": -0.15729812685794475, "in-drivable-lane": 8.333333333333329, "deviation-heading": 6.487894280561919, "deviation-center-line": 0.4650944282204903}, "ep003": {"driven_any": 0.4973540577277655, "driven_lanedir": -0.15744862324291242, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.539716815647427, "deviation-center-line": 0.2023017828020126}, "ep004": {"driven_any": 0.4973540577277666, "driven_lanedir": -0.15741338591251397, "in-drivable-lane": 8.299999999999994, "deviation-heading": 6.537669075338772, "deviation-center-line": 0.527174369158176}}
86881100krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes3220:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
86811096BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3220:02:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.866747271850828
deviation-center-line_median0.5555389657911541
in-drivable-lane_median0


other stats
deviation-center-line_max1.9171462684686436
deviation-center-line_mean0.6834550844518985
deviation-center-line_min0.13763568142564955
deviation-heading_max1.339983092790369
deviation-heading_mean0.8586059365693142
deviation-heading_median0.7555585477940351
deviation-heading_min0.2981794768483772
driven_any_max5.521494310693864
driven_any_mean2.2399664634021543
driven_any_median1.9825921332763012
driven_any_min0.5876221259607323
driven_lanedir_max5.470796161018372
driven_lanedir_mean2.1618715006215092
driven_lanedir_min0.40117073158077465
in-drivable-lane_max0.4
in-drivable-lane_mean0.1133333333333332
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5876221259607323, "driven_lanedir": 0.40117073158077465, "in-drivable-lane": 0.4, "deviation-heading": 0.7555585477940351, "deviation-center-line": 0.13763568142564955}, "ep001": {"driven_any": 1.9825921332763012, "driven_lanedir": 1.866747271850828, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.217035492850674, "deviation-center-line": 0.640484380018231}, "ep002": {"driven_any": 0.815042752277472, "driven_lanedir": 0.8003586073769475, "in-drivable-lane": 0, "deviation-heading": 0.2981794768483772, "deviation-center-line": 0.1664701265558146}, "ep003": {"driven_any": 2.2930809948024025, "driven_lanedir": 2.2702847312806256, "in-drivable-lane": 0, "deviation-heading": 0.6822730725631162, "deviation-center-line": 0.5555389657911541}, "ep004": {"driven_any": 5.521494310693864, "driven_lanedir": 5.470796161018372, "in-drivable-lane": 0, "deviation-heading": 1.339983092790369, "deviation-center-line": 1.9171462684686436}}
86751098krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailedno3220:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 551, in run
    solve(params, cis)
  File "solution.py", line 469, in solve
    if len(lines) == 0:
TypeError: object of type 'NoneType' has no len()


Hidden. If you are the author, please login using the top-right link or use the dashboard.
86701096BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3220:02:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
86681093VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:02:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.6353869216617767
deviation-center-line_median0.34740755992193945
in-drivable-lane_median0.4333333333333318


other stats
deviation-center-line_max1.7489831318171625
deviation-center-line_mean0.6208057981548581
deviation-center-line_min0.09897289157693905
deviation-heading_max2.0312379535929224
deviation-heading_mean1.0323185651392408
deviation-heading_median0.8661598736045732
deviation-heading_min0.06092138286581164
driven_any_max6.36073324637261
driven_any_mean2.762790247184552
driven_any_median2.723932879418109
driven_any_min0.34666666666667245
driven_lanedir_max6.147196705143738
driven_lanedir_mean2.5389872229807287
driven_lanedir_min0.3458718774424743
in-drivable-lane_max1.1666666666666623
in-drivable-lane_mean0.4399999999999988
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8705194095920645, "driven_lanedir": 0.6483823262095907, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0.4203923273971998, "deviation-center-line": 0.1311322124169748}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 3.512099033873305, "driven_lanedir": 2.9180982844460637, "in-drivable-lane": 1.1666666666666623, "deviation-heading": 2.0312379535929224, "deviation-center-line": 0.7775331950412749}, "ep003": {"driven_any": 2.723932879418109, "driven_lanedir": 2.6353869216617767, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.8661598736045732, "deviation-center-line": 0.34740755992193945}, "ep004": {"driven_any": 6.36073324637261, "driven_lanedir": 6.147196705143738, "in-drivable-lane": 0.4333333333333318, "deviation-heading": 1.782881288235697, "deviation-center-line": 1.7489831318171625}}
86601093VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.066666666666651


other stats
episodes
details{"ep000": {"nsteps": 71, "reward": -14.309208415986472, "good_angle": 0.1365987800113235, "survival_time": 2.366666666666668, "traveled_tiles": 2, "valid_direction": 0.29999999999999993}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 286, "reward": -3.684961961026175, "good_angle": 0.6782947521232003, "survival_time": 9.53333333333331, "traveled_tiles": 7, "valid_direction": 1.9999999999999936}, "ep003": {"nsteps": 212, "reward": -4.866575889678162, "good_angle": 0.11116941822204177, "survival_time": 7.066666666666651, "traveled_tiles": 5, "valid_direction": 0.2333333333333325}, "ep004": {"nsteps": 500, "reward": -0.18805094578454737, "good_angle": 24.320267684743087, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 3.1666666666666856}}
good_angle_max24.320267684743087
good_angle_mean5.050090885884438
good_angle_median0.1365987800113235
good_angle_min0.004123794322536422
reward_max-0.18805094578454737
reward_mean-11.86384332455444
reward_median-4.866575889678162
reward_min-36.270419410296846
survival_time_max16.666666666666654
survival_time_mean7.313333333333324
survival_time_min0.9333333333333332
traveled_tiles_max13
traveled_tiles_mean5.6
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max3.1666666666666856
valid_direction_mean1.1400000000000023
valid_direction_median0.29999999999999993
valid_direction_min0
86561091pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes3220:00:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3479984180247596
deviation-center-line_median0.15444496851588396
in-drivable-lane_median0.26666666666666716


other stats
deviation-center-line_max0.16309804709975628
deviation-center-line_mean0.1396709127029548
deviation-center-line_min0.1108007403933787
deviation-heading_max1.521600167399942
deviation-heading_mean1.2206720749466835
deviation-heading_median1.238748819297116
deviation-heading_min0.6301946876993587
driven_any_max0.844378638407504
driven_any_mean0.654625786504307
driven_any_median0.6255576444601703
driven_any_min0.5702735171084232
driven_lanedir_max0.37297763840015286
driven_lanedir_mean0.33570829904849464
driven_lanedir_min0.2892670777243107
in-drivable-lane_max1.2666666666666662
in-drivable-lane_mean0.42000000000000026
in-drivable-lane_min0.13333333333333364
per-episodes
details{"ep000": {"driven_any": 0.844378638407504, "driven_lanedir": 0.3479984180247596, "in-drivable-lane": 1.2666666666666662, "deviation-heading": 0.6301946876993587, "deviation-center-line": 0.15444496851588396}, "ep001": {"driven_any": 0.6394190526828136, "driven_lanedir": 0.37297763840015286, "in-drivable-lane": 0.13333333333333375, "deviation-heading": 1.521600167399942, "deviation-center-line": 0.16309804709975628}, "ep002": {"driven_any": 0.6255576444601703, "driven_lanedir": 0.3649768296424461, "in-drivable-lane": 0.13333333333333364, "deviation-heading": 1.48715675254528, "deviation-center-line": 0.15706452249071284}, "ep003": {"driven_any": 0.5702735171084232, "driven_lanedir": 0.2892670777243107, "in-drivable-lane": 0.26666666666666716, "deviation-heading": 1.238748819297116, "deviation-center-line": 0.1108007403933787}, "ep004": {"driven_any": 0.5935000798626245, "driven_lanedir": 0.3033215314508042, "in-drivable-lane": 0.30000000000000093, "deviation-heading": 1.2256599477917216, "deviation-center-line": 0.11294628501504228}}
86521091pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.933333333333336


other stats
episodes
details{"ep000": {"nsteps": 77, "reward": -13.608360718488209, "good_angle": 1.5062601676545182, "survival_time": 2.5666666666666673, "traveled_tiles": 2, "valid_direction": 1.3666666666666667}, "ep001": {"nsteps": 60, "reward": -17.057688444604477, "good_angle": 1.8258357325297336, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 1.8000000000000027}, "ep002": {"nsteps": 58, "reward": -17.61266718628206, "good_angle": 1.781738406408049, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 1.7000000000000026}, "ep003": {"nsteps": 53, "reward": -19.279425655421363, "good_angle": 1.873411065546353, "survival_time": 1.7666666666666688, "traveled_tiles": 1, "valid_direction": 1.4666666666666688}, "ep004": {"nsteps": 54, "reward": -18.98923834634048, "good_angle": 1.891105457200604, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 1.5333333333333354}}
good_angle_max1.891105457200604
good_angle_mean1.7756701658678515
good_angle_median1.8258357325297336
good_angle_min1.5062601676545182
reward_max-13.608360718488209
reward_mean-17.309476070227316
reward_median-17.61266718628206
reward_min-19.279425655421363
survival_time_max2.5666666666666673
survival_time_mean2.0133333333333354
survival_time_min1.7666666666666688
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.8000000000000027
valid_direction_mean1.5733333333333352
valid_direction_median1.5333333333333354
valid_direction_min1.3666666666666667
86411088VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3220:03:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.050757583513121
deviation-center-line_median1.2994125499262943
in-drivable-lane_median2.033333333333326


other stats
deviation-center-line_max1.9993221263501044
deviation-center-line_mean1.1369861220422568
deviation-center-line_min0.09897289157693905
deviation-heading_max2.5472271240189612
deviation-heading_mean1.4902215688941052
deviation-heading_median1.8055175325629285
deviation-heading_min0.06092138286581164
driven_any_max6.273227779451769
driven_any_mean4.200189455821631
driven_any_median5.950123558240415
driven_any_min0.34666666666667245
driven_lanedir_max5.240250528782286
driven_lanedir_mean3.121772270637142
driven_lanedir_min0.3458718774424743
in-drivable-lane_max5.033333333333319
in-drivable-lane_mean2.613333333333325
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.950123558240415, "driven_lanedir": 4.050757583513121, "in-drivable-lane": 5.033333333333319, "deviation-heading": 2.1148164814004757, "deviation-center-line": 1.9993221263501044}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 6.222005883634688, "driven_lanedir": 4.237402110410632, "in-drivable-lane": 4.8999999999999835, "deviation-heading": 1.8055175325629285, "deviation-center-line": 1.8198826995902624}, "ep003": {"driven_any": 6.273227779451769, "driven_lanedir": 5.240250528782286, "in-drivable-lane": 2.033333333333326, "deviation-heading": 2.5472271240189612, "deviation-center-line": 1.2994125499262943}, "ep004": {"driven_any": 2.2089233911146127, "driven_lanedir": 1.7345792530371982, "in-drivable-lane": 1.099999999999996, "deviation-heading": 0.9226253236223484, "deviation-center-line": 0.46734034276768266}}
86361087BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.1385571958462242, "good_angle": 1.0827976173705394, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.066666666666658}, "ep001": {"nsteps": 500, "reward": -0.4588272203770466, "good_angle": 26.36631660973232, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 3.899999999999987}, "ep002": {"nsteps": 302, "reward": -3.5442560831083307, "good_angle": 0.8967085704316418, "survival_time": 10.066666666666642, "traveled_tiles": 6, "valid_direction": 1.7999999999999945}, "ep003": {"nsteps": 500, "reward": -0.24455104245571416, "good_angle": 1.170968986704092, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 2.5333333333333243}, "ep004": {"nsteps": 500, "reward": -0.47790012961020695, "good_angle": 22.573560307157873, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.599999999999991}}
good_angle_max26.36631660973232
good_angle_mean10.418070418279294
good_angle_median1.170968986704092
good_angle_min0.8967085704316418
reward_max-0.1385571958462242
reward_mean-0.9728183342795044
reward_median-0.4588272203770466
reward_min-3.5442560831083307
survival_time_max16.666666666666654
survival_time_mean15.346666666666652
survival_time_min10.066666666666642
traveled_tiles_max11
traveled_tiles_mean9.6
traveled_tiles_median10
traveled_tiles_min6
valid_direction_max3.899999999999987
valid_direction_mean2.7799999999999914
valid_direction_median2.599999999999991
valid_direction_min1.7999999999999945
86301087BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3220:08:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
86261085pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step4-vizabortedyes3220:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8626-6595', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8626-6595', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8626-6595_evaluation" with the default driver
stderr | Creating job8626-6595_visualization_1 ...
stderr | 
Creating job8626-6595_visualization_1 ... error

stderr | ERROR: for job8626-6595_visualization_1  Cannot start service visualization: network job8626-6595_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8626-6595_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
86211085pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3220:02:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9640057209730148, "good_angle": 46.66296274251999, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.166666666666652}, "ep001": {"nsteps": 500, "reward": -1.3020373888611794, "good_angle": 13.824044637181125, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}, "ep002": {"nsteps": 500, "reward": -1.1174760079681874, "good_angle": 13.82628678256675, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333326}, "ep003": {"nsteps": 500, "reward": -0.9247168089353216, "good_angle": 13.81327756450836, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.899999999999991}, "ep004": {"nsteps": 500, "reward": -1.161978100210428, "good_angle": 13.83176828278006, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}}
good_angle_max46.66296274251999
good_angle_mean20.391668001911256
good_angle_median13.82628678256675
good_angle_min13.81327756450836
reward_max-0.9247168089353216
reward_mean-1.0940428053896265
reward_median-1.1174760079681874
reward_min-1.3020373888611794
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.166666666666652
valid_direction_mean13.259999999999993
valid_direction_median13.09999999999999
valid_direction_min12.899999999999991
86181084BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3220:02:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
86151084BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3220:07:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
86111083BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3220:01:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
86001081lavoiemsFast Dukeaido1_LF1_r3-v3step3-videosabortedyes3220:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8600-9039', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8600-9039', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8600-9039_evaluation" with the default driver
stderr | Creating job8600-9039_videos_1 ...
stderr | 
Creating job8600-9039_videos_1 ... error

stderr | ERROR: for job8600-9039_videos_1  Cannot start service videos: network job8600-9039_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8600-9039_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
85951080lavoiemsFast Dukeaido1_LF1_r3-v3step4-vizsuccessyes3220:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.9955057655691024
deviation-center-line_median0.1791085878890079
in-drivable-lane_median0.2999999999999999


other stats
deviation-center-line_max0.406582772712122
deviation-center-line_mean0.21464777531241547
deviation-center-line_min0.09990963253085516
deviation-heading_max1.3252755756263568
deviation-heading_mean0.9049024242324478
deviation-heading_median0.8008368094712541
deviation-heading_min0.6182295439664158
driven_any_max5.010720305760874
driven_any_mean2.600240589232639
driven_any_median2.298846435398382
driven_any_min1.1455711013459484
driven_lanedir_max4.285751379767374
driven_lanedir_mean2.110527600514174
driven_lanedir_min0.6898227592988182
in-drivable-lane_max0.6666666666666643
in-drivable-lane_mean0.3933333333333327
in-drivable-lane_min0.16666666666666718
per-episodes
details{"ep000": {"driven_any": 2.298846435398382, "driven_lanedir": 1.9955057655691024, "in-drivable-lane": 0.2999999999999999, "deviation-heading": 0.6456679078137356, "deviation-center-line": 0.1791085878890079}, "ep001": {"driven_any": 1.1455711013459484, "driven_lanedir": 0.6898227592988182, "in-drivable-lane": 0.2666666666666673, "deviation-heading": 0.8008368094712541, "deviation-center-line": 0.09990963253085516}, "ep002": {"driven_any": 2.9194744673313804, "driven_lanedir": 2.232484946025281, "in-drivable-lane": 0.5666666666666649, "deviation-heading": 1.3252755756263568, "deviation-center-line": 0.28530215074242776}, "ep003": {"driven_any": 5.010720305760874, "driven_lanedir": 4.285751379767374, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 1.1345022842844763, "deviation-center-line": 0.406582772712122}, "ep004": {"driven_any": 1.6265906363266105, "driven_lanedir": 1.3490731519102948, "in-drivable-lane": 0.16666666666666718, "deviation-heading": 0.6182295439664158, "deviation-center-line": 0.10233573268766444}}
85841079lavoiemsFast Dukeaido1_LF1_r3-v3step3-videossuccessyes3220:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
85791079lavoiemsFast Dukeaido1_LF1_r3-v3step1-simulationsuccessno3220:03:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
85751077DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3220:03:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.0554428873616786
deviation-center-line_median0.6141397077561574
in-drivable-lane_median0.466666666666665


other stats
deviation-center-line_max1.0185134787913035
deviation-center-line_mean0.6297267075674231
deviation-center-line_min0.15406282312759506
deviation-heading_max2.9719488126799143
deviation-heading_mean1.7041424503792009
deviation-heading_median1.5766709344975451
deviation-heading_min0.48776593329341816
driven_any_max4.640053907361315
driven_any_mean2.914472170500271
driven_any_median2.3759232888546973
driven_any_min1.136723992762137
driven_lanedir_max4.333227170761488
driven_lanedir_mean2.7064645304119317
driven_lanedir_min1.1165744195167024
in-drivable-lane_max0.8333333333333326
in-drivable-lane_mean0.413333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.3759232888546973, "driven_lanedir": 2.0554428873616786, "in-drivable-lane": 0.8333333333333326, "deviation-heading": 1.416877853155038, "deviation-center-line": 0.6141397077561574}, "ep001": {"driven_any": 2.1616056616275197, "driven_lanedir": 2.017934293509748, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 1.5766709344975451, "deviation-center-line": 0.4478209495868899}, "ep002": {"driven_any": 4.640053907361315, "driven_lanedir": 4.333227170761488, "in-drivable-lane": 0.5666666666666682, "deviation-heading": 2.9719488126799143, "deviation-center-line": 1.0185134787913035}, "ep003": {"driven_any": 4.258054001895686, "driven_lanedir": 4.009143880910043, "in-drivable-lane": 0.466666666666665, "deviation-heading": 2.0674487182700876, "deviation-center-line": 0.91409657857517}, "ep004": {"driven_any": 1.136723992762137, "driven_lanedir": 1.1165744195167024, "in-drivable-lane": 0, "deviation-heading": 0.48776593329341816, "deviation-center-line": 0.15406282312759506}}
85611075Claudio RuchBig Fleet Controlleraido1_amod_service_quality_r1-v3step1-simulationsuccessno3220:03:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
85561072Claudio RuchAlgorithm of Webinaraido1_amod_service_quality_r1-v3step1-simulationerrorno3220:10:48
Timeout: Waited 603 [...]
Timeout:

Waited 603.440212965 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
85441070Claudio RuchJava templateaido1_amod_service_quality_r1-v3step1-simulationerrorno3220:10:57
Timeout: Waited 603 [...]
Timeout:

Waited 603.585913181 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
85411069Claudio RuchWebinar Algorithmaido1_amod_fleet_size_r1-v3step1-simulationerrorno3220:10:46
Timeout: Waited 602 [...]
Timeout:

Waited 602.665349007 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
85381066BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3220:04:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.989895791384896
deviation-center-line_median1.1553302918063904
in-drivable-lane_median1.1666666666666623


other stats
deviation-center-line_max2.3388961235533343
deviation-center-line_mean1.4609581191301255
deviation-center-line_min0.7844919613514744
deviation-heading_max2.4107762450679044
deviation-heading_mean1.807309896459126
deviation-heading_median1.9019886565358148
deviation-heading_min1.0937762649705445
driven_any_max5.615088377625264
driven_any_mean4.77235309113726
driven_any_median5.149049260363286
driven_any_min3.381530696392794
driven_lanedir_max5.572551454160816
driven_lanedir_mean4.4589456845011375
driven_lanedir_min2.961707707303685
in-drivable-lane_max1.7666666666666626
in-drivable-lane_mean0.8266666666666644
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.309930784496025, "driven_lanedir": 3.700232848313673, "in-drivable-lane": 1.7666666666666626, "deviation-heading": 2.4107762450679044, "deviation-center-line": 0.9759199581671592}, "ep001": {"driven_any": 5.406166336808935, "driven_lanedir": 4.989895791384896, "in-drivable-lane": 1.1666666666666623, "deviation-heading": 2.00735785023558, "deviation-center-line": 2.05015226077227}, "ep002": {"driven_any": 3.381530696392794, "driven_lanedir": 2.961707707303685, "in-drivable-lane": 1.1999999999999966, "deviation-heading": 1.622650465485788, "deviation-center-line": 0.7844919613514744}, "ep003": {"driven_any": 5.149049260363286, "driven_lanedir": 5.070340621342618, "in-drivable-lane": 0, "deviation-heading": 1.9019886565358148, "deviation-center-line": 1.1553302918063904}, "ep004": {"driven_any": 5.615088377625264, "driven_lanedir": 5.572551454160816, "in-drivable-lane": 0, "deviation-heading": 1.0937762649705445, "deviation-center-line": 2.3388961235533343}}
85301066BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3220:08:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
85151064BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3220:03:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
85071063BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.25416273124999134, "good_angle": 0.7444893646124573, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 500, "reward": -0.44939830574346706, "good_angle": 23.524621673805804, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.166666666666655}, "ep002": {"nsteps": 500, "reward": -0.3045769970673136, "good_angle": 0.7257529187394196, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.5666666666666649}, "ep003": {"nsteps": 500, "reward": -0.2888979723546654, "good_angle": 0.4591799947974504, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 0.6999999999999975}, "ep004": {"nsteps": 500, "reward": -0.39088739768415687, "good_angle": 17.242621474406523, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.166666666666659}}
good_angle_max23.524621673805804
good_angle_mean8.539333085272329
good_angle_median0.7444893646124573
good_angle_min0.4591799947974504
reward_max-0.25416273124999134
reward_mean-0.3375846808199189
reward_median-0.3045769970673136
reward_min-0.44939830574346706
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max11
traveled_tiles_mean10.2
traveled_tiles_median10
traveled_tiles_min9
valid_direction_max4.166666666666655
valid_direction_mean2.013333333333327
valid_direction_median1.5666666666666649
valid_direction_min0.6999999999999975
84851059MandanaSamieibazinga!!!aido1_LF1_r3-v3step3-videossuccessyes3220:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
84821059MandanaSamieibazinga!!!aido1_LF1_r3-v3step1-simulationsuccessno3220:02:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
84781057BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes3220:04:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.034610742162956
deviation-center-line_median1.8956281287939272
in-drivable-lane_median6.099999999999979


other stats
deviation-center-line_max2.652751104603314
deviation-center-line_mean1.9755294461261648
deviation-center-line_min1.6460899544723115
deviation-heading_max2.4144712209664254
deviation-heading_mean1.7462435374566574
deviation-heading_median1.549177300553512
deviation-heading_min1.3896800543892318
driven_any_max4.823539949571194
driven_any_mean4.331121312274041
driven_any_median4.305734913326064
driven_any_min4.004167583190454
driven_lanedir_max4.769070445602773
driven_lanedir_mean3.2622858195009172
driven_lanedir_min2.367545820834376
in-drivable-lane_max6.933333333333344
in-drivable-lane_mean4.439999999999992
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.305734913326064, "driven_lanedir": 2.7093287000445647, "in-drivable-lane": 6.79999999999998, "deviation-heading": 1.416082836559443, "deviation-center-line": 1.6657844396461023}, "ep001": {"driven_any": 4.004167583190454, "driven_lanedir": 3.4308733888599168, "in-drivable-lane": 2.366666666666659, "deviation-heading": 2.4144712209664254, "deviation-center-line": 2.017393603115168}, "ep002": {"driven_any": 4.036269614585406, "driven_lanedir": 2.367545820834376, "in-drivable-lane": 6.933333333333344, "deviation-heading": 1.549177300553512, "deviation-center-line": 1.6460899544723115}, "ep003": {"driven_any": 4.485894500697086, "driven_lanedir": 3.034610742162956, "in-drivable-lane": 6.099999999999979, "deviation-heading": 1.3896800543892318, "deviation-center-line": 1.8956281287939272}, "ep004": {"driven_any": 4.823539949571194, "driven_lanedir": 4.769070445602773, "in-drivable-lane": 0, "deviation-heading": 1.9618062748146752, "deviation-center-line": 2.652751104603314}}
84761057BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5926259270254522, "good_angle": 0.8191843059460885, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 1.8333333333333268}, "ep001": {"nsteps": 500, "reward": -0.5868085568649695, "good_angle": 44.97307514874745, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 6.566666666666675}, "ep002": {"nsteps": 500, "reward": -0.660754750397522, "good_angle": 0.9797513618123548, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.666666666666661}, "ep003": {"nsteps": 500, "reward": -0.6510454961033538, "good_angle": 0.842613897542074, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.3333333333333273}, "ep004": {"nsteps": 500, "reward": -0.47875257387198505, "good_angle": 29.73362753251532, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 4.3333333333333215}}
good_angle_max44.97307514874745
good_angle_mean15.469650449312656
good_angle_median0.9797513618123548
good_angle_min0.8191843059460885
reward_max-0.47875257387198505
reward_mean-0.5939974608526565
reward_median-0.5926259270254522
reward_min-0.660754750397522
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max9
traveled_tiles_mean9
traveled_tiles_median9
traveled_tiles_min9
valid_direction_max6.566666666666675
valid_direction_mean3.5466666666666624
valid_direction_median2.666666666666661
valid_direction_min1.8333333333333268
84721057BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno3220:08:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
84581055BenjaminMy ROS solution - param 3aido1_LF1_r3-v3step4-vizsuccessyes3220:03:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.27823326643947355
deviation-center-line_median0.1754483586704807
in-drivable-lane_median14.799999999999985


other stats
deviation-center-line_max0.20899834319026736
deviation-center-line_mean0.15320968266867013
deviation-center-line_min0.023037552405942577
deviation-heading_max1.2386213492038547
deviation-heading_mean0.8573000528571967
deviation-heading_median1.0299514458628671
deviation-heading_min0.013555570229481402
driven_any_max3.8920911916260423
driven_any_mean3.7744849641040914
driven_any_median3.819814656332734
driven_any_min3.60000451186592
driven_lanedir_max0.31956498306497005
driven_lanedir_mean0.23903991065794175
driven_lanedir_min0.02978106876073494
in-drivable-lane_max16.53333333333332
in-drivable-lane_mean15.079999999999988
in-drivable-lane_min14.53333333333332
per-episodes
details{"ep000": {"driven_any": 3.8523436137415583, "driven_lanedir": 0.02978106876073494, "in-drivable-lane": 16.53333333333332, "deviation-heading": 0.013555570229481402, "deviation-center-line": 0.023037552405942577}, "ep001": {"driven_any": 3.708170846954202, "driven_lanedir": 0.305872389512019, "in-drivable-lane": 14.53333333333332, "deviation-heading": 1.2386213492038547, "deviation-center-line": 0.20899834319026736}, "ep002": {"driven_any": 3.60000451186592, "driven_lanedir": 0.27823326643947355, "in-drivable-lane": 14.799999999999985, "deviation-heading": 1.0665703560324402, "deviation-center-line": 0.1754483586704807}, "ep003": {"driven_any": 3.819814656332734, "driven_lanedir": 0.2617478455125113, "in-drivable-lane": 14.866666666666651, "deviation-heading": 0.9378015429573398, "deviation-center-line": 0.15942617918544966}, "ep004": {"driven_any": 3.8920911916260423, "driven_lanedir": 0.31956498306497005, "in-drivable-lane": 14.666666666666652, "deviation-heading": 1.0299514458628671, "deviation-center-line": 0.1991379798912105}}
84551055BenjaminMy ROS solution - param 3aido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.3771748235225678, "good_angle": 1.0277198501197526, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.366666666666659}, "ep001": {"nsteps": 500, "reward": -1.3083202472282571, "good_angle": 44.456263798940945, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 7.599999999999982}, "ep002": {"nsteps": 500, "reward": -1.1992063284544274, "good_angle": 1.568864095112673, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.9333333333333274}, "ep003": {"nsteps": 500, "reward": -1.2368925113058649, "good_angle": 1.4365797579696458, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 3.7666666666666617}, "ep004": {"nsteps": 500, "reward": -1.218028003601357, "good_angle": 45.29305904817017, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 6.533333333333354}}
good_angle_max45.29305904817017
good_angle_mean18.75649731006264
good_angle_median1.568864095112673
good_angle_min1.0277198501197526
reward_max-1.1992063284544274
reward_mean-1.267924382822495
reward_median-1.2368925113058649
reward_min-1.3771748235225678
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max8
traveled_tiles_mean7.6
traveled_tiles_median8
traveled_tiles_min7
valid_direction_max7.599999999999982
valid_direction_mean4.839999999999996
valid_direction_median3.9333333333333274
valid_direction_min2.366666666666659
84471055BenjaminMy ROS solution - param 3aido1_LF1_r3-v3step1-simulationabortedno3220:00:16
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8447-2184', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8447-2184', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8447-2184_evaluation" with the default driver
stderr | Creating job8447-2184_evaluator_1 ...
stderr | Creating job8447-2184_solution_1  ...
stderr | 
Creating job8447-2184_evaluator_1 ... error

stderr | ERROR: for job8447-2184_evaluator_1  Cannot start service evaluator: network job8447-2184_evaluation not found
stderr | 
Creating job8447-2184_solution_1  ... error

stderr | ERROR: for job8447-2184_solution_1  Cannot start service solution: network job8447-2184_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8447-2184_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8447-2184_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
84401054DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3220:05:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
84361053sodabetastay youngaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.6666666666666634


other stats
episodes
details{"ep000": {"nsteps": 34, "reward": -29.653921192765292, "good_angle": 0.5432750363228189, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0.9666666666666668}, "ep001": {"nsteps": 34, "reward": -29.970305812709473, "good_angle": 0.0050401930608778515, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 110, "reward": -9.593723950873722, "good_angle": 0.43242677581517874, "survival_time": 3.6666666666666634, "traveled_tiles": 3, "valid_direction": 0.93333333333333}, "ep003": {"nsteps": 196, "reward": -5.411052850930362, "good_angle": 0.4479678779418729, "survival_time": 6.53333333333332, "traveled_tiles": 4, "valid_direction": 0.9666666666666632}, "ep004": {"nsteps": 148, "reward": -7.345814647617108, "good_angle": 8.8217135095513, "survival_time": 4.933333333333326, "traveled_tiles": 3, "valid_direction": 1.699999999999994}}
good_angle_max8.8217135095513
good_angle_mean2.05008467853841
good_angle_median0.4479678779418729
good_angle_min0.0050401930608778515
reward_max-5.411052850930362
reward_mean-16.39496369097919
reward_median-9.593723950873722
reward_min-29.970305812709473
survival_time_max6.53333333333332
survival_time_mean3.4799999999999955
survival_time_min1.1333333333333335
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.699999999999994
valid_direction_mean0.9133333333333308
valid_direction_median0.9666666666666632
valid_direction_min0
84261052MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:02:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
84151050DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3220:00:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
84131050DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.666666666666649


other stats
episodes
details{"ep000": {"nsteps": 37, "reward": -27.294602750913818, "good_angle": 0.8483111658711615, "survival_time": 1.2333333333333338, "traveled_tiles": 1, "valid_direction": 1.033333333333334}, "ep001": {"nsteps": 500, "reward": -0.4528968470962718, "good_angle": 21.56866975144795, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.233333333333319}, "ep002": {"nsteps": 129, "reward": -7.944797620781907, "good_angle": 0.5179636696946632, "survival_time": 4.2999999999999945, "traveled_tiles": 3, "valid_direction": 0.7666666666666639}, "ep003": {"nsteps": 230, "reward": -4.314899835234973, "good_angle": 0.54671284450962, "survival_time": 7.666666666666649, "traveled_tiles": 4, "valid_direction": 0.7666666666666639}, "ep004": {"nsteps": 500, "reward": -0.5305628583235666, "good_angle": 17.07359450863618, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.3333333333333215}}
good_angle_max21.56866975144795
good_angle_mean8.111050388031916
good_angle_median0.8483111658711615
good_angle_min0.5179636696946632
reward_max-0.4528968470962718
reward_mean-8.107551982470108
reward_median-4.314899835234973
reward_min-27.294602750913818
survival_time_max16.666666666666654
survival_time_mean9.306666666666658
survival_time_min1.2333333333333338
traveled_tiles_max10
traveled_tiles_mean5.4
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max4.233333333333319
valid_direction_mean2.0266666666666606
valid_direction_median1.033333333333334
valid_direction_min0.7666666666666639
84051049pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.1908358143549411, "good_angle": 52.998119493951805, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.399999999999988}, "ep001": {"nsteps": 81, "reward": -14.254433165729782, "good_angle": 2.269004340923326, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.133333333333333}, "ep002": {"nsteps": 500, "reward": -1.1189317028583028, "good_angle": 13.593426476868045, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999991}, "ep003": {"nsteps": 500, "reward": -1.380652267164085, "good_angle": 14.002594977984336, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.799999999999994}, "ep004": {"nsteps": 167, "reward": -7.758919574008017, "good_angle": 4.657493046100808, "survival_time": 5.566666666666657, "traveled_tiles": 1, "valid_direction": 4.433333333333325}}
good_angle_max52.998119493951805
good_angle_mean17.504127667165662
good_angle_median13.593426476868045
good_angle_min2.269004340923326
reward_max-1.1189317028583028
reward_mean-5.1407545048230245
reward_median-1.380652267164085
reward_min-14.254433165729782
survival_time_max16.666666666666654
survival_time_mean11.653333333333324
survival_time_min2.7
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.399999999999988
valid_direction_mean9.353333333333325
valid_direction_median12.799999999999994
valid_direction_min2.133333333333333
83971042sodabetastay youngaido1_LF1_r3-v3step3-videossuccessyes3220:01:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83941047pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.197739092302043, "good_angle": 52.80917847452318, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.499999999999986}, "ep001": {"nsteps": 138, "reward": -9.111790748178096, "good_angle": 3.800184563779621, "survival_time": 4.599999999999993, "traveled_tiles": 1, "valid_direction": 3.666666666666661}, "ep002": {"nsteps": 500, "reward": -1.104745883501571, "good_angle": 13.562967526417962, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.93333333333332}, "ep003": {"nsteps": 500, "reward": -1.1998082705645938, "good_angle": 14.056458667043689, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.933333333333325}, "ep004": {"nsteps": 369, "reward": -4.568006843570771, "good_angle": 10.217857107443788, "survival_time": 12.299999999999969, "traveled_tiles": 1, "valid_direction": 9.733333333333308}}
good_angle_max52.80917847452318
good_angle_mean18.88932926784165
good_angle_median13.562967526417962
good_angle_min3.800184563779621
reward_max-1.104745883501571
reward_mean-3.4364181676234153
reward_median-1.1998082705645938
reward_min-9.111790748178096
survival_time_max16.666666666666654
survival_time_mean13.379999999999985
survival_time_min4.599999999999993
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.499999999999986
valid_direction_mean10.75333333333332
valid_direction_median12.93333333333332
valid_direction_min3.666666666666661
83901047pravishsainathPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3220:04:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
83861045DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3220:01:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83811045DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.07831167613854632, "good_angle": 0.10488373112954916, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep001": {"nsteps": 43, "reward": -23.9106015902619, "good_angle": 0.2431965522977674, "survival_time": 1.4333333333333345, "traveled_tiles": 1, "valid_direction": 0.9333333333333343}, "ep002": {"nsteps": 500, "reward": -0.08896892983990255, "good_angle": 1.587610648010474, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.666666666666657}, "ep003": {"nsteps": 500, "reward": 0.2634899687754514, "good_angle": 0.04892622029136081, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.06862925032433122, "good_angle": 19.198202560906974, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 2.2333333333333254}}
good_angle_max19.198202560906974
good_angle_mean4.236563942527225
good_angle_median0.2431965522977674
good_angle_min0.04892622029136081
reward_max0.2634899687754514
reward_mean-4.745279625102428
reward_median-0.06862925032433122
reward_min-23.9106015902619
survival_time_max16.666666666666654
survival_time_mean13.61999999999999
survival_time_min1.4333333333333345
traveled_tiles_max5
traveled_tiles_mean3.4
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max2.666666666666657
valid_direction_mean1.1666666666666634
valid_direction_median0.9333333333333343
valid_direction_min0
83741046DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3220:02:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
83731044DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.833333333333315


other stats
episodes
details{"ep000": {"nsteps": 235, "reward": -4.062971331277228, "good_angle": 0.683882339362836, "survival_time": 7.833333333333315, "traveled_tiles": 4, "valid_direction": 0.7666666666666639}, "ep001": {"nsteps": 19, "reward": -53.207290230613005, "good_angle": 0.037655511704543704, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.06666666666666665}, "ep002": {"nsteps": 302, "reward": -3.895407359184395, "good_angle": 3.3392309434551373, "survival_time": 10.066666666666642, "traveled_tiles": 6, "valid_direction": 3.4999999999999876}, "ep003": {"nsteps": 435, "reward": -2.0974298458787257, "good_angle": 0.659590743648572, "survival_time": 14.49999999999996, "traveled_tiles": 7, "valid_direction": 0.7333333333333307}, "ep004": {"nsteps": 178, "reward": -6.137244381180572, "good_angle": 11.582440449413555, "survival_time": 5.933333333333322, "traveled_tiles": 4, "valid_direction": 2.166666666666659}}
good_angle_max11.582440449413555
good_angle_mean3.2605599975169284
good_angle_median0.683882339362836
good_angle_min0.037655511704543704
reward_max-2.0974298458787257
reward_mean-13.880068629626786
reward_median-4.062971331277228
reward_min-53.207290230613005
survival_time_max14.49999999999996
survival_time_mean7.7933333333333135
survival_time_min0.6333333333333333
traveled_tiles_max7
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max3.4999999999999876
valid_direction_mean1.4466666666666614
valid_direction_median0.7666666666666639
valid_direction_min0.06666666666666665
83631044DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3220:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
83601042sodabetastay youngaido1_LF1_r3-v3step3-videossuccessyes3220:01:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83531042sodabetastay youngaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.6


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.6635833896398544, "good_angle": 59.10111581671121, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.13333333333332}, "ep001": {"nsteps": 14, "reward": -72.08509808140141, "good_angle": 0.32793213429047213, "survival_time": 0.4666666666666666, "traveled_tiles": 1, "valid_direction": 0.3666666666666666}, "ep002": {"nsteps": 18, "reward": -56.13111195961634, "good_angle": 0.5592134700687729, "survival_time": 0.6, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}, "ep003": {"nsteps": 28, "reward": -37.21505528422339, "good_angle": 0.9237378106184164, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.8333333333333331}, "ep004": {"nsteps": 17, "reward": -59.37879015067045, "good_angle": 0.4376820075900353, "survival_time": 0.5666666666666667, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}}
good_angle_max59.10111581671121
good_angle_mean12.26993624785578
good_angle_median0.5592134700687729
good_angle_min0.32793213429047213
reward_max-1.6635833896398544
reward_mean-45.29472777311029
reward_median-56.13111195961634
reward_min-72.08509808140141
survival_time_max16.666666666666654
survival_time_mean3.846666666666664
survival_time_min0.4666666666666666
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.13333333333332
valid_direction_mean3.4533333333333305
valid_direction_median0.49999999999999994
valid_direction_min0.3666666666666666
83491040VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:01:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83411040VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:04:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
83341038orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step4-vizabortedyes3220:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8334-3463', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8334-3463', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8334-3463_evaluation" with the default driver
stderr | Creating job8334-3463_visualization_1 ...
stderr | 
Creating job8334-3463_visualization_1 ... error

stderr | ERROR: for job8334-3463_visualization_1  Cannot start service visualization: network job8334-3463_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job8334-3463_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
83281036VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3220:06:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
83191034lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizsuccessyes3220:01:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.8341183952516875
deviation-center-line_median0.1358348793072531
in-drivable-lane_median0.8333333333333304


other stats
deviation-center-line_max0.6382228311645498
deviation-center-line_mean0.2245195044722196
deviation-center-line_min0
deviation-heading_max1.9602035414083736
deviation-heading_mean0.7779025626180096
deviation-heading_median0.26837434244431935
deviation-heading_min0
driven_any_max4.013385758739609
driven_any_mean1.5186964751910996
driven_any_median1.0537632787052789
driven_any_min0.5266524301703258
driven_lanedir_max2.6815313575984794
driven_lanedir_mean1.0169025785818993
driven_lanedir_min0
in-drivable-lane_max2.7333333333333236
in-drivable-lane_mean1.1133333333333313
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6130818994328824, "driven_lanedir": 0, "in-drivable-lane": 2.0000000000000027, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.5266524301703258, "driven_lanedir": 0.5218129970084366, "in-drivable-lane": 0, "deviation-heading": 0.16141368104811712, "deviation-center-line": 0.1214156436616722}, "ep002": {"driven_any": 1.386599008907402, "driven_lanedir": 0.8341183952516875, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 1.4995212481892382, "deviation-center-line": 0.227124168227623}, "ep003": {"driven_any": 4.013385758739609, "driven_lanedir": 2.6815313575984794, "in-drivable-lane": 2.7333333333333236, "deviation-heading": 1.9602035414083736, "deviation-center-line": 0.6382228311645498}, "ep004": {"driven_any": 1.0537632787052789, "driven_lanedir": 1.047050143050892, "in-drivable-lane": 0, "deviation-heading": 0.26837434244431935, "deviation-center-line": 0.1358348793072531}}
83131034lavoiemsYoung Dukeaido1_LF1_r3-v3step3-videossuccessyes3220:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
83091034lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationsuccessno3220:01:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
82991032sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3220:05:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 89, in solve
    observation, reward, done, info = env.step(action)
  File "/workspace/wrappers.py", line 252, in step
    return self.step_wait()
  File "/workspace/wrappers.py", line 271, in step_wait
    results = [env.step(a) for (a,env) in zip(self.actions, self.envs)]
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82961031lmandrileTensorflow templateaido1_LF1_r3-v3step1-simulationfailedno3220:00:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 86, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 29, in solve
    from model import TensorflowModel
  File "/workspace/model.py", line 55
    return vels
SyntaxError: 'return' outside function


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82831027VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:05:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
82681023sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3220:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 67, in solve
    from model import A2CPG
  File "/workspace/model.py", line 241
    self._obs_shape = (obs_shape[0] * num_stack,) + *obs_shape[1:]
                                                    ^
SyntaxError: invalid syntax


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82661022sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3220:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 67, in solve
    from model import A2CPG
  File "/workspace/model.py", line 241
    self._obs_shape = (obs_shape[0] * num_stack, *obs_shape[1:])
                                                 ^
SyntaxError: invalid syntax


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82611019sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3220:00:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 286, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
ModuleNotFoundError: No module named 'duckietown_rl'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 286, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 358, in load
    return _load(f, map_location, pickle_module)
  File "/usr/local/lib/python3.7/site-packages/torch/serialization.py", line 542, in _load
    result = unpickler.load()
ModuleNotFoundError: No module named 'duckietown_rl'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82581018sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3220:00:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 285, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
NameError: name 'os' is not defined

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 73, in solve
    model.load("model.pt", "models")
  File "/workspace/model.py", line 285, in load
    self._actor_critic, self._ob_rms = torch.load(os.path.join(directory, filename))
NameError: name 'os' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82551017sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3220:02:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    num_stack=1)
  File "/workspace/model.py", line 239, in __init__
    self._obs_shape = (obs_shape[0] * args.num_stack, *obs_shape[1:])
NameError: name 'args' is not defined

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 127, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    num_stack=1)
  File "/workspace/model.py", line 239, in __init__
    self._obs_shape = (obs_shape[0] * args.num_stack, *obs_shape[1:])
NameError: name 'args' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
82501016orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step4-vizsuccessyes3220:02:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0420704966136085
deviation-center-line_median0.450762725966435
in-drivable-lane_median1.4333333333333282


other stats
deviation-center-line_max0.6883340509228337
deviation-center-line_mean0.4338478802433427
deviation-center-line_min0.20320804757303057
deviation-heading_max2.472742851242546
deviation-heading_mean1.6272956424260854
deviation-heading_median1.779711963877342
deviation-heading_min0.3847169219113941
driven_any_max3.3232179923540857
driven_any_mean1.4969973296695418
driven_any_median1.434880110160263
driven_any_min0.3975416116703704
driven_lanedir_max2.9516039212976346
driven_lanedir_mean1.1778170860958144
driven_lanedir_min0.19414959063454773
in-drivable-lane_max2.633333333333325
in-drivable-lane_mean1.3266666666666622
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3975416116703704, "driven_lanedir": 0.19414959063454773, "in-drivable-lane": 0.36666666666666664, "deviation-heading": 1.938830071623383, "deviation-center-line": 0.20320804757303057}, "ep001": {"driven_any": 0.5652526814066909, "driven_lanedir": 0.5544790059832945, "in-drivable-lane": 0, "deviation-heading": 0.3847169219113941, "deviation-center-line": 0.3704325753311614}, "ep002": {"driven_any": 1.434880110160263, "driven_lanedir": 1.0420704966136085, "in-drivable-lane": 1.4333333333333282, "deviation-heading": 2.472742851242546, "deviation-center-line": 0.450762725966435}, "ep003": {"driven_any": 3.3232179923540857, "driven_lanedir": 2.9516039212976346, "in-drivable-lane": 2.199999999999992, "deviation-heading": 1.5604764034757617, "deviation-center-line": 0.6883340509228337}, "ep004": {"driven_any": 1.7640942527562995, "driven_lanedir": 1.1467824159499866, "in-drivable-lane": 2.633333333333325, "deviation-heading": 1.779711963877342, "deviation-center-line": 0.456502001423253}}
82461016orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step3-videosabortedyes3220:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8246-9677', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8246-9677', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8246-9677_evaluation" with the default driver
stderr | Creating job8246-9677_videos_1 ...
stderr | 
Creating job8246-9677_videos_1 ... error

stderr | ERROR: for job8246-9677_videos_1  Cannot start service videos: network job8246-9677_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8246-9677_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
82401016orlando.m.bol@gmail.comImitatingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.533333333333316


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -13.416412785493058, "good_angle": 0.9723576108709706, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.333333333333334}, "ep001": {"nsteps": 108, "reward": -9.848042460503402, "good_angle": 2.041641545621004, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5666666666666647}, "ep002": {"nsteps": 226, "reward": -4.574839447271614, "good_angle": 1.5760425170941503, "survival_time": 7.533333333333316, "traveled_tiles": 5, "valid_direction": 2.5999999999999908}, "ep003": {"nsteps": 500, "reward": -0.13448444758018013, "good_angle": 0.6536031283623902, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 2.06666666666666}, "ep004": {"nsteps": 282, "reward": -4.769903202343019, "good_angle": 16.060156931528677, "survival_time": 9.399999999999975, "traveled_tiles": 3, "valid_direction": 4.166666666666653}}
good_angle_max16.060156931528677
good_angle_mean4.260760346695439
good_angle_median1.5760425170941503
good_angle_min0.6536031283623902
reward_max-0.13448444758018013
reward_mean-6.548736468638255
reward_median-4.769903202343019
reward_min-13.416412785493058
survival_time_max16.666666666666654
survival_time_mean7.946666666666656
survival_time_min2.533333333333334
traveled_tiles_max6
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.166666666666653
valid_direction_mean2.3466666666666605
valid_direction_median2.333333333333334
valid_direction_min0.5666666666666647
82281015DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3220:01:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.08394985266846833
deviation-center-line_median0.0778449551053503
in-drivable-lane_median0


other stats
deviation-center-line_max0.16898661366894904
deviation-center-line_mean0.10439867905289547
deviation-center-line_min0.07248195277312836
deviation-heading_max1.7253708370840477
deviation-heading_mean0.7875510991650424
deviation-heading_median0.5037614413554353
deviation-heading_min0.4630156498742613
driven_any_max0.7513848549189196
driven_any_mean0.2360831876768089
driven_any_median0.10707211462789996
driven_any_min0.0994549271256484
driven_lanedir_max0.18517716028379183
driven_lanedir_mean0.10393327662038757
driven_lanedir_min0.07534926778880213
in-drivable-lane_max3.1999999999999984
in-drivable-lane_mean0.6399999999999997
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7513848549189196, "driven_lanedir": 0.18517716028379183, "in-drivable-lane": 3.1999999999999984, "deviation-heading": 1.7253708370840477, "deviation-center-line": 0.16898661366894904}, "ep001": {"driven_any": 0.10707211462789996, "driven_lanedir": 0.09269693187246995, "in-drivable-lane": 0, "deviation-heading": 0.5037614413554353, "deviation-center-line": 0.1279065617281198}, "ep002": {"driven_any": 0.0994549271256484, "driven_lanedir": 0.07534926778880213, "in-drivable-lane": 0, "deviation-heading": 0.4951494830918272, "deviation-center-line": 0.07248195277312836}, "ep003": {"driven_any": 0.11762045880819127, "driven_lanedir": 0.08249317048840554, "in-drivable-lane": 0, "deviation-heading": 0.7504580844196407, "deviation-center-line": 0.07477331198892995}, "ep004": {"driven_any": 0.1048835829033852, "driven_lanedir": 0.08394985266846833, "in-drivable-lane": 0, "deviation-heading": 0.4630156498742613, "deviation-center-line": 0.0778449551053503}}
82131013DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3220:01:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.045501921968241
deviation-center-line_median0.2091624126838803
in-drivable-lane_median0.6666666666666643


other stats
deviation-center-line_max0.4092460733590128
deviation-center-line_mean0.22209535103391645
deviation-center-line_min0.09069371930535795
deviation-heading_max1.9898991959179324
deviation-heading_mean0.94011531750907
deviation-heading_median0.9544381615223942
deviation-heading_min0.21977299030009587
driven_any_max4.767455751110348
driven_any_mean2.001900079658949
driven_any_median1.441799742533946
driven_any_min0.4699652285178057
driven_lanedir_max3.5709948744457645
driven_lanedir_mean1.5296434476594245
driven_lanedir_min0.3889697115797952
in-drivable-lane_max1.233333333333329
in-drivable-lane_mean0.6866666666666648
in-drivable-lane_min0.16666666666666718
per-episodes
details{"ep000": {"driven_any": 2.345456280523682, "driven_lanedir": 1.78342391275278, "in-drivable-lane": 1.0666666666666644, "deviation-heading": 1.272508723248177, "deviation-center-line": 0.3002014448323916}, "ep001": {"driven_any": 0.4699652285178057, "driven_lanedir": 0.3889697115797952, "in-drivable-lane": 0.16666666666666718, "deviation-heading": 0.26395751655675054, "deviation-center-line": 0.1011731049889396}, "ep002": {"driven_any": 1.441799742533946, "driven_lanedir": 1.045501921968241, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 0.9544381615223942, "deviation-center-line": 0.2091624126838803}, "ep003": {"driven_any": 4.767455751110348, "driven_lanedir": 3.5709948744457645, "in-drivable-lane": 1.233333333333329, "deviation-heading": 1.9898991959179324, "deviation-center-line": 0.4092460733590128}, "ep004": {"driven_any": 0.984823395608963, "driven_lanedir": 0.85932681755054, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 0.21977299030009587, "deviation-center-line": 0.09069371930535795}}
82101012DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes3220:01:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.361710864104449
deviation-center-line_median0.2783072659197908
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.6050064686595661
deviation-center-line_mean0.31461217400608266
deviation-center-line_min0.17005166211675882
deviation-heading_max1.9169169762749656
deviation-heading_mean1.3761961901678326
deviation-heading_median1.2759200934769432
deviation-heading_min0.9383173707596384
driven_any_max4.252547344324386
driven_any_mean2.1598055194999795
driven_any_median1.595991497331806
driven_any_min1.1641876080390487
driven_lanedir_max4.024505797728752
driven_lanedir_mean1.923334501859577
driven_lanedir_min0.8874632716964423
in-drivable-lane_max0.5999999999999999
in-drivable-lane_mean0.2333333333333329
in-drivable-lane_min0.033333333333333215
per-episodes
details{"ep000": {"driven_any": 2.3423219042750647, "driven_lanedir": 2.039163406184771, "in-drivable-lane": 0.5999999999999999, "deviation-heading": 1.2641576047306058, "deviation-center-line": 0.2783072659197908}, "ep001": {"driven_any": 1.1641876080390487, "driven_lanedir": 0.8874632716964423, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.4856689055970107, "deviation-center-line": 0.29214794376015657}, "ep002": {"driven_any": 1.443979243529592, "driven_lanedir": 1.361710864104449, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.9383173707596384, "deviation-center-line": 0.227547529574141}, "ep003": {"driven_any": 4.252547344324386, "driven_lanedir": 4.024505797728752, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.9169169762749656, "deviation-center-line": 0.6050064686595661}, "ep004": {"driven_any": 1.595991497331806, "driven_lanedir": 1.3038291695834712, "in-drivable-lane": 0.2333333333333325, "deviation-heading": 1.2759200934769432, "deviation-center-line": 0.17005166211675882}}
82021012DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.133333333333328


other stats
episodes
details{"ep000": {"nsteps": 188, "reward": -5.302508274819628, "good_angle": 0.2336332078066926, "survival_time": 6.266666666666654, "traveled_tiles": 5, "valid_direction": 0.33333333333333215}, "ep001": {"nsteps": 96, "reward": -11.286469660078486, "good_angle": 5.260110817210399, "survival_time": 3.1999999999999984, "traveled_tiles": 2, "valid_direction": 1.8333333333333308}, "ep002": {"nsteps": 116, "reward": -8.673792693163831, "good_angle": 0.14625930291742983, "survival_time": 3.8666666666666623, "traveled_tiles": 4, "valid_direction": 0.36666666666666536}, "ep003": {"nsteps": 331, "reward": -3.113548352757646, "good_angle": 0.2870058529237993, "survival_time": 11.033333333333305, "traveled_tiles": 7, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 124, "reward": -8.645794202444977, "good_angle": 6.729997830887314, "survival_time": 4.133333333333328, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}}
good_angle_max6.729997830887314
good_angle_mean2.5314014023491267
good_angle_median0.2870058529237993
good_angle_min0.14625930291742983
reward_max-3.113548352757646
reward_mean-7.404422636652913
reward_median-8.645794202444977
reward_min-11.286469660078486
survival_time_max11.033333333333305
survival_time_mean5.6999999999999895
survival_time_min3.1999999999999984
traveled_tiles_max7
traveled_tiles_mean4.2
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max1.8333333333333308
valid_direction_mean0.9333333333333308
valid_direction_median0.6666666666666643
valid_direction_min0.33333333333333215
81951012DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3220:02:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
81851009sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3220:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 45, in solve
    env = DummyVecEnv([make_env(params)])
TypeError: make_env() takes 0 positional arguments but 1 was given

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 124, in run
    solve(params, cis)
  File "solution.py", line 45, in solve
    env = DummyVecEnv([make_env(params)])
TypeError: make_env() takes 0 positional arguments but 1 was given


Hidden. If you are the author, please login using the top-right link or use the dashboard.
81791008sodabetastay youngaido1_LF1_r3-v3step1-simulationfailedno3220:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 122, in run
    solve(params, cis)
  File "solution.py", line 43, in solve
    env = DummyVecEnv([env])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'ScaleObservations' object is not callable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 122, in run
    solve(params, cis)
  File "solution.py", line 43, in solve
    env = DummyVecEnv([env])
  File "/workspace/wrappers.py", line 261, in __init__
    self.envs = [fn() for fn in env_fns]
  File "/workspace/wrappers.py", line 261, in <listcomp>
    self.envs = [fn() for fn in env_fns]
TypeError: 'ScaleObservations' object is not callable


Hidden. If you are the author, please login using the top-right link or use the dashboard.
81561004lmandrileTensorflow templateaido1_LF1_r3-v3step1-simulationabortedno3220:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8156-7425', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8156-7425', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8156-7425_evaluation" with the default driver
stderr | Creating job8156-7425_solution_1 ...
stderr | Creating job8156-7425_evaluator_1 ...
stderr | 
Creating job8156-7425_solution_1  ... error

stderr | ERROR: for job8156-7425_solution_1  Cannot start service solution: network job8156-7425_evaluation not found
stderr | 
Creating job8156-7425_evaluator_1 ... error

stderr | ERROR: for job8156-7425_evaluator_1  Cannot start service evaluator: network job8156-7425_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8156-7425_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8156-7425_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
81521002lmandrileTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes3220:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
81471002lmandrileTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.733333333333319


other stats
episodes
details{"ep000": {"nsteps": 216, "reward": -6.392362615874003, "good_angle": 22.74045157653506, "survival_time": 7.199999999999984, "traveled_tiles": 2, "valid_direction": 5.499999999999989}, "ep001": {"nsteps": 202, "reward": -6.445137121382695, "good_angle": 4.28775818782871, "survival_time": 6.733333333333319, "traveled_tiles": 1, "valid_direction": 5.233333333333322}, "ep002": {"nsteps": 43, "reward": -25.32363423219947, "good_angle": 0.6317146216669308, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 1.2666666666666673}, "ep003": {"nsteps": 500, "reward": -1.0371820561804344, "good_angle": 9.409300943573458, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 12.533333333333331}, "ep004": {"nsteps": 32, "reward": -32.28967246040702, "good_angle": 0.848158727035083, "survival_time": 1.0666666666666669, "traveled_tiles": 1, "valid_direction": 0.6666666666666666}}
good_angle_max22.74045157653506
good_angle_mean7.583476811327849
good_angle_median4.28775818782871
good_angle_min0.6317146216669308
reward_max-1.0371820561804344
reward_mean-14.297597697208724
reward_median-6.445137121382695
reward_min-32.28967246040702
survival_time_max16.666666666666654
survival_time_mean6.619999999999992
survival_time_min1.0666666666666669
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max12.533333333333331
valid_direction_mean5.039999999999996
valid_direction_median5.233333333333322
valid_direction_min0.6666666666666666
81351000sodabetastay simpleaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.2171028180718422, "good_angle": 48.97482659061072, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.999999999999991}, "ep001": {"nsteps": 500, "reward": -1.6295727347135545, "good_angle": 12.537820502688945, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.366666666666664}, "ep002": {"nsteps": 500, "reward": -1.448073302745819, "good_angle": 12.631829880438866, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.566666666666665}, "ep003": {"nsteps": 500, "reward": -1.2542260830253362, "good_angle": 12.6059242905706, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.499999999999998}, "ep004": {"nsteps": 500, "reward": -1.4929706085324288, "good_angle": 12.700758660733726, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.666666666666664}}
good_angle_max48.97482659061072
good_angle_mean19.890231985008572
good_angle_median12.631829880438866
good_angle_min12.537820502688945
reward_max-1.2171028180718422
reward_mean-1.408389109417796
reward_median-1.448073302745819
reward_min-1.6295727347135545
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.999999999999991
valid_direction_mean12.82
valid_direction_median12.566666666666665
valid_direction_min12.366666666666664
8124997placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.033333333333318


other stats
episodes
details{"ep000": {"nsteps": 239, "reward": -4.242474540087071, "good_angle": 0.7376290935237234, "survival_time": 7.966666666666648, "traveled_tiles": 9, "valid_direction": 2.033333333333327}, "ep001": {"nsteps": 182, "reward": -6.025205468514916, "good_angle": 14.05828564655136, "survival_time": 6.066666666666655, "traveled_tiles": 6, "valid_direction": 3.133333333333328}, "ep002": {"nsteps": 211, "reward": -5.041387968665757, "good_angle": 0.40104802004664575, "survival_time": 7.033333333333318, "traveled_tiles": 7, "valid_direction": 1.0666666666666629}, "ep003": {"nsteps": 247, "reward": -4.259314230150215, "good_angle": 1.126885887792093, "survival_time": 8.233333333333315, "traveled_tiles": 9, "valid_direction": 1.799999999999995}, "ep004": {"nsteps": 86, "reward": -12.251422303685445, "good_angle": 6.0966390643710415, "survival_time": 2.8666666666666663, "traveled_tiles": 4, "valid_direction": 1.2333333333333312}}
good_angle_max14.05828564655136
good_angle_mean4.484097542456974
good_angle_median1.126885887792093
good_angle_min0.40104802004664575
reward_max-4.242474540087071
reward_mean-6.363960902220681
reward_median-5.041387968665757
reward_min-12.251422303685445
survival_time_max8.233333333333315
survival_time_mean6.43333333333332
survival_time_min2.8666666666666663
traveled_tiles_max9
traveled_tiles_mean7
traveled_tiles_median7
traveled_tiles_min4
valid_direction_max3.133333333333328
valid_direction_mean1.8533333333333288
valid_direction_median1.799999999999995
valid_direction_min1.0666666666666629
8116995Manfred DiazDAggeraido1_LF1_r3-v3step3-videossuccessyes3220:01:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
8113995Manfred DiazDAggeraido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.02094303617626429, "good_angle": 0.9213657038113972, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.2999999999999954}, "ep001": {"nsteps": 500, "reward": -2.2470385197401046, "good_angle": 0.9205523237873466, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.0333333333333408}, "ep002": {"nsteps": 500, "reward": 0.018498567581598763, "good_angle": 0.8231955865171153, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 0.9666666666666632}, "ep003": {"nsteps": 500, "reward": -0.00572035870020045, "good_angle": 0.9038617809929954, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.3333333333333304}, "ep004": {"nsteps": 500, "reward": -0.0039552157493308185, "good_angle": 10.082174032600893, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.2333333333333254}}
good_angle_max10.082174032600893
good_angle_mean2.7302298855419496
good_angle_median0.9205523237873466
good_angle_min0.8231955865171153
reward_max0.02094303617626429
reward_mean-0.44345449808635456
reward_median-0.0039552157493308185
reward_min-2.2470385197401046
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max12
traveled_tiles_mean10.8
traveled_tiles_median11
traveled_tiles_min10
valid_direction_max2.2333333333333254
valid_direction_mean1.573333333333331
valid_direction_median1.3333333333333304
valid_direction_min0.9666666666666632
8106995Manfred DiazDAggeraido1_LF1_r3-v3step1-simulationsuccessno3220:03:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
8098993VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.732358459893614, "good_angle": 0.7240931219756537, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.06666666666666}, "ep001": {"nsteps": 500, "reward": -0.8166965480893851, "good_angle": 4.595518930008325, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.633333333333332}, "ep002": {"nsteps": 500, "reward": -0.5397966891722754, "good_angle": 0.6194322536008012, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 1.6333333333333275}, "ep003": {"nsteps": 500, "reward": -0.31135352698806673, "good_angle": 0.5891132255178639, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 1.4666666666666617}, "ep004": {"nsteps": 500, "reward": -0.5582869492536411, "good_angle": 24.80906323546956, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.333333333333359}}
good_angle_max24.80906323546956
good_angle_mean6.267444153314441
good_angle_median0.7240931219756537
good_angle_min0.5891132255178639
reward_max-0.31135352698806673
reward_mean-0.5916984346793965
reward_median-0.5582869492536411
reward_min-0.8166965480893851
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max13
traveled_tiles_mean11.6
traveled_tiles_median12
traveled_tiles_min10
valid_direction_max3.333333333333359
valid_direction_mean2.026666666666668
valid_direction_median1.633333333333332
valid_direction_min1.4666666666666617
8086993VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:08:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
8068988placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3220:02:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.4242563301104236
deviation-center-line_median0.4235321941125148
in-drivable-lane_median1.1333333333333293


other stats
deviation-center-line_max0.9838696346078268
deviation-center-line_mean0.5492542534622713
deviation-center-line_min0.1388905986867797
deviation-heading_max3.605989422765288
deviation-heading_mean2.0935134292498683
deviation-heading_median1.94239365253568
deviation-heading_min0.5054489555737736
driven_any_max6.241050759446081
driven_any_mean3.50359389211917
driven_any_median2.8731590178918407
driven_any_min0.9222823393601846
driven_lanedir_max5.287415626172011
driven_lanedir_mean2.914653798264695
driven_lanedir_min0.593457463402649
in-drivable-lane_max2.166666666666659
in-drivable-lane_mean1.1799999999999962
in-drivable-lane_min0.6666666666666643
per-episodes
details{"ep000": {"driven_any": 1.571879123758249, "driven_lanedir": 1.0513198931339174, "in-drivable-lane": 1.1999999999999968, "deviation-heading": 0.935625019905348, "deviation-center-line": 0.25678959023803216}, "ep001": {"driven_any": 2.8731590178918407, "driven_lanedir": 2.4242563301104236, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 1.94239365253568, "deviation-center-line": 0.4235321941125148}, "ep002": {"driven_any": 6.241050759446081, "driven_lanedir": 5.216819678504474, "in-drivable-lane": 2.166666666666659, "deviation-heading": 3.4781100954692534, "deviation-center-line": 0.9838696346078268}, "ep003": {"driven_any": 0.9222823393601846, "driven_lanedir": 0.593457463402649, "in-drivable-lane": 0.7333333333333316, "deviation-heading": 0.5054489555737736, "deviation-center-line": 0.1388905986867797}, "ep004": {"driven_any": 5.909598220139497, "driven_lanedir": 5.287415626172011, "in-drivable-lane": 1.1333333333333293, "deviation-heading": 3.605989422765288, "deviation-center-line": 0.9431892496662028}}
8065988placailleDolores' Awakeningaido1_LF1_r3-v3step3-videosabortedyes3220:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8065-21', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8065-21', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8065-21_evaluation" with the default driver
stderr | Creating job8065-21_videos_1 ...
stderr | 
Creating job8065-21_videos_1 ... error

stderr | ERROR: for job8065-21_videos_1  Cannot start service videos: network job8065-21_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8065-21_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
8059990Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailedno3220:03:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 86, in run
    solve(params, cis)  # let's try to solve the challenge,
  File "solution.py", line 52, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
8054986VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:02:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
8042985placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.333333333333317


other stats
episodes
details{"ep000": {"nsteps": 91, "reward": -11.150584790064086, "good_angle": 0.1407140490017567, "survival_time": 3.0333333333333323, "traveled_tiles": 3, "valid_direction": 0.30000000000000004}, "ep001": {"nsteps": 243, "reward": -4.586310418257049, "good_angle": 15.139074582275237, "survival_time": 8.099999999999982, "traveled_tiles": 6, "valid_direction": 3.1666666666666607}, "ep002": {"nsteps": 333, "reward": -3.1747410535463567, "good_angle": 0.8234156515103922, "survival_time": 11.099999999999971, "traveled_tiles": 8, "valid_direction": 2.399999999999996}, "ep003": {"nsteps": 220, "reward": -4.907579297724773, "good_angle": 0.12808957681956995, "survival_time": 7.333333333333317, "traveled_tiles": 5, "valid_direction": 0.09999999999999964}, "ep004": {"nsteps": 206, "reward": -5.029392477991263, "good_angle": 8.353891473535883, "survival_time": 6.866666666666652, "traveled_tiles": 5, "valid_direction": 1.1999999999999955}}
good_angle_max15.139074582275237
good_angle_mean4.917037066628568
good_angle_median0.8234156515103922
good_angle_min0.12808957681956995
reward_max-3.1747410535463567
reward_mean-5.769721607516705
reward_median-4.907579297724773
reward_min-11.150584790064086
survival_time_max11.099999999999971
survival_time_mean7.28666666666665
survival_time_min3.0333333333333323
traveled_tiles_max8
traveled_tiles_mean5.4
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max3.1666666666666607
valid_direction_mean1.4333333333333305
valid_direction_median1.1999999999999955
valid_direction_min0.09999999999999964
8037984VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:02:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
8033983placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3220:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
8027983placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessno3220:04:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
8023982placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3220:02:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.2625330150974328
deviation-center-line_median0.30916755957447817
in-drivable-lane_median0.33333333333333215


other stats
deviation-center-line_max1.0214982261463186
deviation-center-line_mean0.41023872038307313
deviation-center-line_min0.16299166942082727
deviation-heading_max2.732953572281096
deviation-heading_mean1.1615341903629683
deviation-heading_median0.6028231172919468
deviation-heading_min0.173107478412578
driven_any_max6.066367652346505
driven_any_mean2.3985491967551646
driven_any_median1.44327103868329
driven_any_min0.7633137550147455
driven_lanedir_max5.9275840023267445
driven_lanedir_mean2.221397173652135
driven_lanedir_min0.7556095534649225
in-drivable-lane_max0.7333333333333307
in-drivable-lane_mean0.2999999999999992
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.44327103868329, "driven_lanedir": 1.2625330150974328, "in-drivable-lane": 0.4, "deviation-heading": 0.6028231172919468, "deviation-center-line": 0.30916755957447817}, "ep001": {"driven_any": 1.1133084154733086, "driven_lanedir": 0.7556095534649225, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 0.5969090928350584, "deviation-center-line": 0.19388399703338516}, "ep002": {"driven_any": 6.066367652346505, "driven_lanedir": 5.9275840023267445, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.732953572281096, "deviation-center-line": 1.0214982261463186}, "ep003": {"driven_any": 0.7633137550147455, "driven_lanedir": 0.7596134962953074, "in-drivable-lane": 0, "deviation-heading": 0.173107478412578, "deviation-center-line": 0.16299166942082727}, "ep004": {"driven_any": 2.6064851222579715, "driven_lanedir": 2.401645801076268, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 1.701877690994163, "deviation-center-line": 0.3636521497403563}}
8020982placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.9666666666666623


other stats
episodes
details{"ep000": {"nsteps": 119, "reward": -8.67190607514026, "good_angle": 0.13115890152822718, "survival_time": 3.9666666666666623, "traveled_tiles": 3, "valid_direction": 0.30000000000000016}, "ep001": {"nsteps": 89, "reward": -12.241311553154098, "good_angle": 6.50578324806141, "survival_time": 2.966666666666666, "traveled_tiles": 3, "valid_direction": 1.6333333333333315}, "ep002": {"nsteps": 500, "reward": -0.227755806643283, "good_angle": 0.5566751401158245, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 0.6999999999999975}, "ep003": {"nsteps": 62, "reward": -16.51877225875374, "good_angle": 0.022132493186739943, "survival_time": 2.066666666666669, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 227, "reward": -4.767665523237709, "good_angle": 8.081839146650118, "survival_time": 7.5666666666666496, "traveled_tiles": 4, "valid_direction": 1.7999999999999936}}
good_angle_max8.081839146650118
good_angle_mean3.059517785908464
good_angle_median0.5566751401158245
good_angle_min0.022132493186739943
reward_max-0.227755806643283
reward_mean-8.485482243385817
reward_median-8.67190607514026
reward_min-16.51877225875374
survival_time_max16.666666666666654
survival_time_mean6.646666666666659
survival_time_min2.066666666666669
traveled_tiles_max11
traveled_tiles_mean4.6
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max1.7999999999999936
valid_direction_mean0.8866666666666646
valid_direction_median0.6999999999999975
valid_direction_min0
8015979placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3220:01:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.2049912938614735
deviation-center-line_median0.24011810285973265
in-drivable-lane_median0


other stats
deviation-center-line_max0.4310720801060612
deviation-center-line_mean0.27528366884675676
deviation-center-line_min0.14678020344195483
deviation-heading_max1.6433526116947783
deviation-heading_mean0.9348912818064186
deviation-heading_median0.977824404767383
deviation-heading_min0.15109148797084823
driven_any_max1.7766386329514503
driven_any_mean1.4119732419500115
driven_any_median1.6032720744741635
driven_any_min0.6883193164757254
driven_lanedir_max1.7138874329636915
driven_lanedir_mean1.2235225682160478
driven_lanedir_min0.53067241554859
in-drivable-lane_max1.2333333333333358
in-drivable-lane_mean0.29333333333333383
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6883193164757254, "driven_lanedir": 0.53067241554859, "in-drivable-lane": 0.2333333333333333, "deviation-heading": 0.6498560186421072, "deviation-center-line": 0.14678020344195483}, "ep001": {"driven_any": 1.2766377432773677, "driven_lanedir": 1.2049912938614735, "in-drivable-lane": 0, "deviation-heading": 0.977824404767383, "deviation-center-line": 0.24011810285973265}, "ep002": {"driven_any": 1.6032720744741635, "driven_lanedir": 1.0124796633283637, "in-drivable-lane": 1.2333333333333358, "deviation-heading": 1.6433526116947783, "deviation-center-line": 0.23504674156568964}, "ep003": {"driven_any": 1.714998442571351, "driven_lanedir": 1.7138874329636915, "in-drivable-lane": 0, "deviation-heading": 0.15109148797084823, "deviation-center-line": 0.3234012162603455}, "ep004": {"driven_any": 1.7766386329514503, "driven_lanedir": 1.65558203537812, "in-drivable-lane": 0, "deviation-heading": 1.2523318859569754, "deviation-center-line": 0.4310720801060612}}
8010979placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessno3220:03:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7997977placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessno3220:02:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7993976placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3220:01:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.5472678870867416
deviation-center-line_median0.3359071713314118
in-drivable-lane_median0.16666666666666607


other stats
deviation-center-line_max0.46773144496088725
deviation-center-line_mean0.32517829066895737
deviation-center-line_min0.16866482502596974
deviation-heading_max1.6293053285312915
deviation-heading_mean1.0663511152258056
deviation-heading_median1.0755561144898615
deviation-heading_min0.4078274737159362
driven_any_max1.9999452675796772
driven_any_mean1.589298862446067
driven_any_median1.6232923958510668
driven_any_min1.0166496092576491
driven_lanedir_max1.7724508685709552
driven_lanedir_mean1.432386566731796
driven_lanedir_min0.8551238051906974
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.18666666666666615
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0166496092576491, "driven_lanedir": 0.8551238051906974, "in-drivable-lane": 0.2666666666666666, "deviation-heading": 0.616923463458322, "deviation-center-line": 0.2349479397681263}, "ep001": {"driven_any": 1.9999452675796772, "driven_lanedir": 1.685268598805122, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.6021431959336172, "deviation-center-line": 0.4186400722583914}, "ep002": {"driven_any": 1.3216422669515713, "driven_lanedir": 1.301821674005465, "in-drivable-lane": 0, "deviation-heading": 0.4078274737159362, "deviation-center-line": 0.16866482502596974}, "ep003": {"driven_any": 1.6232923958510668, "driven_lanedir": 1.5472678870867416, "in-drivable-lane": 0, "deviation-heading": 1.0755561144898615, "deviation-center-line": 0.46773144496088725}, "ep004": {"driven_any": 1.984964772590372, "driven_lanedir": 1.7724508685709552, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.6293053285312915, "deviation-center-line": 0.3359071713314118}}
7989976placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3220:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7981975placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3220:01:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7970974VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:01:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7964973placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3220:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6505766153109622
deviation-center-line_median0.16014963851655162
in-drivable-lane_median0


other stats
deviation-center-line_max0.7603053620165483
deviation-center-line_mean0.2564637341640809
deviation-center-line_min0.09210699726460604
deviation-heading_max0.9642614812629324
deviation-heading_mean0.3996068763062016
deviation-heading_median0.1951626949882956
deviation-heading_min0.08068462255521815
driven_any_max2.9665349579780176
driven_any_mean1.03460971155806
driven_any_median0.6566328495709304
driven_any_min0.3366328495709288
driven_lanedir_max2.923355747095626
driven_lanedir_mean0.9885477295561832
driven_lanedir_min0.3321162244136633
in-drivable-lane_max0.3666666666666667
in-drivable-lane_mean0.07333333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8532550200589977, "driven_lanedir": 0.6787448401236269, "in-drivable-lane": 0.3666666666666667, "deviation-heading": 0.6046620566532065, "deviation-center-line": 0.1704259240979422}, "ep001": {"driven_any": 0.3599928806114263, "driven_lanedir": 0.3579452208370377, "in-drivable-lane": 0, "deviation-heading": 0.08068462255521815, "deviation-center-line": 0.09933074892475642}, "ep002": {"driven_any": 0.3366328495709288, "driven_lanedir": 0.3321162244136633, "in-drivable-lane": 0, "deviation-heading": 0.15326352607135502, "deviation-center-line": 0.09210699726460604}, "ep003": {"driven_any": 0.6566328495709304, "driven_lanedir": 0.6505766153109622, "in-drivable-lane": 0, "deviation-heading": 0.1951626949882956, "deviation-center-line": 0.16014963851655162}, "ep004": {"driven_any": 2.9665349579780176, "driven_lanedir": 2.923355747095626, "in-drivable-lane": 0, "deviation-heading": 0.9642614812629324, "deviation-center-line": 0.7603053620165483}}
7953973placailleDolores' Awakeningaido1_LF1_r3-v3step2-scoringabortedyes3220:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7953-474', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7953-474', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7953-474_evaluation" with the default driver
stderr | Creating job7953-474_scorer_1 ...
stderr | 
Creating job7953-474_scorer_1 ... error

stderr | ERROR: for job7953-474_scorer_1  Cannot start service scorer: network job7953-474_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7953-474_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7948972VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:01:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7945971placailleDolores' Awakeningaido1_LF1_r3-v3step4-vizsuccessyes3220:01:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4215571535808358
deviation-center-line_median0.14891535883491963
in-drivable-lane_median0


other stats
deviation-center-line_max0.33513384218680903
deviation-center-line_mean0.167510353493167
deviation-center-line_min0.08481578970490194
deviation-heading_max1.5676183756560225
deviation-heading_mean0.524382947707912
deviation-heading_median0.1677208224617552
deviation-heading_min0.12551358531169376
driven_any_max1.8148588729327408
driven_any_mean0.7616139683300348
driven_any_median0.4283068580446981
driven_any_min0.28830967617758474
driven_lanedir_max1.5279258801008595
driven_lanedir_mean0.6668931895777604
driven_lanedir_min0.2846481611082692
in-drivable-lane_max0.4333333333333318
in-drivable-lane_mean0.1599999999999997
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8666097115580556, "driven_lanedir": 0.6961797944046832, "in-drivable-lane": 0.3666666666666667, "deviation-heading": 0.6002350491785079, "deviation-center-line": 0.1733329727782846}, "ep001": {"driven_any": 0.4283068580446981, "driven_lanedir": 0.4215571535808358, "in-drivable-lane": 0, "deviation-heading": 0.16082690593158072, "deviation-center-line": 0.14891535883491963}, "ep002": {"driven_any": 0.28830967617758474, "driven_lanedir": 0.2846481611082692, "in-drivable-lane": 0, "deviation-heading": 0.12551358531169376, "deviation-center-line": 0.08481578970490194}, "ep003": {"driven_any": 0.409984722937095, "driven_lanedir": 0.4041549586941544, "in-drivable-lane": 0, "deviation-heading": 0.1677208224617552, "deviation-center-line": 0.09535380396091991}, "ep004": {"driven_any": 1.8148588729327408, "driven_lanedir": 1.5279258801008595, "in-drivable-lane": 0.4333333333333318, "deviation-heading": 1.5676183756560225, "deviation-center-line": 0.33513384218680903}}
7943971placailleDolores' Awakeningaido1_LF1_r3-v3step3-videossuccessyes3220:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7939971placailleDolores' Awakeningaido1_LF1_r3-v3step1-simulationsuccessno3220:02:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7934969VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3220:01:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7916962DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3220:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7910962DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno3220:02:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7906965VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3220:03:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7900964DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes3220:01:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7895963DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.099999999999988


other stats
episodes
details{"ep000": {"nsteps": 183, "reward": -5.8955085768664635, "good_angle": 0.7615583839230401, "survival_time": 6.099999999999988, "traveled_tiles": 5, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 181, "reward": -6.376901165129442, "good_angle": 14.742659996572415, "survival_time": 6.033333333333322, "traveled_tiles": 5, "valid_direction": 2.4999999999999956}, "ep002": {"nsteps": 116, "reward": -9.467982978355804, "good_angle": 0.8004198030576292, "survival_time": 3.8666666666666623, "traveled_tiles": 4, "valid_direction": 1.3333333333333306}, "ep003": {"nsteps": 292, "reward": -4.333883521407014, "good_angle": 0.8823959790426957, "survival_time": 9.73333333333331, "traveled_tiles": 8, "valid_direction": 1.5999999999999943}, "ep004": {"nsteps": 251, "reward": -4.9879272358925215, "good_angle": 2.853382106126485, "survival_time": 8.366666666666648, "traveled_tiles": 5, "valid_direction": 1.866666666666661}}
good_angle_max14.742659996572415
good_angle_mean4.008083253744453
good_angle_median0.8823959790426957
good_angle_min0.7615583839230401
reward_max-4.333883521407014
reward_mean-6.2124406955302485
reward_median-5.8955085768664635
reward_min-9.467982978355804
survival_time_max9.73333333333331
survival_time_mean6.819999999999986
survival_time_min3.8666666666666623
traveled_tiles_max8
traveled_tiles_mean5.4
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max2.4999999999999956
valid_direction_mean1.7533333333333283
valid_direction_median1.5999999999999943
valid_direction_min1.3333333333333306
7889961BenjaminMy ROS solution - param 3aido1_LF1_r3-v3step4-vizsuccessyes3220:01:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.0196946772831752
deviation-center-line_median0.03342743548187272
in-drivable-lane_median0.8333333333333339


other stats
deviation-center-line_max0.07407297343790746
deviation-center-line_mean0.03739803529381719
deviation-center-line_min0
deviation-heading_max1.2591936377912198
deviation-heading_mean0.5076960053369486
deviation-heading_median0.2911588342319564
deviation-heading_min0
driven_any_max1.3944182879618496
driven_any_mean0.3937760178431842
driven_any_median0.17198786646948844
driven_any_min0.04757860401669066
driven_lanedir_max0
driven_lanedir_mean-0.03568657753558444
driven_lanedir_min-0.08888324073276088
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.826666666666664
in-drivable-lane_min0.06666666666666665
per-episodes
details{"ep000": {"driven_any": 1.3944182879618496, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.050315962957557935, "driven_lanedir": -0.0196946772831752, "in-drivable-lane": 0.16666666666666669, "deviation-heading": 0.24835155636272777, "deviation-center-line": 0.03342743548187272}, "ep002": {"driven_any": 0.17198786646948844, "driven_lanedir": -0.05408385209443489, "in-drivable-lane": 0.8333333333333339, "deviation-heading": 0.7397759982988392, "deviation-center-line": 0.05333224628738267}, "ep003": {"driven_any": 0.3045793678103343, "driven_lanedir": -0.08888324073276088, "in-drivable-lane": 1.4333333333333342, "deviation-heading": 1.2591936377912198, "deviation-center-line": 0.07407297343790746}, "ep004": {"driven_any": 0.04757860401669066, "driven_lanedir": -0.01577111756755123, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 0.2911588342319564, "deviation-center-line": 0.02615752126192311}}
7886961BenjaminMy ROS solution - param 3aido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7333333333333354


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.4624892975091934, "good_angle": 61.29866473955287, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.433333333333325}, "ep001": {"nsteps": 16, "reward": -64.0070656966418, "good_angle": 0.5385652891676465, "survival_time": 0.5333333333333333, "traveled_tiles": 1, "valid_direction": 0.5}, "ep002": {"nsteps": 52, "reward": -20.95295720662062, "good_angle": 1.5545408229611977, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 1.4666666666666686}, "ep003": {"nsteps": 86, "reward": -13.359189618725416, "good_angle": 2.514732245125978, "survival_time": 2.8666666666666663, "traveled_tiles": 1, "valid_direction": 2.433333333333332}, "ep004": {"nsteps": 12, "reward": -84.3719012538592, "good_angle": 0.45159185224177034, "survival_time": 0.4, "traveled_tiles": 1, "valid_direction": 0.36666666666666664}}
good_angle_max61.29866473955287
good_angle_mean13.271618989809896
good_angle_median1.5545408229611977
good_angle_min0.45159185224177034
reward_max-1.4624892975091934
reward_mean-36.83072061467125
reward_median-20.95295720662062
reward_min-84.3719012538592
survival_time_max16.666666666666654
survival_time_mean4.439999999999998
survival_time_min0.4
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.433333333333325
valid_direction_mean4.039999999999998
valid_direction_median1.4666666666666686
valid_direction_min0.36666666666666664
7880960BenjaminMy ROS solution - param 2aido1_LF1_r3-v3step3-videossuccessyes3220:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7877960BenjaminMy ROS solution - param 2aido1_LF1_r3-v3step2-scoringabortedyes3220:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7877-2539', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7877-2539', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7877-2539_evaluation" with the default driver
stderr | Creating job7877-2539_scorer_1 ...
stderr | 
Creating job7877-2539_scorer_1 ... error

stderr | ERROR: for job7877-2539_scorer_1  Cannot start service scorer: network job7877-2539_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job7877-2539_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7866958VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3220:10:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
7862957BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes3220:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7854956jasonlclPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3220:04:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-1.05985247177248
deviation-center-line_median0.32463013910329175
in-drivable-lane_median8.23333333333332


other stats
deviation-center-line_max1.2229848197846576
deviation-center-line_mean0.5013585011463242
deviation-center-line_min0.18421462158296809
deviation-heading_max6.639256027638261
deviation-heading_mean6.130316773672168
deviation-heading_median6.587348625790274
deviation-heading_min4.253182461720226
driven_any_max3.317636741607105
driven_any_mean3.31763674160709
driven_any_median3.317636741607098
driven_any_min3.3176367416070653
driven_lanedir_max-0.8727849850798894
driven_lanedir_mean-1.0237415377242507
driven_lanedir_min-1.0652501105207834
in-drivable-lane_max10.466666666666663
in-drivable-lane_mean8.686666666666657
in-drivable-lane_min8.233333333333318
per-episodes
details{"ep000": {"driven_any": 3.317636741607105, "driven_lanedir": -0.8727849850798894, "in-drivable-lane": 10.466666666666663, "deviation-heading": 4.253182461720226, "deviation-center-line": 1.2229848197846576}, "ep001": {"driven_any": 3.3176367416070653, "driven_lanedir": -1.0585760658647092, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.639256027638261, "deviation-center-line": 0.4939995088117161}, "ep002": {"driven_any": 3.317636741607098, "driven_lanedir": -1.0622440553833916, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.60795448532735, "deviation-center-line": 0.28096341644898776}, "ep003": {"driven_any": 3.317636741607083, "driven_lanedir": -1.05985247177248, "in-drivable-lane": 8.266666666666653, "deviation-heading": 6.563842267884727, "deviation-center-line": 0.18421462158296809}, "ep004": {"driven_any": 3.3176367416071, "driven_lanedir": -1.0652501105207834, "in-drivable-lane": 8.233333333333318, "deviation-heading": 6.587348625790274, "deviation-center-line": 0.32463013910329175}}
7850956jasonlclPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3220:01:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7845956jasonlclPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3220:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.966810409963131, "good_angle": 47.08330822850749, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.233333333333322}, "ep001": {"nsteps": 500, "reward": -1.300191262960434, "good_angle": 13.8317262841996, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}, "ep002": {"nsteps": 500, "reward": -1.117795492440462, "good_angle": 13.808909540839275, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.9294596527849426, "good_angle": 13.819737231108473, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}, "ep004": {"nsteps": 500, "reward": -1.163820459574461, "good_angle": 13.824014957850544, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}}
good_angle_max47.08330822850749
good_angle_mean20.473539248501076
good_angle_median13.824014957850544
good_angle_min13.808909540839275
reward_max-0.9294596527849426
reward_mean-1.0956154555446862
reward_median-1.117795492440462
reward_min-1.300191262960434
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.233333333333322
valid_direction_mean13.266666666666657
valid_direction_median13.09999999999999
valid_direction_min12.933333333333326
7833954pravishsainathPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3220:00:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7829952heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizsuccessyes3220:04:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.0672675368220776
deviation-center-line_median0.6566656999765133
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max1.4643514655555545
deviation-center-line_mean0.8334349074486465
deviation-center-line_min0.24338888302510395
deviation-heading_max3.895204271440406
deviation-heading_mean2.4961505054632283
deviation-heading_median2.7219860107949923
deviation-heading_min1.2930067462546844
driven_any_max4.506138192977895
driven_any_mean2.2237786474344547
driven_any_median2.2046019076161603
driven_any_min0.5841864345325466
driven_lanedir_max4.447833623411079
driven_lanedir_mean2.114176640245193
driven_lanedir_min0.4026670018218528
in-drivable-lane_max0.433333333333334
in-drivable-lane_mean0.14666666666666658
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5841864345325466, "driven_lanedir": 0.4026670018218528, "in-drivable-lane": 0.433333333333334, "deviation-heading": 1.2930067462546844, "deviation-center-line": 0.24338888302510395}, "ep001": {"driven_any": 2.2046019076161603, "driven_lanedir": 2.0672675368220776, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.895204271440406, "deviation-center-line": 1.3143242925087115}, "ep002": {"driven_any": 1.3807368787922434, "driven_lanedir": 1.3045249361196944, "in-drivable-lane": 0, "deviation-heading": 2.7219860107949923, "deviation-center-line": 0.48844419617734985}, "ep003": {"driven_any": 2.4432298232534286, "driven_lanedir": 2.3485901030512597, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.8472393554659785, "deviation-center-line": 0.6566656999765133}, "ep004": {"driven_any": 4.506138192977895, "driven_lanedir": 4.447833623411079, "in-drivable-lane": 0, "deviation-heading": 2.723316143360079, "deviation-center-line": 1.4643514655555545}}
7820953Claudio RuchFunky Controller 1aido1_amod_fleet_size_r1-v3step2-scoringsuccessyes3220:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
fleet_size-1000000000


other stats
efficiency-63.89231136588219
service_quality-32.640257841471076
7813952heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessno3220:05:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7807951heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringsuccessyes3220:02:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.30762851211312225, "good_angle": 1.7966961564438535, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 4.66666666666665}, "ep001": {"nsteps": 282, "reward": -4.2281045108630675, "good_angle": 17.377262064057817, "survival_time": 9.399999999999975, "traveled_tiles": 2, "valid_direction": 6.933333333333312}, "ep002": {"nsteps": 500, "reward": -0.19721040973591153, "good_angle": 1.9057760716510457, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 4.433333333333318}, "ep003": {"nsteps": 500, "reward": 0.03781144627043977, "good_angle": 1.3255015432690826, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.733333333333359}, "ep004": {"nsteps": 212, "reward": -5.322310702901615, "good_angle": 11.090993682171026, "survival_time": 7.066666666666651, "traveled_tiles": 3, "valid_direction": 4.133333333333319}}
good_angle_max17.377262064057817
good_angle_mean6.699245903518564
good_angle_median1.9057760716510457
good_angle_min1.3255015432690826
reward_max0.03781144627043977
reward_mean-2.0034885378686553
reward_median-0.30762851211312225
reward_min-5.322310702901615
survival_time_max16.666666666666654
survival_time_mean13.293333333333315
survival_time_min7.066666666666651
traveled_tiles_max9
traveled_tiles_mean6.2
traveled_tiles_median8
traveled_tiles_min2
valid_direction_max6.933333333333312
valid_direction_mean4.579999999999992
valid_direction_median4.433333333333318
valid_direction_min2.733333333333359
7804951heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationsuccessno3220:07:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7802949Claudio RuchFunky Controller 1aido1_amod_service_quality_r1-v3step2-scoringsuccessyes3220:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-32.79703441126326


other stats
efficiency-64.77857764505315
fleet_size-1000000000
7798948Claudio RuchJava templateaido1_amod_service_quality_r1-v3step2-scoringsuccessyes3220:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-31.648553085062535


other stats
efficiency-61.44853234024771
fleet_size-1000000000
7795945Claudio RuchPython templateaido1_amod_fleet_size_r1-v3step2-scoringsuccessyes3220:01:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
fleet_size-1000000000


other stats
efficiency-63.39357988341456
service_quality-32.53305497085425