Duckietown Challenges Home Challenges Submissions

Evaluator 331

ID331
evaluatoridsc-rudolf-6786
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-6786
versionDC:3.1.56;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success13 6247
# timeout1 6616
# failed5 6222
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6616744Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutnoidsc-rudolf-67860:31:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6532839Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-67860:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.12031344862095585
deviation-center-line_median0.14351497747151423
in-drivable-lane_median0


other stats
deviation-center-line_max0.21344619242654947
deviation-center-line_mean0.1443684602876851
deviation-center-line_min0.07730061207473819
deviation-heading_max1.1581601681000258
deviation-heading_mean0.6814716404988106
deviation-heading_median0.5598962097687539
deviation-heading_min0.35864772946578727
driven_any_max0.3520845665811553
driven_any_mean0.18966651839328125
driven_any_median0.15659723751646318
driven_any_min0.1185392255213892
driven_lanedir_max0.15381746557917086
driven_lanedir_mean0.12710804160472566
driven_lanedir_min0.10754013654090322
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3520845665811553, "driven_lanedir": 0.11583955801204592, "in-drivable-lane": 1.500000000000001, "deviation-heading": 0.8508081091790168, "deviation-center-line": 0.07730061207473819}, "ep001": {"driven_any": 0.1185392255213892, "driven_lanedir": 0.10754013654090322, "in-drivable-lane": 0, "deviation-heading": 0.35864772946578727, "deviation-center-line": 0.14650499185659807}, "ep002": {"driven_any": 0.15659723751646318, "driven_lanedir": 0.13802959927055247, "in-drivable-lane": 0, "deviation-heading": 0.5598962097687539, "deviation-center-line": 0.1410755276090256}, "ep003": {"driven_any": 0.18515162061266377, "driven_lanedir": 0.15381746557917086, "in-drivable-lane": 0, "deviation-heading": 1.1581601681000258, "deviation-center-line": 0.21344619242654947}, "ep004": {"driven_any": 0.13595994173473494, "driven_lanedir": 0.12031344862095585, "in-drivable-lane": 0, "deviation-heading": 0.4798459859804696, "deviation-center-line": 0.14351497747151423}}
No reset possible
6513653Iban Harlouchet 🇨🇦Template for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-67860:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6498698Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-67860:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 201, "reward": -5.271642096282738, "good_angle": 0.21334244984511275, "survival_time": 6.699999999999986, "traveled_tiles": 3, "valid_direction": 0.13333333333333375}, "ep001": {"nsteps": 28, "reward": -36.277070889515535, "good_angle": 0.00836420271671713, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 69, "reward": -14.987846991290215, "good_angle": 0.23601712523094, "survival_time": 2.3000000000000016, "traveled_tiles": 2, "valid_direction": 0.533333333333333}, "ep003": {"nsteps": 78, "reward": -13.262679901547155, "good_angle": 0.3093434363389358, "survival_time": 2.6000000000000005, "traveled_tiles": 2, "valid_direction": 0.5666666666666647}, "ep004": {"nsteps": 43, "reward": -23.779265650483065, "good_angle": 0.28257432933074295, "survival_time": 1.4333333333333345, "traveled_tiles": 1, "valid_direction": 0.3666666666666678}}
good_angle_max0.3093434363389358
good_angle_mean0.20992830869248977
good_angle_median0.23601712523094
good_angle_min0.00836420271671713
reward_max-5.271642096282738
reward_mean-18.715701105823744
reward_median-14.987846991290215
reward_min-36.277070889515535
survival_time_max6.699999999999986
survival_time_mean2.793333333333331
survival_time_min0.9333333333333332
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.5666666666666647
valid_direction_mean0.31999999999999984
valid_direction_median0.3666666666666678
valid_direction_min0
No reset possible
6421834Samuel LavoieYoung Dukeaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-67860:04:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.007174640650131
deviation-center-line_median0.7470490299516872
in-drivable-lane_median10.96666666666663


other stats
deviation-center-line_max1.2882373660159392
deviation-center-line_mean0.6562525500331089
deviation-center-line_min0
deviation-heading_max2.3062969492956733
deviation-heading_mean1.2751324529310195
deviation-heading_median1.2324123415856356
deviation-heading_min0
driven_any_max6.370932198627862
driven_any_mean6.286530397440294
driven_any_median6.33989131858102
driven_any_min6.120627628089538
driven_lanedir_max4.038876905070678
driven_lanedir_mean2.148530641897353
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean10.726666666666649
in-drivable-lane_min5.566666666666647
per-episodes
details{"ep000": {"driven_any": 6.232326621558599, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 6.120627628089538, "driven_lanedir": 2.007174640650131, "in-drivable-lane": 10.96666666666663, "deviation-heading": 1.2324123415856356, "deviation-center-line": 0.7470490299516872}, "ep002": {"driven_any": 6.368874220344451, "driven_lanedir": 4.038876905070678, "in-drivable-lane": 5.566666666666647, "deviation-heading": 2.3062969492956733, "deviation-center-line": 1.1050416948852386}, "ep003": {"driven_any": 6.33989131858102, "driven_lanedir": 3.5174523047355586, "in-drivable-lane": 7.000000000000002, "deviation-heading": 2.290768452385038, "deviation-center-line": 1.2882373660159392}, "ep004": {"driven_any": 6.370932198627862, "driven_lanedir": 1.1791493590303976, "in-drivable-lane": 13.466666666666656, "deviation-heading": 0.5461845213887516, "deviation-center-line": 0.14093465931267904}}
No reset possible
6332790Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-67860:03:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 118, in run
    solve(params, cis)
  File "solution.py", line 83, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 86, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6325799Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step4-vizsuccessnoidsc-rudolf-67860:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1360756262058462
deviation-center-line_median0.4394837181007228
in-drivable-lane_median0.06666666666666643


other stats
deviation-center-line_max0.6333827791987502
deviation-center-line_mean0.4212631472000551
deviation-center-line_min0.24366373322158896
deviation-heading_max3.8004671062440982
deviation-heading_mean1.5700097495124463
deviation-heading_median1.1751997611595733
deviation-heading_min0.19159266173442707
driven_any_max1.9333799185588456
driven_any_mean1.077723423927906
driven_any_median1.1802158534322102
driven_any_min0.3144654076456124
driven_lanedir_max1.932166076243618
driven_lanedir_mean0.9565430019281578
driven_lanedir_min0.14257465471603614
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean0.39999999999999913
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3610528751992641, "driven_lanedir": 0.14257465471603614, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 2.4651655876232828, "deviation-center-line": 0.24366373322158896}, "ep001": {"driven_any": 0.3144654076456124, "driven_lanedir": 0.3134573187621861, "in-drivable-lane": 0, "deviation-heading": 0.2176236308008516, "deviation-center-line": 0.2987658071273343}, "ep002": {"driven_any": 1.1802158534322102, "driven_lanedir": 1.1360756262058462, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.1751997611595733, "deviation-center-line": 0.6333827791987502}, "ep003": {"driven_any": 1.9333799185588456, "driven_lanedir": 1.932166076243618, "in-drivable-lane": 0, "deviation-heading": 0.19159266173442707, "deviation-center-line": 0.4394837181007228}, "ep004": {"driven_any": 1.5995030648035986, "driven_lanedir": 1.2584413337131024, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 3.8004671062440982, "deviation-center-line": 0.49101969835187953}}
No reset possible
6322798Luca BonaminiRandom executionaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-67860:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6321798Luca BonaminiRandom executionaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-67860:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.966666666666652


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.923029431277484, "good_angle": 1.3158804276306024, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.166666666666667}, "ep001": {"nsteps": 111, "reward": -9.596115778963846, "good_angle": 0.009812665592739704, "survival_time": 3.6999999999999966, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 255, "reward": -4.519026840317483, "good_angle": 0.9939452414914156, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.199999999999993}, "ep003": {"nsteps": 209, "reward": -5.066346031876557, "good_angle": 0.04524398387971608, "survival_time": 6.966666666666652, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 343, "reward": -3.5039374469770945, "good_angle": 18.831470875777747, "survival_time": 11.433333333333303, "traveled_tiles": 3, "valid_direction": 3.899999999999987}}
good_angle_max18.831470875777747
good_angle_mean4.239270638874444
good_angle_median0.9939452414914156
good_angle_min0.009812665592739704
reward_max-3.5039374469770945
reward_mean-7.121691105882493
reward_median-5.066346031876557
reward_min-12.923029431277484
survival_time_max11.433333333333303
survival_time_mean6.646666666666652
survival_time_min2.6333333333333337
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.899999999999987
valid_direction_mean1.6533333333333295
valid_direction_median2.166666666666667
valid_direction_min0
No reset possible
6309800Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-67860:03:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 118, in run
    solve(params, cis)
  File "solution.py", line 83, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 89, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6279830Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-67860:10:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6265834Samuel LavoieYoung Dukeaido1_LF1_r3-v3step4-vizsuccessnoidsc-rudolf-67860:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.007174640650131
deviation-center-line_median0.7470490299516872
in-drivable-lane_median10.96666666666663


other stats
deviation-center-line_max1.2882373660159392
deviation-center-line_mean0.6562525500331089
deviation-center-line_min0
deviation-heading_max2.3062969492956733
deviation-heading_mean1.2751324529310195
deviation-heading_median1.2324123415856356
deviation-heading_min0
driven_any_max6.370932198627862
driven_any_mean6.286530397440294
driven_any_median6.33989131858102
driven_any_min6.120627628089538
driven_lanedir_max4.038876905070678
driven_lanedir_mean2.148530641897353
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean10.726666666666649
in-drivable-lane_min5.566666666666647
per-episodes
details{"ep000": {"driven_any": 6.232326621558599, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 6.120627628089538, "driven_lanedir": 2.007174640650131, "in-drivable-lane": 10.96666666666663, "deviation-heading": 1.2324123415856356, "deviation-center-line": 0.7470490299516872}, "ep002": {"driven_any": 6.368874220344451, "driven_lanedir": 4.038876905070678, "in-drivable-lane": 5.566666666666647, "deviation-heading": 2.3062969492956733, "deviation-center-line": 1.1050416948852386}, "ep003": {"driven_any": 6.33989131858102, "driven_lanedir": 3.5174523047355586, "in-drivable-lane": 7.000000000000002, "deviation-heading": 2.290768452385038, "deviation-center-line": 1.2882373660159392}, "ep004": {"driven_any": 6.370932198627862, "driven_lanedir": 1.1791493590303976, "in-drivable-lane": 13.466666666666656, "deviation-heading": 0.5461845213887516, "deviation-center-line": 0.14093465931267904}}
No reset possible
6262834Samuel LavoieYoung Dukeaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-67860:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6259834Samuel LavoieYoung Dukeaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-67860:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -2.485302177786827, "good_angle": 44.70155231345539, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 5.533333333333351}, "ep001": {"nsteps": 500, "reward": -1.4064829516261816, "good_angle": 16.665641929545327, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 6.0333333333333155}, "ep002": {"nsteps": 500, "reward": -0.5573239942416549, "good_angle": 2.385354831913217, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.166666666666648}, "ep003": {"nsteps": 500, "reward": -0.78558545652451, "good_angle": 2.7125707063362507, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.833333333333345}, "ep004": {"nsteps": 500, "reward": -2.124756822562427, "good_angle": 32.37004984167209, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 3.9333333333333194}}
good_angle_max44.70155231345539
good_angle_mean19.767033924584457
good_angle_median16.665641929545327
good_angle_min2.385354831913217
reward_max-0.5573239942416549
reward_mean-1.47189028054832
reward_median-1.4064829516261816
reward_min-2.485302177786827
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max13
traveled_tiles_mean11.2
traveled_tiles_median11
traveled_tiles_min8
valid_direction_max6.833333333333345
valid_direction_mean5.699999999999995
valid_direction_median6.0333333333333155
valid_direction_min3.9333333333333194
No reset possible
6253834Samuel LavoieYoung Dukeaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-67860:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6252819Samuel LavoieBaby Dukeaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-67860:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
6247819Samuel LavoieBaby Dukeaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-67860:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.333333333333321


other stats
episodes
details{"ep000": {"nsteps": 190, "reward": -5.411531495141772, "good_angle": 0.5664128526542075, "survival_time": 6.333333333333321, "traveled_tiles": 5, "valid_direction": 1.2666666666666622}, "ep001": {"nsteps": 27, "reward": -37.53334667395662, "good_angle": 0.01972792015467099, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.17876350968470797, "good_angle": 1.7375513988797031, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 3.566666666666654}, "ep003": {"nsteps": 338, "reward": -3.150984287661495, "good_angle": 0.6286363950167211, "survival_time": 11.266666666666636, "traveled_tiles": 8, "valid_direction": 1.6666666666666607}, "ep004": {"nsteps": 68, "reward": -15.01601664590485, "good_angle": 0.025768661624991508, "survival_time": 2.2666666666666684, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max1.7375513988797031
good_angle_mean0.5956194456660588
good_angle_median0.5664128526542075
good_angle_min0.01972792015467099
reward_max-0.17876350968470797
reward_mean-12.258128522469889
reward_median-5.411531495141772
reward_min-37.53334667395662
survival_time_max16.666666666666654
survival_time_mean7.486666666666656
survival_time_min0.8999999999999999
traveled_tiles_max12
traveled_tiles_mean5.6
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max3.566666666666654
valid_direction_mean1.2999999999999954
valid_direction_median1.2666666666666622
valid_direction_min0
No reset possible
6229827Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-67860:09:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 82, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 79, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6222831Anton Mashikhin 🇷🇺SAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-67860:10:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible