Duckietown Challenges Home Challenges Submissions

Evaluator 197

ID197
evaluatoridsc-rudolf-11218
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-11218
versionDC:3.1.47;DCR:3.2.10;DTS:3.0.29
first heard
last heard
statusinactive
# evaluating
# success5 2688
# timeout1 2727
# failed1 2679
# error2 2685
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
2727317Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnoidsc-rudolf-112180:11:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2718268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step4-vizsuccessnoidsc-rudolf-112180:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2703268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step3-videossuccessnoidsc-rudolf-112180:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2701268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step2-scoringsuccessnoidsc-rudolf-112180:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.6999999999999895


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.822278088296366, "good_angle": 24.047411680490292, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 359, "reward": -3.5003374810383265, "good_angle": 20.245344222751616, "survival_time": 11.966666666666637, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}, "ep002": {"nsteps": 113, "reward": -10.02674391109958, "good_angle": 4.367086948301012, "survival_time": 3.766666666666663, "traveled_tiles": 1, "valid_direction": 2.9666666666666632}, "ep003": {"nsteps": 43, "reward": -25.042797066444574, "good_angle": 0.04324913837314072, "survival_time": 1.4333333333333345, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 332, "reward": -3.8384100991379784, "good_angle": 0.12609271252815613, "survival_time": 11.066666666666638, "traveled_tiles": 4, "valid_direction": 0}}
good_angle_max24.047411680490292
good_angle_mean9.765836940488844
good_angle_median4.367086948301012
good_angle_min0.04324913837314072
reward_max-3.5003374810383265
reward_mean-10.046113329203369
reward_median-7.822278088296366
reward_min-25.042797066444574
survival_time_max11.966666666666637
survival_time_mean6.786666666666652
survival_time_min1.4333333333333345
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.9666666666666544
valid_direction_mean2.179999999999994
valid_direction_median2.9666666666666632
valid_direction_min0
No reset possible
2697306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videoserrornoidsc-rudolf-112180:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job2697-7404', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job2697-7404', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2693306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessnoidsc-rudolf-112180:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.838666399086223, "good_angle": 23.445646435511616, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.899999999999987}, "ep001": {"nsteps": 376, "reward": -3.7297279366311873, "good_angle": 23.399582507656955, "survival_time": 12.5333333333333, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 287, "reward": -3.5788261961502807, "good_angle": 0.14728334007659463, "survival_time": 9.566666666666643, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 259, "reward": -6.30121521553938, "good_angle": 25.82775308195767, "survival_time": 8.633333333333313, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 271, "reward": -5.5627731432265355, "good_angle": 4.813138544709433, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 2.966666666666657}}
good_angle_max25.82775308195767
good_angle_mean15.526680781982456
good_angle_median23.399582507656955
good_angle_min0.14728334007659463
reward_max-3.5788261961502807
reward_mean-5.402241778126721
reward_median-5.5627731432265355
reward_min-7.838666399086223
survival_time_max12.5333333333333
survival_time_mean9.086666666666645
survival_time_min5.666666666666656
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.93333333333332
valid_direction_mean2.946666666666657
valid_direction_median3.899999999999987
valid_direction_min0
No reset possible
2688268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step1-simulationsuccessnoidsc-rudolf-112180:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2685306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-112180:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job2685-1581', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job2685-1581', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2679313Andrea Censi 🇨🇭PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-112180:10:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible