Duckietown Challenges Home Challenges Submissions

Evaluator 200

ID200
evaluatoridsc-rudolf-14652
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-14652
versionDC:3.1.47;DCR:3.2.10;DTS:3.0.29
first heard
last heard
statusinactive
# evaluating
# success4 2689
# timeout1 2729
# failed1 2682
# error2 2698
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
2729316Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationtimeoutnoidsc-rudolf-146520:11:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2726317Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-146520:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job2726-4057', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job2726-4057', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2717268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step4-vizsuccessnoidsc-rudolf-146520:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2704268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step3-videossuccessnoidsc-rudolf-146520:00:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2702268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step2-scoringsuccessnoidsc-rudolf-146520:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.6999999999999895


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.822278088296366, "good_angle": 24.047411680490292, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 359, "reward": -3.5003374810383265, "good_angle": 20.245344222751616, "survival_time": 11.966666666666637, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}, "ep002": {"nsteps": 113, "reward": -10.02674391109958, "good_angle": 4.367086948301012, "survival_time": 3.766666666666663, "traveled_tiles": 1, "valid_direction": 2.9666666666666632}, "ep003": {"nsteps": 43, "reward": -25.042797066444574, "good_angle": 0.04324913837314072, "survival_time": 1.4333333333333345, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 332, "reward": -3.8384100991379784, "good_angle": 0.12609271252815613, "survival_time": 11.066666666666638, "traveled_tiles": 4, "valid_direction": 0}}
good_angle_max24.047411680490292
good_angle_mean9.765836940488844
good_angle_median4.367086948301012
good_angle_min0.04324913837314072
reward_max-3.5003374810383265
reward_mean-10.046113329203369
reward_median-7.822278088296366
reward_min-25.042797066444574
survival_time_max11.966666666666637
survival_time_mean6.786666666666652
survival_time_min1.4333333333333345
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.9666666666666544
valid_direction_mean2.179999999999994
valid_direction_median2.9666666666666632
valid_direction_min0
No reset possible
2698306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videoserrornoidsc-rudolf-146520:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job2698-1742', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job2698-1742', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2689267Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-146520:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2682309Andrea Censi 🇨🇭PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-146520:10:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible