Duckietown Challenges Home Challenges Submissions

Evaluator 206

ID206
evaluatoridsc-rudolf-14652
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-14652
versionDC:3.1.48;DCR:3.2.10;DTS:3.0.29
first heard
last heard
statusinactive
# evaluating
# success5 2752
# timeout1 2762
# failed1 2733
# error1 2737
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
2762311Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnoidsc-rudolf-146520:17:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2761316Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step4-vizsuccessnoidsc-rudolf-146520:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2760316Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videossuccessnoidsc-rudolf-146520:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2759316Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessnoidsc-rudolf-146520:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5091864165328444, "good_angle": 57.43752411062863, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 6.866666666666643}, "ep001": {"nsteps": 500, "reward": -0.5651936712861061, "good_angle": 2.422744287958935, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0.3000000000000149}, "ep002": {"nsteps": 500, "reward": -0.5114709859639406, "good_angle": 0.09252956807780274, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.776356368791312, "good_angle": 57.65536251214368, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 6.899999999999979}, "ep004": {"nsteps": 129, "reward": -10.401626305986744, "good_angle": 0.3925861772498824, "survival_time": 4.2999999999999945, "traveled_tiles": 2, "valid_direction": 1.2000000000000024}}
good_angle_max57.65536251214368
good_angle_mean23.60014933121179
good_angle_median2.422744287958935
good_angle_min0.09252956807780274
reward_max-0.5091864165328444
reward_mean-2.5527667497121893
reward_median-0.5651936712861061
reward_min-10.401626305986744
survival_time_max16.666666666666654
survival_time_mean14.193333333333324
survival_time_min4.2999999999999945
traveled_tiles_max4
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max6.899999999999979
valid_direction_mean3.0533333333333283
valid_direction_median1.2000000000000024
valid_direction_min0
No reset possible
2757316Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-146520:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2752267Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step4-vizsuccessnoidsc-rudolf-146520:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2737308Andrea Censi 🇨🇭PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-146520:10:13
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 506, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission308/step1-simulation-idsc-rudolf-14652-job2737/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2733315Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-146520:00:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible