AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 89

evaluator89
ownerAndrea Censi
machineidsc-rudolf
processidsc-rudolf-11371
versionDC:3.1.41;DCR:3.2.3;DTS:3.0.24
first heard
last heard
statusinactive
# evaluating
# success7
# timeout
# failed
# error1
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
460264MandanaSamieiTensorflow templateaido1_LF1_r2-v3step1-simulationsuccessyes890:01:00(hidden)
other stats
simulation-passed1
453261DavidRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes890:00:50(hidden)
other stats
simulation-passed1
444256MandanaSamieiTensorflow templateaido1_LF1_r2-v3step1-simulationsuccessyes890:01:04(hidden)
other stats
simulation-passed1
440253DavidTensorflow templateaido1_LF1_r2-v3step2-scoringsuccessyes890:00:26(hidden)
traveled_tiles_median3
survival_time_mean3.0933333333333293
good_angle_mean0.8676594665950231
valid_direction_mean1.053333333333333


other stats
episodes
details{"ep000": {"nsteps": 45, "reward": -22.730665498682193, "good_angle": 2.464011645649803, "survival_time": 1.500000000000001, "traveled_tiles": 3, "valid_direction": 1.400000000000001}, "ep001": {"nsteps": 108, "reward": -9.473568658999822, "good_angle": 0.21552867377610185, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 237, "reward": -4.432748170956362, "good_angle": 0.44670148280839816, "survival_time": 7.899999999999982, "traveled_tiles": 5, "valid_direction": 0.6666666666666666}, "ep003": {"nsteps": 39, "reward": -27.616461107364067, "good_angle": 0.3437094255476508, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 0.9000000000000002}, "ep004": {"nsteps": 111, "reward": -9.759197562605747, "good_angle": 0.8683461051931616, "survival_time": 1.166666666666667, "traveled_tiles": 5, "valid_direction": 1.766666666666665}}
good_angle_max2.464011645649803
good_angle_median0.44670148280839816
good_angle_min0.21552867377610185
reward_max-4.432748170956362
reward_mean-14.80252819972164
reward_median-9.759197562605747
reward_min-27.616461107364067
survival_time_max7.899999999999982
survival_time_median1.500000000000001
survival_time_min1.166666666666667
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_min1
valid_direction_max1.766666666666665
valid_direction_median0.9000000000000002
valid_direction_min0.5333333333333314
436252MandanaSamieiRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes890:01:26(hidden)
other stats
simulation-passed1
434250MandanaSamieiRandom executionaido1_LF1_r2-v3step1-simulationerroryes890:00:10
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 395, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job434-7082', 'pull']:

   >  Command '['docker-compose', '-p', 'job434-7082', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
(hidden)
432249lmandrileRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes890:01:55(hidden)
other stats
simulation-passed1
431248ikraRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes890:01:10(hidden)
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean19.63598937307565
valid_direction_mean13.373333333333312


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.8135463592708111, "good_angle": 14.404777702689753, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.866666666666656}, "ep001": {"nsteps": 500, "reward": -1.1816018943421076, "good_angle": 34.17890819378457, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.833333333333314}, "ep002": {"nsteps": 500, "reward": -1.2723781438269652, "good_angle": 17.723272578446466, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 12.399999999999968}, "ep003": {"nsteps": 500, "reward": -0.7881940386533388, "good_angle": 19.83841174061446, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.56666666666662}, "ep004": {"nsteps": 500, "reward": -1.4979039161037653, "good_angle": 12.034576649842988, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.199999999999996}}
good_angle_max34.17890819378457
good_angle_median17.723272578446466
good_angle_min12.034576649842988
reward_max-0.7881940386533388
reward_mean-1.1107248704393975
reward_median-1.1816018943421076
reward_min-1.4979039161037653
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max14.833333333333314
valid_direction_median13.56666666666662
valid_direction_min12.199999999999996