AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 79

evaluator79
ownerAndrea Censi
machinenutonomy-P50
processnutonomy-P50-29851
versionDC:3.1.41;DCR:3.2.3;DTS:3.0.24
first heard
last heard
statusinactive
# evaluating
# success22
# timeout
# failed
# error
# aborted2
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
462265MandanaSamieiSolution templateaido1_luck-v3step1successyes790:00:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
score17.626741646983447


461264MandanaSamieiTensorflow templateaido1_LF1_r2-v3step2-scoringsuccessyes790:01:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean3.0999999999999956
good_angle_mean0.8570140833982431
valid_direction_mean1.0799999999999996


other stats
episodes
details{"ep000": {"nsteps": 45, "reward": -22.730665498682193, "good_angle": 2.464011645649803, "survival_time": 1.500000000000001, "traveled_tiles": 3, "valid_direction": 1.400000000000001}, "ep001": {"nsteps": 108, "reward": -9.473568658999822, "good_angle": 0.21552867377610185, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 237, "reward": -4.432748170956362, "good_angle": 0.44670148280839816, "survival_time": 7.899999999999982, "traveled_tiles": 5, "valid_direction": 0.6666666666666666}, "ep003": {"nsteps": 40, "reward": -27.01203115135431, "good_angle": 0.3688051618962453, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.9000000000000004}, "ep004": {"nsteps": 110, "reward": -9.894138616831466, "good_angle": 0.7900234528606676, "survival_time": 1.166666666666667, "traveled_tiles": 5, "valid_direction": 1.899999999999998}}
good_angle_max2.464011645649803
good_angle_median0.44670148280839816
good_angle_min0.21552867377610185
reward_max-4.432748170956362
reward_mean-14.708630419364832
reward_median-9.894138616831466
reward_min-27.01203115135431
survival_time_max7.899999999999982
survival_time_median1.500000000000001
survival_time_min1.166666666666667
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_min1
valid_direction_max1.899999999999998
valid_direction_median0.9000000000000004
valid_direction_min0.5333333333333314
458262PolyProgrammistSimple based on center pixelaido1_LF1_r2-v3step2-scoringsuccessyes790:01:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean1.4466666666666677
good_angle_mean33.66180062299222
valid_direction_mean4.846666666666651


other stats
episodes
details{"ep000": {"nsteps": 43, "reward": -24.1210139712622, "good_angle": 0.0001490357416107672, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 0}, "ep001": {"nsteps": 500, "reward": -0.779671716362238, "good_angle": 59.90173853263349, "survival_time": 1.3666666666666676, "traveled_tiles": 6, "valid_direction": 10.099999999999966}, "ep002": {"nsteps": 500, "reward": -1.5157463335990906, "good_angle": 0.565799216449206, "survival_time": 1.466666666666668, "traveled_tiles": 3, "valid_direction": 0.6999999999999998}, "ep003": {"nsteps": 23, "reward": -45.41889384518499, "good_angle": 0.0007966565707015758, "survival_time": 0.7666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -3.354815784573555, "good_angle": 107.84051967356608, "survival_time": 2.200000000000002, "traveled_tiles": 5, "valid_direction": 13.433333333333287}}
good_angle_max107.84051967356608
good_angle_median0.565799216449206
good_angle_min0.0001490357416107672
reward_max-0.779671716362238
reward_mean-15.038028330196417
reward_median-3.354815784573555
reward_min-45.41889384518499
survival_time_max2.200000000000002
survival_time_median1.4333333333333345
survival_time_min0.7666666666666666
traveled_tiles_max6
traveled_tiles_mean3.4
traveled_tiles_min1
valid_direction_max13.433333333333287
valid_direction_median0.6999999999999998
valid_direction_min0
435251DavidRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes790:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
433249lmandrileRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes790:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean19.8803917415779
valid_direction_mean13.566666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.716711878657341, "good_angle": 12.928631578606826, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.799999999999992}, "ep001": {"nsteps": 500, "reward": -0.6267161850109696, "good_angle": 26.832388208911254, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 16.06666666666663}, "ep002": {"nsteps": 500, "reward": -1.5259272064566611, "good_angle": 18.031352217728003, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 10.899999999999997}, "ep003": {"nsteps": 500, "reward": -0.8399770502801984, "good_angle": 15.92773724687262, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.599999999999987}, "ep004": {"nsteps": 500, "reward": -1.1113408311866224, "good_angle": 25.681849455770795, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.466666666666663}}
good_angle_max26.832388208911254
good_angle_median18.031352217728003
good_angle_min12.928631578606826
reward_max-0.6267161850109696
reward_mean-1.1641346303183586
reward_median-1.1113408311866224
reward_min-1.716711878657341
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max16.06666666666663
valid_direction_median13.799999999999992
valid_direction_min10.899999999999997
430248ikraRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes790:01:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
422241emmasungRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes790:00:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean22.02311555656599
valid_direction_mean12.559999999999992


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.920630420446396, "good_angle": 9.42156234290726, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 10.766666666666652}, "ep001": {"nsteps": 500, "reward": -0.5217390315292869, "good_angle": 66.16948420170264, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 16.39999999999998}, "ep002": {"nsteps": 500, "reward": -1.3886782833337783, "good_angle": 10.474530149205336, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 10.566666666666666}, "ep003": {"nsteps": 500, "reward": -0.8641132079366652, "good_angle": 11.867354211931431, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.233333333333327}, "ep004": {"nsteps": 500, "reward": -1.578261361837387, "good_angle": 12.182646877083304, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 11.833333333333329}}
good_angle_max66.16948420170264
good_angle_median11.867354211931431
good_angle_min9.42156234290726
reward_max-0.5217390315292869
reward_mean-1.0546844610167028
reward_median-0.920630420446396
reward_min-1.578261361837387
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_min1
valid_direction_max16.39999999999998
valid_direction_median11.833333333333329
valid_direction_min10.566666666666666
420240emmasungRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes790:00:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean26.587435657101658
valid_direction_mean13.633333333333322


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0176489030122755, "good_angle": 18.617818819476415, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.199999999999994}, "ep001": {"nsteps": 500, "reward": -0.8716742685264908, "good_angle": 41.07462361123737, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 15.866666666666651}, "ep002": {"nsteps": 500, "reward": -1.1847928442955018, "good_angle": 47.115231328357, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.23333333333332}, "ep003": {"nsteps": 500, "reward": -0.6607411708626896, "good_angle": 11.591295321672384, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 10.43333333333332}, "ep004": {"nsteps": 500, "reward": -1.2609345889687538, "good_angle": 14.5382092047651, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 13.43333333333332}}
good_angle_max47.115231328357
good_angle_median18.617818819476415
good_angle_min11.591295321672384
reward_max-0.6607411708626896
reward_mean-0.9991583551331424
reward_median-1.0176489030122755
reward_min-1.2609345889687538
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max15.866666666666651
valid_direction_median13.43333333333332
valid_direction_min10.43333333333332
418239emmasungSolution templateaido1_luck-v3step1successyes790:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
score127.689130343027273


409233BenjaminTemplate for ROS Submissionaido1_LF1_r2-v3step1-simulationsuccessyes790:01:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
407232jlh457Random executionaido1_LF1_r2-v3step1-simulationsuccessyes790:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
406231jlh457Solution templateaido1_luck-v3step1successyes790:00:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
score152.095840755040726


404230ih258Random executionaido1_LF1_r2-v3step1-simulationsuccessyes790:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
403229ih258Solution templateaido1_luck-v3step1successyes790:00:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
score144.18463844201344


402228placailleRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes790:00:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean11.350653378370495
valid_direction_mean11.833333333333323


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9806589748188272, "good_angle": 14.930434269644056, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.733333333333324}, "ep001": {"nsteps": 500, "reward": -1.8157041236162184, "good_angle": 4.196235290568257, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 8.333333333333318}, "ep002": {"nsteps": 500, "reward": -1.7923278148472308, "good_angle": 15.507665313350032, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.933333333333318}, "ep003": {"nsteps": 500, "reward": -1.212890817284584, "good_angle": 10.885805088807745, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.333333333333332}, "ep004": {"nsteps": 500, "reward": -1.5788201929330823, "good_angle": 11.233126929482388, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 12.833333333333329}}
good_angle_max15.507665313350032
good_angle_median11.233126929482388
good_angle_min4.196235290568257
reward_max-0.9806589748188272
reward_mean-1.4760803846999884
reward_median-1.5788201929330823
reward_min-1.8157041236162184
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_min1
valid_direction_max14.733333333333324
valid_direction_median11.933333333333318
valid_direction_min8.333333333333318
401228placailleRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes790:01:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
400227aroumieSolution templateaido1_luck-v3step1successyes790:00:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
score165.03128303271235


399226placailleSolution templateaido1_luck-v3step1successyes790:00:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
score144.431736853011415


398225JonSolution templateaido1_luck-v3step1successyes790:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
score117.63050261297377


397224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videosabortedno790:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
395224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationabortedno790:02:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
392222spetrykRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes790:01:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
383211Andrea CensiPython templateaido1_amod_fleet_size_r1-v3step2-scoringsuccessyes790:00:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
fleet_size-1000000000


other stats
efficiency-62.53162920579799
service_quality-31.995517301450096
376211Andrea CensiPython templateaido1_amod_fleet_size_r1-v3step1-simulationsuccessno790:03:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue