Duckietown Challenges Home Challenges Submissions

Evaluator 1609

ID1609
evaluatorip-172-31-43-40-10496
ownerI don't have one 😀
machineip-172-31-43-40
processip-172-31-43-40-10496
versiond-c:5.0.7;d-c-r:5.0.11;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success1 25185
# timeout
# failed
# error
# aborted
# host-error3 25138
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
251854403Alex Deliyannischallenge-aido_LF-template-tensorflowaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-43-40-104960:06:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.26397390445661095
survival_time_median1.6500000000000008
deviation-center-line_median0.08299620914157899
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.03143332118079776
agent_compute-ego_mean0.02776626611033941
agent_compute-ego_median0.02699505316244589
agent_compute-ego_min0.02449486936841692
deviation-center-line_max0.2722841868316162
deviation-center-line_mean0.12648973649324005
deviation-center-line_min0.07529415302195537
deviation-heading_max1.294216140774772
deviation-heading_mean0.680675022442286
deviation-heading_median0.5602633054924078
deviation-heading_min0.42519136627828896
driven_any_max0.7727782174565219
driven_any_mean0.434044459300492
driven_any_median0.3764952165202685
driven_any_min0.24129378313457645
driven_lanedir_consec_max0.5971975120566789
driven_lanedir_consec_mean0.2995164614301992
driven_lanedir_consec_min0.13943677430203172
driven_lanedir_max0.5971975120566789
driven_lanedir_mean0.2995164614301992
driven_lanedir_median0.26397390445661095
driven_lanedir_min0.13943677430203172
in-drivable-lane_max0.7500000000000007
in-drivable-lane_mean0.2299999999999999
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.24129378313457645, "sim_physics": 0.1476616178240095, "survival_time": 1.0500000000000005, "driven_lanedir": 0.16757989168849186, "sim_render-ego": 0.013899496623447962, "in-drivable-lane": 0, "agent_compute-ego": 0.03143332118079776, "deviation-heading": 0.5602633054924078, "set_robot_commands": 0.009909925006684802, "deviation-center-line": 0.07529415302195537, "driven_lanedir_consec": 0.16757989168849186, "sim_compute_sim_state": 0.006122952415829613, "sim_compute_performance-ego": 0.009368567239670526, "sim_compute_robot_state-ego": 0.011271283740089053}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7727782174565219, "sim_physics": 0.0909060069492885, "survival_time": 3.149999999999997, "driven_lanedir": 0.5971975120566789, "sim_render-ego": 0.010859701368543835, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.02533267414759076, "deviation-heading": 1.294216140774772, "set_robot_commands": 0.008968709007142082, "deviation-center-line": 0.2722841868316162, "driven_lanedir_consec": 0.5971975120566789, "sim_compute_sim_state": 0.004693042664300828, "sim_compute_performance-ego": 0.006745421697222997, "sim_compute_robot_state-ego": 0.008442224018157475}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3764952165202685, "sim_physics": 0.14641105767452356, "survival_time": 1.6500000000000008, "driven_lanedir": 0.3293942246471828, "sim_render-ego": 0.01444371541341146, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.030575412692445698, "deviation-heading": 0.42519136627828896, "set_robot_commands": 0.01081311341488, "deviation-center-line": 0.12449397335284965, "driven_lanedir_consec": 0.3293942246471828, "sim_compute_sim_state": 0.005277937108820135, "sim_compute_performance-ego": 0.008363962173461914, "sim_compute_robot_state-ego": 0.010337222706187857}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3233213409929598, "sim_physics": 0.09131801979882376, "survival_time": 1.4000000000000006, "driven_lanedir": 0.26397390445661095, "sim_render-ego": 0.011053383350372314, "in-drivable-lane": 0, "agent_compute-ego": 0.02449486936841692, "deviation-heading": 0.626835573187766, "set_robot_commands": 0.008585563727787562, "deviation-center-line": 0.07738016011820004, "driven_lanedir_consec": 0.26397390445661095, "sim_compute_sim_state": 0.003930015223366874, "sim_compute_performance-ego": 0.006287046841212681, "sim_compute_robot_state-ego": 0.007676192692347935}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4563337383981328, "sim_physics": 0.10044667527482316, "survival_time": 1.850000000000001, "driven_lanedir": 0.13943677430203172, "sim_render-ego": 0.011661200910001187, "in-drivable-lane": 0.7500000000000007, "agent_compute-ego": 0.02699505316244589, "deviation-heading": 0.4968687264781948, "set_robot_commands": 0.008781336449288033, "deviation-center-line": 0.08299620914157899, "driven_lanedir_consec": 0.13943677430203172, "sim_compute_sim_state": 0.004593707419730522, "sim_compute_performance-ego": 0.00674788371936695, "sim_compute_robot_state-ego": 0.008172608710624077}}
set_robot_commands_max0.01081311341488
set_robot_commands_mean0.009411729521156495
set_robot_commands_median0.008968709007142082
set_robot_commands_min0.008585563727787562
sim_compute_performance-ego_max0.009368567239670526
sim_compute_performance-ego_mean0.007502576334187013
sim_compute_performance-ego_median0.00674788371936695
sim_compute_performance-ego_min0.006287046841212681
sim_compute_robot_state-ego_max0.011271283740089053
sim_compute_robot_state-ego_mean0.00917990637348128
sim_compute_robot_state-ego_median0.008442224018157475
sim_compute_robot_state-ego_min0.007676192692347935
sim_compute_sim_state_max0.006122952415829613
sim_compute_sim_state_mean0.004923530966409595
sim_compute_sim_state_median0.004693042664300828
sim_compute_sim_state_min0.003930015223366874
sim_physics_max0.1476616178240095
sim_physics_mean0.1153486755042937
sim_physics_median0.10044667527482316
sim_physics_min0.0909060069492885
sim_render-ego_max0.01444371541341146
sim_render-ego_mean0.012383499533155352
sim_render-ego_median0.011661200910001187
sim_render-ego_min0.010859701368543835
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean1.82
survival_time_min1.0500000000000005
No reset possible
251563265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-43-40-104960:00:05
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251503257Liu Sam 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-43-40-104960:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251383264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-43-40-104960:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible