Duckietown Challenges Home Challenges Submissions

Evaluator 1601

ID1601
evaluatorip-172-31-45-34-10501
ownerI don't have one 😀
machineip-172-31-45-34
processip-172-31-45-34-10501
versiond-c:5.0.7;d-c-r:5.0.11;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success1 25189
# timeout
# failed
# error
# aborted
# host-error3 25154
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
251894405Alex Deliyannischallenge-aido_LF-template-tensorflowaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-45-34-105010:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1975513895705547
survival_time_median1.1000000000000003
deviation-center-line_median0.08836388698918868
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.022161115299571644
agent_compute-ego_mean0.02062181809425821
agent_compute-ego_median0.020627084531282123
agent_compute-ego_min0.01875830419135816
deviation-center-line_max0.16484498359442146
deviation-center-line_mean0.10661068530864624
deviation-center-line_min0.08145884606022036
deviation-heading_max1.0087900973754091
deviation-heading_mean0.61955010191282
deviation-heading_median0.6889256374994398
deviation-heading_min0.2598836212506579
driven_any_max1.7016775620457187
driven_any_mean0.5295026666002254
driven_any_median0.25286956299285984
driven_any_min0.2167422714863436
driven_lanedir_consec_max0.5033961656768622
driven_lanedir_consec_mean0.2463274386741961
driven_lanedir_consec_min0.13933973193501137
driven_lanedir_max0.5033961656768622
driven_lanedir_mean0.2463274386741961
driven_lanedir_median0.1975513895705547
driven_lanedir_min0.13933973193501137
in-drivable-lane_max4.399999999999984
in-drivable-lane_mean0.8999999999999968
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2186395016314254, "sim_physics": 0.14835714210163464, "survival_time": 1.1000000000000003, "driven_lanedir": 0.13933973193501137, "sim_render-ego": 0.010097471150484953, "in-drivable-lane": 0, "agent_compute-ego": 0.022161115299571644, "deviation-heading": 0.6889256374994398, "set_robot_commands": 0.00695435567335649, "deviation-center-line": 0.08242574751127323, "driven_lanedir_consec": 0.13933973193501137, "sim_compute_sim_state": 0.003630833192305131, "sim_compute_performance-ego": 0.005832011049444025, "sim_compute_robot_state-ego": 0.007251674478704279, "sim_compute_robot_state-npc0": 0.006595741618763317, "sim_compute_robot_state-npc1": 0.006533135067332874, "sim_compute_robot_state-npc2": 0.006494023583152078, "sim_compute_robot_state-npc3": 0.0065241293473677206}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.25286956299285984, "sim_physics": 0.12605103579434482, "survival_time": 1.6500000000000008, "driven_lanedir": 0.17406125600847933, "sim_render-ego": 0.009397210496844667, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01875830419135816, "deviation-heading": 0.8790839312804655, "set_robot_commands": 0.006107995004364939, "deviation-center-line": 0.1159599623881274, "driven_lanedir_consec": 0.17406125600847933, "sim_compute_sim_state": 0.0036362373467647663, "sim_compute_performance-ego": 0.00539918379350142, "sim_compute_robot_state-ego": 0.0065249890992135715, "sim_compute_robot_state-npc0": 0.0062627358870072794, "sim_compute_robot_state-npc1": 0.00617803226817738, "sim_compute_robot_state-npc2": 0.0061908490730054454, "sim_compute_robot_state-npc3": 0.0059608112681995735}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2575844348447798, "sim_physics": 0.14922941298711867, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2172886501800728, "sim_render-ego": 0.009138232185727074, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0203660215650286, "deviation-heading": 0.2598836212506579, "set_robot_commands": 0.007082053593226841, "deviation-center-line": 0.08836388698918868, "driven_lanedir_consec": 0.2172886501800728, "sim_compute_sim_state": 0.003933429718017578, "sim_compute_performance-ego": 0.005492993763514927, "sim_compute_robot_state-ego": 0.00657819566272554, "sim_compute_robot_state-npc0": 0.006426357087634858, "sim_compute_robot_state-npc1": 0.005805265335809617, "sim_compute_robot_state-npc2": 0.0060171399797712055, "sim_compute_robot_state-npc3": 0.006096385774158296}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2167422714863436, "sim_physics": 0.1658641539121929, "survival_time": 0.9500000000000004, "driven_lanedir": 0.1975513895705547, "sim_render-ego": 0.010416306947406967, "in-drivable-lane": 0, "agent_compute-ego": 0.020627084531282123, "deviation-heading": 0.26106722215812755, "set_robot_commands": 0.006840567839773078, "deviation-center-line": 0.08145884606022036, "driven_lanedir_consec": 0.1975513895705547, "sim_compute_sim_state": 0.004004867453324168, "sim_compute_performance-ego": 0.005862875988608913, "sim_compute_robot_state-ego": 0.007779824106316818, "sim_compute_robot_state-npc0": 0.006643935253745631, "sim_compute_robot_state-npc1": 0.006730255327726665, "sim_compute_robot_state-npc2": 0.006417086249903629, "sim_compute_robot_state-npc3": 0.006323400296662983}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7016775620457187, "sim_physics": 0.11155066760719246, "survival_time": 7.049999999999983, "driven_lanedir": 0.5033961656768622, "sim_render-ego": 0.008937069710264815, "in-drivable-lane": 4.399999999999984, "agent_compute-ego": 0.02119656488405052, "deviation-heading": 1.0087900973754091, "set_robot_commands": 0.006404497944716866, "deviation-center-line": 0.16484498359442146, "driven_lanedir_consec": 0.5033961656768622, "sim_compute_sim_state": 0.003689003328905038, "sim_compute_performance-ego": 0.005018420253239625, "sim_compute_robot_state-ego": 0.006264612184348681, "sim_compute_robot_state-npc0": 0.006098564634931848, "sim_compute_robot_state-npc1": 0.005924185962541729, "sim_compute_robot_state-npc2": 0.005955696105957031, "sim_compute_robot_state-npc3": 0.006000882344888457}}
set_robot_commands_max0.007082053593226841
set_robot_commands_mean0.006677894011087643
set_robot_commands_median0.006840567839773078
set_robot_commands_min0.006107995004364939
sim_compute_performance-ego_max0.005862875988608913
sim_compute_performance-ego_mean0.005521096969661782
sim_compute_performance-ego_median0.005492993763514927
sim_compute_performance-ego_min0.005018420253239625
sim_compute_robot_state-ego_max0.007779824106316818
sim_compute_robot_state-ego_mean0.0068798591062617775
sim_compute_robot_state-ego_median0.00657819566272554
sim_compute_robot_state-ego_min0.006264612184348681
sim_compute_robot_state-npc0_max0.006643935253745631
sim_compute_robot_state-npc0_mean0.006405466896416587
sim_compute_robot_state-npc0_median0.006426357087634858
sim_compute_robot_state-npc0_min0.006098564634931848
sim_compute_robot_state-npc1_max0.006730255327726665
sim_compute_robot_state-npc1_mean0.006234174792317653
sim_compute_robot_state-npc1_median0.00617803226817738
sim_compute_robot_state-npc1_min0.005805265335809617
sim_compute_robot_state-npc2_max0.006494023583152078
sim_compute_robot_state-npc2_mean0.006214958998357878
sim_compute_robot_state-npc2_median0.0061908490730054454
sim_compute_robot_state-npc2_min0.005955696105957031
sim_compute_robot_state-npc3_max0.0065241293473677206
sim_compute_robot_state-npc3_mean0.006181121806255406
sim_compute_robot_state-npc3_median0.006096385774158296
sim_compute_robot_state-npc3_min0.0059608112681995735
sim_compute_sim_state_max0.004004867453324168
sim_compute_sim_state_mean0.003778874207863337
sim_compute_sim_state_median0.003689003328905038
sim_compute_sim_state_min0.003630833192305131
sim_physics_max0.1658641539121929
sim_physics_mean0.1402104824804967
sim_physics_median0.14835714210163464
sim_physics_min0.11155066760719246
sim_render-ego_max0.010416306947406967
sim_render-ego_mean0.009597258098145694
sim_render-ego_median0.009397210496844667
sim_render-ego_min0.008937069710264815
simulation-passed1
survival_time_max7.049999999999983
survival_time_mean2.3599999999999968
survival_time_min0.9500000000000004
No reset possible
251663265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-45-34-105010:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251613257Liu Sam 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-45-34-105010:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251543264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-45-34-105010:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible