Duckietown Challenges Home Challenges Submissions

Evaluator 1604

ID1604
evaluatorip-172-31-45-34-10500
ownerI don't have one 😀
machineip-172-31-45-34
processip-172-31-45-34-10500
versiond-c:5.0.7;d-c-r:5.0.11;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success2 25181
# timeout
# failed
# error
# aborted
# host-error3 25139
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
251844407Alex Deliyannischallenge-aido_LF-template-tensorflowaido3-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-45-34-105000:05:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1575921505157463
survival_time_median1.2000000000000004
deviation-center-line_median0.07268833137425876
in-drivable-lane_median0


other stats
agent_compute-ego_max0.027462925229753767
agent_compute-ego_mean0.023023901459974645
agent_compute-ego_median0.022304462664055103
agent_compute-ego_min0.021129508813222248
deviation-center-line_max0.12883807408181858
deviation-center-line_mean0.09247132794998428
deviation-center-line_min0.0674936860672527
deviation-heading_max1.1769736671477675
deviation-heading_mean0.6347890803090191
deviation-heading_median0.5590853100132713
deviation-heading_min0.29465279685531576
driven_any_max0.24091498577643256
driven_any_mean0.20278717048770253
driven_any_median0.20710224319928203
driven_any_min0.14080035692523063
driven_lanedir_consec_max0.22001769762502632
driven_lanedir_consec_mean0.1554526199705707
driven_lanedir_consec_min0.10998161919277472
driven_lanedir_max0.22001769762502632
driven_lanedir_mean0.1554526199705707
driven_lanedir_median0.1575921505157463
driven_lanedir_min0.10998161919277472
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.20710224319928203, "sim_physics": 0.15236298243204752, "survival_time": 1.0500000000000005, "driven_lanedir": 0.11656637769080902, "sim_render-ego": 0.01009882064092727, "in-drivable-lane": 0, "agent_compute-ego": 0.027462925229753767, "deviation-heading": 0.6769621551595798, "set_robot_commands": 0.007837329592023577, "deviation-center-line": 0.07268833137425876, "driven_lanedir_consec": 0.11656637769080902, "sim_compute_sim_state": 0.0041089171455019995, "sim_compute_performance-ego": 0.0058345794677734375, "sim_compute_robot_state-ego": 0.00720033191499256, "sim_compute_robot_state-npc0": 0.007717155274890718, "sim_compute_robot_state-npc1": 0.006999901362827846, "sim_compute_robot_state-npc2": 0.006497996194022042, "sim_compute_robot_state-npc3": 0.00661400386265346}, "udem1-1-0": {"driven_any": 0.23935867709363545, "sim_physics": 0.14684867136406177, "survival_time": 1.6500000000000008, "driven_lanedir": 0.17310525482849703, "sim_render-ego": 0.010154261733546402, "in-drivable-lane": 0, "agent_compute-ego": 0.022304462664055103, "deviation-heading": 1.1769736671477675, "set_robot_commands": 0.006945992961074367, "deviation-center-line": 0.12883807408181858, "driven_lanedir_consec": 0.17310525482849703, "sim_compute_sim_state": 0.0038505611997662168, "sim_compute_performance-ego": 0.0055403420419404, "sim_compute_robot_state-ego": 0.007010958411476829, "sim_compute_robot_state-npc0": 0.00684135610407049, "sim_compute_robot_state-npc1": 0.006491791118275036, "sim_compute_robot_state-npc2": 0.006547414895259973, "sim_compute_robot_state-npc3": 0.006352583567301433}, "udem1-2-0": {"driven_any": 0.14080035692523063, "sim_physics": 0.2056119740009308, "survival_time": 0.8000000000000002, "driven_lanedir": 0.10998161919277472, "sim_render-ego": 0.00982770323753357, "in-drivable-lane": 0, "agent_compute-ego": 0.021593406796455383, "deviation-heading": 0.29465279685531576, "set_robot_commands": 0.006862848997116089, "deviation-center-line": 0.0674936860672527, "driven_lanedir_consec": 0.10998161919277472, "sim_compute_sim_state": 0.003828629851341248, "sim_compute_performance-ego": 0.005859896540641785, "sim_compute_robot_state-ego": 0.007016003131866455, "sim_compute_robot_state-npc0": 0.00674748420715332, "sim_compute_robot_state-npc1": 0.006572723388671875, "sim_compute_robot_state-npc2": 0.0063464343547821045, "sim_compute_robot_state-npc3": 0.006015270948410034}, "udem1-3-0": {"driven_any": 0.1857595894439321, "sim_physics": 0.15386728286743165, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1575921505157463, "sim_render-ego": 0.009706459045410155, "in-drivable-lane": 0, "agent_compute-ego": 0.02262920379638672, "deviation-heading": 0.5590853100132713, "set_robot_commands": 0.006973781585693359, "deviation-center-line": 0.12225045305322574, "driven_lanedir_consec": 0.1575921505157463, "sim_compute_sim_state": 0.003901443481445313, "sim_compute_performance-ego": 0.005618391036987305, "sim_compute_robot_state-ego": 0.006625900268554688, "sim_compute_robot_state-npc0": 0.006983518600463867, "sim_compute_robot_state-npc1": 0.006533546447753906, "sim_compute_robot_state-npc2": 0.006578235626220703, "sim_compute_robot_state-npc3": 0.006533145904541016}, "udem1-4-0": {"driven_any": 0.24091498577643256, "sim_physics": 0.14015031854311624, "survival_time": 1.2000000000000004, "driven_lanedir": 0.22001769762502632, "sim_render-ego": 0.009482781092325846, "in-drivable-lane": 0, "agent_compute-ego": 0.021129508813222248, "deviation-heading": 0.4662714723691615, "set_robot_commands": 0.006794651349385579, "deviation-center-line": 0.07108609517336563, "driven_lanedir_consec": 0.22001769762502632, "sim_compute_sim_state": 0.003903210163116455, "sim_compute_performance-ego": 0.005143811305363973, "sim_compute_robot_state-ego": 0.006888886292775472, "sim_compute_robot_state-npc0": 0.006409754355748494, "sim_compute_robot_state-npc1": 0.00629378358523051, "sim_compute_robot_state-npc2": 0.0063143571217854815, "sim_compute_robot_state-npc3": 0.005963027477264404}}
set_robot_commands_max0.007837329592023577
set_robot_commands_mean0.007082920897058595
set_robot_commands_median0.006945992961074367
set_robot_commands_min0.006794651349385579
sim_compute_performance-ego_max0.005859896540641785
sim_compute_performance-ego_mean0.00559940407854138
sim_compute_performance-ego_median0.005618391036987305
sim_compute_performance-ego_min0.005143811305363973
sim_compute_robot_state-ego_max0.00720033191499256
sim_compute_robot_state-ego_mean0.006948416003933202
sim_compute_robot_state-ego_median0.007010958411476829
sim_compute_robot_state-ego_min0.006625900268554688
sim_compute_robot_state-npc0_max0.007717155274890718
sim_compute_robot_state-npc0_mean0.006939853708465378
sim_compute_robot_state-npc0_median0.00684135610407049
sim_compute_robot_state-npc0_min0.006409754355748494
sim_compute_robot_state-npc1_max0.006999901362827846
sim_compute_robot_state-npc1_mean0.006578349180551835
sim_compute_robot_state-npc1_median0.006533546447753906
sim_compute_robot_state-npc1_min0.00629378358523051
sim_compute_robot_state-npc2_max0.006578235626220703
sim_compute_robot_state-npc2_mean0.006456887638414061
sim_compute_robot_state-npc2_median0.006497996194022042
sim_compute_robot_state-npc2_min0.0063143571217854815
sim_compute_robot_state-npc3_max0.00661400386265346
sim_compute_robot_state-npc3_mean0.006295606352034069
sim_compute_robot_state-npc3_median0.006352583567301433
sim_compute_robot_state-npc3_min0.005963027477264404
sim_compute_sim_state_max0.0041089171455019995
sim_compute_sim_state_mean0.003918552368234246
sim_compute_sim_state_median0.003901443481445313
sim_compute_sim_state_min0.003828629851341248
sim_physics_max0.2056119740009308
sim_physics_mean0.15976824584151758
sim_physics_median0.15236298243204752
sim_physics_min0.14015031854311624
sim_render-ego_max0.010154261733546402
sim_render-ego_mean0.009854005149948648
sim_render-ego_median0.00982770323753357
sim_render-ego_min0.009482781092325846
simulation-passed1
survival_time_max1.6500000000000008
survival_time_mean1.1900000000000004
survival_time_min0.8000000000000002
No reset possible
251814400Vinny RuiaPredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-105000:00:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11344274567279732
error_L20.019807347419560077


No reset possible
251623257Liu Sam 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-45-34-105000:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251593264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-45-34-105000:00:24
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251393265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-45-34-105000:00:24
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible