Duckietown Challenges Home Challenges Submissions

Evaluator 2332

ID2332
evaluatorreg01-ed49617f538f-1
ownerI don't have one 😀
machineChudeQian-Sager-Duckietown
processreg01-ed49617f538f-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 42529
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4252911480Raphael Jeansim-exercise-2aido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. reg01-ed49617f538f-10:08:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.9076734841095537
survival_time_median14.950000000000076
deviation-center-line_median0.7527943825353633
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.014260481198628744
agent_compute-ego_mean0.0139445161819458
agent_compute-ego_median0.014065761963526408
agent_compute-ego_min0.013386059602101643
complete-iteration_max0.18045902887980145
complete-iteration_mean0.17832336763540904
complete-iteration_median0.17887467940648397
complete-iteration_min0.1750850828488668
deviation-center-line_max0.7821704622423149
deviation-center-line_mean0.7446564395829564
deviation-center-line_min0.6908665310187838
deviation-heading_max3.3864367531601354
deviation-heading_mean2.95645386486439
deviation-heading_median3.0683490640675215
deviation-heading_min2.302680578162382
driven_any_max4.576709231840972
driven_any_mean3.9831577059068466
driven_any_median4.027825415494668
driven_any_min3.3002707607970785
driven_lanedir_consec_max4.493645065816795
driven_lanedir_consec_mean3.874223568619426
driven_lanedir_consec_min3.187902240441803
driven_lanedir_max4.493645065816795
driven_lanedir_mean3.874223568619426
driven_lanedir_median3.9076734841095537
driven_lanedir_min3.187902240441803
get_duckie_state_max2.7139981587727863e-06
get_duckie_state_mean2.5546550750732426e-06
get_duckie_state_median2.55584716796875e-06
get_duckie_state_min2.3929278055826824e-06
get_robot_state_max0.016281887690226236
get_robot_state_mean0.015207834442456564
get_robot_state_median0.015017362435658772
get_robot_state_min0.01451472520828247
get_state_dump_max0.013842180569966634
get_state_dump_mean0.012826529343922932
get_state_dump_median0.012588036855061848
get_state_dump_min0.0122878630956014
get_ui_image_max0.02615354617436727
get_ui_image_mean0.025741116603215534
get_ui_image_median0.025727210839589437
get_ui_image_min0.025356498559316
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.954614787355856, "get_ui_image": 0.025939324696858723, "step_physics": 0.0678972848256429, "survival_time": 14.950000000000076, "driven_lanedir": 3.8344024598920488, "get_state_dump": 0.013842180569966634, "sim_render-ego": 0.005393885771433513, "get_robot_state": 0.016281887690226236, "get_duckie_state": 2.7139981587727863e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013893998463948568, "deviation-heading": 3.040407023293147, "complete-iteration": 0.179132239818573, "set_robot_commands": 0.004176522890726725, "deviation-center-line": 0.7738228850790175, "driven_lanedir_consec": 3.8344024598920488, "sim_compute_sim_state": 0.027900853157043454, "sim_compute_performance-ego": 0.003694473107655843}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.1010360436334805, "get_ui_image": 0.02551509698232015, "step_physics": 0.06788585583368938, "survival_time": 14.950000000000076, "driven_lanedir": 3.980944508327058, "get_state_dump": 0.012441821098327636, "sim_render-ego": 0.0055911556879679365, "get_robot_state": 0.014677042166392007, "get_duckie_state": 2.4771690368652345e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014260481198628744, "deviation-heading": 3.0962911048418964, "complete-iteration": 0.1750850828488668, "set_robot_commands": 0.004401625792185466, "deviation-center-line": 0.7317658799917093, "driven_lanedir_consec": 3.980944508327058, "sim_compute_sim_state": 0.026442971229553223, "sim_compute_performance-ego": 0.0037585083643595376}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.3002707607970785, "get_ui_image": 0.02615354617436727, "step_physics": 0.07116590817769368, "survival_time": 14.950000000000076, "driven_lanedir": 3.187902240441803, "get_state_dump": 0.01273425261179606, "sim_render-ego": 0.005581564108530681, "get_robot_state": 0.015357682704925536, "get_duckie_state": 2.634525299072266e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014237525463104249, "deviation-heading": 3.3864367531601354, "complete-iteration": 0.18045902887980145, "set_robot_commands": 0.0043178296089172365, "deviation-center-line": 0.7821704622423149, "driven_lanedir_consec": 3.187902240441803, "sim_compute_sim_state": 0.026982560952504477, "sim_compute_performance-ego": 0.0038169161478678383}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.576709231840972, "get_ui_image": 0.025356498559316, "step_physics": 0.07042422691980997, "survival_time": 14.950000000000076, "driven_lanedir": 4.493645065816795, "get_state_dump": 0.0122878630956014, "sim_render-ego": 0.005169950326283773, "get_robot_state": 0.01451472520828247, "get_duckie_state": 2.3929278055826824e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.013386059602101643, "deviation-heading": 2.302680578162382, "complete-iteration": 0.17861711899439495, "set_robot_commands": 0.004246329466501872, "deviation-center-line": 0.6908665310187838, "driven_lanedir_consec": 4.493645065816795, "sim_compute_sim_state": 0.02970840056737264, "sim_compute_performance-ego": 0.0034165652592976887}}
set_robot_commands_max0.004401625792185466
set_robot_commands_mean0.004285576939582825
set_robot_commands_median0.004282079537709554
set_robot_commands_min0.004176522890726725
sim_compute_performance-ego_max0.0038169161478678383
sim_compute_performance-ego_mean0.003671615719795227
sim_compute_performance-ego_median0.0037264907360076904
sim_compute_performance-ego_min0.0034165652592976887
sim_compute_sim_state_max0.02970840056737264
sim_compute_sim_state_mean0.027758696476618452
sim_compute_sim_state_median0.02744170705477397
sim_compute_sim_state_min0.026442971229553223
sim_render-ego_max0.0055911556879679365
sim_render-ego_mean0.005434138973553976
sim_render-ego_median0.005487724939982097
sim_render-ego_min0.005169950326283773
simulation-passed1
step_physics_max0.07116590817769368
step_physics_mean0.06934331893920899
step_physics_median0.06916075587272644
step_physics_min0.06788585583368938
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible