Duckietown Challenges Home Challenges Submissions

Evaluator 1650

ID1650
evaluatorRamons-MacBook-Pro.local-30529
ownerRamon Emiliani 🇨🇦
machineRamons-MacBook-Pro.local
processRamons-MacBook-Pro.local-30529
versiond-c:5.1.1;d-c-r:5.0.12;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success1 27876
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
278765043Ramon Emiliani 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationsuccessyesRamons-MacBook-Pro.local-305290:12:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0820755786205398
survival_time_median4.549999999999992
deviation-center-line_median0.3987869163128625
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.03223792896714321
agent_compute-ego_mean0.02368671921314522
agent_compute-ego_median0.02124765555063883
agent_compute-ego_min0.01852335510673104
deviation-center-line_max0.7897192977580352
deviation-center-line_mean0.4379576074252136
deviation-center-line_min0.10770343009358764
deviation-heading_max4.166341290822665
deviation-heading_mean2.358377834090642
deviation-heading_median2.2226043911085367
deviation-heading_min1.0918396550266738
driven_any_max4.085186250142421
driven_any_mean1.9499784094459411
driven_any_median1.1784062029699276
driven_any_min0.5075782469809187
driven_lanedir_consec_max3.1550411308765076
driven_lanedir_consec_mean1.5079694517026994
driven_lanedir_consec_min0.19209400035981705
driven_lanedir_max3.1550411308765076
driven_lanedir_mean1.5255154481365625
driven_lanedir_median1.0820755786205398
driven_lanedir_min0.23768690318839417
in-drivable-lane_max2.3499999999999943
in-drivable-lane_mean0.8400000000000013
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0812749430804858, "sim_physics": 0.053883572185740754, "survival_time": 4.249999999999993, "driven_lanedir": 0.6984260781178063, "sim_render-ego": 0.00811303924111759, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.01877461321213666, "deviation-heading": 2.2226043911085367, "set_robot_commands": 0.0063530921936035155, "deviation-center-line": 0.2256372325251037, "driven_lanedir_consec": 0.6570080504058663, "sim_compute_sim_state": 0.003915208928725299, "sim_compute_performance-ego": 0.005476222318761489, "sim_compute_robot_state-ego": 0.0061807015362907855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1784062029699276, "sim_physics": 0.05936281759660322, "survival_time": 4.549999999999992, "driven_lanedir": 1.0820755786205398, "sim_render-ego": 0.009115609493884413, "in-drivable-lane": 0, "agent_compute-ego": 0.01852335510673104, "deviation-heading": 1.4496983090861024, "set_robot_commands": 0.006974346035129421, "deviation-center-line": 0.3987869163128625, "driven_lanedir_consec": 1.0820755786205398, "sim_compute_sim_state": 0.004440784454345703, "sim_compute_performance-ego": 0.005793225634229052, "sim_compute_robot_state-ego": 0.006794486727033343}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.085186250142421, "sim_physics": 0.0574954613049825, "survival_time": 14.950000000000076, "driven_lanedir": 3.1550411308765076, "sim_render-ego": 0.008943564097086588, "in-drivable-lane": 2.3499999999999943, "agent_compute-ego": 0.02124765555063883, "deviation-heading": 4.166341290822665, "set_robot_commands": 0.0069858145713806155, "deviation-center-line": 0.7897192977580352, "driven_lanedir_consec": 3.1550411308765076, "sim_compute_sim_state": 0.004521146615346272, "sim_compute_performance-ego": 0.005964144865671794, "sim_compute_robot_state-ego": 0.006985904375712077}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5075782469809187, "sim_physics": 0.062204749085182365, "survival_time": 2.1500000000000004, "driven_lanedir": 0.23768690318839417, "sim_render-ego": 0.009382558423419332, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.03223792896714321, "deviation-heading": 1.0918396550266738, "set_robot_commands": 0.006727551305016806, "deviation-center-line": 0.10770343009358764, "driven_lanedir_consec": 0.19209400035981705, "sim_compute_sim_state": 0.004495227059652639, "sim_compute_performance-ego": 0.005948088889898256, "sim_compute_robot_state-ego": 0.007057106772134471}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.897446404055952, "sim_physics": 0.0532817283523417, "survival_time": 10.700000000000015, "driven_lanedir": 2.454347549879563, "sim_render-ego": 0.008405473744757821, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.02765004322907635, "deviation-heading": 2.8614055244092307, "set_robot_commands": 0.006010193691075405, "deviation-center-line": 0.667941160436479, "driven_lanedir_consec": 2.4536284982507657, "sim_compute_sim_state": 0.003982264304829535, "sim_compute_performance-ego": 0.0054257417393621995, "sim_compute_robot_state-ego": 0.00646371262095799}}
set_robot_commands_max0.0069858145713806155
set_robot_commands_mean0.006610199559241152
set_robot_commands_median0.006727551305016806
set_robot_commands_min0.006010193691075405
sim_compute_performance-ego_max0.005964144865671794
sim_compute_performance-ego_mean0.005721484689584558
sim_compute_performance-ego_median0.005793225634229052
sim_compute_performance-ego_min0.0054257417393621995
sim_compute_robot_state-ego_max0.007057106772134471
sim_compute_robot_state-ego_mean0.006696382406425732
sim_compute_robot_state-ego_median0.006794486727033343
sim_compute_robot_state-ego_min0.0061807015362907855
sim_compute_sim_state_max0.004521146615346272
sim_compute_sim_state_mean0.00427092627257989
sim_compute_sim_state_median0.004440784454345703
sim_compute_sim_state_min0.003915208928725299
sim_physics_max0.062204749085182365
sim_physics_mean0.057245665704970104
sim_physics_median0.0574954613049825
sim_physics_min0.0532817283523417
sim_render-ego_max0.009382558423419332
sim_render-ego_mean0.00879204900005315
sim_render-ego_median0.008943564097086588
sim_render-ego_min0.00811303924111759
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.320000000000016
survival_time_min2.1500000000000004
No reset possible