Duckietown Challenges Home Challenges Submissions

Evaluator 719

ID719
evaluatoridsc-rudolf-9560
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-9560
versiond-c:4.0.17;d-c-r:4.0.25;d-s:4.0.17
first heard
last heard
statusinactive
# evaluating
# success1 17765
# timeout1 17790
# failed
# error3 17752
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
177902495Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationtimeoutnoidsc-rudolf-95600:26:00
I can see how the jo [...]
I can see how the job 17790 is timeout because passed 1560 seconds and the timeout is 1200.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177822507Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-95600:00:36
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177722542Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-95600:00:38
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177652417Andrea Censi 🇨🇭random_agentaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-95600:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8171921272237834
survival_time_median1.1000000000000003
deviation-center-line_median0.025668493904927793
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.12898714646049167
agent_compute-ego_mean0.1198823952695256
agent_compute-ego_median0.11944048028243216
agent_compute-ego_min0.11307856310968814
deviation-center-line_max0.057019386027434615
deviation-center-line_mean0.03634226830745448
deviation-center-line_min0.02280708605632212
deviation-heading_max0.235756116193223
deviation-heading_mean0.1638165081234764
deviation-heading_median0.1411032446854075
deviation-heading_min0.118601117425238
driven_any_max1.028556309238097
driven_any_mean0.8412197852214389
driven_any_median0.956358012875939
driven_any_min0.39300074524610096
driven_lanedir_consec_max0.9648079053779924
driven_lanedir_consec_mean0.6642871273891694
driven_lanedir_consec_min0.31973792380899546
driven_lanedir_max0.9648079053779924
driven_lanedir_mean0.6642871273891694
driven_lanedir_median0.8171921272237834
driven_lanedir_min0.31973792380899546
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.012162426243657652, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.05247543169104535, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.11307856310968814, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.07504956618599269, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.03307385030000106, "sim_compute_performance-ego": 0.05551323683365532, "sim_compute_robot_state-ego": 0.05806612968444824}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.013710923816846764, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.059262565944505775, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12898714646049167, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07792957969333815, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.03947719283725904, "sim_compute_performance-ego": 0.06038122591765031, "sim_compute_robot_state-ego": 0.06464554952538532}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.013412182981317694, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.061240011995488945, "in-drivable-lane": 0, "agent_compute-ego": 0.12371793660250575, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.07470092990181663, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.03679332949898459, "sim_compute_performance-ego": 0.06588025526566939, "sim_compute_robot_state-ego": 0.0649244026704268}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.012168592876858182, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.05728427569071451, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.11418784989251032, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.07692064179314508, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.03652924961513943, "sim_compute_performance-ego": 0.057143953111436635, "sim_compute_robot_state-ego": 0.055764330757988825}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.014411788237722297, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.057841049997430095, "in-drivable-lane": 0, "agent_compute-ego": 0.11944048028243216, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.07187648823386744, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.03544792376066509, "sim_compute_performance-ego": 0.060252214732923005, "sim_compute_robot_state-ego": 0.060335962395919}}
set_robot_commands_max0.07792957969333815
set_robot_commands_mean0.07529544116163199
set_robot_commands_median0.07504956618599269
set_robot_commands_min0.07187648823386744
sim_compute_performance-ego_max0.06588025526566939
sim_compute_performance-ego_mean0.05983417717226693
sim_compute_performance-ego_median0.060252214732923005
sim_compute_performance-ego_min0.05551323683365532
sim_compute_robot_state-ego_max0.0649244026704268
sim_compute_robot_state-ego_mean0.060747275006833634
sim_compute_robot_state-ego_median0.060335962395919
sim_compute_robot_state-ego_min0.055764330757988825
sim_compute_sim_state_max0.03947719283725904
sim_compute_sim_state_mean0.03626430920240984
sim_compute_sim_state_median0.03652924961513943
sim_compute_sim_state_min0.03307385030000106
sim_physics_max0.014411788237722297
sim_physics_mean0.01317318283128052
sim_physics_median0.013412182981317694
sim_physics_min0.012162426243657652
sim_render-ego_max0.061240011995488945
sim_render-ego_mean0.057620667063836936
sim_render-ego_median0.057841049997430095
sim_render-ego_min0.05247543169104535
simulation-passed1
survival_time_max1.1500000000000004
survival_time_mean0.9600000000000004
survival_time_min0.45
No reset possible
177522509Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-95600:01:05
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible