Duckietown Challenges Home Challenges Submissions

Evaluator 715

ID715
evaluatorip-172-31-25-98-9766
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-9766
versiond-c:4.0.17;d-c-r:4.0.25;d-s:4.0.17
first heard
last heard
statusinactive
# evaluating
# success1 17759
# timeout1 17808
# failed
# error5 17770
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
178082472Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationtimeoutnoip-172-31-25-98-97660:25:03
I can see how the jo [...]
I can see how the job 17808 is timeout because passed 1503 seconds and the timeout is 1200.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
178052483Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:00:33
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
178022536Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFVI-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:00:30
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177882501jiang pengtest for ppoaido2-LF-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:01:27
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177812502Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerrornoip-172-31-25-98-97660:00:30
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177702521Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-25-98-97660:00:53
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177592440Jacopo Tanirandom_agentaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-25-98-97660:03:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8171921272237834
survival_time_median1.1000000000000003
deviation-center-line_median0.025668493904927793
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.15329597213051535
agent_compute-ego_mean0.11731318261711944
agent_compute-ego_median0.11156484955235532
agent_compute-ego_min0.08731101906817892
deviation-center-line_max0.057019386027434615
deviation-center-line_mean0.03634226830745448
deviation-center-line_min0.02280708605632212
deviation-heading_max0.235756116193223
deviation-heading_mean0.1638165081234764
deviation-heading_median0.1411032446854075
deviation-heading_min0.118601117425238
driven_any_max1.028556309238097
driven_any_mean0.8412197852214389
driven_any_median0.956358012875939
driven_any_min0.39300074524610096
driven_lanedir_consec_max0.9648079053779924
driven_lanedir_consec_mean0.6642871273891694
driven_lanedir_consec_min0.31973792380899546
driven_lanedir_max0.9648079053779924
driven_lanedir_mean0.6642871273891694
driven_lanedir_median0.8171921272237834
driven_lanedir_min0.31973792380899546
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.010635158290033754, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.03929356906725013, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.08731101906817892, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.05500868092412534, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.022810044495955757, "sim_compute_performance-ego": 0.039406175198762314, "sim_compute_robot_state-ego": 0.040037289909694504}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.01288847301317298, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.04557892550592837, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.10066109118254288, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07437769226405931, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.026328646618386978, "sim_compute_performance-ego": 0.04701017296832541, "sim_compute_robot_state-ego": 0.04670727771261464}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.02073926275426691, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.06920371272347191, "in-drivable-lane": 0, "agent_compute-ego": 0.15329597213051535, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.10625606233423408, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.04350179975683039, "sim_compute_performance-ego": 0.07129745049910112, "sim_compute_robot_state-ego": 0.07353314486416904}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.01840554343329535, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.05922728114657932, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.13373298115200466, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.08427331182691786, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.03280846277872721, "sim_compute_performance-ego": 0.059732516606648765, "sim_compute_robot_state-ego": 0.06176082293192545}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.015730117496691252, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.04590966826991031, "in-drivable-lane": 0, "agent_compute-ego": 0.11156484955235532, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.06801105800427888, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.031025999470760943, "sim_compute_performance-ego": 0.05573324153297826, "sim_compute_robot_state-ego": 0.05069485463594135}}
set_robot_commands_max0.10625606233423408
set_robot_commands_mean0.07758536107072309
set_robot_commands_median0.07437769226405931
set_robot_commands_min0.05500868092412534
sim_compute_performance-ego_max0.07129745049910112
sim_compute_performance-ego_mean0.05463591136116317
sim_compute_performance-ego_median0.05573324153297826
sim_compute_performance-ego_min0.039406175198762314
sim_compute_robot_state-ego_max0.07353314486416904
sim_compute_robot_state-ego_mean0.054546678010869
sim_compute_robot_state-ego_median0.05069485463594135
sim_compute_robot_state-ego_min0.040037289909694504
sim_compute_sim_state_max0.04350179975683039
sim_compute_sim_state_mean0.031294990624132255
sim_compute_sim_state_median0.031025999470760943
sim_compute_sim_state_min0.022810044495955757
sim_physics_max0.02073926275426691
sim_physics_mean0.015679710997492054
sim_physics_median0.015730117496691252
sim_physics_min0.010635158290033754
sim_render-ego_max0.06920371272347191
sim_render-ego_mean0.05184263134262801
sim_render-ego_median0.04590966826991031
sim_render-ego_min0.03929356906725013
simulation-passed1
survival_time_max1.1500000000000004
survival_time_mean0.9600000000000004
survival_time_min0.45
No reset possible