Duckietown Challenges Home Challenges Submissions

Evaluator 686

ID686
evaluatorInstance1
ownerJulian Zilly
machineidsc-rudolf
processInstance1
versiond-c:4.0.16;d-c-r:4.0.22;d-s:4.0.16
first heard
last heard
statusinactive
# evaluating
# success1 17724
# timeout
# failed
# error2 17734
# aborted1 17714
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
177382541jiang pengtest for ppoaido2-LF-sim-testingstep1-simulationerrornoInstance10:00:39
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177342521Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoInstance10:00:49
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177242509Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationsuccessnoInstance10:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2448526305955787
survival_time_median1.0000000000000002
deviation-center-line_median0.02780958695734228
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.16508736780711583
agent_compute-ego_mean0.155597275259308
agent_compute-ego_median0.15947642633991857
agent_compute-ego_min0.1338280200958252
deviation-center-line_max0.1367821583469593
deviation-center-line_mean0.05703771312424479
deviation-center-line_min0.019515313732513393
deviation-heading_max0.6295143987792061
deviation-heading_mean0.33854872313755296
deviation-heading_median0.30747603818653535
deviation-heading_min0.1699364276466551
driven_any_max0.9094890302704564
driven_any_mean0.614817253072296
driven_any_median0.5457640496143875
driven_any_min0.3022738981004904
driven_lanedir_consec_max0.7972872880234139
driven_lanedir_consec_mean0.4211895144689454
driven_lanedir_consec_min0.1644714808652381
driven_lanedir_max0.7972872880234139
driven_lanedir_mean0.42291373507306657
driven_lanedir_median0.2448526305955787
driven_lanedir_min0.1644714808652381
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.2500000000000001
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.011880922317504882, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.05603849887847901, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.15590590238571167, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.07596391439437866, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.03665059804916382, "sim_compute_performance-ego": 0.061207365989685056, "sim_compute_robot_state-ego": 0.06148838996887207}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126885, "sim_physics": 0.017441749572753906, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120271352061035, "sim_render-ego": 0.07409170094658346, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.16368865966796875, "deviation-heading": 0.30747603818653535, "set_robot_commands": 0.08188739944906796, "deviation-center-line": 0.023999233443120993, "driven_lanedir_consec": 0.17258161050000476, "sim_compute_sim_state": 0.046381810132194966, "sim_compute_performance-ego": 0.07495794576757095, "sim_compute_robot_state-ego": 0.07337178903467514}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3022738981004904, "sim_physics": 0.013043665885925293, "survival_time": 0.49999999999999994, "driven_lanedir": 0.2448526305955787, "sim_render-ego": 0.061265301704406736, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.1338280200958252, "deviation-heading": 0.1699364276466551, "set_robot_commands": 0.07542119026184083, "deviation-center-line": 0.02780958695734228, "driven_lanedir_consec": 0.2448526305955787, "sim_compute_sim_state": 0.03932950496673584, "sim_compute_performance-ego": 0.06313416957855225, "sim_compute_robot_state-ego": 0.06568176746368408}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.014809574399675642, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.07136282750538417, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16508736780711583, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.07960720573152814, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.04445556231907436, "sim_compute_performance-ego": 0.07020352567945208, "sim_compute_robot_state-ego": 0.07218959501811437}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704564, "sim_physics": 0.013713852051765688, "survival_time": 1.5500000000000007, "driven_lanedir": 0.7972872880234139, "sim_render-ego": 0.0743225928275816, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.15947642633991857, "deviation-heading": 0.6295143987792061, "set_robot_commands": 0.07790109419053601, "deviation-center-line": 0.1367821583469593, "driven_lanedir_consec": 0.7972872880234139, "sim_compute_sim_state": 0.04077179201187626, "sim_compute_performance-ego": 0.06746325954314202, "sim_compute_robot_state-ego": 0.06701275610154675}}
set_robot_commands_max0.08188739944906796
set_robot_commands_mean0.07815616080547032
set_robot_commands_median0.07790109419053601
set_robot_commands_min0.07542119026184083
sim_compute_performance-ego_max0.07495794576757095
sim_compute_performance-ego_mean0.06739325331168047
sim_compute_performance-ego_median0.06746325954314202
sim_compute_performance-ego_min0.061207365989685056
sim_compute_robot_state-ego_max0.07337178903467514
sim_compute_robot_state-ego_mean0.06794885951737847
sim_compute_robot_state-ego_median0.06701275610154675
sim_compute_robot_state-ego_min0.06148838996887207
sim_compute_sim_state_max0.046381810132194966
sim_compute_sim_state_mean0.04151785349580905
sim_compute_sim_state_median0.04077179201187626
sim_compute_sim_state_min0.03665059804916382
sim_physics_max0.017441749572753906
sim_physics_mean0.014177952845525085
sim_physics_median0.013713852051765688
sim_physics_min0.011880922317504882
sim_render-ego_max0.0743225928275816
sim_render-ego_mean0.067416184372487
sim_render-ego_median0.07136282750538417
sim_render-ego_min0.05603849887847901
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0600000000000005
survival_time_min0.49999999999999994
No reset possible
177142529Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LF-sim-validationstep1-simulationabortednoInstance10:02:12
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible