Duckietown Challenges Home Challenges Submissions

Evaluator 721

ID721
evaluatoridsc-rudolf-10292
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-10292
versiond-c:4.0.17;d-c-r:4.0.25;d-s:4.0.17
first heard
last heard
statusinactive
# evaluating
# success2 17750
# timeout1 17810
# failed
# error4 17767
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
178102471Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationtimeoutnoidsc-rudolf-102920:25:46
I can see how the jo [...]
I can see how the job 17810 is timeout because passed 1546 seconds and the timeout is 1200.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177892491Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-102920:11:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13191702483974377
survival_time_median1.5000000000000009
deviation-center-line_median0.01698500218179681
in-drivable-lane_median0.7500000000000003


other stats
agent_compute-ego_max0.28601667086283367
agent_compute-ego_mean0.2367318064901564
agent_compute-ego_median0.2355027198791504
agent_compute-ego_min0.19604749149746364
deviation-center-line_max0.7255272560835362
deviation-center-line_mean0.2620509018603136
deviation-center-line_min0.013244531841535833
deviation-heading_max5.464433385453119
deviation-heading_mean2.296896541547144
deviation-heading_median0.5422885831229769
deviation-heading_min0.26804861195406005
driven_any_max3.904375209873649
driven_any_mean1.6912120210378447
driven_any_median0.3815939614036788
driven_any_min0.1447007154952868
driven_lanedir_consec_max1.261875664540606
driven_lanedir_consec_mean0.49325877641878246
driven_lanedir_consec_min0.05719861091488277
driven_lanedir_max1.261875664540606
driven_lanedir_mean0.49325877641878246
driven_lanedir_median0.13191702483974377
driven_lanedir_min0.05719861091488277
in-drivable-lane_max8.700000000000053
in-drivable-lane_mean3.5200000000000173
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14916659770129187, "sim_physics": 0.012498431735568576, "survival_time": 0.45, "driven_lanedir": 0.06361349749287637, "sim_render-ego": 0.05613011784023709, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.19604749149746364, "deviation-heading": 0.26804861195406005, "set_robot_commands": 0.07455068164401585, "deviation-center-line": 0.015132351350257, "driven_lanedir_consec": 0.06361349749287637, "sim_compute_sim_state": 0.03858478864034017, "sim_compute_performance-ego": 0.055882665846082896, "sim_compute_robot_state-ego": 0.05882125430636936}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3815939614036788, "sim_physics": 0.013045485814412434, "survival_time": 1.5000000000000009, "driven_lanedir": 0.13191702483974377, "sim_render-ego": 0.05477661291758219, "in-drivable-lane": 0.7500000000000003, "agent_compute-ego": 0.28601667086283367, "deviation-heading": 0.5422885831229769, "set_robot_commands": 0.07296191056569418, "deviation-center-line": 0.01698500218179681, "driven_lanedir_consec": 0.13191702483974377, "sim_compute_sim_state": 0.03638777732849121, "sim_compute_performance-ego": 0.05724594593048096, "sim_compute_robot_state-ego": 0.0639383872350057}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.904375209873649, "sim_physics": 0.012110771338144938, "survival_time": 14.950000000000076, "driven_lanedir": 0.9516890843058036, "sim_render-ego": 0.0594208288192749, "in-drivable-lane": 8.700000000000053, "agent_compute-ego": 0.23046093861262004, "deviation-heading": 4.940004911693939, "set_robot_commands": 0.0747700039545695, "deviation-center-line": 0.5393653678444421, "driven_lanedir_consec": 0.9516890843058036, "sim_compute_sim_state": 0.03699468453725179, "sim_compute_performance-ego": 0.06101818323135376, "sim_compute_robot_state-ego": 0.06335805972417195}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1447007154952868, "sim_physics": 0.013558758629692923, "survival_time": 0.45, "driven_lanedir": 0.05719861091488277, "sim_render-ego": 0.05656615893046061, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.2355027198791504, "deviation-heading": 0.2697072155116236, "set_robot_commands": 0.07153693834940593, "deviation-center-line": 0.013244531841535833, "driven_lanedir_consec": 0.05719861091488277, "sim_compute_sim_state": 0.03721904754638672, "sim_compute_performance-ego": 0.06096349822150336, "sim_compute_robot_state-ego": 0.060198969311184354}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.876223620715318, "sim_physics": 0.012850988705952962, "survival_time": 14.950000000000076, "driven_lanedir": 1.261875664540606, "sim_render-ego": 0.06344454367955525, "in-drivable-lane": 7.950000000000035, "agent_compute-ego": 0.2356312115987142, "deviation-heading": 5.464433385453119, "set_robot_commands": 0.0756415589650472, "deviation-center-line": 0.7255272560835362, "driven_lanedir_consec": 1.261875664540606, "sim_compute_sim_state": 0.038444900512695314, "sim_compute_performance-ego": 0.06380800803502401, "sim_compute_robot_state-ego": 0.06367817322413126}}
set_robot_commands_max0.0756415589650472
set_robot_commands_mean0.07389221869574654
set_robot_commands_median0.07455068164401585
set_robot_commands_min0.07153693834940593
sim_compute_performance-ego_max0.06380800803502401
sim_compute_performance-ego_mean0.05978366025288901
sim_compute_performance-ego_median0.06096349822150336
sim_compute_performance-ego_min0.055882665846082896
sim_compute_robot_state-ego_max0.0639383872350057
sim_compute_robot_state-ego_mean0.06199896876017253
sim_compute_robot_state-ego_median0.06335805972417195
sim_compute_robot_state-ego_min0.05882125430636936
sim_compute_sim_state_max0.03858478864034017
sim_compute_sim_state_mean0.03752623971303304
sim_compute_sim_state_median0.03721904754638672
sim_compute_sim_state_min0.03638777732849121
sim_physics_max0.013558758629692923
sim_physics_mean0.012812887244754368
sim_physics_median0.012850988705952962
sim_physics_min0.012110771338144938
sim_render-ego_max0.06344454367955525
sim_render-ego_mean0.05806765243742201
sim_render-ego_median0.05656615893046061
sim_render-ego_min0.05477661291758219
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.460000000000031
survival_time_min0.45
No reset possible
177832507Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-102920:00:37
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177762538Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-102920:00:37
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177712511Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-102920:00:38
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177672537Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-102920:00:38
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
177502492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-102920:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07290936395204684
survival_time_median0.49999999999999994
deviation-center-line_median0.015678790019499088
in-drivable-lane_median0.14999999999999997


other stats
agent_compute-ego_max0.24599783420562743
agent_compute-ego_mean0.17798296276625095
agent_compute-ego_median0.16196621548045764
agent_compute-ego_min0.14258214831352234
deviation-center-line_max0.017718593255997013
deviation-center-line_mean0.012928426372865847
deviation-center-line_min0.004933969838268843
deviation-heading_max0.28073208735269645
deviation-heading_mean0.23365864861646993
deviation-heading_median0.268589904093567
deviation-heading_min0.15250368920319213
driven_any_max0.1905236140947372
driven_any_mean0.1607669595340293
driven_any_median0.1542030873610846
driven_any_min0.13756992504662127
driven_lanedir_consec_max0.09144663791241658
driven_lanedir_consec_mean0.07119411373399767
driven_lanedir_consec_min0.04662598394139361
driven_lanedir_max0.09144663791241658
driven_lanedir_mean0.07119411373399767
driven_lanedir_median0.07290936395204684
driven_lanedir_min0.04662598394139361
in-drivable-lane_max0.24999999999999992
in-drivable-lane_mean0.12999999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1542030873610846, "sim_physics": 0.013134866952896118, "survival_time": 0.4, "driven_lanedir": 0.07290936395204684, "sim_render-ego": 0.04721623659133911, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.14258214831352234, "deviation-heading": 0.19526581282672636, "set_robot_commands": 0.06734910607337952, "deviation-center-line": 0.008745513086168987, "driven_lanedir_consec": 0.07290936395204684, "sim_compute_sim_state": 0.03330394625663757, "sim_compute_performance-ego": 0.04882878065109253, "sim_compute_robot_state-ego": 0.05083805322647095}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15148544119929036, "sim_physics": 0.012413382530212402, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04662598394139361, "sim_render-ego": 0.060921740531921384, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.17821502685546875, "deviation-heading": 0.15250368920319213, "set_robot_commands": 0.07563886642456055, "deviation-center-line": 0.004933969838268843, "driven_lanedir_consec": 0.04662598394139361, "sim_compute_sim_state": 0.038210487365722655, "sim_compute_performance-ego": 0.05901007652282715, "sim_compute_robot_state-ego": 0.06189916133880615}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13756992504662127, "sim_physics": 0.014210326331002372, "survival_time": 0.35, "driven_lanedir": 0.07447540938600161, "sim_render-ego": 0.058519227164132256, "in-drivable-lane": 0, "agent_compute-ego": 0.16115358897617885, "deviation-heading": 0.268589904093567, "set_robot_commands": 0.08157736914498466, "deviation-center-line": 0.017718593255997013, "driven_lanedir_consec": 0.07447540938600161, "sim_compute_sim_state": 0.03724898610796247, "sim_compute_performance-ego": 0.06448500497000557, "sim_compute_robot_state-ego": 0.06724367822919573}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1905236140947372, "sim_physics": 0.013966191898692738, "survival_time": 0.5499999999999999, "driven_lanedir": 0.09144663791241658, "sim_render-ego": 0.05884799090298739, "in-drivable-lane": 0.14999999999999997, "agent_compute-ego": 0.16196621548045764, "deviation-heading": 0.28073208735269645, "set_robot_commands": 0.07376766204833984, "deviation-center-line": 0.01756526566439531, "driven_lanedir_consec": 0.09144663791241658, "sim_compute_sim_state": 0.03506068749861284, "sim_compute_performance-ego": 0.05575559355995872, "sim_compute_robot_state-ego": 0.06085857478055087}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17005272996841309, "sim_physics": 0.014673995971679689, "survival_time": 0.49999999999999994, "driven_lanedir": 0.07051317347812969, "sim_render-ego": 0.05978360176086426, "in-drivable-lane": 0.14999999999999997, "agent_compute-ego": 0.24599783420562743, "deviation-heading": 0.2712017496061676, "set_robot_commands": 0.071773362159729, "deviation-center-line": 0.015678790019499088, "driven_lanedir_consec": 0.07051317347812969, "sim_compute_sim_state": 0.04062278270721435, "sim_compute_performance-ego": 0.06487312316894531, "sim_compute_robot_state-ego": 0.06451098918914795}}
set_robot_commands_max0.08157736914498466
set_robot_commands_mean0.07402127317019871
set_robot_commands_median0.07376766204833984
set_robot_commands_min0.06734910607337952
sim_compute_performance-ego_max0.06487312316894531
sim_compute_performance-ego_mean0.05859051577456585
sim_compute_performance-ego_median0.05901007652282715
sim_compute_performance-ego_min0.04882878065109253
sim_compute_robot_state-ego_max0.06724367822919573
sim_compute_robot_state-ego_mean0.06107009135283433
sim_compute_robot_state-ego_median0.06189916133880615
sim_compute_robot_state-ego_min0.05083805322647095
sim_compute_sim_state_max0.04062278270721435
sim_compute_sim_state_mean0.03688937798722998
sim_compute_sim_state_median0.03724898610796247
sim_compute_sim_state_min0.03330394625663757
sim_physics_max0.014673995971679689
sim_physics_mean0.013679752736896663
sim_physics_median0.013966191898692738
sim_physics_min0.012413382530212402
sim_render-ego_max0.060921740531921384
sim_render-ego_mean0.05705775939024889
sim_render-ego_median0.05884799090298739
sim_render-ego_min0.04721623659133911
simulation-passed1
survival_time_max0.5499999999999999
survival_time_mean0.46
survival_time_min0.35
No reset possible