Duckietown Challenges Home Challenges Submissions

Evaluator 1465

ID1465
evaluatorp-2747
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processp-2747
versiond-c:4.0.30;d-c-r:4.0.47;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success4 23807
# timeout
# failed
# error2 23942
# aborted3 23773
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
239873786Andrés Calderón 🇨🇴challenge-aido_LF-template-randomaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesp-27470:07:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1440129620688302
agent_compute-ego_mean0.1387782490508609
agent_compute-ego_median0.1373949889783506
agent_compute-ego_min0.13690314111830312
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.09956055217319064, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05936376695279722, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1373949889783506, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.07535355179398148, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0335334406958686, "sim_compute_performance-ego": 0.0607633458243476, "sim_compute_robot_state-ego": 0.061774607057924626, "sim_compute_robot_state-npc0": 0.07018302546607123, "sim_compute_robot_state-npc1": 0.0653378963470459, "sim_compute_robot_state-npc2": 0.064093342533818, "sim_compute_robot_state-npc3": 0.06097750310544615}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.10900340080261232, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.05598312377929687, "in-drivable-lane": 0, "agent_compute-ego": 0.137391881942749, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.0744699478149414, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.036470155715942386, "sim_compute_performance-ego": 0.0599599552154541, "sim_compute_robot_state-ego": 0.05812923431396484, "sim_compute_robot_state-npc0": 0.06956705093383789, "sim_compute_robot_state-npc1": 0.06165043830871582, "sim_compute_robot_state-npc2": 0.06149115562438965, "sim_compute_robot_state-npc3": 0.06205124855041504}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.10469976224397358, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06068538050902517, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.13818827114607157, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.07546393181148328, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.035429800811566804, "sim_compute_performance-ego": 0.06061732769012451, "sim_compute_robot_state-ego": 0.06467544718792564, "sim_compute_robot_state-npc0": 0.07082632340882954, "sim_compute_robot_state-npc1": 0.06360301532243427, "sim_compute_robot_state-npc2": 0.0601205543467873, "sim_compute_robot_state-npc3": 0.06088889272589432}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1140564483932302, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05631347245807889, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.13690314111830312, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.07733726501464844, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03475034689601464, "sim_compute_performance-ego": 0.06095402452010143, "sim_compute_robot_state-ego": 0.06415284736247003, "sim_compute_robot_state-npc0": 0.06914590883858596, "sim_compute_robot_state-npc1": 0.062209657475918154, "sim_compute_robot_state-npc2": 0.0616027343122265, "sim_compute_robot_state-npc3": 0.0601346492767334}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1377842596599034, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06264290639332362, "in-drivable-lane": 0, "agent_compute-ego": 0.1440129620688302, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08424878971917289, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03626590967178345, "sim_compute_performance-ego": 0.06600916385650635, "sim_compute_robot_state-ego": 0.06621365036283221, "sim_compute_robot_state-npc0": 0.06631555727549962, "sim_compute_robot_state-npc1": 0.06545015743800572, "sim_compute_robot_state-npc2": 0.06440103054046631, "sim_compute_robot_state-npc3": 0.0633103506905692}}
set_robot_commands_max0.08424878971917289
set_robot_commands_mean0.0773746972308455
set_robot_commands_median0.07546393181148328
set_robot_commands_min0.0744699478149414
sim_compute_performance-ego_max0.06600916385650635
sim_compute_performance-ego_mean0.061660763421306795
sim_compute_performance-ego_median0.0607633458243476
sim_compute_performance-ego_min0.0599599552154541
sim_compute_robot_state-ego_max0.06621365036283221
sim_compute_robot_state-ego_mean0.06298915725702348
sim_compute_robot_state-ego_median0.06415284736247003
sim_compute_robot_state-ego_min0.05812923431396484
sim_compute_robot_state-npc0_max0.07082632340882954
sim_compute_robot_state-npc0_mean0.06920757318456486
sim_compute_robot_state-npc0_median0.06956705093383789
sim_compute_robot_state-npc0_min0.06631555727549962
sim_compute_robot_state-npc1_max0.06545015743800572
sim_compute_robot_state-npc1_mean0.06365023297842398
sim_compute_robot_state-npc1_median0.06360301532243427
sim_compute_robot_state-npc1_min0.06165043830871582
sim_compute_robot_state-npc2_max0.06440103054046631
sim_compute_robot_state-npc2_mean0.06234176347153756
sim_compute_robot_state-npc2_median0.0616027343122265
sim_compute_robot_state-npc2_min0.0601205543467873
sim_compute_robot_state-npc3_max0.0633103506905692
sim_compute_robot_state-npc3_mean0.061472528869811624
sim_compute_robot_state-npc3_median0.06097750310544615
sim_compute_robot_state-npc3_min0.0601346492767334
sim_compute_sim_state_max0.036470155715942386
sim_compute_sim_state_mean0.03528993075823517
sim_compute_sim_state_median0.035429800811566804
sim_compute_sim_state_min0.0335334406958686
sim_physics_max0.1377842596599034
sim_physics_mean0.11302088465458202
sim_physics_median0.10900340080261232
sim_physics_min0.09956055217319064
sim_render-ego_max0.06264290639332362
sim_render-ego_mean0.05899773001850435
sim_render-ego_median0.05936376695279722
sim_render-ego_min0.05598312377929687
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
239723761Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-real-validationeval1-videos-watchtowerserroryesp-27473:00:32
Waited 10801 seconds [...]
Waited 10801 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239693761Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-real-validationeval1-videos-autobotssuccessyesp-27470:16:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239423774Anastasiya Nikolskaya 🇷🇺Offset-based Oneaido2-LF-real-validationeval0-videos-watchtowerserroryesp-27473:00:31
Waited 10801 seconds [...]
Waited 10801 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239053758Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-real-validationeval0-videos-watchtowerssuccessyesp-27472:05:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
238223769Anastasiya Nikolskaya 🇷🇺Boxed Solution 0.3aido2-LFV-real-validationeval0-videos-watchtowersabortedyesp-27473:00:27
Waited 10800 seconds [...]
Waited 10800 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
238073769Anastasiya Nikolskaya 🇷🇺Boxed Solution 0.3aido2-LFV-real-validationeval0-videos-autobotssuccessyesp-27470:18:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237933773Anastasiya Nikolskaya 🇷🇺Fine-tuned netaido2-LFVI-real-validationeval0-videos-autobotsabortedyesp-27473:00:31
Waited 10804 seconds [...]
Waited 10804 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237733767Anastasiya Nikolskaya 🇷🇺Boxed Solution 0.2aido2-LFVI-real-validationeval0-videos-autobotsabortedyesp-27473:00:57
Waited 10804 seconds [...]
Waited 10804 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible