Duckietown Challenges Home Challenges Submissions

Evaluator 690

ID690
evaluatoridsc-rudolf-5273
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-5273
versiond-c:4.0.16;d-c-r:4.0.22;d-s:4.0.16
first heard
last heard
statusinactive
# evaluating
# success1 17725
# timeout
# failed
# error1 17713
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
177252513Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-52730:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2448526305955765
survival_time_median1.0000000000000002
deviation-center-line_median0.02780956837444773
in-drivable-lane_median0.4500000000000001


other stats
agent_compute-ego_max0.1745742451060902
agent_compute-ego_mean0.1606410415096079
agent_compute-ego_median0.15621024019577923
agent_compute-ego_min0.15347459316253662
deviation-center-line_max0.1257230388091751
deviation-center-line_mean0.05577343615770758
deviation-center-line_min0.01951527185289407
deviation-heading_max0.5595345336423936
deviation-heading_mean0.32175424111925316
deviation-heading_median0.3074760381865353
deviation-heading_min0.16993642764665495
driven_any_max1.135775595781212
driven_any_mean0.7105521201006961
driven_any_median0.5457640496143795
driven_any_min0.3022738981004901
driven_lanedir_consec_max0.8171012478585276
driven_lanedir_consec_mean0.42515260445919045
driven_lanedir_consec_min0.164471242446655
driven_lanedir_max0.8171012478585276
driven_lanedir_mean0.4357084916634508
driven_lanedir_median0.2448526305955765
driven_lanedir_min0.164471242446655
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.38000000000000017
in-drivable-lane_min0.04999999999999999
per-episodes
details{"udem1-0-0": {"driven_any": 0.5457640496143795, "sim_physics": 0.0265034556388855, "survival_time": 1.0000000000000002, "driven_lanedir": 0.164471242446655, "sim_render-ego": 0.058061075210571286, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.16319881677627562, "deviation-heading": 0.18758204257854744, "set_robot_commands": 0.07358083724975586, "deviation-center-line": 0.01951527185289407, "driven_lanedir_consec": 0.164471242446655, "sim_compute_sim_state": 0.03180626630783081, "sim_compute_performance-ego": 0.05938920974731445, "sim_compute_robot_state-ego": 0.0594559907913208, "sim_compute_robot_state-npc0": 0.06176016330718994, "sim_compute_robot_state-npc1": 0.05857540369033813, "sim_compute_robot_state-npc2": 0.058703064918518066, "sim_compute_robot_state-npc3": 0.057883501052856445}, "udem1-1-0": {"driven_any": 0.5108934139126888, "sim_physics": 0.025116906446569102, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120319035776863, "sim_render-ego": 0.06702250592848834, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.15621024019577923, "deviation-heading": 0.3074760381865353, "set_robot_commands": 0.07763228696935318, "deviation-center-line": 0.02399913959382396, "driven_lanedir_consec": 0.1725821469418083, "sim_compute_sim_state": 0.03584560225991642, "sim_compute_performance-ego": 0.0662840955397662, "sim_compute_robot_state-ego": 0.06415522799772375, "sim_compute_robot_state-npc0": 0.07290988809922162, "sim_compute_robot_state-npc1": 0.06931826647590189, "sim_compute_robot_state-npc2": 0.06738936199861414, "sim_compute_robot_state-npc3": 0.06396589559667251}, "udem1-2-0": {"driven_any": 0.3022738981004901, "sim_physics": 0.03339641094207764, "survival_time": 0.49999999999999994, "driven_lanedir": 0.2448526305955765, "sim_render-ego": 0.06664421558380126, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.15347459316253662, "deviation-heading": 0.16993642764665495, "set_robot_commands": 0.074772310256958, "deviation-center-line": 0.02780956837444773, "driven_lanedir_consec": 0.2448526305955765, "sim_compute_sim_state": 0.03740968704223633, "sim_compute_performance-ego": 0.06530847549438476, "sim_compute_robot_state-ego": 0.06567344665527344, "sim_compute_robot_state-npc0": 0.07150394916534424, "sim_compute_robot_state-npc1": 0.06920888423919677, "sim_compute_robot_state-npc2": 0.07290987968444824, "sim_compute_robot_state-npc3": 0.06799879074096679}, "udem1-3-0": {"driven_any": 1.135775595781212, "sim_physics": 0.026743054389953613, "survival_time": 2.000000000000001, "driven_lanedir": 0.7709141470587263, "sim_render-ego": 0.06625162959098815, "in-drivable-lane": 0.6000000000000003, "agent_compute-ego": 0.15574731230735778, "deviation-heading": 0.3842421635421346, "set_robot_commands": 0.07837108373641968, "deviation-center-line": 0.08182016215819705, "driven_lanedir_consec": 0.7267557544533849, "sim_compute_sim_state": 0.036861580610275266, "sim_compute_performance-ego": 0.06360097527503968, "sim_compute_robot_state-ego": 0.06588000655174256, "sim_compute_robot_state-npc0": 0.06897886991500854, "sim_compute_robot_state-npc1": 0.06144158244132995, "sim_compute_robot_state-npc2": 0.06400299668312073, "sim_compute_robot_state-npc3": 0.0643235981464386}, "udem1-4-0": {"driven_any": 1.05805364309471, "sim_physics": 0.02730352228338068, "survival_time": 1.6500000000000008, "driven_lanedir": 0.8171012478585276, "sim_render-ego": 0.07456195715701941, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1745742451060902, "deviation-heading": 0.5595345336423936, "set_robot_commands": 0.08174464919350365, "deviation-center-line": 0.1257230388091751, "driven_lanedir_consec": 0.8171012478585276, "sim_compute_sim_state": 0.04193684549042673, "sim_compute_performance-ego": 0.0709497206138842, "sim_compute_robot_state-ego": 0.07164371374881628, "sim_compute_robot_state-npc0": 0.07829322236956972, "sim_compute_robot_state-npc1": 0.07503164175784949, "sim_compute_robot_state-npc2": 0.07462411215811064, "sim_compute_robot_state-npc3": 0.07528138160705566}}
set_robot_commands_max0.08174464919350365
set_robot_commands_mean0.07722023348119808
set_robot_commands_median0.07763228696935318
set_robot_commands_min0.07358083724975586
sim_compute_performance-ego_max0.0709497206138842
sim_compute_performance-ego_mean0.06510649533407786
sim_compute_performance-ego_median0.06530847549438476
sim_compute_performance-ego_min0.05938920974731445
sim_compute_robot_state-ego_max0.07164371374881628
sim_compute_robot_state-ego_mean0.06536167714897537
sim_compute_robot_state-ego_median0.06567344665527344
sim_compute_robot_state-ego_min0.0594559907913208
sim_compute_robot_state-npc0_max0.07829322236956972
sim_compute_robot_state-npc0_mean0.0706892185712668
sim_compute_robot_state-npc0_median0.07150394916534424
sim_compute_robot_state-npc0_min0.06176016330718994
sim_compute_robot_state-npc1_max0.07503164175784949
sim_compute_robot_state-npc1_mean0.06671515572092325
sim_compute_robot_state-npc1_median0.06920888423919677
sim_compute_robot_state-npc1_min0.05857540369033813
sim_compute_robot_state-npc2_max0.07462411215811064
sim_compute_robot_state-npc2_mean0.06752588308856236
sim_compute_robot_state-npc2_median0.06738936199861414
sim_compute_robot_state-npc2_min0.058703064918518066
sim_compute_robot_state-npc3_max0.07528138160705566
sim_compute_robot_state-npc3_mean0.065890633428798
sim_compute_robot_state-npc3_median0.0643235981464386
sim_compute_robot_state-npc3_min0.057883501052856445
sim_compute_sim_state_max0.04193684549042673
sim_compute_sim_state_mean0.03677199634213711
sim_compute_sim_state_median0.036861580610275266
sim_compute_sim_state_min0.03180626630783081
sim_physics_max0.03339641094207764
sim_physics_mean0.027812669940173305
sim_physics_median0.026743054389953613
sim_physics_min0.025116906446569102
sim_render-ego_max0.07456195715701941
sim_render-ego_mean0.0665082766941737
sim_render-ego_median0.06664421558380126
sim_render-ego_min0.058061075210571286
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.2000000000000004
survival_time_min0.49999999999999994
No reset possible
177132537Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-52730:02:12
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible