Duckietown Challenges Home Challenges Submissions

Evaluator 1571

ID1571
evaluatoridsc-rudolf-23126
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-23126
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success2 24262
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
242654125Andrea Censi 🇨🇭rotationaido3-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-231260:52:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.0014713911579301575
survival_time_median14.950000000000076
deviation-center-line_median0.3550429130563084
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.15530245542526244
agent_compute-ego_mean0.1536648703681098
agent_compute-ego_median0.1539902353286743
agent_compute-ego_min0.1489858388900757
deviation-center-line_max0.6007136359417561
deviation-center-line_mean0.3394558693803663
deviation-center-line_min0.017558302483544185
deviation-heading_max5.876680788839771
deviation-heading_mean5.668498743453998
deviation-heading_median5.709677935349317
deviation-heading_min5.445457843647878
driven_any_max0.026478672834056367
driven_any_mean0.02338944237901273
driven_any_median0.023285267728313904
driven_any_min0.0197794984093383
driven_lanedir_consec_max0.0021599934447711355
driven_lanedir_consec_mean-0.0011081890688229216
driven_lanedir_consec_min-0.004544743757038283
driven_lanedir_max0.0021599934447711355
driven_lanedir_mean-0.0011081890688229216
driven_lanedir_median-0.0014713911579301575
driven_lanedir_min-0.004544743757038283
in-drivable-lane_max7.700000000000042
in-drivable-lane_mean7.596666666666709
in-drivable-lane_min7.500000000000043
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834056367, "sim_physics": 0.06328751166661581, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.06634373744328817, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.15438468217849732, "deviation-heading": 5.657649106857695, "set_robot_commands": 0.07979588349660238, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.0439460301399231, "sim_compute_performance-ego": 0.06840981562932333, "sim_compute_robot_state-ego": 0.06692718744277953}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.02593019554121306, "sim_physics": 0.06215843836466471, "survival_time": 14.950000000000076, "driven_lanedir": -0.003361806018059577, "sim_render-ego": 0.0663268256187439, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.15398761987686158, "deviation-heading": 5.445457843647878, "set_robot_commands": 0.0802239982287089, "deviation-center-line": 0.13860669343031343, "driven_lanedir_consec": -0.003361806018059577, "sim_compute_sim_state": 0.04306969006856282, "sim_compute_performance-ego": 0.06901517709096273, "sim_compute_robot_state-ego": 0.06746103207270304}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672438047, "sim_physics": 0.06206013123194377, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021181059556472093, "sim_render-ego": 0.0648059352238973, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.15232099771499633, "deviation-heading": 5.876680788839771, "set_robot_commands": 0.07752265930175781, "deviation-center-line": 0.4784517475259532, "driven_lanedir_consec": 0.0021181059556472093, "sim_compute_sim_state": 0.04364782810211182, "sim_compute_performance-ego": 0.06729976733525594, "sim_compute_robot_state-ego": 0.06623500982920329}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661374756, "sim_physics": 0.0644118603070577, "survival_time": 14.950000000000076, "driven_lanedir": -0.002690854798440334, "sim_render-ego": 0.06555468400319417, "in-drivable-lane": 7.700000000000042, "agent_compute-ego": 0.15523473501205445, "deviation-heading": 5.721005148732661, "set_robot_commands": 0.07953610897064209, "deviation-center-line": 0.44901648578509457, "driven_lanedir_consec": -0.002690854798440334, "sim_compute_sim_state": 0.04365025281906128, "sim_compute_performance-ego": 0.0695761243502299, "sim_compute_robot_state-ego": 0.06861776351928711}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.025942472252175396, "sim_physics": 0.06355425834655762, "survival_time": 14.950000000000076, "driven_lanedir": -0.0005547867508171045, "sim_render-ego": 0.0668791659673055, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.15379367669423422, "deviation-heading": 5.453097843541612, "set_robot_commands": 0.07987092971801758, "deviation-center-line": 0.28665447981951625, "driven_lanedir_consec": -0.0005547867508171045, "sim_compute_sim_state": 0.04337929169336955, "sim_compute_performance-ego": 0.06862497806549073, "sim_compute_robot_state-ego": 0.06657718181610107}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.026249880775217276, "sim_physics": 0.06339315255482991, "survival_time": 14.950000000000076, "driven_lanedir": -0.0017675599932500674, "sim_render-ego": 0.06750413656234741, "in-drivable-lane": 7.650000000000041, "agent_compute-ego": 0.15481612602869668, "deviation-heading": 5.813994332249986, "set_robot_commands": 0.07836196660995483, "deviation-center-line": 0.6007136359417561, "driven_lanedir_consec": -0.0017675599932500674, "sim_compute_sim_state": 0.04388678232828776, "sim_compute_performance-ego": 0.06952503124872843, "sim_compute_robot_state-ego": 0.06625304698944091}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.023285267728313904, "sim_physics": 0.06336154619852702, "survival_time": 14.950000000000076, "driven_lanedir": -0.00391925832851836, "sim_render-ego": 0.06649650494257608, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.15526344776153564, "deviation-heading": 5.466476436400955, "set_robot_commands": 0.07810294071833293, "deviation-center-line": 0.3550429130563084, "driven_lanedir_consec": -0.00391925832851836, "sim_compute_sim_state": 0.04367817163467407, "sim_compute_performance-ego": 0.06918798367182413, "sim_compute_robot_state-ego": 0.06624686320622762}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.023561644755163248, "sim_physics": 0.06063908974329631, "survival_time": 14.950000000000076, "driven_lanedir": 0.002049277100081514, "sim_render-ego": 0.06377577940622965, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.1539902353286743, "deviation-heading": 5.854958069383543, "set_robot_commands": 0.07937946637471517, "deviation-center-line": 0.41169203827872664, "driven_lanedir_consec": 0.002049277100081514, "sim_compute_sim_state": 0.042297062079111734, "sim_compute_performance-ego": 0.06724754889806112, "sim_compute_robot_state-ego": 0.06456191301345825}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.02419197298360903, "sim_physics": 0.060309227307637533, "survival_time": 14.950000000000076, "driven_lanedir": 0.0002979654230168549, "sim_render-ego": 0.06628595908482869, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.15530245542526244, "deviation-heading": 5.709677935349317, "set_robot_commands": 0.0800510851542155, "deviation-center-line": 0.017558302483544185, "driven_lanedir_consec": 0.0002979654230168549, "sim_compute_sim_state": 0.04255184809366862, "sim_compute_performance-ego": 0.06943958600362142, "sim_compute_robot_state-ego": 0.06499128580093384}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.021258166206925968, "sim_physics": 0.05930630604426066, "survival_time": 14.950000000000076, "driven_lanedir": -4.181733071773053e-05, "sim_render-ego": 0.06281275113423665, "in-drivable-lane": 7.500000000000043, "agent_compute-ego": 0.1489858388900757, "deviation-heading": 5.783324089492346, "set_robot_commands": 0.07798081477483114, "deviation-center-line": 0.2514968415228165, "driven_lanedir_consec": -4.181733071773053e-05, "sim_compute_sim_state": 0.04054956833521525, "sim_compute_performance-ego": 0.06528804937998454, "sim_compute_robot_state-ego": 0.06227096080780029}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.021434292120195386, "sim_physics": 0.058026281197865806, "survival_time": 14.950000000000076, "driven_lanedir": 0.000713963463023104, "sim_render-ego": 0.06503580172856649, "in-drivable-lane": 7.600000000000045, "agent_compute-ego": 0.15218138297398884, "deviation-heading": 5.526728061201507, "set_robot_commands": 0.07942506710688273, "deviation-center-line": 0.46282395191752784, "driven_lanedir_consec": 0.000713963463023104, "sim_compute_sim_state": 0.04189381996790568, "sim_compute_performance-ego": 0.06658447821935018, "sim_compute_robot_state-ego": 0.06227092027664185}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.0197794984093383, "sim_physics": 0.056707510948181154, "survival_time": 14.950000000000076, "driven_lanedir": -0.0014713911579301575, "sim_render-ego": 0.06351203838984172, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.15335987170537313, "deviation-heading": 5.8066732640248135, "set_robot_commands": 0.07767504692077637, "deviation-center-line": 0.16800033110632376, "driven_lanedir_consec": -0.0014713911579301575, "sim_compute_sim_state": 0.04117744445800781, "sim_compute_performance-ego": 0.06504496335983276, "sim_compute_robot_state-ego": 0.06076296806335449}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.020981564902326583, "sim_physics": 0.05924777905146281, "survival_time": 14.950000000000076, "driven_lanedir": -0.001808663823426926, "sim_render-ego": 0.06651751518249512, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15427648067474364, "deviation-heading": 5.5154737798413205, "set_robot_commands": 0.07929592291514079, "deviation-center-line": 0.3169911817232478, "driven_lanedir_consec": -0.001808663823426926, "sim_compute_sim_state": 0.043365108966827395, "sim_compute_performance-ego": 0.06745627403259277, "sim_compute_robot_state-ego": 0.06404088258743286}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.022551048035819046, "sim_physics": 0.0577426274617513, "survival_time": 14.950000000000076, "driven_lanedir": -0.004544743757038283, "sim_render-ego": 0.0628503942489624, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.15412769397099813, "deviation-heading": 5.790764092245773, "set_robot_commands": 0.07923656463623047, "deviation-center-line": 0.03881032426772201, "driven_lanedir_consec": -0.004544743757038283, "sim_compute_sim_state": 0.040366671085357665, "sim_compute_performance-ego": 0.06563508907953898, "sim_compute_robot_state-ego": 0.06197880427042643}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.023227101807024583, "sim_physics": 0.05755729913711548, "survival_time": 14.950000000000076, "driven_lanedir": -0.0038012594606851025, "sim_render-ego": 0.06591565052668254, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.1529478112856547, "deviation-heading": 5.605520360000814, "set_robot_commands": 0.07865493535995484, "deviation-center-line": 0.5549657935250676, "driven_lanedir_consec": -0.0038012594606851025, "sim_compute_sim_state": 0.04191742658615112, "sim_compute_performance-ego": 0.06749451955159505, "sim_compute_robot_state-ego": 0.0626363762219747}}
set_robot_commands_max0.0802239982287089
set_robot_commands_mean0.0790075593524509
set_robot_commands_median0.07929592291514079
set_robot_commands_min0.07752265930175781
sim_compute_performance-ego_max0.0695761243502299
sim_compute_performance-ego_mean0.06772195906109282
sim_compute_performance-ego_median0.06749451955159505
sim_compute_performance-ego_min0.06504496335983276
sim_compute_robot_state-ego_max0.06861776351928711
sim_compute_robot_state-ego_mean0.06478881306118435
sim_compute_robot_state-ego_median0.06499128580093384
sim_compute_robot_state-ego_min0.06076296806335449
sim_compute_sim_state_max0.0439460301399231
sim_compute_sim_state_mean0.04262513309054905
sim_compute_sim_state_median0.04306969006856282
sim_compute_sim_state_min0.040366671085357665
sim_physics_max0.0644118603070577
sim_physics_mean0.060784201304117845
sim_physics_median0.06063908974329631
sim_physics_min0.056707510948181154
sim_render-ego_max0.06750413656234741
sim_render-ego_mean0.06537445863087973
sim_render-ego_median0.06591565052668254
sim_render-ego_min0.06281275113423665
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
242624128Andrea Censi 🇨🇭rotationaido3-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-231260:28:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0003144622101045602
survival_time_median14.950000000000076
deviation-center-line_median0.489104853041521
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.1562151026725769
agent_compute-ego_mean0.15574077081680296
agent_compute-ego_median0.15581998825073243
agent_compute-ego_min0.1549456016222636
deviation-center-line_max0.6113242374220981
deviation-center-line_mean0.422546032853888
deviation-center-line_min0.020737127615471695
deviation-heading_max5.830135897709593
deviation-heading_mean5.684570550707688
deviation-heading_median5.657649106857695
deviation-heading_min5.536662996854866
driven_any_max0.026478672834056367
driven_any_mean0.024864239592254977
driven_any_median0.025930195541215405
driven_any_min0.022165452661382225
driven_lanedir_consec_max0.0021599934447711355
driven_lanedir_consec_mean-0.00048592825605582314
driven_lanedir_consec_min-0.003645956811333395
driven_lanedir_max0.0021599934447711355
driven_lanedir_mean-0.00048592825605582314
driven_lanedir_median0.0003144622101045602
driven_lanedir_min-0.003645956811333395
in-drivable-lane_max7.650000000000043
in-drivable-lane_mean7.600000000000042
in-drivable-lane_min7.550000000000044
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834056367, "sim_physics": 0.1058502451578776, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.06771411816279094, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.1555706763267517, "deviation-heading": 5.657649106857695, "set_robot_commands": 0.08063910722732544, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.04037964900334677, "sim_compute_performance-ego": 0.06949366966883341, "sim_compute_robot_state-ego": 0.06407558520634969, "sim_compute_robot_state-npc0": 0.07508555809656779, "sim_compute_robot_state-npc1": 0.07171164115269979, "sim_compute_robot_state-npc2": 0.07104880491892497, "sim_compute_robot_state-npc3": 0.07091373523076375}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025930195541215405, "sim_physics": 0.10431272427241008, "survival_time": 14.950000000000076, "driven_lanedir": -0.003645956811333395, "sim_render-ego": 0.06745347658793131, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15615248521169026, "deviation-heading": 5.795316370396737, "set_robot_commands": 0.0813184380531311, "deviation-center-line": 0.6113242374220981, "driven_lanedir_consec": -0.003645956811333395, "sim_compute_sim_state": 0.04136717557907105, "sim_compute_performance-ego": 0.06902496894200642, "sim_compute_robot_state-ego": 0.06372738679250081, "sim_compute_robot_state-npc0": 0.07655418395996094, "sim_compute_robot_state-npc1": 0.07320612827936808, "sim_compute_robot_state-npc2": 0.07182053248087565, "sim_compute_robot_state-npc3": 0.071808709303538}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672440337, "sim_physics": 0.10284298499425253, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017527010091673567, "sim_render-ego": 0.06732421159744263, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.15581998825073243, "deviation-heading": 5.6030883817195525, "set_robot_commands": 0.07880007743835449, "deviation-center-line": 0.489104853041521, "driven_lanedir_consec": 0.0017527010091673567, "sim_compute_sim_state": 0.04015664498011271, "sim_compute_performance-ego": 0.06769041299819946, "sim_compute_robot_state-ego": 0.06222387790679931, "sim_compute_robot_state-npc0": 0.07393586238225301, "sim_compute_robot_state-npc1": 0.07051185687383016, "sim_compute_robot_state-npc2": 0.07075055042902628, "sim_compute_robot_state-npc3": 0.07068170547485352}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661382225, "sim_physics": 0.10345732927322387, "survival_time": 14.950000000000076, "driven_lanedir": -0.003010841132988773, "sim_render-ego": 0.0668676495552063, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.1549456016222636, "deviation-heading": 5.536662996854866, "set_robot_commands": 0.07843338092168173, "deviation-center-line": 0.4305506258687733, "driven_lanedir_consec": -0.003010841132988773, "sim_compute_sim_state": 0.0414661431312561, "sim_compute_performance-ego": 0.06817951122919719, "sim_compute_robot_state-ego": 0.06208506981531779, "sim_compute_robot_state-npc0": 0.07560099999109904, "sim_compute_robot_state-npc1": 0.07278646230697632, "sim_compute_robot_state-npc2": 0.07225055615107219, "sim_compute_robot_state-npc3": 0.0735692040125529}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.02594247225218054, "sim_physics": 0.09881088018417358, "survival_time": 14.950000000000076, "driven_lanedir": 0.0003144622101045602, "sim_render-ego": 0.0649801238377889, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.1562151026725769, "deviation-heading": 5.830135897709593, "set_robot_commands": 0.0780871868133545, "deviation-center-line": 0.020737127615471695, "driven_lanedir_consec": 0.0003144622101045602, "sim_compute_sim_state": 0.039624082247416176, "sim_compute_performance-ego": 0.06664757092793783, "sim_compute_robot_state-ego": 0.06297576904296875, "sim_compute_robot_state-npc0": 0.072662885983785, "sim_compute_robot_state-npc1": 0.06964182217915853, "sim_compute_robot_state-npc2": 0.07009018262227376, "sim_compute_robot_state-npc3": 0.06888938426971436}}
set_robot_commands_max0.0813184380531311
set_robot_commands_mean0.07945563809076946
set_robot_commands_median0.07880007743835449
set_robot_commands_min0.0780871868133545
sim_compute_performance-ego_max0.06949366966883341
sim_compute_performance-ego_mean0.06820722675323486
sim_compute_performance-ego_median0.06817951122919719
sim_compute_performance-ego_min0.06664757092793783
sim_compute_robot_state-ego_max0.06407558520634969
sim_compute_robot_state-ego_mean0.06301753775278726
sim_compute_robot_state-ego_median0.06297576904296875
sim_compute_robot_state-ego_min0.06208506981531779
sim_compute_robot_state-npc0_max0.07655418395996094
sim_compute_robot_state-npc0_mean0.07476789808273317
sim_compute_robot_state-npc0_median0.07508555809656779
sim_compute_robot_state-npc0_min0.072662885983785
sim_compute_robot_state-npc1_max0.07320612827936808
sim_compute_robot_state-npc1_mean0.07157158215840657
sim_compute_robot_state-npc1_median0.07171164115269979
sim_compute_robot_state-npc1_min0.06964182217915853
sim_compute_robot_state-npc2_max0.07225055615107219
sim_compute_robot_state-npc2_mean0.07119212532043458
sim_compute_robot_state-npc2_median0.07104880491892497
sim_compute_robot_state-npc2_min0.07009018262227376
sim_compute_robot_state-npc3_max0.0735692040125529
sim_compute_robot_state-npc3_mean0.0711725476582845
sim_compute_robot_state-npc3_median0.07091373523076375
sim_compute_robot_state-npc3_min0.06888938426971436
sim_compute_sim_state_max0.0414661431312561
sim_compute_sim_state_mean0.040598738988240554
sim_compute_sim_state_median0.04037964900334677
sim_compute_sim_state_min0.039624082247416176
sim_physics_max0.1058502451578776
sim_physics_mean0.10305483277638754
sim_physics_median0.10345732927322387
sim_physics_min0.09881088018417358
sim_render-ego_max0.06771411816279094
sim_render-ego_mean0.06686791594823202
sim_render-ego_median0.06732421159744263
sim_render-ego_min0.0649801238377889
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible