Duckietown Challenges Home Challenges Submissions

Evaluator 1578

ID1578
evaluatorip-172-31-35-218-10491
ownerI don't have one 😀
machineip-172-31-35-218
processip-172-31-35-218-10491
versiond-c:5.0.7;d-c-r:5.0.10;d-s:5.0.3
first heard
last heard
statusinactive
# evaluating
# success30 24487
# timeout
# failed5 24360
# error19 24346
# aborted1 24780
# host-error5 24647
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
251314396András Kalaposexp2217aido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:06:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.96402943056696
survival_time_median8.199999999999982
deviation-center-line_median0.40884227625640424
in-drivable-lane_median0.8999999999999992


other stats
agent_compute-ego_max0.0241066624478596
agent_compute-ego_mean0.02370951071844762
agent_compute-ego_median0.02376268126747825
agent_compute-ego_min0.023304226351719276
deviation-center-line_max0.8016027884613596
deviation-center-line_mean0.4426082597122091
deviation-center-line_min0.11387337689118215
deviation-heading_max4.348700758353462
deviation-heading_mean2.1605366279730216
deviation-heading_median2.1472627277145953
deviation-heading_min0.4653347402174019
driven_any_max5.506521859741974
driven_any_mean2.9004855687050264
driven_any_median3.046841819046561
driven_any_min0.49095053686880347
driven_lanedir_consec_max4.909115309232991
driven_lanedir_consec_mean2.330071930152753
driven_lanedir_consec_min0.46338607771909546
driven_lanedir_max4.909115309232991
driven_lanedir_mean2.330071930152753
driven_lanedir_median1.96402943056696
driven_lanedir_min0.46338607771909546
in-drivable-lane_max2.099999999999995
in-drivable-lane_mean1.0100000000000031
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.652424130024583, "sim_physics": 0.056274647640092726, "survival_time": 9.850000000000003, "driven_lanedir": 2.972210652195905, "sim_render-ego": 0.007066333354427125, "in-drivable-lane": 1.3000000000000105, "agent_compute-ego": 0.024020781976922513, "deviation-heading": 2.278678557386131, "set_robot_commands": 0.005040259530701613, "deviation-center-line": 0.5258387000410243, "driven_lanedir_consec": 2.972210652195905, "sim_compute_sim_state": 0.002897868906785994, "sim_compute_performance-ego": 0.004135175404814899, "sim_compute_robot_state-ego": 0.004989908431387189}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.506521859741974, "sim_physics": 0.056155826250712075, "survival_time": 14.950000000000076, "driven_lanedir": 4.909115309232991, "sim_render-ego": 0.007084428469340006, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.023353201548258463, "deviation-heading": 4.348700758353462, "set_robot_commands": 0.005111117362976075, "deviation-center-line": 0.8016027884613596, "driven_lanedir_consec": 4.909115309232991, "sim_compute_sim_state": 0.0029123648007710777, "sim_compute_performance-ego": 0.0040408929189046225, "sim_compute_robot_state-ego": 0.00501887559890747}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8056894978432088, "sim_physics": 0.05643777286305147, "survival_time": 5.09999999999999, "driven_lanedir": 1.3416181810488137, "sim_render-ego": 0.0070884157629574045, "in-drivable-lane": 0.8999999999999992, "agent_compute-ego": 0.023304226351719276, "deviation-heading": 1.562706356193517, "set_robot_commands": 0.005010689006132238, "deviation-center-line": 0.40884227625640424, "driven_lanedir_consec": 1.3416181810488137, "sim_compute_sim_state": 0.0029116074244181314, "sim_compute_performance-ego": 0.003993022675607719, "sim_compute_robot_state-ego": 0.00496818738825181}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.49095053686880347, "sim_physics": 0.05890023347103235, "survival_time": 1.6500000000000008, "driven_lanedir": 0.46338607771909546, "sim_render-ego": 0.007358016389789003, "in-drivable-lane": 0, "agent_compute-ego": 0.02376268126747825, "deviation-heading": 0.4653347402174019, "set_robot_commands": 0.005042574622414329, "deviation-center-line": 0.11387337689118215, "driven_lanedir_consec": 0.46338607771909546, "sim_compute_sim_state": 0.0029715552474513197, "sim_compute_performance-ego": 0.0040691332383589315, "sim_compute_robot_state-ego": 0.0050693280769116954}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.046841819046561, "sim_physics": 0.0574341125604583, "survival_time": 8.199999999999982, "driven_lanedir": 1.96402943056696, "sim_render-ego": 0.007273431231335896, "in-drivable-lane": 2.099999999999995, "agent_compute-ego": 0.0241066624478596, "deviation-heading": 2.1472627277145953, "set_robot_commands": 0.0051559689568310245, "deviation-center-line": 0.3628841569110752, "driven_lanedir_consec": 1.96402943056696, "sim_compute_sim_state": 0.002995546271161335, "sim_compute_performance-ego": 0.004088317475667814, "sim_compute_robot_state-ego": 0.0051082794259234175}}
set_robot_commands_max0.0051559689568310245
set_robot_commands_mean0.005072121895811056
set_robot_commands_median0.005042574622414329
set_robot_commands_min0.005010689006132238
sim_compute_performance-ego_max0.004135175404814899
sim_compute_performance-ego_mean0.004065308342670797
sim_compute_performance-ego_median0.0040691332383589315
sim_compute_performance-ego_min0.003993022675607719
sim_compute_robot_state-ego_max0.0051082794259234175
sim_compute_robot_state-ego_mean0.005030915784276316
sim_compute_robot_state-ego_median0.00501887559890747
sim_compute_robot_state-ego_min0.00496818738825181
sim_compute_sim_state_max0.002995546271161335
sim_compute_sim_state_mean0.0029377885301175716
sim_compute_sim_state_median0.0029123648007710777
sim_compute_sim_state_min0.002897868906785994
sim_physics_max0.05890023347103235
sim_physics_mean0.057040518557069375
sim_physics_median0.05643777286305147
sim_physics_min0.056155826250712075
sim_render-ego_max0.007358016389789003
sim_render-ego_mean0.007174125041569887
sim_render-ego_median0.0070884157629574045
sim_render-ego_min0.007066333354427125
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.950000000000012
survival_time_min1.6500000000000008
No reset possible
251204392Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-ros - Template solution using ROSaido3-LFV-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104910:13:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30314311735235044
survival_time_median2.6499999999999986
deviation-center-line_median0.1192462800776758
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.02668465559299175
agent_compute-ego_mean0.01787917528096487
agent_compute-ego_median0.014455349645882009
agent_compute-ego_min0.013295555114746092
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.12653708755488868
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330367
deviation-heading_mean0.44799520296706863
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829773
driven_any_max1.5997333541177865
driven_any_mean0.8095342605803051
driven_any_median0.7336463183586179
driven_any_min0.26903550091980144
driven_lanedir_consec_max1.021002447119848
driven_lanedir_consec_mean0.4489048090243791
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max1.021002447119848
driven_lanedir_mean0.4489048090243791
driven_lanedir_median0.30314311735235044
driven_lanedir_min0.2407721645627201
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean1.1466666666666634
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.17295599319565463, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.013178378763333174, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.023571427439300106, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.010634469314360283, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0056310472354083, "sim_compute_performance-ego": 0.007496867381351095, "sim_compute_robot_state-ego": 0.009094379317592566, "sim_compute_robot_state-npc0": 0.009444015126832772, "sim_compute_robot_state-npc1": 0.009255365586616625, "sim_compute_robot_state-npc2": 0.009140934742672342, "sim_compute_robot_state-npc3": 0.009381448718863476}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953953, "sim_physics": 0.2188508063554764, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.012728683650493622, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02360215038061142, "deviation-heading": 0.6986268167330367, "set_robot_commands": 0.010690771043300629, "deviation-center-line": 0.10463456752710912, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.005271323025226593, "sim_compute_performance-ego": 0.007619015872478485, "sim_compute_robot_state-ego": 0.009482309222221376, "sim_compute_robot_state-npc0": 0.00900566577911377, "sim_compute_robot_state-npc1": 0.008544079959392548, "sim_compute_robot_state-npc2": 0.008628740906715393, "sim_compute_robot_state-npc3": 0.008459456264972687}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586179, "sim_physics": 0.198090700002817, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.013229338022378774, "in-drivable-lane": 0, "agent_compute-ego": 0.02668465559299175, "deviation-heading": 0.27230767118055227, "set_robot_commands": 0.009963902143331677, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.004879561754373403, "sim_compute_performance-ego": 0.007650884298177866, "sim_compute_robot_state-ego": 0.009433595033792349, "sim_compute_robot_state-npc0": 0.008920660385718713, "sim_compute_robot_state-npc1": 0.008873127973996676, "sim_compute_robot_state-npc2": 0.008442255166860728, "sim_compute_robot_state-npc3": 0.008449554443359375}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.19507250990918887, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.012499173482259115, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.023642222086588543, "deviation-heading": 0.49111273392260785, "set_robot_commands": 0.009441347532374885, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.004965279691962785, "sim_compute_performance-ego": 0.00708424916831396, "sim_compute_robot_state-ego": 0.009063792485062797, "sim_compute_robot_state-npc0": 0.008827296636437857, "sim_compute_robot_state-npc1": 0.00878680649624076, "sim_compute_robot_state-npc2": 0.008619321289882865, "sim_compute_robot_state-npc3": 0.008754086750809865}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.22534329550606863, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.013640562693277994, "in-drivable-lane": 0, "agent_compute-ego": 0.023113409678141277, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.011150530406406949, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.005680061521984282, "sim_compute_performance-ego": 0.00755287352062407, "sim_compute_robot_state-ego": 0.009663445608956472, "sim_compute_robot_state-npc0": 0.008766469501313708, "sim_compute_robot_state-npc1": 0.009273370107014976, "sim_compute_robot_state-npc2": 0.008979104814075288, "sim_compute_robot_state-npc3": 0.009486073539370582}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5997333541177865, "sim_physics": 0.1470138888713742, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.01059456305070357, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.02046288537585046, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.008215157453678856, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.004265237445673667, "sim_compute_performance-ego": 0.006224035231535099, "sim_compute_robot_state-ego": 0.007534767970565922, "sim_compute_robot_state-npc0": 0.007344929639958153, "sim_compute_robot_state-npc1": 0.007310674210225255, "sim_compute_robot_state-npc2": 0.007257565979130012, "sim_compute_robot_state-npc3": 0.007423079703464981}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085552, "sim_physics": 0.08764818736485072, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231916, "sim_render-ego": 0.007113380091530936, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.01370776551110404, "deviation-heading": 0.5971215168818821, "set_robot_commands": 0.004890771139235724, "deviation-center-line": 0.11288019725884532, "driven_lanedir_consec": 0.5659790827231916, "sim_compute_sim_state": 0.002816134975070045, "sim_compute_performance-ego": 0.003959783485957554, "sim_compute_robot_state-ego": 0.004965739590781075, "sim_compute_robot_state-npc0": 0.004740476608276367, "sim_compute_robot_state-npc1": 0.004639250891549247, "sim_compute_robot_state-npc2": 0.004593866212027413, "sim_compute_robot_state-npc3": 0.004584953898475284}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.045244117645196, "sim_physics": 0.1092532357654056, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.007100105285644531, "in-drivable-lane": 0, "agent_compute-ego": 0.013978394302161964, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.004887999715031804, "deviation-center-line": 0.143630204236955, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.0028370812132551865, "sim_compute_performance-ego": 0.003942470292787294, "sim_compute_robot_state-ego": 0.005039965784227526, "sim_compute_robot_state-npc0": 0.0048200923043328365, "sim_compute_robot_state-npc1": 0.004700618821221429, "sim_compute_robot_state-npc2": 0.004589345004107501, "sim_compute_robot_state-npc3": 0.004579937135851061}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576203, "sim_physics": 0.08921337127685547, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.007175604502360026, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.01416690813170539, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.004899640878041585, "deviation-center-line": 0.10907487511555888, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.002881679270002577, "sim_compute_performance-ego": 0.003987365298800998, "sim_compute_robot_state-ego": 0.005023863580491807, "sim_compute_robot_state-npc0": 0.004846162266201443, "sim_compute_robot_state-npc1": 0.0046462515989939375, "sim_compute_robot_state-npc2": 0.004657619529300266, "sim_compute_robot_state-npc3": 0.004646788040796916}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.479979900188255, "sim_physics": 0.1355413610690108, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.007120114620600905, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.014455349645882009, "deviation-heading": 0.551444452143596, "set_robot_commands": 0.004900974648021092, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.00288478013511016, "sim_compute_performance-ego": 0.003974493418898538, "sim_compute_robot_state-ego": 0.00501871331829891, "sim_compute_robot_state-npc0": 0.004860648484987633, "sim_compute_robot_state-npc1": 0.004642564559651312, "sim_compute_robot_state-npc2": 0.004614157097361913, "sim_compute_robot_state-npc3": 0.004618105487288715}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.12284282401756004, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.007231791814168294, "in-drivable-lane": 0, "agent_compute-ego": 0.014577618351689092, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.005128251181708442, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.0028781007837366175, "sim_compute_performance-ego": 0.003924546418366609, "sim_compute_robot_state-ego": 0.005009024231522171, "sim_compute_robot_state-npc0": 0.0048845697332311555, "sim_compute_robot_state-npc1": 0.004687856744836878, "sim_compute_robot_state-npc2": 0.00470166736178928, "sim_compute_robot_state-npc3": 0.004697022614655671}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.2779147140642616, "sim_physics": 0.09142422676086426, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.007253274917602539, "in-drivable-lane": 0, "agent_compute-ego": 0.013295555114746092, "deviation-heading": 0.31056899459809534, "set_robot_commands": 0.00503082275390625, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.0029090595245361327, "sim_compute_performance-ego": 0.003960723876953125, "sim_compute_robot_state-ego": 0.005038652420043945, "sim_compute_robot_state-npc0": 0.004858474731445312, "sim_compute_robot_state-npc1": 0.004675350189208984, "sim_compute_robot_state-npc2": 0.004652566909790039, "sim_compute_robot_state-npc3": 0.004730310440063477}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727134, "sim_physics": 0.09144400650600218, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.007146309006888911, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.01420211342145812, "deviation-heading": 0.31225938815789966, "set_robot_commands": 0.004997257916432507, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.002904950447802274, "sim_compute_performance-ego": 0.00401222031071501, "sim_compute_robot_state-ego": 0.0050500968717179205, "sim_compute_robot_state-npc0": 0.004875988330481187, "sim_compute_robot_state-npc1": 0.00464544656141749, "sim_compute_robot_state-npc2": 0.004631321385221661, "sim_compute_robot_state-npc3": 0.004614726552423442}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101933, "sim_physics": 0.1157381534576416, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.006999654154623708, "in-drivable-lane": 0, "agent_compute-ego": 0.0143544981556554, "deviation-heading": 0.299628345931933, "set_robot_commands": 0.004703621710500409, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.0029295721361714024, "sim_compute_performance-ego": 0.003878378099010837, "sim_compute_robot_state-ego": 0.0048389434814453125, "sim_compute_robot_state-npc0": 0.004663636607508506, "sim_compute_robot_state-npc1": 0.004594095291629914, "sim_compute_robot_state-npc2": 0.004510671861710087, "sim_compute_robot_state-npc3": 0.00464850087319651}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522841, "sim_physics": 0.11673043288436592, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.0069949767168830425, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.014372676026587391, "deviation-heading": 0.5504810423056019, "set_robot_commands": 0.004803816477457683, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.0027805029177198222, "sim_compute_performance-ego": 0.0038765972735835055, "sim_compute_robot_state-ego": 0.0048853883556291165, "sim_compute_robot_state-npc0": 0.004689810322780235, "sim_compute_robot_state-npc1": 0.004548474854114009, "sim_compute_robot_state-npc2": 0.004567702611287435, "sim_compute_robot_state-npc3": 0.004508514030306947}}
set_robot_commands_max0.011150530406406949
set_robot_commands_mean0.006955955620919251
set_robot_commands_median0.00503082275390625
set_robot_commands_min0.004703621710500409
sim_compute_performance-ego_max0.007650884298177866
sim_compute_performance-ego_mean0.00527630026317027
sim_compute_performance-ego_median0.003987365298800998
sim_compute_performance-ego_min0.0038765972735835055
sim_compute_robot_state-ego_max0.009663445608956472
sim_compute_robot_state-ego_mean0.006609511818156619
sim_compute_robot_state-ego_median0.005039965784227526
sim_compute_robot_state-ego_min0.0048389434814453125
sim_compute_robot_state-npc0_max0.009444015126832772
sim_compute_robot_state-npc0_mean0.0063699264305746425
sim_compute_robot_state-npc0_median0.004875988330481187
sim_compute_robot_state-npc0_min0.004663636607508506
sim_compute_robot_state-npc1_max0.009273370107014976
sim_compute_robot_state-npc1_mean0.0062548889230740045
sim_compute_robot_state-npc1_median0.004687856744836878
sim_compute_robot_state-npc1_min0.004548474854114009
sim_compute_robot_state-npc2_max0.009140934742672342
sim_compute_robot_state-npc2_mean0.006172456058128816
sim_compute_robot_state-npc2_median0.004657619529300266
sim_compute_robot_state-npc2_min0.004510671861710087
sim_compute_robot_state-npc3_max0.009486073539370582
sim_compute_robot_state-npc3_mean0.0062388372329266
sim_compute_robot_state-npc3_median0.004697022614655671
sim_compute_robot_state-npc3_min0.004508514030306947
sim_compute_sim_state_max0.005680061521984282
sim_compute_sim_state_mean0.003767624805202216
sim_compute_sim_state_median0.0029090595245361327
sim_compute_sim_state_min0.0027805029177198222
sim_physics_max0.22534329550606863
sim_physics_mean0.1411441995295424
sim_physics_median0.12284282401756004
sim_physics_min0.08764818736485072
sim_render-ego_max0.013640562693277994
sim_render-ego_mean0.009333727384849942
sim_render-ego_median0.007231791814168294
sim_render-ego_min0.0069949767168830425
simulation-passed1
survival_time_max6.0499999999999865
survival_time_mean3.046666666666663
survival_time_min1.0500000000000005
No reset possible
251084386Soroush Saryazdi 🇨🇦bluejayaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:04:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251004381Soroush Saryazdi 🇨🇦bluejayaido3-LF-sim-validationstep1-simulationfailednoip-172-31-35-218-104910:04:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 68 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
250874373Peter Almasi 🇭🇺reinforcement-learning-submissionaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104910:21:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.969290041368174
survival_time_median10.20000000000001
deviation-center-line_median0.4270857082595348
in-drivable-lane_median0


other stats
agent_compute-ego_max0.02384787033765744
agent_compute-ego_mean0.023301675135482963
agent_compute-ego_median0.02330914198183546
agent_compute-ego_min0.022784122065001845
deviation-center-line_max1.0445074629268372
deviation-center-line_mean0.5003002689396436
deviation-center-line_min0.22682496726954032
deviation-heading_max4.433232773657423
deviation-heading_mean2.4851838582253696
deviation-heading_median2.441685521538835
deviation-heading_min0.9865179544867272
driven_any_max1.6773075644829878
driven_any_mean1.1886678353157056
driven_any_median1.099456640423864
driven_any_min0.3639287415998651
driven_lanedir_consec_max1.6330060337993926
driven_lanedir_consec_mean1.1129587214094354
driven_lanedir_consec_min0.33726438274657644
driven_lanedir_max1.6330060337993926
driven_lanedir_mean1.1272332401534189
driven_lanedir_median0.969290041368174
driven_lanedir_min0.33726438274657644
in-drivable-lane_max0.6000000000000032
in-drivable-lane_mean0.07666666666666729
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.722402905309275, "sim_physics": 0.057351971348972186, "survival_time": 7.049999999999983, "driven_lanedir": 0.657753956318957, "sim_render-ego": 0.007262950247906624, "in-drivable-lane": 0, "agent_compute-ego": 0.023698838890021577, "deviation-heading": 2.18422858497121, "set_robot_commands": 0.005275178462901014, "deviation-center-line": 0.5619999217800294, "driven_lanedir_consec": 0.657753956318957, "sim_compute_sim_state": 0.00310914398085141, "sim_compute_performance-ego": 0.004253076323380707, "sim_compute_robot_state-ego": 0.005096892093090301}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6773075644829878, "sim_physics": 0.05737930138905843, "survival_time": 14.950000000000076, "driven_lanedir": 1.6330060337993926, "sim_render-ego": 0.0070822421709696454, "in-drivable-lane": 0, "agent_compute-ego": 0.02297247648239136, "deviation-heading": 2.71497195103323, "set_robot_commands": 0.0051810693740844726, "deviation-center-line": 0.7325395641594101, "driven_lanedir_consec": 1.6330060337993926, "sim_compute_sim_state": 0.003147914409637451, "sim_compute_performance-ego": 0.004031674861907959, "sim_compute_robot_state-ego": 0.005053029855092366}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5872052673770078, "sim_physics": 0.058066975275675455, "survival_time": 14.950000000000076, "driven_lanedir": 1.5438270997895749, "sim_render-ego": 0.0071116328239440914, "in-drivable-lane": 0, "agent_compute-ego": 0.023427050908406577, "deviation-heading": 2.903855176519504, "set_robot_commands": 0.005171438058217366, "deviation-center-line": 0.39301490306098186, "driven_lanedir_consec": 1.5438270997895749, "sim_compute_sim_state": 0.0030934890111287434, "sim_compute_performance-ego": 0.004059536457061768, "sim_compute_robot_state-ego": 0.005076472759246826}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.021466420877054, "sim_physics": 0.06025164260476979, "survival_time": 9.850000000000003, "driven_lanedir": 0.9444846778406296, "sim_render-ego": 0.007207621172599986, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.023263202705964214, "deviation-heading": 2.441685521538835, "set_robot_commands": 0.0051487859735634125, "deviation-center-line": 0.4324427303155387, "driven_lanedir_consec": 0.9444846778406296, "sim_compute_sim_state": 0.003183224479559109, "sim_compute_performance-ego": 0.004078203046382381, "sim_compute_robot_state-ego": 0.005078164454038978}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0401972878260992, "sim_physics": 0.059649861326404645, "survival_time": 10.20000000000001, "driven_lanedir": 0.9691355543446064, "sim_render-ego": 0.007158113460914761, "in-drivable-lane": 0, "agent_compute-ego": 0.02330914198183546, "deviation-heading": 2.888599403462638, "set_robot_commands": 0.0051623489342483815, "deviation-center-line": 0.38629135666944775, "driven_lanedir_consec": 0.9691355543446064, "sim_compute_sim_state": 0.003166721147649428, "sim_compute_performance-ego": 0.00401918327107149, "sim_compute_robot_state-ego": 0.005037305401820762}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.6559356291301148, "sim_physics": 0.058086901505788165, "survival_time": 14.950000000000076, "driven_lanedir": 1.6156294430933775, "sim_render-ego": 0.007182522614796957, "in-drivable-lane": 0, "agent_compute-ego": 0.023183096249898276, "deviation-heading": 2.769374450200744, "set_robot_commands": 0.0051824442545572915, "deviation-center-line": 1.0445074629268372, "driven_lanedir_consec": 1.6156294430933775, "sim_compute_sim_state": 0.003181938330332438, "sim_compute_performance-ego": 0.004082489013671875, "sim_compute_robot_state-ego": 0.005098444620768229}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0548305333664327, "sim_physics": 0.057141457118240056, "survival_time": 10.20000000000001, "driven_lanedir": 0.8311077831876008, "sim_render-ego": 0.007118050958596024, "in-drivable-lane": 0.6000000000000032, "agent_compute-ego": 0.022784122065001845, "deviation-heading": 4.433232773657423, "set_robot_commands": 0.005123022724600399, "deviation-center-line": 0.6318440676891176, "driven_lanedir_consec": 0.6169900020278511, "sim_compute_sim_state": 0.0031100862166460823, "sim_compute_performance-ego": 0.004025006995481604, "sim_compute_robot_state-ego": 0.005030827195036645}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.099456640423864, "sim_physics": 0.05928348536467432, "survival_time": 9.950000000000006, "driven_lanedir": 0.969290041368174, "sim_render-ego": 0.007084587710586625, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.02303181820778391, "deviation-heading": 3.1991569065840713, "set_robot_commands": 0.005101256634122762, "deviation-center-line": 0.4126629507053513, "driven_lanedir_consec": 0.969290041368174, "sim_compute_sim_state": 0.003168079721268697, "sim_compute_performance-ego": 0.004014096667419127, "sim_compute_robot_state-ego": 0.005038335694739567}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.545873626377811, "sim_physics": 0.06052709102630615, "survival_time": 14.950000000000076, "driven_lanedir": 1.52074143811147, "sim_render-ego": 0.007808655897776286, "in-drivable-lane": 0, "agent_compute-ego": 0.02324408769607544, "deviation-heading": 2.3739896276072914, "set_robot_commands": 0.005254034201304118, "deviation-center-line": 0.40803601401669337, "driven_lanedir_consec": 1.52074143811147, "sim_compute_sim_state": 0.0031522663434346517, "sim_compute_performance-ego": 0.004074242909749349, "sim_compute_robot_state-ego": 0.005077222983042399}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.3744376509887631, "sim_physics": 0.06266968983870286, "survival_time": 3.899999999999994, "driven_lanedir": 0.3374757294483133, "sim_render-ego": 0.007271033066969652, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.02384787033765744, "deviation-heading": 0.9865179544867272, "set_robot_commands": 0.005189247620411408, "deviation-center-line": 0.2533540374048445, "driven_lanedir_consec": 0.3374757294483133, "sim_compute_sim_state": 0.0030846718030098155, "sim_compute_performance-ego": 0.004047234853108724, "sim_compute_robot_state-ego": 0.0050565799077351885}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.9609214616133924, "sim_physics": 0.05769064691331652, "survival_time": 9.45, "driven_lanedir": 0.9135231871897012, "sim_render-ego": 0.007211236095933056, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.023403243413047184, "deviation-heading": 1.997616458722406, "set_robot_commands": 0.005210995043396319, "deviation-center-line": 0.3742007008378713, "driven_lanedir_consec": 0.9135231871897012, "sim_compute_sim_state": 0.003098983613271562, "sim_compute_performance-ego": 0.0040852102653059375, "sim_compute_robot_state-ego": 0.005075964347395317}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.3639287415998651, "sim_physics": 0.06181192711779946, "survival_time": 3.7999999999999945, "driven_lanedir": 0.33726438274657644, "sim_render-ego": 0.007296458670967503, "in-drivable-lane": 0, "agent_compute-ego": 0.023135332684767872, "deviation-heading": 1.0839269337215451, "set_robot_commands": 0.005284350169332404, "deviation-center-line": 0.22682496726954032, "driven_lanedir_consec": 0.33726438274657644, "sim_compute_sim_state": 0.0030271661909003007, "sim_compute_performance-ego": 0.004048115328738564, "sim_compute_robot_state-ego": 0.0051081149201644095}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.60871685448673, "sim_physics": 0.05759851535161336, "survival_time": 14.950000000000076, "driven_lanedir": 1.5724473691324825, "sim_render-ego": 0.007231406370798747, "in-drivable-lane": 0, "agent_compute-ego": 0.02351611057917277, "deviation-heading": 2.4263565580387234, "set_robot_commands": 0.005228120485941569, "deviation-center-line": 0.7920687539171162, "driven_lanedir_consec": 1.5724473691324825, "sim_compute_sim_state": 0.0031488561630249024, "sim_compute_performance-ego": 0.004046899477640788, "sim_compute_robot_state-ego": 0.00511133352915446}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5424923715065475, "sim_physics": 0.05817605972290039, "survival_time": 14.950000000000076, "driven_lanedir": 1.51911328659684, "sim_render-ego": 0.00713950236638387, "in-drivable-lane": 0, "agent_compute-ego": 0.023371858596801756, "deviation-heading": 2.299477166859734, "set_robot_commands": 0.00524554173151652, "deviation-center-line": 0.42763089508233953, "driven_lanedir_consec": 1.51911328659684, "sim_compute_sim_state": 0.003141681353251139, "sim_compute_performance-ego": 0.004026397069295248, "sim_compute_robot_state-ego": 0.005063983599344889}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.5748445743696438, "sim_physics": 0.05971516768137614, "survival_time": 14.950000000000076, "driven_lanedir": 1.543698619333585, "sim_render-ego": 0.007125912507375081, "in-drivable-lane": 0, "agent_compute-ego": 0.023336876233418784, "deviation-heading": 2.5747684059764606, "set_robot_commands": 0.0052633317311604816, "deviation-center-line": 0.4270857082595348, "driven_lanedir_consec": 1.543698619333585, "sim_compute_sim_state": 0.003152867158253988, "sim_compute_performance-ego": 0.004041841030120849, "sim_compute_robot_state-ego": 0.005030825138092041}}
set_robot_commands_max0.005284350169332404
set_robot_commands_mean0.005201411026623861
set_robot_commands_median0.005189247620411408
set_robot_commands_min0.005101256634122762
sim_compute_performance-ego_max0.004253076323380707
sim_compute_performance-ego_mean0.004062213838022425
sim_compute_performance-ego_median0.004047234853108724
sim_compute_performance-ego_min0.004014096667419127
sim_compute_robot_state-ego_max0.00511133352915446
sim_compute_robot_state-ego_mean0.005068899766584158
sim_compute_robot_state-ego_median0.005075964347395317
sim_compute_robot_state-ego_min0.005030825138092041
sim_compute_sim_state_max0.003183224479559109
sim_compute_sim_state_mean0.0031311393281479812
sim_compute_sim_state_median0.003147914409637451
sim_compute_sim_state_min0.0030271661909003007
sim_physics_max0.06266968983870286
sim_physics_mean0.05902671290570653
sim_physics_median0.05817605972290039
sim_physics_min0.057141457118240056
sim_render-ego_max0.007808655897776286
sim_render-ego_mean0.007219461742434595
sim_render-ego_median0.007182522614796957
sim_render-ego_min0.0070822421709696454
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.270000000000037
survival_time_min3.7999999999999945
No reset possible
250734368Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-tensorflowaido3-LFV-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104910:12:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.20053062743998273
survival_time_median1.4500000000000006
deviation-center-line_median0.10029507485278658
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03124226056612455
agent_compute-ego_mean0.023291036026538876
agent_compute-ego_median0.023424989298770304
agent_compute-ego_min0.015726902268149635
deviation-center-line_max0.20618389498304607
deviation-center-line_mean0.10726217203780213
deviation-center-line_min0.05639744833568416
deviation-heading_max1.4611958535441456
deviation-heading_mean0.6832880646569669
deviation-heading_median0.6522380933158527
deviation-heading_min0.26165524762672404
driven_any_max0.808300317598023
driven_any_mean0.3686250096578973
driven_any_median0.2674442206508112
driven_any_min0.19204533286327044
driven_lanedir_consec_max0.5717152341776583
driven_lanedir_consec_mean0.2551781771427683
driven_lanedir_consec_min0.105220918036121
driven_lanedir_max0.5717152341776583
driven_lanedir_mean0.2551781771427683
driven_lanedir_median0.20053062743998273
driven_lanedir_min0.105220918036121
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.14333333333333312
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2330551045594355, "sim_physics": 0.22125133184286264, "survival_time": 1.3000000000000005, "driven_lanedir": 0.15859254325737604, "sim_render-ego": 0.013067804850064792, "in-drivable-lane": 0, "agent_compute-ego": 0.03124226056612455, "deviation-heading": 0.806746999201126, "set_robot_commands": 0.010888182199918307, "deviation-center-line": 0.10262966986628122, "driven_lanedir_consec": 0.15859254325737604, "sim_compute_sim_state": 0.005405407685499925, "sim_compute_performance-ego": 0.007474798422593337, "sim_compute_robot_state-ego": 0.010511985191932091, "sim_compute_robot_state-npc0": 0.009206781020531287, "sim_compute_robot_state-npc1": 0.009062702839191144, "sim_compute_robot_state-npc2": 0.009253859519958496, "sim_compute_robot_state-npc3": 0.009189899151141826}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.47733358601342446, "sim_physics": 0.19514732360839843, "survival_time": 2.25, "driven_lanedir": 0.4485862383694736, "sim_render-ego": 0.012600506676567926, "in-drivable-lane": 0, "agent_compute-ego": 0.026037571165296765, "deviation-heading": 0.6858742448105529, "set_robot_commands": 0.009612719217936196, "deviation-center-line": 0.15142491487247595, "driven_lanedir_consec": 0.4485862383694736, "sim_compute_sim_state": 0.00529123412238227, "sim_compute_performance-ego": 0.0073416021135118276, "sim_compute_robot_state-ego": 0.008887953228420682, "sim_compute_robot_state-npc0": 0.008666335211859808, "sim_compute_robot_state-npc1": 0.008097192976209852, "sim_compute_robot_state-npc2": 0.008364041646321615, "sim_compute_robot_state-npc3": 0.008377345403035481}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22349491735916935, "sim_physics": 0.17471963480899208, "survival_time": 0.9500000000000004, "driven_lanedir": 0.20044131568344303, "sim_render-ego": 0.010582258826807925, "in-drivable-lane": 0, "agent_compute-ego": 0.023424989298770304, "deviation-heading": 0.2704731749274404, "set_robot_commands": 0.008871944327103464, "deviation-center-line": 0.08595136325932723, "driven_lanedir_consec": 0.20044131568344303, "sim_compute_sim_state": 0.004250877781918174, "sim_compute_performance-ego": 0.005929808867605109, "sim_compute_robot_state-ego": 0.007296875903480931, "sim_compute_robot_state-npc0": 0.0075336631975675885, "sim_compute_robot_state-npc1": 0.006956464365908974, "sim_compute_robot_state-npc2": 0.007014889466135125, "sim_compute_robot_state-npc3": 0.006942736475091232}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19443823161601692, "sim_physics": 0.26197704515959086, "survival_time": 0.9500000000000004, "driven_lanedir": 0.14770045738585935, "sim_render-ego": 0.014169266349390933, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.029957896784732214, "deviation-heading": 0.3077906234188462, "set_robot_commands": 0.010565481687846935, "deviation-center-line": 0.07601945164099867, "driven_lanedir_consec": 0.14770045738585935, "sim_compute_sim_state": 0.005232949005930047, "sim_compute_performance-ego": 0.007584007162796824, "sim_compute_robot_state-ego": 0.010720491409301758, "sim_compute_robot_state-npc0": 0.009590186570820057, "sim_compute_robot_state-npc1": 0.009173154830932615, "sim_compute_robot_state-npc2": 0.008273513693558542, "sim_compute_robot_state-npc3": 0.008790555753205953}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.808300317598023, "sim_physics": 0.17919047062213606, "survival_time": 3.2499999999999964, "driven_lanedir": 0.3744263247453107, "sim_render-ego": 0.012892539684589092, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.02755915935222919, "deviation-heading": 1.1667493263499342, "set_robot_commands": 0.010194661067082332, "deviation-center-line": 0.13981953235214378, "driven_lanedir_consec": 0.3744263247453107, "sim_compute_sim_state": 0.0053380819467397835, "sim_compute_performance-ego": 0.007646560668945312, "sim_compute_robot_state-ego": 0.0091949279491718, "sim_compute_robot_state-npc0": 0.008915006197415865, "sim_compute_robot_state-npc1": 0.008838162055382362, "sim_compute_robot_state-npc2": 0.008714136710533728, "sim_compute_robot_state-npc3": 0.008876481423011192}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.45469802056019126, "sim_physics": 0.1743150211515881, "survival_time": 2.1000000000000005, "driven_lanedir": 0.38627921480585536, "sim_render-ego": 0.01295014222462972, "in-drivable-lane": 0, "agent_compute-ego": 0.027451600347246443, "deviation-heading": 0.8054326720626284, "set_robot_commands": 0.010885363533383324, "deviation-center-line": 0.13457814638048243, "driven_lanedir_consec": 0.38627921480585536, "sim_compute_sim_state": 0.005623965036301385, "sim_compute_performance-ego": 0.007965212776547386, "sim_compute_robot_state-ego": 0.00934688817887079, "sim_compute_robot_state-npc0": 0.009182407742454893, "sim_compute_robot_state-npc1": 0.009450418608529227, "sim_compute_robot_state-npc2": 0.008993489401681083, "sim_compute_robot_state-npc3": 0.008941587947663806}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.19204533286327044, "sim_physics": 0.19959947797987196, "survival_time": 0.9000000000000002, "driven_lanedir": 0.1424973228484121, "sim_render-ego": 0.014935784869723847, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03044956260257297, "deviation-heading": 0.30242844865351914, "set_robot_commands": 0.01146611902448866, "deviation-center-line": 0.05887030460450043, "driven_lanedir_consec": 0.1424973228484121, "sim_compute_sim_state": 0.0050466060638427734, "sim_compute_performance-ego": 0.007860342661539713, "sim_compute_robot_state-ego": 0.010116100311279295, "sim_compute_robot_state-npc0": 0.010233720143636068, "sim_compute_robot_state-npc1": 0.009174068768819174, "sim_compute_robot_state-npc2": 0.008610632684495714, "sim_compute_robot_state-npc3": 0.008823037147521973}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.2195066076339944, "sim_physics": 0.2036619597467883, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1819595054539649, "sim_render-ego": 0.012368670825300543, "in-drivable-lane": 0, "agent_compute-ego": 0.026205589031351024, "deviation-heading": 0.5004249909075597, "set_robot_commands": 0.008972644805908203, "deviation-center-line": 0.10129325610156564, "driven_lanedir_consec": 0.1819595054539649, "sim_compute_sim_state": 0.005010004701285526, "sim_compute_performance-ego": 0.007276987207346949, "sim_compute_robot_state-ego": 0.009476546583504513, "sim_compute_robot_state-npc0": 0.009311133417589912, "sim_compute_robot_state-npc1": 0.00965111831138874, "sim_compute_robot_state-npc2": 0.00856370761476714, "sim_compute_robot_state-npc3": 0.008939652607358736}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.49740114205697195, "sim_physics": 0.13881817162036897, "survival_time": 3.999999999999994, "driven_lanedir": 0.2826018514032853, "sim_render-ego": 0.010151708126068117, "in-drivable-lane": 0, "agent_compute-ego": 0.02270921766757965, "deviation-heading": 1.4611958535441456, "set_robot_commands": 0.007974833250045776, "deviation-center-line": 0.20618389498304607, "driven_lanedir_consec": 0.2826018514032853, "sim_compute_sim_state": 0.004131531715393067, "sim_compute_performance-ego": 0.005676451325416565, "sim_compute_robot_state-ego": 0.00736238956451416, "sim_compute_robot_state-npc0": 0.007400742173194886, "sim_compute_robot_state-npc1": 0.0073596805334091185, "sim_compute_robot_state-npc2": 0.006879442930221557, "sim_compute_robot_state-npc3": 0.0068963408470153805}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.2674442206508112, "sim_physics": 0.12786982173011416, "survival_time": 1.0500000000000005, "driven_lanedir": 0.20053062743998273, "sim_render-ego": 0.010068700427100771, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.020364761352539062, "deviation-heading": 0.4946918890522781, "set_robot_commands": 0.006794407254173642, "deviation-center-line": 0.0570714863837531, "driven_lanedir_consec": 0.20053062743998273, "sim_compute_sim_state": 0.0035424913678850445, "sim_compute_performance-ego": 0.005357106526692708, "sim_compute_robot_state-ego": 0.006530239468529111, "sim_compute_robot_state-npc0": 0.006041231609526135, "sim_compute_robot_state-npc1": 0.0058558327811104914, "sim_compute_robot_state-npc2": 0.005751439503261021, "sim_compute_robot_state-npc3": 0.006083658763340541}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.718337346320073, "sim_physics": 0.13319046050310135, "survival_time": 3.1999999999999966, "driven_lanedir": 0.5717152341776583, "sim_render-ego": 0.008458856493234634, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.018906675279140472, "deviation-heading": 1.4025178070071356, "set_robot_commands": 0.006315603852272034, "deviation-center-line": 0.15704369885205854, "driven_lanedir_consec": 0.5717152341776583, "sim_compute_sim_state": 0.0034224987030029297, "sim_compute_performance-ego": 0.0049363113939762115, "sim_compute_robot_state-ego": 0.005912028253078461, "sim_compute_robot_state-npc0": 0.005883932113647461, "sim_compute_robot_state-npc1": 0.005565322935581207, "sim_compute_robot_state-npc2": 0.0056927502155303955, "sim_compute_robot_state-npc3": 0.00568731501698494}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.19305655754758572, "sim_physics": 0.10552160306410356, "survival_time": 1.1000000000000003, "driven_lanedir": 0.17136527999941276, "sim_render-ego": 0.008901010860096325, "in-drivable-lane": 0, "agent_compute-ego": 0.017764124003323643, "deviation-heading": 0.37344882528115186, "set_robot_commands": 0.005643855441700329, "deviation-center-line": 0.10029507485278658, "driven_lanedir_consec": 0.17136527999941276, "sim_compute_sim_state": 0.003303040157664906, "sim_compute_performance-ego": 0.005245252089066939, "sim_compute_robot_state-ego": 0.00607609748840332, "sim_compute_robot_state-npc0": 0.00577855110168457, "sim_compute_robot_state-npc1": 0.005544955080205744, "sim_compute_robot_state-npc2": 0.005558241497386585, "sim_compute_robot_state-npc3": 0.005564375357194381}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.3269034450661553, "sim_physics": 0.10596402760209708, "survival_time": 1.4500000000000006, "driven_lanedir": 0.25487713383035504, "sim_render-ego": 0.007247036901013604, "in-drivable-lane": 0, "agent_compute-ego": 0.0157299699454472, "deviation-heading": 0.6522380933158527, "set_robot_commands": 0.005078973441288389, "deviation-center-line": 0.09396643203300344, "driven_lanedir_consec": 0.25487713383035504, "sim_compute_sim_state": 0.0028692771648538523, "sim_compute_performance-ego": 0.0039563836722538385, "sim_compute_robot_state-ego": 0.005047896812702048, "sim_compute_robot_state-npc0": 0.004902412151468211, "sim_compute_robot_state-npc1": 0.004680781528867525, "sim_compute_robot_state-npc2": 0.004646317712191878, "sim_compute_robot_state-npc3": 0.004629052918532799}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.21218419907112748, "sim_physics": 0.11731268059123648, "survival_time": 1.1000000000000003, "driven_lanedir": 0.20087868970501388, "sim_render-ego": 0.007343834096735174, "in-drivable-lane": 0, "agent_compute-ego": 0.015726902268149635, "deviation-heading": 0.26165524762672404, "set_robot_commands": 0.005004189231178977, "deviation-center-line": 0.08738790604892421, "driven_lanedir_consec": 0.20087868970501388, "sim_compute_sim_state": 0.0028529275547374377, "sim_compute_performance-ego": 0.004014578732577237, "sim_compute_robot_state-ego": 0.005031867460771041, "sim_compute_robot_state-npc0": 0.004916570403359153, "sim_compute_robot_state-npc1": 0.004693963310935281, "sim_compute_robot_state-npc2": 0.004614515738053756, "sim_compute_robot_state-npc3": 0.004610841924493963}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.5111761159522099, "sim_physics": 0.11690052961691833, "survival_time": 1.950000000000001, "driven_lanedir": 0.105220918036121, "sim_render-ego": 0.007244305732922676, "in-drivable-lane": 0.9000000000000008, "agent_compute-ego": 0.01583526073357998, "deviation-heading": 0.7576527736956076, "set_robot_commands": 0.004892281996898162, "deviation-center-line": 0.05639744833568416, "driven_lanedir_consec": 0.105220918036121, "sim_compute_sim_state": 0.002843661186022636, "sim_compute_performance-ego": 0.003962260026198167, "sim_compute_robot_state-ego": 0.0050017038981119795, "sim_compute_robot_state-npc0": 0.00482793343372834, "sim_compute_robot_state-npc1": 0.004568576812744141, "sim_compute_robot_state-npc2": 0.0045629220131116035, "sim_compute_robot_state-npc3": 0.004569414334419446}}
set_robot_commands_max0.01146611902448866
set_robot_commands_mean0.008210750688748316
set_robot_commands_median0.008871944327103464
set_robot_commands_min0.004892281996898162
sim_compute_performance-ego_max0.007965212776547386
sim_compute_performance-ego_mean0.006148510909804542
sim_compute_performance-ego_median0.005929808867605109
sim_compute_performance-ego_min0.0039563836722538385
sim_compute_robot_state-ego_max0.010720491409301758
sim_compute_robot_state-ego_mean0.0077675994468048
sim_compute_robot_state-ego_median0.00736238956451416
sim_compute_robot_state-ego_min0.0050017038981119795
sim_compute_robot_state-npc0_max0.010233720143636068
sim_compute_robot_state-npc0_mean0.007492707099232282
sim_compute_robot_state-npc0_median0.0075336631975675885
sim_compute_robot_state-npc0_min0.00482793343372834
sim_compute_robot_state-npc1_max0.00965111831138874
sim_compute_robot_state-npc1_mean0.007244826382614374
sim_compute_robot_state-npc1_median0.0073596805334091185
sim_compute_robot_state-npc1_min0.004568576812744141
sim_compute_robot_state-npc2_max0.009253859519958496
sim_compute_robot_state-npc2_mean0.007032926689813882
sim_compute_robot_state-npc2_median0.007014889466135125
sim_compute_robot_state-npc2_min0.0045629220131116035
sim_compute_robot_state-npc3_max0.009189899151141826
sim_compute_robot_state-npc3_mean0.007128153004667443
sim_compute_robot_state-npc3_median0.006942736475091232
sim_compute_robot_state-npc3_min0.004569414334419446
sim_compute_sim_state_max0.005623965036301385
sim_compute_sim_state_mean0.00427763694623065
sim_compute_sim_state_median0.004250877781918174
sim_compute_sim_state_min0.002843661186022636
sim_physics_max0.26197704515959086
sim_physics_mean0.1636959706432112
sim_physics_median0.1743150211515881
sim_physics_min0.10552160306410356
sim_render-ego_max0.014935784869723847
sim_render-ego_mean0.010865495129616404
sim_render-ego_median0.010582258826807925
sim_render-ego_min0.007244305732922676
simulation-passed1
survival_time_max3.999999999999994
survival_time_mean1.7999999999999996
survival_time_min0.9000000000000002
No reset possible
250224362Soroush Saryazdi 🇨🇦bluejayaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-35-218-104910:01:06
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
250014128Andrea Censi 🇨🇭rotationaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:23:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.00031446221011421915
survival_time_median14.950000000000076
deviation-center-line_median0.4891048530415207
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.10532257239023844
agent_compute-ego_mean0.09953829034169516
agent_compute-ego_median0.10272166649500528
agent_compute-ego_min0.08258579651514689
deviation-center-line_max0.6113242374220981
deviation-center-line_mean0.422546032853888
deviation-center-line_min0.020737127615471695
deviation-heading_max5.830135897709593
deviation-heading_mean5.6845705507076865
deviation-heading_median5.657649106857694
deviation-heading_min5.536662996854859
driven_any_max0.026478672834058543
driven_any_mean0.02486423959225546
driven_any_median0.025930195541210208
driven_any_min0.022165452661382513
driven_lanedir_consec_max0.0021599934447711355
driven_lanedir_consec_mean-0.0004859282560538025
driven_lanedir_consec_min-0.003645956811333395
driven_lanedir_max0.0021599934447711355
driven_lanedir_mean-0.0004859282560538025
driven_lanedir_median0.00031446221011421915
driven_lanedir_min-0.003645956811333395
in-drivable-lane_max7.650000000000043
in-drivable-lane_mean7.600000000000042
in-drivable-lane_min7.550000000000044
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834058543, "sim_physics": 0.18326583464940388, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.012239761352539062, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.10532257239023844, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.009607036908467611, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.00497359037399292, "sim_compute_performance-ego": 0.00742319901784261, "sim_compute_robot_state-ego": 0.009360865751902262, "sim_compute_robot_state-npc0": 0.008712097803751628, "sim_compute_robot_state-npc1": 0.008421087265014648, "sim_compute_robot_state-npc2": 0.008603216807047526, "sim_compute_robot_state-npc3": 0.008377297719319662}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025930195541210208, "sim_physics": 0.16820766687393188, "survival_time": 14.950000000000076, "driven_lanedir": -0.003645956811333395, "sim_render-ego": 0.01193625291188558, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.10509859641393024, "deviation-heading": 5.795316370396739, "set_robot_commands": 0.009559356371561686, "deviation-center-line": 0.6113242374220981, "driven_lanedir_consec": -0.003645956811333395, "sim_compute_sim_state": 0.005000279744466146, "sim_compute_performance-ego": 0.007179756959279378, "sim_compute_robot_state-ego": 0.009180161952972412, "sim_compute_robot_state-npc0": 0.00873213291168213, "sim_compute_robot_state-npc1": 0.008272241751352946, "sim_compute_robot_state-npc2": 0.008168537616729737, "sim_compute_robot_state-npc3": 0.008033588727315267}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672443435, "sim_physics": 0.17492976347605388, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017527010091673567, "sim_render-ego": 0.012321910858154296, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.10272166649500528, "deviation-heading": 5.603088381719547, "set_robot_commands": 0.009052234490712484, "deviation-center-line": 0.4891048530415207, "driven_lanedir_consec": 0.0017527010091673567, "sim_compute_sim_state": 0.005182320276896159, "sim_compute_performance-ego": 0.007562305132548014, "sim_compute_robot_state-ego": 0.009524368445078531, "sim_compute_robot_state-npc0": 0.008556431134541829, "sim_compute_robot_state-npc1": 0.008465760548909506, "sim_compute_robot_state-npc2": 0.008665785789489747, "sim_compute_robot_state-npc3": 0.008794041474660237}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661382513, "sim_physics": 0.17165109237035114, "survival_time": 14.950000000000076, "driven_lanedir": -0.003010841132988329, "sim_render-ego": 0.011523542404174804, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.10196281989415489, "deviation-heading": 5.536662996854859, "set_robot_commands": 0.008973665237426758, "deviation-center-line": 0.4305506258687733, "driven_lanedir_consec": -0.003010841132988329, "sim_compute_sim_state": 0.004783617655436198, "sim_compute_performance-ego": 0.007048606872558594, "sim_compute_robot_state-ego": 0.008804656664530437, "sim_compute_robot_state-npc0": 0.00835223913192749, "sim_compute_robot_state-npc1": 0.008277901808420817, "sim_compute_robot_state-npc2": 0.008129688103993733, "sim_compute_robot_state-npc3": 0.008213566144307455}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.02594247225218261, "sim_physics": 0.1349743930498759, "survival_time": 14.950000000000076, "driven_lanedir": 0.00031446221011421915, "sim_render-ego": 0.00996581554412842, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.08258579651514689, "deviation-heading": 5.830135897709593, "set_robot_commands": 0.007593216101328532, "deviation-center-line": 0.020737127615471695, "driven_lanedir_consec": 0.00031446221011421915, "sim_compute_sim_state": 0.004139641920725505, "sim_compute_performance-ego": 0.005835136572519938, "sim_compute_robot_state-ego": 0.007236727078755696, "sim_compute_robot_state-npc0": 0.0069833000500996905, "sim_compute_robot_state-npc1": 0.006679545243581136, "sim_compute_robot_state-npc2": 0.006660831769307454, "sim_compute_robot_state-npc3": 0.00664189338684082}}
set_robot_commands_max0.009607036908467611
set_robot_commands_mean0.008957101821899413
set_robot_commands_median0.009052234490712484
set_robot_commands_min0.007593216101328532
sim_compute_performance-ego_max0.007562305132548014
sim_compute_performance-ego_mean0.007009800910949706
sim_compute_performance-ego_median0.007179756959279378
sim_compute_performance-ego_min0.005835136572519938
sim_compute_robot_state-ego_max0.009524368445078531
sim_compute_robot_state-ego_mean0.008821355978647867
sim_compute_robot_state-ego_median0.009180161952972412
sim_compute_robot_state-ego_min0.007236727078755696
sim_compute_robot_state-npc0_max0.00873213291168213
sim_compute_robot_state-npc0_mean0.008267240206400555
sim_compute_robot_state-npc0_median0.008556431134541829
sim_compute_robot_state-npc0_min0.0069833000500996905
sim_compute_robot_state-npc1_max0.008465760548909506
sim_compute_robot_state-npc1_mean0.008023307323455811
sim_compute_robot_state-npc1_median0.008277901808420817
sim_compute_robot_state-npc1_min0.006679545243581136
sim_compute_robot_state-npc2_max0.008665785789489747
sim_compute_robot_state-npc2_mean0.00804561201731364
sim_compute_robot_state-npc2_median0.008168537616729737
sim_compute_robot_state-npc2_min0.006660831769307454
sim_compute_robot_state-npc3_max0.008794041474660237
sim_compute_robot_state-npc3_mean0.008012077490488687
sim_compute_robot_state-npc3_median0.008213566144307455
sim_compute_robot_state-npc3_min0.00664189338684082
sim_compute_sim_state_max0.005182320276896159
sim_compute_sim_state_mean0.004815889994303386
sim_compute_sim_state_median0.00497359037399292
sim_compute_sim_state_min0.004139641920725505
sim_physics_max0.18326583464940388
sim_physics_mean0.16660575008392337
sim_physics_median0.17165109237035114
sim_physics_min0.1349743930498759
sim_render-ego_max0.012321910858154296
sim_render-ego_mean0.011597456614176433
sim_render-ego_median0.01193625291188558
sim_render-ego_min0.00996581554412842
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
249844157Andrea Censi 🇨🇭minimal_agent_python2 (Python 2)aido3-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104910:23:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4674075261701268
survival_time_median3.699999999999995
deviation-center-line_median0.2037212999690195
in-drivable-lane_median0


other stats
agent_compute-ego_max0.010617283257571134
agent_compute-ego_mean0.009460766770979257
agent_compute-ego_median0.009910727992202295
agent_compute-ego_min0.007155373289778426
deviation-center-line_max0.5183621890690367
deviation-center-line_mean0.2365365432439713
deviation-center-line_min0.1001276403534276
deviation-heading_max1.8192903310562811
deviation-heading_mean0.7195980419067693
deviation-heading_median0.5070424162880826
deviation-heading_min0.2495279988048577
driven_any_max2.764827318571964
driven_any_mean1.0818349506618754
driven_any_median1.0098273192909006
driven_any_min0.3648701917101222
driven_lanedir_consec_max1.9044523873117627
driven_lanedir_consec_mean0.759860328609196
driven_lanedir_consec_min0.3272146444894328
driven_lanedir_max1.9045033171069223
driven_lanedir_mean0.7732651243581526
driven_lanedir_median0.6173586051289615
driven_lanedir_min0.3272146444894328
in-drivable-lane_max3.7999999999999887
in-drivable-lane_mean0.8633333333333326
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.13558700063207127, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.008938937573819547, "in-drivable-lane": 0, "agent_compute-ego": 0.007414504214450046, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.006962585019635725, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.003658356967273059, "sim_compute_performance-ego": 0.005222140131769954, "sim_compute_robot_state-ego": 0.006464953895087715, "sim_compute_robot_state-npc0": 0.006182213087339659, "sim_compute_robot_state-npc1": 0.006158351898193359, "sim_compute_robot_state-npc2": 0.00624006073754113, "sim_compute_robot_state-npc3": 0.0062245119799364795}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.1857692550968479, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.0119362650690852, "in-drivable-lane": 0, "agent_compute-ego": 0.010083546509613862, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.008515125996357686, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.004840915267531936, "sim_compute_performance-ego": 0.007263138487532332, "sim_compute_robot_state-ego": 0.008717234070236618, "sim_compute_robot_state-npc0": 0.008287236497208878, "sim_compute_robot_state-npc1": 0.00822494481060956, "sim_compute_robot_state-npc2": 0.008357731071678368, "sim_compute_robot_state-npc3": 0.008002590488743138}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.2038245911629784, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.012206862304384345, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.010394532159464249, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.01015504938087716, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.005130990451534852, "sim_compute_performance-ego": 0.007401949522511059, "sim_compute_robot_state-ego": 0.009281515285668784, "sim_compute_robot_state-npc0": 0.009006170247564253, "sim_compute_robot_state-npc1": 0.008713169603158306, "sim_compute_robot_state-npc2": 0.008495643438882386, "sim_compute_robot_state-npc3": 0.008504632292993811}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.18521582893052027, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.012273829644887236, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.0098443842683163, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.009254160975910608, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.004713873588601957, "sim_compute_performance-ego": 0.006932132531211014, "sim_compute_robot_state-ego": 0.008918974412049299, "sim_compute_robot_state-npc0": 0.008099533500471665, "sim_compute_robot_state-npc1": 0.008083184976228244, "sim_compute_robot_state-npc2": 0.00809718052130095, "sim_compute_robot_state-npc3": 0.007994264832341858}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.17362292110919952, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.011800497770309448, "in-drivable-lane": 0, "agent_compute-ego": 0.00926164537668228, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.008747845888137817, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.00448039174079895, "sim_compute_performance-ego": 0.006564214825630188, "sim_compute_robot_state-ego": 0.008525319397449493, "sim_compute_robot_state-npc0": 0.007743813097476959, "sim_compute_robot_state-npc1": 0.00787198543548584, "sim_compute_robot_state-npc2": 0.007593028247356415, "sim_compute_robot_state-npc3": 0.007271207869052887}, "udem1-5-0": {"driven_any": 1.0548273189057942, "sim_physics": 0.2029352807379388, "survival_time": 3.8499999999999943, "driven_lanedir": 0.39637369698573455, "sim_render-ego": 0.012287251361004718, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.010569234947105507, "deviation-heading": 1.272726140232846, "set_robot_commands": 0.010809613512707997, "deviation-center-line": 0.2037212999690195, "driven_lanedir_consec": 0.39637369698573455, "sim_compute_sim_state": 0.004783305254849521, "sim_compute_performance-ego": 0.007240063184267515, "sim_compute_robot_state-ego": 0.009388000934154955, "sim_compute_robot_state-npc0": 0.008784767869230988, "sim_compute_robot_state-npc1": 0.008645630502081537, "sim_compute_robot_state-npc2": 0.008386379712587827, "sim_compute_robot_state-npc3": 0.008405035192316229}, "udem1-6-0": {"driven_any": 0.8898273241328052, "sim_physics": 0.2264948216351596, "survival_time": 3.2999999999999963, "driven_lanedir": 0.8871438691197218, "sim_render-ego": 0.012106256051497026, "in-drivable-lane": 0, "agent_compute-ego": 0.009910727992202295, "deviation-heading": 0.2564691131854334, "set_robot_commands": 0.009018283901792584, "deviation-center-line": 0.3019392944051749, "driven_lanedir_consec": 0.8871438691197218, "sim_compute_sim_state": 0.004560448906638406, "sim_compute_performance-ego": 0.007118785020076867, "sim_compute_robot_state-ego": 0.008806846358559349, "sim_compute_robot_state-npc0": 0.00810038320945971, "sim_compute_robot_state-npc1": 0.008125131780450994, "sim_compute_robot_state-npc2": 0.007959170774980024, "sim_compute_robot_state-npc3": 0.007893020456487482}, "udem1-7-0": {"driven_any": 1.0098273192909006, "sim_physics": 0.2591646361995388, "survival_time": 3.699999999999995, "driven_lanedir": 0.8892952338440012, "sim_render-ego": 0.013370153066274282, "in-drivable-lane": 0, "agent_compute-ego": 0.010239414266637851, "deviation-heading": 1.3305395181824708, "set_robot_commands": 0.009875861374107568, "deviation-center-line": 0.2328954250769578, "driven_lanedir_consec": 0.8751257158125099, "sim_compute_sim_state": 0.005306656296188767, "sim_compute_performance-ego": 0.007383678410504316, "sim_compute_robot_state-ego": 0.009273200421719936, "sim_compute_robot_state-npc0": 0.008624234715023556, "sim_compute_robot_state-npc1": 0.008642679936177022, "sim_compute_robot_state-npc2": 0.00869188759777997, "sim_compute_robot_state-npc3": 0.008633342949119775}, "udem1-8-0": {"driven_any": 1.024827319128602, "sim_physics": 0.18457607587178548, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6173586051289615, "sim_render-ego": 0.012390324274698892, "in-drivable-lane": 0.9999999999999978, "agent_compute-ego": 0.010469732284545898, "deviation-heading": 1.2558531851712094, "set_robot_commands": 0.009933404922485352, "deviation-center-line": 0.25318000812184893, "driven_lanedir_consec": 0.6173586051289615, "sim_compute_sim_state": 0.004702167510986328, "sim_compute_performance-ego": 0.007453187306722005, "sim_compute_robot_state-ego": 0.009002431233723959, "sim_compute_robot_state-npc0": 0.008886311848958333, "sim_compute_robot_state-npc1": 0.008719555536905925, "sim_compute_robot_state-npc2": 0.008905658721923828, "sim_compute_robot_state-npc3": 0.008054154713948568}, "udem1-9-0": {"driven_any": 0.45483656177104664, "sim_physics": 0.18374304513673528, "survival_time": 1.850000000000001, "driven_lanedir": 0.4388914430822646, "sim_render-ego": 0.009370816720498576, "in-drivable-lane": 0, "agent_compute-ego": 0.007155373289778426, "deviation-heading": 0.49131063474122394, "set_robot_commands": 0.006862627493368613, "deviation-center-line": 0.1166531854243332, "driven_lanedir_consec": 0.4388914430822646, "sim_compute_sim_state": 0.003848378722732131, "sim_compute_performance-ego": 0.00519297574017499, "sim_compute_robot_state-ego": 0.0065826918627764726, "sim_compute_robot_state-npc0": 0.006527365864934148, "sim_compute_robot_state-npc1": 0.006136546263823638, "sim_compute_robot_state-npc2": 0.006146720937780432, "sim_compute_robot_state-npc3": 0.006200178249462231}, "udem1-10-0": {"driven_any": 0.3648701917101222, "sim_physics": 0.14810682881262996, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552109787971164, "sim_render-ego": 0.00983769662918583, "in-drivable-lane": 0, "agent_compute-ego": 0.007688391593194777, "deviation-heading": 0.5070424162880826, "set_robot_commands": 0.0072202605585898125, "deviation-center-line": 0.1001276403534276, "driven_lanedir_consec": 0.34552109787971164, "sim_compute_sim_state": 0.004147022001204952, "sim_compute_performance-ego": 0.005325432746641098, "sim_compute_robot_state-ego": 0.00628692873062626, "sim_compute_robot_state-npc0": 0.007055113392491494, "sim_compute_robot_state-npc1": 0.006772064393566501, "sim_compute_robot_state-npc2": 0.006805581431235036, "sim_compute_robot_state-npc3": 0.006699969691614951}, "udem1-11-0": {"driven_any": 0.4098472254790859, "sim_physics": 0.17666720642763026, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054397040222266, "sim_render-ego": 0.01238375551560346, "in-drivable-lane": 0, "agent_compute-ego": 0.008766854510587804, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.008069185649647433, "deviation-center-line": 0.16731842400967326, "driven_lanedir_consec": 0.4054397040222266, "sim_compute_sim_state": 0.004927522995892693, "sim_compute_performance-ego": 0.007233381271362305, "sim_compute_robot_state-ego": 0.008188394939198214, "sim_compute_robot_state-npc0": 0.008230931618634392, "sim_compute_robot_state-npc1": 0.008460598833420697, "sim_compute_robot_state-npc2": 0.008751146933611701, "sim_compute_robot_state-npc3": 0.008788445416618796}, "udem1-12-0": {"driven_any": 1.4748273185722356, "sim_physics": 0.240355802717663, "survival_time": 5.249999999999989, "driven_lanedir": 0.3272146444894328, "sim_render-ego": 0.012236738204956054, "in-drivable-lane": 3.7999999999999887, "agent_compute-ego": 0.009990637642996653, "deviation-heading": 0.3112188917063981, "set_robot_commands": 0.009443637302943638, "deviation-center-line": 0.16525953982768174, "driven_lanedir_consec": 0.3272146444894328, "sim_compute_sim_state": 0.004662854330880302, "sim_compute_performance-ego": 0.007265395209902809, "sim_compute_robot_state-ego": 0.008885633377801804, "sim_compute_robot_state-npc0": 0.00843783560253325, "sim_compute_robot_state-npc1": 0.008151701518467494, "sim_compute_robot_state-npc2": 0.0081736269451323, "sim_compute_robot_state-npc3": 0.008128118515014649}, "udem1-13-0": {"driven_any": 0.9948273195001724, "sim_physics": 0.18004374634729672, "survival_time": 3.649999999999995, "driven_lanedir": 0.6553480498428992, "sim_render-ego": 0.011941723627586888, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.009505239251541764, "deviation-heading": 0.7740959733116568, "set_robot_commands": 0.008600956773104733, "deviation-center-line": 0.19736301642105017, "driven_lanedir_consec": 0.6553480498428992, "sim_compute_sim_state": 0.004580409559485031, "sim_compute_performance-ego": 0.006949365955509552, "sim_compute_robot_state-ego": 0.00898482374948998, "sim_compute_robot_state-npc0": 0.008146393789003973, "sim_compute_robot_state-npc1": 0.007639630200111703, "sim_compute_robot_state-npc2": 0.008101861770838907, "sim_compute_robot_state-npc3": 0.007719278335571289}, "udem1-14-0": {"driven_any": 1.219827318592, "sim_physics": 0.20810855789618057, "survival_time": 4.399999999999992, "driven_lanedir": 0.6539905402707253, "sim_render-ego": 0.01206152547489513, "in-drivable-lane": 1.2499999999999962, "agent_compute-ego": 0.010617283257571134, "deviation-heading": 1.8192903310562811, "set_robot_commands": 0.009837172248146751, "deviation-center-line": 0.26377380229393954, "driven_lanedir_consec": 0.4674075261701268, "sim_compute_sim_state": 0.004776355895129117, "sim_compute_performance-ego": 0.006992413239045577, "sim_compute_robot_state-ego": 0.008941620588302612, "sim_compute_robot_state-npc0": 0.008809200742027977, "sim_compute_robot_state-npc1": 0.008337977257641878, "sim_compute_robot_state-npc2": 0.008285389705137773, "sim_compute_robot_state-npc3": 0.008286318995735863}}
set_robot_commands_max0.010809613512707997
set_robot_commands_mean0.008887051399854231
set_robot_commands_median0.009018283901792584
set_robot_commands_min0.006862627493368613
sim_compute_performance-ego_max0.007453187306722005
sim_compute_performance-ego_mean0.006769216905524106
sim_compute_performance-ego_median0.007118785020076867
sim_compute_performance-ego_min0.00519297574017499
sim_compute_robot_state-ego_max0.009388000934154955
sim_compute_robot_state-ego_mean0.008416571283789698
sim_compute_robot_state-ego_median0.008885633377801804
sim_compute_robot_state-ego_min0.00628692873062626
sim_compute_robot_state-npc0_max0.009006170247564253
sim_compute_robot_state-npc0_mean0.008061433672157283
sim_compute_robot_state-npc0_median0.008230931618634392
sim_compute_robot_state-npc0_min0.006182213087339659
sim_compute_robot_state-npc1_max0.008719555536905925
sim_compute_robot_state-npc1_mean0.007912210196421512
sim_compute_robot_state-npc1_median0.008151701518467494
sim_compute_robot_state-npc1_min0.006136546263823638
sim_compute_robot_state-npc2_max0.008905658721923828
sim_compute_robot_state-npc2_mean0.00793273790318447
sim_compute_robot_state-npc2_median0.0081736269451323
sim_compute_robot_state-npc2_min0.006146720937780432
sim_compute_robot_state-npc3_max0.008788445416618796
sim_compute_robot_state-npc3_mean0.007787004665263868
sim_compute_robot_state-npc3_median0.008002590488743138
sim_compute_robot_state-npc3_min0.006200178249462231
sim_compute_sim_state_max0.005306656296188767
sim_compute_sim_state_mean0.004607976632648533
sim_compute_sim_state_median0.004702167510986328
sim_compute_sim_state_min0.003658356967273059
sim_physics_max0.2591646361995388
sim_physics_mean0.1929477065809451
sim_physics_median0.18521582893052027
sim_physics_min0.13558700063207127
sim_render-ego_max0.013370153066274282
sim_render-ego_mean0.01167617555257911
sim_render-ego_median0.012106256051497026
sim_render-ego_min0.008938937573819547
simulation-passed1
survival_time_max9.55
survival_time_mean3.939999999999995
survival_time_min1.5500000000000007
No reset possible
249794165Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LFV-sim-testingstep1-simulationerrornoip-172-31-35-218-104910:01:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249734171Bhairav Mehtachallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationfailednoip-172-31-35-218-104910:01:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 36, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 9, in preprocess
               ||     from scipy.misc import imresize
               || ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249544190Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:06:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.5999999999999988
deviation-center-line_median0.16987818035809085
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.026281523448164743
agent_compute-ego_mean0.023363268283855498
agent_compute-ego_median0.0232236310839653
agent_compute-ego_min0.02082446595312844
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.14972083567701736
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330367
deviation-heading_mean0.4280304166285302
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829773
driven_any_max1.2972979671834337
driven_any_mean0.7173901327940223
driven_any_median0.7336463183586179
driven_any_min0.26903550091980144
driven_lanedir_consec_max0.97716132702229
driven_lanedir_consec_mean0.5227475277218055
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max0.97716132702229
driven_lanedir_mean0.5227475277218055
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2407721645627201
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.5799999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.1183325169791638, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.009764631029585715, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.02082446595312844, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.007254462846567933, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0043112929438201475, "sim_compute_performance-ego": 0.0057386143106809805, "sim_compute_robot_state-ego": 0.007066552068146182, "sim_compute_robot_state-npc0": 0.006692503539609237, "sim_compute_robot_state-npc1": 0.006513672815242284, "sim_compute_robot_state-npc2": 0.006748390869355537, "sim_compute_robot_state-npc3": 0.006567894572943029}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953953, "sim_physics": 0.18925592303276065, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.01913231611251831, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0232236310839653, "deviation-heading": 0.6986268167330367, "set_robot_commands": 0.008659668266773224, "deviation-center-line": 0.10463456752710912, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.004802152514457703, "sim_compute_performance-ego": 0.007533945143222809, "sim_compute_robot_state-ego": 0.009189851582050323, "sim_compute_robot_state-npc0": 0.008822299540042877, "sim_compute_robot_state-npc1": 0.008514009416103363, "sim_compute_robot_state-npc2": 0.008380092680454254, "sim_compute_robot_state-npc3": 0.008665233850479126}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586179, "sim_physics": 0.1952024331459632, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.013512817712930532, "in-drivable-lane": 0, "agent_compute-ego": 0.02401284071115347, "deviation-heading": 0.27230767118055227, "set_robot_commands": 0.00913894634980422, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.005255722082578219, "sim_compute_performance-ego": 0.007141470909118652, "sim_compute_robot_state-ego": 0.009057764823620137, "sim_compute_robot_state-npc0": 0.00886391676389254, "sim_compute_robot_state-npc1": 0.008672512494600736, "sim_compute_robot_state-npc2": 0.009073569224430963, "sim_compute_robot_state-npc3": 0.008719861507415771}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.22799147841750936, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.013114703598842826, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.026281523448164743, "deviation-heading": 0.49111273392260785, "set_robot_commands": 0.010484649289038871, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.005595578942247616, "sim_compute_performance-ego": 0.007731663283481393, "sim_compute_robot_state-ego": 0.00966556097871514, "sim_compute_robot_state-npc0": 0.009513555034514396, "sim_compute_robot_state-npc1": 0.00918939805799915, "sim_compute_robot_state-npc2": 0.009308099746704102, "sim_compute_robot_state-npc3": 0.009242675637686123}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.1432046549660819, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.010896750858851842, "in-drivable-lane": 0, "agent_compute-ego": 0.022473880222865512, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.00909235363914853, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.004520234607514881, "sim_compute_performance-ego": 0.0063486553373790925, "sim_compute_robot_state-ego": 0.007789396104358491, "sim_compute_robot_state-npc0": 0.007546209153674897, "sim_compute_robot_state-npc1": 0.007253124600365048, "sim_compute_robot_state-npc2": 0.007365169979277111, "sim_compute_robot_state-npc3": 0.007351909364972796}}
set_robot_commands_max0.010484649289038871
set_robot_commands_mean0.008926016078266557
set_robot_commands_median0.00909235363914853
set_robot_commands_min0.007254462846567933
sim_compute_performance-ego_max0.007731663283481393
sim_compute_performance-ego_mean0.006898869796776586
sim_compute_performance-ego_median0.007141470909118652
sim_compute_performance-ego_min0.0057386143106809805
sim_compute_robot_state-ego_max0.00966556097871514
sim_compute_robot_state-ego_mean0.008553825111378054
sim_compute_robot_state-ego_median0.009057764823620137
sim_compute_robot_state-ego_min0.007066552068146182
sim_compute_robot_state-npc0_max0.009513555034514396
sim_compute_robot_state-npc0_mean0.00828769680634679
sim_compute_robot_state-npc0_median0.008822299540042877
sim_compute_robot_state-npc0_min0.006692503539609237
sim_compute_robot_state-npc1_max0.00918939805799915
sim_compute_robot_state-npc1_mean0.008028543476862117
sim_compute_robot_state-npc1_median0.008514009416103363
sim_compute_robot_state-npc1_min0.006513672815242284
sim_compute_robot_state-npc2_max0.009308099746704102
sim_compute_robot_state-npc2_mean0.008175064500044394
sim_compute_robot_state-npc2_median0.008380092680454254
sim_compute_robot_state-npc2_min0.006748390869355537
sim_compute_robot_state-npc3_max0.009242675637686123
sim_compute_robot_state-npc3_mean0.00810951498669937
sim_compute_robot_state-npc3_median0.008665233850479126
sim_compute_robot_state-npc3_min0.006567894572943029
sim_compute_sim_state_max0.005595578942247616
sim_compute_sim_state_mean0.004896996218123713
sim_compute_sim_state_median0.004802152514457703
sim_compute_sim_state_min0.0043112929438201475
sim_physics_max0.22799147841750936
sim_physics_mean0.17479740130829577
sim_physics_median0.18925592303276065
sim_physics_min0.1183325169791638
sim_render-ego_max0.01913231611251831
sim_render-ego_mean0.013284243862545848
sim_render-ego_median0.013114703598842826
sim_render-ego_min0.009764631029585715
simulation-passed1
survival_time_max4.6499999999999915
survival_time_mean2.6899999999999973
survival_time_min1.0500000000000005
No reset possible
249424210Bhairav Mehtachallenge-aido_LF-template-pytorchaido3-LFV-sim-validationstep1-simulationfailednoip-172-31-35-218-104910:03:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249124237Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104910:11:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4126113388371666
survival_time_median2.6999999999999984
deviation-center-line_median0.1187177598523136
in-drivable-lane_median0.9499999999999976


other stats
agent_compute-ego_max0.025997209548950195
agent_compute-ego_mean0.02429119243571757
agent_compute-ego_median0.024318540599984183
agent_compute-ego_min0.020958671203026406
deviation-center-line_max0.2616199012603187
deviation-center-line_mean0.12663752615997417
deviation-center-line_min0.07143676193760398
deviation-heading_max1.4563581054906
deviation-heading_mean0.5551840294909584
deviation-heading_median0.55940705176748
deviation-heading_min0.2596285487829773
driven_any_max1.6839250134630204
driven_any_mean0.7327294413370019
driven_any_median0.7309130538792374
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.9416535020294268
driven_lanedir_consec_mean0.4469104002974222
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.9416535020294268
driven_lanedir_mean0.4469104002974222
driven_lanedir_median0.4126113388371666
driven_lanedir_min0.2221238695940002
in-drivable-lane_max2.1499999999999924
in-drivable-lane_mean0.8233333333333307
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.102070496115886, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.012282398385061344, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.024318540599984183, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.009160129117294096, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.004918746545281209, "sim_compute_performance-ego": 0.007479080012146856, "sim_compute_robot_state-ego": 0.009052387425597283}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811183, "sim_physics": 0.12183967034022011, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572033, "sim_render-ego": 0.013287075360616048, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.024950738747914633, "deviation-heading": 0.5809378480871985, "set_robot_commands": 0.010534199078877766, "deviation-center-line": 0.11667593935453972, "driven_lanedir_consec": 0.6632135184572033, "sim_compute_sim_state": 0.005605260531107585, "sim_compute_performance-ego": 0.007553033034006755, "sim_compute_robot_state-ego": 0.009548449516296386}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.13725125789642334, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.012127020142295143, "in-drivable-lane": 0, "agent_compute-ego": 0.023370081728154964, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.009512955492193048, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.004827651110562411, "sim_compute_performance-ego": 0.00698222897269509, "sim_compute_robot_state-ego": 0.009566838091070002}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.1320295731226603, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.012916609644889832, "in-drivable-lane": 0, "agent_compute-ego": 0.024631539980570476, "deviation-heading": 0.568524016017798, "set_robot_commands": 0.010580907265345257, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.004973158240318298, "sim_compute_performance-ego": 0.007389679551124573, "sim_compute_robot_state-ego": 0.009387393792470297}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6091462024047467, "sim_physics": 0.12077524351037068, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.012914092644401218, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.025256467902142067, "deviation-heading": 0.33908617460335944, "set_robot_commands": 0.010277665179708729, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.005142341489377229, "sim_compute_performance-ego": 0.007343986760015073, "sim_compute_robot_state-ego": 0.00929087141285772}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.3217723172279551, "sim_physics": 0.10724002122879028, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.01233630379041036, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.024056464433670044, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.009042719999949137, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.004564762115478516, "sim_compute_performance-ego": 0.007222851117451985, "sim_compute_robot_state-ego": 0.008143375317255655}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466092, "sim_physics": 0.10167405238518348, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.012764851252237955, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.024883190790812176, "deviation-heading": 0.6586708623908945, "set_robot_commands": 0.009503309543316182, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.005001327930352626, "sim_compute_performance-ego": 0.007377398319733448, "sim_compute_robot_state-ego": 0.008640503272032127}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048737, "sim_physics": 0.10584901486124312, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.012834842715944563, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.024060449429920742, "deviation-heading": 0.6465417997696937, "set_robot_commands": 0.008730679750442505, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.0050255400793893, "sim_compute_performance-ego": 0.007197469472885132, "sim_compute_robot_state-ego": 0.008862180369240897}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0820250408860437, "sim_physics": 0.1028118791251347, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.013941277032611011, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.022388913165563823, "deviation-heading": 0.613751936282656, "set_robot_commands": 0.008346505548762179, "deviation-center-line": 0.1187177598523136, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.004388970890264401, "sim_compute_performance-ego": 0.007082911743514839, "sim_compute_robot_state-ego": 0.008400316896109745}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630204, "sim_physics": 0.12967492233623157, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.012540830265391956, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.02555159005251798, "deviation-heading": 1.4563581054906, "set_robot_commands": 0.009860855882818048, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.005055243318731134, "sim_compute_performance-ego": 0.007410049438476563, "sim_compute_robot_state-ego": 0.009401258555325595}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.26677752846248903, "sim_physics": 0.1327558159828186, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.013588170210520426, "in-drivable-lane": 0, "agent_compute-ego": 0.02572178840637207, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.010818978150685629, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.00515069564183553, "sim_compute_performance-ego": 0.007587134838104248, "sim_compute_robot_state-ego": 0.010235538085301718}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387629, "sim_physics": 0.10723806356454824, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.012316877191716974, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.02425304945413168, "deviation-heading": 0.5216992361385433, "set_robot_commands": 0.009752954755510603, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.005018410744605127, "sim_compute_performance-ego": 0.007219032807783647, "sim_compute_robot_state-ego": 0.009664092745099748}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.10451084613800048, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.012086987495422363, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.025997209548950195, "deviation-heading": 0.4739455376152245, "set_robot_commands": 0.010556774139404297, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.005422134399414063, "sim_compute_performance-ego": 0.0069923210144042965, "sim_compute_robot_state-ego": 0.008656635284423828}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.0805417666068444, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.010220876106849084, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.020958671203026406, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.007579620067889874, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.004555830588707557, "sim_compute_performance-ego": 0.005514254936805138, "sim_compute_robot_state-ego": 0.007090293444119967}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792374, "sim_physics": 0.102464583184984, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.011735496697602448, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.023969191092031973, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.008589903513590494, "deviation-center-line": 0.12406277512673572, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.004662447505527073, "sim_compute_performance-ego": 0.006806020383481626, "sim_compute_robot_state-ego": 0.008054071002536349}}
set_robot_commands_max0.010818978150685629
set_robot_commands_mean0.009523210499052522
set_robot_commands_median0.009512955492193048
set_robot_commands_min0.007579620067889874
sim_compute_performance-ego_max0.007587134838104248
sim_compute_performance-ego_mean0.007143830160175285
sim_compute_performance-ego_median0.007222851117451985
sim_compute_performance-ego_min0.005514254936805138
sim_compute_robot_state-ego_max0.010235538085301718
sim_compute_robot_state-ego_mean0.008932947013982487
sim_compute_robot_state-ego_median0.009052387425597283
sim_compute_robot_state-ego_min0.007090293444119967
sim_compute_sim_state_max0.005605260531107585
sim_compute_sim_state_mean0.004954168075396804
sim_compute_sim_state_median0.005001327930352626
sim_compute_sim_state_min0.004388970890264401
sim_physics_max0.13725125789642334
sim_physics_mean0.11258181375995592
sim_physics_median0.10723806356454824
sim_physics_min0.0805417666068444
sim_render-ego_max0.013941277032611011
sim_render-ego_mean0.012526247262398049
sim_render-ego_median0.012540830265391956
sim_render-ego_min0.010220876106849084
simulation-passed1
survival_time_max5.4999999999999885
survival_time_mean2.7766666666666637
survival_time_min1.1000000000000003
No reset possible
248874261Gianmarco Bernasconichallenge-aido_LF-baseline-duckietownaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104910:32:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.043723040631585
survival_time_median10.95000000000002
deviation-center-line_median0.5365579504967247
in-drivable-lane_median0.3500000000000032


other stats
agent_compute-ego_max0.08522682364394026
agent_compute-ego_mean0.0501307295336677
agent_compute-ego_median0.050892727715628486
agent_compute-ego_min0.02457580016209529
deviation-center-line_max1.2188676588919043
deviation-center-line_mean0.6188780045605459
deviation-center-line_min0.1508374093216363
deviation-heading_max5.685680173860553
deviation-heading_mean2.4682024524941877
deviation-heading_median2.5113793344784185
deviation-heading_min0.6298686799702061
driven_any_max2.349155174919098
driven_any_mean1.5191650741655809
driven_any_median1.7060006819163087
driven_any_min0.45258338264198766
driven_lanedir_consec_max2.325241449185567
driven_lanedir_consec_mean1.1176403026778938
driven_lanedir_consec_min0.4238445211188213
driven_lanedir_max2.325241449185567
driven_lanedir_mean1.1623999280438482
driven_lanedir_median1.043723040631585
driven_lanedir_min0.4238445211188213
in-drivable-lane_max6.100000000000052
in-drivable-lane_mean1.5200000000000111
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5494162896394557, "sim_physics": 0.12687729220641286, "survival_time": 3.7999999999999945, "driven_lanedir": 0.49494992736889953, "sim_render-ego": 0.013285207120995773, "in-drivable-lane": 0, "agent_compute-ego": 0.03258775096190603, "deviation-heading": 1.237551741247981, "set_robot_commands": 0.011425357115896125, "deviation-center-line": 0.2945997576463044, "driven_lanedir_consec": 0.49494992736889953, "sim_compute_sim_state": 0.006416292567002146, "sim_compute_performance-ego": 0.008423786414297004, "sim_compute_robot_state-ego": 0.010546282718056127}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0352503957071857, "sim_physics": 0.07330601031963642, "survival_time": 13.00000000000005, "driven_lanedir": 1.349541915750465, "sim_render-ego": 0.008783250588637131, "in-drivable-lane": 2.2500000000000115, "agent_compute-ego": 0.02457580016209529, "deviation-heading": 5.685680173860553, "set_robot_commands": 0.008339958007519062, "deviation-center-line": 0.863284298044201, "driven_lanedir_consec": 1.0841415237865282, "sim_compute_sim_state": 0.004373046985039345, "sim_compute_performance-ego": 0.005063016598041241, "sim_compute_robot_state-ego": 0.0066962113747229945}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8427647543297512, "sim_physics": 0.11781629869493387, "survival_time": 11.800000000000033, "driven_lanedir": 1.280179188390144, "sim_render-ego": 0.013216038881722144, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.04603272171343787, "deviation-heading": 2.914831077689947, "set_robot_commands": 0.010674174559318413, "deviation-center-line": 0.42919845322062866, "driven_lanedir_consec": 1.280179188390144, "sim_compute_sim_state": 0.0063823047330824, "sim_compute_performance-ego": 0.007796627990270065, "sim_compute_robot_state-ego": 0.010122010263346007}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.2681940346451266, "sim_physics": 0.10929829356579632, "survival_time": 14.45000000000007, "driven_lanedir": 1.0365549578831303, "sim_render-ego": 0.012940436498516571, "in-drivable-lane": 5.450000000000048, "agent_compute-ego": 0.04954379900104034, "deviation-heading": 5.320290185641131, "set_robot_commands": 0.009872290502370025, "deviation-center-line": 0.5365579504967247, "driven_lanedir_consec": 0.9052346933291352, "sim_compute_sim_state": 0.005300752844364998, "sim_compute_performance-ego": 0.00791890233445745, "sim_compute_robot_state-ego": 0.00941462335289556}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2802077973556132, "sim_physics": 0.10865419169506396, "survival_time": 8.299999999999983, "driven_lanedir": 1.0874844088372169, "sim_render-ego": 0.013072446168187151, "in-drivable-lane": 0.3500000000000032, "agent_compute-ego": 0.05297661689390619, "deviation-heading": 2.777029792419968, "set_robot_commands": 0.009189233722456967, "deviation-center-line": 0.6036799242423788, "driven_lanedir_consec": 1.0874844088372169, "sim_compute_sim_state": 0.005524992942810059, "sim_compute_performance-ego": 0.0074911534068096116, "sim_compute_robot_state-ego": 0.009756010698984904}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.348969861068425, "sim_physics": 0.13033366918563843, "survival_time": 14.950000000000076, "driven_lanedir": 1.2421900252598417, "sim_render-ego": 0.013035720984141031, "in-drivable-lane": 6.100000000000052, "agent_compute-ego": 0.0527520473798116, "deviation-heading": 2.9425624272801634, "set_robot_commands": 0.010780553023020426, "deviation-center-line": 0.7796414421052108, "driven_lanedir_consec": 1.2421900252598417, "sim_compute_sim_state": 0.005675628185272217, "sim_compute_performance-ego": 0.007928099632263184, "sim_compute_robot_state-ego": 0.009844292004903155}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5088287154453232, "sim_physics": 0.1253878355026245, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45261889461514615, "sim_render-ego": 0.014013143948146276, "in-drivable-lane": 0, "agent_compute-ego": 0.05755559716905866, "deviation-heading": 1.16072496088325, "set_robot_commands": 0.010542586871555874, "deviation-center-line": 0.1508374093216363, "driven_lanedir_consec": 0.45261889461514615, "sim_compute_sim_state": 0.005696303503853934, "sim_compute_performance-ego": 0.008030567850385393, "sim_compute_robot_state-ego": 0.00961237975529262}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.2641264233833371, "sim_physics": 0.1439748202882162, "survival_time": 8.199999999999982, "driven_lanedir": 1.043723040631585, "sim_render-ego": 0.014589724017352592, "in-drivable-lane": 0.5999999999999996, "agent_compute-ego": 0.08522682364394026, "deviation-heading": 2.4386101402325533, "set_robot_commands": 0.012747388060499982, "deviation-center-line": 0.5101657375112428, "driven_lanedir_consec": 1.043723040631585, "sim_compute_sim_state": 0.0060783348432401334, "sim_compute_performance-ego": 0.008484077162858917, "sim_compute_robot_state-ego": 0.011299586877590272}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3491399547737934, "sim_physics": 0.08626500129699707, "survival_time": 14.950000000000076, "driven_lanedir": 2.295906102709081, "sim_render-ego": 0.01024328629175822, "in-drivable-lane": 0, "agent_compute-ego": 0.043805445035298665, "deviation-heading": 2.5113793344784185, "set_robot_commands": 0.007535929679870605, "deviation-center-line": 1.1674591318172447, "driven_lanedir_consec": 2.295906102709081, "sim_compute_sim_state": 0.0041316509246826175, "sim_compute_performance-ego": 0.00592191219329834, "sim_compute_robot_state-ego": 0.007440577348073324}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.45258338264198766, "sim_physics": 0.10787408692496164, "survival_time": 3.149999999999997, "driven_lanedir": 0.4238445211188213, "sim_render-ego": 0.01292238159785195, "in-drivable-lane": 0, "agent_compute-ego": 0.050892727715628486, "deviation-heading": 0.6298686799702061, "set_robot_commands": 0.00944904675559392, "deviation-center-line": 0.21850366573057245, "driven_lanedir_consec": 0.4238445211188213, "sim_compute_sim_state": 0.00517227536156064, "sim_compute_performance-ego": 0.007242918014526367, "sim_compute_robot_state-ego": 0.00938868901086232}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.023151912404619, "sim_physics": 0.14060568809509277, "survival_time": 6.699999999999984, "driven_lanedir": 0.9947697563345907, "sim_render-ego": 0.01374202166030656, "in-drivable-lane": 0, "agent_compute-ego": 0.05569945164580843, "deviation-heading": 1.0289105809764196, "set_robot_commands": 0.0109585737114522, "deviation-center-line": 0.6431605461220412, "driven_lanedir_consec": 0.9947697563345907, "sim_compute_sim_state": 0.0056951419631047035, "sim_compute_performance-ego": 0.008269770821528648, "sim_compute_robot_state-ego": 0.010574173571458505}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4606296914942887, "sim_physics": 0.12705952674150467, "survival_time": 3.1999999999999966, "driven_lanedir": 0.43784370460383226, "sim_render-ego": 0.012492775917053224, "in-drivable-lane": 0, "agent_compute-ego": 0.05324351415038109, "deviation-heading": 0.6424090959582407, "set_robot_commands": 0.010260626673698424, "deviation-center-line": 0.22593016856591996, "driven_lanedir_consec": 0.43784370460383226, "sim_compute_sim_state": 0.005081355571746826, "sim_compute_performance-ego": 0.007117606699466705, "sim_compute_robot_state-ego": 0.009041979908943176}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.7060006819163087, "sim_physics": 0.11272841501453695, "survival_time": 10.95000000000002, "driven_lanedir": 0.9659276267102456, "sim_render-ego": 0.013154647121690724, "in-drivable-lane": 3.7999999999999927, "agent_compute-ego": 0.05127329586847732, "deviation-heading": 2.737556758783904, "set_robot_commands": 0.009972011661965008, "deviation-center-line": 0.441829240251344, "driven_lanedir_consec": 0.8502868978890528, "sim_compute_sim_state": 0.005446171651692151, "sim_compute_performance-ego": 0.008038974788090954, "sim_compute_robot_state-ego": 0.009744937017083712}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.349155174919098, "sim_physics": 0.11270177205403646, "survival_time": 14.950000000000076, "driven_lanedir": 2.325241449185567, "sim_render-ego": 0.012270816167195638, "in-drivable-lane": 0, "agent_compute-ego": 0.046414484977722166, "deviation-heading": 1.8333135887820275, "set_robot_commands": 0.00982846180597941, "deviation-center-line": 1.1994546844408336, "driven_lanedir_consec": 2.325241449185567, "sim_compute_sim_state": 0.0051720937093098955, "sim_compute_performance-ego": 0.007370376586914062, "sim_compute_robot_state-ego": 0.009293887615203856}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.349057042759396, "sim_physics": 0.10899268627166749, "survival_time": 14.950000000000076, "driven_lanedir": 2.0052234012591565, "sim_render-ego": 0.01246097485224406, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.04938086668650309, "deviation-heading": 3.1623182492080533, "set_robot_commands": 0.009707536697387695, "deviation-center-line": 1.2188676588919043, "driven_lanedir_consec": 1.8461904061089665, "sim_compute_sim_state": 0.0051787662506103515, "sim_compute_performance-ego": 0.007674617767333984, "sim_compute_robot_state-ego": 0.009244943459828694}}
set_robot_commands_max0.012747388060499982
set_robot_commands_mean0.010085581923238942
set_robot_commands_median0.009972011661965008
set_robot_commands_min0.007535929679870605
sim_compute_performance-ego_max0.008484077162858917
sim_compute_performance-ego_mean0.007518160550702794
sim_compute_performance-ego_median0.007796627990270065
sim_compute_performance-ego_min0.005063016598041241
sim_compute_robot_state-ego_max0.011299586877590272
sim_compute_robot_state-ego_mean0.009468038998483017
sim_compute_robot_state-ego_median0.00961237975529262
sim_compute_robot_state-ego_min0.0066962113747229945
sim_compute_sim_state_max0.006416292567002146
sim_compute_sim_state_mean0.0054216741358248275
sim_compute_sim_state_median0.005446171651692151
sim_compute_sim_state_min0.0041316509246826175
sim_physics_max0.1439748202882162
sim_physics_mean0.115458372523808
sim_physics_median0.11272841501453695
sim_physics_min0.07330601031963642
sim_render-ego_max0.014589724017352592
sim_render-ego_mean0.012681524787719936
sim_render-ego_median0.013035720984141031
sim_render-ego_min0.008783250588637131
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.790000000000028
survival_time_min3.149999999999997
No reset possible
248814265Gianmarco Bernasconichallenge-aido_LF-baseline-duckietownaido3-LFV-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:02:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
248774272Riza Velioglu 🇩🇪Uni Bielefeldaido3-LFV-sim-testingstep1-simulationerrornoip-172-31-35-218-104910:00:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
248734273Riza Velioglu 🇩🇪Uni Bielefeldaido3-LFV-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:00:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
248724276Riza Velioglu 🇩🇪Uni Bielefeldaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:00:53
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
248664285Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.01938955307006836
agent_compute-ego_mean0.017693908948202348
agent_compute-ego_median0.017848899092855332
agent_compute-ego_min0.015596416261461046
deviation-center-line_max0.17439134565029044
deviation-center-line_mean0.1265175655253199
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599271
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811225
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589055
driven_any_mean1.0272530755098268
driven_any_median1.0243289631429704
driven_any_min0.4119037580118985
driven_lanedir_consec_max1.2433038249708372
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708372
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.10095771595283792, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.008428251301800763, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.015596416261461046, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.006555155471519187, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.00325522157880995, "sim_compute_performance-ego": 0.00487965566140634, "sim_compute_robot_state-ego": 0.005974645967836733, "sim_compute_robot_state-npc0": 0.005835082795884874, "sim_compute_robot_state-npc1": 0.005521827273898655, "sim_compute_robot_state-npc2": 0.005572129178930212, "sim_compute_robot_state-npc3": 0.0054136161450986505}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.15724183082580567, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.010830907821655274, "in-drivable-lane": 0, "agent_compute-ego": 0.01938955307006836, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.008154983520507813, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.003858671188354492, "sim_compute_performance-ego": 0.006213607788085937, "sim_compute_robot_state-ego": 0.007716970443725586, "sim_compute_robot_state-npc0": 0.006859340667724609, "sim_compute_robot_state-npc1": 0.006763086318969726, "sim_compute_robot_state-npc2": 0.006659917831420899, "sim_compute_robot_state-npc3": 0.006804132461547851}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.13352255131068982, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.009166692432604338, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.017516848288084332, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.006776405008215653, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.003762176162318179, "sim_compute_performance-ego": 0.005241161898562783, "sim_compute_robot_state-ego": 0.006748409647690623, "sim_compute_robot_state-npc0": 0.006312699694382517, "sim_compute_robot_state-npc1": 0.0061083373270536725, "sim_compute_robot_state-npc2": 0.0060019085281773615, "sim_compute_robot_state-npc3": 0.005991292627234208}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.14312518699259696, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.00961667676515217, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.017848899092855332, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.007167704497711568, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.003899876075454905, "sim_compute_performance-ego": 0.00545438030098058, "sim_compute_robot_state-ego": 0.006845528566384617, "sim_compute_robot_state-npc0": 0.006641384921496427, "sim_compute_robot_state-npc1": 0.00642646113528481, "sim_compute_robot_state-npc2": 0.00632681122309045, "sim_compute_robot_state-npc3": 0.0063678131827825234}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.10174920729228427, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.008583128452301025, "in-drivable-lane": 0, "agent_compute-ego": 0.018117828028542653, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.006681927612849644, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.0032811505453927176, "sim_compute_performance-ego": 0.0048029763357979914, "sim_compute_robot_state-ego": 0.005918587957109723, "sim_compute_robot_state-npc0": 0.005712849753243583, "sim_compute_robot_state-npc1": 0.00558347361428397, "sim_compute_robot_state-npc2": 0.005550001348767962, "sim_compute_robot_state-npc3": 0.005626678466796875}}
set_robot_commands_max0.008154983520507813
set_robot_commands_mean0.007067235222160772
set_robot_commands_median0.006776405008215653
set_robot_commands_min0.006555155471519187
sim_compute_performance-ego_max0.006213607788085937
sim_compute_performance-ego_mean0.005318356396966726
sim_compute_performance-ego_median0.005241161898562783
sim_compute_performance-ego_min0.0048029763357979914
sim_compute_robot_state-ego_max0.007716970443725586
sim_compute_robot_state-ego_mean0.006640828516549456
sim_compute_robot_state-ego_median0.006748409647690623
sim_compute_robot_state-ego_min0.005918587957109723
sim_compute_robot_state-npc0_max0.006859340667724609
sim_compute_robot_state-npc0_mean0.006272271566546403
sim_compute_robot_state-npc0_median0.006312699694382517
sim_compute_robot_state-npc0_min0.005712849753243583
sim_compute_robot_state-npc1_max0.006763086318969726
sim_compute_robot_state-npc1_mean0.006080637133898167
sim_compute_robot_state-npc1_median0.0061083373270536725
sim_compute_robot_state-npc1_min0.005521827273898655
sim_compute_robot_state-npc2_max0.006659917831420899
sim_compute_robot_state-npc2_mean0.006022153622077377
sim_compute_robot_state-npc2_median0.0060019085281773615
sim_compute_robot_state-npc2_min0.005550001348767962
sim_compute_robot_state-npc3_max0.006804132461547851
sim_compute_robot_state-npc3_mean0.006040706576692022
sim_compute_robot_state-npc3_median0.005991292627234208
sim_compute_robot_state-npc3_min0.0054136161450986505
sim_compute_sim_state_max0.003899876075454905
sim_compute_sim_state_mean0.003611419110066049
sim_compute_sim_state_median0.003762176162318179
sim_compute_sim_state_min0.00325522157880995
sim_physics_max0.15724183082580567
sim_physics_mean0.12731929847484294
sim_physics_median0.13352255131068982
sim_physics_min0.10095771595283792
sim_render-ego_max0.010830907821655274
sim_render-ego_mean0.009325131354702714
sim_render-ego_median0.009166692432604338
sim_render-ego_min0.008428251301800763
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
248614294Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.01819678197933149
agent_compute-ego_mean0.016432929451258297
agent_compute-ego_median0.017371261821073646
agent_compute-ego_min0.014261960983276367
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989765
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.6182144577009443
driven_any_mean0.861378585933269
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.07062402036454943, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.007725424236721463, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.014484617445203992, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.005875552142107928, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.003296966905947085, "sim_compute_performance-ego": 0.004542487638968008, "sim_compute_robot_state-ego": 0.00552438806604456}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.06449640965929218, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.00790118703655168, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.017850025027405982, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.00605619654935949, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0031741880903057022, "sim_compute_performance-ego": 0.004399299621582031, "sim_compute_robot_state-ego": 0.0057404649023916204}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.07884477166568532, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.010545099482816808, "in-drivable-lane": 0, "agent_compute-ego": 0.017371261821073646, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.00755914519814884, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0041239261627197266, "sim_compute_performance-ego": 0.005286118563483743, "sim_compute_robot_state-ego": 0.006808841929716223}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.0698995590209961, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.007654619216918945, "in-drivable-lane": 0, "agent_compute-ego": 0.014261960983276367, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.0057850837707519535, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0032087993621826173, "sim_compute_performance-ego": 0.0042564296722412106, "sim_compute_robot_state-ego": 0.005469760894775391}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.07458898689173445, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.009707637980014464, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.01819678197933149, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.007084436054471173, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.003961022896102712, "sim_compute_performance-ego": 0.00552681729763369, "sim_compute_robot_state-ego": 0.00669033014321629}}
set_robot_commands_max0.00755914519814884
set_robot_commands_mean0.006472082742967876
set_robot_commands_median0.00605619654935949
set_robot_commands_min0.0057850837707519535
sim_compute_performance-ego_max0.00552681729763369
sim_compute_performance-ego_mean0.004802230558781736
sim_compute_performance-ego_median0.004542487638968008
sim_compute_performance-ego_min0.0042564296722412106
sim_compute_robot_state-ego_max0.006808841929716223
sim_compute_robot_state-ego_mean0.006046757187228817
sim_compute_robot_state-ego_median0.0057404649023916204
sim_compute_robot_state-ego_min0.005469760894775391
sim_compute_sim_state_max0.0041239261627197266
sim_compute_sim_state_mean0.003552980683451568
sim_compute_sim_state_median0.003296966905947085
sim_compute_sim_state_min0.0031741880903057022
sim_physics_max0.07884477166568532
sim_physics_mean0.07169074952045149
sim_physics_median0.07062402036454943
sim_physics_min0.06449640965929218
sim_render-ego_max0.010545099482816808
sim_render-ego_mean0.00870679359060467
sim_render-ego_median0.00790118703655168
sim_render-ego_min0.007654619216918945
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
248584297Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:04:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.022947950363159175
agent_compute-ego_mean0.018347660310485507
agent_compute-ego_median0.017188872609819685
agent_compute-ego_min0.016998767852783203
deviation-center-line_max0.17439134565029044
deviation-center-line_mean0.1265175655253199
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599271
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811225
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589055
driven_any_mean1.0272530755098268
driven_any_median1.0243289631429704
driven_any_min0.4119037580118985
driven_lanedir_consec_max1.2433038249708372
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708372
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.10430832262392398, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.00831700254369665, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.01714532905154758, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.006255136595831977, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.003437788398177535, "sim_compute_performance-ego": 0.004710135636506257, "sim_compute_robot_state-ego": 0.005969550874498155, "sim_compute_robot_state-npc0": 0.006000351022790979, "sim_compute_robot_state-npc1": 0.005829806681032534, "sim_compute_robot_state-npc2": 0.005709352316679778, "sim_compute_robot_state-npc3": 0.005619472927517361}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.18026962280273437, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.011897850036621091, "in-drivable-lane": 0, "agent_compute-ego": 0.022947950363159175, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.00986618995666504, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.004618644714355469, "sim_compute_performance-ego": 0.006656780242919922, "sim_compute_robot_state-ego": 0.008297910690307617, "sim_compute_robot_state-npc0": 0.008298091888427735, "sim_compute_robot_state-npc1": 0.00803257942199707, "sim_compute_robot_state-npc2": 0.007959604263305664, "sim_compute_robot_state-npc3": 0.008026466369628907}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12646005655589856, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.009097754955291748, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.017457381675117893, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.006912607895700555, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.003572533005162289, "sim_compute_performance-ego": 0.005247655667756733, "sim_compute_robot_state-ego": 0.006485857461628161, "sim_compute_robot_state-npc0": 0.006156497880032188, "sim_compute_robot_state-npc1": 0.005912994083605315, "sim_compute_robot_state-npc2": 0.005985859193299946, "sim_compute_robot_state-npc3": 0.005969047546386719}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.13602697396580177, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.009037736095959628, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.016998767852783203, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.007087936884240259, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0035761549502988403, "sim_compute_performance-ego": 0.005019703997841365, "sim_compute_robot_state-ego": 0.006219906142995327, "sim_compute_robot_state-npc0": 0.006179800516442407, "sim_compute_robot_state-npc1": 0.0060706108431272865, "sim_compute_robot_state-npc2": 0.005992177166516268, "sim_compute_robot_state-npc3": 0.005986231791822216}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.11953999314989362, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.00941600969859532, "in-drivable-lane": 0, "agent_compute-ego": 0.017188872609819685, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.006747935499463763, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.0038009796823774062, "sim_compute_performance-ego": 0.005677487168993268, "sim_compute_robot_state-ego": 0.007085451057979039, "sim_compute_robot_state-npc0": 0.006251692771911621, "sim_compute_robot_state-npc1": 0.006229511329105922, "sim_compute_robot_state-npc2": 0.006091679845537458, "sim_compute_robot_state-npc3": 0.006173499992915562}}
set_robot_commands_max0.00986618995666504
set_robot_commands_mean0.00737396136638032
set_robot_commands_median0.006912607895700555
set_robot_commands_min0.006255136595831977
sim_compute_performance-ego_max0.006656780242919922
sim_compute_performance-ego_mean0.005462352542803509
sim_compute_performance-ego_median0.005247655667756733
sim_compute_performance-ego_min0.004710135636506257
sim_compute_robot_state-ego_max0.008297910690307617
sim_compute_robot_state-ego_mean0.00681173524548166
sim_compute_robot_state-ego_median0.006485857461628161
sim_compute_robot_state-ego_min0.005969550874498155
sim_compute_robot_state-npc0_max0.008298091888427735
sim_compute_robot_state-npc0_mean0.006577286815920987
sim_compute_robot_state-npc0_median0.006179800516442407
sim_compute_robot_state-npc0_min0.006000351022790979
sim_compute_robot_state-npc1_max0.00803257942199707
sim_compute_robot_state-npc1_mean0.006415100471773625
sim_compute_robot_state-npc1_median0.0060706108431272865
sim_compute_robot_state-npc1_min0.005829806681032534
sim_compute_robot_state-npc2_max0.007959604263305664
sim_compute_robot_state-npc2_mean0.006347734557067821
sim_compute_robot_state-npc2_median0.005992177166516268
sim_compute_robot_state-npc2_min0.005709352316679778
sim_compute_robot_state-npc3_max0.008026466369628907
sim_compute_robot_state-npc3_mean0.006354943725654154
sim_compute_robot_state-npc3_median0.005986231791822216
sim_compute_robot_state-npc3_min0.005619472927517361
sim_compute_sim_state_max0.004618644714355469
sim_compute_sim_state_mean0.003801220150074308
sim_compute_sim_state_median0.0035761549502988403
sim_compute_sim_state_min0.003437788398177535
sim_physics_max0.18026962280273437
sim_physics_mean0.13332099381965046
sim_physics_median0.12646005655589856
sim_physics_min0.10430832262392398
sim_render-ego_max0.011897850036621091
sim_render-ego_mean0.009553270666032888
sim_render-ego_median0.009097754955291748
sim_render-ego_min0.00831700254369665
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
248314341Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104910:40:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0300933560601888
survival_time_median8.449999999999985
deviation-center-line_median0.6066190538121987
in-drivable-lane_median1.599999999999998


other stats
agent_compute-ego_max0.0473327214738964
agent_compute-ego_mean0.039672424559358446
agent_compute-ego_median0.04033486922581991
agent_compute-ego_min0.02150596512688531
deviation-center-line_max1.1760525122231231
deviation-center-line_mean0.698239416337745
deviation-center-line_min0.26687664832029573
deviation-heading_max6.399100781489687
deviation-heading_mean3.297695010468314
deviation-heading_median3.478617507553511
deviation-heading_min0.6130596291767865
driven_any_max2.349015083614392
driven_any_mean1.6717642551237115
driven_any_median1.304313840286803
driven_any_min0.52492185129474
driven_lanedir_consec_max2.0793561120369577
driven_lanedir_consec_mean1.0824216584996025
driven_lanedir_consec_min0.20292743529165905
driven_lanedir_max2.0793561120369577
driven_lanedir_mean1.2515616866370955
driven_lanedir_median1.1770434661325686
driven_lanedir_min0.3086848450424089
in-drivable-lane_max4.200000000000033
in-drivable-lane_mean1.6000000000000094
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.240486905639207, "sim_physics": 0.12762224232708966, "survival_time": 8.09999999999998, "driven_lanedir": 1.1770434661325686, "sim_render-ego": 0.00934682657689224, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.02150596512688531, "deviation-heading": 1.7865455316584953, "set_robot_commands": 0.008859192883526837, "deviation-center-line": 0.6251319633096136, "driven_lanedir_consec": 1.1770434661325686, "sim_compute_sim_state": 0.003685221259976611, "sim_compute_performance-ego": 0.005476954542560342, "sim_compute_robot_state-ego": 0.006878256797790527, "sim_compute_robot_state-npc0": 0.007387560090900939, "sim_compute_robot_state-npc1": 0.006721087443975754, "sim_compute_robot_state-npc2": 0.006406814963729294, "sim_compute_robot_state-npc3": 0.006343788570827908}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3488603417791407, "sim_physics": 0.1393704930941264, "survival_time": 14.950000000000076, "driven_lanedir": 2.0793561120369577, "sim_render-ego": 0.009682233333587647, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.035126713116963706, "deviation-heading": 5.402995847813094, "set_robot_commands": 0.007841235001881917, "deviation-center-line": 0.956592919382955, "driven_lanedir_consec": 2.0793561120369577, "sim_compute_sim_state": 0.00382698933283488, "sim_compute_performance-ego": 0.005636390844980876, "sim_compute_robot_state-ego": 0.007046999931335449, "sim_compute_robot_state-npc0": 0.007031492392222087, "sim_compute_robot_state-npc1": 0.006655870278676351, "sim_compute_robot_state-npc2": 0.006655564308166504, "sim_compute_robot_state-npc3": 0.006509539286295573}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.1517279137086178, "sim_physics": 0.1528984022140503, "survival_time": 7.499999999999981, "driven_lanedir": 1.1209582727621896, "sim_render-ego": 0.010804696083068848, "in-drivable-lane": 0, "agent_compute-ego": 0.04234602292378743, "deviation-heading": 1.33678887295443, "set_robot_commands": 0.00768640677134196, "deviation-center-line": 0.6066190538121987, "driven_lanedir_consec": 1.1209582727621896, "sim_compute_sim_state": 0.004061209360758464, "sim_compute_performance-ego": 0.006123630205790201, "sim_compute_robot_state-ego": 0.007888886133829752, "sim_compute_robot_state-npc0": 0.007275648117065429, "sim_compute_robot_state-npc1": 0.00720823605855306, "sim_compute_robot_state-npc2": 0.0071379470825195315, "sim_compute_robot_state-npc3": 0.007201371192932129}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348604451538812, "sim_physics": 0.15327285448710123, "survival_time": 14.950000000000076, "driven_lanedir": 1.437641116286254, "sim_render-ego": 0.010809353987375895, "in-drivable-lane": 3.2000000000000126, "agent_compute-ego": 0.04268963654836019, "deviation-heading": 6.399100781489687, "set_robot_commands": 0.008259527683258057, "deviation-center-line": 1.113045743673044, "driven_lanedir_consec": 0.8475279902296471, "sim_compute_sim_state": 0.004290790557861328, "sim_compute_performance-ego": 0.006417940457661947, "sim_compute_robot_state-ego": 0.008017374674479166, "sim_compute_robot_state-npc0": 0.007598146597544353, "sim_compute_robot_state-npc1": 0.007451703548431396, "sim_compute_robot_state-npc2": 0.007496937115987142, "sim_compute_robot_state-npc3": 0.007398167451222738}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1838480635174229, "sim_physics": 0.1368483490758128, "survival_time": 7.699999999999981, "driven_lanedir": 1.0594964263966, "sim_render-ego": 0.011472051793878729, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.044631300034461086, "deviation-heading": 1.5252523761356471, "set_robot_commands": 0.008793572326759239, "deviation-center-line": 0.45174236328874, "driven_lanedir_consec": 1.0594964263966, "sim_compute_sim_state": 0.004442475058815696, "sim_compute_performance-ego": 0.006590937639211679, "sim_compute_robot_state-ego": 0.008231300812262993, "sim_compute_robot_state-npc0": 0.007911251736925794, "sim_compute_robot_state-npc1": 0.007765821048191616, "sim_compute_robot_state-npc2": 0.007872764166299399, "sim_compute_robot_state-npc3": 0.007641185413707386}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.8541781985968041, "sim_physics": 0.17290880827777153, "survival_time": 5.649999999999988, "driven_lanedir": 0.3086848450424089, "sim_render-ego": 0.012335665458071549, "in-drivable-lane": 2.5999999999999925, "agent_compute-ego": 0.0473327214738964, "deviation-heading": 2.007393934195606, "set_robot_commands": 0.00908991931814008, "deviation-center-line": 0.30914575937626576, "driven_lanedir_consec": 0.20292743529165905, "sim_compute_sim_state": 0.004611779103236915, "sim_compute_performance-ego": 0.006917527291627056, "sim_compute_robot_state-ego": 0.008829127370783714, "sim_compute_robot_state-npc0": 0.008131449201465708, "sim_compute_robot_state-npc1": 0.007849362044207818, "sim_compute_robot_state-npc2": 0.00783703812455709, "sim_compute_robot_state-npc3": 0.007817361207134955}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.52492185129474, "sim_physics": 0.14125860730806986, "survival_time": 3.599999999999995, "driven_lanedir": 0.4329700358780447, "sim_render-ego": 0.010525935226016574, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.04358437988493177, "deviation-heading": 0.6130596291767865, "set_robot_commands": 0.007784982522328694, "deviation-center-line": 0.26687664832029573, "driven_lanedir_consec": 0.4329700358780447, "sim_compute_sim_state": 0.004141949945025974, "sim_compute_performance-ego": 0.006070984734429253, "sim_compute_robot_state-ego": 0.007541037268108792, "sim_compute_robot_state-npc0": 0.0076369742552439375, "sim_compute_robot_state-npc1": 0.007393125030729506, "sim_compute_robot_state-npc2": 0.007305178377363417, "sim_compute_robot_state-npc3": 0.007214807801776462}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.3485532114284653, "sim_physics": 0.1430394713083903, "survival_time": 14.950000000000076, "driven_lanedir": 1.3278074419568853, "sim_render-ego": 0.00967368205388387, "in-drivable-lane": 4.200000000000033, "agent_compute-ego": 0.04079364458719889, "deviation-heading": 5.794908729142199, "set_robot_commands": 0.007489821116129557, "deviation-center-line": 0.5742248550532094, "driven_lanedir_consec": 0.7391871443907383, "sim_compute_sim_state": 0.003970387776692708, "sim_compute_performance-ego": 0.005768756071726481, "sim_compute_robot_state-ego": 0.007283204396565755, "sim_compute_robot_state-npc0": 0.00705949068069458, "sim_compute_robot_state-npc1": 0.006677733262379964, "sim_compute_robot_state-npc2": 0.006992313861846924, "sim_compute_robot_state-npc3": 0.006733215649922688}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3485423741144555, "sim_physics": 0.1242024048169454, "survival_time": 14.950000000000076, "driven_lanedir": 1.4247012840290243, "sim_render-ego": 0.009364147186279296, "in-drivable-lane": 3.550000000000021, "agent_compute-ego": 0.03918247620264689, "deviation-heading": 6.358177683629962, "set_robot_commands": 0.007517124017079671, "deviation-center-line": 0.994295533142114, "driven_lanedir_consec": 0.823600667491593, "sim_compute_sim_state": 0.003900370597839355, "sim_compute_performance-ego": 0.005478703180948894, "sim_compute_robot_state-ego": 0.00685062328974406, "sim_compute_robot_state-npc0": 0.006776628494262696, "sim_compute_robot_state-npc1": 0.006535624663035075, "sim_compute_robot_state-npc2": 0.00642230749130249, "sim_compute_robot_state-npc3": 0.006386906305948893}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.3489357715034367, "sim_physics": 0.1489913026491801, "survival_time": 14.950000000000076, "driven_lanedir": 1.8197806344477208, "sim_render-ego": 0.009646983941396075, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.03974537054697672, "deviation-heading": 3.723542434418729, "set_robot_commands": 0.0070013093948364255, "deviation-center-line": 1.1068972041236105, "driven_lanedir_consec": 1.294220649079814, "sim_compute_sim_state": 0.003664599259694417, "sim_compute_performance-ego": 0.005559633572896322, "sim_compute_robot_state-ego": 0.0069857152303059895, "sim_compute_robot_state-npc0": 0.006571857929229736, "sim_compute_robot_state-npc1": 0.006282704671223958, "sim_compute_robot_state-npc2": 0.006212275028228759, "sim_compute_robot_state-npc3": 0.006130862236022949}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.304313840286803, "sim_physics": 0.12236253185385078, "survival_time": 8.449999999999985, "driven_lanedir": 0.9001917595950185, "sim_render-ego": 0.009342261320035131, "in-drivable-lane": 1.599999999999998, "agent_compute-ego": 0.04078560326931745, "deviation-heading": 2.678234601413158, "set_robot_commands": 0.007264968206191204, "deviation-center-line": 0.4167929549132132, "driven_lanedir_consec": 0.9001917595950185, "sim_compute_sim_state": 0.003797629881187303, "sim_compute_performance-ego": 0.005520864351261297, "sim_compute_robot_state-ego": 0.006807608011911607, "sim_compute_robot_state-npc0": 0.006686790455022507, "sim_compute_robot_state-npc1": 0.006194344639072757, "sim_compute_robot_state-npc2": 0.006239988394742887, "sim_compute_robot_state-npc3": 0.006305320728460007}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.3489966369960404, "sim_physics": 0.12997207482655845, "survival_time": 14.950000000000076, "driven_lanedir": 1.8571341874453977, "sim_render-ego": 0.009215292930603029, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.04033486922581991, "deviation-heading": 3.597170687261103, "set_robot_commands": 0.00749178409576416, "deviation-center-line": 1.1760525122231231, "driven_lanedir_consec": 1.8571341874453977, "sim_compute_sim_state": 0.003719764550526937, "sim_compute_performance-ego": 0.005296141306559245, "sim_compute_robot_state-ego": 0.006779593626658122, "sim_compute_robot_state-npc0": 0.0068725665410359705, "sim_compute_robot_state-npc1": 0.006515602270762126, "sim_compute_robot_state-npc2": 0.006476341088612874, "sim_compute_robot_state-npc3": 0.006395734945933024}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.296057005578486, "sim_physics": 0.13238317058199928, "survival_time": 8.399999999999984, "driven_lanedir": 0.8310124371314359, "sim_render-ego": 0.009524654774438769, "in-drivable-lane": 1.5000000000000022, "agent_compute-ego": 0.040011728093737646, "deviation-heading": 3.768391827634808, "set_robot_commands": 0.007097447202319191, "deviation-center-line": 0.5713808176934332, "driven_lanedir_consec": 0.7469847436836395, "sim_compute_sim_state": 0.003592919735681443, "sim_compute_performance-ego": 0.0054798708075568785, "sim_compute_robot_state-ego": 0.006553488118307931, "sim_compute_robot_state-npc0": 0.006340537752423968, "sim_compute_robot_state-npc1": 0.006142173494611468, "sim_compute_robot_state-npc2": 0.00612704526810419, "sim_compute_robot_state-npc3": 0.006043378795896258}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.079422177258848, "sim_physics": 0.1241087998058779, "survival_time": 7.049999999999983, "driven_lanedir": 1.0300933560601888, "sim_render-ego": 0.009236384790839878, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.03947002667907282, "deviation-heading": 0.9952447125474816, "set_robot_commands": 0.00717914527189647, "deviation-center-line": 0.6045890316413975, "driven_lanedir_consec": 1.0300933560601888, "sim_compute_sim_state": 0.003951316184185921, "sim_compute_performance-ego": 0.005392967386448637, "sim_compute_robot_state-ego": 0.0069817262338408344, "sim_compute_robot_state-npc0": 0.006592777603906943, "sim_compute_robot_state-npc1": 0.00635986125215571, "sim_compute_robot_state-npc2": 0.006518675080427886, "sim_compute_robot_state-npc3": 0.006632613797559805}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.349015083614392, "sim_physics": 0.1319904629389445, "survival_time": 14.950000000000076, "driven_lanedir": 1.9665539243557373, "sim_render-ego": 0.008826978206634521, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.0375459106763204, "deviation-heading": 3.478617507553511, "set_robot_commands": 0.007190457185109456, "deviation-center-line": 0.700203885112961, "driven_lanedir_consec": 1.924632631019973, "sim_compute_sim_state": 0.003659130732218424, "sim_compute_performance-ego": 0.005123436450958252, "sim_compute_robot_state-ego": 0.006438345114390055, "sim_compute_robot_state-npc0": 0.0066400400797526045, "sim_compute_robot_state-npc1": 0.006385788122812907, "sim_compute_robot_state-npc2": 0.006341358820597331, "sim_compute_robot_state-npc3": 0.006387191613515218}}
set_robot_commands_max0.00908991931814008
set_robot_commands_mean0.007769792866437529
set_robot_commands_median0.007517124017079671
set_robot_commands_min0.0070013093948364255
sim_compute_performance-ego_max0.006917527291627056
sim_compute_performance-ego_mean0.005790315922974491
sim_compute_performance-ego_median0.005559633572896322
sim_compute_performance-ego_min0.005123436450958252
sim_compute_robot_state-ego_max0.008829127370783714
sim_compute_robot_state-ego_mean0.007274219134020982
sim_compute_robot_state-ego_median0.0069857152303059895
sim_compute_robot_state-ego_min0.006438345114390055
sim_compute_robot_state-npc0_max0.008131449201465708
sim_compute_robot_state-npc0_mean0.0071008807951798165
sim_compute_robot_state-npc0_median0.007031492392222087
sim_compute_robot_state-npc0_min0.006340537752423968
sim_compute_robot_state-npc1_max0.007849362044207818
sim_compute_robot_state-npc1_mean0.0068092691885879636
sim_compute_robot_state-npc1_median0.006655870278676351
sim_compute_robot_state-npc1_min0.006142173494611468
sim_compute_robot_state-npc2_max0.007872764166299399
sim_compute_robot_state-npc2_mean0.006802836611499048
sim_compute_robot_state-npc2_median0.006518675080427886
sim_compute_robot_state-npc2_min0.00612704526810419
sim_compute_robot_state-npc3_max0.007817361207134955
sim_compute_robot_state-npc3_mean0.0067427629998104
sim_compute_robot_state-npc3_median0.006509539286295573
sim_compute_robot_state-npc3_min0.006043378795896258
sim_compute_sim_state_max0.004611779103236915
sim_compute_sim_state_mean0.003954435555769091
sim_compute_sim_state_median0.003900370597839355
sim_compute_sim_state_min0.003592919735681443
sim_physics_max0.17290880827777153
sim_physics_mean0.1387486650377179
sim_physics_median0.1368483490758128
sim_physics_min0.12236253185385078
sim_render-ego_max0.012335665458071549
sim_render-ego_mean0.00998714317753347
sim_render-ego_median0.009646983941396075
sim_render-ego_min0.008826978206634521
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.740000000000029
survival_time_min3.599999999999995
No reset possible
248154321Riza Velioglu 🇩🇪UniBielefeld-testaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:06:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
248024344Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:17:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.49255102316626087
survival_time_median3.599999999999995
deviation-center-line_median0.29790524821897285
in-drivable-lane_median0


other stats
agent_compute-ego_max0.07600790389040683
agent_compute-ego_mean0.06689747620158279
agent_compute-ego_median0.06471687473662913
agent_compute-ego_min0.06316670184860582
deviation-center-line_max0.4812646795372727
deviation-center-line_mean0.30005026789152256
deviation-center-line_min0.14139099170245206
deviation-heading_max2.4873590797031215
deviation-heading_mean1.365344299517938
deviation-heading_median1.166649027879229
deviation-heading_min0.5135901026162242
driven_any_max1.6899707657984495
driven_any_mean0.8222510784854371
driven_any_median0.5249324663275781
driven_any_min0.32400957480368947
driven_lanedir_consec_max0.9634801042850364
driven_lanedir_consec_mean0.53258198051457
driven_lanedir_consec_min0.2572963447912615
driven_lanedir_max0.9634801042850364
driven_lanedir_mean0.5685333816420262
driven_lanedir_median0.5101265218549711
driven_lanedir_min0.2572963447912615
in-drivable-lane_max3.900000000000033
in-drivable-lane_mean1.1500000000000052
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1117155571726205, "sim_physics": 0.2437632982045004, "survival_time": 7.299999999999982, "driven_lanedir": 0.6723080288035419, "sim_render-ego": 0.015736788919527237, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06471687473662913, "deviation-heading": 2.4873590797031215, "set_robot_commands": 0.011986018860176818, "deviation-center-line": 0.3101543591559555, "driven_lanedir_consec": 0.49255102316626087, "sim_compute_sim_state": 0.006602738001575209, "sim_compute_performance-ego": 0.009404985872033525, "sim_compute_robot_state-ego": 0.011457779636121776, "sim_compute_robot_state-npc0": 0.011266902701495446, "sim_compute_robot_state-npc1": 0.011462980753754915, "sim_compute_robot_state-npc2": 0.011049100797470304, "sim_compute_robot_state-npc3": 0.01136973786027464}, "udem1-1-0": {"driven_any": 0.32400957480368947, "sim_physics": 0.2331205885461036, "survival_time": 2.3499999999999996, "driven_lanedir": 0.2572963447912615, "sim_render-ego": 0.016385808904120263, "in-drivable-lane": 0, "agent_compute-ego": 0.07600790389040683, "deviation-heading": 1.166649027879229, "set_robot_commands": 0.011046166115618766, "deviation-center-line": 0.14139099170245206, "driven_lanedir_consec": 0.2572963447912615, "sim_compute_sim_state": 0.005802671960059633, "sim_compute_performance-ego": 0.009106357046898376, "sim_compute_robot_state-ego": 0.011377045448790203, "sim_compute_robot_state-npc0": 0.01057554305867946, "sim_compute_robot_state-npc1": 0.010731752882612512, "sim_compute_robot_state-npc2": 0.010775916119839284, "sim_compute_robot_state-npc3": 0.010054573099663917}, "udem1-2-0": {"driven_any": 0.4606270283248484, "sim_physics": 0.2570389695465565, "survival_time": 3.1999999999999966, "driven_lanedir": 0.43945590847532, "sim_render-ego": 0.015416938811540604, "in-drivable-lane": 0, "agent_compute-ego": 0.0659862570464611, "deviation-heading": 0.5135901026162242, "set_robot_commands": 0.0117824524641037, "deviation-center-line": 0.2695360608429596, "driven_lanedir_consec": 0.43945590847532, "sim_compute_sim_state": 0.006752625107765198, "sim_compute_performance-ego": 0.009162191301584244, "sim_compute_robot_state-ego": 0.01145719364285469, "sim_compute_robot_state-npc0": 0.01064162328839302, "sim_compute_robot_state-npc1": 0.011073432862758636, "sim_compute_robot_state-npc2": 0.011606741696596146, "sim_compute_robot_state-npc3": 0.011259850114583967}, "udem1-3-0": {"driven_any": 0.5249324663275781, "sim_physics": 0.2503042651547326, "survival_time": 3.599999999999995, "driven_lanedir": 0.5101265218549711, "sim_render-ego": 0.016133427619934082, "in-drivable-lane": 0, "agent_compute-ego": 0.06460964348581102, "deviation-heading": 0.6070650268782053, "set_robot_commands": 0.011263045999738906, "deviation-center-line": 0.29790524821897285, "driven_lanedir_consec": 0.5101265218549711, "sim_compute_sim_state": 0.005944937467575073, "sim_compute_performance-ego": 0.00922751095559862, "sim_compute_robot_state-ego": 0.010924693610933092, "sim_compute_robot_state-npc0": 0.009854478968514336, "sim_compute_robot_state-npc1": 0.01072824001312256, "sim_compute_robot_state-npc2": 0.01070824596616957, "sim_compute_robot_state-npc3": 0.010451363192664253}, "udem1-4-0": {"driven_any": 1.6899707657984495, "sim_physics": 0.23068059204910207, "survival_time": 10.85000000000002, "driven_lanedir": 0.9634801042850364, "sim_render-ego": 0.01438448725757511, "in-drivable-lane": 3.900000000000033, "agent_compute-ego": 0.06316670184860582, "deviation-heading": 2.05205826051291, "set_robot_commands": 0.01090918048735588, "deviation-center-line": 0.4812646795372727, "driven_lanedir_consec": 0.9634801042850364, "sim_compute_sim_state": 0.006080738410422329, "sim_compute_performance-ego": 0.008662780858404625, "sim_compute_robot_state-ego": 0.010681871994299822, "sim_compute_robot_state-npc0": 0.010273065435172226, "sim_compute_robot_state-npc1": 0.010381586540679229, "sim_compute_robot_state-npc2": 0.010349517593735374, "sim_compute_robot_state-npc3": 0.010293563939459313}}
set_robot_commands_max0.011986018860176818
set_robot_commands_mean0.011397372785398811
set_robot_commands_median0.011263045999738906
set_robot_commands_min0.01090918048735588
sim_compute_performance-ego_max0.009404985872033525
sim_compute_performance-ego_mean0.009112765206903878
sim_compute_performance-ego_median0.009162191301584244
sim_compute_performance-ego_min0.008662780858404625
sim_compute_robot_state-ego_max0.011457779636121776
sim_compute_robot_state-ego_mean0.011179716866599918
sim_compute_robot_state-ego_median0.011377045448790203
sim_compute_robot_state-ego_min0.010681871994299822
sim_compute_robot_state-npc0_max0.011266902701495446
sim_compute_robot_state-npc0_mean0.010522322690450897
sim_compute_robot_state-npc0_median0.01057554305867946
sim_compute_robot_state-npc0_min0.009854478968514336
sim_compute_robot_state-npc1_max0.011462980753754915
sim_compute_robot_state-npc1_mean0.01087559861058557
sim_compute_robot_state-npc1_median0.010731752882612512
sim_compute_robot_state-npc1_min0.010381586540679229
sim_compute_robot_state-npc2_max0.011606741696596146
sim_compute_robot_state-npc2_mean0.010897904434762136
sim_compute_robot_state-npc2_median0.010775916119839284
sim_compute_robot_state-npc2_min0.010349517593735374
sim_compute_robot_state-npc3_max0.01136973786027464
sim_compute_robot_state-npc3_mean0.01068581764132922
sim_compute_robot_state-npc3_median0.010451363192664253
sim_compute_robot_state-npc3_min0.010054573099663917
sim_compute_sim_state_max0.006752625107765198
sim_compute_sim_state_mean0.0062367421894794885
sim_compute_sim_state_median0.006080738410422329
sim_compute_sim_state_min0.005802671960059633
sim_physics_max0.2570389695465565
sim_physics_mean0.24298154270019903
sim_physics_median0.2437632982045004
sim_physics_min0.23068059204910207
sim_render-ego_max0.016385808904120263
sim_render-ego_mean0.01561149030253946
sim_render-ego_median0.015736788919527237
sim_render-ego_min0.01438448725757511
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean5.459999999999998
survival_time_min2.3499999999999996
No reset possible
247944333Soroush Saryazdi 🇨🇦challenge-aido_LF-template-randomaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:07:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.024036872236034536
agent_compute-ego_mean0.021510848469964115
agent_compute-ego_median0.023505506692109285
agent_compute-ego_min0.013873929977416991
deviation-center-line_max0.17439134565029044
deviation-center-line_mean0.1265175655253199
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599271
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811225
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589055
driven_any_mean1.0272530755098268
driven_any_median1.0243289631429704
driven_any_min0.4119037580118985
driven_lanedir_consec_max1.2433038249708372
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708372
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.17784962830720125, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.013503997414200396, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.023505506692109285, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.00922862688700358, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0058473436920731155, "sim_compute_performance-ego": 0.007884038819207085, "sim_compute_robot_state-ego": 0.009526420522619176, "sim_compute_robot_state-npc0": 0.009338983783015498, "sim_compute_robot_state-npc1": 0.009552147653367784, "sim_compute_robot_state-npc2": 0.009520389415599682, "sim_compute_robot_state-npc3": 0.008927508636757179}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.1043244743347168, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.007661714553833008, "in-drivable-lane": 0, "agent_compute-ego": 0.013873929977416991, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.005467281341552734, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.003140077590942383, "sim_compute_performance-ego": 0.004070634841918945, "sim_compute_robot_state-ego": 0.005358600616455078, "sim_compute_robot_state-npc0": 0.0050611114501953125, "sim_compute_robot_state-npc1": 0.0048920631408691405, "sim_compute_robot_state-npc2": 0.004951324462890625, "sim_compute_robot_state-npc3": 0.004887046813964843}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1787138863613731, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.012423951374857047, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.023707317678551925, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.009160311598526804, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.0051953823942887155, "sim_compute_performance-ego": 0.0071688231668974225, "sim_compute_robot_state-ego": 0.00911296668805574, "sim_compute_robot_state-npc0": 0.008810309987319144, "sim_compute_robot_state-npc1": 0.008126723138909591, "sim_compute_robot_state-npc2": 0.008174133928198563, "sim_compute_robot_state-npc3": 0.008284145279934532}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.19302988957755177, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.012653930277764043, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.024036872236034536, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.009278454358064675, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.005303298370747627, "sim_compute_performance-ego": 0.007264677482315257, "sim_compute_robot_state-ego": 0.00943495653852632, "sim_compute_robot_state-npc0": 0.008593830881239493, "sim_compute_robot_state-npc1": 0.008337790452981298, "sim_compute_robot_state-npc2": 0.008304580857482138, "sim_compute_robot_state-npc3": 0.00835357436650916}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.14350943905966623, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.0121977584702628, "in-drivable-lane": 0, "agent_compute-ego": 0.022430615765707835, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.007855994360787528, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.004673702376229423, "sim_compute_performance-ego": 0.007034957408905029, "sim_compute_robot_state-ego": 0.00840461254119873, "sim_compute_robot_state-npc0": 0.00745751176561628, "sim_compute_robot_state-npc1": 0.007934587342398507, "sim_compute_robot_state-npc2": 0.0080572281564985, "sim_compute_robot_state-npc3": 0.007685542106628418}}
set_robot_commands_max0.009278454358064675
set_robot_commands_mean0.008198133709187063
set_robot_commands_median0.009160311598526804
set_robot_commands_min0.005467281341552734
sim_compute_performance-ego_max0.007884038819207085
sim_compute_performance-ego_mean0.006684626343848749
sim_compute_performance-ego_median0.0071688231668974225
sim_compute_performance-ego_min0.004070634841918945
sim_compute_robot_state-ego_max0.009526420522619176
sim_compute_robot_state-ego_mean0.008367511381371009
sim_compute_robot_state-ego_median0.00911296668805574
sim_compute_robot_state-ego_min0.005358600616455078
sim_compute_robot_state-npc0_max0.009338983783015498
sim_compute_robot_state-npc0_mean0.007852349573477146
sim_compute_robot_state-npc0_median0.008593830881239493
sim_compute_robot_state-npc0_min0.0050611114501953125
sim_compute_robot_state-npc1_max0.009552147653367784
sim_compute_robot_state-npc1_mean0.007768662345705264
sim_compute_robot_state-npc1_median0.008126723138909591
sim_compute_robot_state-npc1_min0.0048920631408691405
sim_compute_robot_state-npc2_max0.009520389415599682
sim_compute_robot_state-npc2_mean0.007801531364133902
sim_compute_robot_state-npc2_median0.008174133928198563
sim_compute_robot_state-npc2_min0.004951324462890625
sim_compute_robot_state-npc3_max0.008927508636757179
sim_compute_robot_state-npc3_mean0.007627563440758827
sim_compute_robot_state-npc3_median0.008284145279934532
sim_compute_robot_state-npc3_min0.004887046813964843
sim_compute_sim_state_max0.0058473436920731155
sim_compute_sim_state_mean0.004831960884856252
sim_compute_sim_state_median0.0051953823942887155
sim_compute_sim_state_min0.003140077590942383
sim_physics_max0.19302988957755177
sim_physics_mean0.15948546352810183
sim_physics_median0.17784962830720125
sim_physics_min0.1043244743347168
sim_render-ego_max0.013503997414200396
sim_render-ego_mean0.011688270418183455
sim_render-ego_median0.012423951374857047
sim_render-ego_min0.007661714553833008
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
247804323Riza Velioglu 🇩🇪UniBielefeldaido3-LF-sim-validationstep1-simulationabortednoip-172-31-35-218-104910:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5199541836131956
survival_time_median7.99999999999998
deviation-center-line_median0.3483518809373187
in-drivable-lane_median1.399999999999995


other stats
agent_compute-ego_max0.0258639641390502
agent_compute-ego_mean0.023654304453356048
agent_compute-ego_median0.023125359950921475
agent_compute-ego_min0.02246134728193283
deviation-center-line_max0.37290320844877345
deviation-center-line_mean0.33185873766115226
deviation-center-line_min0.27717202789485784
deviation-heading_max6.855090196628479
deviation-heading_mean3.541479733043346
deviation-heading_median3.20424527405465
deviation-heading_min1.544196168595377
driven_any_max1.5491169564701608
driven_any_mean1.1329645404349329
driven_any_median1.028622165063508
driven_any_min0.639985032193232
driven_lanedir_consec_max1.2966690415910411
driven_lanedir_consec_mean0.5160544282480969
driven_lanedir_consec_min0.014581392793340251
driven_lanedir_max1.2966690415910411
driven_lanedir_mean0.5160544282480969
driven_lanedir_median0.5199541836131956
driven_lanedir_min0.014581392793340251
in-drivable-lane_max6.400000000000035
in-drivable-lane_mean2.5000000000000044
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.028622165063508, "sim_physics": 0.06740921093867375, "survival_time": 9.750000000000004, "driven_lanedir": 0.13991313889573487, "sim_render-ego": 0.009508466720581057, "in-drivable-lane": 4.099999999999994, "agent_compute-ego": 0.023125359950921475, "deviation-heading": 3.895028373843125, "set_robot_commands": 0.006385293373694786, "deviation-center-line": 0.3483518809373187, "driven_lanedir_consec": 0.13991313889573487, "sim_compute_sim_state": 0.004049230233216897, "sim_compute_performance-ego": 0.005609862009684245, "sim_compute_robot_state-ego": 0.006806339361728766}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5491169564701608, "sim_physics": 0.060954001545906064, "survival_time": 7.99999999999998, "driven_lanedir": 1.2966690415910411, "sim_render-ego": 0.00925123393535614, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02246134728193283, "deviation-heading": 3.20424527405465, "set_robot_commands": 0.006368955969810486, "deviation-center-line": 0.3699347951892102, "driven_lanedir_consec": 1.2966690415910411, "sim_compute_sim_state": 0.003816048800945282, "sim_compute_performance-ego": 0.005166766047477722, "sim_compute_robot_state-ego": 0.006483261287212372}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.639985032193232, "sim_physics": 0.05984368389599944, "survival_time": 3.649999999999995, "driven_lanedir": 0.5199541836131956, "sim_render-ego": 0.007543491990598914, "in-drivable-lane": 0, "agent_compute-ego": 0.02292134337229271, "deviation-heading": 1.544196168595377, "set_robot_commands": 0.005430038661172945, "deviation-center-line": 0.27717202789485784, "driven_lanedir_consec": 0.5199541836131956, "sim_compute_sim_state": 0.0031997994200824056, "sim_compute_performance-ego": 0.004082895305058728, "sim_compute_robot_state-ego": 0.005246423695185413}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.951535431483562, "sim_physics": 0.07911731632611224, "survival_time": 6.549999999999985, "driven_lanedir": 0.6091543843471725, "sim_render-ego": 0.01007446441941589, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.0258639641390502, "deviation-heading": 2.208838652095096, "set_robot_commands": 0.007170082048605417, "deviation-center-line": 0.37290320844877345, "driven_lanedir_consec": 0.6091543843471725, "sim_compute_sim_state": 0.004248244161824234, "sim_compute_performance-ego": 0.0055853483331112464, "sim_compute_robot_state-ego": 0.006985726247306998}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4955631169642003, "sim_physics": 0.06667188088099162, "survival_time": 14.950000000000076, "driven_lanedir": 0.014581392793340251, "sim_render-ego": 0.010218247572580974, "in-drivable-lane": 6.400000000000035, "agent_compute-ego": 0.02389950752258301, "deviation-heading": 6.855090196628479, "set_robot_commands": 0.006403415203094482, "deviation-center-line": 0.29093177583560104, "driven_lanedir_consec": 0.014581392793340251, "sim_compute_sim_state": 0.0038035098711649575, "sim_compute_performance-ego": 0.005082370440165202, "sim_compute_robot_state-ego": 0.006394541263580323}}
set_robot_commands_max0.007170082048605417
set_robot_commands_mean0.006351557051275623
set_robot_commands_median0.006385293373694786
set_robot_commands_min0.005430038661172945
sim_compute_performance-ego_max0.005609862009684245
sim_compute_performance-ego_mean0.005105448427099429
sim_compute_performance-ego_median0.005166766047477722
sim_compute_performance-ego_min0.004082895305058728
sim_compute_robot_state-ego_max0.006985726247306998
sim_compute_robot_state-ego_mean0.006383258371002775
sim_compute_robot_state-ego_median0.006483261287212372
sim_compute_robot_state-ego_min0.005246423695185413
sim_compute_sim_state_max0.004248244161824234
sim_compute_sim_state_mean0.0038233664974467543
sim_compute_sim_state_median0.003816048800945282
sim_compute_sim_state_min0.0031997994200824056
sim_physics_max0.07911731632611224
sim_physics_mean0.06679921871753662
sim_physics_median0.06667188088099162
sim_physics_min0.05984368389599944
sim_render-ego_max0.010218247572580974
sim_render-ego_mean0.009319180927706595
sim_render-ego_median0.009508466720581057
sim_render-ego_min0.007543491990598914
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.580000000000007
survival_time_min3.649999999999995
No reset possible
247774322Gianmarco Bernasconibaseline-IL-sim-tensorflowaido3-LF-sim-validationstep1-simulationhost-errornoip-172-31-35-218-104910:02:53
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 887, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1269, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 306, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 287, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4322/step1-simulation-ip-172-31-35-218-10491-job24777': '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4322/step1-simulation-ip-172-31-35-218-10491-job24777'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247724319Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-35-218-104910:10:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247553257Liu Sam 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104910:00:05
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247444307Frank (Chude) Qian 🇨🇦Frank test submissionaido3-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:09:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5636399177084477
survival_time_median2.9499999999999975
deviation-center-line_median0.19417316650714284
in-drivable-lane_median0


other stats
agent_compute-ego_max0.029295682907104492
agent_compute-ego_mean0.02726112560067494
agent_compute-ego_median0.027288820170149015
agent_compute-ego_min0.024469208717346192
deviation-center-line_max0.27212935355303575
deviation-center-line_mean0.1659879300685689
deviation-center-line_min0.060733287044270105
deviation-heading_max0.3681646786246837
deviation-heading_mean0.2857346549044181
deviation-heading_median0.2652784439875202
deviation-heading_min0.2528567413804248
driven_any_max2.7696546371463566
driven_any_mean1.474111788433791
driven_any_median1.5696547037668402
driven_any_min0.4010834948810282
driven_lanedir_consec_max1.9242206205397283
driven_lanedir_consec_mean1.2102809057090995
driven_lanedir_consec_min0.38720104799654376
driven_lanedir_max1.924267585170248
driven_lanedir_mean1.2103413601562374
driven_lanedir_median1.5638383114510817
driven_lanedir_min0.38720104799654376
in-drivable-lane_max1.399999999999995
in-drivable-lane_mean0.4199999999999985
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5696547037668402, "sim_physics": 0.20047688888291185, "survival_time": 2.9499999999999975, "driven_lanedir": 1.5638383114510817, "sim_render-ego": 0.013351614192380745, "in-drivable-lane": 0, "agent_compute-ego": 0.028995627063815876, "deviation-heading": 0.2528567413804248, "set_robot_commands": 0.009209325758077333, "deviation-center-line": 0.19417316650714284, "driven_lanedir_consec": 1.5636399177084477, "sim_compute_sim_state": 0.005122803025326486, "sim_compute_performance-ego": 0.0075613038014557404, "sim_compute_robot_state-ego": 0.009265879453238797, "sim_compute_robot_state-npc0": 0.009313397488351596, "sim_compute_robot_state-npc1": 0.008527872926097805, "sim_compute_robot_state-npc2": 0.008327302286180399, "sim_compute_robot_state-npc3": 0.008640519643233995}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.21468364108692517, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.013597932728854092, "in-drivable-lane": 0, "agent_compute-ego": 0.029295682907104492, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.009859984571283514, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.005976286801424893, "sim_compute_performance-ego": 0.006946899674155496, "sim_compute_robot_state-ego": 0.009759263558821243, "sim_compute_robot_state-npc0": 0.008767463944175026, "sim_compute_robot_state-npc1": 0.009312250397422096, "sim_compute_robot_state-npc2": 0.008281035856767134, "sim_compute_robot_state-npc3": 0.008957266807556152}, "udem1-2-0": {"driven_any": 2.1696546375441614, "sim_physics": 0.17972950995722903, "survival_time": 3.949999999999994, "driven_lanedir": 1.7414407758715231, "sim_render-ego": 0.012440171422837655, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.027288820170149015, "deviation-heading": 0.2785063205851342, "set_robot_commands": 0.008810308915150316, "deviation-center-line": 0.22563902167216496, "driven_lanedir_consec": 1.7413838620089876, "sim_compute_sim_state": 0.0047669501244267335, "sim_compute_performance-ego": 0.007141179676297345, "sim_compute_robot_state-ego": 0.008994371076173421, "sim_compute_robot_state-npc0": 0.008356006839607336, "sim_compute_robot_state-npc1": 0.008341415018974981, "sim_compute_robot_state-npc2": 0.008130040349839609, "sim_compute_robot_state-npc3": 0.007986286018468156}, "udem1-3-0": {"driven_any": 2.7696546371463566, "sim_physics": 0.17177411040874443, "survival_time": 4.94999999999999, "driven_lanedir": 1.924267585170248, "sim_render-ego": 0.0122109278283938, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.026256289144959113, "deviation-heading": 0.2652784439875202, "set_robot_commands": 0.008360255848277699, "deviation-center-line": 0.27212935355303575, "driven_lanedir_consec": 1.9242206205397283, "sim_compute_sim_state": 0.004736259730175288, "sim_compute_performance-ego": 0.006488508648342556, "sim_compute_robot_state-ego": 0.008272968157373294, "sim_compute_robot_state-npc0": 0.0075544299501361266, "sim_compute_robot_state-npc1": 0.007886667444248392, "sim_compute_robot_state-npc2": 0.0077439582709110145, "sim_compute_robot_state-npc3": 0.007458352079295149}, "udem1-4-0": {"driven_any": 0.4010834948810282, "sim_physics": 0.18931636810302735, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38720104799654376, "sim_render-ego": 0.011887621879577636, "in-drivable-lane": 0, "agent_compute-ego": 0.024469208717346192, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.007688581943511963, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38720104799654376, "sim_compute_sim_state": 0.005046296119689942, "sim_compute_performance-ego": 0.006579685211181641, "sim_compute_robot_state-ego": 0.009588265419006347, "sim_compute_robot_state-npc0": 0.00735853910446167, "sim_compute_robot_state-npc1": 0.007738435268402099, "sim_compute_robot_state-npc2": 0.007989764213562012, "sim_compute_robot_state-npc3": 0.007611870765686035}}
set_robot_commands_max0.009859984571283514
set_robot_commands_mean0.008785691407260165
set_robot_commands_median0.008810308915150316
set_robot_commands_min0.007688581943511963
sim_compute_performance-ego_max0.0075613038014557404
sim_compute_performance-ego_mean0.0069435154022865556
sim_compute_performance-ego_median0.006946899674155496
sim_compute_performance-ego_min0.006488508648342556
sim_compute_robot_state-ego_max0.009759263558821243
sim_compute_robot_state-ego_mean0.00917614953292262
sim_compute_robot_state-ego_median0.009265879453238797
sim_compute_robot_state-ego_min0.008272968157373294
sim_compute_robot_state-npc0_max0.009313397488351596
sim_compute_robot_state-npc0_mean0.008269967465346351
sim_compute_robot_state-npc0_median0.008356006839607336
sim_compute_robot_state-npc0_min0.00735853910446167
sim_compute_robot_state-npc1_max0.009312250397422096
sim_compute_robot_state-npc1_mean0.008361328211029074
sim_compute_robot_state-npc1_median0.008341415018974981
sim_compute_robot_state-npc1_min0.007738435268402099
sim_compute_robot_state-npc2_max0.008327302286180399
sim_compute_robot_state-npc2_mean0.008094420195452035
sim_compute_robot_state-npc2_median0.008130040349839609
sim_compute_robot_state-npc2_min0.0077439582709110145
sim_compute_robot_state-npc3_max0.008957266807556152
sim_compute_robot_state-npc3_mean0.008130859062847898
sim_compute_robot_state-npc3_median0.007986286018468156
sim_compute_robot_state-npc3_min0.007458352079295149
sim_compute_sim_state_max0.005976286801424893
sim_compute_sim_state_mean0.005129719160208669
sim_compute_sim_state_median0.005046296119689942
sim_compute_sim_state_min0.004736259730175288
sim_physics_max0.21468364108692517
sim_physics_mean0.19119610368776757
sim_physics_median0.18931636810302735
sim_physics_min0.17177411040874443
sim_render-ego_max0.013597932728854092
sim_render-ego_mean0.012697653610408786
sim_render-ego_median0.012440171422837655
sim_render-ego_min0.011887621879577636
simulation-passed1
survival_time_max4.94999999999999
survival_time_mean2.7899999999999965
survival_time_min1.0000000000000002
No reset possible
247222686Maxim ScherbakovPredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:00:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1056329505228273
error_L20.017186127240682313


No reset possible
247172887Diego Charrez 🇵🇪PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.09981573838922685
error_L20.017077890140506036


No reset possible
247053067Lei ChenPredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12123615325060594
error_L20.02270492675267548


No reset possible
246923171Chao-Chun Hsu 🇹🇼PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:00:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10060273309701089
error_L20.016727857446851888


No reset possible
246893265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104910:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
246833265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104910:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
246713181Pokai ChangPredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:00:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.097718386399328
error_L20.014701255610926082


No reset possible
246513245Shen Yu Chia 🇹🇼PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12226140650570153
error_L20.022663471117563855


No reset possible
246473264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-35-218-104910:00:05
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
246383279Tony HsiaoPredictorRandomaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.32436324990483056
error_L20.15677682201451518


No reset possible
246303583Karthikk Subramanian 🇸🇬PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.09699792927592885
error_L20.014373336438548445


No reset possible
246223819Philippe LaferrierePredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11614092250742793
error_L20.02065579153822581


No reset possible
246113836Philippe LaferrierePredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1199478702046252
error_L20.023546337630569993


No reset possible
245504294Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-35-218-104910:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.021018667221069334
agent_compute-ego_mean0.0169147952169904
agent_compute-ego_median0.01669814013227632
agent_compute-ego_min0.013699924244600184
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989765
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.6182144577009443
driven_any_mean0.861378585933269
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.07345646840554697, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010251817879853424, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.018793366573475027, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.005940265125698513, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004083584856103968, "sim_compute_performance-ego": 0.005861141063548901, "sim_compute_robot_state-ego": 0.007395969496832954}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05967118225845637, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.008064288719027651, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.014363877913531137, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.00551308837591433, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0033943653106689453, "sim_compute_performance-ego": 0.0043639902975045, "sim_compute_robot_state-ego": 0.0055313203849044505}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06543841081507065, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.007735715192906997, "in-drivable-lane": 0, "agent_compute-ego": 0.013699924244600184, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.005152772454654469, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.003313892027911018, "sim_compute_performance-ego": 0.004322935553158031, "sim_compute_robot_state-ego": 0.005500947727876551}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.0907347011566162, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.012570953369140624, "in-drivable-lane": 0, "agent_compute-ego": 0.021018667221069334, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.007925701141357423, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.004772872924804688, "sim_compute_performance-ego": 0.007446651458740235, "sim_compute_robot_state-ego": 0.009009037017822264}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.06745746165891237, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.009248624874066705, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.01669814013227632, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.006663449202911763, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.003810294066803365, "sim_compute_performance-ego": 0.005141065090517455, "sim_compute_robot_state-ego": 0.006440367879746835}}
set_robot_commands_max0.007925701141357423
set_robot_commands_mean0.0062390552601073
set_robot_commands_median0.005940265125698513
set_robot_commands_min0.005152772454654469
sim_compute_performance-ego_max0.007446651458740235
sim_compute_performance-ego_mean0.005427156692693824
sim_compute_performance-ego_median0.005141065090517455
sim_compute_performance-ego_min0.004322935553158031
sim_compute_robot_state-ego_max0.009009037017822264
sim_compute_robot_state-ego_mean0.00677552850143661
sim_compute_robot_state-ego_median0.006440367879746835
sim_compute_robot_state-ego_min0.005500947727876551
sim_compute_sim_state_max0.004772872924804688
sim_compute_sim_state_mean0.0038750018372583966
sim_compute_sim_state_median0.003810294066803365
sim_compute_sim_state_min0.003313892027911018
sim_physics_max0.0907347011566162
sim_physics_mean0.07135164485892051
sim_physics_median0.06745746165891237
sim_physics_min0.05967118225845637
sim_render-ego_max0.012570953369140624
sim_render-ego_mean0.00957428000699908
sim_render-ego_median0.009248624874066705
sim_render-ego_min0.007735715192906997
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
245304115Simone Arreghini 🇮🇹PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-35-218-104910:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11427126176521545
error_L20.020217678744320875


No reset possible
245284289Frank (Chude) Qian 🇨🇦PredictorLastaido2-PREDstep1-simulationerrornoip-172-31-35-218-104910:01:09
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
    attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
    return deserialize_Dict(K, mj, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
    attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
    return schema_to_type(schema, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
    res = schema_to_type_(schema0, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
    assert False, schema  # pragma: no cover
AssertionError: {'title': 'Any'}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
    attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
    return deserialize_dataclass(K, mj, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
    raise Exception(msg) from e
Exception: Cannot deserialize attribute inputs (expect: typing.Dict[str, type])
value: {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}

| Traceback (most recent call last):
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
|     return deserialize_Dict(K, mj, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
|     return schema_to_type(schema, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
|     res = schema_to_type_(schema0, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
|     assert False, schema  # pragma: no cover
| AssertionError: {'title': 'Any'}
| 

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 75, in <module>
    main(cie)
  File "experiment_manager.py", line 26, in main
    agent_ci._get_node_protocol()
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 79, in _get_node_protocol
    timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 92, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 211, in read_one
    data = ipce_to_object(msg[FIELD_DATA], {}, expect_type=klass)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
    return deserialize_dataclass(K, mj, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
    raise Exception(msg) from e
Exception: Cannot deserialize attribute meta (expect: <class 'zuper_nodes.language.InteractionProtocol'>)
value: {'inputs': {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'outputs': {'logs': {'type': 'array', 'items': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'title': 'List[str]', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'aborted': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'node_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state_ack': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config_ack': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state_error': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'node_description': {'$id': 'http://invalid.json-schema.org/NodeDescription#', 'type': 'object', 'order': ['description'], 'title': 'NodeDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'NodeDescription(description: str)', '__qualname__': 'NodeDescription'}, 'set_config_error': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'build_description': {'$id': 'http://invalid.json-schema.org/BuildDescription#', 'type': 'object', 'order': [], 'title': 'BuildDescription', '$schema': 'http://json-schema.org/draft-07/schema#', '__module__': 'zuper_nodes_wrapper.meta_protocol', 'description': 'BuildDescription()', '__qualname__': 'BuildDescription'}, 'config_description': {'$id': 'http://invalid.json-schema.org/ConfigDescription#', 'type': 'object', 'order': ['config', 'current'], 'title': 'ConfigDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['config', 'current'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'config': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}, 'current': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'ConfigDescription(config: type, current: Any)', '__qualname__': 'ConfigDescription'}, 'protocol_description': {'$id': 'http://invalid.json-schema.org/ProtocolDescription#', 'type': 'object', 'order': ['data', 'meta'], 'title': 'ProtocolDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['data', 'meta'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'data': {'$id': 'http://invalid.json-schema.org/InteractionProtocol#', 'type': 'object', 'order': ['description', 'inputs', 'outputs', 'language'], 'title': 'InteractionProtocol', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description', 'inputs', 'language', 'outputs'], '__module__': 'zuper_nodes.language', 'properties': {'inputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'outputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'language': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'InteractionProtocol(description: str, inputs: Dict[str, type], outputs: Dict[str, type], language: str)', '__qualname__': 'InteractionProtocol'}, 'meta': {'$id': 'http://invalid.json-schema.org/InteractionProtocol#', 'type': 'object', 'order': ['description', 'inputs', 'outputs', 'language'], 'title': 'InteractionProtocol', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description', 'inputs', 'language', 'outputs'], '__module__': 'zuper_nodes.language', 'properties': {'inputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'outputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'language': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'InteractionProtocol(description: str, inputs: Dict[str, type], outputs: Dict[str, type], language: str)', '__qualname__': 'InteractionProtocol'}}, 'description': 'ProtocolDescription(data: zuper_nodes.language.InteractionProtocol, meta: zuper_nodes.language.InteractionProtocol)', '__qualname__': 'ProtocolDescription'}}, 'language': '((in:describe_config ; out:config_description) | (in:set_config ; (out:set_config_ack | out:set_config_error)) | (in:describe_protocol ; out:protocol_description) | (in:describe_node ; out:node_description) | (in:describe_build ; out:build_description) | (in:get_state ; out:node_state) | (in:set_state ; (out:set_state_ack | out:set_state_error)) | (in:get_logs ; out:logs) | out:aborted)*', 'description': '\nBasic interaction protocol for nodes spoken by the node wrapper.\n\n    '}

| Traceback (most recent call last):
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
|     return deserialize_Dict(K, mj, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
|     return schema_to_type(schema, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
|     res = schema_to_type_(schema0, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
|     assert False, schema  # pragma: no cover
| AssertionError: {'title': 'Any'}
| 
| The above exception was the direct cause of the following exception:
| 
| Traceback (most recent call last):
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
|     return deserialize_dataclass(K, mj, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
|     raise Exception(msg) from e
| Exception: Cannot deserialize attribute inputs (expect: typing.Dict[str, type])
| value: {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}
| 
| | Traceback (most recent call last):
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
| |     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
| |     return deserialize_Dict(K, mj, global_symbols, encountered)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
| |     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
| |     return schema_to_type(schema, global_symbols, encountered)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
| |     res = schema_to_type_(schema0, global_symbols, encountered)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
| |     assert False, schema  # pragma: no cover
| | AssertionError: {'title': 'Any'}
| |
| 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
245174281Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104910:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.019612897800493845
agent_compute-ego_mean0.017106946548126833
agent_compute-ego_median0.017444448471069338
agent_compute-ego_min0.013527842128978056
deviation-center-line_max0.28386357003337986
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652288
deviation-heading_median0.3292838510353387
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.975949037827615
driven_any_median1.0117660515775695
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063861
driven_lanedir_consec_mean0.6896171461819268
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063861
driven_lanedir_mean0.6896171461819268
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.07467835037796586, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010226121655216924, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.0184983147515191, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.006553292274475098, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004086286933333786, "sim_compute_performance-ego": 0.005931518695972584, "sim_compute_robot_state-ego": 0.006850896058259187}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05510797220117906, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.007813392900953106, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.017213653115665212, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.00557712480133655, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0030877356435738356, "sim_compute_performance-ego": 0.0042266705456902, "sim_compute_robot_state-ego": 0.005499101152607039}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.059962104348575365, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.007538318634033203, "in-drivable-lane": 0, "agent_compute-ego": 0.013527842128978056, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.005214845432954676, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0030724441303926356, "sim_compute_performance-ego": 0.0039722779217888325, "sim_compute_robot_state-ego": 0.005324966767254998}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06950467109680175, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.009847650527954102, "in-drivable-lane": 0, "agent_compute-ego": 0.017444448471069338, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.006321353912353516, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.004287319183349609, "sim_compute_performance-ego": 0.0055457019805908205, "sim_compute_robot_state-ego": 0.006936836242675781}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.0786283016204834, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.01017494443096692, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.019612897800493845, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0073355662671825556, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.004059562200232398, "sim_compute_performance-ego": 0.00562598735471315, "sim_compute_robot_state-ego": 0.007202021683318706}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.003851495683299, "sim_physics": 0.062251168854382574, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735949, "sim_render-ego": 0.009022070437061543, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.01723548830771933, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.006214628414231904, "deviation-center-line": 0.08968283443958694, "driven_lanedir_consec": 0.7531703123735949, "sim_compute_sim_state": 0.003908308184876734, "sim_compute_performance-ego": 0.004770609797263632, "sim_compute_robot_state-ego": 0.006458983129384566}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504386, "sim_physics": 0.0769568043095725, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.010015628167561122, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.018677869013377597, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.0070811765534537175, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.004074211631502424, "sim_compute_performance-ego": 0.005418155874524798, "sim_compute_robot_state-ego": 0.006967633962631226}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.07753467559814453, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.01008584385826474, "in-drivable-lane": 0, "agent_compute-ego": 0.018867594855172292, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.007061776660737537, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.00439536003839402, "sim_compute_performance-ego": 0.005571354003179641, "sim_compute_robot_state-ego": 0.007054533277239118}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510794, "sim_physics": 0.056277561995942714, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.007516270976955608, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.01382938886092881, "deviation-heading": 0.3292838510353387, "set_robot_commands": 0.005282507104388738, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.0031596846499685515, "sim_compute_performance-ego": 0.004137920121015128, "sim_compute_robot_state-ego": 0.005383790549585375}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.043548155325732, "sim_physics": 0.07434545863758434, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.009661964936689898, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.018348689512772992, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.0071140809492631395, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.003802806680852717, "sim_compute_performance-ego": 0.005348504673350941, "sim_compute_robot_state-ego": 0.0068232796408913355}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193285, "sim_physics": 0.06256593047798455, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848785, "sim_render-ego": 0.009140116827828544, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.0180413970699558, "deviation-heading": 0.35668107106767694, "set_robot_commands": 0.006302870713271104, "deviation-center-line": 0.2251391443608223, "driven_lanedir_consec": 1.1042463557848785, "sim_compute_sim_state": 0.003616472343345741, "sim_compute_performance-ego": 0.004958694631403143, "sim_compute_robot_state-ego": 0.006205654763556146}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.06629621982574463, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.007982935224260603, "in-drivable-lane": 0, "agent_compute-ego": 0.01461372205189296, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.005329115050179618, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.003176791327340262, "sim_compute_performance-ego": 0.004409313201904297, "sim_compute_robot_state-ego": 0.005681088992527553}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775695, "sim_physics": 0.06176132781832826, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.010536591211954752, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.017605243944654278, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.008005679822435566, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.003926380007874732, "sim_compute_performance-ego": 0.0059401194254557295, "sim_compute_robot_state-ego": 0.0072022466098561}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.06268349400273075, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.008310423956976997, "in-drivable-lane": 0, "agent_compute-ego": 0.016555830284401222, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.006047760998761213, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.0033580373834680628, "sim_compute_performance-ego": 0.004317839940388997, "sim_compute_robot_state-ego": 0.00556732107091833}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.05536184123918122, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063861, "sim_render-ego": 0.00788407699734557, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.016531818053301645, "deviation-heading": 0.5178939525116448, "set_robot_commands": 0.00572815829632329, "deviation-center-line": 0.28386357003337986, "driven_lanedir_consec": 1.919400421063861, "sim_compute_sim_state": 0.0032800880132936965, "sim_compute_performance-ego": 0.004417122579088398, "sim_compute_robot_state-ego": 0.005751958080366546}}
set_robot_commands_max0.008005679822435566
set_robot_commands_mean0.006344662483423216
set_robot_commands_median0.006302870713271104
set_robot_commands_min0.005214845432954676
sim_compute_performance-ego_max0.0059401194254557295
sim_compute_performance-ego_mean0.004972786049755353
sim_compute_performance-ego_median0.004958694631403143
sim_compute_performance-ego_min0.0039722779217888325
sim_compute_robot_state-ego_max0.0072022466098561
sim_compute_robot_state-ego_mean0.006327354132071468
sim_compute_robot_state-ego_median0.006458983129384566
sim_compute_robot_state-ego_min0.005324966767254998
sim_compute_sim_state_max0.00439536003839402
sim_compute_sim_state_mean0.00368609922345328
sim_compute_sim_state_median0.003802806680852717
sim_compute_sim_state_min0.0030724441303926356
sim_physics_max0.0786283016204834
sim_physics_mean0.06626105882697343
sim_physics_median0.06268349400273075
sim_physics_min0.05510797220117906
sim_render-ego_max0.010536591211954752
sim_render-ego_mean0.00905042338293491
sim_render-ego_median0.009140116827828544
sim_render-ego_min0.007516270976955608
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible
245054276Riza Velioglu 🇩🇪Uni Bielefeldaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:01:57
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
244994270Riza Velioglu 🇩🇪Uni Bielefeldaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:01:59
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
244904267Gianmarco Bernasconichallenge-aido_LF-baseline-duckietownaido3-LFVI-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:06:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
244884259Riza Velioglu 🇩🇪Uni Bielefeldaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:03:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
244874258Anastasiya Nikolskaya 🇷🇺betaaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-35-218-104910:23:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7682830990812033
survival_time_median13.400000000000055
deviation-center-line_median0.5992304149874592
in-drivable-lane_median1.999999999999993


other stats
agent_compute-ego_max0.04775888919830322
agent_compute-ego_mean0.047127585148084614
agent_compute-ego_median0.047152678991101454
agent_compute-ego_min0.04622697830200195
deviation-center-line_max1.1320867856256165
deviation-center-line_mean0.6501628090102274
deviation-center-line_min0.22585045001834453
deviation-heading_max4.394769159225656
deviation-heading_mean2.3560209596115818
deviation-heading_median2.2813505105951473
deviation-heading_min0.6330306279218182
driven_any_max1.9779260927364972
driven_any_mean1.454109139703781
driven_any_median1.6662665960601095
driven_any_min0.4737620395428482
driven_lanedir_consec_max1.9461447636461848
driven_lanedir_consec_mean1.017482491525696
driven_lanedir_consec_min0.46054384366544143
driven_lanedir_max1.9461447636461848
driven_lanedir_mean1.1100755806526137
driven_lanedir_median1.2329481856844553
driven_lanedir_min0.46054384366544143
in-drivable-lane_max8.550000000000093
in-drivable-lane_mean2.2033333333333474
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.5950196112021284, "sim_physics": 0.04822915077209473, "survival_time": 14.950000000000076, "driven_lanedir": 1.421907339806391, "sim_render-ego": 0.006682670911153157, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.04753945509592692, "deviation-heading": 3.189077596704791, "set_robot_commands": 0.004510773817698161, "deviation-center-line": 0.7782425235084787, "driven_lanedir_consec": 0.605770244512791, "sim_compute_sim_state": 0.0027677003542582192, "sim_compute_performance-ego": 0.0038031975428263346, "sim_compute_robot_state-ego": 0.004692803223927816}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.964692711353324, "sim_physics": 0.04650168657302856, "survival_time": 14.950000000000076, "driven_lanedir": 1.923187177350548, "sim_render-ego": 0.007457722028096517, "in-drivable-lane": 0, "agent_compute-ego": 0.04707299868265788, "deviation-heading": 2.1419821740862286, "set_robot_commands": 0.004546384811401367, "deviation-center-line": 0.953669485194954, "driven_lanedir_consec": 1.923187177350548, "sim_compute_sim_state": 0.0027802348136901855, "sim_compute_performance-ego": 0.003734941482543945, "sim_compute_robot_state-ego": 0.0046808513005574546}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0332893588787009, "sim_physics": 0.04956927684822468, "survival_time": 9.900000000000006, "driven_lanedir": 0.6226777285751108, "sim_render-ego": 0.006878985299004449, "in-drivable-lane": 3.2000000000000215, "agent_compute-ego": 0.04662203909170748, "deviation-heading": 1.6389239175417738, "set_robot_commands": 0.004614471185086954, "deviation-center-line": 0.6005997162895127, "driven_lanedir_consec": 0.6226777285751108, "sim_compute_sim_state": 0.0027981225890342637, "sim_compute_performance-ego": 0.0037360046849106297, "sim_compute_robot_state-ego": 0.0046724394114330565}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7217044876656875, "sim_physics": 0.04489726519239121, "survival_time": 13.80000000000006, "driven_lanedir": 1.2329481856844553, "sim_render-ego": 0.006796758244003075, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.04683287247367527, "deviation-heading": 4.394769159225656, "set_robot_commands": 0.004583665426226629, "deviation-center-line": 1.0239650607588229, "driven_lanedir_consec": 1.1836947640680189, "sim_compute_sim_state": 0.002798214338827824, "sim_compute_performance-ego": 0.0037427941958109536, "sim_compute_robot_state-ego": 0.00471300923306009}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6662665960601095, "sim_physics": 0.04561045952141285, "survival_time": 12.800000000000049, "driven_lanedir": 1.264678574915095, "sim_render-ego": 0.006809067912399769, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.04768192954361439, "deviation-heading": 2.2813505105951473, "set_robot_commands": 0.0044700875878334045, "deviation-center-line": 0.5673105035879952, "driven_lanedir_consec": 1.209389128044509, "sim_compute_sim_state": 0.002830992452800274, "sim_compute_performance-ego": 0.0037262849509716034, "sim_compute_robot_state-ego": 0.0047439271584153175}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.8439940398715065, "sim_physics": 0.04470690568288167, "survival_time": 14.950000000000076, "driven_lanedir": 1.6821174621239878, "sim_render-ego": 0.0067376438776652016, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.04770254850387573, "deviation-heading": 2.3536561398055516, "set_robot_commands": 0.004519905249277751, "deviation-center-line": 0.958275452068856, "driven_lanedir_consec": 1.6821174621239878, "sim_compute_sim_state": 0.002802442709604899, "sim_compute_performance-ego": 0.003723467191060384, "sim_compute_robot_state-ego": 0.004697428544362386}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.1372002430950952, "sim_physics": 0.04439496839201296, "survival_time": 7.699999999999981, "driven_lanedir": 0.6874997318910254, "sim_render-ego": 0.006753416804524211, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.046550357496583615, "deviation-heading": 2.452664031168391, "set_robot_commands": 0.004486474123868075, "deviation-center-line": 0.22585045001834453, "driven_lanedir_consec": 0.6330604194303624, "sim_compute_sim_state": 0.002779615389836299, "sim_compute_performance-ego": 0.003717944219514921, "sim_compute_robot_state-ego": 0.00467860543882692}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.8311987723733951, "sim_physics": 0.045090573937145634, "survival_time": 13.400000000000055, "driven_lanedir": 1.3067819125520876, "sim_render-ego": 0.007309942992765512, "in-drivable-lane": 2.350000000000013, "agent_compute-ego": 0.0472973318242315, "deviation-heading": 3.3197205856054555, "set_robot_commands": 0.004568951343422506, "deviation-center-line": 1.1320867856256165, "driven_lanedir_consec": 1.2904915795202017, "sim_compute_sim_state": 0.002784644489857688, "sim_compute_performance-ego": 0.003747739009003141, "sim_compute_robot_state-ego": 0.0047182823295023905}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.6854088564619476, "sim_physics": 0.04640557686487834, "survival_time": 14.950000000000076, "driven_lanedir": 0.5712033126717624, "sim_render-ego": 0.006760397752126058, "in-drivable-lane": 8.550000000000093, "agent_compute-ego": 0.04752743482589722, "deviation-heading": 1.281249037215461, "set_robot_commands": 0.00455283006032308, "deviation-center-line": 0.5655880550526432, "driven_lanedir_consec": 0.5712033126717624, "sim_compute_sim_state": 0.0027849904696146646, "sim_compute_performance-ego": 0.003718123435974121, "sim_compute_robot_state-ego": 0.00467589537302653}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9833669224418566, "sim_physics": 0.04403412026703042, "survival_time": 9.45, "driven_lanedir": 0.5393208280331521, "sim_render-ego": 0.006809544941735646, "in-drivable-lane": 3.700000000000012, "agent_compute-ego": 0.04653857372425221, "deviation-heading": 1.854751712324951, "set_robot_commands": 0.004537384346048668, "deviation-center-line": 0.35995839183640066, "driven_lanedir_consec": 0.5372733379392138, "sim_compute_sim_state": 0.00278251259415238, "sim_compute_performance-ego": 0.00371516192400897, "sim_compute_robot_state-ego": 0.004688256632083308}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.8032627334136937, "sim_physics": 0.04641284147898357, "survival_time": 14.950000000000076, "driven_lanedir": 1.5846432975767266, "sim_render-ego": 0.006862466335296631, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.04775888919830322, "deviation-heading": 3.7423232821219874, "set_robot_commands": 0.004501646359761556, "deviation-center-line": 0.5992304149874592, "driven_lanedir_consec": 1.2264714523216158, "sim_compute_sim_state": 0.0027881773312886556, "sim_compute_performance-ego": 0.003712822596232096, "sim_compute_robot_state-ego": 0.004706851641337077}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0831874744282437, "sim_physics": 0.04424171595229316, "survival_time": 9.700000000000005, "driven_lanedir": 0.6391964522160318, "sim_render-ego": 0.006674228255281744, "in-drivable-lane": 3.3500000000000174, "agent_compute-ego": 0.047152678991101454, "deviation-heading": 3.1953387990074393, "set_robot_commands": 0.004458735898597953, "deviation-center-line": 0.5069894275076379, "driven_lanedir_consec": 0.6019290599344902, "sim_compute_sim_state": 0.0027279841531183302, "sim_compute_performance-ego": 0.003664821693577718, "sim_compute_robot_state-ego": 0.004603459662997846}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.011357156031686, "sim_physics": 0.04352053960164388, "survival_time": 7.499999999999981, "driven_lanedir": 0.7682830990812033, "sim_render-ego": 0.006728019714355469, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.04622697830200195, "deviation-heading": 1.021499396689066, "set_robot_commands": 0.004574275016784668, "deviation-center-line": 0.3934222136649902, "driven_lanedir_consec": 0.7682830990812033, "sim_compute_sim_state": 0.002768691380818685, "sim_compute_performance-ego": 0.0036762030919392902, "sim_compute_robot_state-ego": 0.004638772010803222}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4737620395428482, "sim_physics": 0.047722497294026035, "survival_time": 3.099999999999997, "driven_lanedir": 0.46054384366544143, "sim_render-ego": 0.006833707132647114, "in-drivable-lane": 0, "agent_compute-ego": 0.04713257666557066, "deviation-heading": 0.6330306279218182, "set_robot_commands": 0.004394077485607517, "deviation-center-line": 0.26856448321547716, "driven_lanedir_consec": 0.46054384366544143, "sim_compute_sim_state": 0.002677932862312563, "sim_compute_performance-ego": 0.0036263927336662046, "sim_compute_robot_state-ego": 0.0045492764442197735}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.9779260927364972, "sim_physics": 0.042209981282552086, "survival_time": 14.950000000000076, "driven_lanedir": 1.9461447636461848, "sim_render-ego": 0.006614000002543132, "in-drivable-lane": 0, "agent_compute-ego": 0.04727711280186971, "deviation-heading": 1.839977424160003, "set_robot_commands": 0.0045161692301432296, "deviation-center-line": 0.8186891718362214, "driven_lanedir_consec": 1.9461447636461848, "sim_compute_sim_state": 0.002733598550160726, "sim_compute_performance-ego": 0.003669304052988688, "sim_compute_robot_state-ego": 0.00459523598353068}}
set_robot_commands_max0.004614471185086954
set_robot_commands_mean0.004522388796138767
set_robot_commands_median0.004519905249277751
set_robot_commands_min0.004394077485607517
sim_compute_performance-ego_max0.0038031975428263346
sim_compute_performance-ego_mean0.0037143468536686
sim_compute_performance-ego_median0.003718123435974121
sim_compute_performance-ego_min0.0036263927336662046
sim_compute_robot_state-ego_max0.0047439271584153175
sim_compute_robot_state-ego_mean0.0046703396258722584
sim_compute_robot_state-ego_median0.0046808513005574546
sim_compute_robot_state-ego_min0.0045492764442197735
sim_compute_sim_state_max0.002830992452800274
sim_compute_sim_state_mean0.0027737236319583776
sim_compute_sim_state_median0.00278251259415238
sim_compute_sim_state_min0.002677932862312563
sim_physics_max0.04956927684822468
sim_physics_mean0.04556983731070665
sim_physics_median0.045090573937145634
sim_physics_min0.042209981282552086
sim_render-ego_max0.007457722028096517
sim_render-ego_mean0.0068472381469065115
sim_render-ego_median0.006796758244003075
sim_render-ego_min0.006614000002543132
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.803333333333374
survival_time_min3.099999999999997
No reset possible
244434240Manfred DiazBaseline-IL-logs-tensorflowaido3-LF-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:04:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
244244226Manfred DiazBaseline-IL-logs-tensorflowaido3-LFV-sim-validationstep1-simulationfailednoip-172-31-35-218-104910:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[{{node prefix/ConvNet/fc_layer_2/bias/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 60, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/fc_layer_2/bias/read', defined at:
               ||   File "imitation_agent.py", line 136, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 132, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 43, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243864193Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-testingstep1-simulationerrornoip-172-31-35-218-104910:00:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243764191Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-35-218-104910:09:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243704182Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-validationstep1-simulationerrornoip-172-31-35-218-104910:02:19
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243604175Bhairav Mehtachallenge-aido_LF-template-pytorchaido3-LFVI-sim-testingstep1-simulationfailednoip-172-31-35-218-104910:02:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 36, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 9, in preprocess
               ||     from scipy.misc import imresize
               || ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243464167Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-35-218-104910:13:05
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible