Duckietown Challenges Home Challenges Submissions

Evaluator 744

ID744
evaluatoruberduck2
ownerLiam Paull 🇨🇦
machineuberduck
processuberduck2
versiond-c:4.0.18;d-c-r:4.0.27;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success22 18129
# timeout
# failed1 18294
# error22 18127
# aborted
# host-error1 18128
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
183862605Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessnouberduck20:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04328562663151668
agent_compute-ego_mean0.04252308378056213
agent_compute-ego_median0.04233201006625561
agent_compute-ego_min0.04210790192208639
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.011782122821342654, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.03421379880207341, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.04210790192208639, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.05152568584535181, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.02319198992194199, "sim_compute_performance-ego": 0.036025875952185656, "sim_compute_robot_state-ego": 0.04084354784430527}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.010361267970158504, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.03533707215235783, "in-drivable-lane": 0, "agent_compute-ego": 0.04328562663151668, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.05074150745685284, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.02332912041590764, "sim_compute_performance-ego": 0.03644929482386662, "sim_compute_robot_state-ego": 0.04205798185788668}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.010584095691112762, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.03463638589737263, "in-drivable-lane": 0, "agent_compute-ego": 0.04233201006625561, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.0505934421052324, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.022966780561081902, "sim_compute_performance-ego": 0.03658145032030471, "sim_compute_robot_state-ego": 0.042214028378750414}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.011685664837176982, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.03436108211894612, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0427717638539744, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.050505334204369846, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.02389929582784464, "sim_compute_performance-ego": 0.036742527406294266, "sim_compute_robot_state-ego": 0.041133458797748275}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.010439000631633558, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.03590498472514905, "in-drivable-lane": 0, "agent_compute-ego": 0.042118116428977566, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.050348181473581416, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.023177090444062885, "sim_compute_performance-ego": 0.03562037568343313, "sim_compute_robot_state-ego": 0.04247268877531353}}
set_robot_commands_max0.05152568584535181
set_robot_commands_mean0.050742830217077664
set_robot_commands_median0.0505934421052324
set_robot_commands_min0.050348181473581416
sim_compute_performance-ego_max0.036742527406294266
sim_compute_performance-ego_mean0.03628390483721688
sim_compute_performance-ego_median0.03644929482386662
sim_compute_performance-ego_min0.03562037568343313
sim_compute_robot_state-ego_max0.04247268877531353
sim_compute_robot_state-ego_mean0.04174434113080083
sim_compute_robot_state-ego_median0.04205798185788668
sim_compute_robot_state-ego_min0.04084354784430527
sim_compute_sim_state_max0.02389929582784464
sim_compute_sim_state_mean0.023312855434167813
sim_compute_sim_state_median0.02319198992194199
sim_compute_sim_state_min0.022966780561081902
sim_physics_max0.011782122821342654
sim_physics_mean0.010970430390284893
sim_physics_median0.010584095691112762
sim_physics_min0.010361267970158504
sim_render-ego_max0.03590498472514905
sim_render-ego_mean0.03489066473917981
sim_render-ego_median0.03463638589737263
sim_render-ego_min0.03421379880207341
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
183812617Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessnouberduck20:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.08647616854253805
agent_compute-ego_mean0.08537657191224718
agent_compute-ego_median0.08569270723006304
agent_compute-ego_min0.08411348407918756
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.010004812816403946, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.03493065204260484, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.08647616854253805, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.05161354676732477, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.023562521304724353, "sim_compute_performance-ego": 0.036950552238608304, "sim_compute_robot_state-ego": 0.04173443902213619}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.009932675144889136, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.03468706391074441, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.08411348407918756, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.05028783191334118, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.02313707633451982, "sim_compute_performance-ego": 0.036630451679229736, "sim_compute_robot_state-ego": 0.041488587856292725}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.00962143474155002, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.0347036255730523, "in-drivable-lane": 0, "agent_compute-ego": 0.08467961947123209, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.050453869501749675, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.02267717785305447, "sim_compute_performance-ego": 0.03645413716634115, "sim_compute_robot_state-ego": 0.04152143266465929}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.00982131560643514, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.03549582759539286, "in-drivable-lane": 0, "agent_compute-ego": 0.08592088023821513, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0508022407690684, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.023313164710998535, "sim_compute_performance-ego": 0.03646679719289144, "sim_compute_robot_state-ego": 0.04184998571872711}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01077182503307567, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.035028843318714815, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.08569270723006304, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05208446699030259, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.02342435542274924, "sim_compute_performance-ego": 0.03689518746207742, "sim_compute_robot_state-ego": 0.04164917328778435}}
set_robot_commands_max0.05208446699030259
set_robot_commands_mean0.05104839118835732
set_robot_commands_median0.0508022407690684
set_robot_commands_min0.05028783191334118
sim_compute_performance-ego_max0.036950552238608304
sim_compute_performance-ego_mean0.03667942514782961
sim_compute_performance-ego_median0.036630451679229736
sim_compute_performance-ego_min0.03645413716634115
sim_compute_robot_state-ego_max0.04184998571872711
sim_compute_robot_state-ego_mean0.041648723709919934
sim_compute_robot_state-ego_median0.04164917328778435
sim_compute_robot_state-ego_min0.041488587856292725
sim_compute_sim_state_max0.023562521304724353
sim_compute_sim_state_mean0.02322285912520928
sim_compute_sim_state_median0.023313164710998535
sim_compute_sim_state_min0.02267717785305447
sim_physics_max0.01077182503307567
sim_physics_mean0.010030412668470785
sim_physics_median0.009932675144889136
sim_physics_min0.00962143474155002
sim_render-ego_max0.03549582759539286
sim_render-ego_mean0.03496920248810185
sim_render-ego_median0.03493065204260484
sim_render-ego_min0.03468706391074441
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
183712636Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnouberduck20:07:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.08645755904061454
agent_compute-ego_mean0.0848698206276353
agent_compute-ego_median0.08463226210686468
agent_compute-ego_min0.0839183101287255
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.022019291680956645, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.034930263246808736, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.08645755904061454, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.04983620416550409, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.022131280293540348, "sim_compute_performance-ego": 0.03526128284514896, "sim_compute_robot_state-ego": 0.04209756094311911, "sim_compute_robot_state-npc0": 0.0379845036400689, "sim_compute_robot_state-npc1": 0.037519125711350215, "sim_compute_robot_state-npc2": 0.03754558260478671, "sim_compute_robot_state-npc3": 0.037710886152963786}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.01938942366955327, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.03520506036047842, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.0851278164807488, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.05236315259746477, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.021886965807746437, "sim_compute_performance-ego": 0.03563786955440745, "sim_compute_robot_state-ego": 0.04148059265286315, "sim_compute_robot_state-npc0": 0.03725282351175944, "sim_compute_robot_state-npc1": 0.03797776558819939, "sim_compute_robot_state-npc2": 0.03661170192793304, "sim_compute_robot_state-npc3": 0.03743408708011403}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.0210429314644106, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.035565630082161195, "in-drivable-lane": 0, "agent_compute-ego": 0.08463226210686468, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.050161180957671136, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.02177628778642224, "sim_compute_performance-ego": 0.03544080641961867, "sim_compute_robot_state-ego": 0.040959208242354855, "sim_compute_robot_state-npc0": 0.037050462538196195, "sim_compute_robot_state-npc1": 0.03791001535231067, "sim_compute_robot_state-npc2": 0.037424364397602695, "sim_compute_robot_state-npc3": 0.03770831707985171}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.021651970579269084, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.03524621750446076, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.084213155381223, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.050090695949310954, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.02271701934489798, "sim_compute_performance-ego": 0.03510731585482334, "sim_compute_robot_state-ego": 0.04274351546104918, "sim_compute_robot_state-npc0": 0.03907214073424644, "sim_compute_robot_state-npc1": 0.03838842473131545, "sim_compute_robot_state-npc2": 0.03725247433845033, "sim_compute_robot_state-npc3": 0.039017601216093024}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.019507756600013144, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.034830180498269886, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0839183101287255, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05029548131502592, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.021680891513824463, "sim_compute_performance-ego": 0.03513526458006639, "sim_compute_robot_state-ego": 0.041339640433971696, "sim_compute_robot_state-npc0": 0.038755760743067816, "sim_compute_robot_state-npc1": 0.038079908260932334, "sim_compute_robot_state-npc2": 0.03707666121996366, "sim_compute_robot_state-npc3": 0.038316625815171465}}
set_robot_commands_max0.05236315259746477
set_robot_commands_mean0.05054934299699537
set_robot_commands_median0.050161180957671136
set_robot_commands_min0.04983620416550409
sim_compute_performance-ego_max0.03563786955440745
sim_compute_performance-ego_mean0.03531650785081296
sim_compute_performance-ego_median0.03526128284514896
sim_compute_performance-ego_min0.03510731585482334
sim_compute_robot_state-ego_max0.04274351546104918
sim_compute_robot_state-ego_mean0.041724103546671595
sim_compute_robot_state-ego_median0.04148059265286315
sim_compute_robot_state-ego_min0.040959208242354855
sim_compute_robot_state-npc0_max0.03907214073424644
sim_compute_robot_state-npc0_mean0.03802313823346776
sim_compute_robot_state-npc0_median0.0379845036400689
sim_compute_robot_state-npc0_min0.037050462538196195
sim_compute_robot_state-npc1_max0.03838842473131545
sim_compute_robot_state-npc1_mean0.03797504792882161
sim_compute_robot_state-npc1_median0.03797776558819939
sim_compute_robot_state-npc1_min0.037519125711350215
sim_compute_robot_state-npc2_max0.03754558260478671
sim_compute_robot_state-npc2_mean0.03718215689774729
sim_compute_robot_state-npc2_median0.03725247433845033
sim_compute_robot_state-npc2_min0.03661170192793304
sim_compute_robot_state-npc3_max0.039017601216093024
sim_compute_robot_state-npc3_mean0.038037503468838794
sim_compute_robot_state-npc3_median0.037710886152963786
sim_compute_robot_state-npc3_min0.03743408708011403
sim_compute_sim_state_max0.02271701934489798
sim_compute_sim_state_mean0.02203848894928629
sim_compute_sim_state_median0.021886965807746437
sim_compute_sim_state_min0.021680891513824463
sim_physics_max0.022019291680956645
sim_physics_mean0.020722274798840545
sim_physics_median0.0210429314644106
sim_physics_min0.01938942366955327
sim_render-ego_max0.035565630082161195
sim_render-ego_mean0.0351554703384358
sim_render-ego_median0.03520506036047842
sim_render-ego_min0.034830180498269886
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
183672644Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationsuccessnouberduck20:06:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04328705909404349
agent_compute-ego_mean0.04210509277254528
agent_compute-ego_median0.04231869257413424
agent_compute-ego_min0.04035933424786824
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.018008336788270532, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.03512828815274122, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.04035933424786824, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.050494130064801475, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.02193595141899295, "sim_compute_performance-ego": 0.03478572136018335, "sim_compute_robot_state-ego": 0.04230305334416831, "sim_compute_robot_state-npc0": 0.03797119710503555, "sim_compute_robot_state-npc1": 0.03893822867695878, "sim_compute_robot_state-npc2": 0.037195071941468774, "sim_compute_robot_state-npc3": 0.03792484213666218}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.018127991602971003, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.03570154080024132, "in-drivable-lane": 0, "agent_compute-ego": 0.04231869257413424, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.05054791157062237, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.022101310583261344, "sim_compute_performance-ego": 0.03549732611729549, "sim_compute_robot_state-ego": 0.04245339907132662, "sim_compute_robot_state-npc0": 0.03793937426346999, "sim_compute_robot_state-npc1": 0.03874536661001352, "sim_compute_robot_state-npc2": 0.03699155037219708, "sim_compute_robot_state-npc3": 0.0380549064049354}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.017538648970583652, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.033964263631942423, "in-drivable-lane": 0, "agent_compute-ego": 0.04328705909404349, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.050355104689902445, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.021167638454031436, "sim_compute_performance-ego": 0.03480527248788387, "sim_compute_robot_state-ego": 0.040614944823244785, "sim_compute_robot_state-npc0": 0.03628718092086467, "sim_compute_robot_state-npc1": 0.03779100864491564, "sim_compute_robot_state-npc2": 0.03644883886296699, "sim_compute_robot_state-npc3": 0.03759819903272264}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.017690807908445925, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.034599398518656635, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.04176968270605737, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.050575623145470254, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.021674418187403417, "sim_compute_performance-ego": 0.03571067537580218, "sim_compute_robot_state-ego": 0.04110039983476911, "sim_compute_robot_state-npc0": 0.037828880351978345, "sim_compute_robot_state-npc1": 0.03779295250609681, "sim_compute_robot_state-npc2": 0.036783616621415695, "sim_compute_robot_state-npc3": 0.037860477363670264}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.016726638141431306, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.03442200234061793, "in-drivable-lane": 0, "agent_compute-ego": 0.042790695240623074, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.05047589854190224, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.02240139559695595, "sim_compute_performance-ego": 0.03563811277088366, "sim_compute_robot_state-ego": 0.04235142783114785, "sim_compute_robot_state-npc0": 0.03783840254733437, "sim_compute_robot_state-npc1": 0.03871770908958033, "sim_compute_robot_state-npc2": 0.03715663207204718, "sim_compute_robot_state-npc3": 0.03879493788668984}}
set_robot_commands_max0.050575623145470254
set_robot_commands_mean0.05048973360253976
set_robot_commands_median0.050494130064801475
set_robot_commands_min0.050355104689902445
sim_compute_performance-ego_max0.03571067537580218
sim_compute_performance-ego_mean0.035287421622409706
sim_compute_performance-ego_median0.03549732611729549
sim_compute_performance-ego_min0.03478572136018335
sim_compute_robot_state-ego_max0.04245339907132662
sim_compute_robot_state-ego_mean0.04176464498093134
sim_compute_robot_state-ego_median0.04230305334416831
sim_compute_robot_state-ego_min0.040614944823244785
sim_compute_robot_state-npc0_max0.03797119710503555
sim_compute_robot_state-npc0_mean0.03757300703773658
sim_compute_robot_state-npc0_median0.03783840254733437
sim_compute_robot_state-npc0_min0.03628718092086467
sim_compute_robot_state-npc1_max0.03893822867695878
sim_compute_robot_state-npc1_mean0.038397053105513015
sim_compute_robot_state-npc1_median0.03871770908958033
sim_compute_robot_state-npc1_min0.03779100864491564
sim_compute_robot_state-npc2_max0.037195071941468774
sim_compute_robot_state-npc2_mean0.03691514197401914
sim_compute_robot_state-npc2_median0.03699155037219708
sim_compute_robot_state-npc2_min0.03644883886296699
sim_compute_robot_state-npc3_max0.03879493788668984
sim_compute_robot_state-npc3_mean0.03804667256493606
sim_compute_robot_state-npc3_median0.03792484213666218
sim_compute_robot_state-npc3_min0.03759819903272264
sim_compute_sim_state_max0.02240139559695595
sim_compute_sim_state_mean0.021856142848129017
sim_compute_sim_state_median0.02193595141899295
sim_compute_sim_state_min0.021167638454031436
sim_physics_max0.018127991602971003
sim_physics_mean0.017618484682340486
sim_physics_median0.017690807908445925
sim_physics_min0.016726638141431306
sim_render-ego_max0.03570154080024132
sim_render-ego_mean0.03476309868883991
sim_render-ego_median0.034599398518656635
sim_render-ego_min0.033964263631942423
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
183642649Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationsuccessnouberduck20:06:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.04439541415164345
agent_compute-ego_mean0.04362818506042375
agent_compute-ego_median0.04393953398654336
agent_compute-ego_min0.04254768111489036
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.021712875366210936, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.03580837500722785, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.04439541415164345, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.051538053311799704, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.022357074837935597, "sim_compute_performance-ego": 0.03660252721686112, "sim_compute_robot_state-ego": 0.04249859860068873, "sim_compute_robot_state-npc0": 0.03860466354771664, "sim_compute_robot_state-npc1": 0.038578811444734275, "sim_compute_robot_state-npc2": 0.03791550084164269, "sim_compute_robot_state-npc3": 0.03816884191412675}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.018979078844973917, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.03577120680558054, "in-drivable-lane": 0, "agent_compute-ego": 0.04393953398654336, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.05121554199017977, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.022264894686247177, "sim_compute_performance-ego": 0.03671457265552722, "sim_compute_robot_state-ego": 0.04278282742751272, "sim_compute_robot_state-npc0": 0.03844267443606728, "sim_compute_robot_state-npc1": 0.03719038712350946, "sim_compute_robot_state-npc2": 0.03851007160387541, "sim_compute_robot_state-npc3": 0.03806439198945698}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.019361495971679688, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.0358580503708277, "in-drivable-lane": 0, "agent_compute-ego": 0.04398930989778959, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.05130154658586551, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.021969379522861578, "sim_compute_performance-ego": 0.036492182658268854, "sim_compute_robot_state-ego": 0.04189567076854217, "sim_compute_robot_state-npc0": 0.03846301787938827, "sim_compute_robot_state-npc1": 0.03851117843236679, "sim_compute_robot_state-npc2": 0.03722127889975523, "sim_compute_robot_state-npc3": 0.0381927245702499}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.021705744971691723, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.03569095571276168, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.04326898615125199, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.051285797441509406, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.02270185779517805, "sim_compute_performance-ego": 0.035981906971461336, "sim_compute_robot_state-ego": 0.04264806022106762, "sim_compute_robot_state-npc0": 0.03922974559622751, "sim_compute_robot_state-npc1": 0.038811381434051086, "sim_compute_robot_state-npc2": 0.03867073797843826, "sim_compute_robot_state-npc3": 0.038533056286019336}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.018262987787073307, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.03536064516414295, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.04254768111489036, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.051319328221407806, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.022219917990944603, "sim_compute_performance-ego": 0.03588924624703147, "sim_compute_robot_state-ego": 0.04244269024242054, "sim_compute_robot_state-npc0": 0.038507131013003265, "sim_compute_robot_state-npc1": 0.039201622659509834, "sim_compute_robot_state-npc2": 0.03727634386582808, "sim_compute_robot_state-npc3": 0.03887590495022861}}
set_robot_commands_max0.051538053311799704
set_robot_commands_mean0.05133205351015245
set_robot_commands_median0.05130154658586551
set_robot_commands_min0.05121554199017977
sim_compute_performance-ego_max0.03671457265552722
sim_compute_performance-ego_mean0.03633608714983
sim_compute_performance-ego_median0.036492182658268854
sim_compute_performance-ego_min0.03588924624703147
sim_compute_robot_state-ego_max0.04278282742751272
sim_compute_robot_state-ego_mean0.042453569452046355
sim_compute_robot_state-ego_median0.04249859860068873
sim_compute_robot_state-ego_min0.04189567076854217
sim_compute_robot_state-npc0_max0.03922974559622751
sim_compute_robot_state-npc0_mean0.03864944649448059
sim_compute_robot_state-npc0_median0.038507131013003265
sim_compute_robot_state-npc0_min0.03844267443606728
sim_compute_robot_state-npc1_max0.039201622659509834
sim_compute_robot_state-npc1_mean0.03845867621883429
sim_compute_robot_state-npc1_median0.038578811444734275
sim_compute_robot_state-npc1_min0.03719038712350946
sim_compute_robot_state-npc2_max0.03867073797843826
sim_compute_robot_state-npc2_mean0.03791878663790793
sim_compute_robot_state-npc2_median0.03791550084164269
sim_compute_robot_state-npc2_min0.03722127889975523
sim_compute_robot_state-npc3_max0.03887590495022861
sim_compute_robot_state-npc3_mean0.03836698394201631
sim_compute_robot_state-npc3_median0.0381927245702499
sim_compute_robot_state-npc3_min0.03806439198945698
sim_compute_sim_state_max0.02270185779517805
sim_compute_sim_state_mean0.0223026249666334
sim_compute_sim_state_median0.022264894686247177
sim_compute_sim_state_min0.021969379522861578
sim_physics_max0.021712875366210936
sim_physics_mean0.020004436588325913
sim_physics_median0.019361495971679688
sim_physics_min0.018262987787073307
sim_render-ego_max0.0358580503708277
sim_render-ego_mean0.03569784661210814
sim_render-ego_median0.03577120680558054
sim_render-ego_min0.03536064516414295
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
183462681Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessnouberduck20:18:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1099178216504757
survival_time_median9.4
deviation-center-line_median0.6891850501480127
in-drivable-lane_median0.34999999999999876


other stats
agent_compute-ego_max0.04579476912816365
agent_compute-ego_mean0.045258548409244766
agent_compute-ego_median0.04534661374385888
agent_compute-ego_min0.04450549826716745
deviation-center-line_max1.094628842665842
deviation-center-line_mean0.6545654322508427
deviation-center-line_min0.2569150387489945
deviation-heading_max4.721511817928979
deviation-heading_mean2.706393786088841
deviation-heading_median2.1806889868169073
deviation-heading_min1.4022927119026225
driven_any_max2.3555294183517015
driven_any_mean1.469508400409695
driven_any_median1.4636647597625811
driven_any_min0.713613268734168
driven_lanedir_consec_max1.8340473946900513
driven_lanedir_consec_mean1.2122662729683198
driven_lanedir_consec_min0.6599278909573126
driven_lanedir_max1.8340473946900513
driven_lanedir_mean1.2574605952788829
driven_lanedir_median1.3358894332032905
driven_lanedir_min0.6599278909573126
in-drivable-lane_max1.6500000000000234
in-drivable-lane_mean0.5600000000000052
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.713613268734168, "sim_physics": 0.01851624498764674, "survival_time": 4.799999999999991, "driven_lanedir": 0.6599278909573126, "sim_render-ego": 0.0360946257909139, "in-drivable-lane": 0, "agent_compute-ego": 0.04561645785967509, "deviation-heading": 1.4022927119026225, "set_robot_commands": 0.05256840089956919, "deviation-center-line": 0.2569150387489945, "driven_lanedir_consec": 0.6599278909573126, "sim_compute_sim_state": 0.022585158546765644, "sim_compute_performance-ego": 0.03729526946942011, "sim_compute_robot_state-ego": 0.04336390147606531, "sim_compute_robot_state-npc0": 0.04030268142620722, "sim_compute_robot_state-npc1": 0.03920900324980418, "sim_compute_robot_state-npc2": 0.03852697958548864, "sim_compute_robot_state-npc3": 0.039198197424411774}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6483609851898042, "sim_physics": 0.01765415114814071, "survival_time": 10.550000000000017, "driven_lanedir": 1.3358894332032905, "sim_render-ego": 0.0365279127636227, "in-drivable-lane": 0.8000000000000034, "agent_compute-ego": 0.04534661374385888, "deviation-heading": 3.5101866226493437, "set_robot_commands": 0.052120989532832285, "deviation-center-line": 0.6891850501480127, "driven_lanedir_consec": 1.1099178216504757, "sim_compute_sim_state": 0.022813438804228724, "sim_compute_performance-ego": 0.0373716569059833, "sim_compute_robot_state-ego": 0.04393601530536091, "sim_compute_robot_state-npc0": 0.040678261580625416, "sim_compute_robot_state-npc1": 0.03936681363254927, "sim_compute_robot_state-npc2": 0.039079926025245994, "sim_compute_robot_state-npc3": 0.03953034504894962}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3555294183517015, "sim_physics": 0.016871001720428467, "survival_time": 14.950000000000076, "driven_lanedir": 1.8340473946900513, "sim_render-ego": 0.035764563083648684, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.04579476912816365, "deviation-heading": 4.721511817928979, "set_robot_commands": 0.05217934449513753, "deviation-center-line": 1.094628842665842, "driven_lanedir_consec": 1.8340473946900513, "sim_compute_sim_state": 0.02270143429438273, "sim_compute_performance-ego": 0.0372372031211853, "sim_compute_robot_state-ego": 0.04262589454650879, "sim_compute_robot_state-npc0": 0.04053692976633707, "sim_compute_robot_state-npc1": 0.03920315345128377, "sim_compute_robot_state-npc2": 0.03860588709513346, "sim_compute_robot_state-npc3": 0.03903048515319824}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4636647597625811, "sim_physics": 0.017992143935345588, "survival_time": 9.4, "driven_lanedir": 1.3992453660332962, "sim_render-ego": 0.03614132581873143, "in-drivable-lane": 0, "agent_compute-ego": 0.04502940304735874, "deviation-heading": 2.1806889868169073, "set_robot_commands": 0.051850984705255385, "deviation-center-line": 0.7914825498926447, "driven_lanedir_consec": 1.3992453660332962, "sim_compute_sim_state": 0.0227378378523157, "sim_compute_performance-ego": 0.0373641366654254, "sim_compute_robot_state-ego": 0.04299791569405414, "sim_compute_robot_state-npc0": 0.04101489579423945, "sim_compute_robot_state-npc1": 0.03911208725990133, "sim_compute_robot_state-npc2": 0.0390538344991968, "sim_compute_robot_state-npc3": 0.03945530348635735}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1663735700102198, "sim_physics": 0.017463286191422418, "survival_time": 7.549999999999981, "driven_lanedir": 1.058192891510463, "sim_render-ego": 0.03657416476319168, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.04450549826716745, "deviation-heading": 1.7172887911463517, "set_robot_commands": 0.051746930507634646, "deviation-center-line": 0.44061567979872, "driven_lanedir_consec": 1.058192891510463, "sim_compute_sim_state": 0.02284563929829377, "sim_compute_performance-ego": 0.03776296085079774, "sim_compute_robot_state-ego": 0.04293792610926344, "sim_compute_robot_state-npc0": 0.04048167001332669, "sim_compute_robot_state-npc1": 0.039403024888196525, "sim_compute_robot_state-npc2": 0.03896521574614064, "sim_compute_robot_state-npc3": 0.039079884030171576}}
set_robot_commands_max0.05256840089956919
set_robot_commands_mean0.052093330028085805
set_robot_commands_median0.052120989532832285
set_robot_commands_min0.051746930507634646
sim_compute_performance-ego_max0.03776296085079774
sim_compute_performance-ego_mean0.03740624540256237
sim_compute_performance-ego_median0.0373641366654254
sim_compute_performance-ego_min0.0372372031211853
sim_compute_robot_state-ego_max0.04393601530536091
sim_compute_robot_state-ego_mean0.04317233062625052
sim_compute_robot_state-ego_median0.04299791569405414
sim_compute_robot_state-ego_min0.04262589454650879
sim_compute_robot_state-npc0_max0.04101489579423945
sim_compute_robot_state-npc0_mean0.040602887716147174
sim_compute_robot_state-npc0_median0.04053692976633707
sim_compute_robot_state-npc0_min0.04030268142620722
sim_compute_robot_state-npc1_max0.039403024888196525
sim_compute_robot_state-npc1_mean0.039258816496347014
sim_compute_robot_state-npc1_median0.03920900324980418
sim_compute_robot_state-npc1_min0.03911208725990133
sim_compute_robot_state-npc2_max0.039079926025245994
sim_compute_robot_state-npc2_mean0.03884636859024111
sim_compute_robot_state-npc2_median0.03896521574614064
sim_compute_robot_state-npc2_min0.03852697958548864
sim_compute_robot_state-npc3_max0.03953034504894962
sim_compute_robot_state-npc3_mean0.03925884302861771
sim_compute_robot_state-npc3_median0.039198197424411774
sim_compute_robot_state-npc3_min0.03903048515319824
sim_compute_sim_state_max0.02284563929829377
sim_compute_sim_state_mean0.02273670175919731
sim_compute_sim_state_median0.0227378378523157
sim_compute_sim_state_min0.022585158546765644
sim_physics_max0.01851624498764674
sim_physics_mean0.017699365596596787
sim_physics_median0.01765415114814071
sim_physics_min0.016871001720428467
sim_render-ego_max0.03657416476319168
sim_render-ego_mean0.036220518444021674
sim_render-ego_median0.03614132581873143
sim_render-ego_min0.035764563083648684
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.450000000000014
survival_time_min4.799999999999991
No reset possible
183362707Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessnouberduck20:19:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7913973283713115
survival_time_median8.14999999999998
deviation-center-line_median0.4771767758800493
in-drivable-lane_median0.4500000000000002


other stats
agent_compute-ego_max0.046005647961455995
agent_compute-ego_mean0.04542925644710137
agent_compute-ego_median0.045531790680680535
agent_compute-ego_min0.044881705726896017
deviation-center-line_max0.8605097120228962
deviation-center-line_mean0.5507122852935121
deviation-center-line_min0.34581067631051454
deviation-heading_max6.110307944646417
deviation-heading_mean2.888495431126587
deviation-heading_median2.481128690063512
deviation-heading_min0.7934900967294212
driven_any_max2.3552529581289097
driven_any_mean1.4855455318820605
driven_any_median1.2627878576133904
driven_any_min0.7645941809436542
driven_lanedir_consec_max1.088809422668986
driven_lanedir_consec_mean0.8851793863797706
driven_lanedir_consec_min0.7493107776620294
driven_lanedir_max1.3515777317207136
driven_lanedir_mean1.0470658995077096
driven_lanedir_median1.088809422668986
driven_lanedir_min0.7493107776620294
in-drivable-lane_max4.80000000000003
in-drivable-lane_mean1.8400000000000076
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8421811223254343, "sim_physics": 0.018480935267039707, "survival_time": 5.599999999999988, "driven_lanedir": 0.7913973283713115, "sim_render-ego": 0.03566482237407139, "in-drivable-lane": 0, "agent_compute-ego": 0.045756908399718146, "deviation-heading": 1.492252001456641, "set_robot_commands": 0.05257931777409145, "deviation-center-line": 0.34581067631051454, "driven_lanedir_consec": 0.7913973283713115, "sim_compute_sim_state": 0.02255328212465559, "sim_compute_performance-ego": 0.037081064922469, "sim_compute_robot_state-ego": 0.04315558075904846, "sim_compute_robot_state-npc0": 0.04069348105362484, "sim_compute_robot_state-npc1": 0.039814140115465434, "sim_compute_robot_state-npc2": 0.038925230503082275, "sim_compute_robot_state-npc3": 0.03966248674052102}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.202911540398914, "sim_physics": 0.017596278871808733, "survival_time": 14.000000000000064, "driven_lanedir": 1.2542342371155075, "sim_render-ego": 0.03639324392591204, "in-drivable-lane": 4.80000000000003, "agent_compute-ego": 0.044881705726896017, "deviation-heading": 3.5652984227369453, "set_robot_commands": 0.05318761723382132, "deviation-center-line": 0.6425309060853074, "driven_lanedir_consec": 1.0102067008408224, "sim_compute_sim_state": 0.023000939403261457, "sim_compute_performance-ego": 0.037400591373443606, "sim_compute_robot_state-ego": 0.04324178695678711, "sim_compute_robot_state-npc0": 0.04114596503121512, "sim_compute_robot_state-npc1": 0.03980989371027265, "sim_compute_robot_state-npc2": 0.03924528700964791, "sim_compute_robot_state-npc3": 0.039641943999699183}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2627878576133904, "sim_physics": 0.0177597326735046, "survival_time": 8.14999999999998, "driven_lanedir": 1.088809422668986, "sim_render-ego": 0.03596691119890272, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.045531790680680535, "deviation-heading": 2.481128690063512, "set_robot_commands": 0.05288857185036127, "deviation-center-line": 0.4771767758800493, "driven_lanedir_consec": 1.088809422668986, "sim_compute_sim_state": 0.02274052350798999, "sim_compute_performance-ego": 0.037485881817121446, "sim_compute_robot_state-ego": 0.04326398972353321, "sim_compute_robot_state-npc0": 0.04106782111653521, "sim_compute_robot_state-npc1": 0.03947863842080707, "sim_compute_robot_state-npc2": 0.03881926478052432, "sim_compute_robot_state-npc3": 0.03972684386317715}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3552529581289097, "sim_physics": 0.017274043560028075, "survival_time": 14.950000000000076, "driven_lanedir": 1.3515777317207136, "sim_render-ego": 0.03613660494486491, "in-drivable-lane": 3.950000000000008, "agent_compute-ego": 0.04497022946675618, "deviation-heading": 6.110307944646417, "set_robot_commands": 0.05244232257207235, "deviation-center-line": 0.8605097120228962, "driven_lanedir_consec": 0.7861727023557044, "sim_compute_sim_state": 0.022957525253295898, "sim_compute_performance-ego": 0.03802459398905436, "sim_compute_robot_state-ego": 0.04338470300038656, "sim_compute_robot_state-npc0": 0.04133031368255615, "sim_compute_robot_state-npc1": 0.03998137553532918, "sim_compute_robot_state-npc2": 0.03900428533554077, "sim_compute_robot_state-npc3": 0.03948255062103272}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7645941809436542, "sim_physics": 0.018279111031258465, "survival_time": 5.04999999999999, "driven_lanedir": 0.7493107776620294, "sim_render-ego": 0.03654914091129114, "in-drivable-lane": 0, "agent_compute-ego": 0.046005647961455995, "deviation-heading": 0.7934900967294212, "set_robot_commands": 0.05441086363084245, "deviation-center-line": 0.42753335616879307, "driven_lanedir_consec": 0.7493107776620294, "sim_compute_sim_state": 0.02276564116525178, "sim_compute_performance-ego": 0.03732231583925757, "sim_compute_robot_state-ego": 0.04274892807006836, "sim_compute_robot_state-npc0": 0.040144474199502775, "sim_compute_robot_state-npc1": 0.039136990462199296, "sim_compute_robot_state-npc2": 0.03889859076773766, "sim_compute_robot_state-npc3": 0.039352147886068514}}
set_robot_commands_max0.05441086363084245
set_robot_commands_mean0.05310173861223777
set_robot_commands_median0.05288857185036127
set_robot_commands_min0.05244232257207235
sim_compute_performance-ego_max0.03802459398905436
sim_compute_performance-ego_mean0.0374628895882692
sim_compute_performance-ego_median0.037400591373443606
sim_compute_performance-ego_min0.037081064922469
sim_compute_robot_state-ego_max0.04338470300038656
sim_compute_robot_state-ego_mean0.04315899770196474
sim_compute_robot_state-ego_median0.04324178695678711
sim_compute_robot_state-ego_min0.04274892807006836
sim_compute_robot_state-npc0_max0.04133031368255615
sim_compute_robot_state-npc0_mean0.04087641101668682
sim_compute_robot_state-npc0_median0.04106782111653521
sim_compute_robot_state-npc0_min0.040144474199502775
sim_compute_robot_state-npc1_max0.03998137553532918
sim_compute_robot_state-npc1_mean0.039644207648814725
sim_compute_robot_state-npc1_median0.03980989371027265
sim_compute_robot_state-npc1_min0.039136990462199296
sim_compute_robot_state-npc2_max0.03924528700964791
sim_compute_robot_state-npc2_mean0.03897853167930659
sim_compute_robot_state-npc2_median0.038925230503082275
sim_compute_robot_state-npc2_min0.03881926478052432
sim_compute_robot_state-npc3_max0.03972684386317715
sim_compute_robot_state-npc3_mean0.03957319462209972
sim_compute_robot_state-npc3_median0.039641943999699183
sim_compute_robot_state-npc3_min0.039352147886068514
sim_compute_sim_state_max0.023000939403261457
sim_compute_sim_state_mean0.022803582290890943
sim_compute_sim_state_median0.02276564116525178
sim_compute_sim_state_min0.02255328212465559
sim_physics_max0.018480935267039707
sim_physics_mean0.017878020280727915
sim_physics_median0.0177597326735046
sim_physics_min0.017274043560028075
sim_render-ego_max0.03654914091129114
sim_render-ego_mean0.03614214467100844
sim_render-ego_median0.03613660494486491
sim_render-ego_min0.03566482237407139
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.55000000000002
survival_time_min5.04999999999999
No reset possible
183032775Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessnouberduck20:20:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6604108528489878
survival_time_median11.200000000000024
deviation-center-line_median0.6739622424307645
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.07598353201343168
agent_compute-ego_mean0.0682665103795547
agent_compute-ego_median0.06611142258195511
agent_compute-ego_min0.06535031965800694
deviation-center-line_max1.405974511761293
deviation-center-line_mean0.7177307940958095
deviation-center-line_min0.06551451591721544
deviation-heading_max3.1827494263780953
deviation-heading_mean1.9757818155087044
deviation-heading_median2.0949369990768756
deviation-heading_min0.6994114023305026
driven_any_max2.259303753407064
driven_any_mean1.4873005389106688
driven_any_median1.752860665244429
driven_any_min0.2020509243848191
driven_lanedir_consec_max2.140610694414847
driven_lanedir_consec_mean0.9366228526335492
driven_lanedir_consec_min0.15653224658354836
driven_lanedir_max2.140610694414847
driven_lanedir_mean1.211174049413283
driven_lanedir_median1.253159178194606
driven_lanedir_min0.15653224658354836
in-drivable-lane_max5.000000000000059
in-drivable-lane_mean1.2200000000000109
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.0194181996643454, "sim_physics": 0.020415931716001125, "survival_time": 6.649999999999984, "driven_lanedir": 1.0054134435525848, "sim_render-ego": 0.03581620876054119, "in-drivable-lane": 0, "agent_compute-ego": 0.06559966919117403, "deviation-heading": 0.8218782718860602, "set_robot_commands": 0.051791248464942874, "deviation-center-line": 0.6190581832395162, "driven_lanedir_consec": 0.6604108528489878, "sim_compute_sim_state": 0.022297434340742297, "sim_compute_performance-ego": 0.03686062554667767, "sim_compute_robot_state-ego": 0.042311356479960274, "sim_compute_robot_state-npc0": 0.04055178792853104, "sim_compute_robot_state-npc1": 0.03934192836732793, "sim_compute_robot_state-npc2": 0.038669430223622715, "sim_compute_robot_state-npc3": 0.0383886018193754}, "udem1-1-0": {"driven_any": 2.202869151852686, "sim_physics": 0.019610758338655745, "survival_time": 14.000000000000064, "driven_lanedir": 1.253159178194606, "sim_render-ego": 0.035959333181381226, "in-drivable-lane": 5.000000000000059, "agent_compute-ego": 0.06828760845320565, "deviation-heading": 3.079932977871989, "set_robot_commands": 0.05259883659226554, "deviation-center-line": 0.6739622424307645, "driven_lanedir_consec": 0.6599449088013329, "sim_compute_sim_state": 0.022635066509246828, "sim_compute_performance-ego": 0.03717899577958243, "sim_compute_robot_state-ego": 0.04283248782157898, "sim_compute_robot_state-npc0": 0.04046733123915536, "sim_compute_robot_state-npc1": 0.03940165979521615, "sim_compute_robot_state-npc2": 0.039110379559653144, "sim_compute_robot_state-npc3": 0.03928235258374895}, "udem1-2-0": {"driven_any": 1.752860665244429, "sim_physics": 0.0206162514431136, "survival_time": 11.200000000000024, "driven_lanedir": 1.5001546843208289, "sim_render-ego": 0.03622591921261379, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.06535031965800694, "deviation-heading": 3.1827494263780953, "set_robot_commands": 0.05205531631197248, "deviation-center-line": 0.8241445171302585, "driven_lanedir_consec": 1.0656155605190296, "sim_compute_sim_state": 0.02256034846816744, "sim_compute_performance-ego": 0.03715144736426217, "sim_compute_robot_state-ego": 0.04285562889916556, "sim_compute_robot_state-npc0": 0.040264156247888296, "sim_compute_robot_state-npc1": 0.03895432608468192, "sim_compute_robot_state-npc2": 0.038767955132893155, "sim_compute_robot_state-npc3": 0.03928567681993757}, "udem1-3-0": {"driven_any": 0.2020509243848191, "sim_physics": 0.020212542626165578, "survival_time": 1.5500000000000007, "driven_lanedir": 0.15653224658354836, "sim_render-ego": 0.03697659892420615, "in-drivable-lane": 0, "agent_compute-ego": 0.07598353201343168, "deviation-heading": 0.6994114023305026, "set_robot_commands": 0.05193623419730894, "deviation-center-line": 0.06551451591721544, "driven_lanedir_consec": 0.15653224658354836, "sim_compute_sim_state": 0.02335036954572124, "sim_compute_performance-ego": 0.036673984219951015, "sim_compute_robot_state-ego": 0.04333363809893208, "sim_compute_robot_state-npc0": 0.04074116676084457, "sim_compute_robot_state-npc1": 0.03918926177486297, "sim_compute_robot_state-npc2": 0.03944785364212528, "sim_compute_robot_state-npc3": 0.04028854062480311}, "udem1-4-0": {"driven_any": 2.259303753407064, "sim_physics": 0.019073021951868142, "survival_time": 14.350000000000067, "driven_lanedir": 2.140610694414847, "sim_render-ego": 0.035947263863859276, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.06611142258195511, "deviation-heading": 2.0949369990768756, "set_robot_commands": 0.0521064145224435, "deviation-center-line": 1.405974511761293, "driven_lanedir_consec": 2.140610694414847, "sim_compute_sim_state": 0.02267458879158472, "sim_compute_performance-ego": 0.03718241249642721, "sim_compute_robot_state-ego": 0.04278894251647311, "sim_compute_robot_state-npc0": 0.040873761791800786, "sim_compute_robot_state-npc1": 0.03973966525406788, "sim_compute_robot_state-npc2": 0.03987726434182622, "sim_compute_robot_state-npc3": 0.03942183999649739}}
set_robot_commands_max0.05259883659226554
set_robot_commands_mean0.052097610017786664
set_robot_commands_median0.05205531631197248
set_robot_commands_min0.051791248464942874
sim_compute_performance-ego_max0.03718241249642721
sim_compute_performance-ego_mean0.0370094930813801
sim_compute_performance-ego_median0.03715144736426217
sim_compute_performance-ego_min0.036673984219951015
sim_compute_robot_state-ego_max0.04333363809893208
sim_compute_robot_state-ego_mean0.04282441076322201
sim_compute_robot_state-ego_median0.04283248782157898
sim_compute_robot_state-ego_min0.042311356479960274
sim_compute_robot_state-npc0_max0.040873761791800786
sim_compute_robot_state-npc0_mean0.04057964079364401
sim_compute_robot_state-npc0_median0.04055178792853104
sim_compute_robot_state-npc0_min0.040264156247888296
sim_compute_robot_state-npc1_max0.03973966525406788
sim_compute_robot_state-npc1_mean0.03932536825523137
sim_compute_robot_state-npc1_median0.03934192836732793
sim_compute_robot_state-npc1_min0.03895432608468192
sim_compute_robot_state-npc2_max0.03987726434182622
sim_compute_robot_state-npc2_mean0.03917457658002411
sim_compute_robot_state-npc2_median0.039110379559653144
sim_compute_robot_state-npc2_min0.038669430223622715
sim_compute_robot_state-npc3_max0.04028854062480311
sim_compute_robot_state-npc3_mean0.039333402368872485
sim_compute_robot_state-npc3_median0.03928567681993757
sim_compute_robot_state-npc3_min0.0383886018193754
sim_compute_sim_state_max0.02335036954572124
sim_compute_sim_state_mean0.022703561531092507
sim_compute_sim_state_median0.022635066509246828
sim_compute_sim_state_min0.022297434340742297
sim_physics_max0.0206162514431136
sim_physics_mean0.01998570121516084
sim_physics_median0.020212542626165578
sim_physics_min0.019073021951868142
sim_render-ego_max0.03697659892420615
sim_render-ego_mean0.03618506478852033
sim_render-ego_median0.035959333181381226
sim_render-ego_min0.03581620876054119
simulation-passed1
survival_time_max14.350000000000067
survival_time_mean9.55000000000003
survival_time_min1.5500000000000007
No reset possible
182992782Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerrornouberduck20:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182972786Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationerrornouberduck20:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182942796Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationfailednouberduck20:01:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182832826Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnouberduck20:07:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.08602508421867125
agent_compute-ego_mean0.08461485803825167
agent_compute-ego_median0.08468936098382827
agent_compute-ego_min0.08266322285521265
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.02164846374875023, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.03531705387054928, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.08595912040226043, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.05121903570871505, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.021254531920902313, "sim_compute_performance-ego": 0.035256083049471414, "sim_compute_robot_state-ego": 0.04098145545475067, "sim_compute_robot_state-npc0": 0.03706470368400453, "sim_compute_robot_state-npc1": 0.037072620694599455, "sim_compute_robot_state-npc2": 0.03647649098956396, "sim_compute_robot_state-npc3": 0.037284499122982935}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.019753488839841356, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.03507386936860926, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.08266322285521265, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.05061664300806382, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.021834382823869295, "sim_compute_performance-ego": 0.03537153262718051, "sim_compute_robot_state-ego": 0.04263019561767578, "sim_compute_robot_state-npc0": 0.0375521603752585, "sim_compute_robot_state-npc1": 0.039387871237362135, "sim_compute_robot_state-npc2": 0.03815403171614105, "sim_compute_robot_state-npc3": 0.03858512990614947}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.02127795450149044, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.034746889145143574, "in-drivable-lane": 0, "agent_compute-ego": 0.08602508421867125, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.05040396413495464, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.021375833019133535, "sim_compute_performance-ego": 0.035539761666328676, "sim_compute_robot_state-ego": 0.03960112987026092, "sim_compute_robot_state-npc0": 0.03686849532588836, "sim_compute_robot_state-npc1": 0.03678329913846908, "sim_compute_robot_state-npc2": 0.03616361464223554, "sim_compute_robot_state-npc3": 0.03758761190599011}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.021838675154016374, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.03503375104133119, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.08468936098382827, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.05060076967198798, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.0223143126102204, "sim_compute_performance-ego": 0.03537895831655949, "sim_compute_robot_state-ego": 0.04155517892634615, "sim_compute_robot_state-npc0": 0.03894725251705088, "sim_compute_robot_state-npc1": 0.03855452131717763, "sim_compute_robot_state-npc2": 0.03684178311774071, "sim_compute_robot_state-npc3": 0.03905117004475695}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.018856777594639704, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.03710884772814237, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.08373750173128568, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05071347493391771, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02270242801079383, "sim_compute_performance-ego": 0.03612182232049795, "sim_compute_robot_state-ego": 0.04125226002473097, "sim_compute_robot_state-npc0": 0.03845461973777184, "sim_compute_robot_state-npc1": 0.0375372079702524, "sim_compute_robot_state-npc2": 0.037439433427957386, "sim_compute_robot_state-npc3": 0.03784330074603741}}
set_robot_commands_max0.05121903570871505
set_robot_commands_mean0.050710777491527845
set_robot_commands_median0.05061664300806382
set_robot_commands_min0.05040396413495464
sim_compute_performance-ego_max0.03612182232049795
sim_compute_performance-ego_mean0.035533631596007614
sim_compute_performance-ego_median0.03537895831655949
sim_compute_performance-ego_min0.035256083049471414
sim_compute_robot_state-ego_max0.04263019561767578
sim_compute_robot_state-ego_mean0.0412040439787529
sim_compute_robot_state-ego_median0.04125226002473097
sim_compute_robot_state-ego_min0.03960112987026092
sim_compute_robot_state-npc0_max0.03894725251705088
sim_compute_robot_state-npc0_mean0.03777744632799482
sim_compute_robot_state-npc0_median0.0375521603752585
sim_compute_robot_state-npc0_min0.03686849532588836
sim_compute_robot_state-npc1_max0.039387871237362135
sim_compute_robot_state-npc1_mean0.037867104071572136
sim_compute_robot_state-npc1_median0.0375372079702524
sim_compute_robot_state-npc1_min0.03678329913846908
sim_compute_robot_state-npc2_max0.03815403171614105
sim_compute_robot_state-npc2_mean0.037015070778727725
sim_compute_robot_state-npc2_median0.03684178311774071
sim_compute_robot_state-npc2_min0.03616361464223554
sim_compute_robot_state-npc3_max0.03905117004475695
sim_compute_robot_state-npc3_mean0.038070342345183375
sim_compute_robot_state-npc3_median0.03784330074603741
sim_compute_robot_state-npc3_min0.037284499122982935
sim_compute_sim_state_max0.02270242801079383
sim_compute_sim_state_mean0.021896297676983877
sim_compute_sim_state_median0.021834382823869295
sim_compute_sim_state_min0.021254531920902313
sim_physics_max0.021838675154016374
sim_physics_mean0.020675071967747614
sim_physics_median0.02127795450149044
sim_physics_min0.018856777594639704
sim_render-ego_max0.03710884772814237
sim_render-ego_mean0.03545608223075514
sim_render-ego_median0.03507386936860926
sim_render-ego_min0.034746889145143574
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
182812839Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrornouberduck20:00:29
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182802851Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrornouberduck20:00:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182702828Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnouberduck20:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.08571613331635793
agent_compute-ego_mean0.08456432861154992
agent_compute-ego_median0.08415814963254062
agent_compute-ego_min0.08365142080518935
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.010342782398439804, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.03458843591078272, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.08388007811780246, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.05099597067203162, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.022721452533074143, "sim_compute_performance-ego": 0.03627618753685141, "sim_compute_robot_state-ego": 0.03979921340942383}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.009916646914048628, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.03433947129683061, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.08415814963254062, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.049856250936334785, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.022746476260098545, "sim_compute_performance-ego": 0.035998317328366364, "sim_compute_robot_state-ego": 0.041533405130559746}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.009914726681179473, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.03408313327365452, "in-drivable-lane": 0, "agent_compute-ego": 0.08365142080518935, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.05051325692070855, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.02223265435960558, "sim_compute_performance-ego": 0.035895490646362306, "sim_compute_robot_state-ego": 0.040299050013224286}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.010079696774482729, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.03462637464205424, "in-drivable-lane": 0, "agent_compute-ego": 0.08571613331635793, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.050014227628707886, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.02268088360627492, "sim_compute_performance-ego": 0.036012555162111916, "sim_compute_robot_state-ego": 0.04057615498701731}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.010761050616993624, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.0347257046138539, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.08541586118585923, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05161702282288495, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.02278832127066219, "sim_compute_performance-ego": 0.03697220718159395, "sim_compute_robot_state-ego": 0.040427383254556096}}
set_robot_commands_max0.05161702282288495
set_robot_commands_mean0.05059934579613355
set_robot_commands_median0.05051325692070855
set_robot_commands_min0.049856250936334785
sim_compute_performance-ego_max0.03697220718159395
sim_compute_performance-ego_mean0.036230951571057185
sim_compute_performance-ego_median0.036012555162111916
sim_compute_performance-ego_min0.035895490646362306
sim_compute_robot_state-ego_max0.041533405130559746
sim_compute_robot_state-ego_mean0.04052704135895625
sim_compute_robot_state-ego_median0.040427383254556096
sim_compute_robot_state-ego_min0.03979921340942383
sim_compute_sim_state_max0.02278832127066219
sim_compute_sim_state_mean0.022633957605943077
sim_compute_sim_state_median0.022721452533074143
sim_compute_sim_state_min0.02223265435960558
sim_physics_max0.010761050616993624
sim_physics_mean0.010202980677028852
sim_physics_median0.010079696774482729
sim_physics_min0.009914726681179473
sim_render-ego_max0.0347257046138539
sim_render-ego_mean0.0344726239474352
sim_render-ego_median0.03458843591078272
sim_render-ego_min0.03408313327365452
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
182682843Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornouberduck20:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182672852Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerrornouberduck20:00:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182652836Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornouberduck20:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182612716jiang pengtest for ppoaido2-LF-sim-validationstep1-simulationerrornouberduck20:01:06
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182522844Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrornouberduck20:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182422408jiang pengBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessnouberduck20:15:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3614583993086016
survival_time_median14.950000000000076
deviation-center-line_median1.011969887428033
in-drivable-lane_median4.050000000000022


other stats
agent_compute-ego_max0.09465670188268026
agent_compute-ego_mean0.0936401720046997
agent_compute-ego_median0.09326562722524008
agent_compute-ego_min0.09255512237548828
deviation-center-line_max1.0119709059919424
deviation-center-line_mean1.0119700704341597
deviation-center-line_min1.0119697838947566
deviation-heading_max6.81542792438532
deviation-heading_mean6.815427924385318
deviation-heading_median6.815427924385319
deviation-heading_min6.815427924385317
driven_any_max4.390824152784936
driven_any_mean4.390824152784928
driven_any_median4.390824152784926
driven_any_min4.390824152784922
driven_lanedir_consec_max-1.361452200425545
driven_lanedir_consec_mean-1.3614594960339783
driven_lanedir_consec_min-1.3614696049818191
driven_lanedir_max-2.315814608416598
driven_lanedir_mean-2.3158178509092298
driven_lanedir_median-2.3158179462767055
driven_lanedir_min-2.315821760973971
in-drivable-lane_max4.050000000000022
in-drivable-lane_mean4.050000000000022
in-drivable-lane_min4.050000000000022
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.39082415278493, "sim_physics": 0.00983591079711914, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158179462767055, "sim_render-ego": 0.03428708553314209, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09465670188268026, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.05098353226979573, "deviation-center-line": 1.0119698874280334, "driven_lanedir_consec": -1.3614583993086016, "sim_compute_sim_state": 0.022849481105804443, "sim_compute_performance-ego": 0.036598768234252926, "sim_compute_robot_state-ego": 0.04079390605290731}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.390824152784936, "sim_physics": 0.009968449274698893, "survival_time": 14.950000000000076, "driven_lanedir": -2.315820330462275, "sim_render-ego": 0.034949417114257815, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09313456694285074, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.051686991850535074, "deviation-center-line": 1.0119709059919424, "driven_lanedir_consec": -1.3614650750283808, "sim_compute_sim_state": 0.02273496866226196, "sim_compute_performance-ego": 0.03607688029607137, "sim_compute_robot_state-ego": 0.041315283775329587}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.390824152784926, "sim_physics": 0.009666412671407065, "survival_time": 14.950000000000076, "driven_lanedir": -2.315821760973971, "sim_render-ego": 0.034832774003346764, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09255512237548828, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.05029426256815592, "deviation-center-line": 1.0119697838947566, "driven_lanedir_consec": -1.3614696049818191, "sim_compute_sim_state": 0.022994649410247803, "sim_compute_performance-ego": 0.03649616400400797, "sim_compute_robot_state-ego": 0.04103114048639933}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.390824152784922, "sim_physics": 0.010055814584096273, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.034900094668070474, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09326562722524008, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.05064382235209147, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.023178947766621907, "sim_compute_performance-ego": 0.03716924111048381, "sim_compute_robot_state-ego": 0.04138567129770915}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.390824152784922, "sim_physics": 0.010112621784210206, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.03473737160364787, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09458884159723918, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.05044980605443319, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.02315916061401367, "sim_compute_performance-ego": 0.036499502658844, "sim_compute_robot_state-ego": 0.04142152627309163}}
set_robot_commands_max0.051686991850535074
set_robot_commands_mean0.050811683019002275
set_robot_commands_median0.05064382235209147
set_robot_commands_min0.05029426256815592
sim_compute_performance-ego_max0.03716924111048381
sim_compute_performance-ego_mean0.03656811126073202
sim_compute_performance-ego_median0.036499502658844
sim_compute_performance-ego_min0.03607688029607137
sim_compute_robot_state-ego_max0.04142152627309163
sim_compute_robot_state-ego_mean0.04118950557708741
sim_compute_robot_state-ego_median0.041315283775329587
sim_compute_robot_state-ego_min0.04079390605290731
sim_compute_sim_state_max0.023178947766621907
sim_compute_sim_state_mean0.02298344151178996
sim_compute_sim_state_median0.022994649410247803
sim_compute_sim_state_min0.02273496866226196
sim_physics_max0.010112621784210206
sim_physics_mean0.009927841822306317
sim_physics_median0.009968449274698893
sim_physics_min0.009666412671407065
sim_render-ego_max0.034949417114257815
sim_render-ego_mean0.034741348584493
sim_render-ego_median0.034832774003346764
sim_render-ego_min0.03428708553314209
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
182402428Andrea Censi 🇨🇭random_agentaido2-LF-sim-testingstep1-simulationerrornouberduck20:00:27
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182352455Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerrornouberduck20:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182302479Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornouberduck20:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182282508Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerrornouberduck20:00:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182212543Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnouberduck20:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.08546171548231593
agent_compute-ego_mean0.08418092655990421
agent_compute-ego_median0.0838476022084554
agent_compute-ego_min0.08306560733101585
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.010114179467255216, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.034419320664315856, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.08546171548231593, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.050885276974372146, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.022548949943398528, "sim_compute_performance-ego": 0.03603215937344533, "sim_compute_robot_state-ego": 0.04090785530378234}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.009613069620999422, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.034346249970522796, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.08306560733101585, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.04973122748461637, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.022986997257579456, "sim_compute_performance-ego": 0.036177505146373405, "sim_compute_robot_state-ego": 0.0420735315843062}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01050124168395996, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.034106037351820204, "in-drivable-lane": 0, "agent_compute-ego": 0.08318031628926595, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.05000752872890896, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.022738287183973523, "sim_compute_performance-ego": 0.03565211296081543, "sim_compute_robot_state-ego": 0.03963168462117513}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01062577466169993, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.033822014927864075, "in-drivable-lane": 0, "agent_compute-ego": 0.0838476022084554, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.05058298508326212, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.02220703661441803, "sim_compute_performance-ego": 0.036506970723470054, "sim_compute_robot_state-ego": 0.04118643204371134}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.010915724670185764, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.034699229633106905, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.08534939148846794, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.051231142352609074, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.023142691920785344, "sim_compute_performance-ego": 0.036124239949619066, "sim_compute_robot_state-ego": 0.041390124489279354}}
set_robot_commands_max0.051231142352609074
set_robot_commands_mean0.05048763212475373
set_robot_commands_median0.05058298508326212
set_robot_commands_min0.04973122748461637
sim_compute_performance-ego_max0.036506970723470054
sim_compute_performance-ego_mean0.036098597630744654
sim_compute_performance-ego_median0.036124239949619066
sim_compute_performance-ego_min0.03565211296081543
sim_compute_robot_state-ego_max0.0420735315843062
sim_compute_robot_state-ego_mean0.04103792560845088
sim_compute_robot_state-ego_median0.04118643204371134
sim_compute_robot_state-ego_min0.03963168462117513
sim_compute_sim_state_max0.023142691920785344
sim_compute_sim_state_mean0.022724792584030977
sim_compute_sim_state_median0.022738287183973523
sim_compute_sim_state_min0.02220703661441803
sim_physics_max0.010915724670185764
sim_physics_mean0.010353998020820055
sim_physics_median0.01050124168395996
sim_physics_min0.009613069620999422
sim_render-ego_max0.034699229633106905
sim_render-ego_mean0.034278570509525964
sim_render-ego_median0.034346249970522796
sim_render-ego_min0.033822014927864075
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
182172560Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessnouberduck20:04:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04427974040691669
agent_compute-ego_mean0.042824103768884514
agent_compute-ego_median0.04273115961175216
agent_compute-ego_min0.04186610477726634
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.01168143458482696, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.034155060605304995, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.04186610477726634, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.052060880312105505, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.023260910336564227, "sim_compute_performance-ego": 0.03645173224007211, "sim_compute_robot_state-ego": 0.04089122574503829}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.010365587014418382, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.034078350433936484, "in-drivable-lane": 0, "agent_compute-ego": 0.04236359779651348, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.05122467187734751, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.024181897823627178, "sim_compute_performance-ego": 0.036648961213918835, "sim_compute_robot_state-ego": 0.04185785697056697}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.010462350033699198, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.03423843485243777, "in-drivable-lane": 0, "agent_compute-ego": 0.042879916251973904, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.05138852748465031, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.023962264365338264, "sim_compute_performance-ego": 0.0368972788465784, "sim_compute_robot_state-ego": 0.04179328553220059}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.0111999695117657, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.03473921660538558, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.04427974040691669, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.05218751351911943, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.023488139058207416, "sim_compute_performance-ego": 0.03650803618378692, "sim_compute_robot_state-ego": 0.04128412099984976}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.010080161847566304, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.03522222920467979, "in-drivable-lane": 0, "agent_compute-ego": 0.04273115961175216, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.051757360759534334, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.022493011073062296, "sim_compute_performance-ego": 0.036846436952289785, "sim_compute_robot_state-ego": 0.04124276888997931}}
set_robot_commands_max0.05218751351911943
set_robot_commands_mean0.051723790790551415
set_robot_commands_median0.051757360759534334
set_robot_commands_min0.05122467187734751
sim_compute_performance-ego_max0.0368972788465784
sim_compute_performance-ego_mean0.036670489087329214
sim_compute_performance-ego_median0.036648961213918835
sim_compute_performance-ego_min0.03645173224007211
sim_compute_robot_state-ego_max0.04185785697056697
sim_compute_robot_state-ego_mean0.04141385162752699
sim_compute_robot_state-ego_median0.04128412099984976
sim_compute_robot_state-ego_min0.04089122574503829
sim_compute_sim_state_max0.024181897823627178
sim_compute_sim_state_mean0.02347724453135987
sim_compute_sim_state_median0.023488139058207416
sim_compute_sim_state_min0.022493011073062296
sim_physics_max0.01168143458482696
sim_physics_mean0.01075790059845531
sim_physics_median0.010462350033699198
sim_physics_min0.010080161847566304
sim_render-ego_max0.03522222920467979
sim_render-ego_mean0.034486658340348926
sim_render-ego_median0.03423843485243777
sim_render-ego_min0.034078350433936484
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
182152573Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerrornouberduck20:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182112596Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornouberduck20:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
182072600Liam Paull 🇨🇦challenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationsuccessnouberduck20:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8986297848351752
survival_time_median4.199999999999993
deviation-center-line_median0.1737277070277045
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.0811685553768225
agent_compute-ego_mean0.07934902802935523
agent_compute-ego_median0.07919326395091444
agent_compute-ego_min0.07750352392805383
deviation-center-line_max0.33297240400755673
deviation-center-line_mean0.2012749276249906
deviation-center-line_min0.07198849695349571
deviation-heading_max2.120555986395429
deviation-heading_mean1.3535644080533515
deviation-heading_median1.2613548731202808
deviation-heading_min0.32407950273728403
driven_any_max1.3870338070945685
driven_any_mean1.0184411329928484
driven_any_median1.2467159459034582
driven_any_min0.3933305442582112
driven_lanedir_consec_max1.1995314792743788
driven_lanedir_consec_mean0.7801780797354769
driven_lanedir_consec_min0.3668828007345852
driven_lanedir_max1.1995314792743788
driven_lanedir_mean0.7805629925269285
driven_lanedir_median0.8986297848351752
driven_lanedir_min0.3668828007345852
in-drivable-lane_max0.7999999999999972
in-drivable-lane_mean0.289999999999999
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.743280823601232, "sim_physics": 0.010485352131358363, "survival_time": 2.849999999999998, "driven_lanedir": 0.3971767138826672, "sim_render-ego": 0.03465606455217328, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.0811685553768225, "deviation-heading": 1.2613548731202808, "set_robot_commands": 0.05041469607436866, "deviation-center-line": 0.11019237882257996, "driven_lanedir_consec": 0.3952521499254096, "sim_compute_sim_state": 0.022771609456915604, "sim_compute_performance-ego": 0.036246764032464275, "sim_compute_robot_state-ego": 0.040595205206620064}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3870338070945685, "sim_physics": 0.011666130311418287, "survival_time": 5.04999999999999, "driven_lanedir": 1.1995314792743788, "sim_render-ego": 0.034370065915702595, "in-drivable-lane": 0, "agent_compute-ego": 0.07919326395091444, "deviation-heading": 2.120555986395429, "set_robot_commands": 0.04970437229269802, "deviation-center-line": 0.33297240400755673, "driven_lanedir_consec": 1.1995314792743788, "sim_compute_sim_state": 0.0230639122500278, "sim_compute_performance-ego": 0.036190358719023145, "sim_compute_robot_state-ego": 0.041012922135910186}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3933305442582112, "sim_physics": 0.009801645278930664, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3668828007345852, "sim_render-ego": 0.03452240943908692, "in-drivable-lane": 0, "agent_compute-ego": 0.08075645446777344, "deviation-heading": 0.32407950273728403, "set_robot_commands": 0.04969894409179688, "deviation-center-line": 0.07198849695349571, "driven_lanedir_consec": 0.3668828007345852, "sim_compute_sim_state": 0.02293044090270996, "sim_compute_performance-ego": 0.03704183578491211, "sim_compute_robot_state-ego": 0.04103785514831543}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3218445441067717, "sim_physics": 0.011196732521057127, "survival_time": 4.199999999999993, "driven_lanedir": 0.8986297848351752, "sim_render-ego": 0.034776012102762856, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07812334242321196, "deviation-heading": 1.171220708589202, "set_robot_commands": 0.04970561890375046, "deviation-center-line": 0.1737277070277045, "driven_lanedir_consec": 0.8986297848351752, "sim_compute_sim_state": 0.02299365827015468, "sim_compute_performance-ego": 0.03641740481058756, "sim_compute_robot_state-ego": 0.04092654443922497}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2467159459034582, "sim_physics": 0.011805514071850067, "survival_time": 4.699999999999991, "driven_lanedir": 1.040594183907836, "sim_render-ego": 0.034978382130886644, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.07750352392805383, "deviation-heading": 1.8906109694245616, "set_robot_commands": 0.04977976768574816, "deviation-center-line": 0.3174936513136161, "driven_lanedir_consec": 1.040594183907836, "sim_compute_sim_state": 0.02279545398468667, "sim_compute_performance-ego": 0.036193578801256544, "sim_compute_robot_state-ego": 0.04112308836997824}}
set_robot_commands_max0.05041469607436866
set_robot_commands_mean0.04986067980967244
set_robot_commands_median0.04970561890375046
set_robot_commands_min0.04969894409179688
sim_compute_performance-ego_max0.03704183578491211
sim_compute_performance-ego_mean0.036417988429648725
sim_compute_performance-ego_median0.036246764032464275
sim_compute_performance-ego_min0.036190358719023145
sim_compute_robot_state-ego_max0.04112308836997824
sim_compute_robot_state-ego_mean0.04093912306000978
sim_compute_robot_state-ego_median0.041012922135910186
sim_compute_robot_state-ego_min0.040595205206620064
sim_compute_sim_state_max0.0230639122500278
sim_compute_sim_state_mean0.022911014972898942
sim_compute_sim_state_median0.02293044090270996
sim_compute_sim_state_min0.022771609456915604
sim_physics_max0.011805514071850067
sim_physics_mean0.010991074862922903
sim_physics_median0.011196732521057127
sim_physics_min0.009801645278930664
sim_render-ego_max0.034978382130886644
sim_render-ego_mean0.03466058682812245
sim_render-ego_median0.03465606455217328
sim_render-ego_min0.034370065915702595
simulation-passed1
survival_time_max5.04999999999999
survival_time_mean3.6099999999999945
survival_time_min1.2500000000000004
No reset possible
181962690Konstantin Chaikachallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessnouberduck20:10:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1736396062747143
survival_time_median10.90000000000002
deviation-center-line_median0.6223760158424115
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.04532951719305488
agent_compute-ego_mean0.044733881493630105
agent_compute-ego_median0.04448314746220906
agent_compute-ego_min0.04435051253082555
deviation-center-line_max1.0952052770511216
deviation-center-line_mean0.6713523141032698
deviation-center-line_min0.18051433084287577
deviation-heading_max5.969780927486059
deviation-heading_mean3.1201388390311795
deviation-heading_median2.5975014741646967
deviation-heading_min0.6841211228731245
driven_any_max2.3555684722913126
driven_any_mean1.5643410657714043
driven_any_median1.7047482493801278
driven_any_min0.6573844748514421
driven_lanedir_consec_max1.6224875942105037
driven_lanedir_consec_mean1.0509570759590727
driven_lanedir_consec_min0.4879956695875416
driven_lanedir_max1.8752330929188763
driven_lanedir_mean1.2947339294278182
driven_lanedir_median1.6224875942105037
driven_lanedir_min0.4879956695875416
in-drivable-lane_max2.2500000000000067
in-drivable-lane_mean0.7800000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6573844748514421, "sim_physics": 0.012015211448240816, "survival_time": 4.449999999999992, "driven_lanedir": 0.4879956695875416, "sim_render-ego": 0.03613138198852539, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.04532951719305488, "deviation-heading": 1.5151009399067246, "set_robot_commands": 0.05209636956118466, "deviation-center-line": 0.18051433084287577, "driven_lanedir_consec": 0.4879956695875416, "sim_compute_sim_state": 0.02486937769343344, "sim_compute_performance-ego": 0.0379096952716956, "sim_compute_robot_state-ego": 0.041540657536367355}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.355473458682705, "sim_physics": 0.010044220288594564, "survival_time": 14.950000000000076, "driven_lanedir": 1.8752330929188763, "sim_render-ego": 0.036541613737742104, "in-drivable-lane": 1.0999999999999972, "agent_compute-ego": 0.04435365279515584, "deviation-heading": 5.969780927486059, "set_robot_commands": 0.05225282271703084, "deviation-center-line": 0.9948686111860808, "driven_lanedir_consec": 1.1736396062747143, "sim_compute_sim_state": 0.024438060919443765, "sim_compute_performance-ego": 0.03722197771072388, "sim_compute_robot_state-ego": 0.041646220684051515}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3555684722913126, "sim_physics": 0.010406290690104169, "survival_time": 14.950000000000076, "driven_lanedir": 1.7512099247794932, "sim_render-ego": 0.03573849121729533, "in-drivable-lane": 2.2500000000000067, "agent_compute-ego": 0.04448314746220906, "deviation-heading": 4.834189730725294, "set_robot_commands": 0.05209734916687011, "deviation-center-line": 1.0952052770511216, "driven_lanedir_consec": 1.233919144079928, "sim_compute_sim_state": 0.024702511628468832, "sim_compute_performance-ego": 0.03784877061843872, "sim_compute_robot_state-ego": 0.041723997592926027}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7485306736514343, "sim_physics": 0.011391422965309836, "survival_time": 4.94999999999999, "driven_lanedir": 0.7367433656426763, "sim_render-ego": 0.03598049915198124, "in-drivable-lane": 0, "agent_compute-ego": 0.04515257748690518, "deviation-heading": 0.6841211228731245, "set_robot_commands": 0.052257699195784754, "deviation-center-line": 0.4637973355938595, "driven_lanedir_consec": 0.7367433656426763, "sim_compute_sim_state": 0.02413961381623239, "sim_compute_performance-ego": 0.0373695402434378, "sim_compute_robot_state-ego": 0.04151260732400297}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7047482493801278, "sim_physics": 0.010524429312539756, "survival_time": 10.90000000000002, "driven_lanedir": 1.6224875942105037, "sim_render-ego": 0.03618890539221807, "in-drivable-lane": 0, "agent_compute-ego": 0.04435051253082555, "deviation-heading": 2.5975014741646967, "set_robot_commands": 0.05233864281155647, "deviation-center-line": 0.6223760158424115, "driven_lanedir_consec": 1.6224875942105037, "sim_compute_sim_state": 0.024310510092919027, "sim_compute_performance-ego": 0.03748115596421268, "sim_compute_robot_state-ego": 0.04138699802783651}}
set_robot_commands_max0.05233864281155647
set_robot_commands_mean0.05220857669048538
set_robot_commands_median0.05225282271703084
set_robot_commands_min0.05209636956118466
sim_compute_performance-ego_max0.0379096952716956
sim_compute_performance-ego_mean0.03756622796170173
sim_compute_performance-ego_median0.03748115596421268
sim_compute_performance-ego_min0.03722197771072388
sim_compute_robot_state-ego_max0.041723997592926027
sim_compute_robot_state-ego_mean0.041562096233036874
sim_compute_robot_state-ego_median0.041540657536367355
sim_compute_robot_state-ego_min0.04138699802783651
sim_compute_sim_state_max0.02486937769343344
sim_compute_sim_state_mean0.02449201483009949
sim_compute_sim_state_median0.024438060919443765
sim_compute_sim_state_min0.02413961381623239
sim_physics_max0.012015211448240816
sim_physics_mean0.010876314940957829
sim_physics_median0.010524429312539756
sim_physics_min0.010044220288594564
sim_render-ego_max0.036541613737742104
sim_render-ego_mean0.036116178297552426
sim_render-ego_median0.03613138198852539
sim_render-ego_min0.03573849121729533
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.040000000000031
survival_time_min4.449999999999992
No reset possible
181822754Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessnouberduck20:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.043048394905341854
agent_compute-ego_mean0.04177349414823946
agent_compute-ego_median0.041765845738924466
agent_compute-ego_min0.04097582431549721
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.011814632066866247, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.034180362050126235, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.04114834273733744, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.05148787614775867, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.02232175629313399, "sim_compute_performance-ego": 0.03656776649195973, "sim_compute_robot_state-ego": 0.04050456896060851}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.010541741664593035, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.035202668263362005, "in-drivable-lane": 0, "agent_compute-ego": 0.041765845738924466, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.05049686248485859, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.024671114408052884, "sim_compute_performance-ego": 0.036135425934424766, "sim_compute_robot_state-ego": 0.0421753663283128}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.0105368583760363, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.03479000355334992, "in-drivable-lane": 0, "agent_compute-ego": 0.04097582431549721, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.050651159692317885, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.02315370072709753, "sim_compute_performance-ego": 0.03675734743158868, "sim_compute_robot_state-ego": 0.04129575668497289}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.012383903775896344, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.03469682525802445, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.043048394905341854, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.05116311534420474, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.02339811901469807, "sim_compute_performance-ego": 0.036551632723965485, "sim_compute_robot_state-ego": 0.041535998438740826}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.01027322442908036, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.03508107913167853, "in-drivable-lane": 0, "agent_compute-ego": 0.04192906304409629, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.05067202919407895, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.022672069700140705, "sim_compute_performance-ego": 0.036115985167653936, "sim_compute_robot_state-ego": 0.0416173119294016}}
set_robot_commands_max0.05148787614775867
set_robot_commands_mean0.05089420857264376
set_robot_commands_median0.05067202919407895
set_robot_commands_min0.05049686248485859
sim_compute_performance-ego_max0.03675734743158868
sim_compute_performance-ego_mean0.03642563154991852
sim_compute_performance-ego_median0.036551632723965485
sim_compute_performance-ego_min0.036115985167653936
sim_compute_robot_state-ego_max0.0421753663283128
sim_compute_robot_state-ego_mean0.041425800468407326
sim_compute_robot_state-ego_median0.041535998438740826
sim_compute_robot_state-ego_min0.04050456896060851
sim_compute_sim_state_max0.024671114408052884
sim_compute_sim_state_mean0.023243352028624636
sim_compute_sim_state_median0.02315370072709753
sim_compute_sim_state_min0.02232175629313399
sim_physics_max0.012383903775896344
sim_physics_mean0.011110072062494456
sim_physics_median0.010541741664593035
sim_physics_min0.01027322442908036
sim_render-ego_max0.035202668263362005
sim_render-ego_mean0.03479018765130822
sim_render-ego_median0.03479000355334992
sim_render-ego_min0.034180362050126235
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
181802852Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerrornouberduck20:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181742831Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornouberduck20:00:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181632823Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessnouberduck20:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2342705027983982
survival_time_median1.7500000000000009
deviation-center-line_median0.10801953665034704
in-drivable-lane_median0.7000000000000004


other stats
agent_compute-ego_max0.08899333166039508
agent_compute-ego_mean0.08601553312463968
agent_compute-ego_median0.08576604298182897
agent_compute-ego_min0.08413670909020209
deviation-center-line_max0.17768774509810673
deviation-center-line_mean0.08758489727910898
deviation-center-line_min0.019005533143064354
deviation-heading_max0.759385645220147
deviation-heading_mean0.3195081252333424
deviation-heading_median0.1806788823983304
deviation-heading_min0.118601117425238
driven_any_max2.812198352312563
driven_any_mean1.6891781761410722
driven_any_median1.608242001486626
driven_any_min0.3130680825984642
driven_lanedir_consec_max1.7389031534183392
driven_lanedir_consec_mean0.9694700664283822
driven_lanedir_consec_min0.28316071129320397
driven_lanedir_max1.7389031534183392
driven_lanedir_mean0.9694700664283822
driven_lanedir_median1.2342705027983982
driven_lanedir_min0.28316071129320397
in-drivable-lane_max1.5999999999999988
in-drivable-lane_mean0.7299999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.014764879060828169, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.03436524971671726, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.08899333166039508, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.05064289466194485, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.02163269208825153, "sim_compute_performance-ego": 0.035947499067887016, "sim_compute_robot_state-ego": 0.04170811694601308, "sim_compute_robot_state-npc0": 0.03767297578894574, "sim_compute_robot_state-npc1": 0.036474445591802185, "sim_compute_robot_state-npc2": 0.03658063515372898, "sim_compute_robot_state-npc3": 0.03649252393971319}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.01728135539639381, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.03459252080609722, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.08413670909020209, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.0522885053388534, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.02214167194981729, "sim_compute_performance-ego": 0.03563720949234501, "sim_compute_robot_state-ego": 0.041979393651408535, "sim_compute_robot_state-npc0": 0.03778017720868511, "sim_compute_robot_state-npc1": 0.03761274968424151, "sim_compute_robot_state-npc2": 0.03716028505756009, "sim_compute_robot_state-npc3": 0.03789524878225019}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.01559608323233468, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.03523782321384975, "in-drivable-lane": 0, "agent_compute-ego": 0.08576604298182897, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.05055560384477888, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.021604095186506, "sim_compute_performance-ego": 0.03459194728306362, "sim_compute_robot_state-ego": 0.04230976104736328, "sim_compute_robot_state-npc0": 0.03695406232561384, "sim_compute_robot_state-npc1": 0.03916008131844657, "sim_compute_robot_state-npc2": 0.03655978611537388, "sim_compute_robot_state-npc3": 0.03825439725603376}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.014532177788870676, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.0354466370173863, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.08454580307006836, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.05060359409877232, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.021875960486275808, "sim_compute_performance-ego": 0.03566808700561523, "sim_compute_robot_state-ego": 0.04241298948015485, "sim_compute_robot_state-npc0": 0.037980243137904574, "sim_compute_robot_state-npc1": 0.03777270998273577, "sim_compute_robot_state-npc2": 0.03709837368556431, "sim_compute_robot_state-npc3": 0.03812567847115653}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.01574841756669302, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.03541715939839681, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.0866357788207039, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.050418142288450214, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.02235138605511378, "sim_compute_performance-ego": 0.03556686734396314, "sim_compute_robot_state-ego": 0.04252884123060438, "sim_compute_robot_state-npc0": 0.03800150704762292, "sim_compute_robot_state-npc1": 0.038265515887548056, "sim_compute_robot_state-npc2": 0.03780873994978647, "sim_compute_robot_state-npc3": 0.03881539995708163}}
set_robot_commands_max0.0522885053388534
set_robot_commands_mean0.05090174804655993
set_robot_commands_median0.05060359409877232
set_robot_commands_min0.050418142288450214
sim_compute_performance-ego_max0.035947499067887016
sim_compute_performance-ego_mean0.0354823220385748
sim_compute_performance-ego_median0.03563720949234501
sim_compute_performance-ego_min0.03459194728306362
sim_compute_robot_state-ego_max0.04252884123060438
sim_compute_robot_state-ego_mean0.04218782047110882
sim_compute_robot_state-ego_median0.04230976104736328
sim_compute_robot_state-ego_min0.04170811694601308
sim_compute_robot_state-npc0_max0.03800150704762292
sim_compute_robot_state-npc0_mean0.03767779310175444
sim_compute_robot_state-npc0_median0.03778017720868511
sim_compute_robot_state-npc0_min0.03695406232561384
sim_compute_robot_state-npc1_max0.03916008131844657
sim_compute_robot_state-npc1_mean0.03785710049295482
sim_compute_robot_state-npc1_median0.03777270998273577
sim_compute_robot_state-npc1_min0.036474445591802185
sim_compute_robot_state-npc2_max0.03780873994978647
sim_compute_robot_state-npc2_mean0.03704156399240275
sim_compute_robot_state-npc2_median0.03709837368556431
sim_compute_robot_state-npc2_min0.03655978611537388
sim_compute_robot_state-npc3_max0.03881539995708163
sim_compute_robot_state-npc3_mean0.037916649681247055
sim_compute_robot_state-npc3_median0.03812567847115653
sim_compute_robot_state-npc3_min0.03649252393971319
sim_compute_sim_state_max0.02235138605511378
sim_compute_sim_state_mean0.02192116115319288
sim_compute_sim_state_median0.021875960486275808
sim_compute_sim_state_min0.021604095186506
sim_physics_max0.01728135539639381
sim_physics_mean0.015584582609024072
sim_physics_median0.01559608323233468
sim_physics_min0.014532177788870676
sim_render-ego_max0.0354466370173863
sim_render-ego_mean0.03501187803048947
sim_render-ego_median0.03523782321384975
sim_render-ego_min0.03436524971671726
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean1.899999999999999
survival_time_min0.35
No reset possible
181482808Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LFV-sim-testingstep1-simulationsuccessnouberduck20:05:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2342705027983982
survival_time_median1.7500000000000009
deviation-center-line_median0.10801953665034704
in-drivable-lane_median0.7000000000000004


other stats
agent_compute-ego_max0.08666071684464165
agent_compute-ego_mean0.08452497098772796
agent_compute-ego_median0.08494278362819127
agent_compute-ego_min0.08222549983433315
deviation-center-line_max0.17768774509810673
deviation-center-line_mean0.08758489727910898
deviation-center-line_min0.019005533143064354
deviation-heading_max0.759385645220147
deviation-heading_mean0.3195081252333424
deviation-heading_median0.1806788823983304
deviation-heading_min0.118601117425238
driven_any_max2.812198352312563
driven_any_mean1.6891781761410722
driven_any_median1.608242001486626
driven_any_min0.3130680825984642
driven_lanedir_consec_max1.7389031534183392
driven_lanedir_consec_mean0.9694700664283822
driven_lanedir_consec_min0.28316071129320397
driven_lanedir_max1.7389031534183392
driven_lanedir_mean0.9694700664283822
driven_lanedir_median1.2342705027983982
driven_lanedir_min0.28316071129320397
in-drivable-lane_max1.5999999999999988
in-drivable-lane_mean0.7299999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.014948171118031378, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.0350567568903384, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.08666071684464165, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.05176569067913553, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.021578228991964588, "sim_compute_performance-ego": 0.036398213842640754, "sim_compute_robot_state-ego": 0.04115191749904467, "sim_compute_robot_state-npc0": 0.03847350244936736, "sim_compute_robot_state-npc1": 0.03683167955149775, "sim_compute_robot_state-npc2": 0.03682860084201978, "sim_compute_robot_state-npc3": 0.03674717571424401}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.01723170280456543, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.03527683211911109, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.08377363220337898, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.04973336958116101, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.02246917063190091, "sim_compute_performance-ego": 0.035289241421607234, "sim_compute_robot_state-ego": 0.04246312956656179, "sim_compute_robot_state-npc0": 0.03999678934774091, "sim_compute_robot_state-npc1": 0.03847676707852271, "sim_compute_robot_state-npc2": 0.037798004765664375, "sim_compute_robot_state-npc3": 0.03826552821743873}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.01633296694074358, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.03542733192443848, "in-drivable-lane": 0, "agent_compute-ego": 0.08494278362819127, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.050002949578421454, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.02193706376211984, "sim_compute_performance-ego": 0.034765379769461494, "sim_compute_robot_state-ego": 0.04229170935494559, "sim_compute_robot_state-npc0": 0.03708229746137347, "sim_compute_robot_state-npc1": 0.03872169767107282, "sim_compute_robot_state-npc2": 0.0392826965876988, "sim_compute_robot_state-npc3": 0.03710791042872837}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.014041239874703544, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.03382927349635533, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.08222549983433315, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.04999258858816964, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.02090482030596052, "sim_compute_performance-ego": 0.033576222828456334, "sim_compute_robot_state-ego": 0.041680220195225305, "sim_compute_robot_state-npc0": 0.03598551750183106, "sim_compute_robot_state-npc1": 0.03778705596923828, "sim_compute_robot_state-npc2": 0.03619604110717774, "sim_compute_robot_state-npc3": 0.03820238794599261}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.01568503606887091, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.03536236853826614, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.08502222242809478, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.050084541714380655, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.02234031662108406, "sim_compute_performance-ego": 0.035475367591494604, "sim_compute_robot_state-ego": 0.041652092857966345, "sim_compute_robot_state-npc0": 0.03782932342044891, "sim_compute_robot_state-npc1": 0.03814348341926696, "sim_compute_robot_state-npc2": 0.03678824409605965, "sim_compute_robot_state-npc3": 0.03877670802767315}}
set_robot_commands_max0.05176569067913553
set_robot_commands_mean0.05031582802825365
set_robot_commands_median0.050002949578421454
set_robot_commands_min0.04973336958116101
sim_compute_performance-ego_max0.036398213842640754
sim_compute_performance-ego_mean0.03510088509073209
sim_compute_performance-ego_median0.035289241421607234
sim_compute_performance-ego_min0.033576222828456334
sim_compute_robot_state-ego_max0.04246312956656179
sim_compute_robot_state-ego_mean0.04184781389474874
sim_compute_robot_state-ego_median0.041680220195225305
sim_compute_robot_state-ego_min0.04115191749904467
sim_compute_robot_state-npc0_max0.03999678934774091
sim_compute_robot_state-npc0_mean0.037873486036152336
sim_compute_robot_state-npc0_median0.03782932342044891
sim_compute_robot_state-npc0_min0.03598551750183106
sim_compute_robot_state-npc1_max0.03872169767107282
sim_compute_robot_state-npc1_mean0.0379921367379197
sim_compute_robot_state-npc1_median0.03814348341926696
sim_compute_robot_state-npc1_min0.03683167955149775
sim_compute_robot_state-npc2_max0.0392826965876988
sim_compute_robot_state-npc2_mean0.03737871747972407
sim_compute_robot_state-npc2_median0.03682860084201978
sim_compute_robot_state-npc2_min0.03619604110717774
sim_compute_robot_state-npc3_max0.03877670802767315
sim_compute_robot_state-npc3_mean0.03781994206681537
sim_compute_robot_state-npc3_median0.03820238794599261
sim_compute_robot_state-npc3_min0.03674717571424401
sim_compute_sim_state_max0.02246917063190091
sim_compute_sim_state_mean0.021845920062605988
sim_compute_sim_state_median0.02193706376211984
sim_compute_sim_state_min0.02090482030596052
sim_physics_max0.01723170280456543
sim_physics_mean0.015647823361382967
sim_physics_median0.01568503606887091
sim_physics_min0.014041239874703544
sim_render-ego_max0.03542733192443848
sim_render-ego_mean0.03499051259370189
sim_render-ego_median0.03527683211911109
sim_render-ego_min0.03382927349635533
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean1.899999999999999
survival_time_min0.35
No reset possible
181462801Shashank GaurPredictorLastaido2-PREDstep1-simulationsuccessnouberduck20:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11297188159524908
error_L20.01955287129142203


No reset possible
181452799Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrornouberduck20:20:31
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181412796Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornouberduck20:20:35
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181372788Andrea Daniele 🇮🇹PredictorLastaido2-PREDstep1-simulationsuccessnouberduck20:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1013581716957429
error_L20.01631854003110063


No reset possible
181362742Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornouberduck20:20:33
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181332746Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrornouberduck20:20:34
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181302755Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessnouberduck20:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2448526305955787
survival_time_median1.0000000000000002
deviation-center-line_median0.02780958695734228
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.047244983060019355
agent_compute-ego_mean0.04339400237089381
agent_compute-ego_median0.042951036902034986
agent_compute-ego_min0.04082818031311035
deviation-center-line_max0.1367821583469593
deviation-center-line_mean0.05703771312424479
deviation-center-line_min0.019515313732513393
deviation-heading_max0.6295143987792061
deviation-heading_mean0.33854872313755296
deviation-heading_median0.30747603818653535
deviation-heading_min0.1699364276466551
driven_any_max0.9094890302704564
driven_any_mean0.614817253072296
driven_any_median0.5457640496143875
driven_any_min0.3022738981004904
driven_lanedir_consec_max0.7972872880234139
driven_lanedir_consec_mean0.4211895144689454
driven_lanedir_consec_min0.1644714808652381
driven_lanedir_max0.7972872880234139
driven_lanedir_mean0.42291373507306657
driven_lanedir_median0.2448526305955787
driven_lanedir_min0.1644714808652381
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.2500000000000001
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.008108055591583252, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.03473960161209107, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.042741703987121585, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.05161501169204712, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.02367655038833618, "sim_compute_performance-ego": 0.0369950532913208, "sim_compute_robot_state-ego": 0.04174284934997559}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126885, "sim_physics": 0.008562873391544117, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120271352061035, "sim_render-ego": 0.03500669142779182, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.042951036902034986, "deviation-heading": 0.30747603818653535, "set_robot_commands": 0.05087936625761144, "deviation-center-line": 0.023999233443120993, "driven_lanedir_consec": 0.17258161050000476, "sim_compute_sim_state": 0.023093083325554344, "sim_compute_performance-ego": 0.036574265536139995, "sim_compute_robot_state-ego": 0.04087610805735869}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3022738981004904, "sim_physics": 0.00859534740447998, "survival_time": 0.49999999999999994, "driven_lanedir": 0.2448526305955787, "sim_render-ego": 0.034009909629821776, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.04082818031311035, "deviation-heading": 0.1699364276466551, "set_robot_commands": 0.05102338790893555, "deviation-center-line": 0.02780958695734228, "driven_lanedir_consec": 0.2448526305955787, "sim_compute_sim_state": 0.023114585876464845, "sim_compute_performance-ego": 0.03654313087463379, "sim_compute_robot_state-ego": 0.041907882690429686}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.00930171353476388, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.0354546138218471, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.047244983060019355, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.05154939208711896, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.023301848343440464, "sim_compute_performance-ego": 0.03720407826559884, "sim_compute_robot_state-ego": 0.04198301689965384}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704564, "sim_physics": 0.008466628289991809, "survival_time": 1.5500000000000007, "driven_lanedir": 0.7972872880234139, "sim_render-ego": 0.03664898103283298, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.043204107592182774, "deviation-heading": 0.6295143987792061, "set_robot_commands": 0.05161593806359076, "deviation-center-line": 0.1367821583469593, "driven_lanedir_consec": 0.7972872880234139, "sim_compute_sim_state": 0.023053507651052168, "sim_compute_performance-ego": 0.03653575528052545, "sim_compute_robot_state-ego": 0.041985450252409906}}
set_robot_commands_max0.05161593806359076
set_robot_commands_mean0.05133661920186077
set_robot_commands_median0.05154939208711896
set_robot_commands_min0.05087936625761144
sim_compute_performance-ego_max0.03720407826559884
sim_compute_performance-ego_mean0.036770456649643776
sim_compute_performance-ego_median0.036574265536139995
sim_compute_performance-ego_min0.03653575528052545
sim_compute_robot_state-ego_max0.041985450252409906
sim_compute_robot_state-ego_mean0.04169906144996554
sim_compute_robot_state-ego_median0.041907882690429686
sim_compute_robot_state-ego_min0.04087610805735869
sim_compute_sim_state_max0.02367655038833618
sim_compute_sim_state_mean0.0232479151169696
sim_compute_sim_state_median0.023114585876464845
sim_compute_sim_state_min0.023053507651052168
sim_physics_max0.00930171353476388
sim_physics_mean0.008606923642472609
sim_physics_median0.008562873391544117
sim_physics_min0.008108055591583252
sim_render-ego_max0.03664898103283298
sim_render-ego_mean0.03517195950487695
sim_render-ego_median0.03500669142779182
sim_render-ego_min0.034009909629821776
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0600000000000005
survival_time_min0.49999999999999994
No reset possible
181292758Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationsuccessnouberduck20:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24485310743273692
survival_time_median1.0000000000000002
deviation-center-line_median0.02780957766589444
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.04472272396087647
agent_compute-ego_mean0.0425902136776563
agent_compute-ego_median0.042178237438201906
agent_compute-ego_min0.041349691503188186
deviation-center-line_max0.1367821242164622
deviation-center-line_mean0.05703768142247749
deviation-center-line_min0.019515313732513393
deviation-heading_max0.6295143987792059
deviation-heading_mean0.33854872313755296
deviation-heading_median0.3074760381865352
deviation-heading_min0.16993642764665506
driven_any_max0.9094890302704578
driven_any_mean0.6148172530722962
driven_any_median0.5457640496143875
driven_any_min0.30227389810048894
driven_lanedir_consec_max0.797287526441987
driven_lanedir_consec_mean0.4211897171247365
driven_lanedir_consec_min0.1644714808652381
driven_lanedir_max0.797287526441987
driven_lanedir_mean0.4229139258079286
driven_lanedir_median0.24485310743273692
driven_lanedir_min0.1644714808652381
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.2500000000000001
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.0145766019821167, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.036591196060180665, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.042178237438201906, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.05125304460525513, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.022764420509338378, "sim_compute_performance-ego": 0.03795170783996582, "sim_compute_robot_state-ego": 0.04225994348526001, "sim_compute_robot_state-npc0": 0.04099259376525879, "sim_compute_robot_state-npc1": 0.04049006700515747, "sim_compute_robot_state-npc2": 0.038893723487854005, "sim_compute_robot_state-npc3": 0.03974690437316895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126896, "sim_physics": 0.01690383518443388, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120295193918956, "sim_render-ego": 0.03500001570757698, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.041349691503188186, "deviation-heading": 0.3074760381865352, "set_robot_commands": 0.05036598093369428, "deviation-center-line": 0.02399911835622947, "driven_lanedir_consec": 0.17258190852322874, "sim_compute_sim_state": 0.022292543860042795, "sim_compute_performance-ego": 0.0364685339086196, "sim_compute_robot_state-ego": 0.04217698994804831, "sim_compute_robot_state-npc0": 0.038942912045647114, "sim_compute_robot_state-npc1": 0.038898496066822726, "sim_compute_robot_state-npc2": 0.03783291928908404, "sim_compute_robot_state-npc3": 0.038478542776668775}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30227389810048894, "sim_physics": 0.016798019409179688, "survival_time": 0.49999999999999994, "driven_lanedir": 0.24485310743273692, "sim_render-ego": 0.0363661527633667, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.04472272396087647, "deviation-heading": 0.16993642764665506, "set_robot_commands": 0.052027106285095215, "deviation-center-line": 0.02780957766589444, "driven_lanedir_consec": 0.24485310743273692, "sim_compute_sim_state": 0.023671436309814452, "sim_compute_performance-ego": 0.03808636665344238, "sim_compute_robot_state-ego": 0.04387176036834717, "sim_compute_robot_state-npc0": 0.03936722278594971, "sim_compute_robot_state-npc1": 0.04065251350402832, "sim_compute_robot_state-npc2": 0.03985261917114258, "sim_compute_robot_state-npc3": 0.04063661098480224}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.016529483454568044, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.03612490211214338, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.042610807078225274, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.05068013497761318, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.0226175103868757, "sim_compute_performance-ego": 0.035863595349448066, "sim_compute_robot_state-ego": 0.043051106589181085, "sim_compute_robot_state-npc0": 0.03895382370267596, "sim_compute_robot_state-npc1": 0.03984720366341727, "sim_compute_robot_state-npc2": 0.037811279296875, "sim_compute_robot_state-npc3": 0.03892222472599575}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704578, "sim_physics": 0.014953413317280432, "survival_time": 1.5500000000000007, "driven_lanedir": 0.797287526441987, "sim_render-ego": 0.0364614148293772, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.042089608407789664, "deviation-heading": 0.6295143987792059, "set_robot_commands": 0.05184868843324723, "deviation-center-line": 0.1367821242164622, "driven_lanedir_consec": 0.797287526441987, "sim_compute_sim_state": 0.022661770543744488, "sim_compute_performance-ego": 0.03820063990931357, "sim_compute_robot_state-ego": 0.04392560835807554, "sim_compute_robot_state-npc0": 0.0401264698274674, "sim_compute_robot_state-npc1": 0.03981204955808578, "sim_compute_robot_state-npc2": 0.03968522625584756, "sim_compute_robot_state-npc3": 0.03909463267172537}}
set_robot_commands_max0.052027106285095215
set_robot_commands_mean0.051234991046981
set_robot_commands_median0.05125304460525513
set_robot_commands_min0.05036598093369428
sim_compute_performance-ego_max0.03820063990931357
sim_compute_performance-ego_mean0.037314168732157885
sim_compute_performance-ego_median0.03795170783996582
sim_compute_performance-ego_min0.035863595349448066
sim_compute_robot_state-ego_max0.04392560835807554
sim_compute_robot_state-ego_mean0.04305708174978243
sim_compute_robot_state-ego_median0.043051106589181085
sim_compute_robot_state-ego_min0.04217698994804831
sim_compute_robot_state-npc0_max0.04099259376525879
sim_compute_robot_state-npc0_mean0.03967660442539979
sim_compute_robot_state-npc0_median0.03936722278594971
sim_compute_robot_state-npc0_min0.038942912045647114
sim_compute_robot_state-npc1_max0.04065251350402832
sim_compute_robot_state-npc1_mean0.039940065959502315
sim_compute_robot_state-npc1_median0.03984720366341727
sim_compute_robot_state-npc1_min0.038898496066822726
sim_compute_robot_state-npc2_max0.03985261917114258
sim_compute_robot_state-npc2_mean0.03881515350016064
sim_compute_robot_state-npc2_median0.038893723487854005
sim_compute_robot_state-npc2_min0.037811279296875
sim_compute_robot_state-npc3_max0.04063661098480224
sim_compute_robot_state-npc3_mean0.03937578310647222
sim_compute_robot_state-npc3_median0.03909463267172537
sim_compute_robot_state-npc3_min0.038478542776668775
sim_compute_sim_state_max0.023671436309814452
sim_compute_sim_state_mean0.02280153632196316
sim_compute_sim_state_median0.022661770543744488
sim_compute_sim_state_min0.022292543860042795
sim_physics_max0.01690383518443388
sim_physics_mean0.01595227066951575
sim_physics_median0.016529483454568044
sim_physics_min0.0145766019821167
sim_render-ego_max0.036591196060180665
sim_render-ego_mean0.03610873629452899
sim_render-ego_median0.0363661527633667
sim_render-ego_min0.03500001570757698
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0600000000000005
survival_time_min0.49999999999999994
No reset possible
181282759Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationhost-errornouberduck20:00:54
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18128-704807', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18128-704807', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18128-704807', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
181272779Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerrornouberduck20:00:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible