Duckietown Challenges Home Challenges Submissions

Evaluator 652

ID652
evaluatorInstance1
ownerJulian Zilly
machineidsc-rudolf
processInstance1
versiond-c:4.0.14;d-c-r:4.0.19;d-s:4.0.15
first heard
last heard
statusinactive
# evaluating
# success5 17653
# timeout
# failed
# error4 17632
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
177042456Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationsuccessnoInstance10:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2448526305955787
survival_time_median1.0000000000000002
deviation-center-line_median0.02780958695734228
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.16538326740264891
agent_compute-ego_mean0.15061462178596088
agent_compute-ego_median0.15114624159676687
agent_compute-ego_min0.13855504989624023
deviation-center-line_max0.1367821583469593
deviation-center-line_mean0.05703771312424479
deviation-center-line_min0.019515313732513393
deviation-heading_max0.6295143987792061
deviation-heading_mean0.33854872313755296
deviation-heading_median0.30747603818653535
deviation-heading_min0.1699364276466551
driven_any_max0.9094890302704564
driven_any_mean0.614817253072296
driven_any_median0.5457640496143875
driven_any_min0.3022738981004904
driven_lanedir_consec_max0.7972872880234139
driven_lanedir_consec_mean0.4211895144689454
driven_lanedir_consec_min0.1644714808652381
driven_lanedir_max0.7972872880234139
driven_lanedir_mean0.42291373507306657
driven_lanedir_median0.2448526305955787
driven_lanedir_min0.1644714808652381
in-drivable-lane_max0.6500000000000002
in-drivable-lane_mean0.2500000000000001
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.01204226016998291, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.05914826393127441, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.16538326740264891, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.0779342532157898, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.036675310134887694, "sim_compute_performance-ego": 0.057631516456604005, "sim_compute_robot_state-ego": 0.059815406799316406}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126885, "sim_physics": 0.013180901022518385, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120271352061035, "sim_render-ego": 0.05858293701620663, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.15279638066011317, "deviation-heading": 0.30747603818653535, "set_robot_commands": 0.07889297429253073, "deviation-center-line": 0.023999233443120993, "driven_lanedir_consec": 0.17258161050000476, "sim_compute_sim_state": 0.03647366692038143, "sim_compute_performance-ego": 0.056122260935166306, "sim_compute_robot_state-ego": 0.06035472364986644}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3022738981004904, "sim_physics": 0.013064098358154298, "survival_time": 0.49999999999999994, "driven_lanedir": 0.2448526305955787, "sim_render-ego": 0.05265793800354004, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.13855504989624023, "deviation-heading": 0.1699364276466551, "set_robot_commands": 0.07596359252929688, "deviation-center-line": 0.02780958695734228, "driven_lanedir_consec": 0.2448526305955787, "sim_compute_sim_state": 0.036905956268310544, "sim_compute_performance-ego": 0.05640666484832764, "sim_compute_robot_state-ego": 0.06179337501525879}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.013994651181357247, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.0583192024912153, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15114624159676687, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.07820384843008858, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.03587123325892857, "sim_compute_performance-ego": 0.05812042100088937, "sim_compute_robot_state-ego": 0.06064110994338989}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704564, "sim_physics": 0.012616188295425908, "survival_time": 1.5500000000000007, "driven_lanedir": 0.7972872880234139, "sim_render-ego": 0.05508388242413921, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.14519216937403526, "deviation-heading": 0.6295143987792061, "set_robot_commands": 0.07263560448923419, "deviation-center-line": 0.1367821583469593, "driven_lanedir_consec": 0.7972872880234139, "sim_compute_sim_state": 0.03315567201183688, "sim_compute_performance-ego": 0.054460340930569555, "sim_compute_robot_state-ego": 0.05930645235123173}}
set_robot_commands_max0.07889297429253073
set_robot_commands_mean0.07672605459138802
set_robot_commands_median0.0779342532157898
set_robot_commands_min0.07263560448923419
sim_compute_performance-ego_max0.05812042100088937
sim_compute_performance-ego_mean0.056548240834311383
sim_compute_performance-ego_median0.05640666484832764
sim_compute_performance-ego_min0.054460340930569555
sim_compute_robot_state-ego_max0.06179337501525879
sim_compute_robot_state-ego_mean0.06038221355181265
sim_compute_robot_state-ego_median0.06035472364986644
sim_compute_robot_state-ego_min0.05930645235123173
sim_compute_sim_state_max0.036905956268310544
sim_compute_sim_state_mean0.03581636771886902
sim_compute_sim_state_median0.03647366692038143
sim_compute_sim_state_min0.03315567201183688
sim_physics_max0.013994651181357247
sim_physics_mean0.012979619805487747
sim_physics_median0.013064098358154298
sim_physics_min0.01204226016998291
sim_render-ego_max0.05914826393127441
sim_render-ego_mean0.05675844477327512
sim_render-ego_median0.0583192024912153
sim_render-ego_min0.05265793800354004
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0600000000000005
survival_time_min0.49999999999999994
No reset possible
176972467Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnoInstance10:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8171921272237834
survival_time_median1.1000000000000003
deviation-center-line_median0.025668493904927793
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.1550327602185701
agent_compute-ego_mean0.1514535100390119
agent_compute-ego_median0.15151524543762207
agent_compute-ego_min0.14791134129399838
deviation-center-line_max0.057019386027434615
deviation-center-line_mean0.03634226830745448
deviation-center-line_min0.02280708605632212
deviation-heading_max0.235756116193223
deviation-heading_mean0.1638165081234764
deviation-heading_median0.1411032446854075
deviation-heading_min0.118601117425238
driven_any_max1.028556309238097
driven_any_mean0.8412197852214389
driven_any_median0.956358012875939
driven_any_min0.39300074524610096
driven_lanedir_consec_max0.9648079053779924
driven_lanedir_consec_mean0.6642871273891694
driven_lanedir_consec_min0.31973792380899546
driven_lanedir_max0.9648079053779924
driven_lanedir_mean0.6642871273891694
driven_lanedir_median0.8171921272237834
driven_lanedir_min0.31973792380899546
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.1700000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.012743856595910114, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06383130861365277, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.14791134129399838, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.07713680681974991, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.038940751034280525, "sim_compute_performance-ego": 0.06287578914476477, "sim_compute_robot_state-ego": 0.06290088529172151}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.013676052508146866, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.06705318326535432, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1522892765376879, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07811388762100883, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.0425622152245563, "sim_compute_performance-ego": 0.06762661104616911, "sim_compute_robot_state-ego": 0.06667825450067935}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.01432479511607777, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.07000147212635387, "in-drivable-lane": 0, "agent_compute-ego": 0.15051892670718106, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.07871159640225497, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.04123358293013139, "sim_compute_performance-ego": 0.06696005301042036, "sim_compute_robot_state-ego": 0.0669624155217951}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.013114637798733182, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.0649573802947998, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.15151524543762207, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.07993721961975098, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.0403949154747857, "sim_compute_performance-ego": 0.06424813800387913, "sim_compute_robot_state-ego": 0.06813942061530219}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.014194551267121968, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.06645216439899645, "in-drivable-lane": 0, "agent_compute-ego": 0.1550327602185701, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.08382363068430047, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.043304079457333215, "sim_compute_performance-ego": 0.06448546208833393, "sim_compute_robot_state-ego": 0.06402951792666786}}
set_robot_commands_max0.08382363068430047
set_robot_commands_mean0.07954462822941302
set_robot_commands_median0.07871159640225497
set_robot_commands_min0.07713680681974991
sim_compute_performance-ego_max0.06762661104616911
sim_compute_performance-ego_mean0.06523921065871346
sim_compute_performance-ego_median0.06448546208833393
sim_compute_performance-ego_min0.06287578914476477
sim_compute_robot_state-ego_max0.06813942061530219
sim_compute_robot_state-ego_mean0.0657420987712332
sim_compute_robot_state-ego_median0.06667825450067935
sim_compute_robot_state-ego_min0.06290088529172151
sim_compute_sim_state_max0.043304079457333215
sim_compute_sim_state_mean0.041287108824217426
sim_compute_sim_state_median0.04123358293013139
sim_compute_sim_state_min0.038940751034280525
sim_physics_max0.01432479511607777
sim_physics_mean0.01361077865719798
sim_physics_median0.013676052508146866
sim_physics_min0.012743856595910114
sim_render-ego_max0.07000147212635387
sim_render-ego_mean0.06645910173983145
sim_render-ego_median0.06645216439899645
sim_render-ego_min0.06383130861365277
simulation-passed1
survival_time_max1.1500000000000004
survival_time_mean0.9600000000000004
survival_time_min0.45
No reset possible
176952506Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrornoInstance10:00:57
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
176862492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoInstance10:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0954710478558487
survival_time_median0.4
deviation-center-line_median0.020513490342268445
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1901193346296038
agent_compute-ego_mean0.16919303587504794
agent_compute-ego_median0.16818442344665527
agent_compute-ego_min0.15466231107711792
deviation-center-line_max0.025272919597450743
deviation-center-line_mean0.020741884167327425
deviation-center-line_min0.016255031594153847
deviation-heading_max0.32380425654906403
deviation-heading_mean0.28616761113551215
deviation-heading_median0.291438508669243
deviation-heading_min0.23805342395516
driven_any_max0.20638179749965177
driven_any_mean0.17421242200504655
driven_any_median0.1682381529981585
driven_any_min0.14307402365572502
driven_lanedir_consec_max0.13633358996516876
driven_lanedir_consec_mean0.10688942129071469
driven_lanedir_consec_min0.08108458589999756
driven_lanedir_max0.13633358996516876
driven_lanedir_mean0.10688942129071469
driven_lanedir_median0.0954710478558487
driven_lanedir_min0.08108458589999756
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14307402365572502, "sim_physics": 0.01128537314278739, "survival_time": 0.35, "driven_lanedir": 0.08108458589999756, "sim_render-ego": 0.055719239371163506, "in-drivable-lane": 0, "agent_compute-ego": 0.1901193346296038, "deviation-heading": 0.2549766514669446, "set_robot_commands": 0.07289304052080427, "deviation-center-line": 0.016255031594153847, "driven_lanedir_consec": 0.08108458589999756, "sim_compute_sim_state": 0.03191338266645159, "sim_compute_performance-ego": 0.05203931672232492, "sim_compute_robot_state-ego": 0.054666485105242045}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16257108669571535, "sim_physics": 0.014845311641693115, "survival_time": 0.4, "driven_lanedir": 0.0954710478558487, "sim_render-ego": 0.0696965754032135, "in-drivable-lane": 0, "agent_compute-ego": 0.17720085382461548, "deviation-heading": 0.291438508669243, "set_robot_commands": 0.08192232251167297, "deviation-center-line": 0.022758322717507586, "driven_lanedir_consec": 0.0954710478558487, "sim_compute_sim_state": 0.04714587330818176, "sim_compute_performance-ego": 0.06910574436187744, "sim_compute_robot_state-ego": 0.07271650433540344}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1682381529981585, "sim_physics": 0.013777583837509155, "survival_time": 0.4, "driven_lanedir": 0.08634031990820068, "sim_render-ego": 0.06028100848197937, "in-drivable-lane": 0, "agent_compute-ego": 0.15466231107711792, "deviation-heading": 0.32380425654906403, "set_robot_commands": 0.08061018586158752, "deviation-center-line": 0.025272919597450743, "driven_lanedir_consec": 0.08634031990820068, "sim_compute_sim_state": 0.0426674485206604, "sim_compute_performance-ego": 0.0584757924079895, "sim_compute_robot_state-ego": 0.06839707493782043}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20638179749965177, "sim_physics": 0.013646817207336426, "survival_time": 0.49999999999999994, "driven_lanedir": 0.1352175628243577, "sim_render-ego": 0.06895477771759033, "in-drivable-lane": 0, "agent_compute-ego": 0.16818442344665527, "deviation-heading": 0.3225652150371494, "set_robot_commands": 0.07620773315429688, "deviation-center-line": 0.01890965658525649, "driven_lanedir_consec": 0.1352175628243577, "sim_compute_sim_state": 0.04135196208953858, "sim_compute_performance-ego": 0.07068266868591308, "sim_compute_robot_state-ego": 0.06519217491149902}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19079704917598203, "sim_physics": 0.01413947343826294, "survival_time": 0.4, "driven_lanedir": 0.13633358996516876, "sim_render-ego": 0.06729209423065186, "in-drivable-lane": 0, "agent_compute-ego": 0.15579825639724731, "deviation-heading": 0.23805342395516, "set_robot_commands": 0.07524442672729492, "deviation-center-line": 0.020513490342268445, "driven_lanedir_consec": 0.13633358996516876, "sim_compute_sim_state": 0.04314759373664856, "sim_compute_performance-ego": 0.06502765417098999, "sim_compute_robot_state-ego": 0.08613499999046326}}
set_robot_commands_max0.08192232251167297
set_robot_commands_mean0.07737554175513131
set_robot_commands_median0.07620773315429688
set_robot_commands_min0.07289304052080427
sim_compute_performance-ego_max0.07068266868591308
sim_compute_performance-ego_mean0.06306623526981898
sim_compute_performance-ego_median0.06502765417098999
sim_compute_performance-ego_min0.05203931672232492
sim_compute_robot_state-ego_max0.08613499999046326
sim_compute_robot_state-ego_mean0.06942144785608564
sim_compute_robot_state-ego_median0.06839707493782043
sim_compute_robot_state-ego_min0.054666485105242045
sim_compute_sim_state_max0.04714587330818176
sim_compute_sim_state_mean0.041245252064296176
sim_compute_sim_state_median0.0426674485206604
sim_compute_sim_state_min0.03191338266645159
sim_physics_max0.014845311641693115
sim_physics_mean0.013538911853517804
sim_physics_median0.013777583837509155
sim_physics_min0.01128537314278739
sim_render-ego_max0.0696965754032135
sim_render-ego_mean0.06438873904091971
sim_render-ego_median0.06729209423065186
sim_render-ego_min0.055719239371163506
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.41
survival_time_min0.35
No reset possible
176692492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoInstance10:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06532683138552775
survival_time_median0.49999999999999994
deviation-center-line_median0.009778764937981507
in-drivable-lane_median0.19999999999999996


other stats
agent_compute-ego_max0.2532487213611603
agent_compute-ego_mean0.20662944700982835
agent_compute-ego_median0.18791687488555908
agent_compute-ego_min0.17672889232635497
deviation-center-line_max0.01625152449158168
deviation-center-line_mean0.010465553019901775
deviation-center-line_min0.006491486852991015
deviation-heading_max0.27074065804481506
deviation-heading_mean0.21763182497199848
deviation-heading_median0.21080137986470665
deviation-heading_min0.18410149479613583
driven_any_max0.17277194661752163
driven_any_mean0.16074542741767078
driven_any_median0.16093051084561166
driven_any_min0.14822755399633508
driven_lanedir_consec_max0.07029923482568945
driven_lanedir_consec_mean0.058265257660874335
driven_lanedir_consec_min0.03845942738318797
driven_lanedir_max0.07029923482568945
driven_lanedir_mean0.058265257660874335
driven_lanedir_median0.06532683138552775
driven_lanedir_min0.03845942738318797
in-drivable-lane_max0.19999999999999996
in-drivable-lane_mean0.16999999999999998
in-drivable-lane_min0.04999999999999999
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16284907286852474, "sim_physics": 0.014224720001220704, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05121418675395173, "sim_render-ego": 0.05316319465637207, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.18791687488555908, "deviation-heading": 0.2258554017719101, "set_robot_commands": 0.08047468662261963, "deviation-center-line": 0.009778764937981507, "driven_lanedir_consec": 0.05121418675395173, "sim_compute_sim_state": 0.036658644676208496, "sim_compute_performance-ego": 0.05945684909820557, "sim_compute_robot_state-ego": 0.05791871547698975}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17277194661752163, "sim_physics": 0.013705301284790038, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06602660795601478, "sim_render-ego": 0.06603066921234131, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.18040244579315184, "deviation-heading": 0.21080137986470665, "set_robot_commands": 0.07388088703155518, "deviation-center-line": 0.010678788498688613, "driven_lanedir_consec": 0.06602660795601478, "sim_compute_sim_state": 0.04153940677642822, "sim_compute_performance-ego": 0.06834113597869873, "sim_compute_robot_state-ego": 0.06649582386016846}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1589480527603607, "sim_physics": 0.013783454895019531, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06532683138552775, "sim_render-ego": 0.06687667369842529, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.17672889232635497, "deviation-heading": 0.19666019038242455, "set_robot_commands": 0.0785897970199585, "deviation-center-line": 0.009127200318266068, "driven_lanedir_consec": 0.06532683138552775, "sim_compute_sim_state": 0.04265515804290772, "sim_compute_performance-ego": 0.062258338928222655, "sim_compute_robot_state-ego": 0.06175258159637451}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16093051084561166, "sim_physics": 0.01541110873222351, "survival_time": 0.4, "driven_lanedir": 0.07029923482568945, "sim_render-ego": 0.06648042798042297, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.2532487213611603, "deviation-heading": 0.27074065804481506, "set_robot_commands": 0.07629936933517456, "deviation-center-line": 0.01625152449158168, "driven_lanedir_consec": 0.07029923482568945, "sim_compute_sim_state": 0.03754737973213196, "sim_compute_performance-ego": 0.06478267908096313, "sim_compute_robot_state-ego": 0.06140825152397156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14822755399633508, "sim_physics": 0.013177977667914497, "survival_time": 0.45, "driven_lanedir": 0.03845942738318797, "sim_render-ego": 0.06950985060797797, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.23485030068291557, "deviation-heading": 0.18410149479613583, "set_robot_commands": 0.08034364382425944, "deviation-center-line": 0.006491486852991015, "driven_lanedir_consec": 0.03845942738318797, "sim_compute_sim_state": 0.04108071327209473, "sim_compute_performance-ego": 0.0629582405090332, "sim_compute_robot_state-ego": 0.06424530347188313}}
set_robot_commands_max0.08047468662261963
set_robot_commands_mean0.07791767676671346
set_robot_commands_median0.0785897970199585
set_robot_commands_min0.07388088703155518
sim_compute_performance-ego_max0.06834113597869873
sim_compute_performance-ego_mean0.06355944871902466
sim_compute_performance-ego_median0.0629582405090332
sim_compute_performance-ego_min0.05945684909820557
sim_compute_robot_state-ego_max0.06649582386016846
sim_compute_robot_state-ego_mean0.06236413518587748
sim_compute_robot_state-ego_median0.06175258159637451
sim_compute_robot_state-ego_min0.05791871547698975
sim_compute_sim_state_max0.04265515804290772
sim_compute_sim_state_mean0.03989626049995423
sim_compute_sim_state_median0.04108071327209473
sim_compute_sim_state_min0.036658644676208496
sim_physics_max0.01541110873222351
sim_physics_mean0.014060512516233655
sim_physics_median0.013783454895019531
sim_physics_min0.013177977667914497
sim_render-ego_max0.06950985060797797
sim_render-ego_mean0.06441216323110792
sim_render-ego_median0.06648042798042297
sim_render-ego_min0.05316319465637207
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.4699999999999999
survival_time_min0.4
No reset possible
176662480Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrornoInstance10:00:50
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
176532476Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFVI-sim-validationstep1-simulationsuccessnoInstance10:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6896127428821732
survival_time_median1.1500000000000004
deviation-center-line_median0.05610305022565209
in-drivable-lane_median0.20000000000000007


other stats
agent_compute-ego_max0.1483666996161143
agent_compute-ego_mean0.1409402428823475
agent_compute-ego_median0.1401153632572719
agent_compute-ego_min0.1344536076421323
deviation-center-line_max0.07504669169058735
deviation-center-line_mean0.05629372528587068
deviation-center-line_min0.031337769455374115
deviation-heading_max0.4695314592890065
deviation-heading_mean0.28295632700130013
deviation-heading_median0.28969351082790473
deviation-heading_min0.13822734158708538
driven_any_max1.1972535692377095
driven_any_mean1.069550703128448
driven_any_median1.0381750331691957
driven_any_min1.0257183998178268
driven_lanedir_consec_max0.8123144800841251
driven_lanedir_consec_mean0.6312226729648216
driven_lanedir_consec_min0.4373052105850964
driven_lanedir_max0.9325407987545682
driven_lanedir_mean0.7224147694584564
driven_lanedir_median0.8123144800841251
driven_lanedir_min0.48318684247252186
in-drivable-lane_max0.6000000000000004
in-drivable-lane_mean0.3000000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.02543053456715175, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.06985839775630406, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.1401153632572719, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.07606232166290283, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.03480954681124006, "sim_compute_performance-ego": 0.06292473418372017, "sim_compute_robot_state-ego": 0.06163062368120466, "sim_compute_robot_state-npc0": 0.07187084640775408, "sim_compute_robot_state-npc1": 0.06328180858067103, "sim_compute_robot_state-npc2": 0.06225539105279105, "sim_compute_robot_state-npc3": 0.06449443101882935}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.025831351677576705, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.060510734717051186, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.1483666996161143, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.07948517799377441, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03346902132034302, "sim_compute_performance-ego": 0.05774525801340739, "sim_compute_robot_state-ego": 0.059589902559916176, "sim_compute_robot_state-npc0": 0.07060879468917847, "sim_compute_robot_state-npc1": 0.06066500147183736, "sim_compute_robot_state-npc2": 0.05885937809944153, "sim_compute_robot_state-npc3": 0.06015398104985555}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.027706519417140796, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.06557862654976222, "in-drivable-lane": 0, "agent_compute-ego": 0.14441515051800272, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.07741287480229916, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.035488916480022926, "sim_compute_performance-ego": 0.06376703925754713, "sim_compute_robot_state-ego": 0.061938140703284225, "sim_compute_robot_state-npc0": 0.07095472708992336, "sim_compute_robot_state-npc1": 0.0630603665890901, "sim_compute_robot_state-npc2": 0.05749061833257261, "sim_compute_robot_state-npc3": 0.058077065841011376}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.0280577099841574, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.06669360658396846, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.1344536076421323, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.0780662142712137, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.036878616913505226, "sim_compute_performance-ego": 0.06800237945888353, "sim_compute_robot_state-ego": 0.06707875624946925, "sim_compute_robot_state-npc0": 0.06990667011426843, "sim_compute_robot_state-npc1": 0.06574302134306534, "sim_compute_robot_state-npc2": 0.06248420217762823, "sim_compute_robot_state-npc3": 0.06343238250068996}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.02514879599861477, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.0647154476331628, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.13735039337821628, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.07547376466834027, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.037828352140343705, "sim_compute_performance-ego": 0.0626859768577244, "sim_compute_robot_state-ego": 0.06862602026566215, "sim_compute_robot_state-npc0": 0.06922269904095193, "sim_compute_robot_state-npc1": 0.06292974430581798, "sim_compute_robot_state-npc2": 0.06351580827132515, "sim_compute_robot_state-npc3": 0.06296053140059761}}
set_robot_commands_max0.07948517799377441
set_robot_commands_mean0.07730007067970608
set_robot_commands_median0.07741287480229916
set_robot_commands_min0.07547376466834027
sim_compute_performance-ego_max0.06800237945888353
sim_compute_performance-ego_mean0.06302507755425653
sim_compute_performance-ego_median0.06292473418372017
sim_compute_performance-ego_min0.05774525801340739
sim_compute_robot_state-ego_max0.06862602026566215
sim_compute_robot_state-ego_mean0.0637726886919073
sim_compute_robot_state-ego_median0.061938140703284225
sim_compute_robot_state-ego_min0.059589902559916176
sim_compute_robot_state-npc0_max0.07187084640775408
sim_compute_robot_state-npc0_mean0.07051274746841525
sim_compute_robot_state-npc0_median0.07060879468917847
sim_compute_robot_state-npc0_min0.06922269904095193
sim_compute_robot_state-npc1_max0.06574302134306534
sim_compute_robot_state-npc1_mean0.06313598845809636
sim_compute_robot_state-npc1_median0.0630603665890901
sim_compute_robot_state-npc1_min0.06066500147183736
sim_compute_robot_state-npc2_max0.06351580827132515
sim_compute_robot_state-npc2_mean0.06092107958675171
sim_compute_robot_state-npc2_median0.06225539105279105
sim_compute_robot_state-npc2_min0.05749061833257261
sim_compute_robot_state-npc3_max0.06449443101882935
sim_compute_robot_state-npc3_mean0.061823678362196766
sim_compute_robot_state-npc3_median0.06296053140059761
sim_compute_robot_state-npc3_min0.058077065841011376
sim_compute_sim_state_max0.037828352140343705
sim_compute_sim_state_mean0.03569489073309099
sim_compute_sim_state_median0.035488916480022926
sim_compute_sim_state_min0.03346902132034302
sim_physics_max0.0280577099841574
sim_physics_mean0.02643498232892828
sim_physics_median0.025831351677576705
sim_physics_min0.02514879599861477
sim_render-ego_max0.06985839775630406
sim_render-ego_mean0.06547136264804973
sim_render-ego_median0.06557862654976222
sim_render-ego_min0.060510734717051186
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.2100000000000004
survival_time_min1.1500000000000004
No reset possible
176422487Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrornoInstance10:01:35
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
176322450Nicky EichmannBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerrornoInstance10:20:57
Waited 1202 seconds [...]
Waited 1202 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible