Duckietown Challenges Home Challenges Submissions

Evaluator 766

ID766
evaluatornutonomy-P50-5996
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-5996
versiond-c:4.0.18;d-c-r:4.0.27;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success11 18835
# timeout2 19130
# failed1 19197
# error11 18790
# aborted4 18958
# host-error8 18917
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
192182973Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationtimeoutnonutonomy-P50-59961:05:56
I can see how the jo [...]
I can see how the job 19218 is timeout because passed 3956 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
192132982Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-validationstep1-simulationsuccessnonutonomy-P50-59960:18:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8281719836205654
survival_time_median12.850000000000048
deviation-center-line_median0.5959428498457681
in-drivable-lane_median0.4500000000000064


other stats
agent_compute-ego_max0.11643129143060424
agent_compute-ego_mean0.11350910398044652
agent_compute-ego_median0.11329312152690715
agent_compute-ego_min0.10879228512446086
deviation-center-line_max1.401091801640871
deviation-center-line_mean0.6758666389800195
deviation-center-line_min0.33492206012863057
deviation-heading_max2.7746270789033844
deviation-heading_mean1.7622695247401603
deviation-heading_median1.5975450132693465
deviation-heading_min1.1144386728911029
driven_any_max1.4120389358057757
driven_any_mean1.0853815537830371
driven_any_median1.1530541192958483
driven_any_min0.5171860731930935
driven_lanedir_consec_max0.988424456693104
driven_lanedir_consec_mean0.795362260609016
driven_lanedir_consec_min0.5014379134202489
driven_lanedir_max1.294283739936706
driven_lanedir_mean0.9194222275876875
driven_lanedir_median0.8281719836205654
driven_lanedir_min0.5014379134202489
in-drivable-lane_max3.7000000000000526
in-drivable-lane_mean1.5300000000000218
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2661985488615797, "sim_physics": 0.01834189971288045, "survival_time": 14.950000000000076, "driven_lanedir": 1.2549235527594311, "sim_render-ego": 0.035230780442555745, "in-drivable-lane": 0, "agent_compute-ego": 0.116151868502299, "deviation-heading": 1.5975450132693465, "set_robot_commands": 0.05276282389958699, "deviation-center-line": 0.5959428498457681, "driven_lanedir_consec": 0.9654765659341922, "sim_compute_sim_state": 0.021742544174194335, "sim_compute_performance-ego": 0.03786525885264079, "sim_compute_robot_state-ego": 0.03949528853098552, "sim_compute_robot_state-npc0": 0.038969972133636475, "sim_compute_robot_state-npc1": 0.038094766934712726, "sim_compute_robot_state-npc2": 0.03794551610946655, "sim_compute_robot_state-npc3": 0.038575146993001304}, "udem1-1-0": {"driven_any": 0.5171860731930935, "sim_physics": 0.0193976539749283, "survival_time": 5.549999999999988, "driven_lanedir": 0.5014379134202489, "sim_render-ego": 0.034435141193974124, "in-drivable-lane": 0, "agent_compute-ego": 0.11329312152690715, "deviation-heading": 1.1144386728911029, "set_robot_commands": 0.052023836084314296, "deviation-center-line": 0.33492206012863057, "driven_lanedir_consec": 0.5014379134202489, "sim_compute_sim_state": 0.021389727119926937, "sim_compute_performance-ego": 0.03779355255333153, "sim_compute_robot_state-ego": 0.03959853799493463, "sim_compute_robot_state-npc0": 0.03826163910530709, "sim_compute_robot_state-npc1": 0.03855417870186471, "sim_compute_robot_state-npc2": 0.03805432233724508, "sim_compute_robot_state-npc3": 0.03768374468829181}, "udem1-2-0": {"driven_any": 1.0784300917588885, "sim_physics": 0.01853236057415083, "survival_time": 12.850000000000048, "driven_lanedir": 0.7182939482014871, "sim_render-ego": 0.03488740104645607, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.11287695331796134, "deviation-heading": 2.12508093443164, "set_robot_commands": 0.05169278823911912, "deviation-center-line": 0.612223324245103, "driven_lanedir_consec": 0.6933003833769696, "sim_compute_sim_state": 0.02124841946108332, "sim_compute_performance-ego": 0.035821382173768276, "sim_compute_robot_state-ego": 0.03752072961413907, "sim_compute_robot_state-npc0": 0.03703991726678633, "sim_compute_robot_state-npc1": 0.037314565265225065, "sim_compute_robot_state-npc2": 0.037251229416071674, "sim_compute_robot_state-npc3": 0.037056984140715246}, "udem1-3-0": {"driven_any": 1.4120389358057757, "sim_physics": 0.017462772528330485, "survival_time": 14.950000000000076, "driven_lanedir": 1.294283739936706, "sim_render-ego": 0.03306616624196371, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.10879228512446086, "deviation-heading": 2.7746270789033844, "set_robot_commands": 0.05013420740763346, "deviation-center-line": 1.401091801640871, "driven_lanedir_consec": 0.988424456693104, "sim_compute_sim_state": 0.020203750133514404, "sim_compute_performance-ego": 0.03512113650639852, "sim_compute_robot_state-ego": 0.03629992961883545, "sim_compute_robot_state-npc0": 0.03610272725423177, "sim_compute_robot_state-npc1": 0.0361629327138265, "sim_compute_robot_state-npc2": 0.035685230096181235, "sim_compute_robot_state-npc3": 0.03556145668029785}, "udem1-4-0": {"driven_any": 1.1530541192958483, "sim_physics": 0.017905457814534505, "survival_time": 12.750000000000046, "driven_lanedir": 0.8281719836205654, "sim_render-ego": 0.03497292668211694, "in-drivable-lane": 3.7000000000000526, "agent_compute-ego": 0.11643129143060424, "deviation-heading": 1.1996559242053286, "set_robot_commands": 0.05262196671728994, "deviation-center-line": 0.4351531590397249, "driven_lanedir_consec": 0.8281719836205654, "sim_compute_sim_state": 0.021686280942430684, "sim_compute_performance-ego": 0.0373992078444537, "sim_compute_robot_state-ego": 0.03859470030840705, "sim_compute_robot_state-npc0": 0.03990379782284007, "sim_compute_robot_state-npc1": 0.03884799433689491, "sim_compute_robot_state-npc2": 0.0385525432287478, "sim_compute_robot_state-npc3": 0.03848743812710631}}
set_robot_commands_max0.05276282389958699
set_robot_commands_mean0.051847124469588765
set_robot_commands_median0.052023836084314296
set_robot_commands_min0.05013420740763346
sim_compute_performance-ego_max0.03786525885264079
sim_compute_performance-ego_mean0.03680010758611856
sim_compute_performance-ego_median0.0373992078444537
sim_compute_performance-ego_min0.03512113650639852
sim_compute_robot_state-ego_max0.03959853799493463
sim_compute_robot_state-ego_mean0.038301837213460345
sim_compute_robot_state-ego_median0.03859470030840705
sim_compute_robot_state-ego_min0.03629992961883545
sim_compute_robot_state-npc0_max0.03990379782284007
sim_compute_robot_state-npc0_mean0.03805561071656034
sim_compute_robot_state-npc0_median0.03826163910530709
sim_compute_robot_state-npc0_min0.03610272725423177
sim_compute_robot_state-npc1_max0.03884799433689491
sim_compute_robot_state-npc1_mean0.037794887590504776
sim_compute_robot_state-npc1_median0.038094766934712726
sim_compute_robot_state-npc1_min0.0361629327138265
sim_compute_robot_state-npc2_max0.0385525432287478
sim_compute_robot_state-npc2_mean0.037497768237542466
sim_compute_robot_state-npc2_median0.03794551610946655
sim_compute_robot_state-npc2_min0.035685230096181235
sim_compute_robot_state-npc3_max0.038575146993001304
sim_compute_robot_state-npc3_mean0.03747295412588251
sim_compute_robot_state-npc3_median0.03768374468829181
sim_compute_robot_state-npc3_min0.03556145668029785
sim_compute_sim_state_max0.021742544174194335
sim_compute_sim_state_mean0.02125414436622993
sim_compute_sim_state_median0.021389727119926937
sim_compute_sim_state_min0.020203750133514404
sim_physics_max0.0193976539749283
sim_physics_mean0.018328028920964915
sim_physics_median0.01834189971288045
sim_physics_min0.017462772528330485
sim_render-ego_max0.035230780442555745
sim_render-ego_mean0.03451848312141332
sim_render-ego_median0.03488740104645607
sim_render-ego_min0.03306616624196371
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.210000000000043
survival_time_min5.549999999999988
No reset possible
192082961Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessnonutonomy-P50-59960:17:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.197002349029686
survival_time_median13.900000000000064
deviation-center-line_median0.4124080826469516
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.1172042553373378
agent_compute-ego_mean0.1142798858453878
agent_compute-ego_median0.11587449320319558
agent_compute-ego_min0.10684455377714974
deviation-center-line_max0.6189776444070136
deviation-center-line_mean0.4056458059400697
deviation-center-line_min0.20174284840289708
deviation-heading_max3.650118383722661
deviation-heading_mean2.2463917054568077
deviation-heading_median2.282969712612091
deviation-heading_min0.45657996322505456
driven_any_max1.9355623245796447
driven_any_mean1.6206553403845247
driven_any_median1.7170122699733468
driven_any_min1.0727503116507664
driven_lanedir_consec_max1.9337436467068043
driven_lanedir_consec_mean1.2242719509621742
driven_lanedir_consec_min0.6028946149350563
driven_lanedir_max1.9337436467068043
driven_lanedir_mean1.257100612829017
driven_lanedir_median1.242727201007797
driven_lanedir_min0.6364788998552253
in-drivable-lane_max2.450000000000035
in-drivable-lane_mean1.6100000000000168
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0727503116507664, "sim_physics": 0.016758625199194667, "survival_time": 7.349999999999982, "driven_lanedir": 0.6364788998552253, "sim_render-ego": 0.03492433359833802, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.11587449320319558, "deviation-heading": 2.282969712612091, "set_robot_commands": 0.0541867090731251, "deviation-center-line": 0.20174284840289708, "driven_lanedir_consec": 0.6028946149350563, "sim_compute_sim_state": 0.021595906238166655, "sim_compute_performance-ego": 0.03789202696612092, "sim_compute_robot_state-ego": 0.038964642959387126, "sim_compute_robot_state-npc0": 0.039455215947157674, "sim_compute_robot_state-npc1": 0.038646076812225136, "sim_compute_robot_state-npc2": 0.038714073142226864, "sim_compute_robot_state-npc3": 0.03829082015420303}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9355623245796447, "sim_physics": 0.01717163642247518, "survival_time": 14.950000000000076, "driven_lanedir": 1.9337436467068043, "sim_render-ego": 0.03580820480982463, "in-drivable-lane": 0, "agent_compute-ego": 0.1159025756518046, "deviation-heading": 0.45657996322505456, "set_robot_commands": 0.05301082293192545, "deviation-center-line": 0.6189776444070136, "driven_lanedir_consec": 1.9337436467068043, "sim_compute_sim_state": 0.021574769020080566, "sim_compute_performance-ego": 0.03777657429377238, "sim_compute_robot_state-ego": 0.03912058432896932, "sim_compute_robot_state-npc0": 0.03910189946492513, "sim_compute_robot_state-npc1": 0.038671243190765384, "sim_compute_robot_state-npc2": 0.03833375453948975, "sim_compute_robot_state-npc3": 0.03853429873784383}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.75507407022657, "sim_physics": 0.015438636711665562, "survival_time": 14.000000000000064, "driven_lanedir": 1.242727201007797, "sim_render-ego": 0.03252267071178981, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.10684455377714974, "deviation-heading": 2.927663149655495, "set_robot_commands": 0.05097158210618155, "deviation-center-line": 0.4124080826469516, "driven_lanedir_consec": 1.205954368801316, "sim_compute_sim_state": 0.02028876713344029, "sim_compute_performance-ego": 0.03508265359061105, "sim_compute_robot_state-ego": 0.03636414153235299, "sim_compute_robot_state-npc0": 0.035899924380438666, "sim_compute_robot_state-npc1": 0.03598841003009251, "sim_compute_robot_state-npc2": 0.03596752115658351, "sim_compute_robot_state-npc3": 0.03567061935152326}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.622877725492296, "sim_physics": 0.01670080522696177, "survival_time": 12.000000000000036, "driven_lanedir": 1.207717168019785, "sim_render-ego": 0.03413038055102031, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.11557355125745138, "deviation-heading": 1.914627318068738, "set_robot_commands": 0.05277612606684367, "deviation-center-line": 0.32971790589112093, "driven_lanedir_consec": 1.1817647753380092, "sim_compute_sim_state": 0.021587007244428, "sim_compute_performance-ego": 0.037088903784751895, "sim_compute_robot_state-ego": 0.03843956689039866, "sim_compute_robot_state-npc0": 0.03862385849157969, "sim_compute_robot_state-npc1": 0.03828646540641785, "sim_compute_robot_state-npc2": 0.038226444522539774, "sim_compute_robot_state-npc3": 0.038524747888247175}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7170122699733468, "sim_physics": 0.016240854057476675, "survival_time": 13.900000000000064, "driven_lanedir": 1.264836148555473, "sim_render-ego": 0.03508270387169268, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.1172042553373378, "deviation-heading": 3.650118383722661, "set_robot_commands": 0.05250223420506759, "deviation-center-line": 0.46538254835236503, "driven_lanedir_consec": 1.197002349029686, "sim_compute_sim_state": 0.02227197276602546, "sim_compute_performance-ego": 0.03799315322217324, "sim_compute_robot_state-ego": 0.03908120042128529, "sim_compute_robot_state-npc0": 0.03957048337236583, "sim_compute_robot_state-npc1": 0.03889691229346845, "sim_compute_robot_state-npc2": 0.03842764535396219, "sim_compute_robot_state-npc3": 0.038635320800671474}}
set_robot_commands_max0.0541867090731251
set_robot_commands_mean0.05268949487662867
set_robot_commands_median0.05277612606684367
set_robot_commands_min0.05097158210618155
sim_compute_performance-ego_max0.03799315322217324
sim_compute_performance-ego_mean0.037166662371485894
sim_compute_performance-ego_median0.03777657429377238
sim_compute_performance-ego_min0.03508265359061105
sim_compute_robot_state-ego_max0.03912058432896932
sim_compute_robot_state-ego_mean0.03839402722647868
sim_compute_robot_state-ego_median0.038964642959387126
sim_compute_robot_state-ego_min0.03636414153235299
sim_compute_robot_state-npc0_max0.03957048337236583
sim_compute_robot_state-npc0_mean0.0385302763312934
sim_compute_robot_state-npc0_median0.03910189946492513
sim_compute_robot_state-npc0_min0.035899924380438666
sim_compute_robot_state-npc1_max0.03889691229346845
sim_compute_robot_state-npc1_mean0.038097821546593864
sim_compute_robot_state-npc1_median0.038646076812225136
sim_compute_robot_state-npc1_min0.03598841003009251
sim_compute_robot_state-npc2_max0.038714073142226864
sim_compute_robot_state-npc2_mean0.037933887742960415
sim_compute_robot_state-npc2_median0.03833375453948975
sim_compute_robot_state-npc2_min0.03596752115658351
sim_compute_robot_state-npc3_max0.038635320800671474
sim_compute_robot_state-npc3_mean0.037931161386497755
sim_compute_robot_state-npc3_median0.038524747888247175
sim_compute_robot_state-npc3_min0.03567061935152326
sim_compute_sim_state_max0.02227197276602546
sim_compute_sim_state_mean0.02146368448042819
sim_compute_sim_state_median0.021587007244428
sim_compute_sim_state_min0.02028876713344029
sim_physics_max0.01717163642247518
sim_physics_mean0.01646211152355477
sim_physics_median0.01670080522696177
sim_physics_min0.015438636711665562
sim_render-ego_max0.03580820480982463
sim_render-ego_mean0.03449365870853309
sim_render-ego_median0.03492433359833802
sim_render-ego_min0.03252267071178981
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.440000000000044
survival_time_min7.349999999999982
No reset possible
192052868Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessnonutonomy-P50-59960:05:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.458760055494689
survival_time_median2.499999999999999
deviation-center-line_median0.07925389406775694
in-drivable-lane_median0.3999999999999996


other stats
agent_compute-ego_max0.09567042676413932
agent_compute-ego_mean0.0931884564253752
agent_compute-ego_median0.09316260650240142
agent_compute-ego_min0.09057127767139012
deviation-center-line_max0.176093181162229
deviation-center-line_mean0.09711076773011096
deviation-center-line_min0.025736419241635857
deviation-heading_max1.7932831021816578
deviation-heading_mean0.6548214059417061
deviation-heading_median0.4219454932663717
deviation-heading_min0.1920304163407524
driven_any_max1.6188405461229574
driven_any_mean1.1010381959517015
driven_any_median1.0599153702519213
driven_any_min0.6841307702800227
driven_lanedir_consec_max1.433325905054209
driven_lanedir_consec_mean0.6356488624623509
driven_lanedir_consec_min0.30648874452623964
driven_lanedir_max1.433325905054209
driven_lanedir_mean0.709735391321112
driven_lanedir_median0.5491998412647145
driven_lanedir_min0.4488301181017995
in-drivable-lane_max1.3499999999999988
in-drivable-lane_mean0.5999999999999994
in-drivable-lane_min0.29999999999999893
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0063334671931958, "sim_physics": 0.00920267221404285, "survival_time": 2.0500000000000007, "driven_lanedir": 0.6585610366901471, "sim_render-ego": 0.03238797187805176, "in-drivable-lane": 0.6000000000000001, "agent_compute-ego": 0.09567042676413932, "deviation-heading": 0.1920304163407524, "set_robot_commands": 0.05185818672180176, "deviation-center-line": 0.025736419241635857, "driven_lanedir_consec": 0.6585610366901471, "sim_compute_sim_state": 0.021321162944886743, "sim_compute_performance-ego": 0.035416463526283824, "sim_compute_robot_state-ego": 0.03711829534391078}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1359708259104109, "sim_physics": 0.009699821472167969, "survival_time": 2.499999999999999, "driven_lanedir": 0.458760055494689, "sim_render-ego": 0.03359052181243896, "in-drivable-lane": 1.3499999999999988, "agent_compute-ego": 0.09249833106994627, "deviation-heading": 0.21115656920869583, "set_robot_commands": 0.0514376163482666, "deviation-center-line": 0.06508890410631893, "driven_lanedir_consec": 0.458760055494689, "sim_compute_sim_state": 0.02032560348510742, "sim_compute_performance-ego": 0.03846983432769775, "sim_compute_robot_state-ego": 0.03803068161010742}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6188405461229574, "sim_physics": 0.01040480213780557, "survival_time": 3.099999999999997, "driven_lanedir": 1.433325905054209, "sim_render-ego": 0.03369172542325912, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09403964011899886, "deviation-heading": 0.4219454932663717, "set_robot_commands": 0.051219497957537254, "deviation-center-line": 0.1393814400726141, "driven_lanedir_consec": 1.433325905054209, "sim_compute_sim_state": 0.020732049019105973, "sim_compute_performance-ego": 0.0361287324659286, "sim_compute_robot_state-ego": 0.03821379523123464}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0599153702519213, "sim_physics": 0.01015157124091839, "survival_time": 2.8999999999999977, "driven_lanedir": 0.5491998412647145, "sim_render-ego": 0.03229803052441827, "in-drivable-lane": 0.3999999999999996, "agent_compute-ego": 0.09316260650240142, "deviation-heading": 1.7932831021816578, "set_robot_commands": 0.05012461234783304, "deviation-center-line": 0.176093181162229, "driven_lanedir_consec": 0.30648874452623964, "sim_compute_sim_state": 0.02020429331680824, "sim_compute_performance-ego": 0.035880064142161404, "sim_compute_robot_state-ego": 0.037161210487628805}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6841307702800227, "sim_physics": 0.00935065746307373, "survival_time": 1.800000000000001, "driven_lanedir": 0.4488301181017995, "sim_render-ego": 0.03198535574807061, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.09057127767139012, "deviation-heading": 0.6556914487110533, "set_robot_commands": 0.05046857727898492, "deviation-center-line": 0.07925389406775694, "driven_lanedir_consec": 0.32110857054646935, "sim_compute_sim_state": 0.02004936668607924, "sim_compute_performance-ego": 0.03556236293580797, "sim_compute_robot_state-ego": 0.037581841150919594}}
set_robot_commands_max0.05185818672180176
set_robot_commands_mean0.05102169813088471
set_robot_commands_median0.051219497957537254
set_robot_commands_min0.05012461234783304
sim_compute_performance-ego_max0.03846983432769775
sim_compute_performance-ego_mean0.03629149147957591
sim_compute_performance-ego_median0.035880064142161404
sim_compute_performance-ego_min0.035416463526283824
sim_compute_robot_state-ego_max0.03821379523123464
sim_compute_robot_state-ego_mean0.03762116476476025
sim_compute_robot_state-ego_median0.037581841150919594
sim_compute_robot_state-ego_min0.03711829534391078
sim_compute_sim_state_max0.021321162944886743
sim_compute_sim_state_mean0.02052649509039752
sim_compute_sim_state_median0.02032560348510742
sim_compute_sim_state_min0.02004936668607924
sim_physics_max0.01040480213780557
sim_physics_mean0.0097619049056017
sim_physics_median0.009699821472167969
sim_physics_min0.00920267221404285
sim_render-ego_max0.03369172542325912
sim_render-ego_mean0.032790721077247745
sim_render-ego_median0.03238797187805176
sim_render-ego_min0.03198535574807061
simulation-passed1
survival_time_max3.099999999999997
survival_time_mean2.469999999999999
survival_time_min1.800000000000001
No reset possible
192002944Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessnonutonomy-P50-59960:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07489590860998341
survival_time_median1.6000000000000008
deviation-center-line_median0.03231709551235866
in-drivable-lane_median0.6000000000000005


other stats
agent_compute-ego_max0.10220592468976974
agent_compute-ego_mean0.09786954661210376
agent_compute-ego_median0.09920374870300291
agent_compute-ego_min0.09010647982358932
deviation-center-line_max0.21267530867542692
deviation-center-line_mean0.07690137636055445
deviation-center-line_min0.021851142000941248
deviation-heading_max5.965787888737152
deviation-heading_mean1.829759828299275
deviation-heading_median0.6046788861370507
deviation-heading_min0.5312350914708001
driven_any_max1.4852152040777735
driven_any_mean0.4679517869877016
driven_any_median0.15865366637006345
driven_any_min0.15237055020529242
driven_lanedir_consec_max0.5621843115207449
driven_lanedir_consec_mean0.18065186388127444
driven_lanedir_consec_min0.05447452151894483
driven_lanedir_max0.5621843115207449
driven_lanedir_mean0.18065186388127444
driven_lanedir_median0.07489590860998341
driven_lanedir_min0.05447452151894483
in-drivable-lane_max7.050000000000042
in-drivable-lane_mean2.030000000000008
in-drivable-lane_min0.5000000000000004
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15237055020529242, "sim_physics": 0.009574070572853088, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05447452151894483, "sim_render-ego": 0.03235114365816116, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09010647982358932, "deviation-heading": 0.5458311178772823, "set_robot_commands": 0.0480663999915123, "deviation-center-line": 0.021851142000941248, "driven_lanedir_consec": 0.05447452151894483, "sim_compute_sim_state": 0.0195477232336998, "sim_compute_performance-ego": 0.034237511456012726, "sim_compute_robot_state-ego": 0.03618714213371277}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4852152040777735, "sim_physics": 0.010354023774464923, "survival_time": 14.950000000000076, "driven_lanedir": 0.5621843115207449, "sim_render-ego": 0.03626159429550171, "in-drivable-lane": 7.050000000000042, "agent_compute-ego": 0.0985887654622396, "deviation-heading": 5.965787888737152, "set_robot_commands": 0.05476852814356486, "deviation-center-line": 0.21267530867542692, "driven_lanedir_consec": 0.5621843115207449, "sim_compute_sim_state": 0.02292634884516398, "sim_compute_performance-ego": 0.03923245032628377, "sim_compute_robot_state-ego": 0.040638412634531655}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15865366637006345, "sim_physics": 0.011243373155593872, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07489590860998341, "sim_render-ego": 0.037909671664237976, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.10220592468976974, "deviation-heading": 0.6046788861370507, "set_robot_commands": 0.05756199359893799, "deviation-center-line": 0.03231709551235866, "driven_lanedir_consec": 0.07489590860998341, "sim_compute_sim_state": 0.024386614561080933, "sim_compute_performance-ego": 0.042878732085227966, "sim_compute_robot_state-ego": 0.04317869246006012}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1536453522684555, "sim_physics": 0.010819474856058756, "survival_time": 1.5000000000000009, "driven_lanedir": 0.060421223464425466, "sim_render-ego": 0.03706453641255696, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09924281438191732, "deviation-heading": 0.5312350914708001, "set_robot_commands": 0.0558823029200236, "deviation-center-line": 0.02266354572929106, "driven_lanedir_consec": 0.060421223464425466, "sim_compute_sim_state": 0.025099849700927733, "sim_compute_performance-ego": 0.040572500228881835, "sim_compute_robot_state-ego": 0.04341082572937012}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3898741620169226, "sim_physics": 0.012081696192423502, "survival_time": 3.7499999999999942, "driven_lanedir": 0.15128335429227358, "sim_render-ego": 0.0361565907796224, "in-drivable-lane": 1.4999999999999991, "agent_compute-ego": 0.09920374870300291, "deviation-heading": 1.5012661572740906, "set_robot_commands": 0.056133426030476885, "deviation-center-line": 0.0949997898847544, "driven_lanedir_consec": 0.15128335429227358, "sim_compute_sim_state": 0.02364599863688151, "sim_compute_performance-ego": 0.03999486287434896, "sim_compute_robot_state-ego": 0.04043855667114258}}
set_robot_commands_max0.05756199359893799
set_robot_commands_mean0.05448253013690313
set_robot_commands_median0.0558823029200236
set_robot_commands_min0.0480663999915123
sim_compute_performance-ego_max0.042878732085227966
sim_compute_performance-ego_mean0.03938321139415105
sim_compute_performance-ego_median0.03999486287434896
sim_compute_performance-ego_min0.034237511456012726
sim_compute_robot_state-ego_max0.04341082572937012
sim_compute_robot_state-ego_mean0.040770725925763446
sim_compute_robot_state-ego_median0.040638412634531655
sim_compute_robot_state-ego_min0.03618714213371277
sim_compute_sim_state_max0.025099849700927733
sim_compute_sim_state_mean0.023121306995550792
sim_compute_sim_state_median0.02364599863688151
sim_compute_sim_state_min0.0195477232336998
sim_physics_max0.012081696192423502
sim_physics_mean0.01081452771027883
sim_physics_median0.010819474856058756
sim_physics_min0.009574070572853088
sim_render-ego_max0.037909671664237976
sim_render-ego_mean0.03594870736201604
sim_render-ego_median0.03626159429550171
sim_render-ego_min0.03235114365816116
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.680000000000016
survival_time_min1.5000000000000009
No reset possible
191972791Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationfailednonutonomy-P50-59960:01:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191892856Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornonutonomy-P50-59960:05:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191842956Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationerrornonutonomy-P50-59960:02:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191822944Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornonutonomy-P50-59960:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    make_video1(fn, out_video)
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
    pg('video_aido', dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
    self.log = read_simulator_log_cbor(self.get_config('filename'))
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
    render_time = read_perfomance(ld)
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
    for i, ob in enumerate(read_topic2(ld, 'timing_information')):
  File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
    for ob in ld.objects:
AttributeError: 'str' object has no attribute 'objects'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 173, in main
 >     make_video1(fn, out_video)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 56, in make_video1
 >     pg('video_aido', dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_video.py", line 16, in init
 >     self.log = read_simulator_log_cbor(self.get_config('filename'))
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 179, in read_simulator_log_cbor
 >     render_time = read_perfomance(ld)
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 74, in read_perfomance
 >     for i, ob in enumerate(read_topic2(ld, 'timing_information')):
 >   File "/project/src/aido-protocols/src/aido_schemas/utils_drawing.py", line 49, in read_topic2
 >     for ob in ld.objects:
 > AttributeError: 'str' object has no attribute 'objects'
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191772932Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornonutonomy-P50-59960:03:15
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191732969Andrea Censi 🇨🇭Java templateaido2-AMOD-service_qualitystep1-simulationerroryesnutonomy-P50-59960:02:09
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191622967Andrea Censi 🇨🇭Python templateaido2-AMOD-service_qualitystep1-simulationsuccessyesnutonomy-P50-59960:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
191322295Andrea Censi 🇨🇭Java templateaido2-AMOD-efficiencystep1-simulationerroryesnutonomy-P50-59960:23:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191302961Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationtimeoutnonutonomy-P50-59960:15:38
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191022924Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationsuccessnonutonomy-P50-59960:24:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07004767287047642
survival_time_median1.4500000000000006
deviation-center-line_median0.030334397848747537
in-drivable-lane_median0.4000000000000003


other stats
agent_compute-ego_max0.10635681947072348
agent_compute-ego_mean0.097265049604751
agent_compute-ego_median0.0963364044825236
agent_compute-ego_min0.0900905927022298
deviation-center-line_max0.046952717022297086
deviation-center-line_mean0.03352656593843855
deviation-center-line_min0.02765374677596816
deviation-heading_max0.6769338031564963
deviation-heading_mean0.6137337224382152
deviation-heading_median0.6149695168155582
deviation-heading_min0.5767725746121062
driven_any_max0.1701017389872622
driven_any_mean0.16101633945092214
driven_any_median0.16422294081204988
driven_any_min0.14598514535104784
driven_lanedir_consec_max0.08603569786117404
driven_lanedir_consec_mean0.07255154656317675
driven_lanedir_consec_min0.06261212703755836
driven_lanedir_max0.08603569786117404
driven_lanedir_mean0.07255154656317675
driven_lanedir_median0.07004767287047642
driven_lanedir_min0.06261212703755836
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.3300000000000003
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1597528823399781, "sim_physics": 0.01775157040563123, "survival_time": 1.4500000000000006, "driven_lanedir": 0.06261212703755836, "sim_render-ego": 0.03762016625239931, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.10034947559751312, "deviation-heading": 0.6149695168155582, "set_robot_commands": 0.05287049556600636, "deviation-center-line": 0.030334397848747537, "driven_lanedir_consec": 0.06261212703755836, "sim_compute_sim_state": 0.022100136197846513, "sim_compute_performance-ego": 0.03814129993833344, "sim_compute_robot_state-ego": 0.042066976941865064, "sim_compute_robot_state-npc0": 0.03962472389484274, "sim_compute_robot_state-npc1": 0.03917734376315413, "sim_compute_robot_state-npc2": 0.03818304785366716, "sim_compute_robot_state-npc3": 0.038416081461413155}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1701017389872622, "sim_physics": 0.015724976857503254, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06674511095913482, "sim_render-ego": 0.03434601624806722, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.0900905927022298, "deviation-heading": 0.5812870178084848, "set_robot_commands": 0.04967341423034668, "deviation-center-line": 0.02765374677596816, "driven_lanedir_consec": 0.06674511095913482, "sim_compute_sim_state": 0.02047469615936279, "sim_compute_performance-ego": 0.03532165686289469, "sim_compute_robot_state-ego": 0.03814615408579509, "sim_compute_robot_state-npc0": 0.036362218856811526, "sim_compute_robot_state-npc1": 0.03656073411305746, "sim_compute_robot_state-npc2": 0.03673948446909587, "sim_compute_robot_state-npc3": 0.03602735201517741}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14598514535104784, "sim_physics": 0.01744118332862854, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08603569786117404, "sim_render-ego": 0.03901957472165426, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0963364044825236, "deviation-heading": 0.6769338031564963, "set_robot_commands": 0.05394840240478515, "deviation-center-line": 0.046952717022297086, "driven_lanedir_consec": 0.08603569786117404, "sim_compute_sim_state": 0.02139681577682495, "sim_compute_performance-ego": 0.038855910301208496, "sim_compute_robot_state-ego": 0.03892902533213297, "sim_compute_robot_state-npc0": 0.039001663525899254, "sim_compute_robot_state-npc1": 0.03881628314654032, "sim_compute_robot_state-npc2": 0.0379773477713267, "sim_compute_robot_state-npc3": 0.03814257184664408}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16501898976427257, "sim_physics": 0.017958368573869978, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0773171240875401, "sim_render-ego": 0.03642725944519043, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.09319195577076504, "deviation-heading": 0.6187056997984304, "set_robot_commands": 0.05254218408039638, "deviation-center-line": 0.03449364572444003, "driven_lanedir_consec": 0.0773171240875401, "sim_compute_sim_state": 0.021176397800445557, "sim_compute_performance-ego": 0.0376356840133667, "sim_compute_robot_state-ego": 0.03834559236254011, "sim_compute_robot_state-npc0": 0.038837237017495294, "sim_compute_robot_state-npc1": 0.03831285238265991, "sim_compute_robot_state-npc2": 0.03774690628051758, "sim_compute_robot_state-npc3": 0.04014062029974801}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16422294081204988, "sim_physics": 0.017253971099853514, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07004767287047642, "sim_render-ego": 0.0404848575592041, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.10635681947072348, "deviation-heading": 0.5767725746121062, "set_robot_commands": 0.0556728998819987, "deviation-center-line": 0.028198322320739933, "driven_lanedir_consec": 0.07004767287047642, "sim_compute_sim_state": 0.022224028905232743, "sim_compute_performance-ego": 0.04144589900970459, "sim_compute_robot_state-ego": 0.044162233670552574, "sim_compute_robot_state-npc0": 0.04487682183583577, "sim_compute_robot_state-npc1": 0.04161678949991862, "sim_compute_robot_state-npc2": 0.04173388481140137, "sim_compute_robot_state-npc3": 0.042081451416015624}}
set_robot_commands_max0.0556728998819987
set_robot_commands_mean0.05294147923270666
set_robot_commands_median0.05287049556600636
set_robot_commands_min0.04967341423034668
sim_compute_performance-ego_max0.04144589900970459
sim_compute_performance-ego_mean0.03828009002510159
sim_compute_performance-ego_median0.03814129993833344
sim_compute_performance-ego_min0.03532165686289469
sim_compute_robot_state-ego_max0.044162233670552574
sim_compute_robot_state-ego_mean0.04032999647857717
sim_compute_robot_state-ego_median0.03892902533213297
sim_compute_robot_state-ego_min0.03814615408579509
sim_compute_robot_state-npc0_max0.04487682183583577
sim_compute_robot_state-npc0_mean0.03974053302617692
sim_compute_robot_state-npc0_median0.039001663525899254
sim_compute_robot_state-npc0_min0.036362218856811526
sim_compute_robot_state-npc1_max0.04161678949991862
sim_compute_robot_state-npc1_mean0.038896800581066086
sim_compute_robot_state-npc1_median0.03881628314654032
sim_compute_robot_state-npc1_min0.03656073411305746
sim_compute_robot_state-npc2_max0.04173388481140137
sim_compute_robot_state-npc2_mean0.03847613423720173
sim_compute_robot_state-npc2_median0.0379773477713267
sim_compute_robot_state-npc2_min0.03673948446909587
sim_compute_robot_state-npc3_max0.042081451416015624
sim_compute_robot_state-npc3_mean0.03896161540779966
sim_compute_robot_state-npc3_median0.038416081461413155
sim_compute_robot_state-npc3_min0.03602735201517741
sim_compute_sim_state_max0.022224028905232743
sim_compute_sim_state_mean0.02147441496794251
sim_compute_sim_state_median0.02139681577682495
sim_compute_sim_state_min0.02047469615936279
sim_physics_max0.017958368573869978
sim_physics_mean0.017226014053097306
sim_physics_median0.01744118332862854
sim_physics_min0.015724976857503254
sim_render-ego_max0.0404848575592041
sim_render-ego_mean0.03757957484530307
sim_render-ego_median0.03762016625239931
sim_render-ego_min0.03434601624806722
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.4100000000000006
survival_time_min1.2000000000000004
No reset possible
190822916Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationabortednonutonomy-P50-59960:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190812917Claudio RuchPython templateaido2-AMOD-service_qualitystep1-simulationabortednonutonomy-P50-59960:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190612915Claudio RuchPython templateaido2-AMOD-service_qualitystep1-simulationhost-errornonutonomy-P50-59960:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190512914Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationhost-errornonutonomy-P50-59960:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190342899Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessnonutonomy-P50-59961:15:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2418929089573187
survival_time_median9.299999999999995
deviation-center-line_median0.10704943552335028
in-drivable-lane_median1.6500000000000163


other stats
agent_compute-ego_max0.12163260675245716
agent_compute-ego_mean0.11906385737791653
agent_compute-ego_median0.11874296084171584
agent_compute-ego_min0.11756986315532396
deviation-center-line_max0.14542288319789867
deviation-center-line_mean0.11133371348423388
deviation-center-line_min0.08307536676086187
deviation-heading_max0.7805111534912288
deviation-heading_mean0.6900932733832119
deviation-heading_median0.6868990614459523
deviation-heading_min0.606798091161077
driven_any_max1.5735900990067144
driven_any_mean1.3394880716567072
driven_any_median1.5735900954610336
driven_any_min0.988335032518486
driven_lanedir_consec_max1.333742368216698
driven_lanedir_consec_mean1.0453531247987484
driven_lanedir_consec_min0.6529391307211823
driven_lanedir_max1.333742368216698
driven_lanedir_mean1.0453531247987484
driven_lanedir_median1.2418929089573187
driven_lanedir_min0.6529391307211823
in-drivable-lane_max1.699999999999994
in-drivable-lane_mean1.490000000000008
in-drivable-lane_min1.1999999999999955
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9883350328981308, "sim_physics": 0.011038860353101202, "survival_time": 5.949999999999987, "driven_lanedir": 0.6529391307211823, "sim_render-ego": 0.03625036888763685, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.11778239442520784, "deviation-heading": 0.6868990614459523, "set_robot_commands": 0.05279652611548159, "deviation-center-line": 0.08307536676086187, "driven_lanedir_consec": 0.6529391307211823, "sim_compute_sim_state": 0.022061367996600495, "sim_compute_performance-ego": 0.03797376256029145, "sim_compute_robot_state-ego": 0.03906892127349597}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.988335032518486, "sim_physics": 0.010890111201951484, "survival_time": 5.949999999999987, "driven_lanedir": 0.7558676111531014, "sim_render-ego": 0.03598128847715234, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.11874296084171584, "deviation-heading": 0.606798091161077, "set_robot_commands": 0.0530365134487633, "deviation-center-line": 0.11889949905686747, "driven_lanedir_consec": 0.7558676111531014, "sim_compute_sim_state": 0.02289839552230194, "sim_compute_performance-ego": 0.03717474977509314, "sim_compute_robot_state-ego": 0.039088108960319966}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5735900983991715, "sim_physics": 0.011189555609098043, "survival_time": 9.299999999999995, "driven_lanedir": 1.333742368216698, "sim_render-ego": 0.03654976557659846, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.12163260675245716, "deviation-heading": 0.6117519454660105, "set_robot_commands": 0.05187192783560804, "deviation-center-line": 0.14542288319789867, "driven_lanedir_consec": 1.333742368216698, "sim_compute_sim_state": 0.02344503838528869, "sim_compute_performance-ego": 0.038340941552192934, "sim_compute_robot_state-ego": 0.04023296730492704}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5735900990067144, "sim_physics": 0.010393540064493816, "survival_time": 9.299999999999995, "driven_lanedir": 1.2423236049454416, "sim_render-ego": 0.035595492650103824, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.11756986315532396, "deviation-heading": 0.764506115351791, "set_robot_commands": 0.05170375557355984, "deviation-center-line": 0.10222138288219108, "driven_lanedir_consec": 1.2423236049454416, "sim_compute_sim_state": 0.02135251542573334, "sim_compute_performance-ego": 0.03675757428651215, "sim_compute_robot_state-ego": 0.03808425062446184}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5735900954610336, "sim_physics": 0.01121627515362155, "survival_time": 9.299999999999995, "driven_lanedir": 1.2418929089573187, "sim_render-ego": 0.03572341447235436, "in-drivable-lane": 1.6500000000000163, "agent_compute-ego": 0.11959146171487788, "deviation-heading": 0.7805111534912288, "set_robot_commands": 0.05182093958700857, "deviation-center-line": 0.10704943552335028, "driven_lanedir_consec": 1.2418929089573187, "sim_compute_sim_state": 0.021907770505515477, "sim_compute_performance-ego": 0.036935124346005016, "sim_compute_robot_state-ego": 0.038556678320771906}}
set_robot_commands_max0.0530365134487633
set_robot_commands_mean0.05224593251208427
set_robot_commands_median0.05187192783560804
set_robot_commands_min0.05170375557355984
sim_compute_performance-ego_max0.038340941552192934
sim_compute_performance-ego_mean0.037436430504018944
sim_compute_performance-ego_median0.03717474977509314
sim_compute_performance-ego_min0.03675757428651215
sim_compute_robot_state-ego_max0.04023296730492704
sim_compute_robot_state-ego_mean0.03900618529679535
sim_compute_robot_state-ego_median0.03906892127349597
sim_compute_robot_state-ego_min0.03808425062446184
sim_compute_sim_state_max0.02344503838528869
sim_compute_sim_state_mean0.022333017567087988
sim_compute_sim_state_median0.022061367996600495
sim_compute_sim_state_min0.02135251542573334
sim_physics_max0.01121627515362155
sim_physics_mean0.01094566847645322
sim_physics_median0.011038860353101202
sim_physics_min0.010393540064493816
sim_render-ego_max0.03654976557659846
sim_render-ego_mean0.036020066012769164
sim_render-ego_median0.03598128847715234
sim_render-ego_min0.035595492650103824
simulation-passed1
survival_time_max9.299999999999995
survival_time_mean7.959999999999994
survival_time_min5.949999999999987
No reset possible
190212892Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationhost-errornonutonomy-P50-59960:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190072890Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationhost-errornonutonomy-P50-59960:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189902891Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationhost-errornonutonomy-P50-59960:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189862889Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationhost-errornonutonomy-P50-59960:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189592889Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationabortednonutonomy-P50-59960:00:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189582890Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationabortednonutonomy-P50-59960:00:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189352880Andrea Daniele 🇮🇹minimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationhost-errornonutonomy-P50-59960:23:28
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2880/step1-simulation-nutonomy-P50-5996-job18935/tmp/tmp4bxcuksu/attempts/ETHZ_autolab_technical_track-4-0.attempt4/log.gs2.cbor']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189172374Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LFVI-sim-validationstep1-simulationhost-errornonutonomy-P50-59960:22:08
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2374/step1-simulation-nutonomy-P50-5996-job18917/tmp/tmpgvg4hl0n/attempts/udem1-3-0.attempt3/log.gs2.cbor']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188862413jiang pengBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrornonutonomy-P50-59960:26:30
Waited 1202 seconds [...]
Waited 1202 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188842406Victor Guerra 🇫🇷Baseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessnonutonomy-P50-59960:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.12224955587106212
survival_time_median1.2500000000000004
deviation-center-line_median0.05760623050076716
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09719847679138184
agent_compute-ego_mean0.093736245289827
agent_compute-ego_median0.09552276611328124
agent_compute-ego_min0.08588429597707894
deviation-center-line_max0.061754048690025376
deviation-center-line_mean0.0568426899232576
deviation-center-line_min0.0514696419253078
deviation-heading_max0.757729386796926
deviation-heading_mean0.6576470826609228
deviation-heading_median0.6430509383755971
deviation-heading_min0.5959718687571699
driven_any_max0.18623463470339716
driven_any_mean0.17198856064460613
driven_any_median0.17159410513073126
driven_any_min0.15180888833772674
driven_lanedir_consec_max0.132454359820799
driven_lanedir_consec_mean0.12003647845906072
driven_lanedir_consec_min0.09113830604979832
driven_lanedir_max0.132454359820799
driven_lanedir_mean0.12003647845906072
driven_lanedir_median0.12224955587106212
driven_lanedir_min0.09113830604979832
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.18623463470339716, "sim_physics": 0.018935375213623047, "survival_time": 1.2500000000000004, "driven_lanedir": 0.132454359820799, "sim_render-ego": 0.03527728080749512, "in-drivable-lane": 0, "agent_compute-ego": 0.09552276611328124, "deviation-heading": 0.6298451910844866, "set_robot_commands": 0.05133660316467285, "deviation-center-line": 0.057658785328955034, "driven_lanedir_consec": 0.132454359820799, "sim_compute_sim_state": 0.021519174575805666, "sim_compute_performance-ego": 0.03608680725097656, "sim_compute_robot_state-ego": 0.03831496238708496, "sim_compute_robot_state-npc0": 0.03826730728149414, "sim_compute_robot_state-npc1": 0.03774250030517578, "sim_compute_robot_state-npc2": 0.03698964118957519, "sim_compute_robot_state-npc3": 0.03929795265197754}, "udem1-1-0": {"driven_any": 0.17159410513073126, "sim_physics": 0.018900690078735353, "survival_time": 1.2500000000000004, "driven_lanedir": 0.12205279724277451, "sim_render-ego": 0.03726399421691894, "in-drivable-lane": 0, "agent_compute-ego": 0.09719847679138184, "deviation-heading": 0.6430509383755971, "set_robot_commands": 0.05140463829040527, "deviation-center-line": 0.05572474317123266, "driven_lanedir_consec": 0.12205279724277451, "sim_compute_sim_state": 0.021345157623291016, "sim_compute_performance-ego": 0.035873394012451175, "sim_compute_robot_state-ego": 0.037834577560424805, "sim_compute_robot_state-npc0": 0.03891343116760254, "sim_compute_robot_state-npc1": 0.03723408699035644, "sim_compute_robot_state-npc2": 0.0367805290222168, "sim_compute_robot_state-npc3": 0.03706594467163086}, "udem1-2-0": {"driven_any": 0.17062231594029909, "sim_physics": 0.021464069684346516, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12224955587106212, "sim_render-ego": 0.03784435987472534, "in-drivable-lane": 0, "agent_compute-ego": 0.09572730461756387, "deviation-heading": 0.5959718687571699, "set_robot_commands": 0.05577868223190307, "deviation-center-line": 0.0514696419253078, "driven_lanedir_consec": 0.12224955587106212, "sim_compute_sim_state": 0.02128256360689799, "sim_compute_performance-ego": 0.03728831807772318, "sim_compute_robot_state-ego": 0.03959806760152181, "sim_compute_robot_state-npc0": 0.03901354471842448, "sim_compute_robot_state-npc1": 0.03664242227872213, "sim_compute_robot_state-npc2": 0.03802116711934408, "sim_compute_robot_state-npc3": 0.03824746608734131}, "udem1-3-0": {"driven_any": 0.15180888833772674, "sim_physics": 0.018602542877197262, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09113830604979832, "sim_render-ego": 0.03657878875732422, "in-drivable-lane": 0, "agent_compute-ego": 0.0943483829498291, "deviation-heading": 0.757729386796926, "set_robot_commands": 0.0509986400604248, "deviation-center-line": 0.05760623050076716, "driven_lanedir_consec": 0.09113830604979832, "sim_compute_sim_state": 0.02028943061828613, "sim_compute_performance-ego": 0.03613572120666504, "sim_compute_robot_state-ego": 0.03757975578308106, "sim_compute_robot_state-npc0": 0.03613400459289551, "sim_compute_robot_state-npc1": 0.03709646224975586, "sim_compute_robot_state-npc2": 0.0370468807220459, "sim_compute_robot_state-npc3": 0.03674124717712402}, "udem1-4-0": {"driven_any": 0.1796828591108763, "sim_physics": 0.017795388515178975, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1322873733108696, "sim_render-ego": 0.03370578472430889, "in-drivable-lane": 0, "agent_compute-ego": 0.08588429597707894, "deviation-heading": 0.6616380282904346, "set_robot_commands": 0.04877952428964468, "deviation-center-line": 0.061754048690025376, "driven_lanedir_consec": 0.1322873733108696, "sim_compute_sim_state": 0.020381899980398323, "sim_compute_performance-ego": 0.034511612011836126, "sim_compute_robot_state-ego": 0.03695073494544396, "sim_compute_robot_state-npc0": 0.03592813014984131, "sim_compute_robot_state-npc1": 0.035388561395498425, "sim_compute_robot_state-npc2": 0.03539741039276123, "sim_compute_robot_state-npc3": 0.03605051224048321}}
set_robot_commands_max0.05577868223190307
set_robot_commands_mean0.051659617607410134
set_robot_commands_median0.05133660316467285
set_robot_commands_min0.04877952428964468
sim_compute_performance-ego_max0.03728831807772318
sim_compute_performance-ego_mean0.03597917051193041
sim_compute_performance-ego_median0.03608680725097656
sim_compute_performance-ego_min0.034511612011836126
sim_compute_robot_state-ego_max0.03959806760152181
sim_compute_robot_state-ego_mean0.03805561965551132
sim_compute_robot_state-ego_median0.037834577560424805
sim_compute_robot_state-ego_min0.03695073494544396
sim_compute_robot_state-npc0_max0.03901354471842448
sim_compute_robot_state-npc0_mean0.037651283582051595
sim_compute_robot_state-npc0_median0.03826730728149414
sim_compute_robot_state-npc0_min0.03592813014984131
sim_compute_robot_state-npc1_max0.03774250030517578
sim_compute_robot_state-npc1_mean0.03682080664390173
sim_compute_robot_state-npc1_median0.03709646224975586
sim_compute_robot_state-npc1_min0.035388561395498425
sim_compute_robot_state-npc2_max0.03802116711934408
sim_compute_robot_state-npc2_mean0.036847125689188645
sim_compute_robot_state-npc2_median0.03698964118957519
sim_compute_robot_state-npc2_min0.03539741039276123
sim_compute_robot_state-npc3_max0.03929795265197754
sim_compute_robot_state-npc3_mean0.037480624565711385
sim_compute_robot_state-npc3_median0.03706594467163086
sim_compute_robot_state-npc3_min0.03605051224048321
sim_compute_sim_state_max0.021519174575805666
sim_compute_sim_state_mean0.020963645280935823
sim_compute_sim_state_median0.02128256360689799
sim_compute_sim_state_min0.02028943061828613
sim_physics_max0.021464069684346516
sim_physics_mean0.01913961327381623
sim_physics_median0.018900690078735353
sim_physics_min0.017795388515178975
sim_render-ego_max0.03784435987472534
sim_render-ego_mean0.036134041676154506
sim_render-ego_median0.03657878875732422
sim_render-ego_min0.03370578472430889
simulation-passed1
survival_time_max1.3000000000000005
survival_time_mean1.2500000000000004
survival_time_min1.2000000000000004
No reset possible
188702425Andrea Censi 🇨🇭random_agentaido2-LFVI-sim-validationstep1-simulationsuccessnonutonomy-P50-59960:10:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.07510636367049872
agent_compute-ego_mean0.07344640650234072
agent_compute-ego_median0.073365571006896
agent_compute-ego_min0.07185945144066444
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.02045449756440662, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.03623081010485452, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.073365571006896, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.05231882276989165, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.021134910129365463, "sim_compute_performance-ego": 0.03733918023487878, "sim_compute_robot_state-ego": 0.03940462309216696, "sim_compute_robot_state-npc0": 0.038170072767469615, "sim_compute_robot_state-npc1": 0.03735823479909745, "sim_compute_robot_state-npc2": 0.03715062898302835, "sim_compute_robot_state-npc3": 0.037957895369756786}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.01805775305804084, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.035181316674924364, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.07510636367049872, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.052824483198278094, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.02109492993822285, "sim_compute_performance-ego": 0.036016197765574735, "sim_compute_robot_state-ego": 0.03794458800671147, "sim_compute_robot_state-npc0": 0.037865213319367055, "sim_compute_robot_state-npc1": 0.03746887749316646, "sim_compute_robot_state-npc2": 0.03727430455824908, "sim_compute_robot_state-npc3": 0.03971230282503016}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.02042207794804727, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.03653790489319832, "in-drivable-lane": 0, "agent_compute-ego": 0.07263173211005426, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.05123285708888885, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.02173597581924931, "sim_compute_performance-ego": 0.03670109856513239, "sim_compute_robot_state-ego": 0.03845550937037314, "sim_compute_robot_state-npc0": 0.0372222815790484, "sim_compute_robot_state-npc1": 0.037251264818253055, "sim_compute_robot_state-npc2": 0.03724309705918835, "sim_compute_robot_state-npc3": 0.037715485019068566}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.019862816688862257, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.03681975476285245, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.07426891428359012, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.05159739991451832, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.020762679424691708, "sim_compute_performance-ego": 0.03701595549887799, "sim_compute_robot_state-ego": 0.0390272799958574, "sim_compute_robot_state-npc0": 0.03848805072459769, "sim_compute_robot_state-npc1": 0.0366627130102604, "sim_compute_robot_state-npc2": 0.03673023873187126, "sim_compute_robot_state-npc3": 0.036898265493677015}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.019252396546877347, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.03566682797211867, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.07185945144066444, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.051668763160705566, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02106642723083496, "sim_compute_performance-ego": 0.03722016627971943, "sim_compute_robot_state-ego": 0.0381654455111577, "sim_compute_robot_state-npc0": 0.03695447169817411, "sim_compute_robot_state-npc1": 0.037273443662203275, "sim_compute_robot_state-npc2": 0.0371710337125338, "sim_compute_robot_state-npc3": 0.037859086806957536}}
set_robot_commands_max0.052824483198278094
set_robot_commands_mean0.051928465226456486
set_robot_commands_median0.051668763160705566
set_robot_commands_min0.05123285708888885
sim_compute_performance-ego_max0.03733918023487878
sim_compute_performance-ego_mean0.036858519668836666
sim_compute_performance-ego_median0.03701595549887799
sim_compute_performance-ego_min0.036016197765574735
sim_compute_robot_state-ego_max0.03940462309216696
sim_compute_robot_state-ego_mean0.038599489195253335
sim_compute_robot_state-ego_median0.03845550937037314
sim_compute_robot_state-ego_min0.03794458800671147
sim_compute_robot_state-npc0_max0.03848805072459769
sim_compute_robot_state-npc0_mean0.03774001801773137
sim_compute_robot_state-npc0_median0.037865213319367055
sim_compute_robot_state-npc0_min0.03695447169817411
sim_compute_robot_state-npc1_max0.03746887749316646
sim_compute_robot_state-npc1_mean0.03720290675659613
sim_compute_robot_state-npc1_median0.037273443662203275
sim_compute_robot_state-npc1_min0.0366627130102604
sim_compute_robot_state-npc2_max0.03727430455824908
sim_compute_robot_state-npc2_mean0.03711386060897417
sim_compute_robot_state-npc2_median0.0371710337125338
sim_compute_robot_state-npc2_min0.03673023873187126
sim_compute_robot_state-npc3_max0.03971230282503016
sim_compute_robot_state-npc3_mean0.038028607102898015
sim_compute_robot_state-npc3_median0.037859086806957536
sim_compute_robot_state-npc3_min0.036898265493677015
sim_compute_sim_state_max0.02173597581924931
sim_compute_sim_state_mean0.02115898450847286
sim_compute_sim_state_median0.02109492993822285
sim_compute_sim_state_min0.020762679424691708
sim_physics_max0.02045449756440662
sim_physics_mean0.019609908361246868
sim_physics_median0.019862816688862257
sim_physics_min0.01805775305804084
sim_render-ego_max0.03681975476285245
sim_render-ego_mean0.03608732288158967
sim_render-ego_median0.03623081010485452
sim_render-ego_min0.035181316674924364
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
188512447Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnonutonomy-P50-59960:19:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3614583993086016
survival_time_median14.950000000000076
deviation-center-line_median1.011969887428033
in-drivable-lane_median4.050000000000022


other stats
agent_compute-ego_max0.09250537554423016
agent_compute-ego_mean0.0905490126609802
agent_compute-ego_median0.0922270154953003
agent_compute-ego_min0.08752888758977254
deviation-center-line_max1.0119709059919424
deviation-center-line_mean1.0119700704341597
deviation-center-line_min1.0119697838947566
deviation-heading_max6.81542792438532
deviation-heading_mean6.815427924385318
deviation-heading_median6.815427924385319
deviation-heading_min6.815427924385317
driven_any_max4.390824152784936
driven_any_mean4.390824152784928
driven_any_median4.390824152784926
driven_any_min4.390824152784922
driven_lanedir_consec_max-1.361452200425545
driven_lanedir_consec_mean-1.3614594960339783
driven_lanedir_consec_min-1.3614696049818191
driven_lanedir_max-2.315814608416598
driven_lanedir_mean-2.3158178509092298
driven_lanedir_median-2.3158179462767055
driven_lanedir_min-2.315821760973971
in-drivable-lane_max4.050000000000022
in-drivable-lane_mean4.050000000000022
in-drivable-lane_min4.050000000000022
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.39082415278493, "sim_physics": 0.010088090101877847, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158179462767055, "sim_render-ego": 0.03558029254277547, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09250537554423016, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.05125650803248088, "deviation-center-line": 1.0119698874280334, "driven_lanedir_consec": -1.3614583993086016, "sim_compute_sim_state": 0.02148747126261393, "sim_compute_performance-ego": 0.036949445406595866, "sim_compute_robot_state-ego": 0.038558873335520424}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.390824152784936, "sim_physics": 0.010246293544769289, "survival_time": 14.950000000000076, "driven_lanedir": -2.315820330462275, "sim_render-ego": 0.03559662103652954, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.0922270154953003, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.05174346288045247, "deviation-center-line": 1.0119709059919424, "driven_lanedir_consec": -1.3614650750283808, "sim_compute_sim_state": 0.021791245937347412, "sim_compute_performance-ego": 0.036877106030782064, "sim_compute_robot_state-ego": 0.0385621436436971}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.390824152784926, "sim_physics": 0.009438944657643635, "survival_time": 14.950000000000076, "driven_lanedir": -2.315821760973971, "sim_render-ego": 0.03398953437805176, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.08752888758977254, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.04950023174285888, "deviation-center-line": 1.0119697838947566, "driven_lanedir_consec": -1.3614696049818191, "sim_compute_sim_state": 0.02028483788172404, "sim_compute_performance-ego": 0.035304322242736816, "sim_compute_robot_state-ego": 0.0368076221148173}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.390824152784922, "sim_physics": 0.009778178532918297, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.03469915548960368, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.0879938300450643, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.04913605531056722, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.02071635882059733, "sim_compute_performance-ego": 0.0364619509379069, "sim_compute_robot_state-ego": 0.036914630730946855}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.390824152784922, "sim_physics": 0.01036766211191813, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.035654620329538984, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09248995463053386, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.05094392776489258, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.021879419485727945, "sim_compute_performance-ego": 0.03703623056411743, "sim_compute_robot_state-ego": 0.03852821191151937}}
set_robot_commands_max0.05174346288045247
set_robot_commands_mean0.0505160371462504
set_robot_commands_median0.05094392776489258
set_robot_commands_min0.04913605531056722
sim_compute_performance-ego_max0.03703623056411743
sim_compute_performance-ego_mean0.03652581103642781
sim_compute_performance-ego_median0.036877106030782064
sim_compute_performance-ego_min0.035304322242736816
sim_compute_robot_state-ego_max0.0385621436436971
sim_compute_robot_state-ego_mean0.03787429634730021
sim_compute_robot_state-ego_median0.03852821191151937
sim_compute_robot_state-ego_min0.0368076221148173
sim_compute_sim_state_max0.021879419485727945
sim_compute_sim_state_mean0.021231866677602133
sim_compute_sim_state_median0.02148747126261393
sim_compute_sim_state_min0.02028483788172404
sim_physics_max0.01036766211191813
sim_physics_mean0.00998383378982544
sim_physics_median0.010088090101877847
sim_physics_min0.009438944657643635
sim_render-ego_max0.035654620329538984
sim_render-ego_mean0.035104044755299886
sim_render-ego_median0.03558029254277547
sim_render-ego_min0.03398953437805176
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
188352472Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessnonutonomy-P50-59960:09:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08982572555541993
agent_compute-ego_mean0.08482746751524625
agent_compute-ego_median0.08425596531699686
agent_compute-ego_min0.0817960338159041
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.015613528917420584, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.035133019933160745, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.08210614042462043, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.05049793675260724, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.021112095634892303, "sim_compute_performance-ego": 0.03623396495603166, "sim_compute_robot_state-ego": 0.03832921891842248, "sim_compute_robot_state-npc0": 0.03708871355596578, "sim_compute_robot_state-npc1": 0.0377761148056894, "sim_compute_robot_state-npc2": 0.03755237471382573, "sim_compute_robot_state-npc3": 0.03799036763749033}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.01664888316934759, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.03428946299986406, "in-drivable-lane": 0, "agent_compute-ego": 0.0817960338159041, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.05067455226724798, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.02051711624318903, "sim_compute_performance-ego": 0.035611531951210716, "sim_compute_robot_state-ego": 0.03686380386352539, "sim_compute_robot_state-npc0": 0.03685698184100064, "sim_compute_robot_state-npc1": 0.03714080832221291, "sim_compute_robot_state-npc2": 0.0364447452805259, "sim_compute_robot_state-npc3": 0.03632323308424516}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.01766952938503689, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.037839810053507485, "in-drivable-lane": 0, "agent_compute-ego": 0.08982572555541993, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.05123906135559082, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.021752813127305773, "sim_compute_performance-ego": 0.03914219538370768, "sim_compute_robot_state-ego": 0.04135799407958984, "sim_compute_robot_state-npc0": 0.04322997728983561, "sim_compute_robot_state-npc1": 0.03960488637288411, "sim_compute_robot_state-npc2": 0.039594072765774195, "sim_compute_robot_state-npc3": 0.0399223804473877}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01734564205010732, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.03646095593770345, "in-drivable-lane": 0, "agent_compute-ego": 0.0861534724632899, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.05046445628007253, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.02145334581534068, "sim_compute_performance-ego": 0.03705055514971415, "sim_compute_robot_state-ego": 0.0399295836687088, "sim_compute_robot_state-npc0": 0.038504267732302346, "sim_compute_robot_state-npc1": 0.03786304593086243, "sim_compute_robot_state-npc2": 0.037192369500796, "sim_compute_robot_state-npc3": 0.03708059589068095}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.016707742915433997, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.03548564279780669, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.08425596531699686, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.0499497792300056, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.020483728717355168, "sim_compute_performance-ego": 0.03600956411922679, "sim_compute_robot_state-ego": 0.03765232422772576, "sim_compute_robot_state-npc0": 0.03720181479173548, "sim_compute_robot_state-npc1": 0.03686922788619995, "sim_compute_robot_state-npc2": 0.03683754275826847, "sim_compute_robot_state-npc3": 0.03663322504828958}}
set_robot_commands_max0.05123906135559082
set_robot_commands_mean0.05056515717710484
set_robot_commands_median0.05049793675260724
set_robot_commands_min0.0499497792300056
sim_compute_performance-ego_max0.03914219538370768
sim_compute_performance-ego_mean0.0368095623119782
sim_compute_performance-ego_median0.03623396495603166
sim_compute_performance-ego_min0.035611531951210716
sim_compute_robot_state-ego_max0.04135799407958984
sim_compute_robot_state-ego_mean0.03882658495159445
sim_compute_robot_state-ego_median0.03832921891842248
sim_compute_robot_state-ego_min0.03686380386352539
sim_compute_robot_state-npc0_max0.04322997728983561
sim_compute_robot_state-npc0_mean0.03857635104216797
sim_compute_robot_state-npc0_median0.03720181479173548
sim_compute_robot_state-npc0_min0.03685698184100064
sim_compute_robot_state-npc1_max0.03960488637288411
sim_compute_robot_state-npc1_mean0.03785081666356976
sim_compute_robot_state-npc1_median0.0377761148056894
sim_compute_robot_state-npc1_min0.03686922788619995
sim_compute_robot_state-npc2_max0.039594072765774195
sim_compute_robot_state-npc2_mean0.03752422100383806
sim_compute_robot_state-npc2_median0.037192369500796
sim_compute_robot_state-npc2_min0.0364447452805259
sim_compute_robot_state-npc3_max0.0399223804473877
sim_compute_robot_state-npc3_mean0.03758996042161874
sim_compute_robot_state-npc3_median0.03708059589068095
sim_compute_robot_state-npc3_min0.03632323308424516
sim_compute_sim_state_max0.021752813127305773
sim_compute_sim_state_mean0.02106381990761659
sim_compute_sim_state_median0.021112095634892303
sim_compute_sim_state_min0.020483728717355168
sim_physics_max0.01766952938503689
sim_physics_mean0.016797065287469277
sim_physics_median0.016707742915433997
sim_physics_min0.015613528917420584
sim_render-ego_max0.037839810053507485
sim_render-ego_mean0.035841778344408486
sim_render-ego_median0.03548564279780669
sim_render-ego_min0.03428946299986406
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
188342479Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornonutonomy-P50-59960:00:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188302483Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrornonutonomy-P50-59960:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188272488Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerrornonutonomy-P50-59960:01:08
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
187902542Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerrornonutonomy-P50-59960:08:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible