Evaluator 834

step1-simulation

success

2019-05-07 16:19:19+00:00

2019-05-07 16:19:51+00:00

0:00:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10435167829498936
error_L2	0.017147981784869783

No reset possible

21629

3253

Kuan-Lin Chen 🇹🇼

challenge-aido_LF-template-random

step1-simulation

success

2019-05-07 15:41:34+00:00

2019-05-07 15:44:52+00:00

0:03:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.0940322272385223
agent_compute-ego_mean	0.08871791699119315
agent_compute-ego_median	0.08768418312072754
agent_compute-ego_min	0.08626008033752441
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.05767073013164379, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03528728308501067, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.08813986071833858, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05605174435509576, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0233622877686112, "sim_compute_performance-ego": 0.03938823717611807, "sim_compute_robot_state-ego": 0.04018039615065963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05687154040617101, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.03534978511286717, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08747323354085286, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.05472285607281853, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.023167198779536227, "sim_compute_performance-ego": 0.03894359925213982, "sim_compute_robot_state-ego": 0.04041747018402698}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06370404187370748, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.03546075259937959, "in-drivable-lane": 0, "agent_compute-ego": 0.08626008033752441, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.056154517566456515, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.022808453615973976, "sim_compute_performance-ego": 0.03881556847516228, "sim_compute_robot_state-ego": 0.04117243430193733}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.061636190414428714, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.036128273010253904, "in-drivable-lane": 0, "agent_compute-ego": 0.08768418312072754, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.05535508155822754, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.023191490173339845, "sim_compute_performance-ego": 0.038706274032592775, "sim_compute_robot_state-ego": 0.04006043434143067}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.05187160153932209, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0362542822391172, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.0940322272385223, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.05456826354883894, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.022837032245684275, "sim_compute_performance-ego": 0.038517707510839536, "sim_compute_robot_state-ego": 0.04072007650061499}}
set_robot_commands_max	0.056154517566456515
set_robot_commands_mean	0.05537049262028746
set_robot_commands_median	0.05535508155822754
set_robot_commands_min	0.05456826354883894
sim_compute_performance-ego_max	0.03938823717611807
sim_compute_performance-ego_mean	0.0388742772893705
sim_compute_performance-ego_median	0.03881556847516228
sim_compute_performance-ego_min	0.038517707510839536
sim_compute_robot_state-ego_max	0.04117243430193733
sim_compute_robot_state-ego_mean	0.04051016229573392
sim_compute_robot_state-ego_median	0.04041747018402698
sim_compute_robot_state-ego_min	0.04006043434143067
sim_compute_sim_state_max	0.0233622877686112
sim_compute_sim_state_mean	0.023073292516629103
sim_compute_sim_state_median	0.023167198779536227
sim_compute_sim_state_min	0.022808453615973976
sim_physics_max	0.06370404187370748
sim_physics_mean	0.05835082087305462
sim_physics_median	0.05767073013164379
sim_physics_min	0.05187160153932209
sim_render-ego_max	0.0362542822391172
sim_render-ego_mean	0.0356960752093257
sim_render-ego_median	0.03546075259937959
sim_render-ego_min	0.03528728308501067
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21623

3247

Second test - TH-jp

step1-simulation

success

2019-05-07 15:08:50+00:00

2019-05-07 15:15:12+00:00

0:06:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5527370866629941
survival_time_median	2.4499999999999993
deviation-center-line_median	0.16063413544397648
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.09567649581215598
agent_compute-ego_mean	0.09458286628151058
agent_compute-ego_median	0.09439708262073752
agent_compute-ego_min	0.09385635512215752
deviation-center-line_max	0.30665946748870376
deviation-center-line_mean	0.1988387219605904
deviation-center-line_min	0.14084995535032427
deviation-heading_max	1.441931057256357
deviation-heading_mean	0.8014919920644941
deviation-heading_median	0.7595089794291247
deviation-heading_min	0.28521323733723025
driven_any_max	2.488293614096722
driven_any_mean	1.012896419283159
driven_any_median	0.6116369317919339
driven_any_min	0.29197898295860103
driven_lanedir_consec_max	1.4016662530040982
driven_lanedir_consec_mean	0.7604765957314226
driven_lanedir_consec_min	0.28431123569276995
driven_lanedir_max	1.4016662530040982
driven_lanedir_mean	0.7604765957314226
driven_lanedir_median	0.5527370866629941
driven_lanedir_min	0.28431123569276995
in-drivable-lane_max	8.800000000000091
in-drivable-lane_mean	1.8100000000000176
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5687252900873313, "sim_physics": 0.05587541406804865, "survival_time": 2.7499999999999982, "driven_lanedir": 0.4719763762644802, "sim_render-ego": 0.03602821176702326, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09567649581215598, "deviation-heading": 1.1458552189054214, "set_robot_commands": 0.053330889615145594, "deviation-center-line": 0.24427463361520857, "driven_lanedir_consec": 0.4719763762644802, "sim_compute_sim_state": 0.02281935431740501, "sim_compute_performance-ego": 0.03932062929326838, "sim_compute_robot_state-ego": 0.040724563598632815}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6116369317919339, "sim_physics": 0.055196061426279495, "survival_time": 2.4499999999999993, "driven_lanedir": 0.5527370866629941, "sim_render-ego": 0.035766878906561404, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.09439708262073752, "deviation-heading": 0.7595089794291247, "set_robot_commands": 0.05429375414945641, "deviation-center-line": 0.14084995535032427, "driven_lanedir_consec": 0.5527370866629941, "sim_compute_sim_state": 0.023252093062108875, "sim_compute_performance-ego": 0.03892365280462771, "sim_compute_robot_state-ego": 0.04045824128754285}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.29197898295860103, "sim_physics": 0.05634334427969796, "survival_time": 1.7500000000000009, "driven_lanedir": 0.28431123569276995, "sim_render-ego": 0.03574361801147461, "in-drivable-lane": 0, "agent_compute-ego": 0.09385635512215752, "deviation-heading": 0.3749514673943365, "set_robot_commands": 0.05368524960109166, "deviation-center-line": 0.16063413544397648, "driven_lanedir_consec": 0.28431123569276995, "sim_compute_sim_state": 0.024009411675589423, "sim_compute_performance-ego": 0.03893356323242188, "sim_compute_robot_state-ego": 0.04084413392203195}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.488293614096722, "sim_physics": 0.054815052350362145, "survival_time": 14.950000000000076, "driven_lanedir": 1.4016662530040982, "sim_render-ego": 0.03552471319834391, "in-drivable-lane": 8.800000000000091, "agent_compute-ego": 0.0943675176302592, "deviation-heading": 1.441931057256357, "set_robot_commands": 0.05430801788965861, "deviation-center-line": 0.30665946748870376, "driven_lanedir_consec": 1.4016662530040982, "sim_compute_sim_state": 0.023123352527618407, "sim_compute_performance-ego": 0.03891439994176229, "sim_compute_robot_state-ego": 0.04061306556065877}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1038472774812078, "sim_physics": 0.05673908214179837, "survival_time": 2.4499999999999993, "driven_lanedir": 1.0916920270327704, "sim_render-ego": 0.03542485529062699, "in-drivable-lane": 0, "agent_compute-ego": 0.09461688022224272, "deviation-heading": 0.28521323733723025, "set_robot_commands": 0.05337586208265655, "deviation-center-line": 0.1417754179047389, "driven_lanedir_consec": 1.0916920270327704, "sim_compute_sim_state": 0.023129151791942363, "sim_compute_performance-ego": 0.04219431293253996, "sim_compute_robot_state-ego": 0.040432521275111606}}
set_robot_commands_max	0.05430801788965861
set_robot_commands_mean	0.05379875466760177
set_robot_commands_median	0.05368524960109166
set_robot_commands_min	0.053330889615145594
sim_compute_performance-ego_max	0.04219431293253996
sim_compute_performance-ego_mean	0.03965731164092405
sim_compute_performance-ego_median	0.03893356323242188
sim_compute_performance-ego_min	0.03891439994176229
sim_compute_robot_state-ego_max	0.04084413392203195
sim_compute_robot_state-ego_mean	0.040614505128795594
sim_compute_robot_state-ego_median	0.04061306556065877
sim_compute_robot_state-ego_min	0.040432521275111606
sim_compute_sim_state_max	0.024009411675589423
sim_compute_sim_state_mean	0.023266672674932813
sim_compute_sim_state_median	0.023129151791942363
sim_compute_sim_state_min	0.02281935431740501
sim_physics_max	0.05673908214179837
sim_physics_mean	0.05579379085323733
sim_physics_median	0.05587541406804865
sim_physics_min	0.054815052350362145
sim_render-ego_max	0.03602821176702326
sim_render-ego_mean	0.03569765543480603
sim_render-ego_median	0.03574361801147461
sim_render-ego_min	0.03542485529062699
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.870000000000015
survival_time_min	1.7500000000000009

No reset possible

21622

3246

Brian Chuang

PredictorLast

step1-simulation

success

2019-05-07 15:03:14+00:00

2019-05-07 15:03:46+00:00

0:00:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.0949578965721301
error_L2	0.014077136407283088

No reset possible

21619

3243

Allen Ou

PredictorLast

step1-simulation

success

2019-05-07 14:36:34+00:00

2019-05-07 14:37:00+00:00

0:00:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11125243748552652
error_L2	0.021094026289575893

No reset possible

21613

3238

Second test - TH

step1-simulation

error

2019-05-07 13:26:39+00:00

2019-05-07 13:27:57+00:00

0:01:18

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21609

3235

RL - TH -hhk

step1-simulation

success

2019-05-07 11:26:55+00:00

2019-05-07 11:34:06+00:00

0:07:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8807469106240912
survival_time_median	3.5499999999999954
deviation-center-line_median	0.16143019760804342
in-drivable-lane_median	0.849999999999997

other stats

agent_compute-ego_max	0.15532912897027057
agent_compute-ego_mean	0.15326520460067455
agent_compute-ego_median	0.1534865243094308
agent_compute-ego_min	0.15073101967573166
deviation-center-line_max	1.0268575598510117
deviation-center-line_mean	0.3650648694131201
deviation-center-line_min	0.09570598191615429
deviation-heading_max	1.436441334698878
deviation-heading_mean	0.9089961298247072
deviation-heading_median	0.7270997708068463
deviation-heading_min	0.35331993268927764
driven_any_max	2.2225161235280604
driven_any_mean	1.2366640204736412
driven_any_median	1.0621558506978923
driven_any_min	0.1597138252547615
driven_lanedir_consec_max	2.1865217336484104
driven_lanedir_consec_mean	1.020975588756802
driven_lanedir_consec_min	0.10561965692190078
driven_lanedir_max	2.1865217336484104
driven_lanedir_mean	1.020975588756802
driven_lanedir_median	0.8807469106240912
driven_lanedir_min	0.10561965692190078
in-drivable-lane_max	6.850000000000097
in-drivable-lane_mean	1.960000000000018
in-drivable-lane_min	0.05000000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0621558506978923, "sim_physics": 0.0542161934812304, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6709275401057364, "sim_render-ego": 0.03596202420516753, "in-drivable-lane": 1.9499999999999944, "agent_compute-ego": 0.1537874416566231, "deviation-heading": 0.35331993268927764, "set_robot_commands": 0.05413449650079432, "deviation-center-line": 0.09570598191615429, "driven_lanedir_consec": 0.6709275401057364, "sim_compute_sim_state": 0.023620988281679824, "sim_compute_performance-ego": 0.038992445233842016, "sim_compute_robot_state-ego": 0.04724705051368391}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0086576130836835, "sim_physics": 0.054999740227409034, "survival_time": 2.3, "driven_lanedir": 0.8807469106240912, "sim_render-ego": 0.03495312255361806, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.15532912897027057, "deviation-heading": 0.7270997708068463, "set_robot_commands": 0.05319258959397026, "deviation-center-line": 0.16143019760804342, "driven_lanedir_consec": 0.8807469106240912, "sim_compute_sim_state": 0.02429540779279626, "sim_compute_performance-ego": 0.03849455066349195, "sim_compute_robot_state-ego": 0.041395140730816384}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1597138252547615, "sim_physics": 0.056554123759269714, "survival_time": 1.6000000000000008, "driven_lanedir": 0.10561965692190078, "sim_render-ego": 0.035972848534584045, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15073101967573166, "deviation-heading": 0.6664392750636854, "set_robot_commands": 0.05466277152299881, "deviation-center-line": 0.1085321560038385, "driven_lanedir_consec": 0.10561965692190078, "sim_compute_sim_state": 0.02318694442510605, "sim_compute_performance-ego": 0.03839609771966934, "sim_compute_robot_state-ego": 0.04118051379919052}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7302766898038076, "sim_physics": 0.05549470654555729, "survival_time": 5.599999999999988, "driven_lanedir": 1.2610621024838706, "sim_render-ego": 0.03615817853382656, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1534865243094308, "deviation-heading": 1.3616803358648495, "set_robot_commands": 0.05451514039720808, "deviation-center-line": 0.43279845168655257, "driven_lanedir_consec": 1.2610621024838706, "sim_compute_sim_state": 0.023626423307827545, "sim_compute_performance-ego": 0.03875094013554709, "sim_compute_robot_state-ego": 0.04154608505112784}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2225161235280604, "sim_physics": 0.05470123529434204, "survival_time": 14.950000000000076, "driven_lanedir": 2.1865217336484104, "sim_render-ego": 0.036123228073120114, "in-drivable-lane": 6.850000000000097, "agent_compute-ego": 0.15299190839131674, "deviation-heading": 1.436441334698878, "set_robot_commands": 0.05507001638412476, "deviation-center-line": 1.0268575598510117, "driven_lanedir_consec": 2.1865217336484104, "sim_compute_sim_state": 0.023993604183197025, "sim_compute_performance-ego": 0.03872184673945109, "sim_compute_robot_state-ego": 0.041577631632486976}}
set_robot_commands_max	0.05507001638412476
set_robot_commands_mean	0.05431500287981925
set_robot_commands_median	0.05451514039720808
set_robot_commands_min	0.05319258959397026
sim_compute_performance-ego_max	0.038992445233842016
sim_compute_performance-ego_mean	0.038671176098400296
sim_compute_performance-ego_median	0.03872184673945109
sim_compute_performance-ego_min	0.03839609771966934
sim_compute_robot_state-ego_max	0.04724705051368391
sim_compute_robot_state-ego_mean	0.04258928434546112
sim_compute_robot_state-ego_median	0.04154608505112784
sim_compute_robot_state-ego_min	0.04118051379919052
sim_compute_sim_state_max	0.02429540779279626
sim_compute_sim_state_mean	0.02374467359812134
sim_compute_sim_state_median	0.023626423307827545
sim_compute_sim_state_min	0.02318694442510605
sim_physics_max	0.056554123759269714
sim_physics_mean	0.0551931998615617
sim_physics_median	0.054999740227409034
sim_physics_min	0.0542161934812304
sim_render-ego_max	0.03615817853382656
sim_render-ego_mean	0.035833880380063264
sim_render-ego_median	0.035972848534584045
sim_render-ego_min	0.03495312255361806
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	5.600000000000012
survival_time_min	1.6000000000000008

No reset possible

21507

3196

Anastasiya Nikolskaya 🇷🇺

NN Solution

step1-simulation

success

2019-05-05 16:00:53+00:00

2019-05-05 16:15:08+00:00

0:14:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.8322303804942328
survival_time_median	9.700000000000005
deviation-center-line_median	0.7534946499835609
in-drivable-lane_median	1.2500000000000178

other stats

agent_compute-ego_max	0.08726166879664586
agent_compute-ego_mean	0.08404981548760858
agent_compute-ego_median	0.08452038341098361
agent_compute-ego_min	0.08007557018130433
deviation-center-line_max	0.9506038159016046
deviation-center-line_mean	0.7246731803610028
deviation-center-line_min	0.3086424034990746
deviation-heading_max	2.3086673692909083
deviation-heading_mean	1.773363237120514
deviation-heading_median	1.943346880961207
deviation-heading_min	1.145094596605766
driven_any_max	2.5863362987175056
driven_any_mean	2.0207000421534085
driven_any_median	2.083720485770157
driven_any_min	1.0657495142190132
driven_lanedir_consec_max	2.198815499388125
driven_lanedir_consec_mean	1.6796819045548628
driven_lanedir_consec_min	0.7779862153035733
driven_lanedir_max	2.198815499388125
driven_lanedir_mean	1.6796819045548628
driven_lanedir_median	1.8322303804942328
driven_lanedir_min	0.7779862153035733
in-drivable-lane_max	2.0999999999999925
in-drivable-lane_mean	1.1800000000000057
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.083720485770157, "sim_physics": 0.095175198672973, "survival_time": 9.700000000000005, "driven_lanedir": 1.6510203435350952, "sim_render-ego": 0.050062295087834, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.08183975072251153, "deviation-heading": 1.943346880961207, "set_robot_commands": 0.07480560258491752, "deviation-center-line": 0.7534946499835609, "driven_lanedir_consec": 1.6510203435350952, "sim_compute_sim_state": 0.03230831795132037, "sim_compute_performance-ego": 0.05852400027599532, "sim_compute_robot_state-ego": 0.06433626302738779}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0657495142190132, "sim_physics": 0.0911865561616187, "survival_time": 5.09999999999999, "driven_lanedir": 0.7779862153035733, "sim_render-ego": 0.051471583983477426, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.08007557018130433, "deviation-heading": 1.145094596605766, "set_robot_commands": 0.07504485868940167, "deviation-center-line": 0.3086424034990746, "driven_lanedir_consec": 0.7779862153035733, "sim_compute_sim_state": 0.036648617071263934, "sim_compute_performance-ego": 0.05601854417838302, "sim_compute_robot_state-ego": 0.06183966702105952}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.441018221409874, "sim_physics": 0.08876379330952962, "survival_time": 11.250000000000025, "driven_lanedir": 1.938357084053288, "sim_render-ego": 0.05464309586418999, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.08452038341098361, "deviation-heading": 1.1920148987344952, "set_robot_commands": 0.07439723544650607, "deviation-center-line": 0.9020453270777132, "driven_lanedir_consec": 1.938357084053288, "sim_compute_sim_state": 0.03249017185635037, "sim_compute_performance-ego": 0.0580414973364936, "sim_compute_robot_state-ego": 0.06003765636020236}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9266756906504947, "sim_physics": 0.0987411850657543, "survival_time": 8.949999999999992, "driven_lanedir": 1.8322303804942328, "sim_render-ego": 0.05140530064119307, "in-drivable-lane": 0, "agent_compute-ego": 0.08726166879664586, "deviation-heading": 2.3086673692909083, "set_robot_commands": 0.0830147546096887, "deviation-center-line": 0.7085797053430605, "driven_lanedir_consec": 1.8322303804942328, "sim_compute_sim_state": 0.03576105666560168, "sim_compute_performance-ego": 0.058458229682964984, "sim_compute_robot_state-ego": 0.06049225450228046}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.5863362987175056, "sim_physics": 0.09577406153959386, "survival_time": 11.900000000000034, "driven_lanedir": 2.198815499388125, "sim_render-ego": 0.05244443196208537, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.08655170432659758, "deviation-heading": 2.277692440010193, "set_robot_commands": 0.08146412031991142, "deviation-center-line": 0.9506038159016046, "driven_lanedir_consec": 2.198815499388125, "sim_compute_sim_state": 0.03400153272292193, "sim_compute_performance-ego": 0.05816166140452152, "sim_compute_robot_state-ego": 0.06136418591026498}}
set_robot_commands_max	0.0830147546096887
set_robot_commands_mean	0.07774531433008507
set_robot_commands_median	0.07504485868940167
set_robot_commands_min	0.07439723544650607
sim_compute_performance-ego_max	0.05852400027599532
sim_compute_performance-ego_mean	0.05784078657567169
sim_compute_performance-ego_median	0.05816166140452152
sim_compute_performance-ego_min	0.05601854417838302
sim_compute_robot_state-ego_max	0.06433626302738779
sim_compute_robot_state-ego_mean	0.06161400536423902
sim_compute_robot_state-ego_median	0.06136418591026498
sim_compute_robot_state-ego_min	0.06003765636020236
sim_compute_sim_state_max	0.036648617071263934
sim_compute_sim_state_mean	0.03424193925349166
sim_compute_sim_state_median	0.03400153272292193
sim_compute_sim_state_min	0.03230831795132037
sim_physics_max	0.0987411850657543
sim_physics_mean	0.0939281589498939
sim_physics_median	0.095175198672973
sim_physics_min	0.08876379330952962
sim_render-ego_max	0.05464309586418999
sim_render-ego_mean	0.05200534150775597
sim_render-ego_median	0.051471583983477426
sim_render-ego_min	0.050062295087834
simulation-passed	1
survival_time_max	11.900000000000034
survival_time_mean	9.38000000000001
survival_time_min	5.09999999999999

No reset possible

21498

3190

Anastasiya Nikolskaya 🇷🇺

NN Solution

step1-simulation

host-error

2019-05-05 13:54:20+00:00

2019-05-05 14:00:05+00:00

0:05:45

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3190/step1-simulation-ip-172-31-40-253-32059-job21498/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21495

3187

Anastasiya Nikolskaya 🇷🇺

Classic Solution

step1-simulation

success

2019-05-05 13:26:28+00:00

2019-05-05 13:35:44+00:00

0:09:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.8965999532197373
survival_time_median	9.299999999999995
deviation-center-line_median	0.8383231952217333
in-drivable-lane_median	1.2499999999999956

other stats

agent_compute-ego_max	0.07912231763203939
agent_compute-ego_mean	0.07540136485602092
agent_compute-ego_median	0.07651844973205238
agent_compute-ego_min	0.07115656924697589
deviation-center-line_max	1.2394539891481682
deviation-center-line_mean	0.80522077570548
deviation-center-line_min	0.3177049508696179
deviation-heading_max	3.5466687756833704
deviation-heading_mean	1.8709761403506264
deviation-heading_median	1.484160389764047
deviation-heading_min	0.8758353115579818
driven_any_max	3.206755524413042
driven_any_mean	2.055147345887195
driven_any_median	1.9736139343997303
driven_any_min	1.0931151827386156
driven_lanedir_consec_max	2.669926502554219
driven_lanedir_consec_mean	1.7643492506065226
driven_lanedir_consec_min	0.7624171072235606
driven_lanedir_max	2.669926502554219
driven_lanedir_mean	1.7643492506065226
driven_lanedir_median	1.8965999532197373
driven_lanedir_min	0.7624171072235606
in-drivable-lane_max	1.9999999999999964
in-drivable-lane_mean	0.9900000000000032
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.206755524413042, "sim_physics": 0.05884271462758382, "survival_time": 14.950000000000076, "driven_lanedir": 2.669926502554219, "sim_render-ego": 0.037134251594543456, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.07912231763203939, "deviation-heading": 3.5466687756833704, "set_robot_commands": 0.05601184765497843, "deviation-center-line": 1.2394539891481682, "driven_lanedir_consec": 2.669926502554219, "sim_compute_sim_state": 0.02397321939468384, "sim_compute_performance-ego": 0.04002931197484334, "sim_compute_robot_state-ego": 0.04195600907007853}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0931151827386156, "sim_physics": 0.05948052541264947, "survival_time": 5.299999999999989, "driven_lanedir": 0.7624171072235606, "sim_render-ego": 0.036610879988040565, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.07115656924697589, "deviation-heading": 1.1851556754723027, "set_robot_commands": 0.05575626301315595, "deviation-center-line": 0.3177049508696179, "driven_lanedir_consec": 0.7624171072235606, "sim_compute_sim_state": 0.0242596594792492, "sim_compute_performance-ego": 0.0420164612104308, "sim_compute_robot_state-ego": 0.04226469768668121}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.028657590941464, "sim_physics": 0.05654198336975737, "survival_time": 9.55, "driven_lanedir": 1.5658440428151674, "sim_render-ego": 0.0362318336027455, "in-drivable-lane": 1.9999999999999964, "agent_compute-ego": 0.07290985946255829, "deviation-heading": 0.8758353115579818, "set_robot_commands": 0.05655212676962008, "deviation-center-line": 0.8383231952217333, "driven_lanedir_consec": 1.5658440428151674, "sim_compute_sim_state": 0.023817742682252258, "sim_compute_performance-ego": 0.03996246397807336, "sim_compute_robot_state-ego": 0.041987641319554514}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9735944969431225, "sim_physics": 0.06014317081820581, "survival_time": 9.299999999999995, "driven_lanedir": 1.8965999532197373, "sim_render-ego": 0.03660336489318519, "in-drivable-lane": 0, "agent_compute-ego": 0.07651844973205238, "deviation-heading": 2.263060549275431, "set_robot_commands": 0.05533636257212649, "deviation-center-line": 0.7892801546196877, "driven_lanedir_consec": 1.8965999532197373, "sim_compute_sim_state": 0.023878070615953016, "sim_compute_performance-ego": 0.04019910161213208, "sim_compute_robot_state-ego": 0.04156426075966128}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9736139343997303, "sim_physics": 0.05977417576697565, "survival_time": 9.299999999999995, "driven_lanedir": 1.9269586472199276, "sim_render-ego": 0.036699184807397985, "in-drivable-lane": 0, "agent_compute-ego": 0.07729962820647865, "deviation-heading": 1.484160389764047, "set_robot_commands": 0.0560271393868231, "deviation-center-line": 0.8413415886681932, "driven_lanedir_consec": 1.9269586472199276, "sim_compute_sim_state": 0.024368727079001805, "sim_compute_performance-ego": 0.04014266562718217, "sim_compute_robot_state-ego": 0.04195926138149795}}
set_robot_commands_max	0.05655212676962008
set_robot_commands_mean	0.05593674787934081
set_robot_commands_median	0.05601184765497843
set_robot_commands_min	0.05533636257212649
sim_compute_performance-ego_max	0.0420164612104308
sim_compute_performance-ego_mean	0.040470000880532354
sim_compute_performance-ego_median	0.04014266562718217
sim_compute_performance-ego_min	0.03996246397807336
sim_compute_robot_state-ego_max	0.04226469768668121
sim_compute_robot_state-ego_mean	0.041946374043494696
sim_compute_robot_state-ego_median	0.04195926138149795
sim_compute_robot_state-ego_min	0.04156426075966128
sim_compute_sim_state_max	0.024368727079001805
sim_compute_sim_state_mean	0.02405948385022802
sim_compute_sim_state_median	0.02397321939468384
sim_compute_sim_state_min	0.023817742682252258
sim_physics_max	0.06014317081820581
sim_physics_mean	0.05895651399903442
sim_physics_median	0.05948052541264947
sim_physics_min	0.05654198336975737
sim_render-ego_max	0.037134251594543456
sim_render-ego_mean	0.03665590297718254
sim_render-ego_median	0.036610879988040565
sim_render-ego_min	0.0362318336027455
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.680000000000012
survival_time_min	5.299999999999989

No reset possible

21493

3185

First test - TH

step1-simulation

success

2019-05-05 12:04:58+00:00

2019-05-05 12:42:20+00:00

0:37:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.990389522110715
survival_time_median	14.950000000000076
deviation-center-line_median	0.9405398066426456
in-drivable-lane_median	1.099999999999996

other stats

agent_compute-ego_max	0.0992563279469808
agent_compute-ego_mean	0.09783130979863253
agent_compute-ego_median	0.09767284393310546
agent_compute-ego_min	0.09682004753200488
deviation-center-line_max	1.6574932607752566
deviation-center-line_mean	0.9373414280482896
deviation-center-line_min	0.19328033386292504
deviation-heading_max	7.6385527665621
deviation-heading_mean	3.3446940667425804
deviation-heading_median	3.164335707846229
deviation-heading_min	1.344040257493335
driven_any_max	5.078022663171658
driven_any_mean	3.4608534639134514
driven_any_median	3.736302639835513
driven_any_min	0.6629566035311828
driven_lanedir_consec_max	4.697864239012609
driven_lanedir_consec_mean	3.0027266927510916
driven_lanedir_consec_min	0.612696530965488
driven_lanedir_max	4.697864239012609
driven_lanedir_mean	3.0027266927510916
driven_lanedir_median	2.990389522110715
driven_lanedir_min	0.612696530965488
in-drivable-lane_max	11.45000000000008
in-drivable-lane_mean	1.7433333333333474
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.736302639835513, "sim_physics": 0.055940248171488446, "survival_time": 14.950000000000076, "driven_lanedir": 2.601145575126397, "sim_render-ego": 0.03573174317677816, "in-drivable-lane": 3.5500000000000504, "agent_compute-ego": 0.0992563279469808, "deviation-heading": 3.79831152578459, "set_robot_commands": 0.05485122760136922, "deviation-center-line": 0.8227369200397089, "driven_lanedir_consec": 2.601145575126397, "sim_compute_sim_state": 0.02289502541224162, "sim_compute_performance-ego": 0.03865820248921712, "sim_compute_robot_state-ego": 0.04010756810506185}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.765387025029655, "sim_physics": 0.0552750555674235, "survival_time": 14.950000000000076, "driven_lanedir": 4.697864239012609, "sim_render-ego": 0.035450797080993655, "in-drivable-lane": 0, "agent_compute-ego": 0.09762889941533406, "deviation-heading": 2.6838739446171496, "set_robot_commands": 0.05482599258422852, "deviation-center-line": 0.9920854193125148, "driven_lanedir_consec": 4.697864239012609, "sim_compute_sim_state": 0.023074817657470704, "sim_compute_performance-ego": 0.03871893088022868, "sim_compute_robot_state-ego": 0.04032618840535482}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.0276966854952776, "sim_physics": 0.05733724196751912, "survival_time": 14.950000000000076, "driven_lanedir": 2.990389522110715, "sim_render-ego": 0.0354609489440918, "in-drivable-lane": 0, "agent_compute-ego": 0.09811352888743084, "deviation-heading": 7.6385527665621, "set_robot_commands": 0.05532190402348836, "deviation-center-line": 0.5891027925484689, "driven_lanedir_consec": 2.990389522110715, "sim_compute_sim_state": 0.02301861842473348, "sim_compute_performance-ego": 0.03898294766743978, "sim_compute_robot_state-ego": 0.04001628796259562}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.3814947046512533, "sim_physics": 0.057345736821492514, "survival_time": 14.950000000000076, "driven_lanedir": 2.9673168985538467, "sim_render-ego": 0.035514151255289714, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.09767284393310546, "deviation-heading": 3.164335707846229, "set_robot_commands": 0.054379009405771894, "deviation-center-line": 1.1211381636379094, "driven_lanedir_consec": 2.9673168985538467, "sim_compute_sim_state": 0.02313105185826619, "sim_compute_performance-ego": 0.03873833100001017, "sim_compute_robot_state-ego": 0.03996975898742676}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.566064193565126, "sim_physics": 0.056137280464172365, "survival_time": 14.950000000000076, "driven_lanedir": 2.900115520653637, "sim_render-ego": 0.03541225512822469, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.09788723707199096, "deviation-heading": 4.338767279307345, "set_robot_commands": 0.0544177508354187, "deviation-center-line": 1.4955366700410315, "driven_lanedir_consec": 2.900115520653637, "sim_compute_sim_state": 0.02320566177368164, "sim_compute_performance-ego": 0.03931485811869304, "sim_compute_robot_state-ego": 0.04023608366648356}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.196827299280056, "sim_physics": 0.05700418949127197, "survival_time": 14.950000000000076, "driven_lanedir": 4.127823536400436, "sim_render-ego": 0.03501964489618937, "in-drivable-lane": 0, "agent_compute-ego": 0.09757946809132892, "deviation-heading": 2.403905029166348, "set_robot_commands": 0.054539048671722413, "deviation-center-line": 0.9405398066426456, "driven_lanedir_consec": 4.127823536400436, "sim_compute_sim_state": 0.02293727795283, "sim_compute_performance-ego": 0.03930735270182291, "sim_compute_robot_state-ego": 0.04025157372156779}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 3.1747717422323993, "sim_physics": 0.05484736442565918, "survival_time": 14.950000000000076, "driven_lanedir": 2.6445828196674572, "sim_render-ego": 0.0357199215888977, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.09867528597513836, "deviation-heading": 3.308931936319176, "set_robot_commands": 0.05431255420049032, "deviation-center-line": 1.2253757651944774, "driven_lanedir_consec": 2.6445828196674572, "sim_compute_sim_state": 0.02417227665583293, "sim_compute_performance-ego": 0.0387045152982076, "sim_compute_robot_state-ego": 0.04019165277481079}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.835536486798138, "sim_physics": 0.05797610521316528, "survival_time": 14.950000000000076, "driven_lanedir": 3.1224645588984923, "sim_render-ego": 0.03559828519821167, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.09890862782796224, "deviation-heading": 3.1754652101318412, "set_robot_commands": 0.054232279459635414, "deviation-center-line": 1.057242913392258, "driven_lanedir_consec": 3.1224645588984923, "sim_compute_sim_state": 0.022881742318471274, "sim_compute_performance-ego": 0.03859342098236084, "sim_compute_robot_state-ego": 0.04001446803410848}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 3.88717691361744, "sim_physics": 0.05519164364512374, "survival_time": 10.25000000000001, "driven_lanedir": 3.205597605766165, "sim_render-ego": 0.03526196945004347, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.09777214468979252, "deviation-heading": 1.9278788222112104, "set_robot_commands": 0.054484850022850966, "deviation-center-line": 0.9040686151715076, "driven_lanedir_consec": 3.205597605766165, "sim_compute_sim_state": 0.023081973703896128, "sim_compute_performance-ego": 0.038572639372290635, "sim_compute_robot_state-ego": 0.040013143492908014}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 5.003004940073928, "sim_physics": 0.054647397994995114, "survival_time": 14.950000000000076, "driven_lanedir": 4.208188596379348, "sim_render-ego": 0.03556475321451823, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.09763949791590372, "deviation-heading": 4.276998473204973, "set_robot_commands": 0.05525036891301473, "deviation-center-line": 1.6574932607752566, "driven_lanedir_consec": 4.208188596379348, "sim_compute_sim_state": 0.022943954467773437, "sim_compute_performance-ego": 0.03896088202794393, "sim_compute_robot_state-ego": 0.04037039836247762}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.6778955188528746, "sim_physics": 0.055769379138946536, "survival_time": 14.950000000000076, "driven_lanedir": 1.6496568821631283, "sim_render-ego": 0.035096271832784014, "in-drivable-lane": 0, "agent_compute-ego": 0.09761483907699584, "deviation-heading": 4.069436649870897, "set_robot_commands": 0.05444226106007894, "deviation-center-line": 1.3296627282059827, "driven_lanedir_consec": 1.6496568821631283, "sim_compute_sim_state": 0.02305970827738444, "sim_compute_performance-ego": 0.038731394608815514, "sim_compute_robot_state-ego": 0.04091125011444092}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.6629566035311828, "sim_physics": 0.05449416081110636, "survival_time": 14.950000000000076, "driven_lanedir": 0.612696530965488, "sim_render-ego": 0.03550829569498698, "in-drivable-lane": 11.45000000000008, "agent_compute-ego": 0.0976908270517985, "deviation-heading": 2.7948336661999167, "set_robot_commands": 0.055043831666310626, "deviation-center-line": 0.19328033386292504, "driven_lanedir_consec": 0.612696530965488, "sim_compute_sim_state": 0.02290362199147542, "sim_compute_performance-ego": 0.03892400582631429, "sim_compute_robot_state-ego": 0.04022025108337402}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.1983233790377097, "sim_physics": 0.0551815224790025, "survival_time": 4.3499999999999925, "driven_lanedir": 1.0250634660423457, "sim_render-ego": 0.03542497788352528, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.09682004753200488, "deviation-heading": 1.344040257493335, "set_robot_commands": 0.05430723058766332, "deviation-center-line": 0.28144003627261205, "driven_lanedir_consec": 1.0250634660423457, "sim_compute_sim_state": 0.022644193693139088, "sim_compute_performance-ego": 0.03859566820078883, "sim_compute_robot_state-ego": 0.03978259261997267}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 5.078022663171658, "sim_physics": 0.053225257396698, "survival_time": 14.950000000000076, "driven_lanedir": 4.265349961309197, "sim_render-ego": 0.0357985520362854, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.09719099680582682, "deviation-heading": 2.2363250288897984, "set_robot_commands": 0.05426157077153524, "deviation-center-line": 0.6436659029396562, "driven_lanedir_consec": 4.265349961309197, "sim_compute_sim_state": 0.023088879585266113, "sim_compute_performance-ego": 0.03866525808970134, "sim_compute_robot_state-ego": 0.04058606227238973}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.721341163529561, "sim_physics": 0.05554468552271525, "survival_time": 14.950000000000076, "driven_lanedir": 4.022644678217116, "sim_render-ego": 0.035405147870381674, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.09701907475789388, "deviation-heading": 3.008754703533799, "set_robot_commands": 0.05384408235549927, "deviation-center-line": 0.8067520926873919, "driven_lanedir_consec": 4.022644678217116, "sim_compute_sim_state": 0.02329242785771688, "sim_compute_performance-ego": 0.03839303811391195, "sim_compute_robot_state-ego": 0.04014523347218831}}
set_robot_commands_max	0.05532190402348836
set_robot_commands_mean	0.05456759747727187
set_robot_commands_median	0.05444226106007894
set_robot_commands_min	0.05384408235549927
sim_compute_performance-ego_max	0.03931485811869304
sim_compute_performance-ego_mean	0.038790763025183105
sim_compute_performance-ego_median	0.03871893088022868
sim_compute_performance-ego_min	0.03839303811391195
sim_compute_robot_state-ego_max	0.04091125011444092
sim_compute_robot_state-ego_mean	0.0402095008716774
sim_compute_robot_state-ego_median	0.04019165277481079
sim_compute_robot_state-ego_min	0.03978259261997267
sim_compute_sim_state_max	0.02417227665583293
sim_compute_sim_state_mean	0.02308874877534529
sim_compute_sim_state_median	0.02305970827738444
sim_compute_sim_state_min	0.022644193693139088
sim_physics_max	0.05797610521316528
sim_physics_mean	0.05572781794071866
sim_physics_median	0.05554468552271525
sim_physics_min	0.053225257396698
sim_render-ego_max	0.0357985520362854
sim_render-ego_mean	0.03546451435008012
sim_render-ego_median	0.0354609489440918
sim_render-ego_min	0.03501964489618937
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.930000000000064
survival_time_min	4.3499999999999925

No reset possible

21490

3183

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-05-05 10:57:50+00:00

2019-05-05 11:00:04+00:00

0:02:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3183/step1-simulation-ip-172-31-40-253-32059-job21490/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21489

3182

First test - TH

step1-simulation

error

2019-05-05 09:04:57+00:00

2019-05-05 09:06:28+00:00

0:01:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21487

3182

First test - TH

step1-simulation

aborted

2019-05-05 08:56:56+00:00

2019-05-05 08:58:09+00:00

0:01:13

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21486

3181

Pokai Chang

PredictorLast

step1-simulation

success

2019-05-04 14:38:22+00:00

2019-05-04 14:38:48+00:00

0:00:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11483190347179056
error_L2	0.0197893756274818

No reset possible

21457

3157

PredictorLast

step1-simulation

success

2019-05-01 16:33:51+00:00

2019-05-01 16:34:18+00:00

0:00:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11979750405128854
error_L2	0.022148961265489087

No reset possible

21448

3151

Eric Lu

PredictorLast

step1-simulation

success

2019-05-01 15:04:49+00:00

2019-05-01 15:05:17+00:00

0:00:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10384757563707316
error_L2	0.01679298265232991

No reset possible

21437

3138

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-30 15:14:55+00:00

2019-04-30 15:19:05+00:00

0:04:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.12528394250308766
agent_compute-ego_mean	0.11648881488481395
agent_compute-ego_median	0.11816168133216567
agent_compute-ego_min	0.1085386509988822
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.08261749921021638, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04756355727160418, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11933523637277108, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.07296145845342565, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.029506034321255155, "sim_compute_performance-ego": 0.05371732181972928, "sim_compute_robot_state-ego": 0.05508720874786377}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.08689051048428405, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.04354013181200214, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1085386509988822, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.06640836771796732, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.028243256550209195, "sim_compute_performance-ego": 0.04897059646307254, "sim_compute_robot_state-ego": 0.04983851488898782}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.0893253017874325, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.054906340206370634, "in-drivable-lane": 0, "agent_compute-ego": 0.12528394250308766, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07332814441007726, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03150599143084358, "sim_compute_performance-ego": 0.05983309184803682, "sim_compute_robot_state-ego": 0.06321629355935489}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.08465819358825684, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.04581248283386231, "in-drivable-lane": 0, "agent_compute-ego": 0.11112456321716307, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.07150868415832519, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.030298166275024414, "sim_compute_performance-ego": 0.05135384559631348, "sim_compute_robot_state-ego": 0.053002872467041016}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.07796986797187902, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.04549035844923575, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.11816168133216567, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.07070869735524624, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.030107458935508244, "sim_compute_performance-ego": 0.05008900618251366, "sim_compute_robot_state-ego": 0.0541110310373427}}
set_robot_commands_max	0.07332814441007726
set_robot_commands_mean	0.07098307041900834
set_robot_commands_median	0.07150868415832519
set_robot_commands_min	0.06640836771796732
sim_compute_performance-ego_max	0.05983309184803682
sim_compute_performance-ego_mean	0.05279277238193316
sim_compute_performance-ego_median	0.05135384559631348
sim_compute_performance-ego_min	0.04897059646307254
sim_compute_robot_state-ego_max	0.06321629355935489
sim_compute_robot_state-ego_mean	0.05505118414011804
sim_compute_robot_state-ego_median	0.0541110310373427
sim_compute_robot_state-ego_min	0.04983851488898782
sim_compute_sim_state_max	0.03150599143084358
sim_compute_sim_state_mean	0.02993218150256812
sim_compute_sim_state_median	0.030107458935508244
sim_compute_sim_state_min	0.028243256550209195
sim_physics_max	0.0893253017874325
sim_physics_mean	0.08429227460841375
sim_physics_median	0.08465819358825684
sim_physics_min	0.07796986797187902
sim_render-ego_max	0.054906340206370634
sim_render-ego_mean	0.047462574114615005
sim_render-ego_median	0.04581248283386231
sim_render-ego_min	0.04354013181200214
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21406

3114

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 20:54:28+00:00

2019-04-28 21:00:08+00:00

0:05:40

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3114/step1-simulation-ip-172-31-40-253-32059-job21406/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21405

3113

Angel Woo 🇭🇰

HKU Duckietown Project

step1-simulation

success

2019-04-28 09:17:24+00:00

2019-04-28 09:26:14+00:00

0:08:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4831480006826556
survival_time_median	7.099999999999983
deviation-center-line_median	0.23636634784812272
in-drivable-lane_median	0.10000000000000007

other stats

agent_compute-ego_max	0.12123943540386688
agent_compute-ego_mean	0.12092254646094772
agent_compute-ego_median	0.12093389951265776
agent_compute-ego_min	0.12041853214132377
deviation-center-line_max	0.5919957933216299
deviation-center-line_mean	0.28785219166055187
deviation-center-line_min	0.11767394810388106
deviation-heading_max	2.36280691377292
deviation-heading_mean	1.3124423317490508
deviation-heading_median	0.9988366368731446
deviation-heading_min	0.5016157808412776
driven_any_max	1.7341242296019226
driven_any_mean	0.9842483965064852
driven_any_median	1.0146282192991596
driven_any_min	0.20644911563066232
driven_lanedir_consec_max	1.6675276514854096
driven_lanedir_consec_mean	0.6417917044904458
driven_lanedir_consec_min	0.17739031427171437
driven_lanedir_max	1.6675276514854096
driven_lanedir_mean	0.64290985921855
driven_lanedir_median	0.4831480006826556
driven_lanedir_min	0.17739031427171437
in-drivable-lane_max	7.900000000000038
in-drivable-lane_mean	1.820000000000007
in-drivable-lane_min	0.05000000000000071
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0146282192991596, "sim_physics": 0.0527275649594589, "survival_time": 7.099999999999983, "driven_lanedir": 0.6852677884725593, "sim_render-ego": 0.03567949483092402, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.12112309227527028, "deviation-heading": 1.8775073627697971, "set_robot_commands": 0.05426233755031102, "deviation-center-line": 0.3475658055728009, "driven_lanedir_consec": 0.6796770148320381, "sim_compute_sim_state": 0.022893778035338496, "sim_compute_performance-ego": 0.03890642481790462, "sim_compute_robot_state-ego": 0.04073270609681035}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7341242296019226, "sim_physics": 0.05600839181053907, "survival_time": 13.300000000000054, "driven_lanedir": 1.6675276514854096, "sim_render-ego": 0.035340415804009685, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.12123943540386688, "deviation-heading": 2.36280691377292, "set_robot_commands": 0.05506834768711176, "deviation-center-line": 0.5919957933216299, "driven_lanedir_consec": 1.6675276514854096, "sim_compute_sim_state": 0.022995008561844214, "sim_compute_performance-ego": 0.038252833194302435, "sim_compute_robot_state-ego": 0.04034424545173358}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.20644911563066232, "sim_physics": 0.05705253009138436, "survival_time": 1.4500000000000006, "driven_lanedir": 0.17739031427171437, "sim_render-ego": 0.034283029622045054, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12041853214132377, "deviation-heading": 0.5016157808412776, "set_robot_commands": 0.054924455182305695, "deviation-center-line": 0.14565906345632457, "driven_lanedir_consec": 0.17739031427171437, "sim_compute_sim_state": 0.022672192803744613, "sim_compute_performance-ego": 0.03783997996100064, "sim_compute_robot_state-ego": 0.03987064032719053}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2713723319002937, "sim_physics": 0.057373835490300104, "survival_time": 1.950000000000001, "driven_lanedir": 0.20121554118041107, "sim_render-ego": 0.034987003375322394, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12093389951265776, "deviation-heading": 0.9988366368731446, "set_robot_commands": 0.05410871138939491, "deviation-center-line": 0.11767394810388106, "driven_lanedir_consec": 0.20121554118041107, "sim_compute_sim_state": 0.022610065264579576, "sim_compute_performance-ego": 0.03812421285189115, "sim_compute_robot_state-ego": 0.03988498907822829}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6946680861003869, "sim_physics": 0.054692300837090674, "survival_time": 11.750000000000032, "driven_lanedir": 0.4831480006826556, "sim_render-ego": 0.03485312766217171, "in-drivable-lane": 7.900000000000038, "agent_compute-ego": 0.12089777297161997, "deviation-heading": 0.8214449644881152, "set_robot_commands": 0.05491344675104669, "deviation-center-line": 0.23636634784812272, "driven_lanedir_consec": 0.4831480006826556, "sim_compute_sim_state": 0.022832437271767474, "sim_compute_performance-ego": 0.03825632054755028, "sim_compute_robot_state-ego": 0.04026537042983035}}
set_robot_commands_max	0.05506834768711176
set_robot_commands_mean	0.05465545971203402
set_robot_commands_median	0.05491344675104669
set_robot_commands_min	0.05410871138939491
sim_compute_performance-ego_max	0.03890642481790462
sim_compute_performance-ego_mean	0.03827595427452982
sim_compute_performance-ego_median	0.038252833194302435
sim_compute_performance-ego_min	0.03783997996100064
sim_compute_robot_state-ego_max	0.04073270609681035
sim_compute_robot_state-ego_mean	0.04021959027675862
sim_compute_robot_state-ego_median	0.04026537042983035
sim_compute_robot_state-ego_min	0.03987064032719053
sim_compute_sim_state_max	0.022995008561844214
sim_compute_sim_state_mean	0.022800696387454876
sim_compute_sim_state_median	0.022832437271767474
sim_compute_sim_state_min	0.022610065264579576
sim_physics_max	0.057373835490300104
sim_physics_mean	0.055570924637754614
sim_physics_median	0.05600839181053907
sim_physics_min	0.0527275649594589
sim_render-ego_max	0.03567949483092402
sim_render-ego_mean	0.03502861425889457
sim_render-ego_median	0.034987003375322394
sim_render-ego_min	0.034283029622045054
simulation-passed	1
survival_time_max	13.300000000000054
survival_time_mean	7.110000000000014
survival_time_min	1.4500000000000006

No reset possible

21396

2448

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-28 04:00:16+00:00

2019-04-28 04:59:31+00:00

0:59:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.355676207214709
survival_time_median	14.950000000000076
deviation-center-line_median	1.002134440312669
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.09489816109339395
agent_compute-ego_mean	0.09405984380510118
agent_compute-ego_median	0.0939664896329244
agent_compute-ego_min	0.09295018513997395
deviation-center-line_max	1.5296442653166566
deviation-center-line_mean	0.8536767524476552
deviation-center-line_min	0.2656525762859935
deviation-heading_max	8.682256325592228
deviation-heading_mean	6.927230740477735
deviation-heading_median	7.090641611385013
deviation-heading_min	5.52174661383955
driven_any_max	4.378506444052824
driven_any_mean	4.378506444052809
driven_any_median	4.378506444052808
driven_any_min	4.378506444052796
driven_lanedir_consec_max	-1.2728379671211965
driven_lanedir_consec_mean	-1.352643582087815
driven_lanedir_consec_min	-1.388190292394527
driven_lanedir_max	-1.3477913186786226
driven_lanedir_mean	-2.005867861365606
driven_lanedir_median	-2.260637650975249
driven_lanedir_min	-2.7253255736285684
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	4.9200000000000275
in-drivable-lane_min	2.100000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.08854095220565796, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.03587556521097819, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.09489816109339395, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.05426461378733317, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.022648061911265057, "sim_compute_performance-ego": 0.038431835174560544, "sim_compute_robot_state-ego": 0.04042193730672201, "sim_compute_robot_state-npc0": 0.04003801743189494, "sim_compute_robot_state-npc1": 0.03924909353256226, "sim_compute_robot_state-npc2": 0.03936473608016968, "sim_compute_robot_state-npc3": 0.038867408434549965}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.08303554137547811, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.03560276826222738, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.09473807493845622, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.05384434143702189, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.022374978065490724, "sim_compute_performance-ego": 0.0384363595644633, "sim_compute_robot_state-ego": 0.04052872737248739, "sim_compute_robot_state-npc0": 0.0399392565091451, "sim_compute_robot_state-npc1": 0.0393153969446818, "sim_compute_robot_state-npc2": 0.03878043095270792, "sim_compute_robot_state-npc3": 0.03931828737258911}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.09031747102737428, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.035471670627593994, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.09482081572214762, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.05387348175048828, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.023216888904571537, "sim_compute_performance-ego": 0.03835935672124227, "sim_compute_robot_state-ego": 0.040446492036183675, "sim_compute_robot_state-npc0": 0.040111605326334634, "sim_compute_robot_state-npc1": 0.039188202222188315, "sim_compute_robot_state-npc2": 0.039002914428710934, "sim_compute_robot_state-npc3": 0.03898273547490438}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.0911534301439921, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.035694526831309, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.09461497942606607, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.05418299357096354, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.022549343903859456, "sim_compute_performance-ego": 0.03814227263132731, "sim_compute_robot_state-ego": 0.04056249459584554, "sim_compute_robot_state-npc0": 0.04122268199920654, "sim_compute_robot_state-npc1": 0.03931381622950236, "sim_compute_robot_state-npc2": 0.03900323152542114, "sim_compute_robot_state-npc3": 0.039095072746276854}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.0897898268699646, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.03583827257156372, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.09469953219095864, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.05486999988555908, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.02257910013198853, "sim_compute_performance-ego": 0.03840741316477458, "sim_compute_robot_state-ego": 0.0402664836247762, "sim_compute_robot_state-npc0": 0.04010037342707316, "sim_compute_robot_state-npc1": 0.039308177630106605, "sim_compute_robot_state-npc2": 0.03916305383046468, "sim_compute_robot_state-npc3": 0.038840881188710534}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.378506444052811, "sim_physics": 0.08929883400599162, "survival_time": 14.950000000000076, "driven_lanedir": -2.608509993180694, "sim_render-ego": 0.035545061429341634, "in-drivable-lane": 2.5500000000000136, "agent_compute-ego": 0.09425200223922728, "deviation-heading": 8.07296329712472, "set_robot_commands": 0.05327834606170654, "deviation-center-line": 1.3867682469030311, "driven_lanedir_consec": -1.388190292394527, "sim_compute_sim_state": 0.022413969834645588, "sim_compute_performance-ego": 0.038011070092519125, "sim_compute_robot_state-ego": 0.040204339027404785, "sim_compute_robot_state-npc0": 0.03995322148005168, "sim_compute_robot_state-npc1": 0.03914058685302734, "sim_compute_robot_state-npc2": 0.0388774577776591, "sim_compute_robot_state-npc3": 0.03883879899978638}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.378506444052805, "sim_physics": 0.09085626363754272, "survival_time": 14.950000000000076, "driven_lanedir": -1.355676207214709, "sim_render-ego": 0.03615245739618937, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.09384165366490682, "deviation-heading": 5.863437531793397, "set_robot_commands": 0.05295120795567831, "deviation-center-line": 0.2923561535172491, "driven_lanedir_consec": -1.355676207214709, "sim_compute_sim_state": 0.022246553897857665, "sim_compute_performance-ego": 0.03792102813720703, "sim_compute_robot_state-ego": 0.04030630906422933, "sim_compute_robot_state-npc0": 0.039528448581695554, "sim_compute_robot_state-npc1": 0.03879883925120036, "sim_compute_robot_state-npc2": 0.03867014408111572, "sim_compute_robot_state-npc3": 0.03871488650639852}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.378506444052796, "sim_physics": 0.08695897261301676, "survival_time": 14.950000000000076, "driven_lanedir": -1.377653082196022, "sim_render-ego": 0.03471480369567871, "in-drivable-lane": 7.30000000000004, "agent_compute-ego": 0.09295018513997395, "deviation-heading": 5.826000672384985, "set_robot_commands": 0.05367092212041219, "deviation-center-line": 0.28890677730047676, "driven_lanedir_consec": -1.377653082196022, "sim_compute_sim_state": 0.02225499947865804, "sim_compute_performance-ego": 0.03760708729426066, "sim_compute_robot_state-ego": 0.03991724967956543, "sim_compute_robot_state-npc0": 0.03931689182917277, "sim_compute_robot_state-npc1": 0.03880667527516683, "sim_compute_robot_state-npc2": 0.03833771546681722, "sim_compute_robot_state-npc3": 0.03831230719884237}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.378506444052807, "sim_physics": 0.08479010581970214, "survival_time": 14.950000000000076, "driven_lanedir": -2.4543552110962836, "sim_render-ego": 0.03471284945805868, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.09349403301874797, "deviation-heading": 7.285030095349859, "set_robot_commands": 0.05450079838434855, "deviation-center-line": 1.16426495230065, "driven_lanedir_consec": -1.3837301815284158, "sim_compute_sim_state": 0.022005930741628012, "sim_compute_performance-ego": 0.03909250418345134, "sim_compute_robot_state-ego": 0.03974979162216186, "sim_compute_robot_state-npc0": 0.03905471881230672, "sim_compute_robot_state-npc1": 0.03850174347559611, "sim_compute_robot_state-npc2": 0.038276919523874915, "sim_compute_robot_state-npc3": 0.0383782164255778}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.378506444052819, "sim_physics": 0.08873210509618124, "survival_time": 14.950000000000076, "driven_lanedir": -2.59861542380514, "sim_render-ego": 0.03490599473317464, "in-drivable-lane": 2.250000000000013, "agent_compute-ego": 0.09341635147730508, "deviation-heading": 8.682256325592228, "set_robot_commands": 0.05481043179829915, "deviation-center-line": 1.4641409944409558, "driven_lanedir_consec": -1.339457603752913, "sim_compute_sim_state": 0.022793031533559164, "sim_compute_performance-ego": 0.03791799545288086, "sim_compute_robot_state-ego": 0.03950987418492635, "sim_compute_robot_state-npc0": 0.03938077608744303, "sim_compute_robot_state-npc1": 0.0384559162457784, "sim_compute_robot_state-npc2": 0.03842135032018026, "sim_compute_robot_state-npc3": 0.03835755666097005}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.378506444052819, "sim_physics": 0.08641610542933147, "survival_time": 14.950000000000076, "driven_lanedir": -2.487619304575852, "sim_render-ego": 0.034993224143981934, "in-drivable-lane": 3.150000000000018, "agent_compute-ego": 0.09362130641937257, "deviation-heading": 7.680289782334559, "set_robot_commands": 0.05297561566034953, "deviation-center-line": 1.2605671921446628, "driven_lanedir_consec": -1.333456085292506, "sim_compute_sim_state": 0.02289315382639567, "sim_compute_performance-ego": 0.03764378150304159, "sim_compute_robot_state-ego": 0.039637742837270104, "sim_compute_robot_state-npc0": 0.03935856660207113, "sim_compute_robot_state-npc1": 0.038527985413869224, "sim_compute_robot_state-npc2": 0.03823441425959269, "sim_compute_robot_state-npc3": 0.03808521509170532}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.378506444052808, "sim_physics": 0.08440748532613118, "survival_time": 14.950000000000076, "driven_lanedir": -1.3477913186786226, "sim_render-ego": 0.035069211324055986, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.0939664896329244, "deviation-heading": 5.52174661383955, "set_robot_commands": 0.05336087942123413, "deviation-center-line": 0.26627156834437943, "driven_lanedir_consec": -1.3477913186786226, "sim_compute_sim_state": 0.02208404858907064, "sim_compute_performance-ego": 0.03777676661809286, "sim_compute_robot_state-ego": 0.039623875617980954, "sim_compute_robot_state-npc0": 0.03939697027206421, "sim_compute_robot_state-npc1": 0.038616925080617266, "sim_compute_robot_state-npc2": 0.03845056931177775, "sim_compute_robot_state-npc3": 0.03830084880193074}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.378506444052802, "sim_physics": 0.0865621821085612, "survival_time": 14.950000000000076, "driven_lanedir": -2.7253255736285684, "sim_render-ego": 0.035091980298360186, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.0944596282641093, "deviation-heading": 8.383960965716458, "set_robot_commands": 0.05318013350168864, "deviation-center-line": 1.5198553376845148, "driven_lanedir_consec": -1.3654612749893655, "sim_compute_sim_state": 0.02203558603922526, "sim_compute_performance-ego": 0.03779962619145711, "sim_compute_robot_state-ego": 0.039545681476593014, "sim_compute_robot_state-npc0": 0.039385409355163575, "sim_compute_robot_state-npc1": 0.03861682891845703, "sim_compute_robot_state-npc2": 0.03848274787267049, "sim_compute_robot_state-npc3": 0.03843799511591593}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.378506444052804, "sim_physics": 0.08760401805241903, "survival_time": 14.950000000000076, "driven_lanedir": -1.3543489995592757, "sim_render-ego": 0.034941739241282146, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.0933458415667216, "deviation-heading": 5.531556420749436, "set_robot_commands": 0.05518441915512085, "deviation-center-line": 0.2656525762859935, "driven_lanedir_consec": -1.3543489995592757, "sim_compute_sim_state": 0.022012420495351157, "sim_compute_performance-ego": 0.039773658116658527, "sim_compute_robot_state-ego": 0.03977667252222697, "sim_compute_robot_state-npc0": 0.03927494287490845, "sim_compute_robot_state-npc1": 0.03862939755121867, "sim_compute_robot_state-npc2": 0.03848309199015299, "sim_compute_robot_state-npc3": 0.0385049041112264}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.378506444052808, "sim_physics": 0.08681473334630331, "survival_time": 14.950000000000076, "driven_lanedir": -1.3871236758121115, "sim_render-ego": 0.03548430681228638, "in-drivable-lane": 7.450000000000041, "agent_compute-ego": 0.09377860228220622, "deviation-heading": 5.569918191698341, "set_robot_commands": 0.05316182931264241, "deviation-center-line": 0.26950853351829485, "driven_lanedir_consec": -1.3871236758121115, "sim_compute_sim_state": 0.022476905186971027, "sim_compute_performance-ego": 0.03816387414932251, "sim_compute_robot_state-ego": 0.03978900909423829, "sim_compute_robot_state-npc0": 0.04043991883595784, "sim_compute_robot_state-npc1": 0.03927997509638469, "sim_compute_robot_state-npc2": 0.03883786837259928, "sim_compute_robot_state-npc3": 0.03899841626485189}}
set_robot_commands_max	0.05518441915512085
set_robot_commands_mean	0.05387400092018976
set_robot_commands_median	0.05384434143702189
set_robot_commands_min	0.05295120795567831
sim_compute_performance-ego_max	0.039773658116658527
sim_compute_performance-ego_mean	0.038232308599683976
sim_compute_performance-ego_median	0.03814227263132731
sim_compute_performance-ego_min	0.03760708729426066
sim_compute_robot_state-ego_max	0.04056249459584554
sim_compute_robot_state-ego_mean	0.040019112004174136
sim_compute_robot_state-ego_median	0.03991724967956543
sim_compute_robot_state-ego_min	0.03950987418492635
sim_compute_robot_state-npc0_max	0.04122268199920654
sim_compute_robot_state-npc0_mean	0.039766786628299286
sim_compute_robot_state-npc0_median	0.039528448581695554
sim_compute_robot_state-npc0_min	0.03905471881230672
sim_compute_robot_state-npc1_max	0.0393153969446818
sim_compute_robot_state-npc1_mean	0.038916637314690486
sim_compute_robot_state-npc1_median	0.03880667527516683
sim_compute_robot_state-npc1_min	0.0384559162457784
sim_compute_robot_state-npc2_max	0.03936473608016968
sim_compute_robot_state-npc2_mean	0.03869244305292765
sim_compute_robot_state-npc2_median	0.03867014408111572
sim_compute_robot_state-npc2_min	0.03823441425959269
sim_compute_robot_state-npc3_max	0.03931828737258911
sim_compute_robot_state-npc3_mean	0.03866890202628242
sim_compute_robot_state-npc3_median	0.03871488650639852
sim_compute_robot_state-npc3_min	0.03808521509170532
sim_compute_sim_state_max	0.023216888904571537
sim_compute_sim_state_mean	0.022438998169369173
sim_compute_sim_state_median	0.022413969834645588
sim_compute_sim_state_min	0.022005930741628012
sim_physics_max	0.0911534301439921
sim_physics_mean	0.08768520180384319
sim_physics_median	0.08760401805241903
sim_physics_min	0.08303554137547811
sim_render-ego_max	0.03615245739618937
sim_render-ego_mean	0.035339628802405466
sim_render-ego_median	0.035471670627593994
sim_render-ego_min	0.03471284945805868
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21391

2410

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 03:00:26+00:00

2019-04-28 04:00:07+00:00

0:59:41

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2410/step1-simulation-ip-172-31-40-253-32059-job21391/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21379

2412

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 02:00:19+00:00

2019-04-28 03:00:09+00:00

0:59:50

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2412/step1-simulation-ip-172-31-40-253-32059-job21379/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21376

2363

Andrea Censi 🇨🇭

random_agent

step1-simulation

host-error

2019-04-28 01:57:04+00:00

2019-04-28 02:00:11+00:00

0:03:07

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2363/step1-simulation-ip-172-31-40-253-32059-job21376/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21371

2385

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-28 01:22:13+00:00

2019-04-28 01:56:25+00:00

0:34:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08338264651478688
survival_time_median	1.5000000000000009
deviation-center-line_median	0.09155707420079402
in-drivable-lane_median	0.5500000000000005

other stats

agent_compute-ego_max	0.19429549243715075
agent_compute-ego_mean	0.17173930127228995
agent_compute-ego_median	0.1708355824152629
agent_compute-ego_min	0.15942185858021612
deviation-center-line_max	0.618960797260178
deviation-center-line_mean	0.1579889386389403
deviation-center-line_min	0.016053265735621682
deviation-heading_max	5.86098707862487
deviation-heading_mean	1.751545745263282
deviation-heading_median	0.7074217175359803
deviation-heading_min	0.56274691338397
driven_any_max	1.871893783764572
driven_any_mean	0.5077265223515959
driven_any_median	0.14305502895477315
driven_any_min	0.10703600647109508
driven_lanedir_consec_max	0.57675631088116
driven_lanedir_consec_mean	0.16852319448941555
driven_lanedir_consec_min	0.021920612924160476
driven_lanedir_max	0.57675631088116
driven_lanedir_mean	0.16852319448941555
driven_lanedir_median	0.08338264651478688
driven_lanedir_min	0.021920612924160476
in-drivable-lane_max	8.850000000000058
in-drivable-lane_mean	1.9166666666666723
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9032813995079014, "sim_physics": 0.1673587608981777, "survival_time": 7.399999999999982, "driven_lanedir": 0.2932724769991011, "sim_render-ego": 0.0587282293551677, "in-drivable-lane": 3.449999999999992, "agent_compute-ego": 0.16494103380151698, "deviation-heading": 2.84780278341426, "set_robot_commands": 0.09404389117215133, "deviation-center-line": 0.1586611726466252, "driven_lanedir_consec": 0.2932724769991011, "sim_compute_sim_state": 0.038058835106926994, "sim_compute_performance-ego": 0.0670464506020417, "sim_compute_robot_state-ego": 0.07182692998164408, "sim_compute_robot_state-npc0": 0.06631970083391345, "sim_compute_robot_state-npc1": 0.06543645182171383, "sim_compute_robot_state-npc2": 0.06645770491780462, "sim_compute_robot_state-npc3": 0.06750938215771236}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.871893783764572, "sim_physics": 0.16274463653564453, "survival_time": 14.950000000000076, "driven_lanedir": 0.4454840976102905, "sim_render-ego": 0.06071863333384196, "in-drivable-lane": 8.850000000000058, "agent_compute-ego": 0.1647105058034261, "deviation-heading": 5.059079017302088, "set_robot_commands": 0.09098892211914064, "deviation-center-line": 0.618960797260178, "driven_lanedir_consec": 0.4454840976102905, "sim_compute_sim_state": 0.03853383143742879, "sim_compute_performance-ego": 0.06723709583282471, "sim_compute_robot_state-ego": 0.07039738734563192, "sim_compute_robot_state-npc0": 0.06681338787078857, "sim_compute_robot_state-npc1": 0.06770326932271321, "sim_compute_robot_state-npc2": 0.06752472639083862, "sim_compute_robot_state-npc3": 0.06759923378626506}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.116447385875375, "sim_physics": 0.21494433154230533, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08338264651478688, "sim_render-ego": 0.06521199060522992, "in-drivable-lane": 0, "agent_compute-ego": 0.178806792134824, "deviation-heading": 0.56274691338397, "set_robot_commands": 0.0973475394041642, "deviation-center-line": 0.10027052713324054, "driven_lanedir_consec": 0.08338264651478688, "sim_compute_sim_state": 0.04247954617375913, "sim_compute_performance-ego": 0.06941443940867549, "sim_compute_robot_state-ego": 0.0788863638172979, "sim_compute_robot_state-npc0": 0.06894430906876274, "sim_compute_robot_state-npc1": 0.0677979510763417, "sim_compute_robot_state-npc2": 0.06806181824725607, "sim_compute_robot_state-npc3": 0.07185178217680557}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1140143641964681, "sim_physics": 0.20650861574255905, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07452938156109479, "sim_render-ego": 0.06161206701527471, "in-drivable-lane": 0, "agent_compute-ego": 0.185753231463225, "deviation-heading": 0.6076794929491733, "set_robot_commands": 0.09259780593540358, "deviation-center-line": 0.09592377286875348, "driven_lanedir_consec": 0.07452938156109479, "sim_compute_sim_state": 0.03990676092064899, "sim_compute_performance-ego": 0.06948925101238748, "sim_compute_robot_state-ego": 0.06818543309750764, "sim_compute_robot_state-npc0": 0.06897788462431534, "sim_compute_robot_state-npc1": 0.0700468809708305, "sim_compute_robot_state-npc2": 0.07165330389271611, "sim_compute_robot_state-npc3": 0.07105395068293033}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.12928562565604762, "sim_physics": 0.16889116764068604, "survival_time": 1.5000000000000009, "driven_lanedir": 0.024505351949500542, "sim_render-ego": 0.05802747408548991, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.1708355824152629, "deviation-heading": 0.6665737104980973, "set_robot_commands": 0.10116132100423177, "deviation-center-line": 0.017148812921400067, "driven_lanedir_consec": 0.024505351949500542, "sim_compute_sim_state": 0.03738476435343425, "sim_compute_performance-ego": 0.06732134819030762, "sim_compute_robot_state-ego": 0.07091372807820638, "sim_compute_robot_state-npc0": 0.06873536904652913, "sim_compute_robot_state-npc1": 0.07143489519755046, "sim_compute_robot_state-npc2": 0.07265547116597494, "sim_compute_robot_state-npc3": 0.07234729925791422}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.5235678863125035, "sim_physics": 0.16715239701063736, "survival_time": 4.599999999999992, "driven_lanedir": 0.18142647505894516, "sim_render-ego": 0.05946328588154005, "in-drivable-lane": 1.8999999999999968, "agent_compute-ego": 0.1666069004846656, "deviation-heading": 1.9077684233031853, "set_robot_commands": 0.09024983126184216, "deviation-center-line": 0.09155707420079402, "driven_lanedir_consec": 0.18142647505894516, "sim_compute_sim_state": 0.03706556817759638, "sim_compute_performance-ego": 0.06391573211421138, "sim_compute_robot_state-ego": 0.07033442414325217, "sim_compute_robot_state-npc0": 0.06822540708210158, "sim_compute_robot_state-npc1": 0.06772244754044907, "sim_compute_robot_state-npc2": 0.0655952381051105, "sim_compute_robot_state-npc3": 0.06826175295788309}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.12337864775757228, "sim_physics": 0.1828698470042302, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0653724810523929, "sim_render-ego": 0.06323480606079102, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.16789719691643348, "deviation-heading": 0.6474594120689361, "set_robot_commands": 0.0950516829123864, "deviation-center-line": 0.07472420723445003, "driven_lanedir_consec": 0.0653724810523929, "sim_compute_sim_state": 0.03602263560661903, "sim_compute_performance-ego": 0.06337456519787128, "sim_compute_robot_state-ego": 0.0707866962139423, "sim_compute_robot_state-npc0": 0.06961684960585374, "sim_compute_robot_state-npc1": 0.07345879994905911, "sim_compute_robot_state-npc2": 0.06748910133655255, "sim_compute_robot_state-npc3": 0.0638199677834144}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.14305502895477315, "sim_physics": 0.18541132079230416, "survival_time": 1.3500000000000003, "driven_lanedir": 0.09886620268333468, "sim_render-ego": 0.060714518582379376, "in-drivable-lane": 0, "agent_compute-ego": 0.16041317692509405, "deviation-heading": 0.7466283620262195, "set_robot_commands": 0.0937966505686442, "deviation-center-line": 0.10574464408629432, "driven_lanedir_consec": 0.09886620268333468, "sim_compute_sim_state": 0.038285529171978985, "sim_compute_performance-ego": 0.06720304489135742, "sim_compute_robot_state-ego": 0.06535213081925004, "sim_compute_robot_state-npc0": 0.06601709789699978, "sim_compute_robot_state-npc1": 0.06734327916745786, "sim_compute_robot_state-npc2": 0.06340980529785156, "sim_compute_robot_state-npc3": 0.06736419819019458}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.17574833330331682, "sim_physics": 0.2231428623199463, "survival_time": 1.800000000000001, "driven_lanedir": 0.07172449108149115, "sim_render-ego": 0.06983623902002971, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.19429549243715075, "deviation-heading": 0.7074217175359803, "set_robot_commands": 0.10928014251920912, "deviation-center-line": 0.03265789753586356, "driven_lanedir_consec": 0.07172449108149115, "sim_compute_sim_state": 0.04432718621359931, "sim_compute_performance-ego": 0.07822626166873509, "sim_compute_robot_state-ego": 0.08634795082939996, "sim_compute_robot_state-npc0": 0.07544108894136217, "sim_compute_robot_state-npc1": 0.07777557770411174, "sim_compute_robot_state-npc2": 0.07476997375488281, "sim_compute_robot_state-npc3": 0.07640894254048665}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.8454258496696387, "sim_physics": 0.17197019497553506, "survival_time": 14.950000000000076, "driven_lanedir": 0.57675631088116, "sim_render-ego": 0.061686696211496986, "in-drivable-lane": 7.400000000000034, "agent_compute-ego": 0.1721569752693176, "deviation-heading": 5.86098707862487, "set_robot_commands": 0.09405592362085978, "deviation-center-line": 0.5619880978900372, "driven_lanedir_consec": 0.57675631088116, "sim_compute_sim_state": 0.03885876893997192, "sim_compute_performance-ego": 0.06889943758646647, "sim_compute_robot_state-ego": 0.07255645434061686, "sim_compute_robot_state-npc0": 0.07002371708552042, "sim_compute_robot_state-npc1": 0.07010675509770711, "sim_compute_robot_state-npc2": 0.06986228942871094, "sim_compute_robot_state-npc3": 0.06981175263722737}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.15372368033986253, "sim_physics": 0.19557872685519131, "survival_time": 1.6500000000000008, "driven_lanedir": 0.021920612924160476, "sim_render-ego": 0.0683240168022387, "in-drivable-lane": 0.8000000000000006, "agent_compute-ego": 0.17678893696178088, "deviation-heading": 0.6199972402394218, "set_robot_commands": 0.0940579284321178, "deviation-center-line": 0.016053265735621682, "driven_lanedir_consec": 0.021920612924160476, "sim_compute_sim_state": 0.040898127989335495, "sim_compute_performance-ego": 0.07361024798768939, "sim_compute_robot_state-ego": 0.07593117338238341, "sim_compute_robot_state-npc0": 0.0702293569391424, "sim_compute_robot_state-npc1": 0.07177830464912183, "sim_compute_robot_state-npc2": 0.07240937695358739, "sim_compute_robot_state-npc3": 0.06978702545166016}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.10703600647109508, "sim_physics": 0.1585958314978558, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06211621866034589, "sim_render-ego": 0.06020287845445716, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15942185858021612, "deviation-heading": 0.6269520127815746, "set_robot_commands": 0.0878297349681025, "deviation-center-line": 0.08853573729299724, "driven_lanedir_consec": 0.06211621866034589, "sim_compute_sim_state": 0.03909214683201002, "sim_compute_performance-ego": 0.06672808398371158, "sim_compute_robot_state-ego": 0.0696861743927002, "sim_compute_robot_state-npc0": 0.06434588846953018, "sim_compute_robot_state-npc1": 0.062586670336516, "sim_compute_robot_state-npc2": 0.06255610092826512, "sim_compute_robot_state-npc3": 0.06912195164224376}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.1590289125906066, "sim_physics": 0.1700058688083893, "survival_time": 10.15000000000001, "driven_lanedir": 0.38038165594769313, "sim_render-ego": 0.061647870857727355, "in-drivable-lane": 4.699999999999998, "agent_compute-ego": 0.1643356642699594, "deviation-heading": 4.048880378148629, "set_robot_commands": 0.0936244133070772, "deviation-center-line": 0.24816328081781375, "driven_lanedir_consec": 0.38038165594769313, "sim_compute_sim_state": 0.03818454883368732, "sim_compute_performance-ego": 0.0662263766885391, "sim_compute_robot_state-ego": 0.06904290462362356, "sim_compute_robot_state-npc0": 0.06655362204377874, "sim_compute_robot_state-npc1": 0.06720939763073851, "sim_compute_robot_state-npc2": 0.06619611984403262, "sim_compute_robot_state-npc3": 0.06818086525489545}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.1089711533915115, "sim_physics": 0.20295361850572669, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06328513689386472, "sim_render-ego": 0.06173001164975374, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1725837873375934, "deviation-heading": 0.6012888519894983, "set_robot_commands": 0.09573925059774648, "deviation-center-line": 0.0785976581532851, "driven_lanedir_consec": 0.06328513689386472, "sim_compute_sim_state": 0.03972223530644956, "sim_compute_performance-ego": 0.06852690033290697, "sim_compute_robot_state-ego": 0.07509545657945715, "sim_compute_robot_state-npc0": 0.0682781986568285, "sim_compute_robot_state-npc1": 0.06915517475294031, "sim_compute_robot_state-npc2": 0.0707866212596064, "sim_compute_robot_state-npc3": 0.07228746621505074}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.14103977748269309, "sim_physics": 0.17616221734455653, "survival_time": 1.4000000000000006, "driven_lanedir": 0.08482437752307126, "sim_render-ego": 0.061899193695613315, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17654238428388322, "deviation-heading": 0.7619207846833301, "set_robot_commands": 0.09788790770939418, "deviation-center-line": 0.08084713380675058, "driven_lanedir_consec": 0.08482437752307126, "sim_compute_sim_state": 0.038706532546452115, "sim_compute_performance-ego": 0.06886648280279976, "sim_compute_robot_state-ego": 0.07165486471993583, "sim_compute_robot_state-npc0": 0.07189723423549108, "sim_compute_robot_state-npc1": 0.0681661878313337, "sim_compute_robot_state-npc2": 0.07136327028274536, "sim_compute_robot_state-npc3": 0.06971405233655657}}
set_robot_commands_max	0.10928014251920912
set_robot_commands_mean	0.0951808630354981
set_robot_commands_median	0.09405592362085978
set_robot_commands_min	0.0878297349681025
sim_compute_performance-ego_max	0.07822626166873509
sim_compute_performance-ego_mean	0.06840571455336836
sim_compute_performance-ego_median	0.06732134819030762
sim_compute_performance-ego_min	0.06337456519787128
sim_compute_robot_state-ego_max	0.08634795082939996
sim_compute_robot_state-ego_mean	0.07246653815765661
sim_compute_robot_state-ego_median	0.07091372807820638
sim_compute_robot_state-ego_min	0.06535213081925004
sim_compute_robot_state-npc0_max	0.07544108894136217
sim_compute_robot_state-npc0_mean	0.06869460749339451
sim_compute_robot_state-npc0_median	0.06873536904652913
sim_compute_robot_state-npc0_min	0.06434588846953018
sim_compute_robot_state-npc1_max	0.07777557770411174
sim_compute_robot_state-npc1_mean	0.06918146953657232
sim_compute_robot_state-npc1_median	0.0681661878313337
sim_compute_robot_state-npc1_min	0.062586670336516
sim_compute_robot_state-npc2_max	0.07476997375488281
sim_compute_robot_state-npc2_mean	0.06871939478706238
sim_compute_robot_state-npc2_median	0.06806181824725607
sim_compute_robot_state-npc2_min	0.06255610092826512
sim_compute_robot_state-npc3_max	0.07640894254048665
sim_compute_robot_state-npc3_mean	0.06967464153808269
sim_compute_robot_state-npc3_median	0.06971405233655657
sim_compute_robot_state-npc3_min	0.0638199677834144
sim_compute_sim_state_max	0.04432718621359931
sim_compute_sim_state_mean	0.03916846784065988
sim_compute_sim_state_median	0.038706532546452115
sim_compute_sim_state_min	0.03602263560661903
sim_physics_max	0.2231428623199463
sim_physics_mean	0.18361935983158303
sim_physics_median	0.17616221734455653
sim_physics_min	0.1585958314978558
sim_render-ego_max	0.06983623902002971
sim_render-ego_mean	0.06220252744073544
sim_render-ego_median	0.061647870857727355
sim_render-ego_min	0.05802747408548991
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.376666666666677
survival_time_min	1.1500000000000004

No reset possible

21364

2375

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-28 01:03:32+00:00

2019-04-28 01:21:40+00:00

0:18:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6560989890090594
survival_time_median	3.649999999999995
deviation-center-line_median	0.14678748740599404
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.07193123327719199
agent_compute-ego_mean	0.06283157808589326
agent_compute-ego_median	0.06457802227565221
agent_compute-ego_min	0.04610342891127975
deviation-center-line_max	0.4005818627784723
deviation-center-line_mean	0.19535396696552737
deviation-center-line_min	0.12422801598242109
deviation-heading_max	1.0645521116851462
deviation-heading_mean	0.5821209778469638
deviation-heading_median	0.5423458590238992
deviation-heading_min	0.29987290367335917
driven_any_max	2.1648273185719797
driven_any_mean	0.9348502469008624
driven_any_median	0.9948273195001768
driven_any_min	0.2750262368649079
driven_lanedir_consec_max	2.0050790504729665
driven_lanedir_consec_mean	0.738495147174259
driven_lanedir_consec_min	0.2671322113623069
driven_lanedir_max	2.0050790504729665
driven_lanedir_mean	0.738495147174259
driven_lanedir_median	0.6560989890090594
driven_lanedir_min	0.2671322113623069
in-drivable-lane_max	1.5499999999999945
in-drivable-lane_mean	0.5433333333333313
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.10839039332246128, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.06433782838795284, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06685337955004549, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.0999243390070249, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.03856808845310995, "sim_compute_performance-ego": 0.0683738891392538, "sim_compute_robot_state-ego": 0.07706688528191553}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009827319290899, "sim_physics": 0.1108509785420186, "survival_time": 3.699999999999995, "driven_lanedir": 0.8760331754635476, "sim_render-ego": 0.059553603868226744, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.0658586089675491, "deviation-heading": 1.047774623333474, "set_robot_commands": 0.09652239245337409, "deviation-center-line": 0.29642020115014733, "driven_lanedir_consec": 0.8760331754635476, "sim_compute_sim_state": 0.03745920593674119, "sim_compute_performance-ego": 0.06787459270374195, "sim_compute_robot_state-ego": 0.07650769723428262}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2750262368649079, "sim_physics": 0.11525729179382324, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2671322113623069, "sim_render-ego": 0.06309609413146973, "in-drivable-lane": 0, "agent_compute-ego": 0.06522618293762207, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.08867458343505859, "deviation-center-line": 0.12422801598242109, "driven_lanedir_consec": 0.2671322113623069, "sim_compute_sim_state": 0.0344154167175293, "sim_compute_performance-ego": 0.06677533149719238, "sim_compute_robot_state-ego": 0.06900970458984375}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4548365617710419, "sim_physics": 0.13559501235549515, "survival_time": 1.850000000000001, "driven_lanedir": 0.4333629680464388, "sim_render-ego": 0.06601747306617531, "in-drivable-lane": 0, "agent_compute-ego": 0.07193123327719199, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.10509681057285618, "deviation-center-line": 0.12501321046442526, "driven_lanedir_consec": 0.4333629680464388, "sim_compute_sim_state": 0.0401221159342173, "sim_compute_performance-ego": 0.07656879682798644, "sim_compute_robot_state-ego": 0.0846370555259086}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.11118386260100774, "survival_time": 5.599999999999988, "driven_lanedir": 1.1257539445961453, "sim_render-ego": 0.057917775852339606, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.06457802227565221, "deviation-heading": 0.31699480744097813, "set_robot_commands": 0.09140450188091824, "deviation-center-line": 0.4005818627784723, "driven_lanedir_consec": 1.1257539445961453, "sim_compute_sim_state": 0.038432687520980835, "sim_compute_performance-ego": 0.064268987093653, "sim_compute_robot_state-ego": 0.07144477111952645}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.454836561771035, "sim_physics": 0.110387744130315, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.058572910927437445, "in-drivable-lane": 0, "agent_compute-ego": 0.06624406092875712, "deviation-heading": 0.6191860504142409, "set_robot_commands": 0.09252187368032094, "deviation-center-line": 0.13177329190693754, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.03964335209614522, "sim_compute_performance-ego": 0.06649158452008222, "sim_compute_robot_state-ego": 0.07231483588347563}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0248273191286392, "sim_physics": 0.11987488428751628, "survival_time": 3.7499999999999942, "driven_lanedir": 0.5418367454355217, "sim_render-ego": 0.06214876810709635, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.06683519999186198, "deviation-heading": 0.5423458590238992, "set_robot_commands": 0.09707263310750326, "deviation-center-line": 0.14678748740599404, "driven_lanedir_consec": 0.5418367454355217, "sim_compute_sim_state": 0.0390739377339681, "sim_compute_performance-ego": 0.07178914388020834, "sim_compute_robot_state-ego": 0.08123177210489908}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3049465552081734, "sim_physics": 0.09232898111696596, "survival_time": 1.3500000000000003, "driven_lanedir": 0.29745564201515107, "sim_render-ego": 0.052232548042579936, "in-drivable-lane": 0, "agent_compute-ego": 0.053566932678222656, "deviation-heading": 0.29987290367335917, "set_robot_commands": 0.07396158465632686, "deviation-center-line": 0.1306820468362013, "driven_lanedir_consec": 0.29745564201515107, "sim_compute_sim_state": 0.031031952963935003, "sim_compute_performance-ego": 0.05869936060022424, "sim_compute_robot_state-ego": 0.05769643960175691}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.7098274382089755, "sim_physics": 0.07463541295793322, "survival_time": 2.6999999999999984, "driven_lanedir": 0.7032085791835883, "sim_render-ego": 0.04378461837768555, "in-drivable-lane": 0, "agent_compute-ego": 0.04610342891127975, "deviation-heading": 0.36899467884091897, "set_robot_commands": 0.06590319121325458, "deviation-center-line": 0.18371297048277177, "driven_lanedir_consec": 0.7032085791835883, "sim_compute_sim_state": 0.02824197875128852, "sim_compute_performance-ego": 0.047912672713950825, "sim_compute_robot_state-ego": 0.05208956312250208}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9948273195001768, "sim_physics": 0.10528562166919447, "survival_time": 3.649999999999995, "driven_lanedir": 0.6560989890090594, "sim_render-ego": 0.05810517807529397, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.06129574775695801, "deviation-heading": 0.6658599650846626, "set_robot_commands": 0.08875670171763798, "deviation-center-line": 0.1561741058626541, "driven_lanedir_consec": 0.6560989890090594, "sim_compute_sim_state": 0.03684775796655106, "sim_compute_performance-ego": 0.06394056751303477, "sim_compute_robot_state-ego": 0.06531205895828875}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5798273185720009, "sim_physics": 0.10530367919376918, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014600726933682, "sim_render-ego": 0.059739338500159125, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06208650554929461, "deviation-heading": 0.5156620482368139, "set_robot_commands": 0.089368109192167, "deviation-center-line": 0.20858216306835017, "driven_lanedir_consec": 1.2014600726933682, "sim_compute_sim_state": 0.036864402038710456, "sim_compute_performance-ego": 0.06390881112643651, "sim_compute_robot_state-ego": 0.06836078422410148}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0098273192909009, "sim_physics": 0.1119665326298894, "survival_time": 3.699999999999995, "driven_lanedir": 0.6405535448452877, "sim_render-ego": 0.05624187637019802, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06159357766847353, "deviation-heading": 1.0645521116851462, "set_robot_commands": 0.08884012054752659, "deviation-center-line": 0.2228681204106694, "driven_lanedir_consec": 0.6405535448452877, "sim_compute_sim_state": 0.037251424145054175, "sim_compute_performance-ego": 0.06680362289016312, "sim_compute_robot_state-ego": 0.07088265547881255}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9948273195001752, "sim_physics": 0.09582068168953674, "survival_time": 3.649999999999995, "driven_lanedir": 0.7695653387571403, "sim_render-ego": 0.06014471511318259, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.06301283183163159, "deviation-heading": 0.4813700122068389, "set_robot_commands": 0.0942535498370863, "deviation-center-line": 0.1442443284046606, "driven_lanedir_consec": 0.7695653387571403, "sim_compute_sim_state": 0.03726933427052955, "sim_compute_performance-ego": 0.06299138069152832, "sim_compute_robot_state-ego": 0.06703865691407086}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4698344777618675, "sim_physics": 0.11582060864097192, "survival_time": 1.900000000000001, "driven_lanedir": 0.4595449996397094, "sim_render-ego": 0.05757531366850201, "in-drivable-lane": 0, "agent_compute-ego": 0.06049592243997674, "deviation-heading": 0.398367781186276, "set_robot_commands": 0.08729440287539833, "deviation-center-line": 0.1252701007981349, "driven_lanedir_consec": 0.4595449996397094, "sim_compute_sim_state": 0.038800948544552454, "sim_compute_performance-ego": 0.06173033463327508, "sim_compute_robot_state-ego": 0.06999766199212325}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1648273185719797, "sim_physics": 0.12834848947082925, "survival_time": 7.549999999999981, "driven_lanedir": 2.0050790504729665, "sim_render-ego": 0.06186221293266246, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.06679203652388213, "deviation-heading": 0.9808458191188588, "set_robot_commands": 0.09766538411576228, "deviation-center-line": 0.3896160126120228, "driven_lanedir_consec": 2.0050790504729665, "sim_compute_sim_state": 0.03937926197683574, "sim_compute_performance-ego": 0.0689860653403579, "sim_compute_robot_state-ego": 0.07757242941698492}}
set_robot_commands_max	0.10509681057285618
set_robot_commands_mean	0.09048401188614771
set_robot_commands_median	0.09140450188091824
set_robot_commands_min	0.06590319121325458
sim_compute_performance-ego_max	0.07656879682798644
sim_compute_performance-ego_mean	0.06514100941140594
sim_compute_performance-ego_median	0.06649158452008222
sim_compute_performance-ego_min	0.047912672713950825
sim_compute_robot_state-ego_max	0.0846370555259086
sim_compute_robot_state-ego_mean	0.07074419809656617
sim_compute_robot_state-ego_median	0.07088265547881255
sim_compute_robot_state-ego_min	0.05208956312250208
sim_compute_sim_state_max	0.0401221159342173
sim_compute_sim_state_mean	0.03689345767000992
sim_compute_sim_state_median	0.03745920593674119
sim_compute_sim_state_min	0.02824197875128852
sim_physics_max	0.13559501235549515
sim_physics_mean	0.10940334496011515
sim_physics_median	0.1108509785420186
sim_physics_min	0.07463541295793322
sim_render-ego_max	0.06601747306617531
sim_render-ego_mean	0.058755350361397445
sim_render-ego_median	0.059553603868226744
sim_render-ego_min	0.04378461837768555
simulation-passed	1
survival_time_max	7.549999999999981
survival_time_mean	3.4499999999999957
survival_time_min	1.2500000000000004

No reset possible

21340

2446

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 00:00:33+00:00

2019-04-28 01:00:10+00:00

0:59:37

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-40-253-32059-job21340/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21320

3058

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

aido2-LFV-sim-validation

2019-04-27 23:08:19+00:00

2019-04-28 00:00:08+00:00

0:51:49

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-40-253-32059-job21320/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21306

2405

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 23:00:17+00:00

2019-04-27 23:07:51+00:00

0:07:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06294709601163995
survival_time_median	1.5000000000000009
deviation-center-line_median	0.05731025987013574
in-drivable-lane_median	0.4500000000000004

other stats

agent_compute-ego_max	0.2319434574672154
agent_compute-ego_mean	0.18381922015104185
agent_compute-ego_median	0.16695943745699796
agent_compute-ego_min	0.1601518953547758
deviation-center-line_max	0.10023663222796585
deviation-center-line_mean	0.06852698065052026
deviation-center-line_min	0.040255255318736846
deviation-heading_max	0.759561028738704
deviation-heading_mean	0.6590612988838862
deviation-heading_median	0.7003898788115144
deviation-heading_min	0.5362181698786559
driven_any_max	0.2012948104812809
driven_any_mean	0.15522089320774957
driven_any_median	0.1604657521993402
driven_any_min	0.11330726268146984
driven_lanedir_consec_max	0.07814990339499328
driven_lanedir_consec_mean	0.06483081100516623
driven_lanedir_consec_min	0.046864279705401746
driven_lanedir_max	0.07814990339499328
driven_lanedir_mean	0.06483081100516623
driven_lanedir_median	0.06294709601163995
driven_lanedir_min	0.046864279705401746
in-drivable-lane_max	0.7000000000000006
in-drivable-lane_mean	0.3600000000000003
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2012948104812809, "sim_physics": 0.22772585323878697, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0580797523313934, "sim_render-ego": 0.07086165291922433, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.2319434574672154, "deviation-heading": 0.7003898788115144, "set_robot_commands": 0.122048282623291, "deviation-center-line": 0.05731025987013574, "driven_lanedir_consec": 0.0580797523313934, "sim_compute_sim_state": 0.046117033277239115, "sim_compute_performance-ego": 0.08274844714573451, "sim_compute_robot_state-ego": 0.08700449807303293, "sim_compute_robot_state-npc0": 0.08643225261143275, "sim_compute_robot_state-npc1": 0.08364971705845424, "sim_compute_robot_state-npc2": 0.08141983577183315, "sim_compute_robot_state-npc3": 0.07956207139151437}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18706687934751265, "sim_physics": 0.15547553931965546, "survival_time": 1.7000000000000008, "driven_lanedir": 0.046864279705401746, "sim_render-ego": 0.060933681095347685, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1601518953547758, "deviation-heading": 0.759561028738704, "set_robot_commands": 0.08987851002637078, "deviation-center-line": 0.0538799191943416, "driven_lanedir_consec": 0.046864279705401746, "sim_compute_sim_state": 0.037278119255514705, "sim_compute_performance-ego": 0.07066024752224193, "sim_compute_robot_state-ego": 0.0748438554651597, "sim_compute_robot_state-npc0": 0.06344460739808924, "sim_compute_robot_state-npc1": 0.061879761078778434, "sim_compute_robot_state-npc2": 0.06616204626419965, "sim_compute_robot_state-npc3": 0.06077095340279972}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11396976132914428, "sim_physics": 0.1677103457243546, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0781130235824028, "sim_render-ego": 0.05718747429225756, "in-drivable-lane": 0, "agent_compute-ego": 0.16414513795272165, "deviation-heading": 0.5685819651203413, "set_robot_commands": 0.08773502059604811, "deviation-center-line": 0.10023663222796585, "driven_lanedir_consec": 0.0781130235824028, "sim_compute_sim_state": 0.03771617101586383, "sim_compute_performance-ego": 0.06690677352573561, "sim_compute_robot_state-ego": 0.06526938728664232, "sim_compute_robot_state-npc0": 0.06747494573178499, "sim_compute_robot_state-npc1": 0.06925716607466988, "sim_compute_robot_state-npc2": 0.06609321677166483, "sim_compute_robot_state-npc3": 0.06227726521699325}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.11330726268146984, "sim_physics": 0.19077573039314963, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07814990339499328, "sim_render-ego": 0.05764065005562522, "in-drivable-lane": 0, "agent_compute-ego": 0.16695943745699796, "deviation-heading": 0.5362181698786559, "set_robot_commands": 0.08997105468403209, "deviation-center-line": 0.09095283664142129, "driven_lanedir_consec": 0.07814990339499328, "sim_compute_sim_state": 0.04039210622960871, "sim_compute_performance-ego": 0.06439711830832741, "sim_compute_robot_state-ego": 0.0634980635209517, "sim_compute_robot_state-npc0": 0.06384075771678578, "sim_compute_robot_state-npc1": 0.06679426540027965, "sim_compute_robot_state-npc2": 0.06364248015663841, "sim_compute_robot_state-npc3": 0.06308907812291925}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1604657521993402, "sim_physics": 0.2051754713058472, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06294709601163995, "sim_render-ego": 0.06581268310546876, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.19589617252349853, "deviation-heading": 0.7305554518702151, "set_robot_commands": 0.10464514096577962, "deviation-center-line": 0.040255255318736846, "driven_lanedir_consec": 0.06294709601163995, "sim_compute_sim_state": 0.04305922985076904, "sim_compute_performance-ego": 0.07549686431884765, "sim_compute_robot_state-ego": 0.08762385845184326, "sim_compute_robot_state-npc0": 0.07884705861409505, "sim_compute_robot_state-npc1": 0.07864894072214762, "sim_compute_robot_state-npc2": 0.07548479239145915, "sim_compute_robot_state-npc3": 0.0761953592300415}}
set_robot_commands_max	0.122048282623291
set_robot_commands_mean	0.09885560177910432
set_robot_commands_median	0.08997105468403209
set_robot_commands_min	0.08773502059604811
sim_compute_performance-ego_max	0.08274844714573451
sim_compute_performance-ego_mean	0.07204189016417742
sim_compute_performance-ego_median	0.07066024752224193
sim_compute_performance-ego_min	0.06439711830832741
sim_compute_robot_state-ego_max	0.08762385845184326
sim_compute_robot_state-ego_mean	0.07564793255952598
sim_compute_robot_state-ego_median	0.0748438554651597
sim_compute_robot_state-ego_min	0.0634980635209517
sim_compute_robot_state-npc0_max	0.08643225261143275
sim_compute_robot_state-npc0_mean	0.07200792441443755
sim_compute_robot_state-npc0_median	0.06747494573178499
sim_compute_robot_state-npc0_min	0.06344460739808924
sim_compute_robot_state-npc1_max	0.08364971705845424
sim_compute_robot_state-npc1_mean	0.07204597006686596
sim_compute_robot_state-npc1_median	0.06925716607466988
sim_compute_robot_state-npc1_min	0.061879761078778434
sim_compute_robot_state-npc2_max	0.08141983577183315
sim_compute_robot_state-npc2_mean	0.07056047427115904
sim_compute_robot_state-npc2_median	0.06616204626419965
sim_compute_robot_state-npc2_min	0.06364248015663841
sim_compute_robot_state-npc3_max	0.07956207139151437
sim_compute_robot_state-npc3_mean	0.06837894547285361
sim_compute_robot_state-npc3_median	0.06308907812291925
sim_compute_robot_state-npc3_min	0.06077095340279972
sim_compute_sim_state_max	0.046117033277239115
sim_compute_sim_state_mean	0.04091253192579908
sim_compute_sim_state_median	0.04039210622960871
sim_compute_sim_state_min	0.037278119255514705
sim_physics_max	0.22772585323878697
sim_physics_mean	0.18937258799635875
sim_physics_median	0.19077573039314963
sim_physics_min	0.15547553931965546
sim_render-ego_max	0.07086165291922433
sim_render-ego_mean	0.062487228293584704
sim_render-ego_median	0.060933681095347685
sim_render-ego_min	0.05718747429225756
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.4400000000000008
survival_time_min	1.1000000000000003

No reset possible

21299

2416

Andrea Censi 🇨🇭

random_agent

step1-simulation

host-error

2019-04-27 22:47:29+00:00

2019-04-27 23:00:09+00:00

0:12:40

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2416/step1-simulation-ip-172-31-40-253-32059-job21299/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21290

2449

aido2-LFV-sim-validation

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 22:09:17+00:00

2019-04-27 22:46:42+00:00

0:37:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.339793520141566
survival_time_median	14.950000000000076
deviation-center-line_median	1.002134440312669
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.18893913745880128
agent_compute-ego_mean	0.17737535858154296
agent_compute-ego_median	0.1752101214726766
agent_compute-ego_min	0.17098739782969158
deviation-center-line_max	1.5296442653166566
deviation-center-line_mean	0.925371790854924
deviation-center-line_min	0.28261955257418875
deviation-heading_max	8.558153948461722
deviation-heading_mean	7.098260242116498
deviation-heading_median	7.090641611385013
deviation-heading_min	5.695926383403844
driven_any_max	4.378506444052824
driven_any_mean	4.378506444052815
driven_any_median	4.378506444052811
driven_any_min	4.378506444052806
driven_lanedir_consec_max	-1.2728379671211965
driven_lanedir_consec_mean	-1.3313530019797526
driven_lanedir_consec_min	-1.3670015115194478
driven_lanedir_max	-1.3662544443440128
driven_lanedir_mean	-2.078199826147362
driven_lanedir_median	-2.260637650975249
driven_lanedir_min	-2.7107548643537447
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.620000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.1827156066894531, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.06471914688746135, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.1752101214726766, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.0990732987721761, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.03949843088785807, "sim_compute_performance-ego": 0.07097182750701904, "sim_compute_robot_state-ego": 0.07593461195627849, "sim_compute_robot_state-npc0": 0.07136260112126669, "sim_compute_robot_state-npc1": 0.0709420410792033, "sim_compute_robot_state-npc2": 0.07040985027949015, "sim_compute_robot_state-npc3": 0.07052261511484782}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.1801827907562256, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.06461849927902222, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17803633689880372, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.1015418593088786, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.04017532745997111, "sim_compute_performance-ego": 0.07109251976013184, "sim_compute_robot_state-ego": 0.0774393351872762, "sim_compute_robot_state-npc0": 0.07153643449147543, "sim_compute_robot_state-npc1": 0.0711844007174174, "sim_compute_robot_state-npc2": 0.07162310838699341, "sim_compute_robot_state-npc3": 0.07103332757949829}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.19490474859873455, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.06442549546559652, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.18893913745880128, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.10093865633010864, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.04055912733078003, "sim_compute_performance-ego": 0.07253766616185506, "sim_compute_robot_state-ego": 0.08136108239491781, "sim_compute_robot_state-npc0": 0.07285413026809692, "sim_compute_robot_state-npc1": 0.07315955400466918, "sim_compute_robot_state-npc2": 0.0723673137029012, "sim_compute_robot_state-npc3": 0.07285567760467529}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.17482227563858033, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.062667715549469, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.1737037992477417, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.09766882340113324, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.040700251261393226, "sim_compute_performance-ego": 0.07005611260732016, "sim_compute_robot_state-ego": 0.0742901333173116, "sim_compute_robot_state-npc0": 0.06956247965494791, "sim_compute_robot_state-npc1": 0.06941971699396769, "sim_compute_robot_state-npc2": 0.07013258854548136, "sim_compute_robot_state-npc3": 0.07044984102249145}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.1771340505282084, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.06086190700531006, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.17098739782969158, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.09553208748499552, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.038272933165232344, "sim_compute_performance-ego": 0.06859138409296671, "sim_compute_robot_state-ego": 0.07530689716339112, "sim_compute_robot_state-npc0": 0.0687521998087565, "sim_compute_robot_state-npc1": 0.06959106524785359, "sim_compute_robot_state-npc2": 0.06926600297292074, "sim_compute_robot_state-npc3": 0.06855684677759806}}
set_robot_commands_max	0.1015418593088786
set_robot_commands_mean	0.0989509450594584
set_robot_commands_median	0.0990732987721761
set_robot_commands_min	0.09553208748499552
sim_compute_performance-ego_max	0.07253766616185506
sim_compute_performance-ego_mean	0.07064990202585857
sim_compute_performance-ego_median	0.07097182750701904
sim_compute_performance-ego_min	0.06859138409296671
sim_compute_robot_state-ego_max	0.08136108239491781
sim_compute_robot_state-ego_mean	0.07686641200383504
sim_compute_robot_state-ego_median	0.07593461195627849
sim_compute_robot_state-ego_min	0.0742901333173116
sim_compute_robot_state-npc0_max	0.07285413026809692
sim_compute_robot_state-npc0_mean	0.07081356906890869
sim_compute_robot_state-npc0_median	0.07136260112126669
sim_compute_robot_state-npc0_min	0.0687521998087565
sim_compute_robot_state-npc1_max	0.07315955400466918
sim_compute_robot_state-npc1_mean	0.07085935560862223
sim_compute_robot_state-npc1_median	0.0709420410792033
sim_compute_robot_state-npc1_min	0.06941971699396769
sim_compute_robot_state-npc2_max	0.0723673137029012
sim_compute_robot_state-npc2_mean	0.07075977277755738
sim_compute_robot_state-npc2_median	0.07040985027949015
sim_compute_robot_state-npc2_min	0.06926600297292074
sim_compute_robot_state-npc3_max	0.07285567760467529
sim_compute_robot_state-npc3_mean	0.07068366161982217
sim_compute_robot_state-npc3_median	0.07052261511484782
sim_compute_robot_state-npc3_min	0.06855684677759806
sim_compute_sim_state_max	0.040700251261393226
sim_compute_sim_state_mean	0.03984121402104696
sim_compute_sim_state_median	0.04017532745997111
sim_compute_sim_state_min	0.038272933165232344
sim_physics_max	0.19490474859873455
sim_physics_mean	0.1819518944422404
sim_physics_median	0.1801827907562256
sim_physics_min	0.17482227563858033
sim_render-ego_max	0.06471914688746135
sim_render-ego_mean	0.06345855283737183
sim_render-ego_median	0.06442549546559652
sim_render-ego_min	0.06086190700531006
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21287

2440

Jacopo Tani

random_agent

step1-simulation

success

2019-04-27 22:02:43+00:00

2019-04-27 22:08:46+00:00

0:06:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.1697379999522921
agent_compute-ego_mean	0.15869363341588305
agent_compute-ego_median	0.1568316197862812
agent_compute-ego_min	0.1538867950439453
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11263235410054524, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06312885549333361, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1538867950439453, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10156518000143544, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03904641557622839, "sim_compute_performance-ego": 0.0695761795397158, "sim_compute_robot_state-ego": 0.07357552316453722}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11917901974098356, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06495362637089748, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1568316197862812, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0974733362010881, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.038939289018219594, "sim_compute_performance-ego": 0.07212354622635186, "sim_compute_robot_state-ego": 0.07445217581356273}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1329674019533045, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06713827918557559, "in-drivable-lane": 0, "agent_compute-ego": 0.15588683240553913, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09299101549036362, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03755673240212833, "sim_compute_performance-ego": 0.07140637846554027, "sim_compute_robot_state-ego": 0.07688431178822237}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13152554512023926, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06606058120727538, "in-drivable-lane": 0, "agent_compute-ego": 0.15712491989135743, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09526534080505372, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03936822891235352, "sim_compute_performance-ego": 0.07282272338867188, "sim_compute_robot_state-ego": 0.07596761703491212}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12555404252643826, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06743296792235555, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1697379999522921, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10547934302800818, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0416502439523045, "sim_compute_performance-ego": 0.07301112971728362, "sim_compute_robot_state-ego": 0.08772744408136682}}
set_robot_commands_max	0.10547934302800818
set_robot_commands_mean	0.0985548431051898
set_robot_commands_median	0.0974733362010881
set_robot_commands_min	0.09299101549036362
sim_compute_performance-ego_max	0.07301112971728362
sim_compute_performance-ego_mean	0.07178799146751269
sim_compute_performance-ego_median	0.07212354622635186
sim_compute_performance-ego_min	0.0695761795397158
sim_compute_robot_state-ego_max	0.08772744408136682
sim_compute_robot_state-ego_mean	0.07772141437652025
sim_compute_robot_state-ego_median	0.07596761703491212
sim_compute_robot_state-ego_min	0.07357552316453722
sim_compute_sim_state_max	0.0416502439523045
sim_compute_sim_state_mean	0.03931218197224686
sim_compute_sim_state_median	0.03904641557622839
sim_compute_sim_state_min	0.03755673240212833
sim_physics_max	0.1329674019533045
sim_physics_mean	0.12437167268830218
sim_physics_median	0.12555404252643826
sim_physics_min	0.11263235410054524
sim_render-ego_max	0.06743296792235555
sim_render-ego_mean	0.06574286203588751
sim_render-ego_median	0.06606058120727538
sim_render-ego_min	0.06312885549333361
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21271

2443

Jacopo Tani

random_agent

step1-simulation

host-error

2019-04-27 21:58:48+00:00

2019-04-27 22:00:11+00:00

0:01:23

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2443/step1-simulation-ip-172-31-40-253-32059-job21271/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21266

2447

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 21:33:01+00:00

2019-04-27 21:58:25+00:00

0:25:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.339366254383536
survival_time_median	14.950000000000076
deviation-center-line_median	1.4012763877174623
in-drivable-lane_median	2.500000000000013

other stats

agent_compute-ego_max	0.17936102549235025
agent_compute-ego_mean	0.1714909944534302
agent_compute-ego_median	0.17528987010320027
agent_compute-ego_min	0.15457382837931316
deviation-center-line_max	1.5195321274570266
deviation-center-line_mean	1.174486624766163
deviation-center-line_min	0.26894128230124625
deviation-heading_max	8.502617994731201
deviation-heading_mean	7.58692926837743
deviation-heading_median	8.166880118443489
deviation-heading_min	5.592005976497815
driven_any_max	4.378506444052819
driven_any_mean	4.37850644405281
driven_any_median	4.37850644405281
driven_any_min	4.378506444052802
driven_lanedir_consec_max	-1.3108775667725403
driven_lanedir_consec_mean	-1.3430087925060197
driven_lanedir_consec_min	-1.375791811242363
driven_lanedir_max	-1.339366254383536
driven_lanedir_mean	-2.3543334685387003
driven_lanedir_median	-2.5973993077066466
driven_lanedir_min	-2.7107548643537447
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	3.5700000000000194
in-drivable-lane_min	2.150000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.12738003015518187, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.06756420850753785, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17936102549235025, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.10057321151097616, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.0415757155418396, "sim_compute_performance-ego": 0.0746863579750061, "sim_compute_robot_state-ego": 0.08174746513366699}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052802, "sim_physics": 0.12192891359329223, "survival_time": 14.950000000000076, "driven_lanedir": -2.44752976847699, "sim_render-ego": 0.06570480346679687, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.17923274517059326, "deviation-heading": 7.300247877354016, "set_robot_commands": 0.10028501669565835, "deviation-center-line": 1.1660826179431367, "driven_lanedir_consec": -1.375791811242363, "sim_compute_sim_state": 0.04088226238886515, "sim_compute_performance-ego": 0.07295308033625285, "sim_compute_robot_state-ego": 0.08084266424179078}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.37850644405281, "sim_physics": 0.11086718638737995, "survival_time": 14.950000000000076, "driven_lanedir": -1.339366254383536, "sim_render-ego": 0.06208219607671102, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.17528987010320027, "deviation-heading": 5.592005976497815, "set_robot_commands": 0.09546318689982096, "deviation-center-line": 0.26894128230124625, "driven_lanedir_consec": -1.339366254383536, "sim_compute_sim_state": 0.03863305489222209, "sim_compute_performance-ego": 0.0706462287902832, "sim_compute_robot_state-ego": 0.07412075440088908}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052819, "sim_physics": 0.1019420584042867, "survival_time": 14.950000000000076, "driven_lanedir": -2.6766171477725837, "sim_render-ego": 0.05614140033721924, "in-drivable-lane": 2.2000000000000126, "agent_compute-ego": 0.15457382837931316, "deviation-heading": 8.502617994731201, "set_robot_commands": 0.08456986586252849, "deviation-center-line": 1.516600708411943, "driven_lanedir_consec": -1.3215500552073602, "sim_compute_sim_state": 0.036658867200215654, "sim_compute_performance-ego": 0.06301776727040609, "sim_compute_robot_state-ego": 0.06702322324117024}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378506444052814, "sim_physics": 0.11868186155954996, "survival_time": 14.950000000000076, "driven_lanedir": -2.5973993077066466, "sim_render-ego": 0.06217381556828817, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.16899750312169393, "deviation-heading": 8.166880118443489, "set_robot_commands": 0.09507014354070029, "deviation-center-line": 1.4012763877174623, "driven_lanedir_consec": -1.3674582749242976, "sim_compute_sim_state": 0.04043944279352824, "sim_compute_performance-ego": 0.06904021739959716, "sim_compute_robot_state-ego": 0.07598942995071412}}
set_robot_commands_max	0.10057321151097616
set_robot_commands_mean	0.09519228490193685
set_robot_commands_median	0.09546318689982096
set_robot_commands_min	0.08456986586252849
sim_compute_performance-ego_max	0.0746863579750061
sim_compute_performance-ego_mean	0.07006873035430908
sim_compute_performance-ego_median	0.0706462287902832
sim_compute_performance-ego_min	0.06301776727040609
sim_compute_robot_state-ego_max	0.08174746513366699
sim_compute_robot_state-ego_mean	0.07594470739364624
sim_compute_robot_state-ego_median	0.07598942995071412
sim_compute_robot_state-ego_min	0.06702322324117024
sim_compute_sim_state_max	0.0415757155418396
sim_compute_sim_state_mean	0.03963786856333414
sim_compute_sim_state_median	0.04043944279352824
sim_compute_sim_state_min	0.036658867200215654
sim_physics_max	0.12738003015518187
sim_physics_mean	0.11616001001993816
sim_physics_median	0.11868186155954996
sim_physics_min	0.1019420584042867
sim_render-ego_max	0.06756420850753785
sim_render-ego_mean	0.06273328479131063
sim_render-ego_median	0.06217381556828817
sim_render-ego_min	0.05614140033721924
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21262

2452

Liam Paull 🇨🇦

Baseline solution using ROS

step1-simulation

error

2019-04-27 21:30:05+00:00

2019-04-27 21:32:24+00:00

0:02:19

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21213

2551

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 21:02:57+00:00

2019-04-27 21:29:39+00:00

0:26:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.30314311735235044
survival_time_median	2.6499999999999986
deviation-center-line_median	0.1192462800776758
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.08607807159423828
agent_compute-ego_mean	0.074743610044745
agent_compute-ego_median	0.07470582733469561
agent_compute-ego_min	0.06621728120026765
deviation-center-line_max	0.2294363663374862
deviation-center-line_mean	0.12653708755488874
deviation-center-line_min	0.06426934298501713
deviation-heading_max	0.6986268167330368
deviation-heading_mean	0.44799520296706863
deviation-heading_median	0.41847631252347706
deviation-heading_min	0.2596285487829774
driven_any_max	1.599733354117788
driven_any_mean	0.8095342605803044
driven_any_median	0.7336463183586153
driven_any_min	0.26903550091980144
driven_lanedir_consec_max	1.021002447119848
driven_lanedir_consec_mean	0.448904809024379
driven_lanedir_consec_min	0.2407721645627201
driven_lanedir_max	1.021002447119848
driven_lanedir_mean	0.448904809024379
driven_lanedir_median	0.30314311735235044
driven_lanedir_min	0.2407721645627201
in-drivable-lane_max	4.799999999999986
in-drivable-lane_mean	1.1466666666666634
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.17432247417073854, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06788356539229272, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07505501491922728, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.101760810529682, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03889623158414599, "sim_compute_performance-ego": 0.07426192726887448, "sim_compute_robot_state-ego": 0.0788298593440526, "sim_compute_robot_state-npc0": 0.07068096751898108, "sim_compute_robot_state-npc1": 0.07158439931735186, "sim_compute_robot_state-npc2": 0.07210579388578173, "sim_compute_robot_state-npc3": 0.07086905962984327}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.2012539654970169, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06530390679836273, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.06838247179985046, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.09439027309417725, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04109682142734528, "sim_compute_performance-ego": 0.07088317722082138, "sim_compute_robot_state-ego": 0.08118298649787903, "sim_compute_robot_state-npc0": 0.07235187292098999, "sim_compute_robot_state-npc1": 0.07057077437639236, "sim_compute_robot_state-npc2": 0.0732564851641655, "sim_compute_robot_state-npc3": 0.06692289561033249}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.19215410489302415, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06438011848009549, "in-drivable-lane": 0, "agent_compute-ego": 0.07050092862202571, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.1013871798148522, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.039475624377910905, "sim_compute_performance-ego": 0.07382829831196712, "sim_compute_robot_state-ego": 0.07968656374857976, "sim_compute_robot_state-npc0": 0.07196629047393799, "sim_compute_robot_state-npc1": 0.0743563175201416, "sim_compute_robot_state-npc2": 0.07542776602965134, "sim_compute_robot_state-npc3": 0.07345110636491042}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.19432855421496975, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.06321070783881731, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07367868320916289, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.10367905709051316, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.04211625232491442, "sim_compute_performance-ego": 0.0712049981599213, "sim_compute_robot_state-ego": 0.07759548259037798, "sim_compute_robot_state-npc0": 0.07193360533765568, "sim_compute_robot_state-npc1": 0.07203642014534242, "sim_compute_robot_state-npc2": 0.07063703126804803, "sim_compute_robot_state-npc3": 0.07244300842285156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.19541708628336588, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.06410430726550874, "in-drivable-lane": 0, "agent_compute-ego": 0.07670548983982631, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.10427076475960868, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.04185172489711216, "sim_compute_performance-ego": 0.06955470357622419, "sim_compute_robot_state-ego": 0.08359990801130023, "sim_compute_robot_state-npc0": 0.06998912493387859, "sim_compute_robot_state-npc1": 0.07635290282113212, "sim_compute_robot_state-npc2": 0.07564894358317058, "sim_compute_robot_state-npc3": 0.07357954978942871}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.1971212477723429, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.06428736497548, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.07470582733469561, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.10348837237712766, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.040705657202350205, "sim_compute_performance-ego": 0.07139587796424046, "sim_compute_robot_state-ego": 0.07994868341556266, "sim_compute_robot_state-npc0": 0.07406469416027227, "sim_compute_robot_state-npc1": 0.07404917724861586, "sim_compute_robot_state-npc2": 0.07246809951530016, "sim_compute_robot_state-npc3": 0.07161503783927477}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.1728521982828776, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.0648879777817499, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07313956249327887, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.10264154559090025, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.04263789313180106, "sim_compute_performance-ego": 0.07361906483059838, "sim_compute_robot_state-ego": 0.07843298855282012, "sim_compute_robot_state-npc0": 0.07414019391650245, "sim_compute_robot_state-npc1": 0.07648766040802002, "sim_compute_robot_state-npc2": 0.07513567095711118, "sim_compute_robot_state-npc3": 0.07392823696136475}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.21149076320029592, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.06744047435554298, "in-drivable-lane": 0, "agent_compute-ego": 0.0760429807611414, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.10840931776407604, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.0415069090353476, "sim_compute_performance-ego": 0.0778380535744332, "sim_compute_robot_state-ego": 0.08829647463721198, "sim_compute_robot_state-npc0": 0.07491991648802886, "sim_compute_robot_state-npc1": 0.07454737134881921, "sim_compute_robot_state-npc2": 0.07356711980458852, "sim_compute_robot_state-npc3": 0.0730093459825258}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.1806398000982073, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06431724627812703, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.08018912540541755, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.10309948854976232, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.04208359453413221, "sim_compute_performance-ego": 0.07176720764901903, "sim_compute_robot_state-ego": 0.07776983910136753, "sim_compute_robot_state-npc0": 0.0709703763326009, "sim_compute_robot_state-npc1": 0.073530246814092, "sim_compute_robot_state-npc2": 0.07031822204589844, "sim_compute_robot_state-npc3": 0.07123995820681255}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.21647039752140224, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.06436565212000196, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.07393703950899784, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.11441397221288949, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.039734581920588125, "sim_compute_performance-ego": 0.0695477222727838, "sim_compute_robot_state-ego": 0.09836388525561753, "sim_compute_robot_state-npc0": 0.07311941084460677, "sim_compute_robot_state-npc1": 0.07754612637457446, "sim_compute_robot_state-npc2": 0.07627576533879075, "sim_compute_robot_state-npc3": 0.07248478960768084}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.17772332827250162, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.058734893798828125, "in-drivable-lane": 0, "agent_compute-ego": 0.06621728120026765, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.09108768569098578, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.03599664900037977, "sim_compute_performance-ego": 0.06488241089714898, "sim_compute_robot_state-ego": 0.06978193918863933, "sim_compute_robot_state-npc0": 0.06540413256044741, "sim_compute_robot_state-npc1": 0.06354661341066714, "sim_compute_robot_state-npc2": 0.06469721264309353, "sim_compute_robot_state-npc3": 0.0645226549219202}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.22872520446777345, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.07449767112731934, "in-drivable-lane": 0, "agent_compute-ego": 0.08607807159423828, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.1263665199279785, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.05145082473754883, "sim_compute_performance-ego": 0.08947483062744141, "sim_compute_robot_state-ego": 0.09315316200256347, "sim_compute_robot_state-npc0": 0.08903553009033204, "sim_compute_robot_state-npc1": 0.08219416618347168, "sim_compute_robot_state-npc2": 0.08136404037475586, "sim_compute_robot_state-npc3": 0.08638484954833985}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.1751507453198703, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.06561351272295106, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.07261910078660497, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.10186943468057884, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.04131246512790896, "sim_compute_performance-ego": 0.07436682143301335, "sim_compute_robot_state-ego": 0.07957350982809966, "sim_compute_robot_state-npc0": 0.07379902983611485, "sim_compute_robot_state-npc1": 0.07292429906017375, "sim_compute_robot_state-npc2": 0.07142689542950324, "sim_compute_robot_state-npc3": 0.07411094881453605}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.2249384618574573, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.06323542133454353, "in-drivable-lane": 0, "agent_compute-ego": 0.0756266963097357, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.0993942060778218, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.0422377432546308, "sim_compute_performance-ego": 0.07109741241701188, "sim_compute_robot_state-ego": 0.0780267177089568, "sim_compute_robot_state-npc0": 0.0702610477324455, "sim_compute_robot_state-npc1": 0.06785554270590505, "sim_compute_robot_state-npc2": 0.07001758390857328, "sim_compute_robot_state-npc3": 0.0734584177694013}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.217040314393885, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.06481481533424527, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.07827587688670438, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.1043390339496089, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.03982830515094832, "sim_compute_performance-ego": 0.0733807834924436, "sim_compute_robot_state-ego": 0.07868241328819126, "sim_compute_robot_state-npc0": 0.07162984212239583, "sim_compute_robot_state-npc1": 0.07241640838922239, "sim_compute_robot_state-npc2": 0.07119084339515835, "sim_compute_robot_state-npc3": 0.0747361650653914}}
set_robot_commands_max	0.1263665199279785
set_robot_commands_mean	0.10403984414070416
set_robot_commands_median	0.10309948854976232
set_robot_commands_min	0.09108768569098578
sim_compute_performance-ego_max	0.08947483062744141
sim_compute_performance-ego_mean	0.07314021931306283
sim_compute_performance-ego_median	0.07176720764901903
sim_compute_performance-ego_min	0.06488241089714898
sim_compute_robot_state-ego_max	0.09836388525561753
sim_compute_robot_state-ego_mean	0.08152829421141465
sim_compute_robot_state-ego_median	0.07957350982809966
sim_compute_robot_state-ego_min	0.06978193918863933
sim_compute_robot_state-npc0_max	0.08903553009033204
sim_compute_robot_state-npc0_mean	0.07295106901794603
sim_compute_robot_state-npc0_median	0.07196629047393799
sim_compute_robot_state-npc0_min	0.06540413256044741
sim_compute_robot_state-npc1_max	0.08219416618347168
sim_compute_robot_state-npc1_mean	0.07333322840826147
sim_compute_robot_state-npc1_median	0.073530246814092
sim_compute_robot_state-npc1_min	0.06354661341066714
sim_compute_robot_state-npc2_max	0.08136404037475586
sim_compute_robot_state-npc2_mean	0.07290249822290604
sim_compute_robot_state-npc2_median	0.07246809951530016
sim_compute_robot_state-npc2_min	0.06469721264309353
sim_compute_robot_state-npc3_max	0.08638484954833985
sim_compute_robot_state-npc3_mean	0.07285040163564092
sim_compute_robot_state-npc3_median	0.0730093459825258
sim_compute_robot_state-npc3_min	0.0645226549219202
sim_compute_sim_state_max	0.05145082473754883
sim_compute_sim_state_mean	0.04139541851380431
sim_compute_sim_state_median	0.04131246512790896
sim_compute_sim_state_min	0.03599664900037977
sim_physics_max	0.22872520446777345
sim_physics_mean	0.19730857641638191
sim_physics_median	0.19541708628336588
sim_physics_min	0.1728521982828776
sim_render-ego_max	0.07449767112731934
sim_render-ego_mean	0.06513850904025774
sim_render-ego_median	0.06438011848009549
sim_render-ego_min	0.058734893798828125
simulation-passed	1
survival_time_max	6.0499999999999865
survival_time_mean	3.046666666666663
survival_time_min	1.0500000000000005

No reset possible

21206

2536

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-27 21:00:44+00:00

2019-04-27 21:02:43+00:00

0:01:59

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21194

2547

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

aido2-LFV-sim-validation

2019-04-27 20:57:23+00:00

2019-04-27 21:00:12+00:00

0:02:49

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2547/step1-simulation-ip-172-31-40-253-32059-job21194/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21191

2552

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 20:48:50+00:00

2019-04-27 20:56:56+00:00

0:08:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.5999999999999988
deviation-center-line_median	0.16987818035809085
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.07856647670269012
agent_compute-ego_mean	0.07218285806662159
agent_compute-ego_median	0.07181594448704873
agent_compute-ego_min	0.06725766567083505
deviation-center-line_max	0.2294363663374862
deviation-center-line_mean	0.14972083567701736
deviation-center-line_min	0.06426934298501713
deviation-heading_max	0.6986268167330368
deviation-heading_mean	0.4280304166285303
deviation-heading_median	0.41847631252347706
deviation-heading_min	0.2596285487829774
driven_any_max	1.2972979671834337
driven_any_mean	0.7173901327940211
driven_any_median	0.7336463183586153
driven_any_min	0.26903550091980144
driven_lanedir_consec_max	0.97716132702229
driven_lanedir_consec_mean	0.5227475277218055
driven_lanedir_consec_min	0.2407721645627201
driven_lanedir_max	0.97716132702229
driven_lanedir_mean	0.5227475277218055
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2407721645627201
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.5799999999999983
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.16371992608191263, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05981575267415651, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06782884664938484, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09192661836113727, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04054845554727904, "sim_compute_performance-ego": 0.06825931643096494, "sim_compute_robot_state-ego": 0.07629442550766637, "sim_compute_robot_state-npc0": 0.06635171258953255, "sim_compute_robot_state-npc1": 0.06494313898220869, "sim_compute_robot_state-npc2": 0.06680860989530321, "sim_compute_robot_state-npc3": 0.06973234700485015}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.2095590233802795, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06339427083730698, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07856647670269012, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.1074354723095894, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04116947203874588, "sim_compute_performance-ego": 0.07358747720718384, "sim_compute_robot_state-ego": 0.08511156588792801, "sim_compute_robot_state-npc0": 0.07377973943948746, "sim_compute_robot_state-npc1": 0.07113180309534073, "sim_compute_robot_state-npc2": 0.0734647661447525, "sim_compute_robot_state-npc3": 0.07075733691453934}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.19472426176071167, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06161088209885817, "in-drivable-lane": 0, "agent_compute-ego": 0.06725766567083505, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.0923663515311021, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.03783342012992272, "sim_compute_performance-ego": 0.07223846362187313, "sim_compute_robot_state-ego": 0.07525393596062294, "sim_compute_robot_state-npc0": 0.06991393749530499, "sim_compute_robot_state-npc1": 0.06620141176077035, "sim_compute_robot_state-npc2": 0.06600948021962093, "sim_compute_robot_state-npc3": 0.06772004641019382}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.1902276803088445, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.06212261158932922, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07181594448704873, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.1026675316595262, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.04212548655848349, "sim_compute_performance-ego": 0.07030690613613334, "sim_compute_robot_state-ego": 0.07475630185937368, "sim_compute_robot_state-npc0": 0.07091060248754358, "sim_compute_robot_state-npc1": 0.07144991556803386, "sim_compute_robot_state-npc2": 0.07104956206455025, "sim_compute_robot_state-npc3": 0.07138436071334346}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.18683131535847983, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.06603297733125232, "in-drivable-lane": 0, "agent_compute-ego": 0.07544535682314918, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.09861532847086588, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.041829949333554224, "sim_compute_performance-ego": 0.072425263268607, "sim_compute_robot_state-ego": 0.07865779740469796, "sim_compute_robot_state-npc0": 0.07107305526733398, "sim_compute_robot_state-npc1": 0.07226738475617908, "sim_compute_robot_state-npc2": 0.07753526596795945, "sim_compute_robot_state-npc3": 0.07464509918576195}}
set_robot_commands_max	0.1074354723095894
set_robot_commands_mean	0.0986022604664442
set_robot_commands_median	0.09861532847086588
set_robot_commands_min	0.09192661836113727
sim_compute_performance-ego_max	0.07358747720718384
sim_compute_performance-ego_mean	0.07136348533295245
sim_compute_performance-ego_median	0.07223846362187313
sim_compute_performance-ego_min	0.06825931643096494
sim_compute_robot_state-ego_max	0.08511156588792801
sim_compute_robot_state-ego_mean	0.07801480532405779
sim_compute_robot_state-ego_median	0.07629442550766637
sim_compute_robot_state-ego_min	0.07475630185937368
sim_compute_robot_state-npc0_max	0.07377973943948746
sim_compute_robot_state-npc0_mean	0.07040580945584052
sim_compute_robot_state-npc0_median	0.07091060248754358
sim_compute_robot_state-npc0_min	0.06635171258953255
sim_compute_robot_state-npc1_max	0.07226738475617908
sim_compute_robot_state-npc1_mean	0.06919873083250654
sim_compute_robot_state-npc1_median	0.07113180309534073
sim_compute_robot_state-npc1_min	0.06494313898220869
sim_compute_robot_state-npc2_max	0.07753526596795945
sim_compute_robot_state-npc2_mean	0.07097353685843727
sim_compute_robot_state-npc2_median	0.07104956206455025
sim_compute_robot_state-npc2_min	0.06600948021962093
sim_compute_robot_state-npc3_max	0.07464509918576195
sim_compute_robot_state-npc3_mean	0.07084783804573774
sim_compute_robot_state-npc3_median	0.07075733691453934
sim_compute_robot_state-npc3_min	0.06772004641019382
sim_compute_sim_state_max	0.04212548655848349
sim_compute_sim_state_mean	0.04070135672159707
sim_compute_sim_state_median	0.04116947203874588
sim_compute_sim_state_min	0.03783342012992272
sim_physics_max	0.2095590233802795
sim_physics_mean	0.18901244137804565
sim_physics_median	0.1902276803088445
sim_physics_min	0.16371992608191263
sim_render-ego_max	0.06603297733125232
sim_render-ego_mean	0.06259529890618064
sim_render-ego_median	0.06212261158932922
sim_render-ego_min	0.05981575267415651
simulation-passed	1
survival_time_max	4.6499999999999915
survival_time_mean	2.6899999999999973
survival_time_min	1.0500000000000005

No reset possible

21166

2594

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 20:02:46+00:00

2019-04-27 20:48:09+00:00

0:45:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.22355620868168247
survival_time_median	5.09999999999999
deviation-center-line_median	0.3623481393019844
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.24213399205889025
agent_compute-ego_mean	0.2282780001834759
agent_compute-ego_median	0.2317621631986776
agent_compute-ego_min	0.17542841759595004
deviation-center-line_max	0.49217432599840777
deviation-center-line_mean	0.35884839005848446
deviation-center-line_min	0.21780603656335767
deviation-heading_max	2.956714451786154
deviation-heading_mean	2.146552584669641
deviation-heading_median	2.188384228601573
deviation-heading_min	1.3154979971200538
driven_any_max	0.4331685489375123
driven_any_mean	0.29708435175875597
driven_any_median	0.25753960604347453
driven_any_min	0.17701393467131604
driven_lanedir_consec_max	0.38260196561550863
driven_lanedir_consec_mean	0.25765985885522896
driven_lanedir_consec_min	0.14889401767513943
driven_lanedir_max	0.38260196561550863
driven_lanedir_mean	0.25765985885522896
driven_lanedir_median	0.22355620868168247
driven_lanedir_min	0.14889401767513943
in-drivable-lane_max	0.09999999999999964
in-drivable-lane_mean	0.019999999999999928
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.3324135276952739, "sim_physics": 0.184592866897583, "survival_time": 5.999999999999987, "driven_lanedir": 0.2795986556186907, "sim_render-ego": 0.060238043467203774, "in-drivable-lane": 0, "agent_compute-ego": 0.23004773259162903, "deviation-heading": 2.7980983869119154, "set_robot_commands": 0.0956952691078186, "deviation-center-line": 0.37253490907237874, "driven_lanedir_consec": 0.2795986556186907, "sim_compute_sim_state": 0.03760039210319519, "sim_compute_performance-ego": 0.06686306397120158, "sim_compute_robot_state-ego": 0.0741072436173757, "sim_compute_robot_state-npc0": 0.06551980773607889, "sim_compute_robot_state-npc1": 0.06715195576349894, "sim_compute_robot_state-npc2": 0.06727902889251709, "sim_compute_robot_state-npc3": 0.06773422559102377}, "udem1-1-0": {"driven_any": 0.2620307159014784, "sim_physics": 0.19681875602058743, "survival_time": 4.599999999999992, "driven_lanedir": 0.2007581032325696, "sim_render-ego": 0.062302146268927536, "in-drivable-lane": 0, "agent_compute-ego": 0.22820897206016208, "deviation-heading": 2.8325194303187367, "set_robot_commands": 0.09322389312412428, "deviation-center-line": 0.3000634994504862, "driven_lanedir_consec": 0.2007581032325696, "sim_compute_sim_state": 0.03838963353115579, "sim_compute_performance-ego": 0.06966473486112512, "sim_compute_robot_state-ego": 0.08571538977001024, "sim_compute_robot_state-npc0": 0.06807966854261316, "sim_compute_robot_state-npc1": 0.0702037733534108, "sim_compute_robot_state-npc2": 0.06908710365710051, "sim_compute_robot_state-npc3": 0.06694706885711006}, "udem1-2-0": {"driven_any": 0.25753960604347453, "sim_physics": 0.2120141203586872, "survival_time": 5.1999999999999895, "driven_lanedir": 0.2335541385306916, "sim_render-ego": 0.05877715578446022, "in-drivable-lane": 0, "agent_compute-ego": 0.23481189058377192, "deviation-heading": 1.6980359284497044, "set_robot_commands": 0.0936947029370528, "deviation-center-line": 0.4718926784650313, "driven_lanedir_consec": 0.2335541385306916, "sim_compute_sim_state": 0.040024759677740246, "sim_compute_performance-ego": 0.06687408685684204, "sim_compute_robot_state-ego": 0.0712010906292842, "sim_compute_robot_state-npc0": 0.0692095527282128, "sim_compute_robot_state-npc1": 0.07026367233349727, "sim_compute_robot_state-npc2": 0.0678731409402994, "sim_compute_robot_state-npc3": 0.07510059154950656}, "udem1-3-0": {"driven_any": 0.24847799601225284, "sim_physics": 0.2038402978111716, "survival_time": 5.09999999999999, "driven_lanedir": 0.22332016616871675, "sim_render-ego": 0.06286512870414585, "in-drivable-lane": 0, "agent_compute-ego": 0.22846691748675177, "deviation-heading": 1.6708489702252356, "set_robot_commands": 0.09709635902853574, "deviation-center-line": 0.42813660164628514, "driven_lanedir_consec": 0.22332016616871675, "sim_compute_sim_state": 0.03817312390196557, "sim_compute_performance-ego": 0.06928693079480938, "sim_compute_robot_state-ego": 0.06957602734659232, "sim_compute_robot_state-npc0": 0.06762482605728448, "sim_compute_robot_state-npc1": 0.06618110105103138, "sim_compute_robot_state-npc2": 0.06657329961365345, "sim_compute_robot_state-npc3": 0.06801009411905326}, "udem1-4-0": {"driven_any": 0.20206574170066413, "sim_physics": 0.1860748042523021, "survival_time": 3.5499999999999954, "driven_lanedir": 0.16382852995750974, "sim_render-ego": 0.060165532877747445, "in-drivable-lane": 0, "agent_compute-ego": 0.2172640175886557, "deviation-heading": 1.9795110448288469, "set_robot_commands": 0.0891741564576055, "deviation-center-line": 0.2465252790780381, "driven_lanedir_consec": 0.16382852995750974, "sim_compute_sim_state": 0.03812897709054007, "sim_compute_performance-ego": 0.06760104609207368, "sim_compute_robot_state-ego": 0.06692458878100759, "sim_compute_robot_state-npc0": 0.06673906890439316, "sim_compute_robot_state-npc1": 0.06292388136957733, "sim_compute_robot_state-npc2": 0.068656840794523, "sim_compute_robot_state-npc3": 0.06605044888778472}, "udem1-5-0": {"driven_any": 0.4331685489375123, "sim_physics": 0.2000454170688702, "survival_time": 7.84999999999998, "driven_lanedir": 0.38260196561550863, "sim_render-ego": 0.06370203813929466, "in-drivable-lane": 0, "agent_compute-ego": 0.2415526611789776, "deviation-heading": 2.956714451786154, "set_robot_commands": 0.09587904298381442, "deviation-center-line": 0.46707961540542464, "driven_lanedir_consec": 0.38260196561550863, "sim_compute_sim_state": 0.03947696412444874, "sim_compute_performance-ego": 0.07075702460708132, "sim_compute_robot_state-ego": 0.07607760247151563, "sim_compute_robot_state-npc0": 0.06989496225004743, "sim_compute_robot_state-npc1": 0.06908982878278015, "sim_compute_robot_state-npc2": 0.06940635298467746, "sim_compute_robot_state-npc3": 0.07041618778447437}, "udem1-6-0": {"driven_any": 0.23394699741347563, "sim_physics": 0.23721100644367496, "survival_time": 4.099999999999993, "driven_lanedir": 0.2035017732785924, "sim_render-ego": 0.06152047762056676, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.23898857395823409, "deviation-heading": 1.5075113991738265, "set_robot_commands": 0.09292444368688071, "deviation-center-line": 0.3450665138009798, "driven_lanedir_consec": 0.2035017732785924, "sim_compute_sim_state": 0.04060790015429985, "sim_compute_performance-ego": 0.06766475991504949, "sim_compute_robot_state-ego": 0.07504622238438304, "sim_compute_robot_state-npc0": 0.0707250252002623, "sim_compute_robot_state-npc1": 0.06998101385628305, "sim_compute_robot_state-npc2": 0.0685808077091124, "sim_compute_robot_state-npc3": 0.06799391130121743}, "udem1-7-0": {"driven_any": 0.3797590272392238, "sim_physics": 0.2055409062177615, "survival_time": 6.649999999999984, "driven_lanedir": 0.34696317730841675, "sim_render-ego": 0.0635410215621604, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.24186915921089344, "deviation-heading": 1.872437836044768, "set_robot_commands": 0.09649500990272464, "deviation-center-line": 0.40758279672041753, "driven_lanedir_consec": 0.34696317730841675, "sim_compute_sim_state": 0.03958721985494284, "sim_compute_performance-ego": 0.06865023849602032, "sim_compute_robot_state-ego": 0.07513610760968431, "sim_compute_robot_state-npc0": 0.07269831707603053, "sim_compute_robot_state-npc1": 0.06899623404768176, "sim_compute_robot_state-npc2": 0.06999711524275012, "sim_compute_robot_state-npc3": 0.06984812693488329}, "udem1-8-0": {"driven_any": 0.4243190309242091, "sim_physics": 0.196206357744005, "survival_time": 7.649999999999981, "driven_lanedir": 0.3819808891638923, "sim_render-ego": 0.06194762466779721, "in-drivable-lane": 0, "agent_compute-ego": 0.23917526357314167, "deviation-heading": 2.4668979054540587, "set_robot_commands": 0.09672758470173756, "deviation-center-line": 0.3435759248528973, "driven_lanedir_consec": 0.3819808891638923, "sim_compute_sim_state": 0.03975752132390839, "sim_compute_performance-ego": 0.06959277040818158, "sim_compute_robot_state-ego": 0.07317284041760015, "sim_compute_robot_state-npc0": 0.06779939988080193, "sim_compute_robot_state-npc1": 0.06878047207601709, "sim_compute_robot_state-npc2": 0.06888649822060579, "sim_compute_robot_state-npc3": 0.06818831200693168}, "udem1-9-0": {"driven_any": 0.22423763974034605, "sim_physics": 0.18175185981549716, "survival_time": 3.7999999999999945, "driven_lanedir": 0.174953714487605, "sim_render-ego": 0.05983439872139379, "in-drivable-lane": 0, "agent_compute-ego": 0.2113975286483765, "deviation-heading": 2.2521377298379983, "set_robot_commands": 0.08612369549901862, "deviation-center-line": 0.22760030166960857, "driven_lanedir_consec": 0.174953714487605, "sim_compute_sim_state": 0.03447467716116654, "sim_compute_performance-ego": 0.06102711276004189, "sim_compute_robot_state-ego": 0.06495931901429829, "sim_compute_robot_state-npc0": 0.062484273785039, "sim_compute_robot_state-npc1": 0.05949475890711734, "sim_compute_robot_state-npc2": 0.060785613561931406, "sim_compute_robot_state-npc3": 0.060433497554377505}, "udem1-10-0": {"driven_any": 0.20192586929782771, "sim_physics": 0.1915484769003732, "survival_time": 3.4999999999999956, "driven_lanedir": 0.15498158091396896, "sim_render-ego": 0.06434348991939, "in-drivable-lane": 0, "agent_compute-ego": 0.24213399205889025, "deviation-heading": 2.188384228601573, "set_robot_commands": 0.09371652943747384, "deviation-center-line": 0.21780603656335767, "driven_lanedir_consec": 0.15498158091396896, "sim_compute_sim_state": 0.03932844911302839, "sim_compute_performance-ego": 0.06774217401232038, "sim_compute_robot_state-ego": 0.07267369202205114, "sim_compute_robot_state-npc0": 0.06878953661237444, "sim_compute_robot_state-npc1": 0.06776583194732666, "sim_compute_robot_state-npc2": 0.06715310301099504, "sim_compute_robot_state-npc3": 0.06529207229614258}, "udem1-11-0": {"driven_any": 0.17701393467131604, "sim_physics": 0.18437342489919356, "survival_time": 3.099999999999997, "driven_lanedir": 0.14889401767513943, "sim_render-ego": 0.060865848295150266, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.23128903296685988, "deviation-heading": 1.3154979971200538, "set_robot_commands": 0.09231010175520374, "deviation-center-line": 0.31035969522360796, "driven_lanedir_consec": 0.14889401767513943, "sim_compute_sim_state": 0.03813902024299868, "sim_compute_performance-ego": 0.06568656813713812, "sim_compute_robot_state-ego": 0.07076869087834511, "sim_compute_robot_state-npc0": 0.06880049167140838, "sim_compute_robot_state-npc1": 0.06599762362818565, "sim_compute_robot_state-npc2": 0.06820079203574889, "sim_compute_robot_state-npc3": 0.06537056738330473}, "udem1-12-0": {"driven_any": 0.4245506941852552, "sim_physics": 0.2022929935698297, "survival_time": 7.84999999999998, "driven_lanedir": 0.3751772504599924, "sim_render-ego": 0.06167311121703713, "in-drivable-lane": 0, "agent_compute-ego": 0.2317621631986776, "deviation-heading": 2.8521095884224983, "set_robot_commands": 0.09424550669967748, "deviation-center-line": 0.49217432599840777, "driven_lanedir_consec": 0.3751772504599924, "sim_compute_sim_state": 0.03847483616725654, "sim_compute_performance-ego": 0.06669290202438452, "sim_compute_robot_state-ego": 0.0755421219358019, "sim_compute_robot_state-npc0": 0.06824915272415064, "sim_compute_robot_state-npc1": 0.06762675570834215, "sim_compute_robot_state-npc2": 0.06843221719097939, "sim_compute_robot_state-npc3": 0.06847855088057792}, "udem1-13-0": {"driven_any": 0.24844004471450756, "sim_physics": 0.14915235205130142, "survival_time": 4.399999999999992, "driven_lanedir": 0.22355620868168247, "sim_render-ego": 0.0491342463276603, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.17542841759595004, "deviation-heading": 1.4577276529188743, "set_robot_commands": 0.07114600051533092, "deviation-center-line": 0.3899795336283611, "driven_lanedir_consec": 0.22355620868168247, "sim_compute_sim_state": 0.0302080051465468, "sim_compute_performance-ego": 0.051859495314684784, "sim_compute_robot_state-ego": 0.052978491241281685, "sim_compute_robot_state-npc0": 0.052294167605313385, "sim_compute_robot_state-npc1": 0.05328217148780823, "sim_compute_robot_state-npc2": 0.05166075446388938, "sim_compute_robot_state-npc3": 0.05297154730016535}, "udem1-14-0": {"driven_any": 0.4063759019045222, "sim_physics": 0.1884101152420044, "survival_time": 7.499999999999981, "driven_lanedir": 0.371227711735457, "sim_render-ego": 0.06056747595469157, "in-drivable-lane": 0, "agent_compute-ego": 0.2317736800511678, "deviation-heading": 2.349856219950373, "set_robot_commands": 0.09408563137054445, "deviation-center-line": 0.3623481393019844, "driven_lanedir_consec": 0.371227711735457, "sim_compute_sim_state": 0.03790419101715088, "sim_compute_performance-ego": 0.06623583952585856, "sim_compute_robot_state-ego": 0.07271578788757324, "sim_compute_robot_state-npc0": 0.06731931527455648, "sim_compute_robot_state-npc1": 0.06801907221476237, "sim_compute_robot_state-npc2": 0.06563730557759603, "sim_compute_robot_state-npc3": 0.06789179166158041}}
set_robot_commands_max	0.09709635902853574
set_robot_commands_mean	0.09216919514716956
set_robot_commands_median	0.09371652943747384
set_robot_commands_min	0.07114600051533092
sim_compute_performance-ego_max	0.07075702460708132
sim_compute_performance-ego_mean	0.06641324985178752
sim_compute_performance-ego_median	0.06760104609207368
sim_compute_performance-ego_min	0.051859495314684784
sim_compute_robot_state-ego_max	0.08571538977001024
sim_compute_robot_state-ego_mean	0.07177301440045364
sim_compute_robot_state-ego_median	0.07271578788757324
sim_compute_robot_state-ego_min	0.052978491241281685
sim_compute_robot_state-npc0_max	0.07269831707603053
sim_compute_robot_state-npc0_mean	0.06708183773657114
sim_compute_robot_state-npc0_median	0.06807966854261316
sim_compute_robot_state-npc0_min	0.052294167605313385
sim_compute_robot_state-npc1_max	0.07026367233349727
sim_compute_robot_state-npc1_mean	0.06638387643515467
sim_compute_robot_state-npc1_median	0.06776583194732666
sim_compute_robot_state-npc1_min	0.05328217148780823
sim_compute_robot_state-npc2_max	0.06999711524275012
sim_compute_robot_state-npc2_mean	0.06654733159309197
sim_compute_robot_state-npc2_median	0.06820079203574889
sim_compute_robot_state-npc2_min	0.05166075446388938
sim_compute_robot_state-npc3_max	0.07510059154950656
sim_compute_robot_state-npc3_mean	0.06671513294054224
sim_compute_robot_state-npc3_median	0.06789179166158041
sim_compute_robot_state-npc3_min	0.05297154730016535
sim_compute_sim_state_max	0.04060790015429985
sim_compute_sim_state_mean	0.03801837804068964
sim_compute_sim_state_median	0.03838963353115579
sim_compute_sim_state_min	0.0302080051465468
sim_physics_max	0.23721100644367496
sim_physics_mean	0.19465825035285617
sim_physics_median	0.196206357744005
sim_physics_min	0.14915235205130142
sim_render-ego_max	0.06434348991939
sim_render-ego_mean	0.060765182635175136
sim_render-ego_median	0.06152047762056676
sim_render-ego_min	0.0491342463276603
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	5.389999999999988
survival_time_min	3.099999999999997

No reset possible

21128

2676

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 19:18:06+00:00

2019-04-27 20:00:12+00:00

0:42:06

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2676/step1-simulation-ip-172-31-40-253-32059-job21128/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21111

2628

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 19:00:12+00:00

2019-04-27 19:17:32+00:00

0:17:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.20141225832479973
agent_compute-ego_mean	0.1548033792606026
agent_compute-ego_median	0.15033777554829916
agent_compute-ego_min	0.13636588077155912
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.15821721818712023, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.07836919360690647, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.20141225832479973, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1335587324919524, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04822171617437293, "sim_compute_performance-ego": 0.0909911968089916, "sim_compute_robot_state-ego": 0.1042792002360026}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.103483751708386, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05832276157304352, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14518084713056975, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09145892835130878, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0356906068091299, "sim_compute_performance-ego": 0.06348807671490837, "sim_compute_robot_state-ego": 0.06824229277816474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.12402855648713954, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06633917023153867, "in-drivable-lane": 0, "agent_compute-ego": 0.14130272584802964, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09197929326225728, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03788294511682847, "sim_compute_performance-ego": 0.06333370769725126, "sim_compute_robot_state-ego": 0.07576950858621036}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11388741493225098, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0579611873626709, "in-drivable-lane": 0, "agent_compute-ego": 0.154260311126709, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09478455543518066, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.037452917098999026, "sim_compute_performance-ego": 0.06311759948730469, "sim_compute_robot_state-ego": 0.06565567970275879}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10878920253319076, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.061186932310273376, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13835653172263615, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08929173252250575, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.037430850765373135, "sim_compute_performance-ego": 0.06644548645502404, "sim_compute_robot_state-ego": 0.0708245657667329}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.09088379023026448, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.0546087342865613, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.13636588077155912, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.0832179322534678, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03500561811486069, "sim_compute_performance-ego": 0.06078823731870067, "sim_compute_robot_state-ego": 0.06541380103753537}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.11437495691435676, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06551675285611834, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1499244783605848, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.09639846427100043, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.03788096564156669, "sim_compute_performance-ego": 0.08055973478725978, "sim_compute_robot_state-ego": 0.07702770829200745}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.12710489545549666, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06737774894351051, "in-drivable-lane": 0, "agent_compute-ego": 0.15033777554829916, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.09440196128118604, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04056281135195777, "sim_compute_performance-ego": 0.0676185857682001, "sim_compute_robot_state-ego": 0.07518282390776135}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.1163892948021323, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06167796102620787, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14727205341145144, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.09864989377684512, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03884343373573432, "sim_compute_performance-ego": 0.06765924065800036, "sim_compute_robot_state-ego": 0.07439172065864175}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.12700259468772196, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06677891557866877, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.16224064826965331, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10429550084200773, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.041891258413141425, "sim_compute_performance-ego": 0.07793222340670498, "sim_compute_robot_state-ego": 0.08296211849559437}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.1246110371180943, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06261415915055708, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15459710591799253, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.09782043989602622, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.038646118981497626, "sim_compute_performance-ego": 0.07147439424093667, "sim_compute_robot_state-ego": 0.077466614834674}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12644641739981516, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06311629499707903, "in-drivable-lane": 0, "agent_compute-ego": 0.14906644821166992, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.08784280504499163, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.03848956312452044, "sim_compute_performance-ego": 0.07145343508039202, "sim_compute_robot_state-ego": 0.07160934380122594}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.12817279497782388, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06488391464831782, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.17160162738725251, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.10788501945196412, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04289405486162971, "sim_compute_performance-ego": 0.0756842996559891, "sim_compute_robot_state-ego": 0.0949847324221742}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.1283595738587556, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06946803905345776, "in-drivable-lane": 0, "agent_compute-ego": 0.16052662001715767, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10482658280266656, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04084205627441406, "sim_compute_performance-ego": 0.07230909665425618, "sim_compute_robot_state-ego": 0.0759589848694978}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12373170899409874, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06412648687175676, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1596053768606747, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.09878335747064328, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.040434465688817645, "sim_compute_performance-ego": 0.07067718225366929, "sim_compute_robot_state-ego": 0.07648238013772403}}
set_robot_commands_max	0.1335587324919524
set_robot_commands_mean	0.09834634661026694
set_robot_commands_median	0.09639846427100043
set_robot_commands_min	0.0832179322534678
sim_compute_performance-ego_max	0.0909911968089916
sim_compute_performance-ego_mean	0.07090216646583929
sim_compute_performance-ego_median	0.07067718225366929
sim_compute_performance-ego_min	0.06078823731870067
sim_compute_robot_state-ego_max	0.1042792002360026
sim_compute_robot_state-ego_mean	0.07708343170178036
sim_compute_robot_state-ego_median	0.07576950858621036
sim_compute_robot_state-ego_min	0.06541380103753537
sim_compute_sim_state_max	0.04822171617437293
sim_compute_sim_state_mean	0.03947795881018958
sim_compute_sim_state_median	0.038646118981497626
sim_compute_sim_state_min	0.03500561811486069
sim_physics_max	0.15821721818712023
sim_physics_mean	0.12103221388577652
sim_physics_median	0.12402855648713954
sim_physics_min	0.09088379023026448
sim_render-ego_max	0.07836919360690647
sim_render-ego_mean	0.06415655016644455
sim_render-ego_median	0.06412648687175676
sim_render-ego_min	0.0546087342865613
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

21092

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 18:17:32+00:00

2019-04-27 19:00:04+00:00

0:42:32

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2698/step1-simulation-ip-172-31-40-253-32059-job21092/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21079

2712

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 18:00:24+00:00

2019-04-27 18:17:18+00:00

0:16:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.205255212058848
survival_time_median	2.1500000000000004
deviation-center-line_median	0.1889035624299865
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.094890034198761
agent_compute-ego_mean	0.09008723548914813
agent_compute-ego_median	0.08878666354763892
agent_compute-ego_min	0.08464749881199428
deviation-center-line_max	0.73674681363687
deviation-center-line_mean	0.2837896020845571
deviation-center-line_min	0.11913585245263653
deviation-heading_max	6.78802516661512
deviation-heading_mean	2.049106931327384
deviation-heading_median	1.1229104932336786
deviation-heading_min	0.3772617004053626
driven_any_max	2.3487558290191037
driven_any_mean	0.7191553187152808
driven_any_median	0.2918728453997954
driven_any_min	0.1954658066951464
driven_lanedir_consec_max	1.0848274877437942
driven_lanedir_consec_mean	0.3861947165800535
driven_lanedir_consec_min	0.18521785667464652
driven_lanedir_max	1.1109154440962932
driven_lanedir_mean	0.3948571237606835
driven_lanedir_median	0.205255212058848
driven_lanedir_min	0.18521785667464652
in-drivable-lane_max	4.800000000000056
in-drivable-lane_mean	1.1800000000000106
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.4919308097017613, "sim_physics": 0.23347014359065463, "survival_time": 3.4999999999999956, "driven_lanedir": 0.202739480643104, "sim_render-ego": 0.06128511428833008, "in-drivable-lane": 1.099999999999997, "agent_compute-ego": 0.08464749881199428, "deviation-heading": 1.4049471311246993, "set_robot_commands": 0.11186794553484236, "deviation-center-line": 0.23161603567394012, "driven_lanedir_consec": 0.18551540109245312, "sim_compute_sim_state": 0.034445244925362724, "sim_compute_performance-ego": 0.06502267973763602, "sim_compute_robot_state-ego": 0.07970905644553049, "sim_compute_robot_state-npc0": 0.06965141977582659, "sim_compute_robot_state-npc1": 0.06394426141466414, "sim_compute_robot_state-npc2": 0.06478560992649623, "sim_compute_robot_state-npc3": 0.06262044906616211}, "udem1-1-0": {"driven_any": 0.267751302760597, "sim_physics": 0.27984371185302737, "survival_time": 2.000000000000001, "driven_lanedir": 0.205255212058848, "sim_render-ego": 0.07608953714370728, "in-drivable-lane": 0, "agent_compute-ego": 0.09427844882011412, "deviation-heading": 1.1229104932336786, "set_robot_commands": 0.13457974791526794, "deviation-center-line": 0.11913585245263653, "driven_lanedir_consec": 0.205255212058848, "sim_compute_sim_state": 0.04574816226959229, "sim_compute_performance-ego": 0.08129372596740722, "sim_compute_robot_state-ego": 0.09003083109855652, "sim_compute_robot_state-npc0": 0.08192483186721802, "sim_compute_robot_state-npc1": 0.08328126668930054, "sim_compute_robot_state-npc2": 0.0780512809753418, "sim_compute_robot_state-npc3": 0.08309395909309387}, "udem1-2-0": {"driven_any": 0.1954658066951464, "sim_physics": 0.29299969826975175, "survival_time": 1.5500000000000007, "driven_lanedir": 0.18521785667464652, "sim_render-ego": 0.06865933633619739, "in-drivable-lane": 0, "agent_compute-ego": 0.08878666354763892, "deviation-heading": 0.3772617004053626, "set_robot_commands": 0.11370441221421763, "deviation-center-line": 0.1425457462293525, "driven_lanedir_consec": 0.18521785667464652, "sim_compute_sim_state": 0.04285743159632529, "sim_compute_performance-ego": 0.07359473166927215, "sim_compute_robot_state-ego": 0.08852894844547395, "sim_compute_robot_state-npc0": 0.07749940503028131, "sim_compute_robot_state-npc1": 0.07664824301196684, "sim_compute_robot_state-npc2": 0.0757834372981902, "sim_compute_robot_state-npc3": 0.07634974295093168}, "udem1-3-0": {"driven_any": 0.2918728453997954, "sim_physics": 0.2681492761124012, "survival_time": 2.1500000000000004, "driven_lanedir": 0.270157625330526, "sim_render-ego": 0.06994580113610556, "in-drivable-lane": 0, "agent_compute-ego": 0.08783353206723235, "deviation-heading": 0.55239016525806, "set_robot_commands": 0.11900820843009062, "deviation-center-line": 0.1889035624299865, "driven_lanedir_consec": 0.270157625330526, "sim_compute_sim_state": 0.04218088194381359, "sim_compute_performance-ego": 0.07453780396040095, "sim_compute_robot_state-ego": 0.08932843873667162, "sim_compute_robot_state-npc0": 0.07590187982071278, "sim_compute_robot_state-npc1": 0.07354428047357603, "sim_compute_robot_state-npc2": 0.0752597076948299, "sim_compute_robot_state-npc3": 0.0768994508787643}, "udem1-4-0": {"driven_any": 2.3487558290191037, "sim_physics": 0.26208980480829874, "survival_time": 14.950000000000076, "driven_lanedir": 1.1109154440962932, "sim_render-ego": 0.07403369665145874, "in-drivable-lane": 4.800000000000056, "agent_compute-ego": 0.094890034198761, "deviation-heading": 6.78802516661512, "set_robot_commands": 0.11956961552302042, "deviation-center-line": 0.73674681363687, "driven_lanedir_consec": 1.0848274877437942, "sim_compute_sim_state": 0.04417143185933431, "sim_compute_performance-ego": 0.08167195638020833, "sim_compute_robot_state-ego": 0.092216792901357, "sim_compute_robot_state-npc0": 0.07911267995834351, "sim_compute_robot_state-npc1": 0.07902647654215494, "sim_compute_robot_state-npc2": 0.08087538401285807, "sim_compute_robot_state-npc3": 0.08077950080235799}}
set_robot_commands_max	0.13457974791526794
set_robot_commands_mean	0.1197459859234878
set_robot_commands_median	0.11900820843009062
set_robot_commands_min	0.11186794553484236
sim_compute_performance-ego_max	0.08167195638020833
sim_compute_performance-ego_mean	0.07522417954298492
sim_compute_performance-ego_median	0.07453780396040095
sim_compute_performance-ego_min	0.06502267973763602
sim_compute_robot_state-ego_max	0.092216792901357
sim_compute_robot_state-ego_mean	0.08796281352551791
sim_compute_robot_state-ego_median	0.08932843873667162
sim_compute_robot_state-ego_min	0.07970905644553049
sim_compute_robot_state-npc0_max	0.08192483186721802
sim_compute_robot_state-npc0_mean	0.07681804329047644
sim_compute_robot_state-npc0_median	0.07749940503028131
sim_compute_robot_state-npc0_min	0.06965141977582659
sim_compute_robot_state-npc1_max	0.08328126668930054
sim_compute_robot_state-npc1_mean	0.07528890562633249
sim_compute_robot_state-npc1_median	0.07664824301196684
sim_compute_robot_state-npc1_min	0.06394426141466414
sim_compute_robot_state-npc2_max	0.08087538401285807
sim_compute_robot_state-npc2_mean	0.07495108398154324
sim_compute_robot_state-npc2_median	0.0757834372981902
sim_compute_robot_state-npc2_min	0.06478560992649623
sim_compute_robot_state-npc3_max	0.08309395909309387
sim_compute_robot_state-npc3_mean	0.07594862055826199
sim_compute_robot_state-npc3_median	0.0768994508787643
sim_compute_robot_state-npc3_min	0.06262044906616211
sim_compute_sim_state_max	0.04574816226959229
sim_compute_sim_state_mean	0.041880630518885645
sim_compute_sim_state_median	0.04285743159632529
sim_compute_sim_state_min	0.034445244925362724
sim_physics_max	0.29299969826975175
sim_physics_mean	0.2673105269268267
sim_physics_median	0.2681492761124012
sim_physics_min	0.23347014359065463
sim_render-ego_max	0.07608953714370728
sim_render-ego_mean	0.07000269711115982
sim_render-ego_median	0.06994580113610556
sim_render-ego_min	0.06128511428833008
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.830000000000015
survival_time_min	1.5500000000000007

No reset possible

21072

2699

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 17:49:21+00:00

2019-04-27 18:00:07+00:00

0:10:46

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2699/step1-simulation-ip-172-31-40-253-32059-job21072/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21064

2716

test for ppo

step1-simulation

error

2019-04-27 17:47:14+00:00

2019-04-27 17:48:52+00:00

0:01:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21034

2762

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 17:18:02+00:00

2019-04-27 17:46:53+00:00

0:28:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2875407694053156
survival_time_median	2.849999999999998
deviation-center-line_median	0.11031194850197353
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.07897885640462239
agent_compute-ego_mean	0.07406605292803119
agent_compute-ego_median	0.07396809543882098
agent_compute-ego_min	0.06996666666973068
deviation-center-line_max	0.2701922695523504
deviation-center-line_mean	0.13746050030700233
deviation-center-line_min	0.07113819587235681
deviation-heading_max	1.4854398920276677
deviation-heading_mean	0.7236995121312619
deviation-heading_median	0.6953408166028192
deviation-heading_min	0.3118646573709166
driven_any_max	1.934434121703833
driven_any_mean	0.806757806634148
driven_any_median	0.8072381933001392
driven_any_min	0.20912585880423715
driven_lanedir_consec_max	0.7222251056746308
driven_lanedir_consec_mean	0.3962831867516217
driven_lanedir_consec_min	0.1917983424483971
driven_lanedir_max	0.7287863177121016
driven_lanedir_mean	0.3975640776898326
driven_lanedir_median	0.2875407694053156
driven_lanedir_min	0.1917983424483971
in-drivable-lane_max	4.04999999999999
in-drivable-lane_mean	1.2133333333333305
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.21483797912138053, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06536581717341779, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.06996666666973068, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.09741794632141848, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.04145184482436582, "sim_compute_performance-ego": 0.07059014274413328, "sim_compute_robot_state-ego": 0.07750354617475028, "sim_compute_robot_state-npc0": 0.0702127146433635, "sim_compute_robot_state-npc1": 0.06980373773230128, "sim_compute_robot_state-npc2": 0.07008849856365158, "sim_compute_robot_state-npc3": 0.07247990297983928}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.2094970632482458, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06703966635244864, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07190158632066515, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.09859591060214572, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.03783922725253635, "sim_compute_performance-ego": 0.07073338826497395, "sim_compute_robot_state-ego": 0.07070020393089012, "sim_compute_robot_state-npc0": 0.07041309497974536, "sim_compute_robot_state-npc1": 0.06756161760400843, "sim_compute_robot_state-npc2": 0.0711229818838614, "sim_compute_robot_state-npc3": 0.0708711235611527}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.21387859796866393, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06701288773463322, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07247491066272442, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.09705676482273982, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.043126956010476135, "sim_compute_performance-ego": 0.07191915389819023, "sim_compute_robot_state-ego": 0.07500650332524227, "sim_compute_robot_state-npc0": 0.06809898217519124, "sim_compute_robot_state-npc1": 0.07469713993561573, "sim_compute_robot_state-npc2": 0.0734864014845628, "sim_compute_robot_state-npc3": 0.07541338602701823}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.2360410773963259, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06632248978865773, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.07301192952875506, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.10293816265306976, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.04133361682557223, "sim_compute_performance-ego": 0.07430166528936018, "sim_compute_robot_state-ego": 0.08351584902980871, "sim_compute_robot_state-npc0": 0.07383910814921062, "sim_compute_robot_state-npc1": 0.07163291646723162, "sim_compute_robot_state-npc2": 0.07218256331326668, "sim_compute_robot_state-npc3": 0.07620826102139656}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.21130353471507196, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06261509397755498, "in-drivable-lane": 0, "agent_compute-ego": 0.07058753138003142, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.0953083556631337, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.04291351981784986, "sim_compute_performance-ego": 0.07225775718688965, "sim_compute_robot_state-ego": 0.07010796795720639, "sim_compute_robot_state-npc0": 0.07061330131862474, "sim_compute_robot_state-npc1": 0.06631736133409583, "sim_compute_robot_state-npc2": 0.07158499178679092, "sim_compute_robot_state-npc3": 0.07543324387591818}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.2114899509093341, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06434539486380185, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07429600930681415, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.0999738468843348, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.039062093285953295, "sim_compute_performance-ego": 0.07040310139749564, "sim_compute_robot_state-ego": 0.07543983880211325, "sim_compute_robot_state-npc0": 0.07291167623856488, "sim_compute_robot_state-npc1": 0.07200746676501106, "sim_compute_robot_state-npc2": 0.07127056402318618, "sim_compute_robot_state-npc3": 0.07410261677760704}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.2260861703327724, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.06466546058654785, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.0764878375189645, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.10359716585704258, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.04133534261158534, "sim_compute_performance-ego": 0.07431079489844186, "sim_compute_robot_state-ego": 0.08361266851425171, "sim_compute_robot_state-npc0": 0.0727272629737854, "sim_compute_robot_state-npc1": 0.07392388582229614, "sim_compute_robot_state-npc2": 0.07455738271985735, "sim_compute_robot_state-npc3": 0.07394624948501587}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.2192172775529835, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06496348119761845, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07153816092504214, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10522729076751292, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.041534645916664434, "sim_compute_performance-ego": 0.07091449384819971, "sim_compute_robot_state-ego": 0.07714416229561584, "sim_compute_robot_state-npc0": 0.07232291077914303, "sim_compute_robot_state-npc1": 0.06869517940364472, "sim_compute_robot_state-npc2": 0.07001964686668083, "sim_compute_robot_state-npc3": 0.07040658062451506}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.19868468406588533, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06464064121246338, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07259100259736527, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.09899546933728597, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.040227729220723, "sim_compute_performance-ego": 0.07290605888810268, "sim_compute_robot_state-ego": 0.07781216155651004, "sim_compute_robot_state-npc0": 0.07156230405319569, "sim_compute_robot_state-npc1": 0.07375431615252827, "sim_compute_robot_state-npc2": 0.07421635195266368, "sim_compute_robot_state-npc3": 0.07179570475289988}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.2468120226493249, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.0691754542864286, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07630050182342529, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.10694833902212288, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.038577611629779525, "sim_compute_performance-ego": 0.07381959144885723, "sim_compute_robot_state-ego": 0.07699739933013916, "sim_compute_robot_state-npc0": 0.06974045129922721, "sim_compute_robot_state-npc1": 0.07453901034135085, "sim_compute_robot_state-npc2": 0.06787705421447754, "sim_compute_robot_state-npc3": 0.06834865533388577}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.19835036913553877, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06498844464619954, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07508366266886393, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09981764475504558, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.04055782636006673, "sim_compute_performance-ego": 0.07471411069234213, "sim_compute_robot_state-ego": 0.07904950141906739, "sim_compute_robot_state-npc0": 0.07156745274861653, "sim_compute_robot_state-npc1": 0.07115076382954916, "sim_compute_robot_state-npc2": 0.07192651430765788, "sim_compute_robot_state-npc3": 0.072162291208903}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.2247028010232108, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06657464163643974, "in-drivable-lane": 0, "agent_compute-ego": 0.07895974885849726, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.11628341674804688, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.03978848457336426, "sim_compute_performance-ego": 0.07136805852254231, "sim_compute_robot_state-ego": 0.07677283741178967, "sim_compute_robot_state-npc0": 0.07616943404788062, "sim_compute_robot_state-npc1": 0.07151911372230166, "sim_compute_robot_state-npc2": 0.07287125360398065, "sim_compute_robot_state-npc3": 0.07508007685343425}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.22679799102073492, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.06173335674197175, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07484429381614507, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.09646931359934252, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.042203226754831714, "sim_compute_performance-ego": 0.06987339951271235, "sim_compute_robot_state-ego": 0.07961990666943927, "sim_compute_robot_state-npc0": 0.0731612804324128, "sim_compute_robot_state-npc1": 0.07156981423843739, "sim_compute_robot_state-npc2": 0.07360740040623864, "sim_compute_robot_state-npc3": 0.06940583850062171}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.21568438836506432, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06538152694702148, "in-drivable-lane": 0, "agent_compute-ego": 0.07396809543882098, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.09979733398982456, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.038460493087768555, "sim_compute_performance-ego": 0.06942346266337804, "sim_compute_robot_state-ego": 0.07667347363063268, "sim_compute_robot_state-npc0": 0.07648993389947074, "sim_compute_robot_state-npc1": 0.07531573942729405, "sim_compute_robot_state-npc2": 0.07078600781304496, "sim_compute_robot_state-npc3": 0.06864598819187709}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.2680225793053122, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06838822832294539, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.07897885640462239, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.10303117247188792, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.04148241117888806, "sim_compute_performance-ego": 0.07425267556134392, "sim_compute_robot_state-ego": 0.08246294657389323, "sim_compute_robot_state-npc0": 0.0753477414449056, "sim_compute_robot_state-npc1": 0.07589046627867456, "sim_compute_robot_state-npc2": 0.0770100799261355, "sim_compute_robot_state-npc3": 0.07489663946862314}}
set_robot_commands_max	0.11628341674804688
set_robot_commands_mean	0.10143054223299695
set_robot_commands_median	0.09981764475504558
set_robot_commands_min	0.0953083556631337
sim_compute_performance-ego_max	0.07471411069234213
sim_compute_performance-ego_mean	0.07211919032113087
sim_compute_performance-ego_median	0.07191915389819023
sim_compute_performance-ego_min	0.06942346266337804
sim_compute_robot_state-ego_max	0.08361266851425171
sim_compute_robot_state-ego_mean	0.07749459777475667
sim_compute_robot_state-ego_median	0.07714416229561584
sim_compute_robot_state-ego_min	0.07010796795720639
sim_compute_robot_state-npc0_max	0.07648993389947074
sim_compute_robot_state-npc0_mean	0.07234517661222253
sim_compute_robot_state-npc0_median	0.07232291077914303
sim_compute_robot_state-npc0_min	0.06809898217519124
sim_compute_robot_state-npc1_max	0.07589046627867456
sim_compute_robot_state-npc1_mean	0.07189190193695606
sim_compute_robot_state-npc1_median	0.07163291646723162
sim_compute_robot_state-npc1_min	0.06631736133409583
sim_compute_robot_state-npc2_max	0.0770100799261355
sim_compute_robot_state-npc2_mean	0.07217384619107044
sim_compute_robot_state-npc2_median	0.07192651430765788
sim_compute_robot_state-npc2_min	0.06787705421447754
sim_compute_robot_state-npc3_max	0.07620826102139656
sim_compute_robot_state-npc3_mean	0.07261310391084717
sim_compute_robot_state-npc3_median	0.07247990297983928
sim_compute_robot_state-npc3_min	0.06834865533388577
sim_compute_sim_state_max	0.043126956010476135
sim_compute_sim_state_mean	0.040659668623361685
sim_compute_sim_state_median	0.04133361682557223
sim_compute_sim_state_min	0.03783922725253635
sim_physics_max	0.2680225793053122
sim_physics_mean	0.22142709912065656
sim_physics_median	0.21568438836506432
sim_physics_min	0.19835036913553877
sim_render-ego_max	0.0691754542864286
sim_render-ego_mean	0.06554750569787669
sim_render-ego_median	0.06536581717341779
sim_render-ego_min	0.06173335674197175
simulation-passed	1
survival_time_max	6.999999999999983
survival_time_mean	3.043333333333329
survival_time_min	1.0500000000000005

No reset possible

21006

2814

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 17:00:21+00:00

2019-04-27 17:17:54+00:00

0:17:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.18834105244389288
agent_compute-ego_mean	0.15511383230614442
agent_compute-ego_median	0.15486599884781185
agent_compute-ego_min	0.11967050552368164
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1402201255162557, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.0703696674770779, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.18834105244389288, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.12359732610208016, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.045708276607372145, "sim_compute_performance-ego": 0.0776286522547404, "sim_compute_robot_state-ego": 0.09070337701726842}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1070864387587005, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.0616294963687074, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1473695063123516, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09261549687853046, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03809846616258808, "sim_compute_performance-ego": 0.07056957600163478, "sim_compute_robot_state-ego": 0.07453159257477406}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10724998922909008, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05854954439051011, "in-drivable-lane": 0, "agent_compute-ego": 0.13849278057322784, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0826278574326459, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03589149082408232, "sim_compute_performance-ego": 0.06959926380830653, "sim_compute_robot_state-ego": 0.07007579242481905}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.0820398235321045, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.046391839981079104, "in-drivable-lane": 0, "agent_compute-ego": 0.11967050552368164, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.07069799423217774, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0297952938079834, "sim_compute_performance-ego": 0.05015077590942383, "sim_compute_robot_state-ego": 0.05466794967651367}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10777020152611068, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.059136429919472225, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.142016537581818, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0863367485094674, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0349956102009061, "sim_compute_performance-ego": 0.05989051770560349, "sim_compute_robot_state-ego": 0.06847893739048438}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.12430192986313178, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06777262201114577, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.1567809435786033, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10127870403990454, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04070624040097606, "sim_compute_performance-ego": 0.07199851834044164, "sim_compute_robot_state-ego": 0.08212000496533452}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.1254003984587533, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06758039338248116, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.16994147215570723, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10429561989648002, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.043581094060625346, "sim_compute_performance-ego": 0.07690169981547765, "sim_compute_robot_state-ego": 0.0845929639680045}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.13028781754629953, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06276542799813407, "in-drivable-lane": 0, "agent_compute-ego": 0.15391413370768228, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10218534015473864, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.040568147386823385, "sim_compute_performance-ego": 0.07086088543846494, "sim_compute_robot_state-ego": 0.07120744387308757}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.13135246503151068, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06437999515210167, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15895668934967558, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.10070264541496664, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.04057840977684926, "sim_compute_performance-ego": 0.07133638252646236, "sim_compute_robot_state-ego": 0.08392276602276301}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.1326463135805997, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06487404216419566, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.15732033469460227, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.0969397241419012, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03827079859646884, "sim_compute_performance-ego": 0.07066773501309481, "sim_compute_robot_state-ego": 0.06995990059592506}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.13533178552404626, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06725307563682656, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.16879727004410386, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.1049211613543622, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.041611346331509674, "sim_compute_performance-ego": 0.07356178296076787, "sim_compute_robot_state-ego": 0.08669507039057744}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12834655387060984, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06213828495570591, "in-drivable-lane": 0, "agent_compute-ego": 0.15463355609348842, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.09853019033159528, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.04219286782400949, "sim_compute_performance-ego": 0.06980371475219727, "sim_compute_robot_state-ego": 0.07637467554637364}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11594174889957204, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.060568716011795344, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15486599884781185, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09326885728275076, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04248960812886556, "sim_compute_performance-ego": 0.06769397212009803, "sim_compute_robot_state-ego": 0.07427128156026204}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.12463846030058684, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06476435837922273, "in-drivable-lane": 0, "agent_compute-ego": 0.15238051061277036, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.09218056996663412, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04133921199374729, "sim_compute_performance-ego": 0.0646644256733082, "sim_compute_robot_state-ego": 0.0739174418979221}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.119302560301388, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06617487645616718, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16322619307274913, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.09936927346622244, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04194081063364066, "sim_compute_performance-ego": 0.07462899357664819, "sim_compute_robot_state-ego": 0.08381345459059172}}
set_robot_commands_max	0.12359732610208016
set_robot_commands_mean	0.0966365006136305
set_robot_commands_median	0.09853019033159528
set_robot_commands_min	0.07069799423217774
sim_compute_performance-ego_max	0.0776286522547404
sim_compute_performance-ego_mean	0.06933045972644467
sim_compute_performance-ego_median	0.07066773501309481
sim_compute_performance-ego_min	0.05015077590942383
sim_compute_robot_state-ego_max	0.09070337701726842
sim_compute_robot_state-ego_mean	0.07635551016631341
sim_compute_robot_state-ego_median	0.07453159257477406
sim_compute_robot_state-ego_min	0.05466794967651367
sim_compute_sim_state_max	0.045708276607372145
sim_compute_sim_state_mean	0.03985117818242983
sim_compute_sim_state_median	0.04070624040097606
sim_compute_sim_state_min	0.0297952938079834
sim_physics_max	0.1402201255162557
sim_physics_mean	0.12079444079591732
sim_physics_median	0.12463846030058684
sim_physics_min	0.0820398235321045
sim_render-ego_max	0.0703696674770779
sim_render-ego_mean	0.06295658468564153
sim_render-ego_median	0.06437999515210167
sim_render-ego_min	0.046391839981079104
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

20960

2864

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 16:00:41+00:00

2019-04-27 17:00:09+00:00

0:59:28

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-40-253-32059-job20960/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20923

2981

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 15:02:46+00:00

2019-04-27 16:00:10+00:00

0:57:24

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2981/step1-simulation-ip-172-31-40-253-32059-job20923/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20920

2933

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 15:01:28+00:00

2019-04-27 15:02:25+00:00

0:00:57

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20862

3078

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 14:00:32+00:00

2019-04-27 15:00:04+00:00

0:59:32

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3078/step1-simulation-ip-172-31-40-253-32059-job20862/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20837

3063

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-27 13:41:42+00:00

2019-04-27 14:00:11+00:00

0:18:29

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission3063/step1-simulation-ip-172-31-40-253-32059-job20837/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20822

2661

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 13:17:24+00:00

2019-04-27 13:41:26+00:00

0:24:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7491476802545606
survival_time_median	5.1999999999999895
deviation-center-line_median	0.4691887034572556
in-drivable-lane_median	0.8999999999999979

other stats

agent_compute-ego_max	0.08918480034712907
agent_compute-ego_mean	0.08661178766091744
agent_compute-ego_median	0.08643222451210023
agent_compute-ego_min	0.0848591627717829
deviation-center-line_max	0.9092807034888656
deviation-center-line_mean	0.5084096426713257
deviation-center-line_min	0.16695173043736486
deviation-heading_max	6.060335836300683
deviation-heading_mean	3.02698303931965
deviation-heading_median	2.095568483733886
deviation-heading_min	0.44394731731572495
driven_any_max	2.3086002589957206
driven_any_mean	1.2462518775358675
driven_any_median	0.7820273341081003
driven_any_min	0.26777658976836893
driven_lanedir_consec_max	1.3202942074913118
driven_lanedir_consec_mean	0.7092227508596112
driven_lanedir_consec_min	0.1702786782941592
driven_lanedir_max	1.6968600510849163
driven_lanedir_mean	0.8644656399917123
driven_lanedir_median	0.7503775918192802
driven_lanedir_min	0.25700021834149167
in-drivable-lane_max	4.25000000000001
in-drivable-lane_mean	1.3200000000000032
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.6605828291070196, "sim_physics": 0.24675581481430556, "survival_time": 4.549999999999992, "driven_lanedir": 0.3650421494096312, "sim_render-ego": 0.07025437564640255, "in-drivable-lane": 0.8999999999999979, "agent_compute-ego": 0.08918480034712907, "deviation-heading": 2.095568483733886, "set_robot_commands": 0.10723547097090835, "deviation-center-line": 0.36437103885117395, "driven_lanedir_consec": 0.1702786782941592, "sim_compute_sim_state": 0.04281544947362208, "sim_compute_performance-ego": 0.07757308194925497, "sim_compute_robot_state-ego": 0.09003096360426682, "sim_compute_robot_state-npc0": 0.07521324891310471, "sim_compute_robot_state-npc1": 0.0758714911701915, "sim_compute_robot_state-npc2": 0.07704994966695597, "sim_compute_robot_state-npc3": 0.0784454712500939}, "udem1-1-0": {"driven_any": 2.3086002589957206, "sim_physics": 0.22180140991600192, "survival_time": 14.700000000000074, "driven_lanedir": 1.253048189303242, "sim_render-ego": 0.06839391082322517, "in-drivable-lane": 4.25000000000001, "agent_compute-ego": 0.0848591627717829, "deviation-heading": 6.060335836300683, "set_robot_commands": 0.10694665892594524, "deviation-center-line": 0.6322560371219684, "driven_lanedir_consec": 1.049392969916533, "sim_compute_sim_state": 0.04392205939000966, "sim_compute_performance-ego": 0.0750029435774096, "sim_compute_robot_state-ego": 0.08138685161564625, "sim_compute_robot_state-npc0": 0.07562630841521178, "sim_compute_robot_state-npc1": 0.07512414698698083, "sim_compute_robot_state-npc2": 0.07583662766177639, "sim_compute_robot_state-npc3": 0.07619398143015751}, "udem1-2-0": {"driven_any": 0.7820273341081003, "sim_physics": 0.2621974509495955, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7503775918192802, "sim_render-ego": 0.06941448954435495, "in-drivable-lane": 0, "agent_compute-ego": 0.08611030532763554, "deviation-heading": 1.111011830855131, "set_robot_commands": 0.11248579162817736, "deviation-center-line": 0.4691887034572556, "driven_lanedir_consec": 0.7491476802545606, "sim_compute_sim_state": 0.04349018747989948, "sim_compute_performance-ego": 0.07630176498339726, "sim_compute_robot_state-ego": 0.08720463972825271, "sim_compute_robot_state-npc0": 0.07728100052246681, "sim_compute_robot_state-npc1": 0.07688632836708656, "sim_compute_robot_state-npc2": 0.08013599194013156, "sim_compute_robot_state-npc3": 0.07636067041983971}, "udem1-3-0": {"driven_any": 0.26777658976836893, "sim_physics": 0.24021466970443725, "survival_time": 2.000000000000001, "driven_lanedir": 0.25700021834149167, "sim_render-ego": 0.07364652752876281, "in-drivable-lane": 0, "agent_compute-ego": 0.08643222451210023, "deviation-heading": 0.44394731731572495, "set_robot_commands": 0.10507475137710572, "deviation-center-line": 0.16695173043736486, "driven_lanedir_consec": 0.25700021834149167, "sim_compute_sim_state": 0.0426468551158905, "sim_compute_performance-ego": 0.07504945397377014, "sim_compute_robot_state-ego": 0.07837879657745361, "sim_compute_robot_state-npc0": 0.07422046661376953, "sim_compute_robot_state-npc1": 0.076067715883255, "sim_compute_robot_state-npc2": 0.07617862820625305, "sim_compute_robot_state-npc3": 0.07822611331939697}, "udem1-4-0": {"driven_any": 2.2122723757001292, "sim_physics": 0.2245748229060613, "survival_time": 14.100000000000064, "driven_lanedir": 1.6968600510849163, "sim_render-ego": 0.06954771745289472, "in-drivable-lane": 1.4500000000000082, "agent_compute-ego": 0.08647244534593948, "deviation-heading": 5.424051728392824, "set_robot_commands": 0.10754997087708602, "deviation-center-line": 0.9092807034888656, "driven_lanedir_consec": 1.3202942074913118, "sim_compute_sim_state": 0.042353444911063985, "sim_compute_performance-ego": 0.07752000271005834, "sim_compute_robot_state-ego": 0.08459852604155844, "sim_compute_robot_state-npc0": 0.07622826606669325, "sim_compute_robot_state-npc1": 0.07640241562051976, "sim_compute_robot_state-npc2": 0.07583458711069527, "sim_compute_robot_state-npc3": 0.07508886452262284}}
set_robot_commands_max	0.11248579162817736
set_robot_commands_mean	0.10785852875584452
set_robot_commands_median	0.10723547097090835
set_robot_commands_min	0.10507475137710572
sim_compute_performance-ego_max	0.07757308194925497
sim_compute_performance-ego_mean	0.07628944943877805
sim_compute_performance-ego_median	0.07630176498339726
sim_compute_performance-ego_min	0.0750029435774096
sim_compute_robot_state-ego_max	0.09003096360426682
sim_compute_robot_state-ego_mean	0.08431995551343556
sim_compute_robot_state-ego_median	0.08459852604155844
sim_compute_robot_state-ego_min	0.07837879657745361
sim_compute_robot_state-npc0_max	0.07728100052246681
sim_compute_robot_state-npc0_mean	0.07571385810624923
sim_compute_robot_state-npc0_median	0.07562630841521178
sim_compute_robot_state-npc0_min	0.07422046661376953
sim_compute_robot_state-npc1_max	0.07688632836708656
sim_compute_robot_state-npc1_mean	0.07607041960560672
sim_compute_robot_state-npc1_median	0.076067715883255
sim_compute_robot_state-npc1_min	0.07512414698698083
sim_compute_robot_state-npc2_max	0.08013599194013156
sim_compute_robot_state-npc2_mean	0.07700715691716245
sim_compute_robot_state-npc2_median	0.07617862820625305
sim_compute_robot_state-npc2_min	0.07583458711069527
sim_compute_robot_state-npc3_max	0.0784454712500939
sim_compute_robot_state-npc3_mean	0.0768630201884222
sim_compute_robot_state-npc3_median	0.07636067041983971
sim_compute_robot_state-npc3_min	0.07508886452262284
sim_compute_sim_state_max	0.04392205939000966
sim_compute_sim_state_mean	0.04304559927409714
sim_compute_sim_state_median	0.04281544947362208
sim_compute_sim_state_min	0.042353444911063985
sim_physics_max	0.2621974509495955
sim_physics_mean	0.2391088336580803
sim_physics_median	0.24021466970443725
sim_physics_min	0.22180140991600192
sim_render-ego_max	0.07364652752876281
sim_render-ego_mean	0.07025140419912804
sim_render-ego_median	0.06954771745289472
sim_render-ego_min	0.06839391082322517
simulation-passed	1
survival_time_max	14.700000000000074
survival_time_mean	8.110000000000024
survival_time_min	2.000000000000001

No reset possible

20821

2751

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-27 13:15:12+00:00

2019-04-27 13:16:58+00:00

0:01:46

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20820

2800

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-27 13:12:47+00:00

2019-04-27 13:14:29+00:00

0:01:42

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20812

2900

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 13:01:24+00:00

2019-04-27 13:12:10+00:00

0:10:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6700426062612106
survival_time_median	6.0499999999999865
deviation-center-line_median	0.22907905482315732
in-drivable-lane_median	0.3999999999999986

other stats

agent_compute-ego_max	0.27153153677244446
agent_compute-ego_mean	0.2324821077039688
agent_compute-ego_median	0.225888437128322
agent_compute-ego_min	0.21465206343280385
deviation-center-line_max	0.6241767996850703
deviation-center-line_mean	0.34589938785352975
deviation-center-line_min	0.18940181805710912
deviation-heading_max	1.709002830340983
deviation-heading_mean	0.9136092257460258
deviation-heading_median	0.9042996768410582
deviation-heading_min	0.4464934246482955
driven_any_max	1.5751381935874411
driven_any_mean	0.8588569604767902
driven_any_median	0.998618283733154
driven_any_min	0.2648710468015355
driven_lanedir_consec_max	1.1899083322361783
driven_lanedir_consec_mean	0.6820653732184564
driven_lanedir_consec_min	0.25717294500984567
driven_lanedir_max	1.1899083322361783
driven_lanedir_mean	0.6820653732184564
driven_lanedir_median	0.6700426062612106
driven_lanedir_min	0.25717294500984567
in-drivable-lane_max	2.1500000000000155
in-drivable-lane_mean	0.8400000000000016
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.998618283733154, "sim_physics": 0.10709173423199614, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6700426062612106, "sim_render-ego": 0.05787717803450655, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.21465206343280385, "deviation-heading": 0.958714398370837, "set_robot_commands": 0.08859422384214795, "deviation-center-line": 0.22907905482315732, "driven_lanedir_consec": 0.6700426062612106, "sim_compute_sim_state": 0.03635864218404471, "sim_compute_performance-ego": 0.06241680964950688, "sim_compute_robot_state-ego": 0.06846827908980944}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0073534341839991, "sim_physics": 0.10585057735443117, "survival_time": 6.099999999999986, "driven_lanedir": 0.866581365126308, "sim_render-ego": 0.06355126568528473, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.230641884881942, "deviation-heading": 1.709002830340983, "set_robot_commands": 0.09513777982993205, "deviation-center-line": 0.48677378246587866, "driven_lanedir_consec": 0.866581365126308, "sim_compute_sim_state": 0.03830728374543737, "sim_compute_performance-ego": 0.06650354041427863, "sim_compute_robot_state-ego": 0.07451801808153996}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2648710468015355, "sim_physics": 0.12190553304311393, "survival_time": 1.850000000000001, "driven_lanedir": 0.25717294500984567, "sim_render-ego": 0.06385078945675411, "in-drivable-lane": 0, "agent_compute-ego": 0.27153153677244446, "deviation-heading": 0.4464934246482955, "set_robot_commands": 0.10351798341080948, "deviation-center-line": 0.18940181805710912, "driven_lanedir_consec": 0.25717294500984567, "sim_compute_sim_state": 0.041623250858203786, "sim_compute_performance-ego": 0.07315771644179886, "sim_compute_robot_state-ego": 0.08638981870702796}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.44830384407782126, "sim_physics": 0.11283838337865368, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4266216174587392, "sim_render-ego": 0.06227979988887392, "in-drivable-lane": 0, "agent_compute-ego": 0.21969661630433185, "deviation-heading": 0.9042996768410582, "set_robot_commands": 0.09235917699748072, "deviation-center-line": 0.2000654842364332, "driven_lanedir_consec": 0.4266216174587392, "sim_compute_sim_state": 0.03774129522257838, "sim_compute_performance-ego": 0.06905479677792253, "sim_compute_robot_state-ego": 0.07326906713946112}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5751381935874411, "sim_physics": 0.10294962694300688, "survival_time": 9.349999999999998, "driven_lanedir": 1.1899083322361783, "sim_render-ego": 0.05936667115930568, "in-drivable-lane": 2.1500000000000155, "agent_compute-ego": 0.225888437128322, "deviation-heading": 0.5495357985289552, "set_robot_commands": 0.0920314100336901, "deviation-center-line": 0.6241767996850703, "driven_lanedir_consec": 1.1899083322361783, "sim_compute_sim_state": 0.03681794079867276, "sim_compute_performance-ego": 0.06689711815533153, "sim_compute_robot_state-ego": 0.07048860463229092}}
set_robot_commands_max	0.10351798341080948
set_robot_commands_mean	0.09432811482281205
set_robot_commands_median	0.09235917699748072
set_robot_commands_min	0.08859422384214795
sim_compute_performance-ego_max	0.07315771644179886
sim_compute_performance-ego_mean	0.06760599628776769
sim_compute_performance-ego_median	0.06689711815533153
sim_compute_performance-ego_min	0.06241680964950688
sim_compute_robot_state-ego_max	0.08638981870702796
sim_compute_robot_state-ego_mean	0.07462675753002587
sim_compute_robot_state-ego_median	0.07326906713946112
sim_compute_robot_state-ego_min	0.06846827908980944
sim_compute_sim_state_max	0.041623250858203786
sim_compute_sim_state_mean	0.0381696825617874
sim_compute_sim_state_median	0.03774129522257838
sim_compute_sim_state_min	0.03635864218404471
sim_physics_max	0.12190553304311393
sim_physics_mean	0.11012717099024036
sim_physics_median	0.10709173423199614
sim_physics_min	0.10294962694300688
sim_render-ego_max	0.06385078945675411
sim_render-ego_mean	0.061385140844944994
sim_render-ego_median	0.06227979988887392
sim_render-ego_min	0.05787717803450655
simulation-passed	1
survival_time_max	9.349999999999998
survival_time_mean	5.249999999999995
survival_time_min	1.850000000000001

No reset possible

20793

2660

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 12:18:34+00:00

2019-04-27 13:00:09+00:00

0:41:35

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2660/step1-simulation-ip-172-31-40-253-32059-job20793/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20781

2924

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-27 12:00:56+00:00

2019-04-27 12:18:02+00:00

0:17:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.14134343397072868
survival_time_median	1.3000000000000005
deviation-center-line_median	0.08180848822794581
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.19466296831766763
agent_compute-ego_mean	0.16204508688642438
agent_compute-ego_median	0.1610289767936424
agent_compute-ego_min	0.12244398840542496
deviation-center-line_max	0.11911319909781166
deviation-center-line_mean	0.08353407752227396
deviation-center-line_min	0.04855176450445412
deviation-heading_max	0.8829047171310109
deviation-heading_mean	0.6561545598876549
deviation-heading_median	0.706978045758891
deviation-heading_min	0.4289914764881656
driven_any_max	0.2757946875716611
driven_any_mean	0.19887242205814495
driven_any_median	0.2098892917767878
driven_any_min	0.13490405254592364
driven_lanedir_consec_max	0.1896197470041483
driven_lanedir_consec_mean	0.14040562481895377
driven_lanedir_consec_min	0.07513781154269039
driven_lanedir_max	0.1896197470041483
driven_lanedir_mean	0.14040562481895377
driven_lanedir_median	0.14134343397072868
driven_lanedir_min	0.07513781154269039
in-drivable-lane_max	0.4500000000000004
in-drivable-lane_mean	0.0733333333333334
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21992534004231343, "sim_physics": 0.10845160484313963, "survival_time": 1.4500000000000006, "driven_lanedir": 0.13649092468686863, "sim_render-ego": 0.04522181379384008, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.12244398840542496, "deviation-heading": 0.8693253239043013, "set_robot_commands": 0.06814683716872642, "deviation-center-line": 0.09100578863141802, "driven_lanedir_consec": 0.13649092468686863, "sim_compute_sim_state": 0.026375696576874833, "sim_compute_performance-ego": 0.04892308136512493, "sim_compute_robot_state-ego": 0.04970308829998148, "sim_compute_robot_state-npc0": 0.04744199226642477, "sim_compute_robot_state-npc1": 0.04774582797083361, "sim_compute_robot_state-npc2": 0.047643653277693127, "sim_compute_robot_state-npc3": 0.047011597403164566}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2231167368696768, "sim_physics": 0.13914028235844203, "survival_time": 1.4000000000000006, "driven_lanedir": 0.14134343397072868, "sim_render-ego": 0.06132220370428903, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17641586916787283, "deviation-heading": 0.8829047171310109, "set_robot_commands": 0.10158810445240564, "deviation-center-line": 0.07799446191402948, "driven_lanedir_consec": 0.14134343397072868, "sim_compute_sim_state": 0.03809539760862078, "sim_compute_performance-ego": 0.06862485408782959, "sim_compute_robot_state-ego": 0.07395522935049874, "sim_compute_robot_state-npc0": 0.07127727781023298, "sim_compute_robot_state-npc1": 0.07353023971830096, "sim_compute_robot_state-npc2": 0.0702072126524789, "sim_compute_robot_state-npc3": 0.06807667016983032}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1562206648545827, "sim_physics": 0.12652153968811036, "survival_time": 1.2500000000000004, "driven_lanedir": 0.12541246165731357, "sim_render-ego": 0.063021821975708, "in-drivable-lane": 0, "agent_compute-ego": 0.1534989070892334, "deviation-heading": 0.5091996627289834, "set_robot_commands": 0.08725316047668458, "deviation-center-line": 0.10971422366291188, "driven_lanedir_consec": 0.12541246165731357, "sim_compute_sim_state": 0.03445520401000977, "sim_compute_performance-ego": 0.06757675170898438, "sim_compute_robot_state-ego": 0.07052873611450196, "sim_compute_robot_state-npc0": 0.0656668472290039, "sim_compute_robot_state-npc1": 0.06396492004394531, "sim_compute_robot_state-npc2": 0.0590395450592041, "sim_compute_robot_state-npc3": 0.06163928031921387}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14781128480811723, "sim_physics": 0.1370461609052575, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11862753930960768, "sim_render-ego": 0.06074777893398119, "in-drivable-lane": 0, "agent_compute-ego": 0.15593022885529892, "deviation-heading": 0.43534581567543096, "set_robot_commands": 0.09864521026611328, "deviation-center-line": 0.09419371495675598, "driven_lanedir_consec": 0.11862753930960768, "sim_compute_sim_state": 0.036021854566491165, "sim_compute_performance-ego": 0.06569231074789296, "sim_compute_robot_state-ego": 0.06767713505288829, "sim_compute_robot_state-npc0": 0.06432126915973166, "sim_compute_robot_state-npc1": 0.06517006003338358, "sim_compute_robot_state-npc2": 0.06842919017957605, "sim_compute_robot_state-npc3": 0.06392408453899881}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13819710480361, "sim_physics": 0.12364975265834642, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07513781154269039, "sim_render-ego": 0.052536415017169456, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.14468218969262164, "deviation-heading": 0.78964237164624, "set_robot_commands": 0.08892512321472168, "deviation-center-line": 0.05188132388728532, "driven_lanedir_consec": 0.07513781154269039, "sim_compute_sim_state": 0.03650583391604216, "sim_compute_performance-ego": 0.063732561857804, "sim_compute_robot_state-ego": 0.06312113222868546, "sim_compute_robot_state-npc0": 0.06218192888342816, "sim_compute_robot_state-npc1": 0.06348964442377505, "sim_compute_robot_state-npc2": 0.06508405312247899, "sim_compute_robot_state-npc3": 0.06591477601424507}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2503476083783059, "sim_physics": 0.15436069832907784, "survival_time": 1.800000000000001, "driven_lanedir": 0.147162754889667, "sim_render-ego": 0.06660029623243544, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.19466296831766763, "deviation-heading": 0.8108286246799639, "set_robot_commands": 0.10020238823360866, "deviation-center-line": 0.07055566257190397, "driven_lanedir_consec": 0.147162754889667, "sim_compute_sim_state": 0.04151577419704861, "sim_compute_performance-ego": 0.07453799247741699, "sim_compute_robot_state-ego": 0.08288166920344035, "sim_compute_robot_state-npc0": 0.07244047191407946, "sim_compute_robot_state-npc1": 0.0728270345264011, "sim_compute_robot_state-npc2": 0.07206086979971991, "sim_compute_robot_state-npc3": 0.0714121659596761}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.2045306142762856, "sim_physics": 0.13877763748168945, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1737936510043161, "sim_render-ego": 0.05750951766967773, "in-drivable-lane": 0, "agent_compute-ego": 0.1770816993713379, "deviation-heading": 0.4819155335466836, "set_robot_commands": 0.09833292007446288, "deviation-center-line": 0.09737022394856328, "driven_lanedir_consec": 0.1737936510043161, "sim_compute_sim_state": 0.038350915908813475, "sim_compute_performance-ego": 0.06391325950622559, "sim_compute_robot_state-ego": 0.07048115730285645, "sim_compute_robot_state-npc0": 0.07235991477966308, "sim_compute_robot_state-npc1": 0.07103999137878418, "sim_compute_robot_state-npc2": 0.06632501602172852, "sim_compute_robot_state-npc3": 0.06685799598693848}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.2098892917767878, "sim_physics": 0.13620291306422308, "survival_time": 1.3000000000000005, "driven_lanedir": 0.18035120143073957, "sim_render-ego": 0.058410506982069746, "in-drivable-lane": 0, "agent_compute-ego": 0.16105595918802115, "deviation-heading": 0.48096704587184663, "set_robot_commands": 0.08184584287496713, "deviation-center-line": 0.10282490931579336, "driven_lanedir_consec": 0.18035120143073957, "sim_compute_sim_state": 0.03546923857468825, "sim_compute_performance-ego": 0.06219668571765606, "sim_compute_robot_state-ego": 0.06421271654275748, "sim_compute_robot_state-npc0": 0.06476256480583778, "sim_compute_robot_state-npc1": 0.06142592430114746, "sim_compute_robot_state-npc2": 0.06255953128521259, "sim_compute_robot_state-npc3": 0.0653452781530527}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.24125934443957503, "sim_physics": 0.15688826098586572, "survival_time": 1.6500000000000008, "driven_lanedir": 0.17294605341454394, "sim_render-ego": 0.05994121956102776, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1645283265547319, "deviation-heading": 0.8093513979556382, "set_robot_commands": 0.09057737119270091, "deviation-center-line": 0.06298220569201309, "driven_lanedir_consec": 0.17294605341454394, "sim_compute_sim_state": 0.037068381454005386, "sim_compute_performance-ego": 0.06326206525166829, "sim_compute_robot_state-ego": 0.066291585113063, "sim_compute_robot_state-npc0": 0.07154366464325876, "sim_compute_robot_state-npc1": 0.06708118409821481, "sim_compute_robot_state-npc2": 0.07253059473904697, "sim_compute_robot_state-npc3": 0.06714104161118016}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.2266708278216609, "sim_physics": 0.12688810091752273, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1740350865486988, "sim_render-ego": 0.05730915986574613, "in-drivable-lane": 0, "agent_compute-ego": 0.15705233353834883, "deviation-heading": 0.7456522871208965, "set_robot_commands": 0.09547238166515644, "deviation-center-line": 0.07646748328114622, "driven_lanedir_consec": 0.1740350865486988, "sim_compute_sim_state": 0.03889752351320707, "sim_compute_performance-ego": 0.06449554516718937, "sim_compute_robot_state-ego": 0.06798194921933688, "sim_compute_robot_state-npc0": 0.06736710438361534, "sim_compute_robot_state-npc1": 0.06713728721325214, "sim_compute_robot_state-npc2": 0.06679101173694317, "sim_compute_robot_state-npc3": 0.0693506277524508}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1607028297869864, "sim_physics": 0.16605006655057272, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08816284197850743, "sim_render-ego": 0.06043975551923116, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18012073636054993, "deviation-heading": 0.7866540954737887, "set_robot_commands": 0.09870592753092448, "deviation-center-line": 0.04855176450445412, "driven_lanedir_consec": 0.08816284197850743, "sim_compute_sim_state": 0.04024032751719157, "sim_compute_performance-ego": 0.06764167547225952, "sim_compute_robot_state-ego": 0.0731823742389679, "sim_compute_robot_state-npc0": 0.07162429889043172, "sim_compute_robot_state-npc1": 0.07235406835873921, "sim_compute_robot_state-npc2": 0.07091313600540161, "sim_compute_robot_state-npc3": 0.07192531228065491}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.21143796038796991, "sim_physics": 0.12851856231689454, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1896197470041483, "sim_render-ego": 0.05676913261413574, "in-drivable-lane": 0, "agent_compute-ego": 0.15773042678833007, "deviation-heading": 0.4289914764881656, "set_robot_commands": 0.0901950454711914, "deviation-center-line": 0.11911319909781166, "driven_lanedir_consec": 0.1896197470041483, "sim_compute_sim_state": 0.035216064453125, "sim_compute_performance-ego": 0.06691407203674317, "sim_compute_robot_state-ego": 0.06611941337585449, "sim_compute_robot_state-npc0": 0.06764471054077148, "sim_compute_robot_state-npc1": 0.061417131423950194, "sim_compute_robot_state-npc2": 0.06046856880187988, "sim_compute_robot_state-npc3": 0.06410706520080567}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.2757946875716611, "sim_physics": 0.15821291304923393, "survival_time": 1.850000000000001, "driven_lanedir": 0.13693012762455303, "sim_render-ego": 0.06073054751834354, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16413532076655207, "deviation-heading": 0.706978045758891, "set_robot_commands": 0.09016504803219356, "deviation-center-line": 0.08062473353377778, "driven_lanedir_consec": 0.13693012762455303, "sim_compute_sim_state": 0.03694734057864627, "sim_compute_performance-ego": 0.06454776428841255, "sim_compute_robot_state-ego": 0.07240457148165316, "sim_compute_robot_state-npc0": 0.07007879824251742, "sim_compute_robot_state-npc1": 0.06970383025504448, "sim_compute_robot_state-npc2": 0.06950836568265348, "sim_compute_robot_state-npc3": 0.06637731758323875}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.13490405254592364, "sim_physics": 0.132136413029262, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10370516066702296, "sim_render-ego": 0.05987175305684408, "in-drivable-lane": 0, "agent_compute-ego": 0.16030837240673246, "deviation-heading": 0.46187287977230385, "set_robot_commands": 0.09148244630722772, "deviation-center-line": 0.08180848822794581, "driven_lanedir_consec": 0.10370516066702296, "sim_compute_sim_state": 0.03859924134753999, "sim_compute_performance-ego": 0.0646161124819801, "sim_compute_robot_state-ego": 0.06594722611563546, "sim_compute_robot_state-npc0": 0.06907936504908971, "sim_compute_robot_state-npc1": 0.06919559978303455, "sim_compute_robot_state-npc2": 0.06920813378833589, "sim_compute_robot_state-npc3": 0.06567718869163877}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.18227798250871857, "sim_physics": 0.1361350483364529, "survival_time": 1.3500000000000003, "driven_lanedir": 0.14236557655490056, "sim_render-ego": 0.05718243563616717, "in-drivable-lane": 0, "agent_compute-ego": 0.1610289767936424, "deviation-heading": 0.6426891205606788, "set_robot_commands": 0.08938723140292698, "deviation-center-line": 0.08792297960829941, "driven_lanedir_consec": 0.14236557655490056, "sim_compute_sim_state": 0.03676632598594383, "sim_compute_performance-ego": 0.06227292837920012, "sim_compute_robot_state-ego": 0.06776094436645508, "sim_compute_robot_state-npc0": 0.06416413519117567, "sim_compute_robot_state-npc1": 0.06897393862406413, "sim_compute_robot_state-npc2": 0.06690654048213253, "sim_compute_robot_state-npc3": 0.06436657905578613}}
set_robot_commands_max	0.10158810445240564
set_robot_commands_mean	0.0913950025576008
set_robot_commands_median	0.09057737119270091
set_robot_commands_min	0.06814683716872642
sim_compute_performance-ego_max	0.07453799247741699
sim_compute_performance-ego_mean	0.06459651070309251
sim_compute_performance-ego_median	0.06454776428841255
sim_compute_performance-ego_min	0.04892308136512493
sim_compute_robot_state-ego_max	0.08288166920344035
sim_compute_robot_state-ego_mean	0.06814992853377172
sim_compute_robot_state-ego_median	0.06776094436645508
sim_compute_robot_state-ego_min	0.04970308829998148
sim_compute_robot_state-npc0_max	0.07244047191407946
sim_compute_robot_state-npc0_mean	0.06679695625261746
sim_compute_robot_state-npc0_median	0.06764471054077148
sim_compute_robot_state-npc0_min	0.04744199226642477
sim_compute_robot_state-npc1_max	0.07353023971830096
sim_compute_robot_state-npc1_mean	0.06633711214352472
sim_compute_robot_state-npc1_median	0.06713728721325214
sim_compute_robot_state-npc1_min	0.04774582797083361
sim_compute_robot_state-npc2_max	0.07253059473904697
sim_compute_robot_state-npc2_mean	0.06584502817563238
sim_compute_robot_state-npc2_median	0.06690654048213253
sim_compute_robot_state-npc2_min	0.047643653277693127
sim_compute_robot_state-npc3_max	0.07192531228065491
sim_compute_robot_state-npc3_mean	0.06527513204805833
sim_compute_robot_state-npc3_median	0.06591477601424507
sim_compute_robot_state-npc3_min	0.047011597403164566
sim_compute_sim_state_max	0.04151577419704861
sim_compute_sim_state_mean	0.03670167468054988
sim_compute_sim_state_median	0.03694734057864627
sim_compute_sim_state_min	0.026375696576874833
sim_physics_max	0.16605006655057272
sim_physics_mean	0.13793199696760602
sim_physics_median	0.13620291306422308
sim_physics_min	0.10845160484313963
sim_render-ego_max	0.06660029623243544
sim_render-ego_mean	0.058507623872044424
sim_render-ego_median	0.05987175305684408
sim_render-ego_min	0.04522181379384008
simulation-passed	1
survival_time_max	1.850000000000001
survival_time_mean	1.3600000000000003
survival_time_min	1.0500000000000005

No reset possible

20772

3103

Angel Woo 🇭🇰

HKU Duckietown Project

step1-simulation

host-error

2019-04-27 11:57:19+00:00

2019-04-27 12:00:08+00:00

0:02:49

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission3103/step1-simulation-ip-172-31-40-253-32059-job20772/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20768

2985

Artem Ioselevskii

challenge-aido_LF-template-tensorflow

step1-simulation

error