Evaluator 847

Second test - TH

step1-simulation

error

2019-05-07 13:33:46+00:00

2019-05-07 13:34:12+00:00

0:00:26

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21611

3237

Second test - TH

step1-simulation

error

2019-05-07 13:12:09+00:00

2019-05-07 13:13:44+00:00

0:01:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21504

3194

Anastasiya Nikolskaya 🇷🇺

NN Solution

step1-simulation

success

2019-05-05 15:15:05+00:00

2019-05-05 15:27:48+00:00

0:12:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.472391116914825
survival_time_median	14.950000000000076
deviation-center-line_median	1.187837251974714
in-drivable-lane_median	1.7999999999999936

other stats

agent_compute-ego_max	0.06393616199493408
agent_compute-ego_mean	0.06291484991227489
agent_compute-ego_median	0.06309420316754984
agent_compute-ego_min	0.061376717090606686
deviation-center-line_max	1.3969874005674887
deviation-center-line_mean	1.012777734036386
deviation-center-line_min	0.19831157150674436
deviation-heading_max	3.6637132084645327
deviation-heading_mean	2.351456331118325
deviation-heading_median	2.744859267700575
deviation-heading_min	0.7133087055338689
driven_any_max	3.166231392287259
driven_any_mean	2.470949543180981
driven_any_median	3.1558463314608036
driven_any_min	0.4800712699486985
driven_lanedir_consec_max	3.0173685724338477
driven_lanedir_consec_mean	2.111042140641971
driven_lanedir_consec_min	0.4598726004888416
driven_lanedir_max	3.0173685724338477
driven_lanedir_mean	2.111042140641971
driven_lanedir_median	2.472391116914825
driven_lanedir_min	0.4598726004888416
in-drivable-lane_max	2.3500000000000334
in-drivable-lane_mean	1.1900000000000042
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.1558463314608036, "sim_physics": 0.06645533005396526, "survival_time": 14.950000000000076, "driven_lanedir": 2.472391116914825, "sim_render-ego": 0.03930520534515381, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.06346698919932048, "deviation-heading": 3.449945479496515, "set_robot_commands": 0.059548233350118, "deviation-center-line": 1.187837251974714, "driven_lanedir_consec": 2.472391116914825, "sim_compute_sim_state": 0.02597692886988322, "sim_compute_performance-ego": 0.04219764947891235, "sim_compute_robot_state-ego": 0.044862234592437746}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.166231392287259, "sim_physics": 0.0655474845568339, "survival_time": 14.950000000000076, "driven_lanedir": 2.645347856115111, "sim_render-ego": 0.03878888686498006, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.061376717090606686, "deviation-heading": 2.744859267700575, "set_robot_commands": 0.05846995592117309, "deviation-center-line": 1.3969874005674887, "driven_lanedir_consec": 2.645347856115111, "sim_compute_sim_state": 0.025463715394337973, "sim_compute_performance-ego": 0.04236523310343424, "sim_compute_robot_state-ego": 0.045161048571268715}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.386397753580968, "sim_physics": 0.06413016340280944, "survival_time": 11.350000000000026, "driven_lanedir": 1.960230557257228, "sim_render-ego": 0.03894639435318598, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.06309420316754984, "deviation-heading": 1.1854549943961334, "set_robot_commands": 0.05811959636368941, "deviation-center-line": 0.9474179259953152, "driven_lanedir_consec": 1.960230557257228, "sim_compute_sim_state": 0.025599365192362916, "sim_compute_performance-ego": 0.042843880632375306, "sim_compute_robot_state-ego": 0.04558958986257142}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4800712699486985, "sim_physics": 0.0692911896051145, "survival_time": 2.549999999999999, "driven_lanedir": 0.4598726004888416, "sim_render-ego": 0.03915761031356512, "in-drivable-lane": 0, "agent_compute-ego": 0.0627001781089633, "deviation-heading": 0.7133087055338689, "set_robot_commands": 0.05878038032382142, "deviation-center-line": 0.19831157150674436, "driven_lanedir_consec": 0.4598726004888416, "sim_compute_sim_state": 0.02578086479037416, "sim_compute_performance-ego": 0.043192176257862765, "sim_compute_robot_state-ego": 0.04465137743482403}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1662009686271753, "sim_physics": 0.06488255818684896, "survival_time": 14.950000000000076, "driven_lanedir": 3.0173685724338477, "sim_render-ego": 0.0391637396812439, "in-drivable-lane": 0, "agent_compute-ego": 0.06393616199493408, "deviation-heading": 3.6637132084645327, "set_robot_commands": 0.0589741325378418, "deviation-center-line": 1.3333345201376678, "driven_lanedir_consec": 3.0173685724338477, "sim_compute_sim_state": 0.025642966429392497, "sim_compute_performance-ego": 0.04237852334976197, "sim_compute_robot_state-ego": 0.04553061008453369}}
set_robot_commands_max	0.059548233350118
set_robot_commands_mean	0.058778459699328746
set_robot_commands_median	0.05878038032382142
set_robot_commands_min	0.05811959636368941
sim_compute_performance-ego_max	0.043192176257862765
sim_compute_performance-ego_mean	0.04259549256446933
sim_compute_performance-ego_median	0.04237852334976197
sim_compute_performance-ego_min	0.04219764947891235
sim_compute_robot_state-ego_max	0.04558958986257142
sim_compute_robot_state-ego_mean	0.04515897210912712
sim_compute_robot_state-ego_median	0.045161048571268715
sim_compute_robot_state-ego_min	0.04465137743482403
sim_compute_sim_state_max	0.02597692886988322
sim_compute_sim_state_mean	0.02569276813527015
sim_compute_sim_state_median	0.025642966429392497
sim_compute_sim_state_min	0.025463715394337973
sim_physics_max	0.0692911896051145
sim_physics_mean	0.06606134516111442
sim_physics_median	0.0655474845568339
sim_physics_min	0.06413016340280944
sim_render-ego_max	0.03930520534515381
sim_render-ego_mean	0.03907236731162578
sim_render-ego_median	0.03915761031356512
sim_render-ego_min	0.03878888686498006
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.750000000000052
survival_time_min	2.549999999999999

No reset possible

21502

3193

Shalom-David Anifowoshe

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-05-05 14:52:41+00:00

2019-05-05 15:00:04+00:00

0:07:23

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 494, in get_cr
    shutil.rmtree(wd)
  File "/usr/lib/python3.6/shutil.py", line 480, in rmtree
    _rmtree_safe_fd(fd, path, onerror)
  File "/usr/lib/python3.6/shutil.py", line 418, in _rmtree_safe_fd
    _rmtree_safe_fd(dirfd, fullname, onerror)
  File "/usr/lib/python3.6/shutil.py", line 418, in _rmtree_safe_fd
    _rmtree_safe_fd(dirfd, fullname, onerror)
  File "/usr/lib/python3.6/shutil.py", line 418, in _rmtree_safe_fd
    _rmtree_safe_fd(dirfd, fullname, onerror)
  [Previous line repeated 1 more time]
  File "/usr/lib/python3.6/shutil.py", line 438, in _rmtree_safe_fd
    onerror(os.unlink, fullname, sys.exc_info())
  File "/usr/lib/python3.6/shutil.py", line 436, in _rmtree_safe_fd
    os.unlink(name, dir_fd=topfd)
FileNotFoundError: [Errno 2] No such file or directory: 'camera.mp4'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21472

3167

Pokai Chang

PredictorLast

aido2-PRED

step1-simulation

success

2019-05-02 12:57:26+00:00

2019-05-02 12:57:54+00:00

0:00:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12382732308417592
error_L2	0.023735220170487195

No reset possible

21469

3165

Jui-Te Huang 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

2019-05-02 10:03:21+00:00

2019-05-02 10:03:54+00:00

0:00:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11669982436237984
error_L2	0.021585770330111245

No reset possible

21436

3146

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-30 15:14:39+00:00

2019-04-30 15:23:48+00:00

0:09:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.17948640244347708
agent_compute-ego_mean	0.15058419975090626
agent_compute-ego_median	0.1638658949472372
agent_compute-ego_min	0.1158469518025716
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.22103263456610184, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.069466298139548, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1658295136463793, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10574047776717174, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.042296937749355654, "sim_compute_performance-ego": 0.07153762141360512, "sim_compute_robot_state-ego": 0.07909142820140984, "sim_compute_robot_state-npc0": 0.07400972933708867, "sim_compute_robot_state-npc1": 0.07413755791096747, "sim_compute_robot_state-npc2": 0.07504480398153957, "sim_compute_robot_state-npc3": 0.07183639309074305}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.22492971590587071, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06881195306777954, "in-drivable-lane": 0, "agent_compute-ego": 0.17948640244347708, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10315498283931188, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04170776265008109, "sim_compute_performance-ego": 0.07591743980135236, "sim_compute_robot_state-ego": 0.08219801528113228, "sim_compute_robot_state-npc0": 0.07978572164263044, "sim_compute_robot_state-npc1": 0.07634212289537702, "sim_compute_robot_state-npc2": 0.07513800689152308, "sim_compute_robot_state-npc3": 0.07401584727423531}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.202852725982666, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0669613115995833, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1638658949472372, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.1034563976584129, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.042683976367839334, "sim_compute_performance-ego": 0.07182836764067121, "sim_compute_robot_state-ego": 0.07846866765068573, "sim_compute_robot_state-npc0": 0.07489013671875, "sim_compute_robot_state-npc1": 0.07100895770545144, "sim_compute_robot_state-npc2": 0.07373254276016383, "sim_compute_robot_state-npc3": 0.07488255824857545}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.16666607558727264, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.050781190395355225, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.12789223591486612, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07786045968532562, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03231047590573629, "sim_compute_performance-ego": 0.06033057967821757, "sim_compute_robot_state-ego": 0.06065903604030609, "sim_compute_robot_state-npc0": 0.05748508870601654, "sim_compute_robot_state-npc1": 0.05356627702713013, "sim_compute_robot_state-npc2": 0.05981019635995229, "sim_compute_robot_state-npc3": 0.05458969871203104}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.16531345957801455, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.048465115683419366, "in-drivable-lane": 0, "agent_compute-ego": 0.1158469518025716, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.06711665789286296, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03074589229765393, "sim_compute_performance-ego": 0.05349682626270112, "sim_compute_robot_state-ego": 0.058679512568882534, "sim_compute_robot_state-npc0": 0.05321791058494931, "sim_compute_robot_state-npc1": 0.05147535460335867, "sim_compute_robot_state-npc2": 0.05147437822251093, "sim_compute_robot_state-npc3": 0.05033124060857864}}
set_robot_commands_max	0.10574047776717174
set_robot_commands_mean	0.09146579516861704
set_robot_commands_median	0.10315498283931188
set_robot_commands_min	0.06711665789286296
sim_compute_performance-ego_max	0.07591743980135236
sim_compute_performance-ego_mean	0.06662216695930948
sim_compute_performance-ego_median	0.07153762141360512
sim_compute_performance-ego_min	0.05349682626270112
sim_compute_robot_state-ego_max	0.08219801528113228
sim_compute_robot_state-ego_mean	0.0718193319484833
sim_compute_robot_state-ego_median	0.07846866765068573
sim_compute_robot_state-ego_min	0.058679512568882534
sim_compute_robot_state-npc0_max	0.07978572164263044
sim_compute_robot_state-npc0_mean	0.06787771739788699
sim_compute_robot_state-npc0_median	0.07400972933708867
sim_compute_robot_state-npc0_min	0.05321791058494931
sim_compute_robot_state-npc1_max	0.07634212289537702
sim_compute_robot_state-npc1_mean	0.06530605402845695
sim_compute_robot_state-npc1_median	0.07100895770545144
sim_compute_robot_state-npc1_min	0.05147535460335867
sim_compute_robot_state-npc2_max	0.07513800689152308
sim_compute_robot_state-npc2_mean	0.06703998564313794
sim_compute_robot_state-npc2_median	0.07373254276016383
sim_compute_robot_state-npc2_min	0.05147437822251093
sim_compute_robot_state-npc3_max	0.07488255824857545
sim_compute_robot_state-npc3_mean	0.0651311475868327
sim_compute_robot_state-npc3_median	0.07183639309074305
sim_compute_robot_state-npc3_min	0.05033124060857864
sim_compute_sim_state_max	0.042683976367839334
sim_compute_sim_state_mean	0.03794900899413326
sim_compute_sim_state_median	0.04170776265008109
sim_compute_sim_state_min	0.03074589229765393
sim_physics_max	0.22492971590587071
sim_physics_mean	0.19615892232398516
sim_physics_median	0.202852725982666
sim_physics_min	0.16531345957801455
sim_render-ego_max	0.069466298139548
sim_render-ego_mean	0.06089717377713708
sim_render-ego_median	0.0669613115995833
sim_render-ego_min	0.048465115683419366
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

21432

3133

Amaury Camus 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

2019-04-30 14:51:06+00:00

2019-04-30 14:51:38+00:00

0:00:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11937119010353092
error_L2	0.023554189517928

No reset possible

21395

2446

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-28 03:00:29+00:00

2019-04-28 03:54:41+00:00

0:54:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.349968485301373
survival_time_median	14.950000000000076
deviation-center-line_median	1.040807946070029
in-drivable-lane_median	4.000000000000023

other stats

agent_compute-ego_max	0.13602806011835733
agent_compute-ego_mean	0.13264088143242733
agent_compute-ego_median	0.13285026947657266
agent_compute-ego_min	0.12937694708506267
deviation-center-line_max	1.529644280889766
deviation-center-line_mean	0.8701756872677942
deviation-center-line_min	0.26477611315883814
deviation-heading_max	8.558153948461722
deviation-heading_mean	6.851383096454355
deviation-heading_median	6.860620529247017
deviation-heading_min	5.521409763793653
driven_any_max	4.378506444052824
driven_any_mean	4.378506444052813
driven_any_median	4.378506444052814
driven_any_min	4.3785064440528
driven_lanedir_consec_max	-1.2728389207955129
driven_lanedir_consec_mean	-1.3462902153896477
driven_lanedir_consec_min	-1.3792285832163174
driven_lanedir_max	-1.339366254383536
driven_lanedir_mean	-2.03259639042992
driven_lanedir_median	-2.3212713812257557
driven_lanedir_min	-2.7107548643537447
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	4.880000000000026
in-drivable-lane_min	2.100000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.08642577648162841, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.04851045767466227, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.13297950903574626, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.07536667029062907, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.031107096672058104, "sim_compute_performance-ego": 0.05479433139165243, "sim_compute_robot_state-ego": 0.058893465995788576}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052802, "sim_physics": 0.08691987117131551, "survival_time": 14.950000000000076, "driven_lanedir": -2.44752976847699, "sim_render-ego": 0.05048577864964803, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.13602806011835733, "deviation-heading": 7.300247877354016, "set_robot_commands": 0.0771160856882731, "deviation-center-line": 1.1660826179431367, "driven_lanedir_consec": -1.375791811242363, "sim_compute_sim_state": 0.03120510816574097, "sim_compute_performance-ego": 0.05668867349624634, "sim_compute_robot_state-ego": 0.061105138460795086}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.37850644405281, "sim_physics": 0.08317522366841634, "survival_time": 14.950000000000076, "driven_lanedir": -1.339366254383536, "sim_render-ego": 0.04890303532282511, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.13012502113978067, "deviation-heading": 5.592005976497815, "set_robot_commands": 0.07289218505223592, "deviation-center-line": 0.26894128230124625, "driven_lanedir_consec": -1.339366254383536, "sim_compute_sim_state": 0.031216882864634195, "sim_compute_performance-ego": 0.05457228740056356, "sim_compute_robot_state-ego": 0.057028980255126954}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052819, "sim_physics": 0.0864794127146403, "survival_time": 14.950000000000076, "driven_lanedir": -2.6766171477725837, "sim_render-ego": 0.04933712561925252, "in-drivable-lane": 2.2000000000000126, "agent_compute-ego": 0.13285026947657266, "deviation-heading": 8.502617994731201, "set_robot_commands": 0.07489354610443115, "deviation-center-line": 1.516600708411943, "driven_lanedir_consec": -1.3215500552073602, "sim_compute_sim_state": 0.031944018999735514, "sim_compute_performance-ego": 0.05636159976323445, "sim_compute_robot_state-ego": 0.05841718673706055}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378506444052814, "sim_physics": 0.0857601277033488, "survival_time": 14.950000000000076, "driven_lanedir": -2.5973993077066466, "sim_render-ego": 0.04888549009958903, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.13392890612284342, "deviation-heading": 8.166880118443489, "set_robot_commands": 0.07486514329910278, "deviation-center-line": 1.4012763877174623, "driven_lanedir_consec": -1.3674582749242976, "sim_compute_sim_state": 0.032506783008575436, "sim_compute_performance-ego": 0.0553258482615153, "sim_compute_robot_state-ego": 0.05898264726003011}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.378506444052818, "sim_physics": 0.08064375162124633, "survival_time": 14.950000000000076, "driven_lanedir": -2.6863506595444093, "sim_render-ego": 0.04808873732884725, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.1313062119483948, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.07205658356348674, "deviation-center-line": 1.529644280889766, "driven_lanedir_consec": -1.2728389207955129, "sim_compute_sim_state": 0.030136813322703043, "sim_compute_performance-ego": 0.052455137570699056, "sim_compute_robot_state-ego": 0.056194670995076496}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.3785064440528165, "sim_physics": 0.08243518908818563, "survival_time": 14.950000000000076, "driven_lanedir": -1.3792285832163174, "sim_render-ego": 0.04841504573822022, "in-drivable-lane": 7.450000000000041, "agent_compute-ego": 0.1325659322738647, "deviation-heading": 5.5809548780508695, "set_robot_commands": 0.07356699784596761, "deviation-center-line": 0.27326177365632137, "driven_lanedir_consec": -1.3792285832163174, "sim_compute_sim_state": 0.030697075525919597, "sim_compute_performance-ego": 0.05426031112670898, "sim_compute_robot_state-ego": 0.05707390069961548}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.378506444052812, "sim_physics": 0.08584404706954957, "survival_time": 14.950000000000076, "driven_lanedir": -1.3432315670097958, "sim_render-ego": 0.04903968731562296, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.13392133394877115, "deviation-heading": 5.577448138086962, "set_robot_commands": 0.07572504679361979, "deviation-center-line": 0.26477611315883814, "driven_lanedir_consec": -1.3432315670097958, "sim_compute_sim_state": 0.03151296536127726, "sim_compute_performance-ego": 0.05546119213104248, "sim_compute_robot_state-ego": 0.05814357280731201}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.378506444052817, "sim_physics": 0.08003878116607666, "survival_time": 14.950000000000076, "driven_lanedir": -2.326178382589746, "sim_render-ego": 0.04847033818562826, "in-drivable-lane": 4.000000000000023, "agent_compute-ego": 0.12937694708506267, "deviation-heading": 6.860620529247017, "set_robot_commands": 0.07248281637827556, "deviation-center-line": 1.040807946070029, "driven_lanedir_consec": -1.349968485301373, "sim_compute_sim_state": 0.03001556158065796, "sim_compute_performance-ego": 0.05345175584157308, "sim_compute_robot_state-ego": 0.05673758109410604}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.378506444052823, "sim_physics": 0.08730617046356201, "survival_time": 14.950000000000076, "driven_lanedir": -1.3566703884391194, "sim_render-ego": 0.04936212380727132, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.13505361080169678, "deviation-heading": 5.521409763793653, "set_robot_commands": 0.07622285763422648, "deviation-center-line": 0.2734733627444725, "driven_lanedir_consec": -1.3566703884391194, "sim_compute_sim_state": 0.03147024313608805, "sim_compute_performance-ego": 0.05776350259780884, "sim_compute_robot_state-ego": 0.05782592296600342}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.3785064440528, "sim_physics": 0.08320647637049357, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662528350192018, "sim_render-ego": 0.05061759789784749, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.13372203906377156, "deviation-heading": 5.773684892471284, "set_robot_commands": 0.07524203141530354, "deviation-center-line": 0.29292877009102625, "driven_lanedir_consec": -1.3662528350192018, "sim_compute_sim_state": 0.03161539951960246, "sim_compute_performance-ego": 0.054639304478963216, "sim_compute_robot_state-ego": 0.058443990548451744}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.378506444052815, "sim_physics": 0.08307898839314778, "survival_time": 14.950000000000076, "driven_lanedir": -1.9006947314702467, "sim_render-ego": 0.04819477796554565, "in-drivable-lane": 5.700000000000033, "agent_compute-ego": 0.13065277179082235, "deviation-heading": 5.897976469138944, "set_robot_commands": 0.07167072216669719, "deviation-center-line": 0.6401646582864557, "driven_lanedir_consec": -1.3481573540947158, "sim_compute_sim_state": 0.03088045597076416, "sim_compute_performance-ego": 0.05324330012003581, "sim_compute_robot_state-ego": 0.05680185238520304}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.3785064440528005, "sim_physics": 0.08270615895589192, "survival_time": 14.950000000000076, "driven_lanedir": -2.6697425839037123, "sim_render-ego": 0.049018498261769614, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.1337539529800415, "deviation-heading": 8.52845713238494, "set_robot_commands": 0.07527488152186076, "deviation-center-line": 1.5113151793151556, "driven_lanedir_consec": -1.3509792024801393, "sim_compute_sim_state": 0.031425457000732425, "sim_compute_performance-ego": 0.0549146588643392, "sim_compute_robot_state-ego": 0.05757980346679688}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.378506444052814, "sim_physics": 0.07818323055903117, "survival_time": 14.950000000000076, "driven_lanedir": -2.3212713812257557, "sim_render-ego": 0.04829586664835612, "in-drivable-lane": 3.9500000000000215, "agent_compute-ego": 0.13124968767166137, "deviation-heading": 6.99662450508493, "set_robot_commands": 0.0735815707842509, "deviation-center-line": 1.0417077412071511, "driven_lanedir_consec": -1.3443245306214604, "sim_compute_sim_state": 0.03103534698486328, "sim_compute_performance-ego": 0.05291268905003865, "sim_compute_robot_state-ego": 0.056521852811177574}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.378506444052824, "sim_physics": 0.08136114199956258, "survival_time": 14.950000000000076, "driven_lanedir": -1.3676574013369849, "sim_render-ego": 0.04820374329884847, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.1320989680290222, "deviation-heading": 5.540769848207861, "set_robot_commands": 0.07370618502298991, "deviation-center-line": 0.31212235976688296, "driven_lanedir_consec": -1.3676574013369849, "sim_compute_sim_state": 0.030656136671702063, "sim_compute_performance-ego": 0.053608717918396, "sim_compute_robot_state-ego": 0.05721550941467285}}
set_robot_commands_max	0.0771160856882731
set_robot_commands_mean	0.07431088823742336
set_robot_commands_median	0.07486514329910278
set_robot_commands_min	0.07167072216669719
sim_compute_performance-ego_max	0.05776350259780884
sim_compute_performance-ego_mean	0.05469688733418784
sim_compute_performance-ego_median	0.054639304478963216
sim_compute_performance-ego_min	0.052455137570699056
sim_compute_robot_state-ego_max	0.061105138460795086
sim_compute_robot_state-ego_mean	0.05779773839314779
sim_compute_robot_state-ego_median	0.05757980346679688
sim_compute_robot_state-ego_min	0.056194670995076496
sim_compute_sim_state_max	0.032506783008575436
sim_compute_sim_state_mean	0.031161689652336965
sim_compute_sim_state_median	0.03120510816574097
sim_compute_sim_state_min	0.03001556158065796
sim_physics_max	0.08730617046356201
sim_physics_mean	0.08357095649507311
sim_physics_median	0.08317522366841634
sim_physics_min	0.07818323055903117
sim_render-ego_max	0.05061759789784749
sim_render-ego_mean	0.04892188692092896
sim_render-ego_median	0.04888549009958903
sim_render-ego_min	0.04808873732884725
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21377

2410

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 02:00:17+00:00

2019-04-28 03:00:08+00:00

0:59:51

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2410/step1-simulation-ip-172-31-25-98-2470-job21377/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21366

2448

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 01:08:21+00:00

2019-04-28 02:00:03+00:00

0:51:42

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2448/step1-simulation-ip-172-31-25-98-2470-job21366/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21360

2376

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-28 01:00:38+00:00

2019-04-28 01:07:56+00:00

0:07:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6707441932890994
survival_time_median	3.649999999999995
deviation-center-line_median	0.14435558631904788
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.07052261764938766
agent_compute-ego_mean	0.06795529750074154
agent_compute-ego_median	0.06820201873779297
agent_compute-ego_min	0.06514978621687208
deviation-center-line_max	0.4005818627784723
deviation-center-line_mean	0.21811977533890275
deviation-center-line_min	0.12422801598242109
deviation-heading_max	1.047774623333474
deviation-heading_mean	0.5589514876466882
deviation-heading_median	0.5590533399929921
deviation-heading_min	0.3001803644882976
driven_any_max	1.5798273185719856
driven_any_mean	0.8628689511998026
driven_any_median	0.9948273195001778
driven_any_min	0.2750262368649079
driven_lanedir_consec_max	1.1257539445961453
driven_lanedir_consec_mean	0.6746052985515076
driven_lanedir_consec_min	0.2671322113623069
driven_lanedir_max	1.1257539445961453
driven_lanedir_mean	0.6746052985515076
driven_lanedir_median	0.6707441932890994
driven_lanedir_min	0.2671322113623069
in-drivable-lane_max	1.499999999999995
in-drivable-lane_mean	0.5299999999999981
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.11897280118236804, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.06440602589959968, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06769287749512555, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.10374414757506488, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.03945476388278073, "sim_compute_performance-ego": 0.07227237257238937, "sim_compute_robot_state-ego": 0.08037291161001545}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009827319290899, "sim_physics": 0.10485329176928546, "survival_time": 3.699999999999995, "driven_lanedir": 0.8760331754635476, "sim_render-ego": 0.06239628147434544, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06820918740452947, "deviation-heading": 1.047774623333474, "set_robot_commands": 0.10181574885909622, "deviation-center-line": 0.29642020115014733, "driven_lanedir_consec": 0.8760331754635476, "sim_compute_sim_state": 0.04005859349225018, "sim_compute_performance-ego": 0.07336336857563741, "sim_compute_robot_state-ego": 0.07826212290171031}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2750262368649079, "sim_physics": 0.11019630432128906, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2671322113623069, "sim_render-ego": 0.06702361106872559, "in-drivable-lane": 0, "agent_compute-ego": 0.06820201873779297, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.0965694522857666, "deviation-center-line": 0.12422801598242109, "driven_lanedir_consec": 0.2671322113623069, "sim_compute_sim_state": 0.041391544342041016, "sim_compute_performance-ego": 0.07212397575378418, "sim_compute_robot_state-ego": 0.08026982307434082}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4548365617710419, "sim_physics": 0.13739001428758776, "survival_time": 1.850000000000001, "driven_lanedir": 0.4333629680464388, "sim_render-ego": 0.06591354189692317, "in-drivable-lane": 0, "agent_compute-ego": 0.07052261764938766, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.1112750092068234, "deviation-center-line": 0.12501321046442526, "driven_lanedir_consec": 0.4333629680464388, "sim_compute_sim_state": 0.04394903698483029, "sim_compute_performance-ego": 0.07662115225920806, "sim_compute_robot_state-ego": 0.08680020796286093}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.11216508064951217, "survival_time": 5.599999999999988, "driven_lanedir": 1.1257539445961453, "sim_render-ego": 0.06303021098886218, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.06514978621687208, "deviation-heading": 0.31699480744097813, "set_robot_commands": 0.09554509392806462, "deviation-center-line": 0.4005818627784723, "driven_lanedir_consec": 1.1257539445961453, "sim_compute_sim_state": 0.038983789937836785, "sim_compute_performance-ego": 0.07167229907853263, "sim_compute_robot_state-ego": 0.07411370958600726}}
set_robot_commands_max	0.1112750092068234
set_robot_commands_mean	0.10178989037096316
set_robot_commands_median	0.10181574885909622
set_robot_commands_min	0.09554509392806462
sim_compute_performance-ego_max	0.07662115225920806
sim_compute_performance-ego_mean	0.07321063364791033
sim_compute_performance-ego_median	0.07227237257238937
sim_compute_performance-ego_min	0.07167229907853263
sim_compute_robot_state-ego_max	0.08680020796286093
sim_compute_robot_state-ego_mean	0.07996375502698695
sim_compute_robot_state-ego_median	0.08026982307434082
sim_compute_robot_state-ego_min	0.07411370958600726
sim_compute_sim_state_max	0.04394903698483029
sim_compute_sim_state_mean	0.040767545727947795
sim_compute_sim_state_median	0.04005859349225018
sim_compute_sim_state_min	0.038983789937836785
sim_physics_max	0.13739001428758776
sim_physics_mean	0.11671549844200849
sim_physics_median	0.11216508064951217
sim_physics_min	0.10485329176928546
sim_render-ego_max	0.06702361106872559
sim_render-ego_mean	0.0645539342656912
sim_render-ego_median	0.06440602589959968
sim_render-ego_min	0.06239628147434544
simulation-passed	1
survival_time_max	5.599999999999988
survival_time_mean	3.209999999999996
survival_time_min	1.2500000000000004

No reset possible

21338

2770

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-28 00:00:33+00:00

2019-04-28 01:00:11+00:00

0:59:38

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-25-98-2470-job21338/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21324

2411

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 23:37:43+00:00

2019-04-28 00:00:11+00:00

0:22:28

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2411/step1-simulation-ip-172-31-25-98-2470-job21324/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21323

2416

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-27 23:19:32+00:00

2019-04-27 23:37:09+00:00

0:17:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.16621170043945313
agent_compute-ego_mean	0.1434439786553428
agent_compute-ego_median	0.1427141638363109
agent_compute-ego_min	0.13460844679723813
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12376905370641636, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06233478917015923, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13934856873971443, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09870579949131718, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03870469552499277, "sim_compute_performance-ego": 0.07228361677240443, "sim_compute_robot_state-ego": 0.0768393322273537}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11238703073239792, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06389732921824735, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14052397597069835, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0981724028493844, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03904930283041561, "sim_compute_performance-ego": 0.07084055507884306, "sim_compute_robot_state-ego": 0.071564141441794}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14238600169911103, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07027979458079618, "in-drivable-lane": 0, "agent_compute-ego": 0.1427141638363109, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.1044596223270192, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04117608070373535, "sim_compute_performance-ego": 0.0774386770585004, "sim_compute_robot_state-ego": 0.0841227980221019}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.14321842193603515, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06913354873657226, "in-drivable-lane": 0, "agent_compute-ego": 0.16621170043945313, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.1093472671508789, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04185707092285156, "sim_compute_performance-ego": 0.07628193855285645, "sim_compute_robot_state-ego": 0.09216656684875488}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11406972438474244, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06577862365336358, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13460844679723813, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.096484570563594, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03897013241731668, "sim_compute_performance-ego": 0.07062035270884068, "sim_compute_robot_state-ego": 0.07423279255251342}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.12218058352567712, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06986918254774444, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.14911026857337173, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10107749335619869, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.041527782167707174, "sim_compute_performance-ego": 0.07343527735496054, "sim_compute_robot_state-ego": 0.07832042051821339}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12007911716188704, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06403038331440516, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.14394574080194747, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10385353650365556, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.040004266159875054, "sim_compute_performance-ego": 0.07322790793010167, "sim_compute_robot_state-ego": 0.07925618120602199}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.12808794067019508, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.0935278165908087, "in-drivable-lane": 0, "agent_compute-ego": 0.13775378181820824, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.09671152205694288, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04005558150155203, "sim_compute_performance-ego": 0.07306009247189477, "sim_compute_robot_state-ego": 0.07124771390642438}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.13497028108370507, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.065156055709063, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14752343145467467, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.10422016402422372, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03985417091240317, "sim_compute_performance-ego": 0.07331589116888532, "sim_compute_robot_state-ego": 0.08140615689552437}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.12754882465709338, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.0666795167055997, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1463763670487837, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10641997944224964, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.042680280858820134, "sim_compute_performance-ego": 0.07408898093483665, "sim_compute_robot_state-ego": 0.0762080972844904}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.127528258732387, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.0673996132689637, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14592994343150745, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.10522636500271884, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04112167482252245, "sim_compute_performance-ego": 0.07383704495120358, "sim_compute_robot_state-ego": 0.08453823374463366}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12780413457325526, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06251730237688337, "in-drivable-lane": 0, "agent_compute-ego": 0.13558333260672434, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.09846929141453334, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.03821701662881034, "sim_compute_performance-ego": 0.07329991034099034, "sim_compute_robot_state-ego": 0.07321391786847796}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.12132554428250182, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06433234027787751, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14356303682514265, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09957414514878216, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04028032340255438, "sim_compute_performance-ego": 0.07175145897210813, "sim_compute_robot_state-ego": 0.07898282069785922}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.13052446753890426, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06212435828314887, "in-drivable-lane": 0, "agent_compute-ego": 0.14205538785016095, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10022683496828431, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.03583225497493037, "sim_compute_performance-ego": 0.07183813165735316, "sim_compute_robot_state-ego": 0.08304375189322012}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.11181674985324636, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06288791637794644, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13641153363620534, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.09882880425920672, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03998229082892923, "sim_compute_performance-ego": 0.07014679675008736, "sim_compute_robot_state-ego": 0.07881287733713786}}
set_robot_commands_max	0.1093472671508789
set_robot_commands_mean	0.10145185323726597
set_robot_commands_median	0.10022683496828431
set_robot_commands_min	0.096484570563594
sim_compute_performance-ego_max	0.0774386770585004
sim_compute_performance-ego_mean	0.07303110884692443
sim_compute_performance-ego_median	0.07322790793010167
sim_compute_performance-ego_min	0.07014679675008736
sim_compute_robot_state-ego_max	0.09216656684875488
sim_compute_robot_state-ego_mean	0.07893038682963475
sim_compute_robot_state-ego_median	0.07881287733713786
sim_compute_robot_state-ego_min	0.07124771390642438
sim_compute_sim_state_max	0.042680280858820134
sim_compute_sim_state_mean	0.039954194977161094
sim_compute_sim_state_median	0.040004266159875054
sim_compute_sim_state_min	0.03583225497493037
sim_physics_max	0.14321842193603515
sim_physics_mean	0.12584640896917035
sim_physics_median	0.127528258732387
sim_physics_min	0.11181674985324636
sim_render-ego_max	0.0935278165908087
sim_render-ego_mean	0.06732990472077197
sim_render-ego_median	0.065156055709063
sim_render-ego_min	0.06212435828314887
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

21312

2406

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 23:00:26+00:00

2019-04-27 23:19:25+00:00

0:18:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.12881429060069616
survival_time_median	1.2500000000000004
deviation-center-line_median	0.08604688395080377
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.29313678400857107
agent_compute-ego_mean	0.2000062079210529
agent_compute-ego_median	0.18752716433617375
agent_compute-ego_min	0.17236741729404614
deviation-center-line_max	0.1180516766878549
deviation-center-line_mean	0.08301778182638428
deviation-center-line_min	0.049250070852227504
deviation-heading_max	1.0581166504090114
deviation-heading_mean	0.7068296040877956
deviation-heading_median	0.6709700448659616
deviation-heading_min	0.4401122019708283
driven_any_max	0.35119657290287587
driven_any_mean	0.18804019660965957
driven_any_median	0.1723763682467449
driven_any_min	0.10909563105045986
driven_lanedir_consec_max	0.25347406972400277
driven_lanedir_consec_mean	0.1277658861052143
driven_lanedir_consec_min	0.07136187834328944
driven_lanedir_max	0.25347406972400277
driven_lanedir_mean	0.1277658861052143
driven_lanedir_median	0.12881429060069616
driven_lanedir_min	0.07136187834328944
in-drivable-lane_max	0.20000000000000015
in-drivable-lane_mean	0.030000000000000027
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.19581305937978644, "sim_physics": 0.29699515413354943, "survival_time": 1.3500000000000003, "driven_lanedir": 0.09454775660589188, "sim_render-ego": 0.08282896324440285, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.2656213089271828, "deviation-heading": 0.827864781796537, "set_robot_commands": 0.13023575146993002, "deviation-center-line": 0.07530132264819048, "driven_lanedir_consec": 0.09454775660589188, "sim_compute_sim_state": 0.04634120729234484, "sim_compute_performance-ego": 0.09249493810865614, "sim_compute_robot_state-ego": 0.11637681501883047, "sim_compute_robot_state-npc0": 0.08819915630199292, "sim_compute_robot_state-npc1": 0.08929249975416395, "sim_compute_robot_state-npc2": 0.08684534496731228, "sim_compute_robot_state-npc3": 0.0896721327746356}, "udem1-1-0": {"driven_any": 0.20013444138854755, "sim_physics": 0.32355157818113056, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09355137740189969, "sim_render-ego": 0.08449756247656685, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.29313678400857107, "deviation-heading": 0.8918369279932556, "set_robot_commands": 0.13621142932346889, "deviation-center-line": 0.06572730839404949, "driven_lanedir_consec": 0.09355137740189969, "sim_compute_sim_state": 0.04748607533318656, "sim_compute_performance-ego": 0.08822998830250331, "sim_compute_robot_state-ego": 0.09937413249697004, "sim_compute_robot_state-npc0": 0.08927294186183385, "sim_compute_robot_state-npc1": 0.0857282280921936, "sim_compute_robot_state-npc2": 0.08595436811447144, "sim_compute_robot_state-npc3": 0.08495378494262695}, "udem1-2-0": {"driven_any": 0.1638396840114623, "sim_physics": 0.2679928385693094, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1336161522967627, "sim_render-ego": 0.06654614987580673, "in-drivable-lane": 0, "agent_compute-ego": 0.18050761844800867, "deviation-heading": 0.4401122019708283, "set_robot_commands": 0.10141327070153278, "deviation-center-line": 0.10473143754714276, "driven_lanedir_consec": 0.1336161522967627, "sim_compute_sim_state": 0.04005191637122113, "sim_compute_performance-ego": 0.0748460811117421, "sim_compute_robot_state-ego": 0.08071892157844875, "sim_compute_robot_state-npc0": 0.07240579439246136, "sim_compute_robot_state-npc1": 0.0699026169984237, "sim_compute_robot_state-npc2": 0.07099937356036642, "sim_compute_robot_state-npc3": 0.07281175903652025}, "udem1-3-0": {"driven_any": 0.17335208708445962, "sim_physics": 0.24228517214457193, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1406346665448286, "sim_render-ego": 0.06673129399617513, "in-drivable-lane": 0, "agent_compute-ego": 0.17369866371154785, "deviation-heading": 0.45767063024754506, "set_robot_commands": 0.09880641102790833, "deviation-center-line": 0.10243584037318113, "driven_lanedir_consec": 0.1406346665448286, "sim_compute_sim_state": 0.04202356934547424, "sim_compute_performance-ego": 0.0720805823802948, "sim_compute_robot_state-ego": 0.08071982860565186, "sim_compute_robot_state-npc0": 0.06798197825749715, "sim_compute_robot_state-npc1": 0.07373584310213725, "sim_compute_robot_state-npc2": 0.07292488217353821, "sim_compute_robot_state-npc3": 0.07606736818949382}, "udem1-4-0": {"driven_any": 0.14351790806728085, "sim_physics": 0.23012701670328775, "survival_time": 1.0500000000000005, "driven_lanedir": 0.0931555920843654, "sim_render-ego": 0.0658954211643764, "in-drivable-lane": 0, "agent_compute-ego": 0.19624262764340356, "deviation-heading": 0.6709700448659616, "set_robot_commands": 0.11232565698169526, "deviation-center-line": 0.049250070852227504, "driven_lanedir_consec": 0.0931555920843654, "sim_compute_sim_state": 0.04191723324003674, "sim_compute_performance-ego": 0.07491434188116164, "sim_compute_robot_state-ego": 0.08357152484712146, "sim_compute_robot_state-npc0": 0.07507644380841937, "sim_compute_robot_state-npc1": 0.07464799426850818, "sim_compute_robot_state-npc2": 0.0811003049214681, "sim_compute_robot_state-npc3": 0.08226658049083892}, "udem1-5-0": {"driven_any": 0.35119657290287587, "sim_physics": 0.22832537920047077, "survival_time": 1.950000000000001, "driven_lanedir": 0.25347406972400277, "sim_render-ego": 0.06188414647028996, "in-drivable-lane": 0, "agent_compute-ego": 0.18710788702353456, "deviation-heading": 1.0581166504090114, "set_robot_commands": 0.10515268032367411, "deviation-center-line": 0.1180516766878549, "driven_lanedir_consec": 0.25347406972400277, "sim_compute_sim_state": 0.041946918536455206, "sim_compute_performance-ego": 0.07115461276127742, "sim_compute_robot_state-ego": 0.07969012015905136, "sim_compute_robot_state-npc0": 0.07193155166430351, "sim_compute_robot_state-npc1": 0.0704042055667975, "sim_compute_robot_state-npc2": 0.07469858878698105, "sim_compute_robot_state-npc3": 0.07312250748658791}, "udem1-6-0": {"driven_any": 0.16572241729036372, "sim_physics": 0.23878068923950196, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1308114683718311, "sim_render-ego": 0.06411557197570801, "in-drivable-lane": 0, "agent_compute-ego": 0.18012394905090331, "deviation-heading": 0.5758668904902187, "set_robot_commands": 0.10322227478027345, "deviation-center-line": 0.094450097724376, "driven_lanedir_consec": 0.1308114683718311, "sim_compute_sim_state": 0.03918574333190918, "sim_compute_performance-ego": 0.07194925308227539, "sim_compute_robot_state-ego": 0.07762831687927246, "sim_compute_robot_state-npc0": 0.07130557060241699, "sim_compute_robot_state-npc1": 0.07251261711120606, "sim_compute_robot_state-npc2": 0.0708811092376709, "sim_compute_robot_state-npc3": 0.07077357292175293}, "udem1-7-0": {"driven_any": 0.1723763682467449, "sim_physics": 0.2382349967956543, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1331596410165401, "sim_render-ego": 0.06901169776916503, "in-drivable-lane": 0, "agent_compute-ego": 0.1904422283172607, "deviation-heading": 0.5602127518021432, "set_robot_commands": 0.10821028709411622, "deviation-center-line": 0.09521926579944048, "driven_lanedir_consec": 0.1331596410165401, "sim_compute_sim_state": 0.0442636775970459, "sim_compute_performance-ego": 0.07579832077026367, "sim_compute_robot_state-ego": 0.08140027046203613, "sim_compute_robot_state-npc0": 0.07383956909179687, "sim_compute_robot_state-npc1": 0.07373961448669433, "sim_compute_robot_state-npc2": 0.07482602119445801, "sim_compute_robot_state-npc3": 0.07716408729553223}, "udem1-8-0": {"driven_any": 0.24543670360849493, "sim_physics": 0.21577518217025263, "survival_time": 1.5500000000000007, "driven_lanedir": 0.1857726339111898, "sim_render-ego": 0.06731759348223286, "in-drivable-lane": 0, "agent_compute-ego": 0.18752716433617375, "deviation-heading": 0.7644837617226077, "set_robot_commands": 0.09845129136116272, "deviation-center-line": 0.0647477489237182, "driven_lanedir_consec": 0.1857726339111898, "sim_compute_sim_state": 0.04116192171650549, "sim_compute_performance-ego": 0.0765954525240006, "sim_compute_robot_state-ego": 0.08116424468255812, "sim_compute_robot_state-npc0": 0.07403949768312516, "sim_compute_robot_state-npc1": 0.07453438543504284, "sim_compute_robot_state-npc2": 0.07091560671406408, "sim_compute_robot_state-npc3": 0.07233533551616053}, "udem1-9-0": {"driven_any": 0.18095532466897324, "sim_physics": 0.2604036789674025, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1055987802067866, "sim_render-ego": 0.06812774218045749, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1907299757003784, "deviation-heading": 0.8815890667660455, "set_robot_commands": 0.10294587795551008, "deviation-center-line": 0.06453572682647107, "driven_lanedir_consec": 0.1055987802067866, "sim_compute_sim_state": 0.04013240337371826, "sim_compute_performance-ego": 0.07309043407440186, "sim_compute_robot_state-ego": 0.07755628915933463, "sim_compute_robot_state-npc0": 0.07809301523061898, "sim_compute_robot_state-npc1": 0.07298687788156363, "sim_compute_robot_state-npc2": 0.07121426325577956, "sim_compute_robot_state-npc3": 0.07309050743396465}, "udem1-10-0": {"driven_any": 0.14694927399707544, "sim_physics": 0.18919813114663828, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07136187834328944, "sim_render-ego": 0.06691752309384554, "in-drivable-lane": 0, "agent_compute-ego": 0.17236741729404614, "deviation-heading": 0.911422559624516, "set_robot_commands": 0.08956658321878185, "deviation-center-line": 0.05495539690476786, "driven_lanedir_consec": 0.07136187834328944, "sim_compute_sim_state": 0.033050578573475715, "sim_compute_performance-ego": 0.06835791339044986, "sim_compute_robot_state-ego": 0.06944462527399478, "sim_compute_robot_state-npc0": 0.06830608326455821, "sim_compute_robot_state-npc1": 0.06704236113506815, "sim_compute_robot_state-npc2": 0.06455260774363643, "sim_compute_robot_state-npc3": 0.05877858659495478}, "udem1-11-0": {"driven_any": 0.10909563105045986, "sim_physics": 0.1952864408493042, "survival_time": 1.0000000000000002, "driven_lanedir": 0.07772558228890736, "sim_render-ego": 0.06912083625793457, "in-drivable-lane": 0, "agent_compute-ego": 0.2025771617889404, "deviation-heading": 0.5245719312807839, "set_robot_commands": 0.10193238258361816, "deviation-center-line": 0.08573804977318855, "driven_lanedir_consec": 0.07772558228890736, "sim_compute_sim_state": 0.03455781936645508, "sim_compute_performance-ego": 0.07269515991210937, "sim_compute_robot_state-ego": 0.07903683185577393, "sim_compute_robot_state-npc0": 0.07163935899734497, "sim_compute_robot_state-npc1": 0.0728947639465332, "sim_compute_robot_state-npc2": 0.06674151420593262, "sim_compute_robot_state-npc3": 0.06417473554611205}, "udem1-12-0": {"driven_any": 0.24176616081258712, "sim_physics": 0.2753446027636528, "survival_time": 1.6000000000000008, "driven_lanedir": 0.14751361512030936, "sim_render-ego": 0.07208868116140366, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.21142367273569107, "deviation-heading": 0.869645637486599, "set_robot_commands": 0.10783468931913376, "deviation-center-line": 0.08948064304440953, "driven_lanedir_consec": 0.14751361512030936, "sim_compute_sim_state": 0.04386734962463379, "sim_compute_performance-ego": 0.07964003086090088, "sim_compute_robot_state-ego": 0.08939338475465775, "sim_compute_robot_state-npc0": 0.07834067940711975, "sim_compute_robot_state-npc1": 0.07713327556848526, "sim_compute_robot_state-npc2": 0.07805173099040985, "sim_compute_robot_state-npc3": 0.07810524851083755}, "udem1-13-0": {"driven_any": 0.1600388158229168, "sim_physics": 0.2207073854363483, "survival_time": 1.1500000000000004, "driven_lanedir": 0.12881429060069616, "sim_render-ego": 0.0680427240288776, "in-drivable-lane": 0, "agent_compute-ego": 0.18587597556736157, "deviation-heading": 0.4990343825118981, "set_robot_commands": 0.0983567134193752, "deviation-center-line": 0.09459525794594274, "driven_lanedir_consec": 0.12881429060069616, "sim_compute_sim_state": 0.04144192778545877, "sim_compute_performance-ego": 0.07352109577344812, "sim_compute_robot_state-ego": 0.07690345722696056, "sim_compute_robot_state-npc0": 0.07165046360181726, "sim_compute_robot_state-npc1": 0.07116121831147568, "sim_compute_robot_state-npc2": 0.07125374545221744, "sim_compute_robot_state-npc3": 0.07433322201604428}, "udem1-14-0": {"driven_any": 0.17040850081286504, "sim_physics": 0.20741298565497765, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1267507870609137, "sim_render-ego": 0.06264031850374661, "in-drivable-lane": 0, "agent_compute-ego": 0.1827106842627892, "deviation-heading": 0.6690458423489841, "set_robot_commands": 0.101889967918396, "deviation-center-line": 0.08604688395080377, "driven_lanedir_consec": 0.1267507870609137, "sim_compute_sim_state": 0.03800440751589262, "sim_compute_performance-ego": 0.06926251374758206, "sim_compute_robot_state-ego": 0.07883692704714261, "sim_compute_robot_state-npc0": 0.0719519119996291, "sim_compute_robot_state-npc1": 0.07169066942655124, "sim_compute_robot_state-npc2": 0.07481407202207126, "sim_compute_robot_state-npc3": 0.06899377015920785}}
set_robot_commands_max	0.13621142932346889
set_robot_commands_mean	0.10643701783190512
set_robot_commands_median	0.10294587795551008
set_robot_commands_min	0.08956658321878185
sim_compute_performance-ego_max	0.09249493810865614
sim_compute_performance-ego_mean	0.07564204791207114
sim_compute_performance-ego_median	0.07352109577344812
sim_compute_performance-ego_min	0.06835791339044986
sim_compute_robot_state-ego_max	0.11637681501883047
sim_compute_robot_state-ego_mean	0.08345437933652032
sim_compute_robot_state-ego_median	0.08071892157844875
sim_compute_robot_state-ego_min	0.06944462527399478
sim_compute_robot_state-npc0_max	0.08927294186183385
sim_compute_robot_state-npc0_mean	0.07493560107766235
sim_compute_robot_state-npc0_median	0.07240579439246136
sim_compute_robot_state-npc0_min	0.06798197825749715
sim_compute_robot_state-npc1_max	0.08929249975416395
sim_compute_robot_state-npc1_mean	0.07449381140565631
sim_compute_robot_state-npc1_median	0.07298687788156363
sim_compute_robot_state-npc1_min	0.06704236113506815
sim_compute_robot_state-npc2_max	0.08684534496731228
sim_compute_robot_state-npc2_mean	0.07438490222269185
sim_compute_robot_state-npc2_median	0.07292488217353821
sim_compute_robot_state-npc2_min	0.06455260774363643
sim_compute_robot_state-npc3_max	0.0896721327746356
sim_compute_robot_state-npc3_mean	0.07444287992768468
sim_compute_robot_state-npc3_median	0.07312250748658791
sim_compute_robot_state-npc3_min	0.05877858659495478
sim_compute_sim_state_max	0.04748607533318656
sim_compute_sim_state_mean	0.04102884993358757
sim_compute_sim_state_median	0.04144192778545877
sim_compute_sim_state_min	0.033050578573475715
sim_physics_max	0.32355157818113056
sim_physics_mean	0.24202808213040347
sim_physics_median	0.2382349967956543
sim_physics_min	0.18919813114663828
sim_render-ego_max	0.08449756247656685
sim_render-ego_mean	0.06905108171206595
sim_render-ego_median	0.06731759348223286
sim_render-ego_min	0.06188414647028996
simulation-passed	1
survival_time_max	1.950000000000001
survival_time_mean	1.3100000000000007
survival_time_min	1.0000000000000002

No reset possible

21288

2450

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 22:03:51+00:00

2019-04-27 23:00:10+00:00

0:56:19

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-25-98-2470-job21288/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21274

2436

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-27 22:00:18+00:00

2019-04-27 22:01:35+00:00

0:01:17

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21211

2774

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 21:01:46+00:00

2019-04-27 22:00:11+00:00

0:58:25

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-25-98-2470-job21211/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21197

2542

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-27 20:58:17+00:00

2019-04-27 21:00:24+00:00

0:02:07

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2542/step1-simulation-ip-172-31-25-98-2470-job21197/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21190

2552

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 20:48:20+00:00

2019-04-27 20:57:59+00:00

0:09:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.5999999999999988
deviation-center-line_median	0.16987818035809085
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.08502737569137359
agent_compute-ego_mean	0.07915146090703248
agent_compute-ego_median	0.08086508512496948
agent_compute-ego_min	0.07297355853594266
deviation-center-line_max	0.2294363663374862
deviation-center-line_mean	0.14972083567701736
deviation-center-line_min	0.06426934298501713
deviation-heading_max	0.6986268167330368
deviation-heading_mean	0.4280304166285303
deviation-heading_median	0.41847631252347706
deviation-heading_min	0.2596285487829774
driven_any_max	1.2972979671834337
driven_any_mean	0.7173901327940211
driven_any_median	0.7336463183586153
driven_any_min	0.26903550091980144
driven_lanedir_consec_max	0.97716132702229
driven_lanedir_consec_mean	0.5227475277218055
driven_lanedir_consec_min	0.2407721645627201
driven_lanedir_max	0.97716132702229
driven_lanedir_mean	0.5227475277218055
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2407721645627201
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.5799999999999983
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.2039426481220084, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.07057987804144202, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.08502737569137359, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.12272363649287694, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04516113979715697, "sim_compute_performance-ego": 0.07938597571681923, "sim_compute_robot_state-ego": 0.09404628713366012, "sim_compute_robot_state-npc0": 0.07886546766254264, "sim_compute_robot_state-npc1": 0.07685034039994361, "sim_compute_robot_state-npc2": 0.07942328654544455, "sim_compute_robot_state-npc3": 0.07990285376427879}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.21972288936376572, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06586648523807526, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08086508512496948, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.10942172259092332, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04338041692972183, "sim_compute_performance-ego": 0.07525432854890823, "sim_compute_robot_state-ego": 0.09025339037179948, "sim_compute_robot_state-npc0": 0.07792536914348602, "sim_compute_robot_state-npc1": 0.07923949509859085, "sim_compute_robot_state-npc2": 0.07367482036352158, "sim_compute_robot_state-npc3": 0.07516453415155411}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.19285537646367, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.0661360896550692, "in-drivable-lane": 0, "agent_compute-ego": 0.07297355853594266, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.10289090413313644, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.042144532387073226, "sim_compute_performance-ego": 0.0732116515819843, "sim_compute_robot_state-ego": 0.07985263145886935, "sim_compute_robot_state-npc0": 0.06895249623518723, "sim_compute_robot_state-npc1": 0.07031880433742817, "sim_compute_robot_state-npc2": 0.07668544237430279, "sim_compute_robot_state-npc3": 0.07373102353169368}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.2141612114444856, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.07124530884527391, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.08194921862694525, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.11285970287938273, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.043822388495168375, "sim_compute_performance-ego": 0.07952327369361796, "sim_compute_robot_state-ego": 0.08845506175871819, "sim_compute_robot_state-npc0": 0.07735368769655945, "sim_compute_robot_state-npc1": 0.07649374777270902, "sim_compute_robot_state-npc2": 0.07872637369299448, "sim_compute_robot_state-npc3": 0.07847189390531151}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.2176366987682524, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.0670528979528518, "in-drivable-lane": 0, "agent_compute-ego": 0.07494206655593146, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.10929872876121884, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.04247296424139114, "sim_compute_performance-ego": 0.0789525622413272, "sim_compute_robot_state-ego": 0.08896324748084658, "sim_compute_robot_state-npc0": 0.07555571056547619, "sim_compute_robot_state-npc1": 0.0724273749760219, "sim_compute_robot_state-npc2": 0.07253827367510114, "sim_compute_robot_state-npc3": 0.07375340234665644}}
set_robot_commands_max	0.12272363649287694
set_robot_commands_mean	0.11143893897150764
set_robot_commands_median	0.10942172259092332
set_robot_commands_min	0.10289090413313644
sim_compute_performance-ego_max	0.07952327369361796
sim_compute_performance-ego_mean	0.07726555835653137
sim_compute_performance-ego_median	0.0789525622413272
sim_compute_performance-ego_min	0.0732116515819843
sim_compute_robot_state-ego_max	0.09404628713366012
sim_compute_robot_state-ego_mean	0.08831412364077876
sim_compute_robot_state-ego_median	0.08896324748084658
sim_compute_robot_state-ego_min	0.07985263145886935
sim_compute_robot_state-npc0_max	0.07886546766254264
sim_compute_robot_state-npc0_mean	0.0757305462606503
sim_compute_robot_state-npc0_median	0.07735368769655945
sim_compute_robot_state-npc0_min	0.06895249623518723
sim_compute_robot_state-npc1_max	0.07923949509859085
sim_compute_robot_state-npc1_mean	0.0750659525169387
sim_compute_robot_state-npc1_median	0.07649374777270902
sim_compute_robot_state-npc1_min	0.07031880433742817
sim_compute_robot_state-npc2_max	0.07942328654544455
sim_compute_robot_state-npc2_mean	0.07620963933027292
sim_compute_robot_state-npc2_median	0.07668544237430279
sim_compute_robot_state-npc2_min	0.07253827367510114
sim_compute_robot_state-npc3_max	0.07990285376427879
sim_compute_robot_state-npc3_mean	0.07620474153989891
sim_compute_robot_state-npc3_median	0.07516453415155411
sim_compute_robot_state-npc3_min	0.07373102353169368
sim_compute_sim_state_max	0.04516113979715697
sim_compute_sim_state_mean	0.0433962883701023
sim_compute_sim_state_median	0.04338041692972183
sim_compute_sim_state_min	0.042144532387073226
sim_physics_max	0.21972288936376572
sim_physics_mean	0.20966376483243643
sim_physics_median	0.2141612114444856
sim_physics_min	0.19285537646367
sim_render-ego_max	0.07124530884527391
sim_render-ego_mean	0.06817613194654243
sim_render-ego_median	0.0670528979528518
sim_render-ego_min	0.06586648523807526
simulation-passed	1
survival_time_max	4.6499999999999915
survival_time_mean	2.6899999999999973
survival_time_min	1.0500000000000005

No reset possible

21185

2561

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 20:40:34+00:00

2019-04-27 20:47:52+00:00

0:07:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.3999999999999995
deviation-center-line_median	0.1166759393545397
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.09112110345259956
agent_compute-ego_mean	0.08698654329143653
agent_compute-ego_median	0.08686385692005426
agent_compute-ego_min	0.0819799154996872
deviation-center-line_max	0.16987818035809085
deviation-center-line_mean	0.13199870851217008
deviation-center-line_min	0.1011892720306074
deviation-heading_max	0.5809378480871981
deviation-heading_mean	0.4194004386292103
deviation-heading_median	0.34882560565471876
deviation-heading_min	0.2596285487829774
driven_any_max	0.922682252912863
driven_any_mean	0.6324710235085378
driven_any_median	0.609146202404747
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.6632135184572027
driven_lanedir_consec_mean	0.4245071231796042
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.6632135184572027
driven_lanedir_mean	0.4245071231796042
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.6299999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.14737017053953358, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.07346182138147489, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.08686385692005426, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.11960422824805891, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.044979683110411735, "sim_compute_performance-ego": 0.08205711337882028, "sim_compute_robot_state-ego": 0.09835714353641992}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.1481584111849467, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.07147337198257446, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08504592180252075, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.11915419101715088, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.04763132731119792, "sim_compute_performance-ego": 0.08273452917734782, "sim_compute_robot_state-ego": 0.0945516268412272}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.1441800052469427, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.07235045866532759, "in-drivable-lane": 0, "agent_compute-ego": 0.08992191878232089, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.12345228411934592, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.04532776095650413, "sim_compute_performance-ego": 0.08441802588376132, "sim_compute_robot_state-ego": 0.10534539005973122}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.13633087277412417, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.07103009521961212, "in-drivable-lane": 0, "agent_compute-ego": 0.0819799154996872, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.12049681941668192, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.04418818652629852, "sim_compute_performance-ego": 0.07807027300198872, "sim_compute_robot_state-ego": 0.08838271101315816}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.1570510605107183, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.07263648509979248, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.09112110345259956, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.1238037399623705, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.04815535959990128, "sim_compute_performance-ego": 0.08257838435794997, "sim_compute_robot_state-ego": 0.09635649556699008}}
set_robot_commands_max	0.1238037399623705
set_robot_commands_mean	0.12130225255272165
set_robot_commands_median	0.12049681941668192
set_robot_commands_min	0.11915419101715088
sim_compute_performance-ego_max	0.08441802588376132
sim_compute_performance-ego_mean	0.08197166515997362
sim_compute_performance-ego_median	0.08257838435794997
sim_compute_performance-ego_min	0.07807027300198872
sim_compute_robot_state-ego_max	0.10534539005973122
sim_compute_robot_state-ego_mean	0.09659867340350532
sim_compute_robot_state-ego_median	0.09635649556699008
sim_compute_robot_state-ego_min	0.08838271101315816
sim_compute_sim_state_max	0.04815535959990128
sim_compute_sim_state_mean	0.04605646350086272
sim_compute_sim_state_median	0.04532776095650413
sim_compute_sim_state_min	0.04418818652629852
sim_physics_max	0.1570510605107183
sim_physics_mean	0.14661810405125308
sim_physics_median	0.14737017053953358
sim_physics_min	0.13633087277412417
sim_render-ego_max	0.07346182138147489
sim_render-ego_mean	0.07219044646975631
sim_render-ego_median	0.07235045866532759
sim_render-ego_min	0.07103009521961212
simulation-passed	1
survival_time_max	3.5499999999999954
survival_time_mean	2.469999999999999
survival_time_min	1.1000000000000003

No reset possible

21175

2612

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 20:04:30+00:00

2019-04-27 20:39:52+00:00

0:35:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2875407694053156
survival_time_median	2.849999999999998
deviation-center-line_median	0.11031194850197353
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.0944156561579023
agent_compute-ego_mean	0.08770328250469776
agent_compute-ego_median	0.08738684972127278
agent_compute-ego_min	0.08167491788449495
deviation-center-line_max	0.2701922695523504
deviation-center-line_mean	0.13746050030700233
deviation-center-line_min	0.07113819587235681
deviation-heading_max	1.4854398920276677
deviation-heading_mean	0.7236995121312619
deviation-heading_median	0.6953408166028192
deviation-heading_min	0.3118646573709166
driven_any_max	1.934434121703833
driven_any_mean	0.806757806634148
driven_any_median	0.8072381933001392
driven_any_min	0.20912585880423715
driven_lanedir_consec_max	0.7222251056746308
driven_lanedir_consec_mean	0.3962831867516217
driven_lanedir_consec_min	0.1917983424483971
driven_lanedir_max	0.7287863177121016
driven_lanedir_mean	0.3975640776898326
driven_lanedir_median	0.2875407694053156
driven_lanedir_min	0.1917983424483971
in-drivable-lane_max	4.04999999999999
in-drivable-lane_mean	1.2133333333333305
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.25162498922233123, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.07415730694690383, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.08731293678283691, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.12180417704294964, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.04436436331415751, "sim_compute_performance-ego": 0.0810396585119776, "sim_compute_robot_state-ego": 0.09377716822796556, "sim_compute_robot_state-npc0": 0.08231486469866281, "sim_compute_robot_state-npc1": 0.08151392764355762, "sim_compute_robot_state-npc2": 0.08141429165759718, "sim_compute_robot_state-npc3": 0.08122366594980998}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.2574063848566126, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.08026738520021792, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08952193790011936, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.12043673903853803, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.05169379269635236, "sim_compute_performance-ego": 0.0798302138293231, "sim_compute_robot_state-ego": 0.09231835824471932, "sim_compute_robot_state-npc0": 0.08589470828021015, "sim_compute_robot_state-npc1": 0.08602687164589211, "sim_compute_robot_state-npc2": 0.07857825137950757, "sim_compute_robot_state-npc3": 0.08231936560736762}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.2896723044224275, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.07544388526525253, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.09167061096582656, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.1203751258361034, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.0446390708287557, "sim_compute_performance-ego": 0.08521149097344814, "sim_compute_robot_state-ego": 0.09594313303629558, "sim_compute_robot_state-npc0": 0.08224566471882355, "sim_compute_robot_state-npc1": 0.08046556436098538, "sim_compute_robot_state-npc2": 0.08053261500138503, "sim_compute_robot_state-npc3": 0.08358933375431941}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.27215602105123954, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.07273179606387489, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.08598628797029194, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.12389429410298664, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.04739915278919956, "sim_compute_performance-ego": 0.0973026292365894, "sim_compute_robot_state-ego": 0.09627778488293028, "sim_compute_robot_state-npc0": 0.08220843264931127, "sim_compute_robot_state-npc1": 0.08500862121582031, "sim_compute_robot_state-npc2": 0.0846738898963259, "sim_compute_robot_state-npc3": 0.08256062708402935}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.2870051757149074, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06889251004094663, "in-drivable-lane": 0, "agent_compute-ego": 0.08167491788449495, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.11572506116784136, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.04231110863063647, "sim_compute_performance-ego": 0.07850843927134639, "sim_compute_robot_state-ego": 0.09465084905209747, "sim_compute_robot_state-npc0": 0.07527673762777577, "sim_compute_robot_state-npc1": 0.07487024431643279, "sim_compute_robot_state-npc2": 0.07494520104449728, "sim_compute_robot_state-npc3": 0.07366720489833666}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.26227139725404625, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.07379507551006242, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.08556941210054884, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.1192481751535453, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.0460586477728451, "sim_compute_performance-ego": 0.08259379863739014, "sim_compute_robot_state-ego": 0.08953168812920065, "sim_compute_robot_state-npc0": 0.08125278061511469, "sim_compute_robot_state-npc1": 0.07980337563683004, "sim_compute_robot_state-npc2": 0.0810550287658093, "sim_compute_robot_state-npc3": 0.08060028272516587}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.2479970795767648, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.07242356709071568, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.08558895587921142, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.12036390474864415, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.04547227621078491, "sim_compute_performance-ego": 0.08047283717564174, "sim_compute_robot_state-ego": 0.09158866575786044, "sim_compute_robot_state-npc0": 0.082516838823046, "sim_compute_robot_state-npc1": 0.0796874795641218, "sim_compute_robot_state-npc2": 0.07989898068564279, "sim_compute_robot_state-npc3": 0.0813608169555664}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.2707526945088008, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.07436142229054073, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.08667807709680844, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.12024301698763076, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.04697115453955245, "sim_compute_performance-ego": 0.08321304843850331, "sim_compute_robot_state-ego": 0.09698360913420376, "sim_compute_robot_state-npc0": 0.0840572037108957, "sim_compute_robot_state-npc1": 0.08133409447865943, "sim_compute_robot_state-npc2": 0.08278374149374766, "sim_compute_robot_state-npc3": 0.08377694103815785}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.27657781645309093, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.07315900436667509, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.08955768097278684, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.1251576778500579, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.04431210839471152, "sim_compute_performance-ego": 0.08259846443353697, "sim_compute_robot_state-ego": 0.10212057135825932, "sim_compute_robot_state-npc0": 0.08128387151762496, "sim_compute_robot_state-npc1": 0.08272718551547029, "sim_compute_robot_state-npc2": 0.08181304432624995, "sim_compute_robot_state-npc3": 0.0809859176014745}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.30978076274578387, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.07678004411550668, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08815246361952561, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.12215019189394435, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.04744386672973633, "sim_compute_performance-ego": 0.08594197493333083, "sim_compute_robot_state-ego": 0.09366772725031926, "sim_compute_robot_state-npc0": 0.07920840153327355, "sim_compute_robot_state-npc1": 0.08461205775921161, "sim_compute_robot_state-npc2": 0.08381855487823486, "sim_compute_robot_state-npc3": 0.08203900777376615}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.27013929684956867, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.07397817611694336, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.08738684972127278, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.11745639801025393, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.0434995969136556, "sim_compute_performance-ego": 0.08560413360595703, "sim_compute_robot_state-ego": 0.09284587860107422, "sim_compute_robot_state-npc0": 0.08010623296101888, "sim_compute_robot_state-npc1": 0.07870336214701334, "sim_compute_robot_state-npc2": 0.08096630096435548, "sim_compute_robot_state-npc3": 0.08236242612202962}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.30247474852062406, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06995251065208799, "in-drivable-lane": 0, "agent_compute-ego": 0.08758647101266044, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.1360346249171666, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.04340788296290806, "sim_compute_performance-ego": 0.08646119208562941, "sim_compute_robot_state-ego": 0.09654579843793595, "sim_compute_robot_state-npc0": 0.08056058202471052, "sim_compute_robot_state-npc1": 0.078270537512643, "sim_compute_robot_state-npc2": 0.07810139656066895, "sim_compute_robot_state-npc3": 0.08016968908764067}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.2617967405984568, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.08161616879840229, "in-drivable-lane": 1.15, "agent_compute-ego": 0.08606320203736771, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.11629722839178042, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.04451772224071414, "sim_compute_performance-ego": 0.08533805470133937, "sim_compute_robot_state-ego": 0.09987663668255474, "sim_compute_robot_state-npc0": 0.08262593801631483, "sim_compute_robot_state-npc1": 0.08216900603715764, "sim_compute_robot_state-npc2": 0.08282660329064657, "sim_compute_robot_state-npc3": 0.08329848910486976}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.2808856112616403, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.0752203209059579, "in-drivable-lane": 0, "agent_compute-ego": 0.0944156561579023, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.13059956686837332, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.044171784605298726, "sim_compute_performance-ego": 0.08625847952706474, "sim_compute_robot_state-ego": 0.09679526090621948, "sim_compute_robot_state-npc0": 0.0900863664490836, "sim_compute_robot_state-npc1": 0.08708803142820086, "sim_compute_robot_state-npc2": 0.08557226828166417, "sim_compute_robot_state-npc3": 0.08432792765753609}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.28276995584076525, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.07239737230188706, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.08838377746881224, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.12215167400883692, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.0454248119803036, "sim_compute_performance-ego": 0.07830315945195217, "sim_compute_robot_state-ego": 0.0939643616769828, "sim_compute_robot_state-npc0": 0.08115020452761183, "sim_compute_robot_state-npc1": 0.07697758487626619, "sim_compute_robot_state-npc2": 0.08037161827087402, "sim_compute_robot_state-npc3": 0.08173533981921625}}
set_robot_commands_max	0.1360346249171666
set_robot_commands_mean	0.12212919040124352
set_robot_commands_median	0.12043673903853803
set_robot_commands_min	0.11572506116784136
sim_compute_performance-ego_max	0.0973026292365894
sim_compute_performance-ego_mean	0.08391183832086865
sim_compute_performance-ego_median	0.08321304843850331
sim_compute_performance-ego_min	0.07830315945195217
sim_compute_robot_state-ego_max	0.10212057135825932
sim_compute_robot_state-ego_mean	0.0951258327585746
sim_compute_robot_state-ego_median	0.09465084905209747
sim_compute_robot_state-ego_min	0.08953168812920065
sim_compute_robot_state-npc0_max	0.0900863664490836
sim_compute_robot_state-npc0_mean	0.08205258854356522
sim_compute_robot_state-npc0_median	0.08220843264931127
sim_compute_robot_state-npc0_min	0.07527673762777577
sim_compute_robot_state-npc1_max	0.08708803142820086
sim_compute_robot_state-npc1_mean	0.08128386294255083
sim_compute_robot_state-npc1_median	0.08133409447865943
sim_compute_robot_state-npc1_min	0.07487024431643279
sim_compute_robot_state-npc2_max	0.08557226828166417
sim_compute_robot_state-npc2_mean	0.08115678576648046
sim_compute_robot_state-npc2_median	0.0810550287658093
sim_compute_robot_state-npc2_min	0.07494520104449728
sim_compute_robot_state-npc3_max	0.08432792765753609
sim_compute_robot_state-npc3_mean	0.08160113567861908
sim_compute_robot_state-npc3_median	0.08203900777376615
sim_compute_robot_state-npc3_min	0.07366720489833666
sim_compute_sim_state_max	0.05169379269635236
sim_compute_sim_state_mean	0.045445822707307466
sim_compute_sim_state_median	0.0446390708287557
sim_compute_sim_state_min	0.04231110863063647
sim_physics_max	0.30978076274578387
sim_physics_mean	0.274887398591804
sim_physics_median	0.27215602105123954
sim_physics_min	0.2479970795767648
sim_render-ego_max	0.08161616879840229
sim_render-ego_mean	0.07434510304439833
sim_render-ego_median	0.07397817611694336
sim_render-ego_min	0.06889251004094663
simulation-passed	1
survival_time_max	6.999999999999983
survival_time_mean	3.043333333333329
survival_time_min	1.0500000000000005

No reset possible

21154

2573

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-27 20:00:25+00:00

2019-04-27 20:03:42+00:00

0:03:17

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21120

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-27 19:01:26+00:00

2019-04-27 20:00:11+00:00

0:58:45

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-25-98-2470-job21120/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21097

2676

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 18:26:28+00:00

2019-04-27 19:00:11+00:00

0:33:43

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2676/step1-simulation-ip-172-31-25-98-2470-job21097/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21083

2685

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 18:02:00+00:00

2019-04-27 18:26:21+00:00

0:24:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24862644546367377
survival_time_median	4.699999999999991
deviation-center-line_median	0.42995423877430233
in-drivable-lane_median	0.9999999999999976

other stats

agent_compute-ego_max	0.10243747843072767
agent_compute-ego_mean	0.09599345113947892
agent_compute-ego_median	0.09397648183090426
agent_compute-ego_min	0.09296518137023715
deviation-center-line_max	0.9013392336916468
deviation-center-line_mean	0.5014139060537774
deviation-center-line_min	0.1449523617614403
deviation-heading_max	5.208916690694444
deviation-heading_mean	2.55638884626002
deviation-heading_median	1.903367667292453
deviation-heading_min	0.5664507153750655
driven_any_max	2.300682682163002
driven_any_mean	1.0421500724040722
driven_any_median	0.6846643963962404
driven_any_min	0.28384869441284694
driven_lanedir_consec_max	1.420459521472255
driven_lanedir_consec_mean	0.5371037632575723
driven_lanedir_consec_min	0.16899767176394564
driven_lanedir_max	1.7680246975748146
driven_lanedir_mean	0.722969491412256
driven_lanedir_median	0.3888669703072547
driven_lanedir_min	0.24767411931551964
in-drivable-lane_max	2.1000000000000147
in-drivable-lane_mean	1.0600000000000052
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.6846643963962404, "sim_physics": 0.2648730937470781, "survival_time": 4.699999999999991, "driven_lanedir": 0.3888669703072547, "sim_render-ego": 0.08056293649876371, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.10243747843072767, "deviation-heading": 1.903367667292453, "set_robot_commands": 0.12549026215330084, "deviation-center-line": 0.42995423877430233, "driven_lanedir_consec": 0.16899767176394564, "sim_compute_sim_state": 0.04747144719387623, "sim_compute_performance-ego": 0.08583412271864871, "sim_compute_robot_state-ego": 0.09350846422479508, "sim_compute_robot_state-npc0": 0.08483741384871463, "sim_compute_robot_state-npc1": 0.08298931730554458, "sim_compute_robot_state-npc2": 0.08282114089803493, "sim_compute_robot_state-npc3": 0.08360896211989383}, "udem1-1-0": {"driven_any": 0.29991237612077026, "sim_physics": 0.27379756082188, "survival_time": 2.2, "driven_lanedir": 0.24862644546367377, "sim_render-ego": 0.07600456476211548, "in-drivable-lane": 0, "agent_compute-ego": 0.0935345237905329, "deviation-heading": 1.1430574482545637, "set_robot_commands": 0.12291509996760976, "deviation-center-line": 0.1449523617614403, "driven_lanedir_consec": 0.24862644546367377, "sim_compute_sim_state": 0.04462567242709073, "sim_compute_performance-ego": 0.08291705630042336, "sim_compute_robot_state-ego": 0.09582602977752686, "sim_compute_robot_state-npc0": 0.08131376721642235, "sim_compute_robot_state-npc1": 0.07996442101218483, "sim_compute_robot_state-npc2": 0.08165565945885399, "sim_compute_robot_state-npc3": 0.08240721442482689}, "udem1-2-0": {"driven_any": 1.6416422129275012, "sim_physics": 0.25380178876397735, "survival_time": 10.550000000000017, "driven_lanedir": 0.9616552244000168, "sim_render-ego": 0.07547875038255447, "in-drivable-lane": 2.1000000000000147, "agent_compute-ego": 0.09397648183090426, "deviation-heading": 5.208916690694444, "set_robot_commands": 0.121360156208418, "deviation-center-line": 0.8589846343799672, "driven_lanedir_consec": 0.5997610582724673, "sim_compute_sim_state": 0.04575955698275453, "sim_compute_performance-ego": 0.08433195877979152, "sim_compute_robot_state-ego": 0.0946518346596668, "sim_compute_robot_state-npc0": 0.08299433676552434, "sim_compute_robot_state-npc1": 0.0831669337376599, "sim_compute_robot_state-npc2": 0.08335812509907366, "sim_compute_robot_state-npc3": 0.08185063719184478}, "udem1-3-0": {"driven_any": 0.28384869441284694, "sim_physics": 0.2724005494798933, "survival_time": 2.1000000000000005, "driven_lanedir": 0.24767411931551964, "sim_render-ego": 0.07833911123729888, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.09705359027499244, "deviation-heading": 0.5664507153750655, "set_robot_commands": 0.12383879366375151, "deviation-center-line": 0.17183906166153062, "driven_lanedir_consec": 0.24767411931551964, "sim_compute_sim_state": 0.04501739002409435, "sim_compute_performance-ego": 0.08445119290124803, "sim_compute_robot_state-ego": 0.09440644014449348, "sim_compute_robot_state-npc0": 0.08424559093656994, "sim_compute_robot_state-npc1": 0.08275022393181211, "sim_compute_robot_state-npc2": 0.08260477156866164, "sim_compute_robot_state-npc3": 0.08234281199319023}, "udem1-4-0": {"driven_any": 2.300682682163002, "sim_physics": 0.27175385960133003, "survival_time": 14.650000000000071, "driven_lanedir": 1.7680246975748146, "sim_render-ego": 0.07506086232312303, "in-drivable-lane": 2.100000000000014, "agent_compute-ego": 0.09296518137023715, "deviation-heading": 3.9601517096835743, "set_robot_commands": 0.12055561811037031, "deviation-center-line": 0.9013392336916468, "driven_lanedir_consec": 1.420459521472255, "sim_compute_sim_state": 0.04540334952162394, "sim_compute_performance-ego": 0.08288964313858604, "sim_compute_robot_state-ego": 0.09598775447025236, "sim_compute_robot_state-npc0": 0.08257926446179074, "sim_compute_robot_state-npc1": 0.0828423133889156, "sim_compute_robot_state-npc2": 0.08156747541329966, "sim_compute_robot_state-npc3": 0.08885713892992039}}
set_robot_commands_max	0.12549026215330084
set_robot_commands_mean	0.12283198602069008
set_robot_commands_median	0.12291509996760976
set_robot_commands_min	0.12055561811037031
sim_compute_performance-ego_max	0.08583412271864871
sim_compute_performance-ego_mean	0.08408479476773953
sim_compute_performance-ego_median	0.08433195877979152
sim_compute_performance-ego_min	0.08288964313858604
sim_compute_robot_state-ego_max	0.09598775447025236
sim_compute_robot_state-ego_mean	0.0948761046553469
sim_compute_robot_state-ego_median	0.0946518346596668
sim_compute_robot_state-ego_min	0.09350846422479508
sim_compute_robot_state-npc0_max	0.08483741384871463
sim_compute_robot_state-npc0_mean	0.0831940746458044
sim_compute_robot_state-npc0_median	0.08299433676552434
sim_compute_robot_state-npc0_min	0.08131376721642235
sim_compute_robot_state-npc1_max	0.0831669337376599
sim_compute_robot_state-npc1_mean	0.0823426418752234
sim_compute_robot_state-npc1_median	0.0828423133889156
sim_compute_robot_state-npc1_min	0.07996442101218483
sim_compute_robot_state-npc2_max	0.08335812509907366
sim_compute_robot_state-npc2_mean	0.08240143448758477
sim_compute_robot_state-npc2_median	0.08260477156866164
sim_compute_robot_state-npc2_min	0.08156747541329966
sim_compute_robot_state-npc3_max	0.08885713892992039
sim_compute_robot_state-npc3_mean	0.08381335293193522
sim_compute_robot_state-npc3_median	0.08240721442482689
sim_compute_robot_state-npc3_min	0.08185063719184478
sim_compute_sim_state_max	0.04747144719387623
sim_compute_sim_state_mean	0.04565548322988795
sim_compute_sim_state_median	0.04540334952162394
sim_compute_sim_state_min	0.04462567242709073
sim_physics_max	0.27379756082188
sim_physics_mean	0.2673253704828318
sim_physics_median	0.27175385960133003
sim_physics_min	0.25380178876397735
sim_render-ego_max	0.08056293649876371
sim_render-ego_mean	0.07708924504077111
sim_render-ego_median	0.07600456476211548
sim_render-ego_min	0.07506086232312303
simulation-passed	1
survival_time_max	14.650000000000071
survival_time_mean	6.840000000000016
survival_time_min	2.1000000000000005

No reset possible

21075

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 17:50:19+00:00

2019-04-27 18:00:04+00:00

0:09:45

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2698/step1-simulation-ip-172-31-25-98-2470-job21075/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21035

2758

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 17:19:59+00:00

2019-04-27 17:49:29+00:00

0:29:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.30314311735235044
survival_time_median	2.6499999999999986
deviation-center-line_median	0.1192462800776758
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.08338322462858977
agent_compute-ego_mean	0.07974228594891357
agent_compute-ego_median	0.0800395371778956
agent_compute-ego_min	0.07386039733886719
deviation-center-line_max	0.2294363663374862
deviation-center-line_mean	0.12653708755488874
deviation-center-line_min	0.06426934298501713
deviation-heading_max	0.6986268167330368
deviation-heading_mean	0.44799520296706863
deviation-heading_median	0.41847631252347706
deviation-heading_min	0.2596285487829774
driven_any_max	1.599733354117788
driven_any_mean	0.8095342605803044
driven_any_median	0.7336463183586153
driven_any_min	0.26903550091980144
driven_lanedir_consec_max	1.021002447119848
driven_lanedir_consec_mean	0.448904809024379
driven_lanedir_consec_min	0.2407721645627201
driven_lanedir_max	1.021002447119848
driven_lanedir_mean	0.448904809024379
driven_lanedir_median	0.30314311735235044
driven_lanedir_min	0.2407721645627201
in-drivable-lane_max	4.799999999999986
in-drivable-lane_mean	1.1466666666666634
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.19698601037683625, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06882589971515495, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.0824488619683494, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.10866999290358852, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04288180781082368, "sim_compute_performance-ego": 0.07969458674041319, "sim_compute_robot_state-ego": 0.08708049545825368, "sim_compute_robot_state-npc0": 0.07734497500137544, "sim_compute_robot_state-npc1": 0.07712284611984038, "sim_compute_robot_state-npc2": 0.07732880619210257, "sim_compute_robot_state-npc3": 0.07974821748867841}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.21035456657409668, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06926004588603973, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0804925262928009, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.10621677339076996, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04251716285943985, "sim_compute_performance-ego": 0.0804612785577774, "sim_compute_robot_state-ego": 0.08838210999965668, "sim_compute_robot_state-npc0": 0.07868785411119461, "sim_compute_robot_state-npc1": 0.07999158650636673, "sim_compute_robot_state-npc2": 0.0801987424492836, "sim_compute_robot_state-npc3": 0.0773993581533432}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.2299086726628817, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06994257064966056, "in-drivable-lane": 0, "agent_compute-ego": 0.07769215106964111, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.10171064963707556, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.041128300703488864, "sim_compute_performance-ego": 0.07495819605313815, "sim_compute_robot_state-ego": 0.08166248064774734, "sim_compute_robot_state-npc0": 0.07835728847063504, "sim_compute_robot_state-npc1": 0.07460068739377536, "sim_compute_robot_state-npc2": 0.07225252114809476, "sim_compute_robot_state-npc3": 0.0740624161866995}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.21161168365068336, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.06857348257495512, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07864264775347966, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.1101967724420691, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.042650499651508945, "sim_compute_performance-ego": 0.07785566647847493, "sim_compute_robot_state-ego": 0.08672411980167512, "sim_compute_robot_state-npc0": 0.07689242465521699, "sim_compute_robot_state-npc1": 0.07603961165233325, "sim_compute_robot_state-npc2": 0.07464728047770838, "sim_compute_robot_state-npc3": 0.07627918130608015}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.20231273060753233, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.07111095246814546, "in-drivable-lane": 0, "agent_compute-ego": 0.07940260569254558, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.10276410693214053, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.044171594438098725, "sim_compute_performance-ego": 0.07392590386526925, "sim_compute_robot_state-ego": 0.08625248500279017, "sim_compute_robot_state-npc0": 0.0727913606734503, "sim_compute_robot_state-npc1": 0.07620990843999953, "sim_compute_robot_state-npc2": 0.07661204111008417, "sim_compute_robot_state-npc3": 0.07504374640328544}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.21208752679430748, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.07131957219651908, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.08081204438012493, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.11584054734096054, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.04185093729949194, "sim_compute_performance-ego": 0.07903962687027356, "sim_compute_robot_state-ego": 0.08751268229208702, "sim_compute_robot_state-npc0": 0.07878312788718989, "sim_compute_robot_state-npc1": 0.07659745807490073, "sim_compute_robot_state-npc2": 0.07774677158387239, "sim_compute_robot_state-npc3": 0.07714857739850509}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.18906372217904951, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.07093748024531774, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0809820776893979, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.11060957397733416, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.041729810692015146, "sim_compute_performance-ego": 0.07708038886388142, "sim_compute_robot_state-ego": 0.08355626889637538, "sim_compute_robot_state-npc0": 0.07560682864416213, "sim_compute_robot_state-npc1": 0.07422243697302681, "sim_compute_robot_state-npc2": 0.0768012801806132, "sim_compute_robot_state-npc3": 0.07767506724312193}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.218369628932025, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.0714061485754477, "in-drivable-lane": 0, "agent_compute-ego": 0.08065896098678177, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.11025363367957038, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.04462848482905207, "sim_compute_performance-ego": 0.07806855601233405, "sim_compute_robot_state-ego": 0.08506557748124406, "sim_compute_robot_state-npc0": 0.07916721137794289, "sim_compute_robot_state-npc1": 0.07749470826741811, "sim_compute_robot_state-npc2": 0.07515648571220604, "sim_compute_robot_state-npc3": 0.0754717781737044}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.18881462017695108, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06843486759397718, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.07905492517683241, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.10883214076360066, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.04572071631749471, "sim_compute_performance-ego": 0.07653019163343641, "sim_compute_robot_state-ego": 0.08417117926809523, "sim_compute_robot_state-npc0": 0.07715237471792433, "sim_compute_robot_state-npc1": 0.07522724403275384, "sim_compute_robot_state-npc2": 0.07920385400454204, "sim_compute_robot_state-npc3": 0.07664543390274048}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.24196921107924987, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.06950663851800366, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.08000262652602151, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.11239303383871774, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.04412303683913757, "sim_compute_performance-ego": 0.07651019096374512, "sim_compute_robot_state-ego": 0.08582059022422149, "sim_compute_robot_state-npc0": 0.0763358312232472, "sim_compute_robot_state-npc1": 0.07603695905097177, "sim_compute_robot_state-npc2": 0.07752838981485813, "sim_compute_robot_state-npc3": 0.07774088984337922}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.250026958960074, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.06898691036083081, "in-drivable-lane": 0, "agent_compute-ego": 0.08338322462858977, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.118777213273225, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.04380955519499602, "sim_compute_performance-ego": 0.0783501907631203, "sim_compute_robot_state-ego": 0.08761995810049551, "sim_compute_robot_state-npc0": 0.07619144298412182, "sim_compute_robot_state-npc1": 0.0781598620944553, "sim_compute_robot_state-npc2": 0.07873425660309968, "sim_compute_robot_state-npc3": 0.08034462398952907}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.198350887298584, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.06625699043273926, "in-drivable-lane": 0, "agent_compute-ego": 0.07386039733886719, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.10232722282409668, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.04355863571166992, "sim_compute_performance-ego": 0.07431442260742188, "sim_compute_robot_state-ego": 0.08200241088867187, "sim_compute_robot_state-npc0": 0.07479866981506347, "sim_compute_robot_state-npc1": 0.07175613403320312, "sim_compute_robot_state-npc2": 0.07364391326904297, "sim_compute_robot_state-npc3": 0.07732876777648925}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.21337771865556823, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.06846251127854833, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.0800395371778956, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.10829983567291836, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.04200547146347334, "sim_compute_performance-ego": 0.07676593762523723, "sim_compute_robot_state-ego": 0.09159682831674253, "sim_compute_robot_state-npc0": 0.07595042462618846, "sim_compute_robot_state-npc1": 0.07561834353321004, "sim_compute_robot_state-npc2": 0.07463921690886875, "sim_compute_robot_state-npc3": 0.07618041758267384}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.2304552678138979, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.06756405676564863, "in-drivable-lane": 0, "agent_compute-ego": 0.07762130614249937, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.10947456667500158, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.041992541282407696, "sim_compute_performance-ego": 0.07569363809400989, "sim_compute_robot_state-ego": 0.08285625519291047, "sim_compute_robot_state-npc0": 0.07725765628199424, "sim_compute_robot_state-npc1": 0.07662138631266932, "sim_compute_robot_state-npc2": 0.07639908021496188, "sim_compute_robot_state-npc3": 0.07782287751474688}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.24330498190487132, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.07940264776641247, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.0810403964098762, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.1114960277781767, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.04247146494248334, "sim_compute_performance-ego": 0.07910355399636661, "sim_compute_robot_state-ego": 0.08783390942741842, "sim_compute_robot_state-npc0": 0.07441781081405341, "sim_compute_robot_state-npc1": 0.07769214873220406, "sim_compute_robot_state-npc2": 0.07894056918574315, "sim_compute_robot_state-npc3": 0.0769195743635589}}
set_robot_commands_max	0.118777213273225
set_robot_commands_mean	0.10919080607528305
set_robot_commands_median	0.10947456667500158
set_robot_commands_min	0.10171064963707556
sim_compute_performance-ego_max	0.0804612785577774
sim_compute_performance-ego_mean	0.07722348860832665
sim_compute_performance-ego_median	0.07708038886388142
sim_compute_performance-ego_min	0.07392590386526925
sim_compute_robot_state-ego_max	0.09159682831674253
sim_compute_robot_state-ego_mean	0.08587582339989233
sim_compute_robot_state-ego_median	0.08625248500279017
sim_compute_robot_state-ego_min	0.08166248064774734
sim_compute_robot_state-npc0_max	0.07916721137794289
sim_compute_robot_state-npc0_mean	0.07664901875225068
sim_compute_robot_state-npc0_median	0.07689242465521699
sim_compute_robot_state-npc0_min	0.0727913606734503
sim_compute_robot_state-npc1_max	0.07999158650636673
sim_compute_robot_state-npc1_mean	0.07622608808114188
sim_compute_robot_state-npc1_median	0.07620990843999953
sim_compute_robot_state-npc1_min	0.07175613403320312
sim_compute_robot_state-npc2_max	0.0801987424492836
sim_compute_robot_state-npc2_mean	0.07665554725700545
sim_compute_robot_state-npc2_median	0.0768012801806132
sim_compute_robot_state-npc2_min	0.07225252114809476
sim_compute_robot_state-npc3_max	0.08034462398952907
sim_compute_robot_state-npc3_mean	0.07705406182176905
sim_compute_robot_state-npc3_median	0.07714857739850509
sim_compute_robot_state-npc3_min	0.0740624161866995
sim_compute_sim_state_max	0.04572071631749471
sim_compute_sim_state_mean	0.043016001335705455
sim_compute_sim_state_median	0.042650499651508945
sim_compute_sim_state_min	0.041128300703488864
sim_physics_max	0.250026958960074
sim_physics_mean	0.21579961251110724
sim_physics_median	0.21208752679430748
sim_physics_min	0.18881462017695108
sim_render-ego_max	0.07940264776641247
sim_render-ego_mean	0.06999938500182672
sim_render-ego_median	0.06926004588603973
sim_render-ego_min	0.06625699043273926
simulation-passed	1
survival_time_max	6.0499999999999865
survival_time_mean	3.046666666666663
survival_time_min	1.0500000000000005

No reset possible

21028

2767

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 17:05:35+00:00

2019-04-27 17:19:16+00:00

0:13:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5675325481967866
survival_time_median	5.14999999999999
deviation-center-line_median	0.4761098915863658
in-drivable-lane_median	0.2500000000000002

other stats

agent_compute-ego_max	0.11873842511858258
agent_compute-ego_mean	0.11650174599269736
agent_compute-ego_median	0.11694746812184652
agent_compute-ego_min	0.11291376444009636
deviation-center-line_max	0.6555874461657204
deviation-center-line_mean	0.4715333638533116
deviation-center-line_min	0.3230993107568988
deviation-heading_max	2.538418655373727
deviation-heading_mean	1.739449497532987
deviation-heading_median	1.9673764813538557
deviation-heading_min	0.5309177745622122
driven_any_max	1.3525723709081223
driven_any_mean	0.931583620237743
driven_any_median	0.7739410204012671
driven_any_min	0.5731606276436365
driven_lanedir_consec_max	1.2256878870481718
driven_lanedir_consec_mean	0.779389347148648
driven_lanedir_consec_min	0.3364985939570633
driven_lanedir_max	1.2256878870481718
driven_lanedir_mean	0.8289946828784382
driven_lanedir_median	0.5845252726060142
driven_lanedir_min	0.5429586026327655
in-drivable-lane_max	0.3999999999999986
in-drivable-lane_mean	0.2100000000000009
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6619260881341728, "sim_physics": 0.1415255414115058, "survival_time": 4.499999999999992, "driven_lanedir": 0.5429586026327655, "sim_render-ego": 0.07504933410220677, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.11694746812184652, "deviation-heading": 1.344050512441643, "set_robot_commands": 0.11748646365271674, "deviation-center-line": 0.3230993107568988, "driven_lanedir_consec": 0.5429586026327655, "sim_compute_sim_state": 0.04347300794389513, "sim_compute_performance-ego": 0.08417974842919243, "sim_compute_robot_state-ego": 0.0925886869430542}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7739410204012671, "sim_physics": 0.14921521446079883, "survival_time": 5.14999999999999, "driven_lanedir": 0.5845252726060142, "sim_render-ego": 0.07283067471772722, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.11756372914730924, "deviation-heading": 2.538418655373727, "set_robot_commands": 0.11658818513444326, "deviation-center-line": 0.4775057247507494, "driven_lanedir_consec": 0.3364985939570633, "sim_compute_sim_state": 0.04463439080321673, "sim_compute_performance-ego": 0.08322803951004176, "sim_compute_robot_state-ego": 0.09163082687600144}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5731606276436365, "sim_physics": 0.1504522164662679, "survival_time": 3.899999999999994, "driven_lanedir": 0.5675325481967866, "sim_render-ego": 0.07253559430440266, "in-drivable-lane": 0, "agent_compute-ego": 0.11291376444009636, "deviation-heading": 0.5309177745622122, "set_robot_commands": 0.11956510177025428, "deviation-center-line": 0.42536444600682327, "driven_lanedir_consec": 0.5675325481967866, "sim_compute_sim_state": 0.04569114782871344, "sim_compute_performance-ego": 0.08174409621801132, "sim_compute_robot_state-ego": 0.08937632731902294}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3525723709081223, "sim_physics": 0.14020444325038364, "survival_time": 8.74999999999999, "driven_lanedir": 1.2256878870481718, "sim_render-ego": 0.07092186110360282, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.11873842511858258, "deviation-heading": 2.316484063933497, "set_robot_commands": 0.12440185274396624, "deviation-center-line": 0.6555874461657204, "driven_lanedir_consec": 1.2256878870481718, "sim_compute_sim_state": 0.044095518929617744, "sim_compute_performance-ego": 0.08240277562822615, "sim_compute_robot_state-ego": 0.09944143704005652}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.296317994101516, "sim_physics": 0.14561947612535386, "survival_time": 8.399999999999984, "driven_lanedir": 1.2242691039084528, "sim_render-ego": 0.07391410640307836, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.11634534313565208, "deviation-heading": 1.9673764813538557, "set_robot_commands": 0.1194083591302236, "deviation-center-line": 0.4761098915863658, "driven_lanedir_consec": 1.2242691039084528, "sim_compute_sim_state": 0.04499018476122901, "sim_compute_performance-ego": 0.08394843056088402, "sim_compute_robot_state-ego": 0.09192346107392084}}
set_robot_commands_max	0.12440185274396624
set_robot_commands_mean	0.11948999248632082
set_robot_commands_median	0.1194083591302236
set_robot_commands_min	0.11658818513444326
sim_compute_performance-ego_max	0.08417974842919243
sim_compute_performance-ego_mean	0.08310061806927113
sim_compute_performance-ego_median	0.08322803951004176
sim_compute_performance-ego_min	0.08174409621801132
sim_compute_robot_state-ego_max	0.09944143704005652
sim_compute_robot_state-ego_mean	0.0929921478504112
sim_compute_robot_state-ego_median	0.09192346107392084
sim_compute_robot_state-ego_min	0.08937632731902294
sim_compute_sim_state_max	0.04569114782871344
sim_compute_sim_state_mean	0.04457685005333441
sim_compute_sim_state_median	0.04463439080321673
sim_compute_sim_state_min	0.04347300794389513
sim_physics_max	0.1504522164662679
sim_physics_mean	0.14540337834286202
sim_physics_median	0.14561947612535386
sim_physics_min	0.14020444325038364
sim_render-ego_max	0.07504933410220677
sim_render-ego_mean	0.07305031412620358
sim_render-ego_median	0.07283067471772722
sim_render-ego_min	0.07092186110360282
simulation-passed	1
survival_time_max	8.74999999999999
survival_time_mean	6.13999999999999
survival_time_min	3.899999999999994

No reset possible

21022

2782

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-27 17:04:36+00:00

2019-04-27 17:05:05+00:00

0:00:29

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21016

2796

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-27 17:02:24+00:00

2019-04-27 17:04:06+00:00

0:01:42

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21005

2791

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-27 17:00:21+00:00

2019-04-27 17:02:07+00:00

0:01:46

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21000

2799

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 16:59:32+00:00

2019-04-27 17:00:13+00:00

0:00:41

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2799/step1-simulation-ip-172-31-25-98-2470-job21000/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20998

2805

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-27 16:54:17+00:00

2019-04-27 16:59:26+00:00

0:05:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.1694025993347168
agent_compute-ego_mean	0.15210544464600723
agent_compute-ego_median	0.14413941348040546
agent_compute-ego_min	0.13965497970581053
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11434529445789478, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.057350595792134605, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14413941348040546, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09066368473900688, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0382742307804249, "sim_compute_performance-ego": 0.06755753799721047, "sim_compute_robot_state-ego": 0.07235527921605993}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.13079136960646687, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06432244356940775, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1649331438775156, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10416024806452732, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.040743598750993315, "sim_compute_performance-ego": 0.07497252669988894, "sim_compute_robot_state-ego": 0.08609193446589451}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1332264507518095, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06491122526281021, "in-drivable-lane": 0, "agent_compute-ego": 0.1694025993347168, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10494205530952004, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04069300258860869, "sim_compute_performance-ego": 0.07163914512185489, "sim_compute_robot_state-ego": 0.08025197421803194}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.09990080833435058, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05523013114929199, "in-drivable-lane": 0, "agent_compute-ego": 0.13965497970581053, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.0830381965637207, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03355520248413086, "sim_compute_performance-ego": 0.06335536003112793, "sim_compute_robot_state-ego": 0.06495541572570801}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10172078579286986, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05528853513017486, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14239708683158778, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0870646162878109, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03662170941316629, "sim_compute_performance-ego": 0.06830029547968998, "sim_compute_robot_state-ego": 0.06812198252617559}}
set_robot_commands_max	0.10494205530952004
set_robot_commands_mean	0.09397376019291716
set_robot_commands_median	0.09066368473900688
set_robot_commands_min	0.0830381965637207
sim_compute_performance-ego_max	0.07497252669988894
sim_compute_performance-ego_mean	0.06916497306595444
sim_compute_performance-ego_median	0.06830029547968998
sim_compute_performance-ego_min	0.06335536003112793
sim_compute_robot_state-ego_max	0.08609193446589451
sim_compute_robot_state-ego_mean	0.074355317230374
sim_compute_robot_state-ego_median	0.07235527921605993
sim_compute_robot_state-ego_min	0.06495541572570801
sim_compute_sim_state_max	0.040743598750993315
sim_compute_sim_state_mean	0.03797754880346481
sim_compute_sim_state_median	0.0382742307804249
sim_compute_sim_state_min	0.03355520248413086
sim_physics_max	0.1332264507518095
sim_physics_mean	0.11599694178867832
sim_physics_median	0.11434529445789478
sim_physics_min	0.09990080833435058
sim_render-ego_max	0.06491122526281021
sim_render-ego_mean	0.05942058618076388
sim_render-ego_median	0.057350595792134605
sim_render-ego_min	0.05523013114929199
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

20994

2813

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-27 16:44:46+00:00

2019-04-27 16:53:37+00:00

0:08:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.1647228470331506
agent_compute-ego_mean	0.15185327917375613
agent_compute-ego_median	0.1572983033448747
agent_compute-ego_min	0.12778487659635998
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.21159788324863096, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06649846668484845, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1647228470331506, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10287519648105284, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.040945514847960655, "sim_compute_performance-ego": 0.0737230113790005, "sim_compute_robot_state-ego": 0.07932921300960492, "sim_compute_robot_state-npc0": 0.07292335546469386, "sim_compute_robot_state-npc1": 0.07304573360877702, "sim_compute_robot_state-npc2": 0.07168582421314867, "sim_compute_robot_state-npc3": 0.07261775415154952}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.21825830425534928, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06460587467466082, "in-drivable-lane": 0, "agent_compute-ego": 0.15976162467684066, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09788498708180018, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03829596723828997, "sim_compute_performance-ego": 0.07039968456540789, "sim_compute_robot_state-ego": 0.0782919270651681, "sim_compute_robot_state-npc0": 0.07053399085998535, "sim_compute_robot_state-npc1": 0.06863305398396083, "sim_compute_robot_state-npc2": 0.06656256743839808, "sim_compute_robot_state-npc3": 0.06827382530484881}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1783094382980495, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05866122477262923, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1572983033448747, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08895872634591408, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03719540938590337, "sim_compute_performance-ego": 0.06327168223927322, "sim_compute_robot_state-ego": 0.06767749323428256, "sim_compute_robot_state-npc0": 0.0657713829892353, "sim_compute_robot_state-npc1": 0.06628310101703533, "sim_compute_robot_state-npc2": 0.0677252579661249, "sim_compute_robot_state-npc3": 0.0664756043443402}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.20011396209398905, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05886197090148926, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14969874421755472, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09362243115901948, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.040775502721468605, "sim_compute_performance-ego": 0.0644356260697047, "sim_compute_robot_state-ego": 0.06953275700410207, "sim_compute_robot_state-npc0": 0.06553867956002553, "sim_compute_robot_state-npc1": 0.07026333113511403, "sim_compute_robot_state-npc2": 0.06825810670852661, "sim_compute_robot_state-npc3": 0.06817696491877238}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1929962294442313, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.0514194511231922, "in-drivable-lane": 0, "agent_compute-ego": 0.12778487659635998, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.08229270435514904, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.032469147727603, "sim_compute_performance-ego": 0.06033896264575776, "sim_compute_robot_state-ego": 0.06701493263244629, "sim_compute_robot_state-npc0": 0.06308490889413017, "sim_compute_robot_state-npc1": 0.05913057781401135, "sim_compute_robot_state-npc2": 0.05610299110412598, "sim_compute_robot_state-npc3": 0.05691430682227725}}
set_robot_commands_max	0.10287519648105284
set_robot_commands_mean	0.09312680908458712
set_robot_commands_median	0.09362243115901948
set_robot_commands_min	0.08229270435514904
sim_compute_performance-ego_max	0.0737230113790005
sim_compute_performance-ego_mean	0.06643379337982883
sim_compute_performance-ego_median	0.0644356260697047
sim_compute_performance-ego_min	0.06033896264575776
sim_compute_robot_state-ego_max	0.07932921300960492
sim_compute_robot_state-ego_mean	0.07236926458912078
sim_compute_robot_state-ego_median	0.06953275700410207
sim_compute_robot_state-ego_min	0.06701493263244629
sim_compute_robot_state-npc0_max	0.07292335546469386
sim_compute_robot_state-npc0_mean	0.06757046355361404
sim_compute_robot_state-npc0_median	0.0657713829892353
sim_compute_robot_state-npc0_min	0.06308490889413017
sim_compute_robot_state-npc1_max	0.07304573360877702
sim_compute_robot_state-npc1_mean	0.0674711595117797
sim_compute_robot_state-npc1_median	0.06863305398396083
sim_compute_robot_state-npc1_min	0.05913057781401135
sim_compute_robot_state-npc2_max	0.07168582421314867
sim_compute_robot_state-npc2_mean	0.06606694948606485
sim_compute_robot_state-npc2_median	0.0677252579661249
sim_compute_robot_state-npc2_min	0.05610299110412598
sim_compute_robot_state-npc3_max	0.07261775415154952
sim_compute_robot_state-npc3_mean	0.06649169110835765
sim_compute_robot_state-npc3_median	0.06817696491877238
sim_compute_robot_state-npc3_min	0.05691430682227725
sim_compute_sim_state_max	0.040945514847960655
sim_compute_sim_state_mean	0.03793630838424512
sim_compute_sim_state_median	0.03829596723828997
sim_compute_sim_state_min	0.032469147727603
sim_physics_max	0.21825830425534928
sim_physics_mean	0.20025516346805
sim_physics_median	0.20011396209398905
sim_physics_min	0.1783094382980495
sim_render-ego_max	0.06649846668484845
sim_render-ego_mean	0.060009397631363995
sim_render-ego_median	0.05886197090148926
sim_render-ego_min	0.0514194511231922
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

20991

2819

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 16:38:02+00:00

2019-04-27 16:44:04+00:00

0:06:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.16946078749263987
agent_compute-ego_mean	0.15559425517283912
agent_compute-ego_median	0.15587323224997218
agent_compute-ego_min	0.1470939064025879
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11118983780896222, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06651903523339166, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15839438526718705, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1006437451751144, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03943828300193504, "sim_compute_performance-ego": 0.07270048724280463, "sim_compute_robot_state-ego": 0.07702313529120551}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10755554367514218, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.061747102176441866, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14714896445180856, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08959508877174527, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03775323138517492, "sim_compute_performance-ego": 0.06896003087361653, "sim_compute_robot_state-ego": 0.07846800018759335}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11411302229937384, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06396348336163689, "in-drivable-lane": 0, "agent_compute-ego": 0.16946078749263987, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.1130819460924934, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.042093908085542565, "sim_compute_performance-ego": 0.07284955417408663, "sim_compute_robot_state-ego": 0.09021252744338092}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1198402976989746, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06080306053161621, "in-drivable-lane": 0, "agent_compute-ego": 0.1470939064025879, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08830805778503419, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03607717514038086, "sim_compute_performance-ego": 0.06978229522705078, "sim_compute_robot_state-ego": 0.0734787368774414}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10678981829293166, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06286525424522689, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15587323224997218, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10015570362911948, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0391970676711843, "sim_compute_performance-ego": 0.07108896291708644, "sim_compute_robot_state-ego": 0.07862780365762831}}
set_robot_commands_max	0.1130819460924934
set_robot_commands_mean	0.09835690829070134
set_robot_commands_median	0.10015570362911948
set_robot_commands_min	0.08830805778503419
sim_compute_performance-ego_max	0.07284955417408663
sim_compute_performance-ego_mean	0.07107626608692899
sim_compute_performance-ego_median	0.07108896291708644
sim_compute_performance-ego_min	0.06896003087361653
sim_compute_robot_state-ego_max	0.09021252744338092
sim_compute_robot_state-ego_mean	0.0795620406914499
sim_compute_robot_state-ego_median	0.07846800018759335
sim_compute_robot_state-ego_min	0.0734787368774414
sim_compute_sim_state_max	0.042093908085542565
sim_compute_sim_state_mean	0.03891193305684354
sim_compute_sim_state_median	0.0391970676711843
sim_compute_sim_state_min	0.03607717514038086
sim_physics_max	0.1198402976989746
sim_physics_mean	0.1118977039550769
sim_physics_median	0.11118983780896222
sim_physics_min	0.10678981829293166
sim_render-ego_max	0.06651903523339166
sim_render-ego_mean	0.0631795871096627
sim_render-ego_median	0.06286525424522689
sim_render-ego_min	0.06080306053161621
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

20957

2866

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 16:00:18+00:00

2019-04-27 16:37:23+00:00

0:37:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2646618289704086
survival_time_median	4.499999999999992
deviation-center-line_median	0.2078683190205053
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.11176561924719042
agent_compute-ego_mean	0.10371780023655532
agent_compute-ego_median	0.1057579623328315
agent_compute-ego_min	0.08420507943452295
deviation-center-line_max	0.2743715297033414
deviation-center-line_mean	0.19362375484487068
deviation-center-line_min	0.1020532111029623
deviation-heading_max	2.2643914004868795
deviation-heading_mean	1.6669797076079222
deviation-heading_median	1.7096441617409257
deviation-heading_min	1.0072410072854048
driven_any_max	1.174539606500167
driven_any_mean	0.4631054030200578
driven_any_median	0.3347811226741067
driven_any_min	0.1419218568197713
driven_lanedir_consec_max	0.5094993067640827
driven_lanedir_consec_mean	0.3134883538619552
driven_lanedir_consec_min	0.11605380251276289
driven_lanedir_max	0.5094993067640827
driven_lanedir_mean	0.3134883538619552
driven_lanedir_median	0.2646618289704086
driven_lanedir_min	0.11605380251276289
in-drivable-lane_max	7.800000000000095
in-drivable-lane_mean	1.280000000000012
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.17072244137897, "sim_physics": 0.12164855241775512, "survival_time": 14.950000000000076, "driven_lanedir": 0.49391758356579274, "sim_render-ego": 0.06614174127578736, "in-drivable-lane": 7.800000000000095, "agent_compute-ego": 0.10732253789901731, "deviation-heading": 1.8010293286291854, "set_robot_commands": 0.1073991624514262, "deviation-center-line": 0.25010978087689684, "driven_lanedir_consec": 0.49391758356579274, "sim_compute_sim_state": 0.04284444411595662, "sim_compute_performance-ego": 0.07390697876612345, "sim_compute_robot_state-ego": 0.08230698744455973}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.24237183111296645, "sim_physics": 0.09906656706511084, "survival_time": 3.349999999999996, "driven_lanedir": 0.19309017251302907, "sim_render-ego": 0.05229168863438848, "in-drivable-lane": 0, "agent_compute-ego": 0.08420507943452295, "deviation-heading": 1.6499719188564637, "set_robot_commands": 0.08599183808511762, "deviation-center-line": 0.15601672233006952, "driven_lanedir_consec": 0.19309017251302907, "sim_compute_sim_state": 0.03455964131141776, "sim_compute_performance-ego": 0.05925473526342592, "sim_compute_robot_state-ego": 0.06047929934601286}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15799545305816282, "sim_physics": 0.11633471820665442, "survival_time": 2.3, "driven_lanedir": 0.13544295644279103, "sim_render-ego": 0.06254980875098187, "in-drivable-lane": 0, "agent_compute-ego": 0.10585847108260445, "deviation-heading": 1.010752911427337, "set_robot_commands": 0.1009092901064002, "deviation-center-line": 0.22212375970808132, "driven_lanedir_consec": 0.13544295644279103, "sim_compute_sim_state": 0.04020125451295272, "sim_compute_performance-ego": 0.0726697237595268, "sim_compute_robot_state-ego": 0.07666587829589844}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5437260479173953, "sim_physics": 0.12723187493606353, "survival_time": 7.099999999999983, "driven_lanedir": 0.4805089801131692, "sim_render-ego": 0.06619923887118487, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.10625483116633457, "deviation-heading": 1.9653899722963435, "set_robot_commands": 0.10612823425883978, "deviation-center-line": 0.21740686391939587, "driven_lanedir_consec": 0.4805089801131692, "sim_compute_sim_state": 0.04168324403359856, "sim_compute_performance-ego": 0.07445710309794251, "sim_compute_robot_state-ego": 0.08522608918203435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5638086188799438, "sim_physics": 0.1271777444956254, "survival_time": 7.349999999999982, "driven_lanedir": 0.46303670019861887, "sim_render-ego": 0.0674480289018073, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.10465420671060782, "deviation-heading": 1.7096441617409257, "set_robot_commands": 0.10293768701099214, "deviation-center-line": 0.16805948426737172, "driven_lanedir_consec": 0.46303670019861887, "sim_compute_sim_state": 0.040593854424093856, "sim_compute_performance-ego": 0.07379483041309175, "sim_compute_robot_state-ego": 0.08162678828855761}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.3669189283422206, "sim_physics": 0.1327636971765635, "survival_time": 4.899999999999991, "driven_lanedir": 0.2509974226134841, "sim_render-ego": 0.06529806341443743, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.10834595378564328, "deviation-heading": 1.761710510902259, "set_robot_commands": 0.10513244356427874, "deviation-center-line": 0.2078683190205053, "driven_lanedir_consec": 0.2509974226134841, "sim_compute_sim_state": 0.040738203087631535, "sim_compute_performance-ego": 0.07686579957300303, "sim_compute_robot_state-ego": 0.08774603872883077}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.174539606500167, "sim_physics": 0.11857224464416503, "survival_time": 14.950000000000076, "driven_lanedir": 0.48394741353500725, "sim_render-ego": 0.0646085810661316, "in-drivable-lane": 7.750000000000095, "agent_compute-ego": 0.1052142874399821, "deviation-heading": 2.2643914004868795, "set_robot_commands": 0.1021105146408081, "deviation-center-line": 0.2743715297033414, "driven_lanedir_consec": 0.48394741353500725, "sim_compute_sim_state": 0.04020881175994873, "sim_compute_performance-ego": 0.07320881446202596, "sim_compute_robot_state-ego": 0.08230937004089356}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1419218568197713, "sim_physics": 0.1200628848302932, "survival_time": 2.1000000000000005, "driven_lanedir": 0.11605380251276289, "sim_render-ego": 0.06452877180916923, "in-drivable-lane": 0, "agent_compute-ego": 0.09644482816968646, "deviation-heading": 1.0072410072854048, "set_robot_commands": 0.0995626960481916, "deviation-center-line": 0.18713198568503112, "driven_lanedir_consec": 0.11605380251276289, "sim_compute_sim_state": 0.03924435660952613, "sim_compute_performance-ego": 0.07463716325305757, "sim_compute_robot_state-ego": 0.07295505773453485}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.29460334739686006, "sim_physics": 0.11941632628440856, "survival_time": 3.999999999999994, "driven_lanedir": 0.23955602522136976, "sim_render-ego": 0.06161411106586456, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.10118822753429411, "deviation-heading": 1.5827370498521371, "set_robot_commands": 0.10411938726902008, "deviation-center-line": 0.11864627883040016, "driven_lanedir_consec": 0.23955602522136976, "sim_compute_sim_state": 0.04156164824962616, "sim_compute_performance-ego": 0.07095080614089966, "sim_compute_robot_state-ego": 0.07322214841842652}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.28254882350338534, "sim_physics": 0.13386847446491193, "survival_time": 3.8499999999999943, "driven_lanedir": 0.22837252510599404, "sim_render-ego": 0.06718758174351283, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.11004626286494268, "deviation-heading": 1.4949191627153164, "set_robot_commands": 0.10811895209473447, "deviation-center-line": 0.16461483374081526, "driven_lanedir_consec": 0.22837252510599404, "sim_compute_sim_state": 0.04087215584593934, "sim_compute_performance-ego": 0.0750140988981569, "sim_compute_robot_state-ego": 0.08807689802987236}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.4714043416156482, "sim_physics": 0.1294683564093805, "survival_time": 6.199999999999986, "driven_lanedir": 0.4170341986017552, "sim_render-ego": 0.06647241500116163, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.11176561924719042, "deviation-heading": 1.8981581113219952, "set_robot_commands": 0.1085130226227545, "deviation-center-line": 0.23938038860657432, "driven_lanedir_consec": 0.4170341986017552, "sim_compute_sim_state": 0.04259137761208319, "sim_compute_performance-ego": 0.07482540991998488, "sim_compute_robot_state-ego": 0.08630171898872621}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5919562762980821, "sim_physics": 0.12773438243122845, "survival_time": 7.699999999999981, "driven_lanedir": 0.5094993067640827, "sim_render-ego": 0.0644991955199799, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.10614387710373124, "deviation-heading": 1.8427098121922976, "set_robot_commands": 0.10421818417388123, "deviation-center-line": 0.25345950119891153, "driven_lanedir_consec": 0.5094993067640827, "sim_compute_sim_state": 0.04278136383403431, "sim_compute_performance-ego": 0.07256477219717843, "sim_compute_robot_state-ego": 0.08088005672801625}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.278519379125818, "sim_physics": 0.12260662568242926, "survival_time": 3.7999999999999945, "driven_lanedir": 0.15844360189219242, "sim_render-ego": 0.0643788827093024, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.10298085526416176, "deviation-heading": 1.3531363304776296, "set_robot_commands": 0.10155914645445974, "deviation-center-line": 0.12855891733584576, "driven_lanedir_consec": 0.15844360189219242, "sim_compute_sim_state": 0.0393043976081045, "sim_compute_performance-ego": 0.07198828772494667, "sim_compute_robot_state-ego": 0.07800691378744025}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3307629706773696, "sim_physics": 0.1222485424427504, "survival_time": 4.449999999999992, "driven_lanedir": 0.2646618289704086, "sim_render-ego": 0.06408544604697924, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.09958400351277898, "deviation-heading": 1.5920502962451486, "set_robot_commands": 0.100585650861933, "deviation-center-line": 0.1020532111029623, "driven_lanedir_consec": 0.2646618289704086, "sim_compute_sim_state": 0.039835260155495635, "sim_compute_performance-ego": 0.07134996639208847, "sim_compute_robot_state-ego": 0.0789671881815021}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.3347811226741067, "sim_physics": 0.11909308698442247, "survival_time": 4.499999999999992, "driven_lanedir": 0.2677627898788706, "sim_render-ego": 0.06474516391754151, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.1057579623328315, "deviation-heading": 2.0708536396895125, "set_robot_commands": 0.10587794515821668, "deviation-center-line": 0.21455474634685776, "driven_lanedir_consec": 0.2677627898788706, "sim_compute_sim_state": 0.040389953719245066, "sim_compute_performance-ego": 0.0746027946472168, "sim_compute_robot_state-ego": 0.08555135991838243}}
set_robot_commands_max	0.1085130226227545
set_robot_commands_mean	0.10287761032007024
set_robot_commands_median	0.10411938726902008
set_robot_commands_min	0.08599183808511762
sim_compute_performance-ego_max	0.07686579957300303
sim_compute_performance-ego_mean	0.07267275230057792
sim_compute_performance-ego_median	0.07379483041309175
sim_compute_performance-ego_min	0.05925473526342592
sim_compute_robot_state-ego_max	0.08807689802987236
sim_compute_robot_state-ego_mean	0.08002145287424588
sim_compute_robot_state-ego_median	0.08162678828855761
sim_compute_robot_state-ego_min	0.06047929934601286
sim_compute_sim_state_max	0.04284444411595662
sim_compute_sim_state_mean	0.04049399779197694
sim_compute_sim_state_median	0.040593854424093856
sim_compute_sim_state_min	0.03455964131141776
sim_physics_max	0.13386847446491193
sim_physics_mean	0.1224862718981175
sim_physics_median	0.1222485424427504
sim_physics_min	0.09906656706511084
sim_render-ego_max	0.0674480289018073
sim_render-ego_mean	0.06413658124854868
sim_render-ego_median	0.0646085810661316
sim_render-ego_min	0.05229168863438848
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.100000000000003
survival_time_min	2.1000000000000005

No reset possible

20925

3058

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-27 15:02:51+00:00

2019-04-27 16:00:05+00:00

0:57:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-25-98-2470-job20925/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20911

2936

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 15:00:29+00:00

2019-04-27 15:02:13+00:00

0:01:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20900

2977

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 14:39:42+00:00

2019-04-27 15:00:07+00:00

0:20:25

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2977/step1-simulation-ip-172-31-25-98-2470-job20900/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20866

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 14:01:41+00:00

2019-04-27 14:39:05+00:00

0:37:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.39532698668362554
survival_time_median	3.1999999999999966
deviation-center-line_median	0.22757877509964264
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.24161884234501765
agent_compute-ego_mean	0.09519354410639894
agent_compute-ego_median	0.07959396188909357
agent_compute-ego_min	0.06261400478642161
deviation-center-line_max	1.2733904229993025
deviation-center-line_mean	0.359511856600597
deviation-center-line_min	0.10138868029808618
deviation-heading_max	8.583046091271532
deviation-heading_mean	1.9876795179631912
deviation-heading_median	1.0325937110268504
deviation-heading_min	0.40276079384080304
driven_any_max	2.348804299619687
driven_any_mean	0.7353361475083126
driven_any_median	0.460624214062678
driven_any_min	0.20349070183926316
driven_lanedir_consec_max	1.5172135417665644
driven_lanedir_consec_mean	0.4701042640409018
driven_lanedir_consec_min	0.17449942605207314
driven_lanedir_max	1.688858707432841
driven_lanedir_mean	0.5603171217500388
driven_lanedir_median	0.39532698668362554
driven_lanedir_min	0.17449942605207314
in-drivable-lane_max	2.400000000000034
in-drivable-lane_mean	0.4166666666666695
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.022259555605337, "sim_physics": 0.18570994629579432, "survival_time": 6.799999999999984, "driven_lanedir": 0.8705543142496541, "sim_render-ego": 0.0572181010947508, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.0765114566859077, "deviation-heading": 2.1233788664741633, "set_robot_commands": 0.08577684970463023, "deviation-center-line": 0.5713859440262332, "driven_lanedir_consec": 0.6314257200545013, "sim_compute_sim_state": 0.03418748168384328, "sim_compute_performance-ego": 0.0591255338752971, "sim_compute_robot_state-ego": 0.06655605049694285, "sim_compute_robot_state-npc0": 0.06325784150291891, "sim_compute_robot_state-npc1": 0.06097137402085697, "sim_compute_robot_state-npc2": 0.06018814269234152, "sim_compute_robot_state-npc3": 0.06046284822856679}, "udem1-1-0": {"driven_any": 0.25167279651417124, "sim_physics": 0.1706340940375077, "survival_time": 1.900000000000001, "driven_lanedir": 0.17449942605207314, "sim_render-ego": 0.05242021460282175, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.07204533878125642, "deviation-heading": 1.0463515734234925, "set_robot_commands": 0.0901300405201159, "deviation-center-line": 0.10138868029808618, "driven_lanedir_consec": 0.17449942605207314, "sim_compute_sim_state": 0.03311132129869963, "sim_compute_performance-ego": 0.05535210433759188, "sim_compute_robot_state-ego": 0.06274423473759701, "sim_compute_robot_state-npc0": 0.06085616663882607, "sim_compute_robot_state-npc1": 0.05810648516604775, "sim_compute_robot_state-npc2": 0.06090703136042545, "sim_compute_robot_state-npc3": 0.05799164270099841}, "udem1-2-0": {"driven_any": 0.21956459533221093, "sim_physics": 0.2119223159902236, "survival_time": 1.7000000000000008, "driven_lanedir": 0.20869718910306112, "sim_render-ego": 0.059321087949416214, "in-drivable-lane": 0, "agent_compute-ego": 0.07558340886059929, "deviation-heading": 0.40276079384080304, "set_robot_commands": 0.0862440642188577, "deviation-center-line": 0.15290179720437985, "driven_lanedir_consec": 0.20869718910306112, "sim_compute_sim_state": 0.03366527837865493, "sim_compute_performance-ego": 0.06250107288360596, "sim_compute_robot_state-ego": 0.0672379171147066, "sim_compute_robot_state-npc0": 0.06021430211908677, "sim_compute_robot_state-npc1": 0.05830676415387322, "sim_compute_robot_state-npc2": 0.0612339692957261, "sim_compute_robot_state-npc3": 0.06216960093554329}, "udem1-3-0": {"driven_any": 0.21151702734256572, "sim_physics": 0.1995863625497529, "survival_time": 1.6500000000000008, "driven_lanedir": 0.18421106476155624, "sim_render-ego": 0.060605879985924926, "in-drivable-lane": 0, "agent_compute-ego": 0.07923897829922763, "deviation-heading": 0.5302790049165401, "set_robot_commands": 0.09432138096202504, "deviation-center-line": 0.13432620630437028, "driven_lanedir_consec": 0.18421106476155624, "sim_compute_sim_state": 0.03538097757281679, "sim_compute_performance-ego": 0.06060313455986254, "sim_compute_robot_state-ego": 0.06669293027935606, "sim_compute_robot_state-npc0": 0.06482155395276619, "sim_compute_robot_state-npc1": 0.06667862516460997, "sim_compute_robot_state-npc2": 0.06325998450770523, "sim_compute_robot_state-npc3": 0.06531229163661148}, "udem1-4-0": {"driven_any": 0.7257535894236883, "sim_physics": 0.20429506990098464, "survival_time": 4.849999999999991, "driven_lanedir": 0.39186759819031103, "sim_render-ego": 0.062214079591416824, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.0828645573448889, "deviation-heading": 2.738452591040503, "set_robot_commands": 0.10034559190887764, "deviation-center-line": 0.23072286471026457, "driven_lanedir_consec": 0.3503070140694451, "sim_compute_sim_state": 0.035184019619656594, "sim_compute_performance-ego": 0.0647623047386248, "sim_compute_robot_state-ego": 0.07241555341740244, "sim_compute_robot_state-npc0": 0.06841843398575931, "sim_compute_robot_state-npc1": 0.06590722270847596, "sim_compute_robot_state-npc2": 0.06686118460193123, "sim_compute_robot_state-npc3": 0.06509625297231772}, "udem1-5-0": {"driven_any": 1.2722086083700572, "sim_physics": 0.18351301857919405, "survival_time": 8.249999999999982, "driven_lanedir": 1.0890243194148106, "sim_render-ego": 0.05672274936329235, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.0767414194164854, "deviation-heading": 3.033981639485521, "set_robot_commands": 0.09210118669452089, "deviation-center-line": 0.6609619226292217, "driven_lanedir_consec": 0.8948963750101038, "sim_compute_sim_state": 0.0363263953815807, "sim_compute_performance-ego": 0.06292076688824277, "sim_compute_robot_state-ego": 0.0684210170399059, "sim_compute_robot_state-npc0": 0.0639849735028816, "sim_compute_robot_state-npc1": 0.06310804684956868, "sim_compute_robot_state-npc2": 0.06313592014890729, "sim_compute_robot_state-npc3": 0.0649055899995746}, "udem1-6-0": {"driven_any": 0.5811694626271902, "sim_physics": 0.18444661852679675, "survival_time": 3.949999999999994, "driven_lanedir": 0.5593614559296691, "sim_render-ego": 0.05358939532992206, "in-drivable-lane": 0, "agent_compute-ego": 0.06957604311689546, "deviation-heading": 0.9356330840031925, "set_robot_commands": 0.08376103413255909, "deviation-center-line": 0.3482025183979379, "driven_lanedir_consec": 0.5593614559296691, "sim_compute_sim_state": 0.0346047636828845, "sim_compute_performance-ego": 0.05922864660432067, "sim_compute_robot_state-ego": 0.06291954426825801, "sim_compute_robot_state-npc0": 0.06094513965558402, "sim_compute_robot_state-npc1": 0.05768764471705956, "sim_compute_robot_state-npc2": 0.06205699715433242, "sim_compute_robot_state-npc3": 0.05818328676344473}, "udem1-7-0": {"driven_any": 0.460624214062678, "sim_physics": 0.2109521776437759, "survival_time": 3.1999999999999966, "driven_lanedir": 0.39532698668362554, "sim_render-ego": 0.0590323731303215, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08621493726968765, "deviation-heading": 1.3719806522425673, "set_robot_commands": 0.09627436473965643, "deviation-center-line": 0.17001474635227046, "driven_lanedir_consec": 0.39532698668362554, "sim_compute_sim_state": 0.035090189427137375, "sim_compute_performance-ego": 0.06352606043219566, "sim_compute_robot_state-ego": 0.06833566725254059, "sim_compute_robot_state-npc0": 0.06409579142928123, "sim_compute_robot_state-npc1": 0.06382342427968979, "sim_compute_robot_state-npc2": 0.062078360468149185, "sim_compute_robot_state-npc3": 0.06378058716654778}, "udem1-8-0": {"driven_any": 2.348467341502636, "sim_physics": 0.142373952070872, "survival_time": 14.950000000000076, "driven_lanedir": 1.4329922513757802, "sim_render-ego": 0.05170242627461751, "in-drivable-lane": 2.150000000000012, "agent_compute-ego": 0.08349217335383097, "deviation-heading": 8.583046091271532, "set_robot_commands": 0.08146457354227701, "deviation-center-line": 1.2733904229993025, "driven_lanedir_consec": 0.7262616741257282, "sim_compute_sim_state": 0.029741485118865967, "sim_compute_performance-ego": 0.05571115414301554, "sim_compute_robot_state-ego": 0.059183952808380125, "sim_compute_robot_state-npc0": 0.059325060844421386, "sim_compute_robot_state-npc1": 0.05385037422180176, "sim_compute_robot_state-npc2": 0.053795212109883625, "sim_compute_robot_state-npc3": 0.05558171113332112}, "udem1-9-0": {"driven_any": 0.4285038305561734, "sim_physics": 0.18457345565160116, "survival_time": 2.9999999999999973, "driven_lanedir": 0.407358669494118, "sim_render-ego": 0.059250863393147786, "in-drivable-lane": 0, "agent_compute-ego": 0.08022214571634928, "deviation-heading": 0.8736804530965162, "set_robot_commands": 0.0965715726216634, "deviation-center-line": 0.22757877509964264, "driven_lanedir_consec": 0.407358669494118, "sim_compute_sim_state": 0.03549201885859172, "sim_compute_performance-ego": 0.06245816151301066, "sim_compute_robot_state-ego": 0.06396828889846802, "sim_compute_robot_state-npc0": 0.06799770593643188, "sim_compute_robot_state-npc1": 0.06806023915608723, "sim_compute_robot_state-npc2": 0.06860224803288778, "sim_compute_robot_state-npc3": 0.06833153565724691}, "udem1-10-0": {"driven_any": 0.46869113670980667, "sim_physics": 0.1128424204312838, "survival_time": 3.2499999999999964, "driven_lanedir": 0.4507702310295232, "sim_render-ego": 0.04079136114854079, "in-drivable-lane": 0, "agent_compute-ego": 0.24161884234501765, "deviation-heading": 0.886992531874861, "set_robot_commands": 0.06546330085167518, "deviation-center-line": 0.24744964518805604, "driven_lanedir_consec": 0.4507702310295232, "sim_compute_sim_state": 0.024173919971172627, "sim_compute_performance-ego": 0.04704617720383864, "sim_compute_robot_state-ego": 0.05179451428926908, "sim_compute_robot_state-npc0": 0.0441100524022029, "sim_compute_robot_state-npc1": 0.042833625353299654, "sim_compute_robot_state-npc2": 0.045107357318584736, "sim_compute_robot_state-npc3": 0.04273866873521071}, "udem1-11-0": {"driven_any": 0.20349070183926316, "sim_physics": 0.12495473772287367, "survival_time": 1.6000000000000008, "driven_lanedir": 0.18106628933605373, "sim_render-ego": 0.04359949380159378, "in-drivable-lane": 0, "agent_compute-ego": 0.18186714500188828, "deviation-heading": 0.5175362364662001, "set_robot_commands": 0.06972280144691467, "deviation-center-line": 0.14102636216211883, "driven_lanedir_consec": 0.18106628933605373, "sim_compute_sim_state": 0.0260784849524498, "sim_compute_performance-ego": 0.04724836349487305, "sim_compute_robot_state-ego": 0.05915434658527374, "sim_compute_robot_state-npc0": 0.052577368915081024, "sim_compute_robot_state-npc1": 0.04639821499586105, "sim_compute_robot_state-npc2": 0.04488787800073624, "sim_compute_robot_state-npc3": 0.046286530792713165}, "udem1-12-0": {"driven_any": 0.27577950913913835, "sim_physics": 0.1250450611114502, "survival_time": 2.0500000000000007, "driven_lanedir": 0.19110869321005364, "sim_render-ego": 0.03947081798460425, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06261400478642161, "deviation-heading": 1.0325937110268504, "set_robot_commands": 0.06323004350429628, "deviation-center-line": 0.1152433480533158, "driven_lanedir_consec": 0.19110869321005364, "sim_compute_sim_state": 0.030489671521070526, "sim_compute_performance-ego": 0.0402726312962974, "sim_compute_robot_state-ego": 0.04306508855121892, "sim_compute_robot_state-npc0": 0.0442811279762082, "sim_compute_robot_state-npc1": 0.04219837305022449, "sim_compute_robot_state-npc2": 0.04280889325025605, "sim_compute_robot_state-npc3": 0.041678858966362184}, "udem1-13-0": {"driven_any": 0.21153554398008595, "sim_physics": 0.1846191305102724, "survival_time": 1.6500000000000008, "driven_lanedir": 0.17905962998745073, "sim_render-ego": 0.07665844397111372, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07959396188909357, "deviation-heading": 0.5877706564217174, "set_robot_commands": 0.09838487885215064, "deviation-center-line": 0.14393743159846925, "driven_lanedir_consec": 0.17905962998745073, "sim_compute_sim_state": 0.03747612057310162, "sim_compute_performance-ego": 0.06746131723577325, "sim_compute_robot_state-ego": 0.07164388714414655, "sim_compute_robot_state-npc0": 0.06579070380239775, "sim_compute_robot_state-npc1": 0.06699633598327637, "sim_compute_robot_state-npc2": 0.06595048037442294, "sim_compute_robot_state-npc3": 0.06554309527079265}, "udem1-14-0": {"driven_any": 2.348804299619687, "sim_physics": 0.20435812711715695, "survival_time": 14.950000000000076, "driven_lanedir": 1.688858707432841, "sim_render-ego": 0.0639841341972351, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.07971874872843425, "deviation-heading": 5.150754883863415, "set_robot_commands": 0.09638004144032795, "deviation-center-line": 0.8741471839852856, "driven_lanedir_consec": 1.5172135417665644, "sim_compute_sim_state": 0.0395605484644572, "sim_compute_performance-ego": 0.06836721340815226, "sim_compute_robot_state-ego": 0.07512989362080892, "sim_compute_robot_state-npc0": 0.0697118353843689, "sim_compute_robot_state-npc1": 0.07023294766743977, "sim_compute_robot_state-npc2": 0.0707899022102356, "sim_compute_robot_state-npc3": 0.07031379699707031}}
set_robot_commands_max	0.10034559190887764
set_robot_commands_mean	0.08667811500936987
set_robot_commands_median	0.0901300405201159
set_robot_commands_min	0.06323004350429628
sim_compute_performance-ego_max	0.06836721340815226
sim_compute_performance-ego_mean	0.05843897617431349
sim_compute_performance-ego_median	0.06060313455986254
sim_compute_performance-ego_min	0.0402726312962974
sim_compute_robot_state-ego_max	0.07512989362080892
sim_compute_robot_state-ego_mean	0.063950859100285
sim_compute_robot_state-ego_median	0.06655605049694285
sim_compute_robot_state-ego_min	0.04306508855121892
sim_compute_robot_state-npc0_max	0.0697118353843689
sim_compute_robot_state-npc0_mean	0.0606925372032144
sim_compute_robot_state-npc0_median	0.06325784150291891
sim_compute_robot_state-npc0_min	0.0441100524022029
sim_compute_robot_state-npc1_max	0.07023294766743977
sim_compute_robot_state-npc1_mean	0.059010646499211485
sim_compute_robot_state-npc1_median	0.06097137402085697
sim_compute_robot_state-npc1_min	0.04219837305022449
sim_compute_robot_state-npc2_max	0.0707899022102356
sim_compute_robot_state-npc2_mean	0.059444237435101695
sim_compute_robot_state-npc2_median	0.06205699715433242
sim_compute_robot_state-npc2_min	0.04280889325025605
sim_compute_robot_state-npc3_max	0.07031379699707031
sim_compute_robot_state-npc3_mean	0.05922508653042145
sim_compute_robot_state-npc3_median	0.06216960093554329
sim_compute_robot_state-npc3_min	0.041678858966362184
sim_compute_sim_state_max	0.0395605484644572
sim_compute_sim_state_mean	0.03337084510033221
sim_compute_sim_state_median	0.0346047636828845
sim_compute_sim_state_min	0.024173919971172627
sim_physics_max	0.2119223159902236
sim_physics_mean	0.17532176587596932
sim_physics_median	0.18457345565160116
sim_physics_min	0.1128424204312838
sim_render-ego_max	0.07665844397111372
sim_render-ego_mean	0.05577209478791463
sim_render-ego_median	0.0572181010947508
sim_render-ego_min	0.03947081798460425
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.916666666666674
survival_time_min	1.6000000000000008

No reset possible

20832

3074

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 13:27:33+00:00

2019-04-27 14:00:11+00:00

0:32:38

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3074/step1-simulation-ip-172-31-25-98-2470-job20832/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20803

3099

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 13:00:20+00:00

2019-04-27 13:27:08+00:00

0:26:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6673926033653608
survival_time_median	12.800000000000049
deviation-center-line_median	0.5421785000599525
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.21800167206674817
agent_compute-ego_mean	0.2086101362087669
agent_compute-ego_median	0.20812702496846516
agent_compute-ego_min	0.2006070772806803
deviation-center-line_max	1.029526373811693
deviation-center-line_mean	0.7187498089493684
deviation-center-line_min	0.49393680820063457
deviation-heading_max	3.503978687423172
deviation-heading_mean	1.8020063395983612
deviation-heading_median	1.2346838887513645
deviation-heading_min	1.2055103296779797
driven_any_max	1.2107249085455207
driven_any_mean	0.880591969464842
driven_any_median	1.0214591896119425
driven_any_min	0.461231439551775
driven_lanedir_consec_max	1.185788861164586
driven_lanedir_consec_mean	0.7938388180496239
driven_lanedir_consec_min	0.4513841238625794
driven_lanedir_max	1.185788861164586
driven_lanedir_mean	0.7938388180496239
driven_lanedir_median	0.6673926033653608
driven_lanedir_min	0.4513841238625794
in-drivable-lane_max	3.300000000000047
in-drivable-lane_mean	0.6600000000000094
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0214591896119425, "sim_physics": 0.1744283977895975, "survival_time": 12.800000000000049, "driven_lanedir": 0.6673926033653608, "sim_render-ego": 0.06112244445830584, "in-drivable-lane": 3.300000000000047, "agent_compute-ego": 0.21800167206674817, "deviation-heading": 3.503978687423172, "set_robot_commands": 0.09895479585975409, "deviation-center-line": 0.5421785000599525, "driven_lanedir_consec": 0.6673926033653608, "sim_compute_sim_state": 0.038721710443496704, "sim_compute_performance-ego": 0.06881040893495083, "sim_compute_robot_state-ego": 0.07334079872816801, "sim_compute_robot_state-npc0": 0.07165845856070518, "sim_compute_robot_state-npc1": 0.06973998621106148, "sim_compute_robot_state-npc2": 0.06926167290657759, "sim_compute_robot_state-npc3": 0.06859475653618574}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5045304362436069, "sim_physics": 0.18007962278617445, "survival_time": 6.449999999999985, "driven_lanedir": 0.48296138055393634, "sim_render-ego": 0.06099617943283199, "in-drivable-lane": 0, "agent_compute-ego": 0.21242930537970492, "deviation-heading": 1.833376631711614, "set_robot_commands": 0.09087840531223504, "deviation-center-line": 0.5167056529544489, "driven_lanedir_consec": 0.48296138055393634, "sim_compute_sim_state": 0.03757817615834318, "sim_compute_performance-ego": 0.0670489507128102, "sim_compute_robot_state-ego": 0.07309800340223682, "sim_compute_robot_state-npc0": 0.06798935121344041, "sim_compute_robot_state-npc1": 0.06975629532984061, "sim_compute_robot_state-npc2": 0.0667254370312358, "sim_compute_robot_state-npc3": 0.06741241336792939}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2107249085455207, "sim_physics": 0.1537655528386434, "survival_time": 14.950000000000076, "driven_lanedir": 1.185788861164586, "sim_render-ego": 0.058699785868326824, "in-drivable-lane": 0, "agent_compute-ego": 0.2006070772806803, "deviation-heading": 1.2324821604276772, "set_robot_commands": 0.08829251607259114, "deviation-center-line": 1.029526373811693, "driven_lanedir_consec": 1.185788861164586, "sim_compute_sim_state": 0.03613217035929362, "sim_compute_performance-ego": 0.06444193998972575, "sim_compute_robot_state-ego": 0.06911116043726603, "sim_compute_robot_state-npc0": 0.06534013032913208, "sim_compute_robot_state-npc1": 0.06481738408406576, "sim_compute_robot_state-npc2": 0.06368811209996542, "sim_compute_robot_state-npc3": 0.06379419962565104}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.205013873371365, "sim_physics": 0.1570953098932902, "survival_time": 14.950000000000076, "driven_lanedir": 1.1816671213016567, "sim_render-ego": 0.0612569801012675, "in-drivable-lane": 0, "agent_compute-ego": 0.20812702496846516, "deviation-heading": 1.2055103296779797, "set_robot_commands": 0.09075628598531088, "deviation-center-line": 1.0114017097201122, "driven_lanedir_consec": 1.1816671213016567, "sim_compute_sim_state": 0.03713268200556437, "sim_compute_performance-ego": 0.0661097272237142, "sim_compute_robot_state-ego": 0.07279996951421101, "sim_compute_robot_state-npc0": 0.06718862295150757, "sim_compute_robot_state-npc1": 0.06573721567789713, "sim_compute_robot_state-npc2": 0.06580589850743612, "sim_compute_robot_state-npc3": 0.06576267719268798}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.461231439551775, "sim_physics": 0.14926430758307965, "survival_time": 5.949999999999987, "driven_lanedir": 0.4513841238625794, "sim_render-ego": 0.05698318842078457, "in-drivable-lane": 0, "agent_compute-ego": 0.20388560134823583, "deviation-heading": 1.2346838887513645, "set_robot_commands": 0.10467592207323605, "deviation-center-line": 0.49393680820063457, "driven_lanedir_consec": 0.4513841238625794, "sim_compute_sim_state": 0.03722043598399443, "sim_compute_performance-ego": 0.06429958744209353, "sim_compute_robot_state-ego": 0.0671003185400442, "sim_compute_robot_state-npc0": 0.06789922113178157, "sim_compute_robot_state-npc1": 0.06718397741558171, "sim_compute_robot_state-npc2": 0.07115396130986575, "sim_compute_robot_state-npc3": 0.06760288486961558}}
set_robot_commands_max	0.10467592207323605
set_robot_commands_mean	0.09471158506062542
set_robot_commands_median	0.09087840531223504
set_robot_commands_min	0.08829251607259114
sim_compute_performance-ego_max	0.06881040893495083
sim_compute_performance-ego_mean	0.0661421228606589
sim_compute_performance-ego_median	0.0661097272237142
sim_compute_performance-ego_min	0.06429958744209353
sim_compute_robot_state-ego_max	0.07334079872816801
sim_compute_robot_state-ego_mean	0.07109005012438521
sim_compute_robot_state-ego_median	0.07279996951421101
sim_compute_robot_state-ego_min	0.0671003185400442
sim_compute_robot_state-npc0_max	0.07165845856070518
sim_compute_robot_state-npc0_mean	0.06801515683731336
sim_compute_robot_state-npc0_median	0.06789922113178157
sim_compute_robot_state-npc0_min	0.06534013032913208
sim_compute_robot_state-npc1_max	0.06975629532984061
sim_compute_robot_state-npc1_mean	0.06744697174368934
sim_compute_robot_state-npc1_median	0.06718397741558171
sim_compute_robot_state-npc1_min	0.06481738408406576
sim_compute_robot_state-npc2_max	0.07115396130986575
sim_compute_robot_state-npc2_mean	0.06732701637101612
sim_compute_robot_state-npc2_median	0.0667254370312358
sim_compute_robot_state-npc2_min	0.06368811209996542
sim_compute_robot_state-npc3_max	0.06859475653618574
sim_compute_robot_state-npc3_mean	0.06663338631841395
sim_compute_robot_state-npc3_median	0.06741241336792939
sim_compute_robot_state-npc3_min	0.06379419962565104
sim_compute_sim_state_max	0.038721710443496704
sim_compute_sim_state_mean	0.03735703499013846
sim_compute_sim_state_median	0.03722043598399443
sim_compute_sim_state_min	0.03613217035929362
sim_physics_max	0.18007962278617445
sim_physics_mean	0.16292663817815706
sim_physics_median	0.1570953098932902
sim_physics_min	0.14926430758307965
sim_render-ego_max	0.0612569801012675
sim_render-ego_mean	0.059811715656303346
sim_render-ego_median	0.06099617943283199
sim_render-ego_min	0.05698318842078457
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.020000000000037
survival_time_min	5.949999999999987

No reset possible

20800

3054

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-27 12:42:10+00:00

2019-04-27 13:00:07+00:00

0:17:57

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3054/step1-simulation-ip-172-31-25-98-2470-job20800/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20785

3103

Angel Woo 🇭🇰

HKU Duckietown Project

step1-simulation

success

2019-04-27 12:02:43+00:00

2019-04-27 12:41:38+00:00

0:38:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4594429411452281
survival_time_median	14.950000000000076
deviation-center-line_median	0.4854877083315773
in-drivable-lane_median	4.600000000000065

other stats

agent_compute-ego_max	0.22551917758854953
agent_compute-ego_mean	0.21617417259744723
agent_compute-ego_median	0.21868364095687867
agent_compute-ego_min	0.2006428798039754
deviation-center-line_max	1.154986188134422
deviation-center-line_mean	0.6304855025691479
deviation-center-line_min	0.39486237912836153
deviation-heading_max	2.999058020413387
deviation-heading_mean	2.496778192773891
deviation-heading_median	2.3112550378100507
deviation-heading_min	2.2707263826074904
driven_any_max	0.954938519777668
driven_any_mean	0.908196385443264
driven_any_median	0.934383890819042
driven_any_min	0.8390832070754263
driven_lanedir_consec_max	0.92035349907647
driven_lanedir_consec_mean	0.5769361768324124
driven_lanedir_consec_min	0.4500940681079544
driven_lanedir_max	0.92035349907647
driven_lanedir_mean	0.60810095177303
driven_lanedir_median	0.5999842939956048
driven_lanedir_min	0.4500940681079544
in-drivable-lane_max	6.000000000000079
in-drivable-lane_mean	4.160000000000054
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.934383890819042, "sim_physics": 0.18895543654759725, "survival_time": 14.950000000000076, "driven_lanedir": 0.6106299565398932, "sim_render-ego": 0.058832817872365314, "in-drivable-lane": 4.550000000000055, "agent_compute-ego": 0.2006428798039754, "deviation-heading": 2.6270609617087928, "set_robot_commands": 0.08888666788736979, "deviation-center-line": 1.154986188134422, "driven_lanedir_consec": 0.4548060818368049, "sim_compute_sim_state": 0.03609935363133748, "sim_compute_performance-ego": 0.06653531948725383, "sim_compute_robot_state-ego": 0.06931533575057984, "sim_compute_robot_state-npc0": 0.0661315147082011, "sim_compute_robot_state-npc1": 0.06666961352030436, "sim_compute_robot_state-npc2": 0.06385404825210571, "sim_compute_robot_state-npc3": 0.06632192373275757}, "udem1-1-0": {"driven_any": 0.954938519777668, "sim_physics": 0.20503058354059855, "survival_time": 14.950000000000076, "driven_lanedir": 0.5999842939956048, "sim_render-ego": 0.06601016441980997, "in-drivable-lane": 4.600000000000065, "agent_compute-ego": 0.21868364095687867, "deviation-heading": 2.999058020413387, "set_robot_commands": 0.09719072024027509, "deviation-center-line": 0.39486237912836153, "driven_lanedir_consec": 0.5999842939956048, "sim_compute_sim_state": 0.039455943902333576, "sim_compute_performance-ego": 0.07115166982014974, "sim_compute_robot_state-ego": 0.07644847790400187, "sim_compute_robot_state-npc0": 0.07154957214991252, "sim_compute_robot_state-npc1": 0.07100821336110433, "sim_compute_robot_state-npc2": 0.06979931831359863, "sim_compute_robot_state-npc3": 0.07019823392232259}, "udem1-2-0": {"driven_any": 0.8390832070754263, "sim_physics": 0.20192155241966248, "survival_time": 13.200000000000053, "driven_lanedir": 0.4500940681079544, "sim_render-ego": 0.06620218537070534, "in-drivable-lane": 5.650000000000071, "agent_compute-ego": 0.22551917758854953, "deviation-heading": 2.3112550378100507, "set_robot_commands": 0.09802768176252193, "deviation-center-line": 0.4758637144917616, "driven_lanedir_consec": 0.4500940681079544, "sim_compute_sim_state": 0.039586298393480705, "sim_compute_performance-ego": 0.07210530295516505, "sim_compute_robot_state-ego": 0.0769087907039758, "sim_compute_robot_state-npc0": 0.07208863352284287, "sim_compute_robot_state-npc1": 0.07244755101926399, "sim_compute_robot_state-npc2": 0.07114327495748346, "sim_compute_robot_state-npc3": 0.07085014021757877}, "udem1-3-0": {"driven_any": 0.8781561821915368, "sim_physics": 0.21541081466814027, "survival_time": 13.70000000000006, "driven_lanedir": 0.4594429411452281, "sim_render-ego": 0.06415313264749346, "in-drivable-lane": 6.000000000000079, "agent_compute-ego": 0.2167361391721851, "deviation-heading": 2.275790561329733, "set_robot_commands": 0.09610434083172877, "deviation-center-line": 0.4854877083315773, "driven_lanedir_consec": 0.4594429411452281, "sim_compute_sim_state": 0.041245736344887395, "sim_compute_performance-ego": 0.07074709530294376, "sim_compute_robot_state-ego": 0.07681074803763062, "sim_compute_robot_state-npc0": 0.07213694596812673, "sim_compute_robot_state-npc1": 0.0711413152026434, "sim_compute_robot_state-npc2": 0.07008476674991802, "sim_compute_robot_state-npc3": 0.07153763649237417}, "udem1-4-0": {"driven_any": 0.9344201273526468, "sim_physics": 0.20058246930440268, "survival_time": 14.950000000000076, "driven_lanedir": 0.92035349907647, "sim_render-ego": 0.06355549017588298, "in-drivable-lane": 0, "agent_compute-ego": 0.21928902546564735, "deviation-heading": 2.2707263826074904, "set_robot_commands": 0.0970490829149882, "deviation-center-line": 0.6412275227596173, "driven_lanedir_consec": 0.92035349907647, "sim_compute_sim_state": 0.03926803588867187, "sim_compute_performance-ego": 0.06900217533111572, "sim_compute_robot_state-ego": 0.07484644730885824, "sim_compute_robot_state-npc0": 0.07130619128545125, "sim_compute_robot_state-npc1": 0.07144750038782756, "sim_compute_robot_state-npc2": 0.06974717378616332, "sim_compute_robot_state-npc3": 0.07072126785914103}}
set_robot_commands_max	0.09802768176252193
set_robot_commands_mean	0.09545169872737674
set_robot_commands_median	0.0970490829149882
set_robot_commands_min	0.08888666788736979
sim_compute_performance-ego_max	0.07210530295516505
sim_compute_performance-ego_mean	0.06990831257932562
sim_compute_performance-ego_median	0.07074709530294376
sim_compute_performance-ego_min	0.06653531948725383
sim_compute_robot_state-ego_max	0.0769087907039758
sim_compute_robot_state-ego_mean	0.07486595994100928
sim_compute_robot_state-ego_median	0.07644847790400187
sim_compute_robot_state-ego_min	0.06931533575057984
sim_compute_robot_state-npc0_max	0.07213694596812673
sim_compute_robot_state-npc0_mean	0.0706425715269069
sim_compute_robot_state-npc0_median	0.07154957214991252
sim_compute_robot_state-npc0_min	0.0661315147082011
sim_compute_robot_state-npc1_max	0.07244755101926399
sim_compute_robot_state-npc1_mean	0.07054283869822872
sim_compute_robot_state-npc1_median	0.0711413152026434
sim_compute_robot_state-npc1_min	0.06666961352030436
sim_compute_robot_state-npc2_max	0.07114327495748346
sim_compute_robot_state-npc2_mean	0.06892571641185383
sim_compute_robot_state-npc2_median	0.06979931831359863
sim_compute_robot_state-npc2_min	0.06385404825210571
sim_compute_robot_state-npc3_max	0.07153763649237417
sim_compute_robot_state-npc3_mean	0.06992584044483482
sim_compute_robot_state-npc3_median	0.07072126785914103
sim_compute_robot_state-npc3_min	0.06632192373275757
sim_compute_sim_state_max	0.041245736344887395
sim_compute_sim_state_mean	0.0391310736321422
sim_compute_sim_state_median	0.039455943902333576
sim_compute_sim_state_min	0.03609935363133748
sim_physics_max	0.21541081466814027
sim_physics_mean	0.20238017129608027
sim_physics_median	0.20192155241966248
sim_physics_min	0.18895543654759725
sim_render-ego_max	0.06620218537070534
sim_render-ego_mean	0.06375075809725142
sim_render-ego_median	0.06415313264749346
sim_render-ego_min	0.058832817872365314
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.350000000000067
survival_time_min	13.200000000000053

No reset possible

20782

2973

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

error